Topologically Informed Atlas Learning. We present a new technique that enables manifold learning to accurately embed data manifolds that contain holes, without discarding any topological information. Manifold learning aims to embed high dimensional data into a lower dimensional Euclidean space by learning a coordinate chart, but it requires that the entire manifold can be embedded in a single chart. This is impossible for manifolds with holes. In such cases, it is necessary to learn an atlas a collection of charts that collectively cover the entire manifold. We begin with many small charts, and combine them in a bottom up approach, where charts are only combined if doing so will not introduce problematic topological features. When it is no longer possible to combine any charts, each chart is individually embedded with standard manifold learning techniques, completing the construction of the atlas. We show the efficacy of our method by constructing atlases for challenging synthetic manifolds learning human motion embeddings from motion capture data and learning kinematic models of articulated objects.


Cross Modal Generative Augmentation for Visual Question Answering. Data augmentation has been shown to effectively improve the performance of multimodal machine learning models. This paper introduces a generative model for data augmentation by leveraging the correlations among multiple modalities. Different from conventional data augmentation approaches that apply low level operations with deterministic heuristics, our method learns a generator that generates samples of the target modality conditioned on observed modalities in the variational auto encoder framework. Additionally, the proposed model is able to quantify the confidence of augmented data by its generative probability, and can be jointly optimised with a downstream task. Experiments on Visual Question Answering as downstream task demonstrate the effectiveness of the proposed generative model, which is able to improve strong UpDn based models to achieve state of the art performance.


REACH Refining Alloy Scenarios by Scope. Writing declarative models has numerous benefits, ranging from automated reasoning and correction of design level properties be fore systems are built, to automated testing and debugging of their implementations after they are built. Alloy is a declarative modeling language that is well suited for verifying system designs. A key strength of Alloy is its scenario finding toolset, the Analyzer, which allows users to explore all valid scenarios that adhere to the model's constraints up to a user provided scope. In Alloy, it is common for users to desire to first validate smaller scenarios, then once confident, move onto validating larger scenarios. However, the Analyzer only presents scenarios in the order they are discovered by the SAT solver. This paper presents Reach, an extension to the Analyzer which allows users to explore scenarios by size. Experimental results reveal Reach's enumeration improves performance while having the added benefit of maintaining a semi sorted ordering of scenarios for the user. Moreover, we highlight Reach's ability to improve the performance of Alloy's analysis when the user makes incremental changes to the scope of the enumeration.


Brain Inspired Deep Imitation Learning for Autonomous Driving Systems. Autonomous driving has attracted great attention from both academics and industries. To realise autonomous driving, Deep Imitation Learning (DIL) is treated as one of the most promising solutions, because it improves autonomous driving systems by automatically learning a complex mapping from human driving data, compared to manually designing the driving policy. However, existing DIL methods cannot generalise well across domains, that is, a network trained on the data of source domain gives rise to poor generalisation on the data of target domain. In the present study, we propose a novel brain inspired deep imitation method that builds on the evidence from human brain functions, to improve the generalisation ability of deep neural networks so that autonomous driving systems can perform well in various scenarios. Specifically, humans have a strong generalisation ability which is beneficial from the structural and functional asymmetry of the two sides of the brain. Here, we design dual Neural Circuit Policy (NCP) architectures in deep neural networks based on the asymmetry of human neural networks. Experimental results demonstrate that our brain inspired method outperforms existing methods regarding generalisation when dealing with unseen data. Our source codes and pretrained models are available at https github.com Intenzo21 Brain Inspired Deep Imitation Learning for Autonomous Driving Systems https github.com Intenzo21 Brain Inspired Deep Imitation Learning for Autonomous Driving Systems.


The Dirichlet problem for possibly singular elliptic equations with degenerate coercivity. We deal with existence, uniqueness and regularity of nonnegative solutions to a Dirichlet problem for equations as begin equation displaystyle operatorname div left( frac nabla u p 2 nabla u (1 u) theta(p 1) right) h(u)f quad text in Omega, end equation where Omega is an open bounded subset of mathbb R N ( N ge 2 ), p 1 , theta ge 0 , f geq 0 belongs to a suitable Lebesgue space and h is a continuous, nonnegative function which may blow up at zero and it is bounded at infinity.


On the Robustness of Controlled Deep Reinforcement Learning for Slice Placement. The evaluation of the impact of using Machine Learning in the management of softwarized networks is considered in multiple research works. Beyond that, we propose to evaluate the robustness of online learning for optimal network slice placement. A major assumption to this study is to consider that slice request arrivals are non stationary. In this context, we simulate unpredictable network load variations and compare two Deep Reinforcement Learning (DRL) algorithms a pure DRL based algorithm and a heuristically controlled DRL as a hybrid DRL heuristic algorithm, to assess the impact of these unpredictable changes of traffic load on the algorithms performance. We conduct extensive simulations of a large scale operator infrastructure. The evaluation results show that the proposed hybrid DRL heuristic approach is more robust and reliable in case of unpredictable network load changes than pure DRL as it reduces the performance degradation. These results are follow ups for a series of recent research we have performed showing that the proposed hybrid DRL heuristic approach is efficient and more adapted to real network scenarios than pure DRL.


Meta Reinforcement Learning for Adaptive Motor Control in Changing Robot Dynamics and Environments. This work developed a meta learning approach that adapts the control policy on the fly to different changing conditions for robust locomotion. The proposed method constantly updates the interaction model, samples feasible sequences of actions of estimated the state action trajectories, and then applies the optimal actions to maximize the reward. To achieve online model adaptation, our proposed method learns different latent vectors of each training condition, which are selected online given the newly collected data. Our work designs appropriate state space and reward functions, and optimizes feasible actions in an MPC fashion which are then sampled directly in the joint space considering constraints, hence requiring no prior design of specific walking gaits. We further demonstrate the robot's capability of detecting unexpected changes during interaction and adapting control policies quickly. The extensive validation on the SpotMicro robot in a physics simulation shows adaptive and robust locomotion skills under varying ground friction, external pushes, and different robot models including hardware faults and changes.


From (secure) w domination in graphs to protection of lexicographic product graphs. Let w (w 0,w 1, dots,w l) be a vector of nonnegative integers such that w 0 ge 1 . Let G be a graph and N(v) the open neighbourhood of v in V(G) . We say that a function f V(G) longrightarrow 0,1, dots ,l is a w dominating function if f(N(v)) sum u in N(v) f(u) ge w i for every vertex v with f(v) i . The weight of f is defined to be omega(f) sum v in V(G) f(v) . Given a w dominating function f and any pair of adjacent vertices v, u in V(G) with f(v) 0 and f(u) 0 , the function f u rightarrow v is defined by f u rightarrow v (v) 1 , f u rightarrow v (u) f(u) 1 and f u rightarrow v (x) f(x) for every x in V(G) setminus u,v . We say that a w dominating function f is a secure w dominating function if for every v with f(v) 0 , there exists u in N(v) such that f(u) 0 and f u rightarrow v is a w dominating function as well. The (secure) w domination number of G , denoted by ( gamma w s(G) ) gamma w (G) , is defined as the minimum weight among all (secure) w dominating functions. In this paper, we show how the secure (total) domination number and the (total) weak Roman domination number of lexicographic product graphs G circ H are related to gamma w s(G) or gamma w(G) . For the case of the secure domination number and the weak Roman domination number, the decision on whether w takes specific components will depend on the value of gamma (1,0) s(H) , while in the case of the total version of these parameters, the decision will depend on the value of gamma (1,1) s(H) .


Out of distribution detection in satellite image classification. In satellite image analysis, distributional mismatch between the training and test data may arise due to several reasons, including unseen classes in the test data and differences in the geographic area. Deep learning based models may behave in unexpected manner when subjected to test data that has such distributional shifts from the training data, also called out of distribution (OOD) examples. Predictive uncertainly analysis is an emerging research topic which has not been explored much in context of satellite image analysis. Towards this, we adopt a Dirichlet Prior Network based model to quantify distributional uncertainty of deep learning models for remote sensing. The approach seeks to maximize the representation gap between the in domain and OOD examples for a better identification of unknown examples at test time. Experimental results on three exemplary test scenarios show the efficacy of the model in satellite image analysis.


A Logical Programming Language as an Instrument for Specifying and Verifying Dynamic Memory. This work proposes a Prolog dialect for the found and prioritised problems on expressibility and automation. Given some given C like program, if dynamic memory is allocated, altered and freed on runtime, then a description of desired dynamic memory is a heap specification. The check of calculated memory state against a given specification is dynamic memory verification. This contribution only considers formal specification and verification in a Hoare calculus. Issues found include invalid assignment, (temporary) unavailable data in memory cells, excessive memory allocation, (accidental) heap alteration in unexpected regions and others. Excessive memory allocation is nowadays successfully resolved by memory analysers like Valgrind. Essentially, papers in those areas did not bring any big breakthrough. Possible reasons may also include the decrease of tension due to more available memory and parallel threads. However, starting with Apt, problems related to variable modes have not yet been resolved neither entirely nor in an acceptable way. Research contributions over the last decades show again and again that heap issues remain and remain complex and still important. A significant contribution was reached in 2016 by Peter O'Hearn, who accepted the G " o del prize for his parallel approach on a spatial heap operation.


Least squares Monte Carlo methods in stochastic Volterra rough volatility models. In stochastic Volterra rough volatility models, the volatility follows a truncated Brownian semi stationary process with stochastic vol of vol. Recently, efficient VIX pricing Monte Carlo methods have been proposed for the case where the vol of vol is Markovian and independent of the volatility. Following recent empirical data, we discuss the VIX option pricing problem for a generalized framework of these models, where the vol of vol may depend on the volatility and or not be Markovian. In such a setting, the aforementioned Monte Carlo methods are not valid. Moreover, the classical least squares Monte Carlo faces exponentially increasing complexity with the number of grid time steps, whilst the nested Monte Carlo method requires a prohibitive number of simulations. By exploring the infinite dimensional Markovian representation of these models, we device a scalable least squares Monte Carlo for VIX option pricing. We apply our method firstly under the independence assumption for benchmarks, and then to the generalized framework. We also discuss the rough vol of vol setting, where Markovianity of the vol of vol is not present. We present simulations and benchmarks to establish the efficiency of our method.


Culture inspired Multi modal Color Palette Generation and Colorization A Chinese Youth Subculture Case. Color is an essential component of graphic design, acting not only as a visual factor but also carrying cultural implications. However, existing research on algorithmic color palette generation and colorization largely ignores the cultural aspect. In this paper, we contribute to this line of research by first constructing a unique color dataset inspired by a specific culture, i.e., Chinese Youth Subculture (CYS), which is an vibrant and trending cultural group especially for the Gen Z population. We show that the colors used in CYS have special aesthetic and semantic characteristics that are different from generic color theory. We then develop an interactive multi modal generative framework to create CYS styled color palettes, which can be used to put a CYS twist on images using our automatic colorization model. Our framework is illustrated via a demo system designed with the human in the loop principle that constantly provides feedback to our algorithms. User studies are also conducted to evaluate our generation results.


Coin Flipping of emph Any Constant Bias Implies One Way Functions. We show that the existence of a coin flipping protocol safe against emph any non trivial constant bias ( eg .499 ) implies the existence of one way functions. This improves upon a recent result of Haitner and Omri FOCS '11 , who proved this implication for protocols with bias frac sqrt2 1 2 o(1) approx .207 . Unlike the result of Haitner and Omri, our result also holds for emph weak coin flipping protocols.


Adapting paths against zero determinant strategies in repeated prisoner's dilemma games. Long term cooperation, competition, or exploitation among individuals can be modeled through repeated games. In repeated games, Press and Dyson discovered zero determinant (ZD) strategies that enforce a special relationship between two players. This special relationship implies that a ZD player can unilaterally impose a linear payoff relationship to the opponent regardless of the opponent's strategies. A ZD player also has a property that can lead the opponent to an unconditional cooperation if the opponent tries to improve its payoff. This property has been mathematically confirmed by Chen and Zinger. Humans often underestimate a payoff obtained in the future. However, such discounting was not considered in their analysis. Here, we mathematically explored whether a ZD player can lead the opponent to an unconditional cooperation even if a discount factor is incorporated. Specifically, we represented the expected payoff with a discount factor as the form of determinants and calculated whether the values obtained by partially differentiating each factor in the strategy vector become positive. As a result, we proved that the strategy vector ends up as an unconditional cooperation even when starting from any initial strategy. This result was confirmed through numerical calculations. We extended the applicability of ZD strategies to real world problems.


On conic line arrangements with nodes, tacnodes, and ordinary triple points. In the present paper, we study conic line arrangements having nodes, tacnodes, and ordinary triple points as singularities. We provide combinatorial constraints on such arrangements and we give the complete classification of free arrangements in this class.


Leveraging Machine Learning to Detect Data Curation Activities. This paper describes a machine learning approach for annotating and analyzing data curation work logs at ICPSR, a large social sciences data archive. The systems we studied track curation work and coordinate team decision making at ICPSR. Repository staff use these systems to organize, prioritize, and document curation work done on datasets, making them promising resources for studying curation work and its impact on data reuse, especially in combination with data usage analytics. A key challenge, however, is classifying similar activities so that they can be measured and associated with impact metrics. This paper contributes 1) a schema of data curation activities 2) a computational model for identifying curation actions in work log descriptions and 3) an analysis of frequent data curation activities at ICPSR over time. We first propose a schema of data curation actions to help us analyze the impact of curation work. We then use this schema to annotate a set of data curation logs, which contain records of data transformations and project management decisions completed by repository staff. Finally, we train a text classifier to detect the frequency of curation actions in a large set of work logs. Our approach supports the analysis of curation work documented in work log systems as an important step toward studying the relationship between research data curation and data reuse.


Deep Learning Schemes For Parabolic Nonlocal Integro Differential Equations. In this paper we consider the numerical approximation of nonlocal integro differential parabolic equations via neural networks. These equations appear in many recent applications, including finance, biology and others, and have been recently studied in great generality starting from the work of Caffarelli and Silvestre. Based in the work by Hure, Pham and Warin, we generalize their Euler scheme and consistency result for Backward Forward Stochastic Differential Equations to the nonlocal case. We rely on L evy processes and a new neural network approximation of the nonlocal part to overcome the lack of a suitable good approximation of the nonlocal part of the solution.


Application of Reverse Engineering and Rapid Prototyping for Reconstruction of Human Mandible. Reconstruction of the mandible is one of the most common challenges facing maxillofacial surgeons. The mandible plays a major role in supporting the teeth inside the mouth. This work aims to develop a proposed methodology for improving reconstructive surgery by using the simulation of a mandibular defect using imaging, design, and fabrication techniques for a custom mandible. The combination of these technologies provides a powerful way to improve and implement the implant process through the design and fabrication of medical models. This work introduces a methodology that the capabilities of Reverse Engineering (RE), Computer Aided Design (CAD), and Rapid Prototyping Technology (RP) for the reconstruction of the mandible and representing the surgery. Patient examination using a high resolution technique represented by Cone beam computed tomography (CBCT), after which a representative digital model of the patient is created to assist in the design process using the 3DSlicer software The patient's implant designed (Defect part) and analyzed using Solidwork.3D models are assembled and implant simulations are performed by (Meshmixer) software, Stereolithography technology (SLA) used as 3D printing technology to fabricate the mandible model the resin. The results of this work show that procedures for mandible reconstruction can be successfully used using the integration of RE CAD RP technologies. This integration will support the acceptable symmetry of the face that will be restored by assisting surgeons in planning reconstruction. This work demonstrates the importance of the CAD system in resolving patient damage requirements directly from medical imaging data, as well as the efficiency of RP techniques used in converting 3D model designs into implant models.


Strong coupling regime and hybrid quasinormal modes of a single plasmonic resonator coupled to a TMDC monolayer. We present a rigorous photonic mode model to describe the strong coupling between a monolayer of rm MoSe 2 and a single gold nanoparticle. The onset of strong coupling is quantified by computing the three dimensional hybrid quasinormal modes of the combined structure, allowing one to accurately model light matter interactions without invoking the usual phenomenological theories of strong coupling. We explore the hybrid quasinormal modes as a function of gap size and temperature and find spectral splittings in the range of around 80 110 meV, with no fitting parameters for the material models. We also show how the hybrid modes exhibit Fano like resonances and quantify the complex poles of the hybrid modes as well as the Purcell factor resonances from embedded dipole emitters. These effects cannot be described with the usual heuristic normal mode theories.


Improving Accountability in Recommender Systems Research Through Reproducibility. Reproducibility is a key requirement for scientific progress. It allows the reproduction of the works of others, and, as a consequence, to fully trust the reported claims and results. In this work, we argue that, by facilitating reproducibility of recommender systems experimentation, we indirectly address the issues of accountability and transparency in recommender systems research from the perspectives of practitioners, designers, and engineers aiming to assess the capabilities of published research works. These issues have become increasingly prevalent in recent literature. Reasons for this include societal movements around intelligent systems and artificial intelligence striving towards fair and objective use of human behavioral data (as in Machine Learning, Information Retrieval, or Human Computer Interaction). Society has grown to expect explanations and transparency standards regarding the underlying algorithms making automated decisions for and around us. This work surveys existing definitions of these concepts, and proposes a coherent terminology for recommender systems research, with the goal to connect reproducibility to accountability. We achieve this by introducing several guidelines and steps that lead to reproducible and, hence, accountable experimental workflows and research. We additionally analyze several instantiations of recommender system implementations available in the literature, and discuss the extent to which they fit in the introduced framework. With this work, we aim to shed light on this important problem, and facilitate progress in the field by increasing the accountability of research.


Generalised quasilinear approximations of turbulent channel flow Part 2. Spanwise scale interactions. Continuing from Part 1 (Hern 'andez emph et al. , emph arXiv 2108.12395 , 2021), a generalized quasilinear (GQL) approximation is studied in turbulent channel flow using a flow decomposition defined with spanwise Fourier modes the flow is decomposed into a set of low wavenumber spanwise Fourier modes and the rest high wavenumber modes. This decomposition leads to the nonlinear low wavenumber group that supports the self sustaining process within the given integral length scales, whereas the linearised high wavenumber group is not able to do so, unlike the GQL models in Part 1 which place a minimal mathematical description for the self sustaining process across all integral scales. Despite the important physical difference, it is shown that the GQL models in this study share some similarities with those in Part 1 i.e. the reduced multi scale behaviour and anisotropic turbulent fluctuations. Furthermore, despite not being able to support the self sustaining process in the high wavenumber group, the GQL models in the present study are found to reproduce some key statistical features in the high wavenumber group solely through the scattering' mechanism proposed by previous studies. Finally, using the nature of the GQL approximation, a set of numerical experiments suppressing certain triadic nonlinear interactions are further carried out. This unveils some key roles played by the certain types of triadic interactions including energy cascade and inverse energy transfer in the near wall region. In particular, the inhibition of inverse energy transfer in the spanwise direction leads to suppression of the near wall positive turbulent transport at large scales.


Graphical translators for anisotropic and crystalline mean curvature flow. In this paper we discuss existence, uniqueness and some properties of a class of solitons to the anisotropic mean curvature flow, i.e., graphical translators, either in the plane or under an assumption of cylindrical symmetry on the anisotropy and the mobility. In these cases, the equation becomes an ordinary differential equation, and this allows to find explicitly the translators and describe their main features.


Calibrating quantum hydrodynamic model for noble metals in nanoplasmonics. Quantum hydrodynamic model (QHDM) has become a versatile and efficient tool for studying plasmonics at the nanoscopic length scale. Yet its application to noble metals has not been sufficiently justified, in particular for situations where the metallic structures interface with dielectric material and electrons spill over the interfaces. In a recent work, we developed a refined QHDM, where the near field effects and static polarization of metal ion lattice, and the electron affinity and static permittivity of the dielectric are incorporated. Here we perform a careful calibration of the model parameters for the refined QHDM. The model parameters are determined by benchmarking with (time dependent) density functional theory calculations for special cases of simple metal. The predictive power of the refined QHDM with calibrated model parameters is faithfully demonstrated by the calculations of the optical responses from gold nanomatryoshkas of different sizes. The refined QHDM approach allows the quasinormal mode analysis for revealing the intrinsic optical properties of the nanoscopic metallic structures. We expect the well calibrated refined QHDM would provide the nanoplasmonics community with a useful tool.


Edge partitions of the complete graph and a determinant like function. In this paper we prove the case dim(V 3) 3 of a conjecture about the exterior operad Lambda S 2 V d . For this we introduce a collection of natural involutions on the set of homogeneous cycle free d partitions of the complete graph K 2d , and show that these involutions correspond to the relations in Lambda S 2 V d (2d 1) . When d 3 this correspondence allows us to give an explicit description of a determinant like map and to settle the above mentioned conjecture.


Mission Impossible Securing Master Keys. Securing a secret master key is a non trivial task, we even argue it is impossible to fully secure it, hence we must make it as difficult as possible for any powerful adversary to steal or use the key. We introduce the reader to interesting cryptography which is starting to get more attention in terms of addressing the above problem, and we briefly overview some commercial and open source products that can be used. Finally, we propose a set of solutions on how to secure master keys, more as guidelines rather than exact technical specifications, with aim to inspire and raise awareness of how to increase the security as much as possible.


Nalin Learning from Runtime Behavior to Find Name Value Inconsistencies in Jupyter Notebooks. Variable names are important to understand and maintain code. If a variable name and the value stored in the variable do not match, then the program suffers from a name value inconsistency, which is due to one of two situations that developers may want to fix Either a correct value is referred to through a misleading name, which negatively affects code understandability and maintainability, or the correct name is bound to a wrong value, which may cause unexpected runtime behavior. Finding name value inconsistencies is hard because it requires an understanding of the meaning of names and knowledge about the values assigned to a variable at runtime. This paper presents Nalin, a technique to automatically detect name value inconsistencies. The approach combines a dynamic analysis that tracks assignments of values to names with a neural machine learning model that predicts whether a name and a value fit together. To the best of our knowledge, this is the first work to formulate the problem of finding coding issues as a classification problem over names and runtime values. We apply Nalin to 106,652 real world Python programs, where meaningful names are particularly important due to the absence of statically declared types. Our results show that the classifier detects name value inconsistencies with high accuracy, that the warnings reported by Nalin have a precision of 80 and a recall of 76 w.r.t. a ground truth created in a user study, and that our approach complements existing techniques for finding coding issues.


Low lying zeros of symmetric power L functions weighted by symmetric square L values. For a totally real number field F and its ad ele ring mathbb A F , let pi vary in the set of irreducible cuspidal automorphic representations of rm PGL 2( mathbb A F) corresponding to primitive Hilbert modular forms of a fixed weight. Then, we determine the symmetry type of the one level density of low lying zeros of the symmetric power L functions L(s, rm Sym r( pi)) weighted by special values of symmetric square L functions L( frac z 1 2 , rm Sym 2( pi)) at z in 0, 1 in the level aspect. If 0 z le 1 , our weighted density in the level aspect has the same symmetry type as Ricotta and Royer's density of low lying zeros of symmetric power L functions for F mathbb Q with harmonic weight. Hence our result is regarded as a z interpolation of Ricotta and Royer's result. If z 0 , density of low lying zeros weighted by central values is a different type only when r 2 , and it does not appear in random matrix theory as Katz and Sarnak predicted. Moreover, we propose a conjecture on weighted density of low lying zeros of L functions by special L values. In the latter part, Appendices A, B and C are dedicated to the comparison among several generalizations of Zagier's parameterized trace formula. We prove that the explicit Jacquet Zagier type trace formula (the ST trace formula) by Tsuzuki and the author recovers all of Zagier's, Takase's and Mizumoto's formulas by specializing several data. Such comparison is not so straightforward and includes non trivial analytic evaluations.


Optical Frequency Comb Fourier Transform Spectroscopy of 14 N 2 16 O at 7.8 mu m. We use a Fourier transform spectrometer based on a compact mid infrared difference frequency generation comb source to perform broadband high resolution measurements of nitrous oxide, 14 N 2 16 O, and retrieve line center frequencies of the nu 1 fundamental band and the nu 1 nu 2 nu 2 hot band. The spectrum spans 90 cm 1 around 1285 cm 1 with a sample point spacing of 3 times 10 4 cm 1 (9 MHz). We report line positions of 72 lines in the nu 1 fundamental band between P(37) and R(38), and 112 lines in the nu 1 nu 2 nu 2 hot band (split into two components with e f rotationless parity) between P(34) and R(33), with uncertainties in the range of 90 600 kHz. We derive upper state constants of both bands from a fit of the effective ro vibrational Hamiltonian to the line center positions. For the fundamental band, we observe excellent agreement in the retrieved line positions and upper state constants with those reported in a recent study by AlSaif et al. using a comb referenced quantum cascade laser J Quant Spectrosc Radiat Transf, 2018 211 172 178 . We determine the origin of the hot band with precision one order of magnitude better than previous work based on FTIR measurements by Toth http mark4sun.jpl.nasa.gov n2o.html , which is the source of the HITRAN2016 data for these bands.


Structural Connectome Atlas Construction in the Space of Riemannian Metrics. The structural connectome is often represented by fiber bundles generated from various types of tractography. We propose a method of analyzing connectomes by representing them as a Riemannian metric, thereby viewing them as points in an infinite dimensional manifold. After equipping this space with a natural metric structure, the Ebin metric, we apply object oriented statistical analysis to define an atlas as the Fr 'echet mean of a population of Riemannian metrics. We demonstrate connectome registration and atlas formation using connectomes derived from diffusion tensors estimated from a subset of subjects from the Human Connectome Project.


Variational Autoencoders A Hands Off Approach to Volatility. A volatility surface is an important tool for pricing and hedging derivatives. The surface shows the volatility that is implied by the market price of an option on an asset as a function of the option's strike price and maturity. Often, market data is incomplete and it is necessary to estimate missing points on partially observed surfaces. In this paper, we show how variational autoencoders can be used for this task. The first step is to derive latent variables that can be used to construct synthetic volatility surfaces that are indistinguishable from those observed historically. The second step is to determine the synthetic surface generated by our latent variables that fits available data as closely as possible. As a dividend of our first step, the synthetic surfaces produced can also be used in stress testing, in market simulators for developing quantitative investment strategies, and for the valuation of exotic options. We illustrate our procedure and demonstrate its power using foreign exchange market data.


Learning and Generalization in Overparameterized Normalizing Flows. In supervised learning, it is known that overparameterized neural networks with one hidden layer provably and efficiently learn and generalize, when trained using stochastic gradient descent with a sufficiently small learning rate and suitable initialization. In contrast, the benefit of overparameterization in unsupervised learning is not well understood. Normalizing flows (NFs) constitute an important class of models in unsupervised learning for sampling and density estimation. In this paper, we theoretically and empirically analyze these models when the underlying neural network is a one hidden layer overparametrized network. Our main contributions are two fold (1) On the one hand, we provide theoretical and empirical evidence that for constrained NFs (this class of NFs underlies many NF constructions) with the one hidden layer network, overparametrization hurts training. (2) On the other hand, we prove that unconstrained NFs, a recently introduced model, can efficiently learn any reasonable data distribution under minimal assumptions when the underlying network is overparametrized and has one hidden layer.


IPC GraspSim Reducing the Sim2Real Gap for Parallel Jaw Grasping with the Incremental Potential Contact Model. Accurately simulating whether an object will be lifted securely or dropped during grasping is a longstanding Sim2Real challenge. Soft compliant jaw tips are almost universally used with parallel jaw robot grippers due to their ability to increase contact area and friction between the jaws and the object to be manipulated. However, interactions between the compliant surfaces and rigid objects are notoriously difficult to model. We introduce IPC GraspSim, a novel grasp simulator that extends Incremental Potential Contact (IPC) a highly accurate collision deformation model developed in 2020 for computer graphics. IPC GraspSim models both the dynamics and the deformation of compliant jaw tips to reduce Sim2Real gap for robot grasping. We evaluate IPC GraspSim using a set of 2,000 physical grasps across 16 adversarial objects where analytic models perform poorly. In comparison to both analytic quasistatic contact models (soft point contact, REACH, 6DFC) and dynamic grasp simulators (Isaac Gym with FleX), results suggest IPC GraspSim can predict robustness with higher precision and recall (F1 0.85). IPC GraspSim increases F1 score by 0.03 to 0.20 over analytic baselines and 0.09 over Isaac Gym, at a cost of 8000x and 1.5x more compute time, respectively. All data, code, videos, and supplementary material are available at https sites.google.com berkeley.edu ipcgraspsim.


What is Learned in Knowledge Graph Embeddings?. A knowledge graph (KG) is a data structure which represents entities and relations as the vertices and edges of a directed graph with edge types. KGs are an important primitive in modern machine learning and artificial intelligence. Embedding based models, such as the seminal TransE Bordes et al., 2013 and the recent PairRE Chao et al., 2020 are among the most popular and successful approaches for representing KGs and inferring missing edges (link completion). Their relative success is often credited in the literature to their ability to learn logical rules between the relations. In this work, we investigate whether learning rules between relations is indeed what drives the performance of embedding based methods. We define motif learning and two alternative mechanisms, network learning (based only on the connectivity of the KG, ignoring the relation types), and unstructured statistical learning (ignoring the connectivity of the graph). Using experiments on synthetic KGs, we show that KG models can learn motifs and how this ability is degraded by non motif (noise) edges. We propose tests to distinguish the contributions of the three mechanisms to performance, and apply them to popular KG benchmarks. We also discuss an issue with the standard performance testing protocol and suggest an improvement. To appear in the proceedings of Complex Networks 2021.


Using Human Guided Causal Knowledge for More Generalized Robot Task Planning. A major challenge in research involving artificial intelligence (AI) is the development of algorithms that can find solutions to problems that can generalize to different environments and tasks. Unlike AI, humans are adept at finding solutions that can transfer. We hypothesize this is because their solutions are informed by causal models. We propose to use human guided causal knowledge to help robots find solutions that can generalize to a new environment. We develop and test the feasibility of a language interface that na "ive participants can use to communicate these causal models to a planner. We find preliminary evidence that participants are able to use our interface and generate causal models that achieve near generalization. We outline an experiment aimed at testing far generalization using our interface and describe our longer terms goals for these causal models.


Dimension of the singular set of wild H "older solutions of the incompressible Euler equations. For beta frac13 , we consider C beta( mathbb T 3 times 0,T ) weak solutions of the incompressible Euler equations that do not conserve the kinetic energy. We prove that for such solutions the closed and non empty set of singular times mathcal B satisfies dim mathcal H ( mathcal B ) geq frac 2 beta 1 beta . This lower bound on the Hausdorff dimension of the singular set in time is intrinsically linked to the H "older regularity of the kinetic energy and we conjecture it to be sharp. As a first step in this direction, for every beta beta' frac 1 3 we are able to construct, via a convex integration scheme, non conservative C beta( mathbb T 3 times 0,T ) weak solutions of the incompressible Euler system such that dim mathcal H ( mathcal B ) leq frac 1 2 frac 1 2 frac 2 beta' 1 beta' . The structure of the wild solutions that we build allows moreover to deduce non uniqueness of C beta( mathbb T 3 times 0,T ) weak solutions of the Cauchy problem for Euler from every smooth initial datum.


Elastic 3D 2D Image Registration. We propose a method to non rigidly align a three dimensional (3D) volumetric image with a two dimensional (2D) planar image representing a projection of the deformed volume. The application in mind comes from biological studies in which 2D intravital microscopy videos of living tissue are recorded, after which the tissue is excised and a more detailed 3D volume microscopy is performed. Coregistration of both data sets allows to combine the temporal (but 2D) information with more detailed spatial 3D information. Our approach is variational and uses a hyperelastic deformation regularization, as is appropriate for biological material. As a particular feature, the out of plane deformation is estimated based on the out of focus blur inside the 2D microscopy image. The approach becomes computationally feasible through the use of a coarse to fine optimization strategy and higher order optimization methods.


Thermostat A Large Collection of NLP Model Explanations and Analysis Tools. In the language domain, as in other domains, neural explainability takes an ever more important role, with feature attribution methods on the forefront. Many such methods require considerable computational resources and expert knowledge about implementation details and parameter choices. To facilitate research, we present Thermostat which consists of a large collection of model explanations and accompanying analysis tools. Thermostat allows easy access to over 200k explanations for the decisions of prominent state of the art models spanning across different NLP tasks, generated with multiple explainers. The dataset took over 10k GPU hours ( one year) to compile compute time that the community now saves. The accompanying software tools allow to analyse explanations instance wise but also accumulatively on corpus level. Users can investigate and compare models, datasets and explainers without the need to orchestrate implementation details. Thermostat is fully open source, democratizes explainability research in the language domain, circumvents redundant computations and increases comparability and replicability.


Solitary structure formation and self guiding of electromagnetic beam in highly degenerate electron plasma. In the present paper we consider the nonlinear interaction of high frequency intense electromagnetic (EM) beam with degenerate electron plasmas. In a slowly varying envelop approximation the beam dynamics is described by the couple of nonlinear equations for the vector and scalar potentials. Numerical simulations demonstrate that for an arbitrary level of degeneracy the plasma supports existence of axially symmetric 2D solitons which are stable against small perturbations. The solitons exist if the power trapped in the structures, being the growing function of soliton amplitude, is above a certain critical value but below the value determining by electron cavitation. The robustness of obtained soliton solutions was verified by simulating the dynamics of initial Gaussian beams with parameters close to the solitonic ones. After few diffraction lengths the beam attains the profile close to the profile of the ground state soliton and propagates for a long distance without detectable distortion. The simulations have been performed for the input Gaussian beams with parameters far from ground state solutions. It is shown that the beam parameters are oscillating near the parameters of the ground soliton solution and thus the formation of oscillating waveguide structures takes place.


Non existence of ground states and gap of variational problems for combined power type nonlinear scalar field equations involving the Sobolev critical exponent in three space dimensions. In this paper, we consider minimization problems related to the combined power type nonlinear scalar field equations involving the Sobolev critical exponent in three space dimensions. In four and higher space dimensions, it is known that for any frequency and any power of the subcritical nonlinearity, there exists a ground state. In contrast to those cases, when the space dimension is three and the subcritical power is three or less, we can show that there exists a threshold frequency, above which no ground state exists, and below which the ground state exists. Furthermore, we prove the difference between two typical variational problems used to characterize the ground states.


Approximate Latent Force Model Inference. Physically inspired latent force models offer an interpretable alternative to purely data driven tools for inference in dynamical systems. They carry the structure of differential equations and the flexibility of Gaussian processes, yielding interpretable parameters and dynamics imposed latent functions. However, the existing inference techniques associated with these models rely on the exact computation of posterior kernel terms which are seldom available in analytical form. Most applications relevant to practitioners, such as Hill equations or diffusion equations, are hence intractable. In this paper, we overcome these computational problems by proposing a variational solution to a general class of non linear and parabolic partial differential equation latent force models. Further, we show that a neural operator approach can scale our model to thousands of instances, enabling fast, distributed computation. We demonstrate the efficacy and flexibility of our framework by achieving competitive performance on several tasks where the kernels are of varying degrees of tractability.


Incremental Knowledge Based Question Answering. In the past years, Knowledge Based Question Answering (KBQA), which aims to answer natural language questions using facts in a knowledge base, has been well developed. Existing approaches often assume a static knowledge base. However, the knowledge is evolving over time in the real world. If we directly apply a fine tuning strategy on an evolving knowledge base, it will suffer from a serious catastrophic forgetting problem. In this paper, we propose a new incremental KBQA learning framework that can progressively expand learning capacity as humans do. Specifically, it comprises a margin distilled loss and a collaborative exemplar selection method, to overcome the catastrophic forgetting problem by taking advantage of knowledge distillation. We reorganize the SimpleQuestion dataset to evaluate the proposed incremental learning solution to KBQA. The comprehensive experiments demonstrate its effectiveness and efficiency when working with the evolving knowledge base.


Agent based modelling of sports riots. Riots originating during, or in the aftermath of, sports events can incur significant costs in damages, as well as large scale panic and injuries. A mathematical description of sports riots is therefore sought to better understand their propagation and limit these physical and financial damages. In this work, we present an agent based modelling framework that describes the qualitative features of populations engaging in riotous behaviour. Agents, pertaining to either a 'rioter' or a 'bystander' sub population, move on an underlying lattice and can either be recruited or defect from their respective subpopulation. In particular, we allow these individual level recruitment and defection processes to vary with local population density. This agent based modelling framework provides the unifying link between multi population stochastic models and density dependent reaction processes. Furthermore, the continuum description of this ABM framework is shown to be a system of nonlinear reaction diffusion equations and faithfully agrees with the average ABM behaviour from individual simulations. Finally, we determine the unique correspondence between the underlying individual level recruitment and defection mechanisms with their population level counterparts, providing a link between local scale effects and macroscale rioting phenomena.


Introducing Information Retrieval for Biomedical Informatics Students. Introducing biomedical informatics (BMI) students to natural language processing (NLP) requires balancing technical depth with practical know how to address application focused needs. We developed a set of three activities introducing introductory BMI students to information retrieval with NLP, covering document representation strategies and language models from TF IDF to BERT. These activities provide students with hands on experience targeted towards common use cases, and introduce fundamental components of NLP workflows for a wide variety of applications.


A Comparison Study of Cellular Deployments in Chicago and Miami Using Apps on Smartphones. Cellular operators have begun deploying 5G New Radio (NR) in all available bands low ( 1 GHz), mid (1 6 GHz), and high ( 24 GHz) to exploit the different capabilities of each. At the same time, traditional 4G Long Term Evolution (LTE) deployments are being enhanced with the addition of bands in the unlicensed 5 GHz (using License Assisted Access, or LAA) and the 3.5 GHz Citizens Broadband Radio Service (CBRS) resulting in throughput performance comparable to 5G in mid band. We present a detailed study comparing 4G and 5G deployments, in all bands in Chicago, and focused mmWave measurements and analysis in Miami. Our methodology, based on commercial and custom apps, is scalable for crowdsourcing measurements on a large scale and provides detailed data (throughput, latency, signal strength, etc.) on actual deployments. Our main conclusions based on the measurements are (i) optimized 4G networks in mid band are comparable in both throughput and latency to current deployments of 5G (both standalone (SA) and non standalone (NSA)) and (ii) mmWave 5G, even in NSA mode, can deliver multi Gbps throughput reliably if the installation is dense enough, but performance is still brittle due to the propagation limitations imposed by distance and body loss. Thus, while 5G demonstrates significant early promise, further work needs to be done to ensure that the stated goals of 5G are met.


Walks avoiding a quadrant and the reflection principle. We continue the enumeration of plane lattice walks with small steps avoiding the negative quadrant, initiated by the first author in 2016. We solve in detail a new case, namely the king model where all eight nearest neighbour steps are allowed. The associated generating function is proved to be the sum of a simple, explicit D finite series (related to the number of walks confined to the first quadrant), and an algebraic one. This was already the case for the two models solved by the first author in 2016. The principle of the approach is also the same, but challenging theoretical and computational difficulties arise as we now handle algebraic series of larger degree. We expect a similar algebraicity phenomenon to hold for the seven Weyl step sets, which are those for which walks confined to the first quadrant can be counted using the reflection principle. With this paper, this is now proved for three of them. For the remaining four, we predict the D finite part of the solution, and in three of the four cases, give evidence for the algebraicity of the remaining part.


Transition based Bubble Parsing Improvements on Coordination Structure Prediction. We propose a transition based bubble parser to perform coordination structure identification and dependency based syntactic analysis simultaneously. Bubble representations were proposed in the formal linguistics literature decades ago they enhance dependency trees by encoding coordination boundaries and internal relationships within coordination structures explicitly. In this paper, we introduce a transition system and neural models for parsing these bubble enhanced structures. Experimental results on the English Penn Treebank and the English GENIA corpus show that our parsers beat previous state of the art approaches on the task of coordination structure prediction, especially for the subset of sentences with complex coordination structures.


The Quantitative Collapse of Concurrent Games with Symmetry. We explore links between the thin concurrent games of Castellan, Clairambault and Winskel, and the weighted relational models of linear logic studied by Laird, Manzonetto, McCusker and Pagani. More precisely, we show that there is an interpretationpreserving "collapse" functor from the former to the latter. On objects, the functor defines for each game a set of possible execution states. Defining the action on morphisms is more subtle, and this is the main contribution of the paper. Given a strategy and an execution state, our functor needs to count the witnesses for this state within the strategy. Strategies in thin concurrent games describe non linear behaviour explicitly, so in general each witness exists in countably many symmetric copies. The challenge is to define the right notion of witnesses, factoring out this infinity while matching the weighted relational model. Understanding how witnesses compose is particularly subtle and requires a delve into the combinatorics of witnesses and their symmetries. In its basic form, this functor connects thin concurrent games and a relational model weighted by N cup infty . We will additionally consider a generalised setting where both models are weighted by elements of an arbitrary continuous semiring this covers the probabilistic case, among others. Witnesses now additionally carry a value from the semiring, and our interpretation preserving collapse functor extends to this setting.


Trajectory Prediction with Graph based Dual scale Context Fusion. Motion prediction for traffic participants is essential for a safe and robust automated driving system, especially in cluttered urban environments. However, it is highly challenging due to the complex road topology as well as the uncertain intentions of the other agents. In this paper, we present a graph based trajectory prediction network named the Dual Scale Predictor (DSP), which encodes both the static and dynamical driving context in a hierarchical manner. Different from methods based on a rasterized map or sparse lane graph, we consider the driving context as a graph with two layers, focusing on both geometrical and topological features. Graph neural networks (GNNs) are applied to extract features with different levels of granularity, and features are subsequently aggregated with attention based inter layer networks, realizing better local global feature fusion. Following the recent goal driven trajectory prediction pipeline, goal candidates with high likelihood for the target agent are extracted, and predicted trajectories are generated conditioned on these goals. Thanks to the proposed dual scale context fusion network, our DSP is able to generate accurate and human like multi modal trajectories. We evaluate the proposed method on the large scale Argoverse motion forecasting benchmark, and it achieves promising results, outperforming the recent state of the art methods.


An empirical assessment of deep learning approaches to task oriented dialog management. Deep learning is providing very positive results in areas related to conversational interfaces, such as speech recognition, but its potential benefit for dialog management has still not been fully studied. In this paper, we perform an assessment of different configurations for deep learned dialog management with three dialog corpora from different application domains and varying in size, dimensionality and possible system responses. Our results have allowed us to identify several aspects that can have an impact on accuracy, including the approaches used for feature extraction, input representation, context consideration and the hyper parameters of the deep neural networks employed.


DynSTGAT Dynamic Spatial Temporal Graph Attention Network for Traffic Signal Control. Adaptive traffic signal control plays a significant role in the construction of smart cities. This task is challenging because of many essential factors, such as cooperation among neighboring intersections and dynamic traffic scenarios. First, to facilitate cooperation of traffic signals, existing work adopts graph neural networks to incorporate the temporal and spatial influences of the surrounding intersections into the target intersection, where spatial temporal information is used separately. However, one drawback of these methods is that the spatial temporal correlations are not adequately exploited to obtain a better control scheme. Second, in a dynamic traffic environment, the historical state of the intersection is also critical for predicting future signal switching. Previous work mainly solves this problem using the current intersection's state, neglecting the fact that traffic flow is continuously changing both spatially and temporally and does not handle the historical state. In this paper, we propose a novel neural network framework named DynSTGAT, which integrates dynamic historical state into a new spatial temporal graph attention network to address the above two problems. More specifically, our DynSTGAT model employs a novel multi head graph attention mechanism, which aims to adequately exploit the joint relations of spatial temporal information. Then, to efficiently utilize the historical state information of the intersection, we design a sequence model with the temporal convolutional network (TCN) to capture the historical information and further merge it with the spatial information to improve its performance. Extensive experiments conducted in the multi intersection scenario on synthetic data and real world data confirm that our method can achieve superior performance in travel time and throughput against the state of the art methods.


Terminating spiral waves with a single designed stimulus Teleportation as the mechanism for defibrillation. We demonstrate a universal mechanism for terminating spiral waves in excitable media using an established topological framework. This mechanism dictates whether high or low energy defibrillation shocks succeed or fail. Furthermore, this mechanism allows for the design of a single minimal stimulus capable of defibrillating, at any time, turbulent states driven by multiple spiral waves. We demonstrate this method in a variety of computational models of cardiac tissue ranging from simple to detailed human models. The theory described here shows how this mechanism underlies all successful defibrillation and can be used to further develop existing and future low energy defibrillation strategies.


Particle Sources. This paper outlines the many ways that the initial beam can be made for particle accelerators. Brief introductions to plasma physics and beam formation are given. Thermionic and photo emission electron guns, with both DC and Radio Frequency (RF) acceleration are outlined. Positive ion sources for producing H ions and multiply charged heavy ions are covered. Hot cathode filament sources and cold cathode sources are explored. RF discharge sources (inductively coupled, microwave and ECR) are discussed, as are laser, vacuum arc, and electron beam sources. The physical principles of negative ion production are outlined and different types of negative ion source technologies are described. Polarised particle sources are mentioned briefly. Source choice is summarised and the general practicalities of source operation and development are discussed.


Distill Domain Specific Compilation for Cognitive Models. This paper discusses our proposal and implementation of Distill, a domain specific compilation tool based on LLVM to accelerate cognitive models. Cognitive models explain the process of cognitive function and offer a path to human like artificial intelligence. However, cognitive modeling is laborious, requiring composition of many types of computational tasks, and suffers from poor performance as it relies on high level languages like Python. In order to continue enjoying the flexibility of Python while achieving high performance, Distill uses domain specific knowledge to compile Python based cognitive models into LLVM IR, carefully stripping away features like dynamic typing and memory management that add overheads to the actual model. As we show, this permits significantly faster model execution. We also show that the code so generated enables using classical compiler data flow analysis passes to reveal properties about data flow in cognitive models that are useful to cognitive scientists. Distill is publicly available, is being used by researchers in cognitive science, and has led to patches that are currently being evaluated for integration into mainline LLVM.


Speed Planning Using Bezier Polynomials with Trapezoidal Corridors. To generate safe and real time trajectories for an autonomous vehicle in dynamic environments, path and speed decoupled planning methods are often considered. This paper studies speed planning, which mainly deals with dynamic obstacle avoidance given the planning path. The main challenges lie in the decisions in non convex space and the trade off between safety, comfort and efficiency performances. This work uses dynamic programming to search heuristic waypoints on the S T graph and to construct convex feasible spaces. Further, a piecewise Bezier polynomials optimization approach with trapezoidal corridors is presented, which theoretically guarantees the safety and optimality of the trajectory. The simulations verify the effectiveness of the proposed approach.


Disentangled Feature Representation for Few shot Image Classification. Learning the generalizable feature representation is critical for few shot image classification. While recent works exploited task specific feature embedding using meta tasks for few shot learning, they are limited in many challenging tasks as being distracted by the excursive features such as the background, domain and style of the image samples. In this work, we propose a novel Disentangled Feature Representation framework, dubbed DFR, for few shot learning applications. DFR can adaptively decouple the discriminative features that are modeled by the classification branch, from the class irrelevant component of the variation branch. In general, most of the popular deep few shot learning methods can be plugged in as the classification branch, thus DFR can boost their performance on various few shot tasks. Furthermore, we propose a novel FS DomainNet dataset based on DomainNet, for benchmarking the few shot domain generalization tasks. We conducted extensive experiments to evaluate the proposed DFR on general and fine grained few shot classification, as well as few shot domain generalization, using the corresponding four benchmarks, i.e., mini ImageNet, tiered ImageNet, CUB, as well as the proposed FS DomainNet. Thanks to the effective feature disentangling, the DFR based few shot classifiers achieved the state of the art results on all datasets.


Computation of the Activity on Node Binary State Reliability with Uncertainty Components. Various networks such as cloud computing, water gas electricity networks, wireless sensor networks, transportation networks, and 4G 5G networks, have become an integral part of our daily lives. A binary state network (BN) is often used to model network structures and applications. The BN reliability is the probability that a BN functions continuously that is, that there is always a simple path connected between a specific pair of nodes. This metric is a popular index for designing, managing, controlling, and evaluating networks. The traditional BN reliability assumes that the reliability of each arc is known in advance. However, this is not always the case. Functioning components operate under different environments moreover, a network might have newly installed components. Hence, the reliability of these components is not always known. To resolve the aforementioned problems, in which the reliability of some components of a network are uncertain, we introduce the fuzzy concept for the analysis of these components, and propose a new algorithm to solve this uncertainty component BN reliability problem. The time complexity of the proposed algorithm is analyzed, and the superior performance of the algorithm is demonstrated through examples.


Slope classicality via completed cohomology. We give a new proof of the slope classicality theorem in classical and higher Coleman theory for modular curves at arbitrary level using the completed cohomology classes attached to overconvergent modular forms. The latter give an embedding of the quotient of overconvergent modular forms by classical modular forms, which is the obstruction space for classicality in either cohomological degree, into a unitary representation of mathrm GL 2( mathbb Q p) . The U p operator becomes a double coset, and unitarity yields the slope vanishing.


Comparison Among Coaxial Microcalorimeter Models. Thermoelectric power sensors used as power transfer standards are promising devices for further enhancements of the microcalorimetric technique in the high frequency field. A coaxial microcalorimeter has been studied, based on thermoelectric power sensors, at Istituto Nazionale di Ricerca Metrologica (INRIM). In the literature, several models have been proposed, considering different calibration processes and error sources. Hereby we analyze these models in terms of total uncertainty for the 3.5 mm coaxial line case between 10 MHz and 26.5 GHz. Merits and limits of the models are highlighted.


Visual Question Rewriting for Increasing Response Rate. When a human asks questions online, or when a conversational virtual agent asks human questions, questions triggering emotions or with details might more likely to get responses or answers. we explore how to automatically rewrite natural language questions to improve the response rate from people. In particular, a new task of Visual Question Rewriting(VQR) task is introduced to explore how visual information can be used to improve the new questions. A data set containing around 4K bland questions, attractive questions and images triples is collected. We developed some baseline sequence to sequence models and more advanced transformer based models, which take a bland question and a related image as input and output a rewritten question that is expected to be more attractive. Offline experiments and mechanical Turk based evaluations show that it is possible to rewrite bland questions in a more detailed and attractive way to increase the response rate, and images can be helpful.


CKMorph A Comprehensive Morphological Analyzer for Central Kurdish. A morphological analyzer, which is a significant component of many natural language processing applications especially for morphologically rich languages, divides an input word into all its composing morphemes and identifies their morphological roles. In this paper, we introduce a comprehensive morphological analyzer for Central Kurdish (CK), a low resourced language with a rich morphology. Building upon the limited existing literature, we first assembled and systematically categorized a comprehensive collection of the morphological and morphophonological rules of the language. Additionally, we collected and manually labeled a generative lexicon containing nearly 10,000 verb, noun and adjective stems, named entities, and other types of word stems. We used these rule sets and resources to implement CKMorph Analyzer based on finite state transducers. In order to provide a benchmark for future research, we collected, manually labeled, and publicly shared test sets for evaluating accuracy and coverage of the analyzer. CKMorph was able to correctly analyze 95.9 of the accuracy test set, containing 1,000 CK words morphologically analyzed according to the context. Moreover, CKMorph gave at least one analysis for 95.5 of 4.22M CK tokens of the coverage test set. The demonstration of the application and resources including CK verb database and test sets are openly accessible at https github.com CKMorph.


A Closer Look at Loss Weighting in Multi Task Learning. Multi Task Learning (MTL) has achieved great success in various fields, however, how to balance different tasks to avoid negative effects is still a key problem. To achieve the task balancing, there exist many works to balance task losses or gradients. In this paper, we unify eight representative task balancing methods from the perspective of loss weighting and provide a consistent experimental comparison. Moreover, we surprisingly find that training a MTL model with random weights sampled from a distribution can achieve comparable performance over state of the art baselines. Based on this finding, we propose a simple yet effective weighting strategy called Random Loss Weighting (RLW), which can be implemented in only one additional line of code over existing works. Theoretically, we analyze the convergence of RLW and reveal that RLW has a higher probability to escape local minima than existing models with fixed task weights, resulting in a better generalization ability. Empirically, we extensively evaluate the proposed RLW method on six image datasets and four multilingual tasks from the XTREME benchmark to show the effectiveness of the proposed RLW strategy when compared with state of the art strategies.


On Discrete Truthful Heterogeneous Two Facility Location. We revisit the discrete heterogeneous two facility location problem, in which there is a set of agents that occupy nodes of a line graph, and have private approval preferences over two facilities. When the facilities are located at some nodes of the line, each agent derives a cost that is equal to her total distance from the facilities she approves. The goal is to decide where to locate the two facilities, so as to (a) incentivize the agents to truthfully report their preferences, and (b) achieve a good approximation of the minimum total (social) cost or the maximum cost among all agents. For both objectives, we design deterministic strategyproof mechanisms with approximation ratios that significantly outperform the state of the art, and complement these results with (almost) tight lower bounds.


Real Time Pothole Detection Using Deep Learning. Roads are connecting line between different places, and used daily. Roads' periodic maintenance keeps them safe and functional. Detecting and reporting the existence of potholes to responsible departments can help in eliminating them. This study deployed and tested on different deep learning architecture to detect potholes. The images used for training were collected by cellphone mounted on the windshield of the car, in addition to many images downloaded from the internet to increase the size and variability of the database. Second, various object detection algorithms are employed and compared to detect potholes in real time like SDD TensorFlow, YOLOv3Darknet53 and YOLOv4Darknet53. YOLOv4 achieved the best performance with 81 recall, 85 precision and 85.39 mean Average Precision (mAP). The speed of processing was 20 frame per second. The system was able to detect potholes from a range on 100 meters away from the camera. The system can increase the safety of drivers and improve the performance of self driving cars by detecting pothole time ahead.


Arithmetic properties of the Genocchi numbers and their generalization. This note is devoted to establish some new arithmetic properties of the generalized Genocchi numbers G n , a ( n in mathbb N , a geq 2 ). The resulting properties for the usual Genocchi numbers G n G n , 2 are then derived. We show for example that for any even positive integer n , the Genocchi number G n is a multiple of the odd part of n .


SituatedQA Incorporating Extra Linguistic Contexts into QA. Answers to the same question may change depending on the extra linguistic contexts (when and where the question was asked). To study this challenge, we introduce SituatedQA, an open retrieval QA dataset where systems must produce the correct answer to a question given the temporal or geographical context. To construct SituatedQA, we first identify such questions in existing QA datasets. We find that a significant proportion of information seeking questions have context dependent answers (e.g., roughly 16.5 of NQ Open). For such context dependent questions, we then crowdsource alternative contexts and their corresponding answers. Our study shows that existing models struggle with producing answers that are frequently updated or from uncommon locations. We further quantify how existing models, which are trained on data collected in the past, fail to generalize to answering questions asked in the present, even when provided with an updated evidence corpus (a roughly 15 point drop in accuracy). Our analysis suggests that open retrieval QA benchmarks should incorporate extra linguistic context to stay relevant globally and in the future. Our data, code, and datasheet are available at https situatedqa.github.io .


Maximal operators on the infinite dimensional torus. We study maximal operators related to bases on the infinite dimensional torus mathbb T omega . For the normalized Haar measure dx on mathbb T omega it is known that M mathcal R 0 , the maximal operator associated with the dyadic basis mathcal R 0 , is of weak type (1,1) , but M mathcal R , the operator associated with the natural general basis mathcal R , is not. We extend the latter result to all q in 1, infty) . Then we find a wide class of intermediate bases mathcal R 0 subset mathcal R ' subset mathcal R , for which maximal functions have controlled, but sometimes very peculiar behavior. Precisely, for given q 0 in 1, infty) we construct mathcal R ' such that M mathcal R ' is of restricted weak type (q,q) if and only if q belongs to a predetermined range of the form (q 0, infty or q 0, infty . Finally, we study the weighted setting, considering the Muckenhoupt A p mathcal R ( mathbb T omega) and reverse H "older mathrm RH r mathcal R ( mathbb T omega) classes of weights associated with mathcal R . For each p in (1, infty) and each w in A p mathcal R ( mathbb T omega) we obtain that M mathcal R is not bounded on L q(w) in the whole range q in 1, infty) . Since we are able to show that bigcup p in (1, infty) A p mathcal R ( mathbb T omega) bigcup r in (1, infty) mathrm RH r mathcal R ( mathbb T omega), the unboundedness result applies also to all reverse H "older weights.


Labeled sample compression schemes for complexes of oriented matroids. We show that the topes of a complex of oriented matroids (abbreviated COM) of VC dimension d admit a proper labeled sample compression scheme of size d . This considerably extends results of Moran and Warmuth and the authors and is a step towards the sample compression conjecture one of the oldest open in computational learning theory. On the one hand, our approach exploits the rich combinatorial cell structure of COMs via oriented matroid theory. On the other hand viewing tope graphs of COMs as partial cubes creates a fruitful link to metric graph theory


Algebraic dimension and complex subvarieties of hypercomplex nilmanifolds. A nilmanifold is a (left) quotient of a nilpotent Lie group by a cocompact lattice. A hypercomplex structure on a manifold is a triple of complex structure operators satisfying the quaternionic relations. A hypercomplex nilmanifold is a compact quotient of a nilpotent Lie group equipped with a left invariant hypercomplex structure. Such a manifold admits a whole 2 dimensional sphere S 2 of complex structures induced by quaternions. We prove that for any hypercomplex nilmanifold M and a generic complex structure L in S 2 , the complex manifold (M,L) has algebraic dimension 0. A stronger result is proven when the hypercomplex nilmanifold is abelian. Consider the Lie algebra of left invariant vector fields of Hodge type (1,0) on the corresponding nilpotent Lie group with respect to some complex structure I in S 2 . A hypercomplex nilmanifold is called abelian when this Lie algebra is abelian. We prove that all complex subvarieties of (M,L) for generic L in S 2 on a hypercomplex abelian nilmanifold are also hypercomplex nilmanifolds.


Agent Based Virus Model using NetLogo Infection Propagation, Precaution, Recovery, Multi site Mobility and (Un)Lockdown. This paper presents a novel virus propagation model using NetLogo. The model allows agents to move across multiple sites using different routes. Routes can be configured, enabled for mobility and (un)locked down independently. Similarly, locations can also be (un)locked down independently. Agents can get infected, propagate their infections to others, can take precautions against infection and also subsequently recover from infection. This model contains certain features that are not present in existing models. The model may be used for educational and research purposes, and the code is made available as open source. This model may also provide a broader framework for more detailed simulations. The results presented are only to demonstrate the model functionalities and do not serve any other purpose.


Exact verification of the strong BSD conjecture for some absolutely simple abelian surfaces. Let X be one of the 28 Atkin Lehner quotients of a curve X 0(N) such that X has genus 2 and its Jacobian variety J is absolutely simple. We show that the Shafarevich Tate group of J mathbb Q is trivial. This verifies the strong BSD conjecture for J .


The questionable impact of population wide public testing in reducing SARS CoV 2 infection prevalence in the Slovak Republic. Mina and Andersen, authors of the Perspectives in Science COVID 19 Testing One Size Does Not Fit All have referred to results and adopted conclusions from recently published governmental report Pavelka et al. "The effectiveness of population wide, rapid antigen test based screening in reducing SARS CoV 2 infection prevalence in Slovakia" without critical consideration, and rigorous verification. We demonstrate that the authors refer to conclusions that are not supported by experimental data. Further, there is a lack of objective, independent information and studies regarding the widespread, public testing program currently in force in the Slovak Republic. We offer an alternative explanation of observed data as they have been provided by the Slovak Republic government to fill this information gap. We also provide explanations and conclusions that more accurately describe viral spread dynamics. Drawing from available public data and our simple but rigorous analysis, we show that it is not possible to make clear conclusions about any positive impact of the public testing program in the Slovak Republic. In particular, it is not possible to conclude that this testing program forces the curve down for the SARS CoV 2 virus outbreak. We think that Pavelka et al. did not consider many fundamental phenomena in their proposed computer simulations and data analysis in particular the complexity of SARS CoV 2 virus spread. In complex spatio temporal dynamical systems, small spatio temporal fluctuations can dramatically change the dynamics of virus spreading on large scales.


Multi agent systems for quadcopters. Unmanned Aerial Vehicles (UAVs) have been increasingly used in the context of remote sensing missions such as target search and tracking, mapping, or surveillance monitoring. In the first part of our paper we consider agent dynamics, network topologies, and collective behaviors. The objective is to enable multiple UAVs to collaborate toward a common goal, as one would find in a remote sensing setting. An agreement protocol is carried out by the multi agents using local information, and without external user input. The second part of the paper focuses on the equations of motion for a specific type of UAV, the quadcopter, and expresses them as an affine nonlinear control system. Finally, we illustrate our work with a simulation of an agreement protocol for dynamically sound quadcopters augmenting the particle graph theoretic approach with orientation and a proper dynamics for quadcopters.


The height of record biased trees. Given a permutation sigma , its corresponding binary search tree is obtained by recursively inserting the values sigma(1), ldots, sigma(n) into a binary tree so that the label of each node is larger than the labels of its left subtree and smaller than the labels of its right subtree. In 1986, Devroye proved that the height of such trees when sigma is a random uniform permutation is of order (c o mathbb P (1)) log n as n tends to infinity, where c is the only solution to c log(2e c) 1 with c geq2 . In this paper, we study the height of binary search trees drawn from the record biased model of permutations, introduced by Auger, Bouvel, Nicaud, and Pivoteau in 2016. The record biased distribution is the probability measure on the set of permutations whose weight is proportional to theta mathrm record ( sigma) , where mathrm record ( sigma) i in n forall j i, sigma(i) sigma(j) . We show that the height of a binary search tree built from a record biased permutation of size n with parameter theta is of order (1 o mathbb P (1)) max c log n, , theta log(1 n theta) , hence giving a full characterization of the first order asymptotic behaviour of the height of such trees.


Video Based Fall Detection Using Human Poses. Video based fall detection accuracy has been largely improved due to the recent progress on deep convolutional neural networks. However, there still exists some challenges, such as lighting variation, complex background, which degrade the accuracy and generalization ability of these approaches. Meanwhile, large computation cost limits the application of existing fall detection approaches. To alleviate these problems, a video based fall detection approach using human poses is proposed in this paper. First, a lightweight pose estimator extracts 2D poses from video sequences and then 2D poses are lifted to 3D poses. Second, we introduce a robust fall detection network to recognize fall events using estimated 3D poses, which increases respective filed and maintains low computation cost by dilated convolutions. The experimental results show that the proposed fall detection approach achieves a high accuracy of 99.83 on large benchmark action recognition dataset NTU RGB D and real time performance of 18 FPS on a non GPU platform and 63 FPS on a GPU platform.


On ruin probabilities with investments in a risky asset with a switching regime price. We investigate the asymptotic of ruin probabilities when the company invests its reserve in a risky asset with a switching regime price. We assume that the asset price is a conditional geometric Brownian motion with parameters modulated by a Markov process with a finite number of states. Using the technique of the implicit renewal theory we obtain the rate of convergence to zero of the ruin probabilities as the initial capital tends to infinity.


Maximal Matroids in Weak Order Posets. Let cX be a family of subsets of a finite set E . A matroid on E is called an cX matroid if each set in cX is a circuit. We consider the problem of determining when there exists a unique maximal cX matroid in the weak order poset of all cX matroids on E , and characterizing its rank function when it exists.


Mostar index and edge Mostar index of polymers. Let G (V,E) be a graph and e uv in E . Define n u(e,G) be the number of vertices of G closer to u than to v . The number n v(e,G) can be defined in an analogous way. The Mostar index of G is a new graph invariant defined as Mo(G) sum uv in E(G) n u(uv,G) n v(uv,G) . The edge version of Mostar index is defined as Mo e(G) sum e uv in E(G) m u(e G) m v(G e) , where m u(e G) and m v(e G) are the number of edges of G lying closer to vertex u than to vertex v and the number of edges of G lying closer to vertex v than to vertex u , respectively. Let G be a connected graph constructed from pairwise disjoint connected graphs G 1, ldots ,G k by selecting a vertex of G 1 , a vertex of G 2 , and identifying these two vertices. Then continue in this manner inductively. We say that G is a polymer graph, obtained by point attaching from monomer units G 1,...,G k . In this paper, we consider some particular cases of these graphs that are of importance in chemistry and study their Mostar and edge Mostar indices.


Weisfeiler Leman Indistinguishability of Graphons. The color refinement algorithm is mainly known as a heuristic method for graph isomorphism testing. It has surprising but natural characterizations in terms of, for example, homomorphism counts from trees and solutions to a system of linear equations. Greb 'ik and Rocha (2021) have recently shown that color refinement and some of its characterizations generalize to graphons, a natural notion for the limit of a sequence of graphs. In particular, they show that these characterizations are still equivalent in the graphon case. The k dimensional Weisfeiler Leman algorithm ( k WL) is a more powerful variant of color refinement that colors k tuples instead of single vertices, where the terms 1 WL and color refinement are often used interchangeably since they compute equivalent colorings. We show how to adapt the result of Greb 'ik and Rocha to k WL or, in other words, how k WL and its characterizations generalize to graphons. In particular, we obtain characterizations in terms of homomorphism densities from multigraphs of bounded treewidth and linear equations. We give a simple example that parallel edges make a difference in the graphon case, which means that the equivalence between 1 WL and color refinement is lost. We also show how to define a variant of k WL that corresponds to homomorphism densities from simple graphs of bounded treewidth.


On decomposition of ambient surfaces admitting A diffeomorphisms with nontrivial attractors and repellers. It is well known that there is a close relationship between the dynamics of diffeomorphisms satisfying the axiom A and the topology of the ambient manifold. In the given article, this statement is considered for the class mathbb G(M 2) of A diffeomorphisms of closed orientable surfaces such that their non wandering set consists of k f geq 2 connected components of one dimensional basic sets (attractors and repellers). We prove that the ambient surface of every diffeomorphism f in mathbb G(M 2) is homeomorphic to the connected sum of k f closed orientable surfaces and l f two dimensional tori such that the genus of each surface is determined by the dynamical properties of appropriating connected component of a basic set and l f is determined by the number and position of bunches, belonging to all connected components of basic sets. We also prove that every diffeomorphism from the class mathbb G(M 2) is Omega stable but is not structurally stable.


ProcessTransformer Predictive Business Process Monitoring with Transformer Network. Predictive business process monitoring focuses on predicting future characteristics of a running process using event logs. The foresight into process execution promises great potentials for efficient operations, better resource management, and effective customer services. Deep learning based approaches have been widely adopted in process mining to address the limitations of classical algorithms for solving multiple problems, especially the next event and remaining time prediction tasks. Nevertheless, designing a deep neural architecture that performs competitively across various tasks is challenging as existing methods fail to capture long range dependencies in the input sequences and perform poorly for lengthy process traces. In this paper, we propose ProcessTransformer, an approach for learning high level representations from event logs with an attention based network. Our model incorporates long range memory and relies on a self attention mechanism to establish dependencies between a multitude of event sequences and corresponding outputs. We evaluate the applicability of our technique on nine real event logs. We demonstrate that the transformer based model outperforms several baselines of prior techniques by obtaining on average above 80 accuracy for the task of predicting the next activity. Our method also perform competitively, compared to baselines, for the tasks of predicting event time and remaining time of a running case


On folded cluster patterns of affine type. A cluster algebra is a commutative algebra whose structure is decided by a skew symmetrizable matrix or a quiver. When a skew symmetrizable matrix is invariant under an action of a finite group and this action is admissible, the folded cluster algebra is obtained from the original one. Any cluster algebra of non simply laced affine type can be obtained by folding a cluster algebra of simply laced affine type with a specific G action. In this paper, we study the combinatorial properties of quivers in the cluster algebra of affine type. We prove that for any quiver of simply laced affine type, G invariance and G admissibility are equivalent. This leads us to prove that the set of G invariant seeds forms the folded cluster pattern.


Towards Tool Support for Interactive Machine Learning Applications in the Android Ecosystem. Consumer applications are becoming increasingly smarter and most of them have to run on device ecosystems. Potential benefits are for example enabling cross device interaction and seamless user experiences. Essential for today's smart solutions with high performance are machine learning models. However, these models are often developed separately by AI engineers for one specific device and do not consider the challenges and potentials associated with a device ecosystem in which their models have to run. We believe that there is a need for tool support for AI engineers to address the challenges of implementing, testing, and deploying machine learning models for a next generation of smart interactive consumer applications. This paper presents preliminary results of a series of inquiries, including interviews with AI engineers and experiments for an interactive machine learning use case with a Smartwatch and Smartphone. We identified the themes through interviews and hands on experience working on our use case and proposed features, such as data collection from sensors and easy testing of the resources consumption of running pre processing code on the target device, which will serve as tool support for AI engineers.


Towards Inter class and Intra class Imbalance in Class imbalanced Learning. Imbalanced Learning (IL) is an important problem that widely exists in data mining applications. Typical IL methods utilize intuitive class wise resampling or reweighting to directly balance the training set. However, some recent research efforts in specific domains show that class imbalanced learning can be achieved without class wise manipulation. This prompts us to think about the relationship between the two different IL strategies and the nature of the class imbalance. Fundamentally, they correspond to two essential imbalances that exist in IL the difference in quantity between examples from different classes as well as between easy and hard examples within a single class, i.e., inter class and intra class imbalance. Existing works fail to explicitly take both imbalances into account and thus suffer from suboptimal performance. In light of this, we present Duple Balanced Ensemble, namely DUBE , a versatile ensemble learning framework. Unlike prevailing methods, DUBE directly performs inter class and intra class balancing without relying on heavy distance based computation, which allows it to achieve competitive performance while being computationally efficient. We also present a detailed discussion and analysis about the pros and cons of different inter intra class balancing strategies based on DUBE . Extensive experiments validate the effectiveness of the proposed method. Code and examples are available at https github.com ICDE2022Sub duplebalance.


Towards an Open Global Air Quality Monitoring Platform to Assess Children's Exposure to Air Pollutants in the Light of COVID 19 Lockdowns. This ongoing work attempts to understand and address the requirements of UNICEF, a leading organization working in children's welfare, where they aim to tackle the problem of air quality for children at a global level. We are motivated by the lack of a proper model to account for heavily fluctuating air quality levels across the world in the wake of the COVID 19 pandemic, leading to uncertainty among public health professionals on the exact levels of children's exposure to air pollutants. We create an initial model as per the agency's requirement to generate insights through a combination of virtual meetups and online presentations. Our research team comprised of UNICEF's researchers and a group of volunteer data scientists. The presentations were delivered to a number of scientists and domain experts from UNICEF and community champions working with open data. We highlight their feedback and possible avenues to develop this research further.


Connecting science fundamentals and career proficiency Development of multi disciplinary science curriculum. The current conventional approach in teaching STEM seems inadequate it is failing both the students and the work force demands in several aspects. Perhaps it is succeeding in equipping students with information and facts but surely falls short in developing them intellectually and in sparking their passion for science. Mixing research with learning by adding components in courses to enforce creativity, reasoning, and to connect the dots between different topics and different subjects can be an effective counter to this tendency. Multi disciplinary science curriculum connecting the dots between different subjects and the dots between fundamentals and applications and demonstrating clear path to current and future industrial jobs can offer a good approach for STEM education. An example for mutli disciplinary science course is presented.


Monotonicity formulas for harmonic functions in rm RCD (0,N) spaces. We generalize to the rm RCD (0,N) setting a family of monotonicity formulas by Colding and Minicozzi for positive harmonic functions in Riemannian manifolds with non negative Ricci curvature. Rigidity and almost rigidity statements are also proven, the second appearing to be new even in the smooth setting. Motivated by the recent work in AFM we also introduce the notion of electrostatic potential in rm RCD spaces, which also satisfies our monotonicity formulas. Our arguments are mainly based on new estimates for harmonic functions in rm RCD (K,N) spaces and on a new functional version of the (almost) outer volume cone implies (almost) outer metric cone' theorem.


The second Hardy Littlewood conjecture is true. The second Hardy Littlewood conjecture, that pi(x) pi(y) geq pi(x y) for integers x and y with min x,y geq 2 , was formulated in 1923. It continues to attract attention to this day, almost 100 years later. In 1975 Udrescu proved that this conjecture holds for (x,y) sufficiently large, but without an explicit effective bound on the region of validity. We shall revisit Udrescu's result, modifying it to obtain explicit effective bounds, ultimately proving that the second Hardy Littlewood conjecture is in fact unconditionally true. Furthermore we note that constraints on the prime counting function imply, (and are implied by), constraints on the location of the primes, and re cast Segal's 1962 equivalent reformulation of the second Hardy Littlewood conjecture in the more symmetric (and perhaps clearer) form that for integers i and j with min i,j geq 2 one has p i j 1 geq p i p j 1 .


Lattice walks confined to an octant in dimension 3 (non )rationality of the second critical exponent. In the field of enumeration of walks in cones, it is known how to compute asymptotically the number of excursions (finite paths in the cone with fixed length, starting and ending points, using jumps from a given step set). As it turns out, the associated critical exponent is related to the eigenvalues of a certain Dirichlet problem on a spherical domain. An important underlying question is to decide whether this asymptotic exponent is a (non )rational number, as this has important consequences on the algebraic nature of the associated generating function. In this paper, we ask whether such an excursion sequence might admit an asymptotic expansion with a first rational exponent and a second non rational exponent. While the current state of the art does not give any access to such many term expansions, we look at the associated continuous problem, involving Brownian motion in cones. Our main result is to prove that in dimension three, there exists a cone such that the heat kernel (the continuous analogue of the excursion sequence) has the desired rational non rational asymptotic property. Our techniques come from spectral theory and perturbation theory. More specifically, our main tool is a new Hadamard formula, which has an independent interest and allows us to compute the derivative of eigenvalues of spherical triangles along infinitesimal variations of the angles.


FedNILM Applying Federated Learning to NILM Applications at the Edge. Non intrusive load monitoring (NILM) helps disaggregate the household's main electricity consumption to energy usages of individual appliances, thus greatly cutting down the cost in fine grained household load monitoring. To address the arisen privacy concern in NILM applications, federated learning (FL) could be leveraged for NILM model training and sharing. When applying the FL paradigm in real world NILM applications, however, we are faced with the challenges of edge resource restriction, edge model personalization and edge training data scarcity. In this paper we present FedNILM, a practical FL paradigm for NILM applications at the edge client. Specifically, FedNILM is designed to deliver privacy preserving and personalized NILM services to large scale edge clients, by leveraging i) secure data aggregation through federated learning, ii) efficient cloud model compression via filter pruning and multi task learning, and iii) personalized edge model building with unsupervised transfer learning. Our experiments on real world energy data show that, FedNILM is able to achieve personalized energy disaggregation with the state of the art accuracy, while ensuring privacy preserving at the edge client.