Coercivity, essential norms, and the Galerkin method for second kind integral equations on polyhedral and Lipschitz domains. It is well known that, with a particular choice of norm, the classical double layer potential operator D has essential norm 1 2 as an operator on the natural trace space H 1 2 ( Gamma) whenever Gamma is the boundary of a bounded Lipschitz domain. This implies, for the standard second kind boundary integral equations for the interior and exterior Dirichlet and Neumann problems in potential theory, convergence of the Galerkin method in H 1 2 ( Gamma) for any sequence of finite dimensional subspaces ( mathcal H N) N 1 infty that is asymptotically dense in H 1 2 ( Gamma) . Long standing open questions are whether the essential norm is also 1 2 for D as an operator on L 2( Gamma) for all Lipschitz Gamma in 2 d or whether, for all Lipschitz Gamma in 2 d and 3 d, or at least for the smaller class of Lipschitz polyhedra in 3 d, the weaker condition holds that the operators pm frac 1 2 I D are compact perturbations of coercive operators this a necessary and sufficient condition for the convergence of the Galerkin method for every sequence of subspaces ( mathcal H N) N 1 infty that is asymptotically dense in L 2( Gamma) . We settle these open questions negatively. We give examples of 2 d and 3 d Lipschitz domains with Lipschitz constant equal to one for which the essential norm of D is geq 1 2 , and examples with Lipschitz constant two for which the operators pm frac 1 2 I D are not coercive plus compact. We also give, for every C 0 , examples of Lipschitz polyhedra for which the essential norm is geq C and for which lambda I D is not a compact perturbation of a coercive operator for any real or complex lambda with lambda leq C . Finally, we resolve negatively a related open question in the convergence theory for collocation methods.


AET EFN A Versatile Design for Static and Dynamic Event Based Vision. The neuromorphic event cameras, which capture the optical changes of a scene, have drawn increasing attention due to their high speed and low power consumption. However, the event data are noisy, sparse, and nonuniform in the spatial temporal domain with an extremely high temporal resolution, making it challenging to design backend algorithms for event based vision. Existing methods encode events into point cloud based or voxel based representations, but suffer from noise and or information loss. Additionally, there is little research that systematically studies how to handle static and dynamic scenes with one universal design for event based vision. This work proposes the Aligned Event Tensor (AET) as a novel event data representation, and a neat framework called Event Frame Net (EFN), which enables our model for event based vision under static and dynamic scenes. The proposed AET and EFN are evaluated on various datasets, and proved to surpass existing state of the art methods by large margins. Our method is also efficient and achieves the fastest inference speed among others.


Reproducibility Companion Paper Knowledge Enhanced Neural Fashion Trend Forecasting. This companion paper supports the replication of the fashion trend forecasting experiments with the KERN (Knowledge Enhanced Recurrent Network) method that we presented in the ICMR 2020. We provide an artifact that allows the replication of the experiments using a Python implementation. The artifact is easy to deploy with simple installation, training and evaluation. We reproduce the experiments conducted in the original paper and obtain similar performance as previously reported. The replication results of the experiments support the main claims in the original paper.


Seed Word Selection for Weakly Supervised Text Classification with Unsupervised Error Estimation. Weakly supervised text classification aims to induce text classifiers from only a few user provided seed words. The vast majority of previous work assumes high quality seed words are given. However, the expert annotated seed words are sometimes non trivial to come up with. Furthermore, in the weakly supervised learning setting, we do not have any labeled document to measure the seed words' efficacy, making the seed word selection process "a walk in the dark". In this work, we remove the need for expert curated seed words by first mining (noisy) candidate seed words associated with the category names. We then train interim models with individual candidate seed words. Lastly, we estimate the interim models' error rate in an unsupervised manner. The seed words that yield the lowest estimated error rates are added to the final seed word set. A comprehensive evaluation of six binary classification tasks on four popular datasets demonstrates that the proposed method outperforms a baseline using only category name seed words and obtained comparable performance as a counterpart using expert annotated seed words.


Effects of Different Optimization Formulations in Evolutionary Reinforcement Learning on Diverse Behavior Generation. Generating various strategies for a given task is challenging. However, it has already proven to bring many assets to the main learning process, such as improved behavior exploration. With the growth in the interest of heterogeneity in solution in evolutionary computation and reinforcement learning, many promising approaches have emerged. To better understand how one guides multiple policies toward distinct strategies and benefit from diversity, we need to analyze further the influence of the reward signal modulation and other evolutionary mechanisms on the obtained behaviors. To that effect, this paper considers an existing evolutionary reinforcement learning framework which exploits multi objective optimization as a way to obtain policies that succeed at behavior related tasks as well as completing the main goal. Experiments on the Atari games stress that optimization formulations which do not consider objectives equally fail at generating diversity and even output agents that are worse at solving the problem at hand, regardless of the obtained behaviors.


SparseBERT Rethinking the Importance Analysis in Self attention. Transformer based models are popularly used in natural language processing (NLP). Its core component, self attention, has aroused widespread interest. To understand the self attention mechanism, a direct method is to visualize the attention map of a pre trained model. Based on the patterns observed, a series of efficient Transformers with different sparse attention masks have been proposed. From a theoretical perspective, universal approximability of Transformer based models is also recently proved. However, the above understanding and analysis of self attention is based on a pre trained model. To rethink the importance analysis in self attention, we study the significance of different positions in attention matrix during pre training. A surprising result is that diagonal elements in the attention map are the least important compared with other attention positions. We provide a proof showing that these diagonal elements can indeed be removed without deteriorating model performance. Furthermore, we propose a Differentiable Attention Mask (DAM) algorithm, which further guides the design of the SparseBERT. Extensive experiments verify our interesting findings and illustrate the effect of the proposed algorithm.


Mild Stochastic Sewing Lemma, SPDE in Random Environment, and Fractional Averaging. Our first result is a stochastic sewing lemma with quantitative estimates for mild incremental processes, with which we study SPDEs driven by fractional Brownian motions in a random environment. We obtain uniform L p bounds. Our second result is a fractional averaging principle admitting non stationary fast environments. As an application, we prove a fractional averaging principle for SPDEs.


Collapsing and noncollapsing in convex ancient mean curvature flow. We provide several characterisations of collapsing and noncollapsing in convex ancient mean curvature flow, establishing in particular that collapsing occurs if and only if the flow is asymptotic to at least one Grim hyperplane. As a consequence, we rule out collapsing singularity models in (n 1) convex mean curvature flow (even when the initial datum is only immersed). Explicit counterexamples show that (n 1) convexity is optimal. We are also able to rule out collapsing singularity models for suitably pinched solutions of higher codimension.


Resolving the two envelope paradox. Consider the following game You are given two indistinguishable envelopes, each containing money. One contains twice as much as the other. You may pick one envelope and keep the money it contains. Having chosen an envelope, you are given the chance to switch envelopes. Should you switch? The intuitive answer is that it makes no difference, since you are equally likely to have picked the envelope with the higher or the lower amount. However, a naive expected value calculation implies you gain by switching, since you have 50 chance of doubling and 50 chance of halving your current winnings, and so if the first chosen envelope contains X, then switching gives an expected final value of (X 2 2X) 2 X . That seems like a paradox. We prove that the former is the correct answer, and show how the apparent "paradox" can be resolved.


Accelerating Abelian Random Walks with Hyperbolic Dynamics. Given integers d geq 2, n geq 1 , we consider affine random walks on torii ( mathbb Z n mathbb Z ) d defined as X t 1 A X t B t mod n , where A in mathrm GL d ( mathbb Z ) is an invertible matrix with integer entries and (B t ) t geq 0 is a sequence of iid random increments on mathbb Z d . We show that when A has no eigenvalues of modulus 1 , this random walk mixes in O( log n log log n) steps as n rightarrow infty , and mixes actually in O( log n) steps only for almost all n . These results generalize those on the so called Chung Diaconis Graham process, which corresponds to the case d 1 . Our proof is based on the initial arguments of Chung, Diaconis and Graham, and relies extensively on the properties of the dynamical system x mapsto A top x on the continuous torus mathbb R d mathbb Z d . Having no eigenvalue of modulus one makes this dynamical system a hyperbolic toral automorphism, a typical example of a chaotic system known to have a rich behaviour. As such our proof sheds new light on the speed up gained by applying a deterministic map to a Markov chain.


Optimal trade execution under small market impact and portfolio liquidation with semimartingale strategies. We consider an optimal liquidation problem with instantaneous price impact and stochastic resilience for small instantaneous impact factors. Within our modelling framework, the optimal portfolio process converges to the solution of an optimal liquidation problem with general semimartingale controls when the instantaneous impact factor converges to zero. Our results provide a unified framework within which to embed the two most commonly used modelling frameworks in the liquidation literature and provide a microscopic foundation for the use of semimartingale liquidation strategies and the use of portfolio processes of unbounded variation. Our convergence results are based on novel convergence results for BSDEs with singular terminal conditions and novel representation results of BSDEs in terms of uniformly continuous functions of forward processes.


Rapid Assessments of Light Duty Gasoline Vehicle Emissions Using On Road Remote Sensing and Machine Learning. In time and accurate assessments of on road vehicle emissions play a central role in urban air quality and health policymaking. However, official insight is hampered by the Inspection Maintenance (I M) procedure conducted in the laboratory annually. It not only has a large gap to real world situations (e.g., meteorological conditions) but also is incapable of regular supervision. Here we build a unique dataset including 103831 light duty gasoline vehicles, in which on road remote sensing (ORRS) measurements are linked to the I M records based on the vehicle identification numbers and license plates. On this basis, we develop an ensemble model framework that integrates three machining learning algorithms, including neural network (NN), extreme gradient boosting (XGBoost), and random forest (RF). We demonstrate that this ensemble model could rapidly assess the vehicle specific emissions (i.e., CO, HC, and NO). In particular, the model performs quite well for the passing vehicles under normal conditions (i.e., lower VSP ( 18 kw t), temperature (6 32 deg C), relative humidity ( 80 ), and wind speed ( 5m s)). Together with the current emission standard, we identify a large number of the dirty (2.33 ) or clean (74.92 ) vehicles in the real world. Our results show that the ORRS measurements, assisted by the machine learning based ensemble model developed here, can realize day to day supervision of on road vehicle specific emissions. This approach framework provides a valuable opportunity to reform the I M procedures globally and mitigate urban air pollution deeply.


OPES On the fly Probability Enhanced Sampling Method. Molecular simulations are playing an ever increasing role, finding applications in fields as varied as physics, chemistry, biology and material science. However, many phenomena of interest take place on time scales that are out of reach of standard molecular simulations. This is known as the sampling problem and over the years several enhanced sampling methods have been developed to mitigate this issue. We propose a unified approach that puts on the same footing the two most popular families of enhanced sampling methods, and paves the way for novel combined approaches. The on the fly probability enhanced sampling method provides an efficient implementation of such generalized approach, while also focusing on simplicity and robustness.


MVLayoutNet 3D layout reconstruction with multi view panoramas. We present MVLayoutNet, an end to end network for holistic 3D reconstruction from multi view panoramas. Our core contribution is to seamlessly combine learned monocular layout estimation and multi view stereo (MVS) for accurate layout reconstruction in both 3D and image space. We jointly train a layout module to produce an initial layout and a novel MVS module to obtain accurate layout geometry. Unlike standard MVSNet 33 , our MVS module takes a newly proposed layout cost volume, which aggregates multi view costs at the same depth layer into corresponding layout elements. We additionally provide an attention based scheme that guides the MVS module to focus on structural regions. Such a design considers both local pixel level costs and global holistic information for better reconstruction. Experiments show that our method outperforms state of the arts in terms of depth rmse by 21.7 and 20.6 on the 2D 3D S 1 and ZInD 5 datasets. Finally, our method leads to coherent layout geometry that enables the reconstruction of an entire scene.


A note on overline 2 separable codes and B 2 codes. We derive a simple proof, based on information theoretic inequalities, of an upper bound on the largest rates of q ary overline 2 separable codes that improves recent results of Wang for any q geq 13 . For the case q 2 , we recover a result of Lindstr "om, but with a much simpler derivation. The method easily extends to give bounds on B 2 codes which, although not improving on Wang's results, use much simpler tools and might be useful for future applications.


DocNLI A Large scale Dataset for Document level Natural Language Inference. Natural language inference (NLI) is formulated as a unified framework for solving various NLP problems such as relation extraction, question answering, summarization, etc. It has been studied intensively in the past few years thanks to the availability of large scale labeled datasets. However, most existing studies focus on merely sentence level inference, which limits the scope of NLI's application in downstream NLP problems. This work presents DocNLI a newly constructed large scale dataset for document level NLI. DocNLI is transformed from a broad range of NLP problems and covers multiple genres of text. The premises always stay in the document granularity, whereas the hypotheses vary in length from single sentences to passages with hundreds of words. Additionally, DocNLI has pretty limited artifacts which unfortunately widely exist in some popular sentence level NLI datasets. Our experiments demonstrate that, even without fine tuning, a model pretrained on DocNLI shows promising performance on popular sentence level benchmarks, and generalizes well to out of domain NLP tasks that rely on inference at document granularity. Task specific fine tuning can bring further improvements. Data, code, and pretrained models can be found at https github.com salesforce DocNLI.


Impact of class imbalance on chest x ray classifiers towards better evaluation practices for discrimination and calibration performance. This work aims to analyze standard evaluation practices adopted by the research community when assessing chest x ray classifiers, particularly focusing on the impact of class imbalance in such appraisals. Our analysis considers a comprehensive definition of model performance, covering not only discriminative performance but also model calibration, a topic of research that has received increasing attention during the last years within the machine learning community. Firstly, we conducted a literature study to analyze common scientific practices and confirmed that (1) even when dealing with highly imbalanced datasets, the community tends to use metrics that are dominated by the majority class and (2) it is still uncommon to include calibration studies for chest x ray classifiers, albeit its importance in the context of healthcare. Secondly, we perform a systematic experiment on two major chest x ray datasets to explore the behavior of several performance metrics under different class ratios and show that widely adopted metrics can conceal the performance in the minority class. Finally, we recommend the inclusion of complementary metrics to better reflect the system's performance in such scenarios. Our study indicates that current evaluation practices adopted by the research community for chest x ray computer aided diagnosis systems may not reflect their performance in real clinical scenarios, and suggest alternatives to improve this situation.


An Attractor Guided Neural Networks for Skeleton Based Human Motion Prediction. Joint relation modeling is a curial component in human motion prediction. Most existing methods tend to design skeletal based graphs to build the relations among joints, where local interactions between joint pairs are well learned. However, the global coordination of all joints, which reflects human motion's balance property, is usually weakened because it is learned from part to whole progressively and asynchronously. Thus, the final predicted motions are sometimes unnatural. To tackle this issue, we learn a medium, called balance attractor (BA), from the spatiotemporal features of motion to characterize the global motion features, which is subsequently used to build new joint relations. Through the BA, all joints are related synchronously, and thus the global coordination of all joints can be better learned. Based on the BA, we propose our framework, referred to Attractor Guided Neural Network, mainly including Attractor Based Joint Relation Extractor (AJRE) and Multi timescale Dynamics Extractor (MTDE). The AJRE mainly includes Global Coordination Extractor (GCE) and Local Interaction Extractor (LIE). The former presents the global coordination of all joints, and the latter encodes local interactions between joint pairs. The MTDE is designed to extract dynamic information from raw position information for effective prediction. Extensive experiments show that the proposed framework outperforms state of the art methods in both short and long term predictions in H3.6M, CMU Mocap, and 3DPW.


Local and global well posedness in L 2 ( mathbb R n ) for the inhomogeneous nonlinear Schr " o dinger equation. This paper investigates the local and global well posedness for the inhomogeneous nonlinear Schr " o dinger (INLS) equation iu t Delta u lambda left x right b left u right sigma u, u(0) u 0 in L 2 ( mathbb R n ) , where lambda in mathbb C , 0 b min left 2, rm n right and 0 sigma le frac 4 2b n . We prove the local well posedness and small data global well posedness of the INLS equation in the mass critical case sigma frac 4 2b n , which have remained open until now. We also obtain some local well posedness results in the mass subcritical case sigma frac 4 2b n . In order to obtain the results above, we establish the Strichartz estimates in Lorentz spaces and use the contraction mapping principle based on Strichartz estimates.


GRAPHOPT constrained optimization based parallelization of irregular graphs. Sparse, irregular graphs show up in various applications like linear algebra, machine learning, engineering simulations, robotic control, etc. These graphs have a high degree of parallelism, but their execution on parallel threads of modern platforms remains challenging due to the irregular data dependencies. The execution performance can be improved by efficiently partitioning the graphs such that the communication and thread synchronization overheads are minimized without hurting the utilization of the threads. To achieve this, this paper proposes GRAPHOPT, a tool that models the graph parallelization as a constrained optimization problem and uses the open Google OR Tools solver to find good partitions. Several scalability techniques are developed to handle large real world graphs with millions of nodes and edges. Extensive experiments are performed on the graphs of sparse matrix triangular solves (linear algebra) and sum product networks (machine learning), respectively, showing a mean speedup of 2.0X and 1.8X over previous state of the art libraries, demonstrating the effectiveness of the constrained optimization based graph parallelization.


Debt Swapping for Risk Mitigation in Financial Networks. We study financial networks where banks are connected by debt contracts. We consider the operation of debt swapping when two creditor banks decide to exchange an incoming payment obligation, thus leading to a locally different network structure. We say that a swap is positive if it is beneficial for both of the banks involved we can interpret this notion either with respect to the amount of assets received by the banks, or their exposure to different shocks that might hit the system. We analyze various properties of these swapping operations in financial networks. We first show that there can be no positive swap for any pair of banks in a static financial system, or when a shock hits each bank in the network proportionally. We then study worst case shock models, when a shock of given size is distributed in the worst possible way for a specific bank. If the goal of banks is to minimize their losses in such a worst case setting, then a positive swap can indeed exist. We analyze the effects of such a positive swap on other banks of the system, the computational complexity of finding a swap, and special cases where a swap can be found efficiently. Finally, we also present some results for more complex swapping operations when the banks swap multiple contracts, or when more than two banks participate in the swap.


Combined function optics for circular high energy hadron colliders. The design of future circular high energy hadron colliders is based on the achievement of challenging magnetic fields, needed to keep the hadron beams orbiting along the ring circumference. The strength of the dipolar magnetic field is a function of the machine radius, beam energy, and of the fraction of the ring circumference that can be filled with dipoles. In this paper we propose to use a combined function periodic cell to maximise the filling factor of the dipole magnets. The optical properties of the proposed periodic structure are discussed in detail together with the design of the superconducting magnets needed to implement the proposed approach.


Context, Judgement, Deduction. We introduce judgemental theories and their calculi as a general framework to present and study deductive systems. As an exemplification of their expressivity, we approach dependent type theory and natural deduction as special kinds of judgemental theories. Our analysis sheds light on both the topics, providing a new point of view. In the case of type theory, we provide an abstract definition of type constructor featuring the usual formation, introduction, elimination and computation rules. For natural deduction we offer a deep analysis of structural rules, demystifying some of their properties, and putting them into context. We finish the paper discussing the internal logic of a topos, a predicative topos, an elementary 2 topos et similia, and show how these can be organized in judgemental theories.


Connecting Deep Reinforcement Learning based Obstacle Avoidance with Conventional Global Planners using Waypoint Generators. Deep Reinforcement Learning has emerged as an efficient dynamic obstacle avoidance method in highly dynamic environments. It has the potential to replace overly conservative or inefficient navigation approaches. However, the integration of Deep Reinforcement Learning into existing navigation systems is still an open frontier due to the myopic nature of Deep Reinforcement Learning based navigation, which hinders its widespread integration into current navigation systems. In this paper, we propose the concept of an intermediate planner to interconnect novel Deep Reinforcement Learning based obstacle avoidance with conventional global planning methods using waypoint generation. Therefore, we integrate different waypoint generators into existing navigation systems and compare the joint system against traditional ones. We found an increased performance in terms of safety, efficiency and path smoothness especially in highly dynamic environments.


Poncelet Plectra Harmonious Curves in Cosine Space. It has been shown that the family of Poncelet N gons in the confocal pair (elliptic billiard) conserves the sum of cosines of its internal angles. Curiously, this quantity is equal to the sum of cosines conserved by its affine image where the caustic is a circle. We show that furthermore, (i) when N 3, the cosine triples of both families sweep the same planar curve an equilateral cubic resembling a plectrum (guitar pick). We also show that (ii) the family of triangles excentral to the confocal family conserves the same product of cosines as the one conserved by its affine image inscribed in a circle and that (iii) cosine triples of both families sweep the same spherical curve. When the triple of log cosines is considered, this curve becomes a planar, plectrum shaped curve, rounder than the one swept by its parent confocal family.


Translated sums of primitive sets. The Erd H o s primitive set conjecture states that the sum f(A) sum a in A frac 1 a log a , ranging over any primitive set A of positive integers, is maximized by the set of prime numbers. Recently Laib, Derbal, and Mechik proved that the translated Erd H o s conjecture for the sum f(A,h) sum a in A frac 1 a( log a h) is false starting at h 81 , by comparison with semiprimes. In this note we prove that such falsehood occurs already at h 1.04 cdots , and show this translate is best possible for semiprimes. We also obtain results for translated sums of k almost primes with larger k .


Multivariate Empirical Mode Decomposition based Hybrid Model for Day ahead Peak Load Forecasting. Accurate day ahead peak load forecasting is crucial not only for power dispatching but also has a great interest to investors and energy policy maker as well as government. Literature reveals that 1 error drop of forecast can reduce 10 million pounds operational cost. Thus, this study proposed a novel hybrid predictive model built upon multivariate empirical mode decomposition (MEMD) and support vector regression (SVR) with parameters optimized by particle swarm optimization (PSO), which is able to capture precise electricity peak load. The novelty of this study mainly comes from the application of MEMD, which enables the multivariate data decomposition to effectively extract inherent information among relevant variables at different time frequency during the deterioration of multivariate over time. Two real world load data sets from the New South Wales (NSW) and the Victoria (VIC) in Australia have been considered to verify the superiority of the proposed MEMD PSO SVR hybrid model. The quantitative and comprehensive assessments are performed, and the results indicate that the proposed MEMD PSO SVR method is a promising alternative for day ahead electricity peak load forecasting.


Hyperpolarized solution state NMR spectroscopy with optically polarized crystals. Nuclear spin hyperpolarization provides a promising route to overcome the challenges imposed by the limited sensitivity of nuclear magnetic resonance. Here we demonstrate that dissolution of spin polarized pentacene doped naphthalene crystals enables transfer of polarization to target molecules via intermolecular cross relaxation at room temperature and moderate magnetic fields (1.45 , T). This makes it possible to exploit the high spin polarization of optically polarized crystals while mitigating the challenges of its transfer to external nuclei, particularly of the large distances and prohibitively weak coupling between source and target nuclei across solid solid or solid liquid interfaces. With this method, here we inject the highly polarized mixture into a benchtop NMR spectrometer and observe the polarization dynamics for target 1 H nuclei. Although the spectra are radiation damped due to the high naphthalene magnetization, we describe a procedure to process the data in order to obtain more conventional NMR spectra, and extract the target nuclei polarization. With the entire process occurring on a timescale of one minute, we observe NMR signals enhanced by factors between 200 and 1730 at 1.45 , T for a range of small molecules.


Efficient narrowband teraherz radiation from electrostatic wakefields in non uniform plasmas. Abstract It is shown that electrostatic plasma wakefields can efficiently radiate at harmonics of the plasma frequency when the plasma has a positive density gradient along the propagation direction of a driver. The driver propagating at a sub luminal group velocity excites the plasma wakefield with the same phase velocity. However, due to the positive density gradient, the wake phase velocity steadily increases behind the driver. As soon as the phase velocity becomes super luminal, the electrostatic wakefield couples efficiently to radiative electromagnetic modes. The period of time when the phase velocity stays above the speed of light depends on the density gradient scale length. The wake radiates at harmonics of the plasma frequency in the teraherz (THz) band. The angle of emission depends on the gradient scale and the time passed behind the driver. For appropriate plasma and driver parameters, the wake can radiate away nearly all its energy, which potentially results in an efficient, narrow band and tunable source of THz radiation.


Zoo Tuning Adaptive Transfer from a Zoo of Models. With the development of deep networks on various large scale datasets, a large zoo of pretrained models are available. When transferring from a model zoo, applying classic single model based transfer learning methods to each source model suffers from high computational burden and cannot fully utilize the rich knowledge in the zoo. We propose emph Zoo Tuning to address these challenges, which learns to adaptively transfer the parameters of pretrained models to the target task. With the learnable channel alignment layer and adaptive aggregation layer, Zoo Tuning emph adaptively aggregates channel aligned pretrained parameters to derive the target model, which promotes knowledge transfer by simultaneously adapting multiple source models to downstream tasks. The adaptive aggregation substantially reduces the computation cost at both training and inference. We further propose lite Zoo Tuning with the temporal ensemble of batch average gating values to reduce the storage cost at the inference time. We evaluate our approach on a variety of tasks, including reinforcement learning, image classification, and facial landmark detection. Experiment results demonstrate that the proposed adaptive transfer learning approach can transfer knowledge from a zoo of models more effectively and efficiently.


Evaluating the effectiveness of Phishing Reports on Twitter. Phishing attacks are an increasingly potent web based threat, with nearly 1.5 million websites created on a monthly basis. In this work, we present the first study towards identifying such attacks through phishing reports shared by users on Twitter. We evaluated over 16.4k such reports posted by 701 Twitter accounts between June to August 2021, which contained 11.1k unique URLs, and analyzed their effectiveness using various quantitative and qualitative measures. Our findings indicate that not only do these users share a high volume of legitimate phishing URLs, but these reports contain more information regarding the phishing websites (which can expedite the process of identifying and removing these threats), when compared to two popular open source phishing feeds PhishTank and OpenPhish. We also notice that the reported websites had very little overlap with the URLs existing in the other feeds, and also remained active for longer periods of time. But despite having these attributes, we found that these reports have very low interaction from other Twitter users, especially from the domains and organizations targeted by the reported URLs. Moreover, nearly 31 of these URLs were still active even after a week of them being reported, with 27 of them being detected by very few anti phishing tools, suggesting that a large majority of these reports remain undiscovered, despite the majority of the follower base of these accounts being security focused users. Thus, this work highlights the effectiveness of the reports, and the benefits of using them as an open source knowledge base for identifying new phishing websites.


Goods Transportation Problem Solving via Routing Algorithm. This paper outlines the ideas behind developing a graph based heuristic driven routing algorithm designed for a particular instance of a goods transportation problem with a single good type. The proposed algorithm solves the optimization problem of satisfying the demand of goods on a given undirected transportation graph with minimizing the estimated cost for each traversed segment of the delivery path. The operation of the routing algorithm is discussed and overall evaluation of the proposed problem solving technique is given.


Validation and parameter optimization of a hybrid embedded homogenized solid tumor perfusion model. The goal of this paper is to investigate the validity of a hybrid embedded homogenized in silico approach for modeling perfusion through solid tumors. The rationale behind this novel idea is that only the larger blood vessels have to be explicitly resolved while the smaller scales of the vasculature are homogenized. As opposed to typical discrete or fully resolved 1D 3D models, the required data can be obtained with in vivo imaging techniques since the morphology of the smaller vessels is not necessary. By contrast, the larger vessels, whose topology and structure is attainable non invasively, are resolved and embedded as one dimensional inclusions into the three dimensional tissue domain which is modeled as a porous medium. A sound mortar type formulation is employed to couple the two representations of the vasculature. We validate the hybrid model and optimize its parameters by comparing its results to a corresponding fully resolved model based on several well defined metrics. These tests are performed on a complex data set of three different tumor types with heterogeneous vascular architectures. The correspondence of the hybrid model in terms of mean representative elementary volume blood and interstitial fluid pressures is excellent with relative errors of less than 4 . Larger, but less important and explicable errors are present in terms of blood flow in the smaller, homogenized vessels. We finally discuss and demonstrate how the hybrid model can be further improved to apply it for studies on tumor perfusion and the efficacy of drug delivery.


An extremal subharmonic function in non archimedean potential theory. We define an analog of the Leja Siciak Zaharjuta subharmonic extremal function for a proper subset E of the Berkovich projective line P 1 over a field with a non archimedean absolute value, relative to a point zeta not in E . When E is a compact set with positive capacity, we prove that the upper semicontinuous regularization of this extremal function equals the Green function of E relative to zeta . As a separate result, we prove the Brelot Cartan principle, under the additional assumption that the Berkovich topology is second countable.


A superior two dimensional nanoporous graphene membrane for hydrogen separation. Hydrogen is one of the prime candidates for clean energy source with high energy density. However, current industrial methods of hydrogen production are difficult to provide hydrogen with high purity, thus hard to meet the requirements in many application scenarios. Consequently, the development of large scale and low cost hydrogen separation technology is urgently needed. In this work, the gas separation properties of a newly synthesized two dimensional nanoporous graphene (NPG) membrane material with patterned dumbbell shape nanopores are investigated. The permeation energy barriers of different gases through this membrane are calculated using the density functional theory (DFT) calculations. Molecular dynamics (MD) simulations are also employed to study the permeation behavior of H2 in binary mixtures with O2, CO2, CO, and CH4. Both the DFT and MD calculation results show that this newly synthesized NPG membrane material can provide a high permeability as well as an ultrahigh selectivity simultaneously, making it a prospective H2 separation membrane with superior performance.


Design a Technology Based on the Fusion of Genetic Algorithm, Neural network and Fuzzy logic. This paper describes the design and development of a prototype technique for artificial intelligence based on the fusion of genetic algorithm, neural network and fuzzy logic. It starts by establishing a relationship between the neural network and fuzzy logic. Then, it combines the genetic algorithm with them. Information fusions are at the confidence level, where matching scores can be reported and discussed. The technique is called the Genetic Neuro Fuzzy (GNF). It can be used for high accuracy real time environments.


An investigation into the turbulence induced by moving ice floes. Several phenomena are known to attenuate waves in the marginal ice zone, such as wave scattering due to ice floes, viscous dissipation inside the ice and energy dissipation caused by ice floe interactions. Our aim of this study is to investigate colliding ice floes and to quantify the Turbulent Kinetic Energy (TKE) dissipation in the surrounding water through direct observations. The field work was carried out in Van Mijen Fjord on Svalbard, where an artificial 3x4 m 2 ice floe was sawed out in the 1 m thick ice. Wave motion was simulated by pulling the ice floe back and forth in an oscillatory manner with two electrical winches in a 4x6 m 2 pool. Ice floe motion was measured with a range meter, and the water turbulence was measured with acoustic velocimeters. TKE frequency spectra were found to contain an inertial subrange where energy was cascading at a rate proportional to f ( 5 3). From the spectra estimated at several vertical positions, the TKE dissipation rate was found to decrease exponentially with depth. The total TKE dissipation rate was estimated by assuming that turbulence was induced over an area spanning over the ice floe width and the pool length. The preliminary energy budget suggests that approximately 60 of the input power from the winches was dissipated in turbulence, which experimentally confirms that energy dissipation by induced turbulent water motion is an important mechanism for colliding ice floe fields.


Temporal MPI Enabling Multi Plane Images for Dynamic Scene Modelling via Temporal Basis Learning. Novel view synthesis of static scenes has achieved remarkable advancements in producing photo realistic results. However, key challenges remain for immersive rendering for dynamic contents. For example, one of the seminal image based rendering frameworks, the multi plane image (MPI) produces high novel view synthesis quality for static scenes but faces difficulty in modeling dynamic parts. In addition, modeling dynamic variations through MPI may require huge storage space and long inference time, which hinders its application in real time scenarios. In this paper, we propose a novel Temporal MPI representation which is able to encode the rich 3D and dynamic variation information throughout the entire video as compact temporal basis. Novel views at arbitrary time instance will be able to be rendered real time with high visual quality due to the highly compact and expressive latent basis and the coefficients jointly learned. We show that given comparable memory consumption, our proposed Temporal MPI framework is able to generate a time instance MPI with only 0.002 seconds, which is up to 3000 times faster, with 3dB higher average view synthesis PSNR as compared with other state of the art dynamic scene modelling frameworks.


A novel pulsed magnet for magnetic linear birefringence measurements. In this paper, we describe a novel pulsed magnet, called Foil Coil, which can deliver a field transverse to the light propagation of more than 10 T over about 0.8 meters operating without cryogenic equipment. It has been designed for linear magnetic birefringence measurements. We report on testing the coil, and also show some physics data taken in vacuum during its commissioning in the framework of the BMV apparatus, with special attention to noise induced by the pulse itself. Finally, we compare the preliminary results obtained here, with data from the previous BMV coil.


Linear time determination of the scattering number for strictly chordal graphs. The scattering number of a graph G was defined by Jung in 1978 as sc(G) max omega(G S) S , S subseteq V, omega(G S) neq1 where omega(G S) is the number of connected components of the graph G S . It is a measure of vulnerability of a graph and it has a direct relationship with the toughness of a graph. Strictly chordal graphs, also known as block duplicate graphs, are a subclass of chordal graphs that includes block and 3 leaf power graphs. In this paper we present a linear time solution for the determination of the scattering number and scattering set of strictly chordal graphs. We show that, although the knowledge of the toughness of the class is helpful, it is not sufficient to provide an immediate result for determining the scattering number.


Trends in Neural Architecture Search Towards the Acceleration of Search. In modern deep learning research, finding optimal (or near optimal) neural network models is one of major research directions and it is widely studied in many applications. In this paper, the main research trends of neural architecture search (NAS) are classified as neuro evolutionary algorithms, reinforcement learning based algorithms, and one shot architecture search approaches. Furthermore, each research trend is introduced and finally all the major three trends are compared. Lastly, the future research directions of NAS research trends are discussed.


Automatic Story Generation Challenges and Attempts. The scope of this survey paper is to explore the challenges in automatic story generation. We hope to contribute in the following ways 1. Explore how previous research in story generation addressed those challenges. 2. Discuss future research directions and new technologies that may aid more advancements. 3. Shed light on emerging and often overlooked challenges such as creativity and discourse.


Quadrics in arithmetic statistics. We (re)introduce the circle method into arithmetic statistics. More specifically, we combine the circle method with Bhargava's counting technique in order to give a general method that allows one to treat arithmetic statistical problems in which one is trying to count orbits on a subvariety of affine space defined by the vanishing of a quadratic invariant. We explain this method by way of example by computing the average size of 2 Selmer groups in the families y 2 x 3 B and y 2 x 3 B 2 . In the course of the argument we introduce a smoothed form of Bhargava's aforementioned method, as well as a trick with which we formally deduce that the above averages are 3 from knowledge of the averages over "unconstrained" families.


MCS HMS A Multi Cluster Selection Strategy for the Human Mental Search Algorithm. Population based metaheuristic algorithms have received significant attention in global optimisation. Human Mental Search (HMS) is a relatively recent population based metaheuristic that has been shown to work well in comparison to other algorithms. However, HMS is time consuming and suffers from relatively poor exploration. Having clustered the candidate solutions, HMS selects a winner cluster with the best mean objective function. This is not necessarily the best criterion to choose the winner group and limits the exploration ability of the algorithm. In this paper, we propose an improvement to the HMS algorithm in which the best bids from multiple clusters are used to benefit from enhanced exploration. We also use a one step k means algorithm in the clustering phase to improve the speed of the algorithm. Our experimental results show that MCS HMS outperforms HMS as well as other population based metaheuristic algorithms


Shock identification and classification in 2D MHD compressible turbulence Orszag Tang vortex. Compressible magnetohydrodynamic (MHD) turbulence is a common feature of astrophysical systems such as the solar atmosphere and interstellar medium. Such systems are rife with shock waves that can redistribute and dissipate energy. For an MHD system, three broad categories of shocks exist (slow, fast or intermediate) however the occurrence rates of each shock type is not known for turbulent systems. Here we present a method for detecting and classifying the full range of MHD shocks applied to the Orszag Tang vortex. Our results show that the system is dominated by fast and slow shocks, with far less frequent intermediate shocks appearing most readily near magnetic reconnection sites. We present a potential mechanism that could lead to the formation of intermediate shocks in MHD systems, and study the coherency and abundances of shocks in compressible MHD turbulence.


About the number of oriented Hamiltonian paths and cycles in tournaments. We prove that a tournament and its complement contain the same number of oriented Hamiltonian paths (resp. cycles) of any given type, as a generalization of Rosenfeld's result proved for antidirected paths.


Relative poset polytopes and semitoric degenerations. The two best studied toric degenerations of the flag variety are those given by the Gelfand Tsetlin and FFLV polytopes. Each of them degenerates further into a particular monomial variety which raises the problem of describing the degenerations intermediate between the toric and the monomial ones. Using a theorem of Zhu one may show that every such degeneration is semitoric with irreducible components given by a regular subdivision of the corresponding polytope. This leads one to study the parts that appear in such subdivisions as well as the associated toric varieties. It turns out that these parts lie in a certain new family of poset polytopes which we term relative poset polytopes each is given by a poset and a weakening of its order relation. In this paper we give an in depth study of (both common and marked) relative poset polytopes and their toric varieties in the generality of an arbitrary poset. We then apply these results to degenerations of flag varieties. We also show that our family of polytopes generalizes the family studied in a series of papers by Fang, Fourier, Litza and Pegel while sharing their key combinatorial properties such as pairwise Ehrhart equivalence and Minkowski additivity.


Event2Graph Event driven Bipartite Graph for Multivariate Time series Anomaly Detection. Modeling inter dependencies between time series is the key to achieve high performance in anomaly detection for multivariate time series data. The de facto solution to model the dependencies is to feed the data into a recurrent neural network (RNN). However, the fully connected network structure underneath the RNN (either GRU or LSTM) assumes a static and complete dependency graph between time series, which may not hold in many real world applications. To alleviate this assumption, we propose a dynamic bipartite graph structure to encode the inter dependencies between time series. More concretely, we model time series as one type of nodes, and the time series segments (regarded as event) as another type of nodes, where the edge between two types of nodes describe a temporal pattern occurred on a specific time series at a certain time. Based on this design, relations between time series can be explicitly modelled via dynamic connections to event nodes, and the multivariate time series anomaly detection problem can be formulated as a self supervised, edge stream prediction problem in dynamic graphs. We conducted extensive experiments to demonstrate the effectiveness of the design.


Firm non expansive mappings in weak metric spaces. We introduce the notion of firm non expansive mapping in weak metric spaces, extending previous work for Banach spaces and certain geodesic spaces. We prove that, for firm non expansive mappings, the minimal displacement, the linear rate of escape, and the asymptotic step size are all equal. This generalises a theorem by Reich and Shafrir.


An AI based Learning Companion Promoting Lifelong Learning Opportunities for All. Artifical Intelligence (AI) in Education has great potential for building more personalised curricula, as well as democratising education worldwide and creating a Renaissance of new ways of teaching and learning. We believe this is a crucial moment for setting the foundations of AI in education in the beginning of this Fourth Industrial Revolution. This report aims to synthesize how AI might change (and is already changing) how we learn, as well as what technological features are crucial for these AI systems in education, with the end goal of starting this pressing dialogue of how the future of AI in education should unfold, engaging policy makers, engineers, researchers and obviously, teachers and learners. This report also presents the advances within the X5GON project, a European H2020 project aimed at building and deploying a cross modal, cross lingual, cross cultural, cross domain and cross site personalised learning platform for Open Educational Resources (OER).


Escape and absorption probabilities for obliquely reflected Brownian motion in a quadrant. We consider an obliquely reflected Brownian motion Z with positive drift in a quadrant stopped at time T , where T inf t 0 Z(t) (0,0) is the first hitting time of the origin. Such a process can be defined even in the non standard case where the reflection matrix is not completely mathcal S . We show that in this case the process has two possible behaviors either it tends to infinity or it hits the corner (origin) in a finite time. Given an arbitrary starting point (u,v) in the quadrant, we consider the escape (resp. absorption) probabilities mathbb P (u,v) T infty (resp. mathbb P (u,v) T infty ). We establish the partial differential equations and the oblique Neumann boundary conditions which characterize the escape probability and provide a functional equation satisfied by the Laplace transform of the escape probability. We then give asymptotics for the absorption probability in the simpler case where the starting point in the quadrant is (u,0) . We exhibit a remarkable geometric condition on the parameters which characterizes the case where the absorption probability has a product form and is exponential. We call this new criterion the dual skew symmetry condition due to its natural connection with the skew symmetry condition for the stationary distribution. We then obtain an explicit integral expression for the Laplace transform of the escape probability. We conclude by presenting exact asymptotics for the escape probability at the origin.


Leveraging Table Content for Zero shot Text to SQL with Meta Learning. Single table text to SQL aims to transform a natural language question into a SQL query according to one single table. Recent work has made promising progress on this task by pre trained language models and a multi submodule framework. However, zero shot table, that is, the invisible table in the training set, is currently the most critical bottleneck restricting the application of existing approaches to real world scenarios. Although some work has utilized auxiliary tasks to help handle zero shot tables, expensive extra manual annotation limits their practicality. In this paper, we propose a new approach for the zero shot text to SQL task which does not rely on any additional manual annotations. Our approach consists of two parts. First, we propose a new model that leverages the abundant information of table content to help establish the mapping between questions and zero shot tables. Further, we propose a simple but efficient meta learning strategy to train our model. The strategy utilizes the two step gradient update to force the model to learn a generalization ability towards zero shot tables. We conduct extensive experiments on a public open domain text to SQL dataset WikiSQL and a domain specific dataset ESQL. Compared to existing approaches using the same pre trained model, our approach achieves significant improvements on both datasets. Compared to the larger pre trained model and the tabular specific pre trained model, our approach is still competitive. More importantly, on the zero shot subsets of both the datasets, our approach further increases the improvements.


Sign Changes of Coefficients of Powers of the Infinite Borwein Product. We denote by c t (m) (n) the coefficient of q n in the series expansion of (q q) infty m(q t q t) infty m , which is the m th power of the infinite Borwein product. Let t and m be positive integers with m(t 1) leq 24 . We provide asymptotic formula for c t (m) (n) , and give characterizations of n for which c t (m) (n) is positive, negative or zero. We show that c t (m) (n) is ultimately periodic in sign and conjecture that this is still true for other positive integer values of t and m . Furthermore, we confirm this conjecture in the cases (t,m) (2,m),(p,1),(p,3) for arbitrary positive integer m and prime p .


Emotion analysis and detection during COVID 19. Crises such as natural disasters, global pandemics, and social unrest continuously threaten our world and emotionally affect millions of people worldwide in distinct ways. Understanding emotions that people express during large scale crises helps inform policy makers and first responders about the emotional states of the population as well as provide emotional support to those who need such support. We present CovidEmo, 3K English tweets labeled with emotions and temporally distributed across 18 months. Our analyses reveal the emotional toll caused by COVID 19, and changes of the social narrative and associated emotions over time. Motivated by the time sensitive nature of crises and the cost of large scale annotation efforts, we examine how well large pre trained language models generalize across domains and timeline in the task of perceived emotion prediction in the context of COVID 19. Our analyses suggest that cross domain information transfers occur, yet there are still significant gaps. We propose semi supervised learning as a way to bridge this gap, obtaining significantly better performance using unlabeled data from the target domain.


Noise Modulation Let Your Model Interpret Itself. Given the great success of Deep Neural Networks(DNNs) and the black box nature of it,the interpretability of these models becomes an important issue.The majority of previous research works on the post hoc interpretation of a trained model.But recently, adversarial training shows that it is possible for a model to have an interpretable input gradient through training.However,adversarial training lacks efficiency for interpretability.To resolve this problem, we construct an approximation of the adversarial perturbations and discover a connection between adversarial training and amplitude modulation. Based on a digital analogy,we propose noise modulation as an efficient and model agnostic alternative to train a model that interprets itself with input gradients.Experiment results show that noise modulation can effectively increase the interpretability of input gradients model agnosticly.


NorDial A Preliminary Corpus of Written Norwegian Dialect Use. Norway has a large amount of dialectal variation, as well as a general tolerance to its use in the public sphere. There are, however, few available resources to study this variation and its change over time and in more informal areas, eg on social media. In this paper, we propose a first step to creating a corpus of dialectal variation of written Norwegian. We collect a small corpus of tweets and manually annotate them as Bokm aa l, Nynorsk, any dialect, or a mix. We further perform preliminary experiments with state of the art models, as well as an analysis of the data to expand this corpus in the future. Finally, we make the annotations and models available for future work.


Single Photon Vibrometry. We propose and demonstrate a single photon sensitive technique for optical vibrometry. It uses high speed photon counting to sample the modulated backscattering from a vibrating target. Designed for remote vibration sensing with ultralow photon flux, we show that this technique can detect small displacements down to 110 nm and resolve vibration frequencies from DC up to several kilohertz, with less than 0.01 detected photons per pulse. This single photon sensitive optical vibrometry may find important applications in acousto optic sensing and imaging, especially in photon starved environments.


On the dimension distortions of quasi symmetric homeomorphisms. In this paper, we first generalize a result of Bishop and Steger Representation theoretic rigidity in PSL(2, R). Acta Math., 170, (1993), 121 149 by proving that for a Fuchsian group G of divergence type and non lattice, if h is a quasi symmetric homeomorphism of the real axis mathbb R corresponding to a quasi conformal compact deformation of G . Then for any E subset mathbb R , we have max(dim E , dim h( mathbb R setminus E)) 1 . Furthermore, we showed that Bishop and steger's result does not hold for the covering groups of all ' d dimensional jungle gym' (d is any positive integer) which generalizes G "onye's results Differentiability of quasi conformal maps on the jungle gym. Trans. Amer. Math. Soc. Vol 359 (2007), 9 32 where the author discussed the case of ' 1 dimensional jungle gym'.


Phy Q A Benchmark for Physical Reasoning. Humans are well versed in reasoning about the behaviors of physical objects when choosing actions to accomplish tasks, while it remains a major challenge for AI. To facilitate research addressing this problem, we propose a new benchmark that requires an agent to reason about physical scenarios and take an action accordingly. Inspired by the physical knowledge acquired in infancy and the capabilities required for robots to operate in real world environments, we identify 15 essential physical scenarios. For each scenario, we create a wide variety of distinct task templates, and we ensure all the task templates within the same scenario can be solved by using one specific physical rule. By having such a design, we evaluate two distinct levels of generalization, namely the local generalization and the broad generalization. We conduct an extensive evaluation with human players, learning agents with varying input types and architectures, and heuristic agents with different strategies. The benchmark gives a Phy Q (physical reasoning quotient) score that reflects the physical reasoning ability of the agents. Our evaluation shows that 1) all agents fail to reach human performance, and 2) learning agents, even with good local generalization ability, struggle to learn the underlying physical reasoning rules and fail to generalize broadly. We encourage the development of intelligent agents with broad generalization abilities in physical domains.


Minimal Euler Characteristics for Even Dimensional Manifolds with Finite Fundamental Group. We consider the Euler characteristics chi(M) of closed orientable topological 2n manifolds with (n 1) connected universal cover and a given fundamental group G of type F n . We define q 2n (G) , a generalized version of the Hausmann Weinberger invariant for 4 manifolds, as the minimal value of ( 1) n chi (M) . For all n geq 2 , we establish a strengthened and extended version of their estimates, in terms of explicit cohomological invariants of G . As an application we obtain new restrictions for non abelian finite groups arising as fundamental groups of rational homology 4 spheres.


Towards Real World Blind Face Restoration with Generative Facial Prior. Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. However, very low quality inputs cannot offer accurate geometric prior while high quality references are inaccessible, limiting the applicability in real world scenarios. In this work, we propose GFP GAN that leverages rich and diverse priors encapsulated in a pretrained face GAN for blind face restoration. This Generative Facial Prior (GFP) is incorporated into the face restoration process via novel channel split spatial feature transform layers, which allow our method to achieve a good balance of realness and fidelity. Thanks to the powerful generative facial prior and delicate designs, our GFP GAN could jointly restore facial details and enhance colors with just a single forward pass, while GAN inversion methods require expensive image specific optimization at inference. Extensive experiments show that our method achieves superior performance to prior art on both synthetic and real world datasets.


Impartial selection with prior information. We study the problem of em impartial selection , a topic that lies at the intersection of computational social choice and mechanism design. The goal is to select the most popular individual among a set of community members. The input can be modeled as a directed graph, where each node represents an individual, and a directed edge indicates nomination or approval of a community member to another. An em impartial mechanism is robust to potential selfish behavior of the individuals and provides appropriate incentives to voters to report their true preferences by ensuring that the chance of a node to become a winner does not depend on its outgoing edges. The goal is to design impartial mechanisms that select a node with an in degree that is as close as possible to the highest in degree. We measure the efficiency of such a mechanism by the difference of these in degrees, known as its em additive approximation. In particular, we study the extent to which prior information on voters' preferences could be useful in the design of efficient deterministic impartial selection mechanisms with good additive approximation guarantees. We consider three models of prior information, which we call the em opinion poll , the em a prior popularity , and the em uniform model. We analyze the performance of a natural selection mechanism that we call em approval voting with default (AVD) and show that it achieves a O( sqrt n ln n ) additive guarantee for opinion poll and a O( ln 2n) for a priori popularity inputs, where n is the number of individuals. We consider this polylogarithmic bound as our main technical contribution. We complement this last result by showing that our analysis is close to tight, showing an Omega( ln n ) lower bound. This holds in the uniform model, which is the simplest among the three models.


Contrastive Explanations for Model Interpretability. Contrastive explanations clarify why an event occurred in contrast to another. They are more inherently intuitive to humans to both produce and comprehend. We propose a methodology to produce contrastive explanations for classification models by modifying the representation to disregard non contrastive information, and modifying model behavior to only be based on contrastive reasoning. Our method is based on projecting model representation to a latent space that captures only the features that are useful (to the model) to differentiate two potential decisions. We demonstrate the value of contrastive explanations by analyzing two different scenarios, using both high level abstract concept attribution and low level input token span attribution, on two widely used text classification tasks. Specifically, we produce explanations for answering for which label, and against which alternative label, is some aspect of the input useful? And which aspects of the input are useful for and against particular decisions? Overall, our findings shed light on the ability of label contrastive explanations to provide a more accurate and finer grained interpretability of a model's decision.


The Healthy States of America Creating a Health Taxonomy with Social Media. Since the uptake of social media, researchers have mined online discussions to track the outbreak and evolution of specific diseases or chronic conditions such as influenza or depression. To broaden the set of diseases under study, we developed a Deep Learning tool for Natural Language Processing that extracts mentions of virtually any medical condition or disease from unstructured social media text. With that tool at hand, we processed Reddit and Twitter posts, analyzed the clusters of the two resulting co occurrence networks of conditions, and discovered that they correspond to well defined categories of medical conditions. This resulted in the creation of the first comprehensive taxonomy of medical conditions automatically derived from online discussions. We validated the structure of our taxonomy against the official International Statistical Classification of Diseases and Related Health Problems (ICD 11), finding matches of our clusters with 20 official categories, out of 22. Based on the mentions of our taxonomy's sub categories on Reddit posts geo referenced in the U.S., we were then able to compute disease specific health scores. As opposed to counts of disease mentions or counts with no knowledge of our taxonomy's structure, we found that our disease specific health scores are causally linked with the officially reported prevalence of 18 conditions.


A shallow neural model for relation prediction. Knowledge graph completion refers to predicting missing triples. Most approaches achieve this goal by predicting entities, given an entity and a relation. We predict missing triples via the relation prediction. To this end, we frame the relation prediction problem as a multi label classification problem and propose a shallow neural model (SHALLOM) that accurately infers missing relations from entities. SHALLOM is analogous to C BOW as both approaches predict a central token (p) given surrounding tokens ((s,o)). Our experiments indicate that SHALLOM outperforms state of the art approaches on the FB15K 237 and WN18RR with margins of up to 3 and 8 (absolute), respectively, while requiring a maximum training time of 8 minutes on these datasets. We ensure the reproducibility of our results by providing an open source implementation including training and evaluation scripts at url https github.com dice group Shallom .


Lorentz spaces and embeddings induced by almost greedy bases in superreflexive Banach spaces. The aim of this paper is to show that almost greedy bases induce tighter embeddings in superreflexive Banach spaces than in general Banach spaces. More specifically, we show that an almost greedy basis in a superreflexive Banach space mathbb X induces embeddings that allow squeezing mathbb X between two superreflexive Lorentz sequence spaces that are close to each other in the sense that they have the same fundamental function.


Podcast Metadata and Content Episode Relevance andAttractiveness in Ad Hoc Search. Rapidly growing online podcast archives contain diverse content on a wide range of topics. These archives form an important resource for entertainment and professional use, but their value can only be realized if users can rapidly and reliably locate content of interest. Search for relevant content can be based on metadata provided by content creators, but also on transcripts of the spoken content itself. Excavating relevant content from deep within these audio streams for diverse types of information needs requires varying the approach to systems prototyping. We describe a set of diverse podcast information needs and different approaches to assessing retrieved content for relevance. We use these information needs in an investigation of the utility and effectiveness of these information sources. Based on our analysis, we recommend approaches for indexing and retrieving podcast content for ad hoc search.


Single Source, Collinear Merged Beam Experiment for the Study of Reactive Neutral Neutral Collisions. We present two methods for studying reactive collisions between two atomic or molecular species a collinear merged beam method, in which two gas pulses from a single supersonic beam source are coalesced, and an intrabeam scattering technique, in which a single gas pulse is used. Both approaches, which rely on the laser cooling and deceleration of a laser coolable species inside a Zeeman slower, can be used for a wide range of scattering studies. Possible experimental implementations of the proposed methods are outlined for autoionizing collisions between helium atoms in the metastable 2 3 mathrm S 1 state and a second, atomic or molecular species. Using numerical trajectory calculations, we provide estimates of the expected on axis detection efficiency, collision energy range and collision energy resolution of the approach. We have experimentally tested the feasibility of such an experiment by producing two gas pulses at very short time intervals, and the results of these measurements are detailed as well.


Scaling up Mean Field Games with Online Mirror Descent. We address scaling up equilibrium computation in Mean Field Games (MFGs) using Online Mirror Descent (OMD). We show that continuous time OMD provably converges to a Nash equilibrium under a natural and well motivated set of monotonicity assumptions. This theoretical result nicely extends to multi population games and to settings involving common noise. A thorough experimental investigation on various single and multi population MFGs shows that OMD outperforms traditional algorithms such as Fictitious Play (FP). We empirically show that OMD scales up and converges significantly faster than FP by solving, for the first time to our knowledge, examples of MFGs with hundreds of billions states. This study establishes the state of the art for learning in large scale multi agent and multi population games.


Long time behaviour for distribution dependent SDEs with local Lipschitz coefficients. By using a classical truncated argument and introducing the local Wasserstein distance, the global existence and uniqueness are proved for the distribution dependent SDEs with local Lipschitz coefficients. Due to the measure dependence, the conditions in the sense of pointwise for classical cases can be simplified to the conditions in the sense of integral. On the basis of the well posedness, we prove the r th moment exponential stability using the measure dependent Lyapunov functions and the existence and uniqueness of invariant probability measure is studied under the integrated strong monotonicity condition. Finally, some examples are given to illustrate the results in this paper.


GzScenic Automatic Scene Generation for Gazebo Simulator. Testing robotic and cyberphysical systems in simulation require specifications of the simulated environments (i.e., scenes). The Scenic domain specific language provides a high level probabilistic programming language that allows users to specify scenarios for simulation. Scenic automatically generates concrete scenes that can be rendered by simulators. However, Scenic is mainly designed for autonomous vehicle simulation and does not support the most popular general purpose simulator Gazebo. In this work, we present GzScenic a tool that automatically generates scenes for simulation in Gazebo. GzScenic automatically generates both the models required for running Scenic on the scenarios, and the models that Gazebo requires for running the simulation.


A Generic Distributed Clustering Framework for Massive Data. In this paper, we introduce a novel Generic distributEd clustEring frameworK (GEEK) beyond k means clustering to process massive amounts of data. To deal with different data types, GEEK first converts data in the original feature space into a unified format of buckets then, we design a new Seeding method based on simILar bucKets (SILK) to determine initial seeds. Compared with state of the art seeding methods such as k means and its variants, SILK can automatically identify the number of initial seeds based on the closeness of shared data objects in similar buckets instead of pre specifying k . Thus, its time complexity is independent of k . With these well selected initial seeds, GEEK only needs a one pass data assignment to get the final clusters. We implement GEEK on a distributed CPU GPU platform for large scale clustering. We evaluate the performance of GEEK over five large scale real life datasets and show that GEEK can deal with massive data of different types and is comparable to (or even better than) many state of the art customized GPU based methods, especially in large k values.


Synchronization of Tree Parity Machines using non binary input vectors. Neural cryptography is the application of artificial neural networks in the subject of cryptography. The functionality of this solution is based on a tree parity machine. It uses artificial neural networks to perform secure key exchange between network entities. This article proposes improvements to the synchronization of two tree parity machines. The improvement is based on learning artificial neural network using input vectors which have a wider range of values than binary ones. As a result, the duration of the synchronization process is reduced. Therefore, tree parity machines achieve common weights in a shorter time due to the reduction of necessary bit exchanges. This approach improves the security of neural cryptography


Patent KG Patent Knowledge Graph Use for Engineering Design. To facilitate knowledge reuse in engineering design, several dataset approaches have been proposed and applied by designers. This paper builds a patent based knowledge graph, patent KG, to represent the knowledge facts in patents for engineering design. The arising patent KG approach proposes a new unsupervised mechanism to extract knowledge facts in a patent, by searching the attention graph in language models. This method avoids using expensive labelled data in supervised learning or listing complex syntactic rules in rule based extraction. The extracted entities are compared with other benchmarks in the criteria of recall rate. The result reaches the highest 0.9 recall rate in the standard list of mechanical engineering related technical terms, which means the highest coverage of engineering words. The extracted relationships are also compared with other benchmarks. The result shows that our method provides more contextual information in relationships, and extracts more relationship types including positional and negation relationships.


Constructing Emotion Consensus and Utilizing Unpaired Data for Empathetic Dialogue Generation. Researches on dialogue empathy aim to endow an agent with the capacity of accurate understanding and proper responding for emotions. Existing models for empathetic dialogue generation focus on the emotion flow in one direction, that is, from the context to response. We argue that conducting an empathetic conversation is a bidirectional process, where empathy occurs when the emotions of two interlocutors could converge on the same point, i.e., reaching an emotion consensus. Besides, we also find that the empathetic dialogue corpus is extremely limited, which further restricts the model performance. To address the above issues, we propose a dual generative model, Dual Emp, to simultaneously construct the emotion consensus and utilize some external unpaired data. Specifically, our model integrates a forward dialogue model, a backward dialogue model, and a discrete latent variable representing the emotion consensus into a unified architecture. Then, to alleviate the constraint of paired data, we extract unpaired emotional data from open domain conversations and employ Dual Emp to produce pseudo paired empathetic samples, which is more efficient and low cost than the human annotation. Automatic and human evaluations demonstrate that our method outperforms competitive baselines in producing coherent and empathetic responses.


Meeting Merging Mission A Multi robot Coordinate Framework for Large Scale Communication Limited Exploration. This letter presents a complete framework Meeting Merging Mission for multi robot exploration under communication restriction. Considering communication is limited in both bandwidth and range in the real world, we propose a lightweight environment presentation method and an efficient cooperative exploration strategy. For lower bandwidth, each robot utilizes specific polytopes to maintains free space and super frontier information (SFI) as the source for exploration decision making. To reduce repeated exploration, we develop a mission based protocol that drives robots to share collected information in stable rendezvous. We also design a complete path planning scheme for both centralized and decentralized cases. To validate that our framework is practical and generic, we present an extensive benchmark and deploy our system into multi UGV and multi UAV platforms.


DeepSteal Advanced Model Extractions Leveraging Efficient Weight Stealing in Memories. Recent advancements of Deep Neural Networks (DNNs) have seen widespread deployment in multiple security sensitive domains. The need of resource intensive training and use of valuable domain specific training data have made these models a top intellectual property (IP) for model owners. One of the major threats to the DNN privacy is model extraction attacks where adversaries attempt to steal sensitive information in DNN models. Recent studies show hardware based side channel attacks can reveal internal knowledge about DNN models (e.g., model architectures) However, to date, existing attacks cannot extract detailed model parameters (e.g., weights biases). In this work, for the first time, we propose an advanced model extraction attack framework DeepSteal that effectively steals DNN weights with the aid of memory side channel attack. Our proposed DeepSteal comprises two key stages. Firstly, we develop a new weight bit information extraction method, called HammerLeak, through adopting the rowhammer based hardware fault technique as the information leakage vector. HammerLeak leverages several novel system level techniques tailed for DNN applications to enable fast and efficient weight stealing. Secondly, we propose a novel substitute model training algorithm with Mean Clustering weight penalty, which leverages the partial leaked bit information effectively and generates a substitute prototype of the target victim model. We evaluate this substitute model extraction method on three popular image datasets (e.g., CIFAR 10 100 GTSRB) and four DNN architectures (e.g., ResNet 18 34 Wide ResNet VGG 11). The extracted substitute model has successfully achieved more than 90 test accuracy on deep residual networks for the CIFAR 10 dataset. Moreover, our extracted substitute model could also generate effective adversarial input samples to fool the victim model.


Loss of mass of non pluripolar products. It is a well known fact that the non pluripolar self products of a closed positive (1,1) current in a big nef cohomology class on a compact Kahler manifold are not of full mass in the presence of positive Lelong numbers of the current in consideration. In this paper, we give a quantitative version of the last property. Our proof involves a generalization of Demailly's comparison of Lelong numbers to the setting of density currents, a reversed Alexandrov Fenchel inequality, and the notion of relative non pluripolar products.


Self Training with Differentiable Teacher. Self training achieves enormous success in various semi supervised and weakly supervised learning tasks. The method can be interpreted as a teacher student framework, where the teacher generates pseudo labels, and the student makes predictions. The two models are updated alternatingly. However, such a straightforward alternating update rule leads to training instability. This is because a small change in the teacher may result in a significant change in the student. To address this issue, we propose DRIFT, short for differentiable self training, that treats teacher student as a Stackelberg game. In this game, a leader is always in a more advantageous position than a follower. In self training, the student contributes to the prediction performance, and the teacher controls the training process by generating pseudo labels. Therefore, we treat the student as the leader and the teacher as the follower. The leader procures its advantage by acknowledging the follower's strategy, which involves differentiable pseudo labels and differentiable sample weights. Consequently, the leader follower interaction can be effectively captured via Stackelberg gradient, obtained by differentiating the follower's strategy. Experimental results on semi and weakly supervised classification and named entity recognition tasks show that our model outperforms existing approaches by large margins.


Nature based solutions in the urban context terminology, classification and scoring for urban challenges and ecosystem services. The concept of Nature Based Solutions (NBS) has emerged to foster sustainable development by transversally addressing social, economic, and environmental urban challenges. However, there is still a considerable lack of agreement on the conceptualization of NBS, especially concerning typologies, nomenclature, and performance assessments in terms of ecosystem services (ES) and urban challenges (UC). Therefore, this article consolidates the knowledge from 4 European projects to set a path for a common understanding of NBS and thus, facilitate their mainstreaming.


Shack Hartmann wavefront sensor with array of phase coded masks. Shack Hartmann wavefront sensors (SHWS) are generally used to measure the wavefront curvature of light beams. Measurement accuracy and the sensitivity of these sensors are important factors for better wavefront sensing. In this study, we demonstrate a new type of SHWS with better measurement accuracy than the regular SHWS. The lenslet array in the regular SHWS is replaced with an array of coded phase masks and the principle of coded aperture correlation holography (COACH) is used for wavefront reconstruction. Sharper correlation peaks achieved by COACH improve the accuracy of the estimated local slopes of the measured wavefront and consequently improve the reconstruction accuracy of the overall wavefront. Experimental results confirm that the proposed method provides a lower mean square wavefront error by one order of magnitude in comparison to the regular SHWS.


Exact pressure elimination for the Crouzeix Raviart scheme applied to the Stokes and Navier Stokes problems. We show that, using the Crouzeix Raviart scheme, a cheap algebraic transformation, applied to the coupled velocity pressure linear systems issued from the transient or steady Stokes or Navier Stokes problems, leads to a linear system only involving as many auxiliary variables as the velocity components. This linear system, which is symmetric positive definite in the case of the transient Stokes problem and symmetric invertible in the case of the steady Stokes problem, with the same stencil as that of the velocity matrix, provides the exact solution of the initial coupled linear system. Numerical results show the increase of performance when applying direct or iterative solvers to the resolution of these linear systems.


From Six Functors Formalisms to Derived Motivic Measures. In this paper, we generally describe a method of taking an abstract six functors formalism in the sense of Khan or Cisinski D ' e glise, and outputting a derived motivic measure in the sense of Campbell Wolfson Zakharevich. In particular, we use this framework to define a lifting of the Gillet Sou 'e motivic measure.


Automating Internet of Things Network Traffic Collection with Robotic Arm Interactions. Consumer Internet of things research often involves collecting network traffic sent or received by IoT devices. These data are typically collected via crowdsourcing or while researchers manually interact with IoT devices in a laboratory setting. However, manual interactions and crowdsourcing are often tedious, expensive, inaccurate, or do not provide comprehensive coverage of possible IoT device behaviors. We present a new method for generating IoT network traffic using a robotic arm to automate user interactions with devices. This eliminates manual button pressing and enables permutation based interaction sequences that rigorously explore the range of possible device behaviors. We test this approach with an Arduino controlled robotic arm, a smart speaker and a smart thermostat, using machine learning to demonstrate that collected network traffic contains information about device interactions that could be useful for network, security, or privacy analyses. We also provide source code and documentation allowing researchers to easily automate IoT device interactions and network traffic collection in future studies.


Transition to chaos in a reduced order model of a shear layer. The present work studies the non linear dynamics of a shear layer, driven by a body force and confined between parallel walls, a simplified setting to study transitional and turbulent shear layers. It was introduced by Nogueira Cavalieri (J. Fluid Mech. 907, A32, 2021), and is here studied using a reduced order model based on a Galerkin projection of the Navier Stokes system. By considering a confined shear layer with free slip boundary conditions on the walls, periodic boundary conditions in streamwise and spanwise directions may be used, simplifying the system and enabling the use of methods of dynamical systems theory. A basis of eight modes is used in the Galerkin projection, representing the mean flow, Kelvin Helmholtz vortices, rolls, streaks and oblique waves, structures observed in the cited work, and also present in shear layers and jets. A dynamical system is obtained, and its transition to chaos is studied. Increasing Reynolds number Re leads to pitchfork and Hopf bifurcations, and the latter leads to a limit cycle with amplitude modulation of vortices, as in the DNS by Nogueira Cavalieri. Further increase of Re leads to the appearance of a chaotic saddle, followed by the emergence of quasi periodic and chaotic attractors. The chaotic attractors suffer a merging crisis for higher Re , leading to chaotic dynamics with amplitude modulation and phase jumps of vortices. This is reminiscent of observations of coherent structures in turbulent jets, suggesting that the model represents dynamics consistent with features of shear layers and jets.


Employing Agent Beliefs during Fault Diagnosis for IEC 61499 Industrial Cyber Physical Systems. We have come to rely on industrial scale cyber physical systems more and more to manage tasks and machinery in safety critical situations. Efficient, reliable fault identification and management has become a critical factor in the design of these increasingly sophisticated and complex devices. Teams of co operating software agents are one way to coordinate the flow of diagnostic information gathered during fault finding. By wielding domain knowledge of the software architecture used to construct the system, agents build and refine their beliefs about the location and root cause of faults. This paper examines how agents constructed within the GORITE Multi Agent Framework create and refine their beliefs. We demonstrate three different belief structures implemented within our Fault Diagnostic Engine, showing how each supports a distinct aspect of the agent's reasoning. Using domain knowledge of the IEC 61499 Function Block architecture, agents are able to examine and rigorously evaluate both individual components and entire subsystems.


A new, optimized Doppler optical probe for phase detection, bubble velocity and size measurements investigation of a bubble column operated in the heterogeneous regime. A new measuring technique dedicated to bubble velocity and size measurements in complex bubbly flows such as those occurring in bubble columns is proposed. This sensor combines the phase detection capability of a conical optical fiber, with velocity measurements from the Doppler signal induced by an interface approaching the extremity of a single mode fiber. The analysis of the probe functioning and of its response in controlled situations, have shown that the Doppler probe provides the translation velocity of bubbles projected along the probe axis. A reliable signal processing routine has been developed that exploits the Doppler signal arising at the gas to liquid transition the resulting uncertainty on velocity is at most 14 . Such a Doppler probe provides statistics on velocity and on size of gas inclusions, as well as local variables including void fraction, gas volumetric flux, number density and its flux. That sensor has been successfully exploited in an air tap water bubble column 0.4m in diameter for global gas hold up from 2.5 to 30 . In the heterogeneous regime, the transverse profiles of the mean bubble velocity scaled by the value on the axis happen to be self similar in the quasi fully developed region of the column. A fit is proposed for these profiles. In addition, on the axis, the standard deviation of bubble velocity scaled by the mean velocity increases with Vsg in the homogeneous regime, and it remains stable, close to 0.55, in the heterogeneous regime.


Explicit sieve estimates and nonexistence of odd multiperfect numbers of a certain form. We prove explicit asymptotic formulae for some functions used in sieve methods and show that there exists no odd multiperfect number of abundancy four whose squared part is cubefree.


Determinization of One Counter Nets. One Counter Nets (OCNs) are finite state automata equipped with a counter that is not allowed to become negative, but does not have zero tests. Their simplicity and close connection to various other models (e.g., VASS, Counter Machines and Pushdown Automata) make them an attractive model for studying the border of decidability for the classical decision problems. The deterministic fragment of OCNs (DOCNs) typically admits more tractable decision problems, and while these problems and the expressive power of DOCNs have been studied, the determinization problem, namely deciding whether an OCN admits an equivalent DOCN, has not received attention. We introduce four notions of OCN determinizability, which arise naturally due to intricacies in the model, and specifically, the interpretation of the initial counter value. We show that in general, determinizability is undecidable under most notions, but over a singleton alphabet (i.e., 1 dimensional VASS) one definition becomes decidable, and the rest become trivial, in that there is always an equivalent DOCN.


Matroid Based TSP Rounding for Half Integral Solutions. We show how to round any half integral solution to the subtour elimination relaxation for the TSP, while losing a less than 1.5 factor. Such a rounding algorithm was recently given by Karlin, Klein, and Oveis Gharan based on sampling from max entropy distributions. We build on an approach of Haddadan and Newman to show how sampling from the matroid intersection polytope, and a new use of max entropy sampling, can give better guarantees.


Enhanced and unenhanced dampings of Kolmogorov flow. In the present study, Kolmogorov flow represents the stationary sinusoidal solution ( sin y,0) to a two dimensional spatially periodic Navier Stokes system, driven by an external force. This system admits the additional non stationary solution ( sin y,0) e nu t ( sin y,0) , which tends exponentially to the Kolmogorov flow at the minimum decay rate determined by the viscosity nu . Enhanced damping or enhanced dissipation of the problem is obtained by presenting higher decay rate for the difference between a solution and the non stationary basic solution. Moreover, for the understanding of the metastability problem in an explicit manner, a variety of exact solutions are presented to show enhanced and unenhanced dampings.


Inferring, comparing and exploring ecological networks from time series data through R packages constructnet, disgraph and dynet. Network inference is a major field of interest for the ecological community, especially in light of the high cost and difficulty of manual observation, and easy availability of remote, long term monitoring data. In addition, comparing across similar network structures, especially with spatial, environmental, or temporal variability and, simulating processes on networks to create toy models and hypotheses are topics of considerable interest to the researchers. A large number of methods are being developed in the network science community to achieve these objectives but either don't have their code available or an implementation in R, the language preferred by ecologists and other biologists. We provide a suite of three packages which will provide a central suite of standardized network inference methods from time series data (constructnet), distance metrics (disgraph) and (process) simulation models (dynet) to the growing R network analysis environment and would help ecologists and biologists to perform and compare methods under one roof. These packages are implemented in a coherent, consistent framework making comparisons across methods and metrics easier. We hope that these tools in R will help increase the accessibility of network tools to ecologists and other biologists, who the language for most of their analysis.


Revisiting closed asymptotic couples. Every discrete definable subset of a closed asymptotic couple with ordered scalar field boldsymbol k is shown to be contained in a finite dimensional boldsymbol k linear subspace of that couple. It follows that the differential valued field mathbb T of transseries induces more structure on its value group than what is definable in its asymptotic couple equipped with its scalar multiplication by real numbers, where this asymptotic couple is construed as a two sorted structure with mathbb R as the underlying set for the second sort.


Kinetic Simulation of the Ideal Multipole Resonance Probe. Active plasma resonance spectroscopy (APRS) is a process compatible plasma diagnostic method which utilizes the natural ability of plasmas to resonate on or near the electron plasma frequency. The Multipole Resonance Probe (MRP) is a particular design of APRS that has a high degree of geometric and electric symmetry. The principle of the MRP can be described on the basis of an idealized geometry that is particularly suited for theoretical investigations. In a pressure regime of a few Pa or lower, kinetic effects become important, which can not be predicted by the Drude model. Therefore, in this paper a dynamic model of the interaction of the idealized MRP with a plasma is established. The proposed scheme reveals the kinetic behavior of the plasma that is able to explain the influence of kinetic effects on the resonance structure. Similar to particle in cell, the spectral kinetic method iteratively determines the electric field at each particle position, however, without employing any numerical grids. The optimized analytical model ensures the high efficiency of the simulation. Eventually, the presented work is expected to cover the limitation of the Drude model, especially for the determination of the pure collisionless damping caused by kinetic effects. A formula to determine the electron temperature from the half width is proposed.