An Online Scheduling Algorithm for Energy Minimization in Wireless Powered Mobile Edge Computing Networks. The integration of Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT), which is usually referred to as Wireless Powered Mobile Edge Computing (WP MEC), has been recognized as a promising technique to enhance the lifetime and computation capacity of wireless devices (WDs). Compared to the conventional battery powered MEC networks, WP MEC brings new challenges to the computation scheduling problem because we have to jointly optimize the resource allocation in WPT and computation offloading. In this paper, we consider the energy minimization problem for WP MEC networks with multiple WDs and multiple access points. We design an online algorithm by transforming the original problem into a series of deterministic optimization problems based on the Lyapunov optimization theory. To reduce the time complexity of our algorithm, the optimization problem is relaxed and decomposed into several independent subproblems. After solving each subproblem, we adjust the computed values of variables to obtain a feasible solution. Extensive simulations are conducted to validate the performance of the proposed algorithm.


Trisections and Ozsvath Szabo cobordism invariants. Given a smooth, compact four manifold X viewed as a cobordism from the empty set to its connected boundary, we demonstrate how to use the data of a trisection map pi X 4 to mathbb D 2 to compute the induced cobordism maps on Heegaard Floer homology associated to X .


Asynchronous Federated Learning for Sensor Data with Concept Drift. Federated learning (FL) involves multiple distributed devices jointly training a shared model without any of the participants having to reveal their local data to a centralized server. Most of previous FL approaches assume that data on devices are fixed and stationary during the training process. However, this assumption is unrealistic because these devices usually have varying sampling rates and different system configurations. In addition, the underlying distribution of the device data can change dynamically over time, which is known as concept drift. Concept drift makes the learning process complicated because of the inconsistency between existing and upcoming data. Traditional concept drift handling techniques such as chunk based and ensemble learning based methods are not suitable in the federated learning frameworks due to the heterogeneity of local devices. We propose a novel approach, FedConD, to detect and deal with the concept drift on local devices and minimize the effect on the performance of models in asynchronous FL. The drift detection strategy is based on an adaptive mechanism which uses the historical performance of the local models. The drift adaptation is realized by adjusting the regularization parameter of objective function on each local device. Additionally, we design a communication strategy on the server side to select local updates in a prudent fashion and speed up model convergence. Experimental evaluations on three evolving data streams and two image datasets show that model detects and handles concept drift, and also reduces the overall communication cost compared to other baseline methods.


What You Can Learn by Staring at a Blank Wall. We present a passive non line of sight method that infers the number of people or activity of a person from the observation of a blank wall in an unknown room. Our technique analyzes complex imperceptible changes in indirect illumination in a video of the wall to reveal a signal that is correlated with motion in the hidden part of a scene. We use this signal to classify between zero, one, or two moving people, or the activity of a person in the hidden scene. We train two convolutional neural networks using data collected from 20 different scenes, and achieve an accuracy of approx94 for both tasks in unseen test environments and real time online settings. Unlike other passive non line of sight methods, the technique does not rely on known occluders or controllable light sources, and generalizes to unknown rooms with no re calibration. We analyze the generalization and robustness of our method with both real and synthetic data, and study the effect of the scene parameters on the signal quality.


Empirical Analysis of Bi directional Wi Fi Network Performance on Mobile Robots in Indoor Environments. This paper proposes a framework to measure the important metrics (throughput, delay, packet retransmits, signal strength, etc.) to determine Wi Fi network performance of mobile robots supported by the Robot Operating Systems (ROS) middleware. We analyze the bidirectional network performance of mobile robots through an experimental setup in an indoor environment, where a mobile robot is communicating vital sensor data such as video streaming from the camera(s) and LiDAR scan values to a command station while it navigates an indoor environment through teleoperated velocity commands received from the command station. The experiments evaluate the performance under 2.4 GHz and 5 GHz channels with different placement of Access Points (AP) with up to two network devices on each side. The framework is generalizable to vehicular network evaluation and the discussions and insights from this study apply to the field robotics community, where the wireless network plays a key role in enabling the success of robotic missions in real world environments.


Adaptive Steering Control for Steer by Wire Systems. Steer by Wire (SBW) systems are being adapted widely in semi autonomous and fully autonomous vehicles. The main control challenge in a SBW system is to follow the steering commands in the face of parametric uncertainties, external disturbances and actuator delay crucially, perturbations in inertial parameters and damping forces give rise to state dependent uncertainties, which cannot be bounded a priori by a constant. However, the state of the art control methods of SBW system rely on a priori bounded uncertainties, and thus, become inapplicable when state dependent dynamics become unknown. In addition, ensuring tracking accuracy under actuator delay is always a challenging task. This work proposes two control frameworks to overcome these challenges. Firstly, an adaptive controller is proposed to tackle the state dependent uncertainties and external disturbances in a typical SBW system without any a priori knowledge of their structures and of their bounds. The stability of the closed loop system is studied analytically via uniformly ultimately bounded notion and the effectiveness of the proposed solution is verified via simulations against the state of the art solution. While this proposed controller handles the uncertainties and external perturbations, it does not consider the actuator delay which sometimes result in decreased accuracy. Therefore, a new adaptive robust control framework is devised to tackle the same control problem of an SBW system under the influence of time varying input delay. In comparison to the existing strategies, the proposed framework removes the conservative assumption of a priori bounded uncertainty and, in addition, the Razumikhin theorem based stability analysis allows the proposed scheme to deal with arbitrary variation in input delay. The effectiveness of the both controllers is proved using comparative simulation studies.


DAGN Discourse Aware Graph Network for Logical Reasoning. Recent QA with logical reasoning questions requires passage level relations among the sentences. However, current approaches still focus on sentence level relations interacting among tokens. In this work, we explore aggregating passage level clues for solving logical reasoning QA by using discourse based information. We propose a discourse aware graph network (DAGN) that reasons relying on the discourse structure of the texts. The model encodes discourse information as a graph with elementary discourse units (EDUs) and discourse relations, and learns the discourse aware features via a graph network for downstream QA tasks. Experiments are conducted on two logical reasoning QA datasets, ReClor and LogiQA, and our proposed DAGN achieves competitive results. The source code is available at https github.com Eleanor H DAGN.


Pre training transformer based framework on large scale pediatric claims data for downstream population specific tasks. The adoption of electronic health records (EHR) has become universal during the past decade, which has afforded in depth data based research. By learning from the large amount of healthcare data, various data driven models have been built to predict future events for different medical tasks, such as auto diagnosis and heart attack prediction. Although EHR is abundant, the population that satisfies specific criteria for learning population specific tasks is scarce, making it challenging to train data hungry deep learning models. This study presents the Claim Pre Training (Claim PT) framework, a generic pre training model that first trains on the entire pediatric claims dataset, followed by a discriminative fine tuning on each population specific task. The semantic meaning of medical events can be captured in the pre training stage, and the effective knowledge transfer is completed through the task aware fine tuning stage. The fine tuning process requires minimal parameter modification without changing the model architecture, which mitigates the data scarcity issue and helps train the deep learning model adequately on small patient cohorts. We conducted experiments on a real world claims dataset with more than one million patient records. Experimental results on two downstream tasks demonstrated the effectiveness of our method our general task agnostic pre training framework outperformed tailored task specific models, achieving more than 10 higher in model performance as compared to baselines. In addition, our framework showed a great generalizability potential to transfer learned knowledge from one institution to another, paving the way for future healthcare model pre training across institutions.


NU BRIEF A Privacy aware Newsletter Personalization Engine for Publishers. Newsletters have (re ) emerged as a powerful tool for publishers to engage with their readers directly and more effectively. Despite the diversity in their audiences, publishers' newsletters remain largely a one size fits all offering, which is suboptimal. In this paper, we present NU BRIEF, a web application for publishers that enables them to personalize their newsletters without harvesting personal data. Personalized newsletters build a habit and become a great conversion tool for publishers, providing an alternative readers generated revenue model to a declining ad clickbait centered business model.


Exact size Sampling of Enriched Trees in Linear Time. Various combinatorial classes such as outerplanar graphs and maps, series parallel graphs, substitution closed classes of permutations and many more allow bijective encodings by so called enriched trees, which are rooted trees with additional structure on the offspring of each node. Using this universal description we develop sampling procedures that uniformly generate objects from this classes with a given size n in expected time O(n) .The key ingredient is a representation of enriched trees in terms of decorated Bienaym 'e Galton Watson trees, which allows us to develop a novel combination of Devroye's efficient sampler for trees (Devroye, 2012) with Boltzmann sampling techniques. Additionally, we construct expected linear time samplers for critical Bienaym 'e Galton Watson trees having exactly n (out of ge n total) nodes with outdegree in some fixed set, enabling uniform generation for many combinatorial classes such as dissections of polygons.


Random Feature Attention. Transformers are state of the art models for a variety of sequence modeling tasks. At their core is an attention function which models pairwise interactions between the inputs at every timestep. While attention is powerful, it does not scale efficiently to long sequences due to its quadratic time and space complexity in the sequence length. We propose RFA, a linear time and space attention that uses random feature methods to approximate the softmax function, and explore its application in transformers. RFA can be used as a drop in replacement for conventional softmax attention and offers a straightforward way of learning with recency bias through an optional gating mechanism. Experiments on language modeling and machine translation demonstrate that RFA achieves similar or better performance compared to strong transformer baselines. In the machine translation experiment, RFA decodes twice as fast as a vanilla transformer. Compared to existing efficient transformer variants, RFA is competitive in terms of both accuracy and efficiency on three long text classification datasets. Our analysis shows that RFA's efficiency gains are especially notable on long sequences, suggesting that RFA will be particularly useful in tasks that require working with large inputs, fast decoding speed, or low memory footprints.


Gradient Inversion with Generative Image Prior. Federated Learning (FL) is a distributed learning framework, in which the local data never leaves clients devices to preserve privacy, and the server trains models on the data via accessing only the gradients of those local data. Without further privacy mechanisms such as differential privacy, this leaves the system vulnerable against an attacker who inverts those gradients to reveal clients sensitive data. However, a gradient is often insufficient to reconstruct the user data without any prior knowledge. By exploiting a generative model pretrained on the data distribution, we demonstrate that data privacy can be easily breached. Further, when such prior knowledge is unavailable, we investigate the possibility of learning the prior from a sequence of gradients seen in the process of FL training. We experimentally show that the prior in a form of generative model is learnable from iterative interactions in FL. Our findings strongly suggest that additional mechanisms are necessary to prevent privacy leakage in FL.


An efficient method for goal oriented linear Bayesian optimal experimental design Application to optimal sensor placemen. Optimal experimental design (OED) plays an important role in the problem of identifying uncertainty with limited experimental data. In many applications, we seek to minimize the uncertainty of a predicted quantity of interest (QoI) based on the solution of the inverse problem, rather than the inversion model parameter itself. In these scenarios, we develop an efficient method for goal oriented optimal experimental design (GOOED) for large scale Bayesian linear inverse problem that finds sensor locations to maximize the expected information gain (EIG) for a predicted QoI. By deriving a new formula to compute the EIG, exploiting low rank structures of two appropriate operators, we are able to employ an online offline decomposition scheme and a swapping greedy algorithm to maximize the EIG at a cost measured in model solutions that is independent of the problem dimensions. We provide detailed error analysis of the approximated EIG, and demonstrate the efficiency, accuracy, and both data and parameter dimension independence of the proposed algorithm for a contaminant transport inverse problem with infinite dimensional parameter field.


Nano Version Control and Robots of Robots Data Driven, Regenerative Production Code. A reflection of the Corona pandemic highlights the need for more sustainable production systems using automation. The goal is to retain automation of repetitive tasks while allowing complex parts to come together. We recognize the fragility and how hard it is to create traditional automation. We introduce a method which converts one really hard problem of producing sustainable production code into three simpler problems being data, patterns and working prototypes. We use developer seniority as a metric to measure whether the proposed method is easier. By using agent based simulation and NanoVC repos for agent arbitration, we are able to create a simulated environment where patterns developed by people are used to transform working prototypes into templates that data can be fed through to create the robots that create the production code. Having two layers of robots allow early implementation choices to be replaced as we gather more feedback from the working system. Several benefits of this approach have been discovered, with the most notable being that the Robot of Robots encodes a legacy of the person that designed it in the form of the 3 ingredients (data, patterns and working prototypes). This method allows us to achieve our goal of reducing the fragility of the production code while removing the difficulty of getting there.


Cycle factors in randomly perturbed graphs. We study the problem of finding pairwise vertex disjoint copies of the ell vertex cycle C ell in the randomly perturbed graph model, which is the union of a deterministic n vertex graph G and the binomial random graph G(n,p) . For ell ge 3 we prove that asymptotically almost surely G cup G(n,p) contains min delta(G), lfloor n ell rfloor pairwise vertex disjoint cycles C ell , provided p ge C log n n for C sufficiently large. Moreover, when delta(G) ge alpha n with 0 alpha le 1 ell and G is not close' to the complete bipartite graph K alpha n,(1 alpha) n , then p ge C n suffices to get the same conclusion. This provides a stability version of our result. In particular, we conclude that p ge C n suffices when alpha 1 ell for finding lfloor n ell rfloor cycles C ell . Our results are asymptotically optimal. They can be seen as an interpolation between the Johansson Kahn Vu Theorem for C ell factors and the resolution of the El Zahar Conjecture for C ell factors by Abbasi.


Stable Elements and Property (S). We study the relation (and differences) between stability and Property (S) in the simple and stably finite framework. This leads us to characterize stable elements in terms of its support, and study these concepts from different sides hereditary subalgebras, projections in the multiplier algebra and order properties in the Cuntz semigroup. We use these approaches to show both that cancellation at infinity on the Cuntz semigroup just holds when its Cuntz equivalence is given by isomorphism at the level of Hilbert right modules, and that different notions as Regularity, omega comparison, Corona Factorization Property, property R, etc.. are equivalent under mild assumptions.


Nonexistence of solutions to quasilinear parabolic equations with a potential in bounded domains. We are concerned with nonexistence results for a class of quasilinear parabolic differential problems with a potential in Omega times(0, infty) , where Omega is a bounded domain. In particular, we investigate how the behavior of the potential near the boundary of the domain and the power nonlinearity affect the nonexistence of solutions. Particular attention is devoted to the special case of the semilinear parabolic problem, for which we show that the critical rate of growth of the potential near the boundary ensuring nonexistence is sharp.


On an isomorphism theorem for the Feichtinger's Segal algebra on locally compact groups. In this article we observe that a locally compact group G is completely determined by the algebraic properties of its Feichtinger's Segal algebra S 0(G). Let G and H be locally compact groups. Then any linear (not necessarily continuous) bijection of S 0(G) onto S 0(H) which preserves the convolution and pointwise products is essentially a composition with a homeomorphic isomorphism of H onto G.


Credit Assignment Through Broadcasting a Global Error Vector. Backpropagation (BP) uses detailed, unit specific feedback to train deep neural networks (DNNs) with remarkable success. That biological neural circuits appear to perform credit assignment, but cannot implement BP, implies the existence of other powerful learning algorithms. Here, we explore the extent to which a globally broadcast learning signal, coupled with local weight updates, enables training of DNNs. We present both a learning rule, called global error vector broadcasting (GEVB), and a class of DNNs, called vectorized nonnegative networks (VNNs), in which this learning rule operates. VNNs have vector valued units and nonnegative weights past the first layer. The GEVB learning rule generalizes three factor Hebbian learning, updating each weight by an amount proportional to the inner product of the presynaptic activation and a globally broadcast error vector when the postsynaptic unit is active. We prove that these weight updates are matched in sign to the gradient, enabling accurate credit assignment. Moreover, at initialization, these updates are exactly proportional to the gradient in the limit of infinite network width. GEVB matches the performance of BP in VNNs, and in some cases outperforms direct feedback alignment (DFA) applied in conventional networks. Unlike DFA, GEVB successfully trains convolutional layers. Altogether, our theoretical and empirical results point to a surprisingly powerful role for a global learning signal in training DNNs.


Auditing the Biases Enacted by YouTube for Political Topics in Germany. With YouTube's growing importance as a news platform, its recommendation system came under increased scrutiny. Recognizing YouTube's recommendation system as a broadcaster of media, we explore the applicability of laws that require broadcasters to give important political, ideological, and social groups adequate opportunity to express themselves in the broadcasted program of the service. We present audits as an important tool to enforce such laws and to ensure that a system operates in the public's interest. To examine whether YouTube is enacting certain biases, we collected video recommendations about political topics by following chains of ten recommendations per video. Our findings suggest that YouTube's recommendation system is enacting important biases. We find that YouTube is recommending increasingly popular but topically unrelated videos. The sadness evoked by the recommended videos decreases while the happiness increases. We discuss the strong popularity bias we identified and analyze the link between the popularity of content and emotions. We also discuss how audits empower researchers and civic hackers to monitor complex machine learning (ML) based systems like YouTube's recommendation system.


Higher semiadditive Grothendieck Witt theory and the K(1) local sphere. We develop a higher semiadditive version of Grothendieck Witt theory. We then apply the theory in the case of a finite field to study the higher semiadditive structure of the K(1) local sphere at the prime 2 . As a further application, we compute and clarify certain power operations in the homotopy of the K(1) local sphere.


Category Adaptive Domain Adaptation for Semantic Segmentation. Unsupervised domain adaptation (UDA) becomes more and more popular in tackling real world problems without ground truth of the target domain. Though tedious annotation work is not required, UDA unavoidably faces two problems 1) how to narrow the domain discrepancy to boost the transferring performance 2) how to improve pseudo annotation producing mechanism for self supervised learning (SSL). In this paper, we focus on UDA for semantic segmentation task. Firstly, we introduce adversarial learning into style gap bridging mechanism to keep the style information from two domains in the similar space. Secondly, to keep the balance of pseudo labels on each category, we propose a category adaptive threshold mechanism to choose category wise pseudo labels for SSL. The experiments are conducted using GTA5 as the source domain, Cityscapes as the target domain. The results show that our model outperforms the state of the arts with a noticeable gain on cross domain adaptation tasks.


Positive scalar curvature on mathbf Pin pm and mathbf Spin c manifolds. It is well known that spin structures and Dirac operators play a crucial role in the study of positive scalar curvature metrics (psc metrics) on compact manifolds. Here we consider a class of non spin manifolds with "almost spin" structure, namely those with spin c or pin pm structures. It turns out that in those cases (under natural assumptions on such a manifold M ), the index of a relevant Dirac operator completely controls existence of a psc metric which is S 1 or C 2 invariant near a "special submanifold" B of M . This submanifold B subset M is dual to the complex (respectively, real) line bundle L which determines the spin c or pin pm structure on M . We also show that these manifold pairs (M,B) can be interpreted as "manifolds with fibered singularities" equipped with "well adapted psc metrics". This survey is based on our recent work as well as on our joint work with Paolo Piazza.


Discrete two countour system with one directional motion. This paper studies a dynamical system, which contains two contours. There is a cluster on each contour. The cluster contains particles, located in adjacent cells. The clusters move under prescribed rules. The delays of clusters are due to that the clusters cannot pass through the node simultaneously. The dynamical system belongs to the class of contour networks introduced by A. P. Buslaev.


Computing the viscous effect in early time drop impact dynamics. The impact of a liquid drop on a solid surface involves many intertwined physical effects, and is influenced by drop velocity, surface tension, ambient pressure and liquid viscosity, among others. Experiments by Kolinski et al. (2014b) show that the liquid air interface begins to deviate away from the solid surface even before contact. They found that the lift off of the interface starts at a critical time that scales with the square root of the kinematic viscosity of the liquid. To understand this, we study the approach of a liquid drop towards a solid surface in the presence of an intervening gas layer. We take a numerical approach to solve the Navier Stokes equations for the liquid, coupled to the compressible lubrication equations for the gas, in two dimensions. With this approach, we recover the experimentally captured early time effect of liquid viscosity on the drop impact, but our results show that lift off time and liquid kinematic viscosity have a more complex dependence than the square root scaling relationship. We also predict the effect of interfacial tension at the liquid gas interface on the drop impact, showing that it mediates the lift off behavior.


A Field Guide to Federated Optimization. Federated learning and analytics are a distributed approach for collaboratively learning models (or statistics) from decentralized data, motivated by and designed for privacy protection. The distributed learning process can be formulated as solving federated optimization problems, which emphasize communication efficiency, data heterogeneity, compatibility with privacy and system requirements, and other constraints that are not primary considerations in other problem settings. This paper provides recommendations and guidelines on formulating, designing, evaluating and analyzing federated optimization algorithms through concrete examples and practical implementation, with a focus on conducting effective simulations to infer real world performance. The goal of this work is not to survey the current literature, but to inspire researchers and practitioners to design federated learning algorithms that can be used in various practical applications.


MemPool 3D Boosting Performance and Efficiency of Shared L1 Memory Many Core Clusters with 3D Integration. Three dimensional integrated circuits promise power, performance, and footprint gains compared to their 2D counterparts, thanks to drastic reductions in the interconnects' length through their smaller form factor. We can leverage the potential of 3D integration by enhancing MemPool, an open source many core design with 256 cores and a shared pool of L1 scratchpad memory connected with a low latency interconnect. MemPool's baseline 2D design is severely limited by routing congestion and wire propagation delay, making the design ideal for 3D integration. In architectural terms, we increase MemPool's scratchpad memory capacity beyond the sweet spot for 2D designs, improving performance in a common digital signal processing kernel. We propose a 3D MemPool design that leverages a smart partitioning of the memory resources across two layers to balance the size and utilization of the stacked dies. In this paper, we explore the architectural and the technology parameter spaces by analyzing the power, performance, area, and energy efficiency of MemPool instances in 2D and 3D with 1 MiB, 2 MiB, 4 MiB, and 8 MiB of scratchpad memory in a commercial 28 nm technology node. We observe a performance gain of 9.1 when running a matrix multiplication on the MemPool 3D design with 4 MiB of scratchpad memory compared to the MemPool 2D counterpart. In terms of energy efficiency, we can implement the MemPool 3D instance with 4 MiB of L1 memory on an energy budget 15 smaller than its 2D counterpart, and even 3.7 smaller than the MemPool 2D instance with one fourth of the L1 scratchpad memory capacity.


Weighted Composition Differentiation Operator on the Hardy and Weighted Bergman Spaces. In this paper, we consider the sum of weighted composition operator C psi 0 , varphi 0 and the weighted composition differentiation operator D psi n , varphi n ,n on the Hardy and weighted Bergman spaces. We describe the spectrum of a compact operator C psi 0 , varphi 0 D psi n , varphi n ,n when the fixed point w of varphi 0 and varphi n is inside the open unit disk and psi n has a zero at w of order at least n . Also the lower estimate and the upper estimate on the norm of a weighted composition differentiation operator on the Hardy space H 2 are obtained. Furthermore, we determine the norm of a composition differentiation operator D varphi,n , acting on the Hardy space H 2 , in the case where varphi(z) bz for some complex number b that b 1 .


An Instance optimal Algorithm for Bichromatic Rectangular Visibility. Afshani, Barbay and Chan (2017) introduced the notion of instance optimal algorithm in the order oblivious setting. An algorithm A is instance optimal in the order oblivious setting for a certain class of algorithms A if the following hold A takes as input a sequence of objects from some domain for any instance sigma and any algorithm A' in A , the runtime of A on sigma is at most a constant factor removed from the runtime of A' on the worst possible permutation of sigma . If we identify permutations of a sequence as representing the same instance, this essentially states that A is optimal on every possible input (and not only in the worst case). We design instance optimal algorithms for the problem of reporting, given a bichromatic set of points in the plane S, all pairs consisting of points of different color which span an empty axis aligned rectangle (or reporting all points which appear in such a pair). This problem has applications for training set reduction in nearest neighbour classifiers. It is also related to the problem consisting of finding the decision boundaries of a euclidean nearest neighbour classifier, for which Bremner et al. (2005) gave an optimal output sensitive algorithm. By showing the existence of an instance optimal algorithm in the order oblivious setting for this problem we push the methods of Afshani et al. closer to their limits by adapting and extending them to a setting which exhibits highly non local features. Previous problems for which instance optimal algorithms were proven to exist were based solely on local relationships between points in a set.


A comparison of particle and fluid models for positive streamer discharges in air. Both fluid and particle models are commonly used to simulate streamer discharges. In this paper, we quantitatively study the agreement between these approaches for axisymmetric and 3D simulations of positive streamers in air. We use a drift diffusion reaction fluid model with the local field approximation and a PIC MCC (particle in cell, Monte Carlo collision) particle model. The simulations are performed at 300 K and 1 bar in a 10 mm plate plate gap with a 2 mm needle electrode. Applied voltages between 11.7 and 15.6 kV are used, which correspond to background fields of about 15 to 20 kV cm. Streamer properties like maximal electric field, head position and velocity are compared as a function of time or space. Our results show good agreement between the particle and fluid simulations, in contrast to some earlier comparisons that were carried out in 1D or for negative streamers. To quantify discrepancies between the models, we mainly look at streamer velocities as a function of streamer length. For the test cases considered here, the mean deviation in streamer velocity between the particle and fluid simulations is less than 4 . We study the effect of different types of transport data for the fluid model, and find that flux coefficients lead to good agreement whereas bulk coefficients do not. Furthermore, we find that with a two term Boltzmann solver, data should be computed using a temporal growth model for the best agreement. The numerical convergence of the particle and fluid models is also studied. In fluid simulations the streamer velocity increases somewhat using finer grids, whereas the particle simulations are less sensitive to the grid. Photoionization is the dominant source of stochastic fluctuations in our simulations. When the same stochastic photoionization model is used, particle and fluid simulations exhibit similar fluctuations.


Exponential Moving Average Normalization for Self supervised and Semi supervised Learning. We present a plug in replacement for batch normalization (BN) called exponential moving average normalization (EMAN), which improves the performance of existing student teacher based self and semi supervised learning techniques. Unlike the standard BN, where the statistics are computed within each batch, EMAN, used in the teacher, updates its statistics by exponential moving average from the BN statistics of the student. This design reduces the intrinsic cross sample dependency of BN and enhances the generalization of the teacher. EMAN improves strong baselines for self supervised learning by 4 6 1 2 points and semi supervised learning by about 7 2 points, when 1 10 supervised labels are available on ImageNet. These improvements are consistent across methods, network architectures, training duration, and datasets, demonstrating the general effectiveness of this technique. The code is available at https github.com amazon research exponential moving average normalization.


Exploring Evolved Multicellular Life Histories in a Open Ended Digital Evolution System. Evolutionary transitions occur when previously independent replicating entities unite to form more complex individuals. Such transitions have profoundly shaped natural evolutionary history and occur in two forms fraternal transitions involve lower level entities that are kin (e.g., transitions to multicellularity or to eusocial colonies), while egalitarian transitions involve unrelated individuals (e.g., the origins of mitochondria). The necessary conditions and evolutionary mechanisms for these transitions to arise continue to be fruitful targets of scientific interest. Here, we examine a range of fraternal transitions in populations of open ended self replicating computer programs. These digital cells were allowed to form and replicate kin groups by selectively adjoining or expelling daughter cells. The capability to recognize kin group membership enabled preferential communication and cooperation between cells. We repeatedly observed group level traits that are characteristic of a fraternal transition. These included reproductive division of labor, resource sharing within kin groups, resource investment in offspring groups, asymmetrical behaviors mediated by messaging, morphological patterning, and adaptive apoptosis. We report eight case studies from replicates where transitions occurred and explore the diverse range of adaptive evolved multicellular strategies.


Quantitative destruction of invariant circles. For area preserving twist maps on the annulus, we consider the problem on quantitative destruction of invariant circles with a given frequency omega of an integrable system by a trigonometric polynomial of degree N perturbation R N with R N C r epsilon . We obtain a relation among N , r , epsilon and the arithmetic property of omega , for which the area preserving map admit no invariant circles with omega .


Detecting and Segmenting Adversarial Graphics Patterns from Images. Adversarial attacks pose a substantial threat to computer vision system security, but the social media industry constantly faces another form of "adversarial attack" in which the hackers attempt to upload inappropriate images and fool the automated screening systems by adding artificial graphics patterns. In this paper, we formulate the defense against such attacks as an artificial graphics pattern segmentation problem. We evaluate the efficacy of several segmentation algorithms and, based on observation of their performance, propose a new method tailored to this specific problem. Extensive experiments show that the proposed method outperforms the baselines and has a promising generalization capability, which is the most crucial aspect in segmenting artificial graphics patterns.


Fire Threat Detection From Videos with Q Rough Sets. This article defines new methods for unsupervised fire region segmentation and fire threat detection from video stream. Fire in control serves a number of purposes to human civilization, but it could simultaneously be a threat once its spread becomes uncontrolled. There exists many methods on fire region segmentation and fire non fire classification. But the approaches to determine the threat associated with fire is relatively scare, and no such unsupervised method has been formulated yet. Here we focus on developing an unsupervised method with which the threat of fire can be quantified and accordingly generate an alarm in automated surveillance systems in indoor as well as in outdoors. Fire region segmentation without any manual intervention labelled data set is a major challenge while formulating such a method. Here we have used rough approximations to approximate the fire region, and to manage the incompleteness of the knowledge base, due to absence of any prior information. Utility maximization of Q learning has been used to minimize ambiguities in the rough approximations. The new set approximation method, thus developed here, is named as Q rough set. It is used for fire region segmentation from video frames. The threat index of fire flame over the input video stream has been defined in sync with the relative growth in the fire segments on the recent frames. All theories and indices defined here have been experimentally validated with different types of fire videos, through demonstrations and comparisons, as superior to the state of the art.


An Unsupervised Video Game Playstyle Metric via State Discretization. On playing video games, different players usually have their own playstyles. Recently, there have been great improvements for the video game AIs on the playing strength. However, past researches for analyzing the behaviors of players still used heuristic rules or the behavior features with the game environment support, thus being exhausted for the developers to define the features of discriminating various playstyles. In this paper, we propose the first metric for video game playstyles directly from the game observations and actions, without any prior specification on the playstyle in the target game. Our proposed method is built upon a novel scheme of learning discrete representations that can map game observations into latent discrete states, such that playstyles can be exhibited from these discrete states. Namely, we measure the playstyle distance based on game observations aligned to the same states. We demonstrate high playstyle accuracy of our metric in experiments on some video game platforms, including TORCS, RGSK, and seven Atari games, and for different agents including rule based AI bots, learning based AI bots, and human players.


On parameterizations of cyclic N isogenies and strict K curves lying above rational points of Y 0 (N) . Elliptic K curves are elliptic curves defined over some field extension L K that are isogenous to all of their Galois conjugates. We present a new result on K curves E that are given by a K rational orbit tau, 1 N tau of the Fricke involution on Y 0(N) , giving a simple Diophantine condition on the extension L K that determines which twists of E allow the isogeny between Galois conjugates to be defined over L . To support and illustrate this result, we also discuss parameterizations of cyclic N isogenies corresponding to points on modular curves X 0(N) of genus 0 . These modular curves admit parameterizations in terms of a distinguished Hauptmodul. We provide an exposition on the derivation of these Hauptmoduln as products of the Dedekind eta function based on the approach of Ligozat. As an application, we provide a complete tabulation of explicit formulas for the coefficients of cyclic N isogenous curves in terms of the Hauptmodul for all N such that X 0(N) has genus 0 . We also include an abbreviated table of rational functions for the j invariant in terms of Hauptmoduln, and we discuss a classical application of these expressions to finding special values of the j invariant at CM points.


Three fundamental problems in risk modeling on big data an information theory view. Since Claude Shannon founded Information Theory, information theory has widely fostered other scientific fields, such as statistics, artificial intelligence, biology, behavioral science, neuroscience, economics, and finance. Unfortunately, actuarial science has hardly benefited from information theory. So far, only one actuarial paper on information theory can be searched by academic search engines. Undoubtedly, information and risk, both as Uncertainty, are constrained by entropy law. Today's insurance big data era means more data and more information. It is unacceptable for risk management and actuarial science to ignore information theory. Therefore, this paper aims to exploit information theory to discover the performance limits of insurance big data systems and seek guidance for risk modeling and the development of actuarial pricing systems.


Convergence of Hermitian manifolds and the Type IIB flow. The Type IIB flow is a flow of conformally balanced complex manifolds introduced by Phong, Picard, and Zhang, about whose singularities little is as yet known. We formulate convergence criteria for the Gromov Cheeger Hamilton convergence of sequences of Hermitian manifolds, and apply them to precompactness theorems and the existence of singularity models for the Type IIB flow, in analogy with Hamilton's classic compactness theorems and classification of singularities for the Ricci flow.


A Hierarchical Transformation Discriminating Generative Model for Few Shot Anomaly Detection. Anomaly detection, the task of identifying unusual samples in data, often relies on a large set of training samples. In this work, we consider the setting of few shot anomaly detection in images, where only a few images are given at training. We devise a hierarchical generative model that captures the multi scale patch distribution of each training image. We further enhance the representation of our model by using image transformations and optimize scale specific patch discriminators to distinguish between real and fake patches of the image, as well as between different transformations applied to those patches. The anomaly score is obtained by aggregating the patch based votes of the correct transformation across scales and image regions. We demonstrate the superiority of our method on both the one shot and few shot settings, on the datasets of Paris, CIFAR10, MNIST and FashionMNIST as well as in the setting of defect detection on MVTec. In all cases, our method outperforms the recent baseline methods.


Evaluation of Summarization Systems across Gender, Age, and Race. Summarization systems are ultimately evaluated by human annotators and raters. Usually, annotators and raters do not reflect the demographics of end users, but are recruited through student populations or crowdsourcing platforms with skewed demographics. For two different evaluation scenarios evaluation against gold summaries and system output ratings we show that summary evaluation is sensitive to protected attributes. This can severely bias system development and evaluation, leading us to build models that cater for some groups rather than others.


Unsupervised Noisy Tracklet Person Re identification. Existing person re identification (re id) methods mostly rely on supervised model learning from a large set of person identity labelled training data per domain. This limits their scalability and usability in large scale deployments. In this work, we present a novel selective tracklet learning (STL) approach that can train discriminative person re id models from unlabelled tracklet data in an unsupervised manner. This avoids the tedious and costly process of exhaustively labelling person image tracklet true matching pairs across camera views. Importantly, our method is particularly more robust against arbitrary noisy data of raw tracklets therefore scalable to learning discriminative models from unconstrained tracking data. This differs from a handful of existing alternative methods that often assume the existence of true matches and balanced tracklet samples per identity class. This is achieved by formulating a data adaptive image to tracklet selective matching loss function explored in a multi camera multi task deep learning model structure. Extensive comparative experiments demonstrate that the proposed STL model surpasses significantly the state of the art unsupervised learning and one shot learning re id methods on three large tracklet person re id benchmarks.


When SRv6 meets 5G Core Implementation and Deployment of a Network Service Chaining Function in SmartNICs. Currently, we have witnessed a myriad of solutions that benefit from programmable hardware. The 5G Core (5GC) can and should also benefit from such paradigm to offload certain functions to the dataplane. In this work, we designed and implemented a P4 based solution for traffic identification and chaining using the Netronome Agilo SmartNIC. The solution here presented is deployed in between the RAN and UPF (User Plane Function) so that traffic coming from the RAN is identified and chained using SRv6 based on different rules defined by the control plane. The traffic identification and the construction of the SRv6 list of segments are done entirely in the SmartNIC. A minimalist Proof of Concept (PoC) was deployed and evaluated to show that this function is perfectly capable to build service function chainings in a transparent and efficient way.


Rolling Horizon Policies in Multistage Stochastic Programming. Multistage Stochastic Programming (MSP) is a class of models for sequential decision making under uncertainty. MSP problems are known for their computational intractability due to the sequential nature of the decision making structure and the uncertainty in the problem data due to the so called curse of dimensionality. A common approach to tackle MSP problems with a large number of stages is a rolling horizon (RH) procedure, where one solves a sequence of MSP problems with a smaller number of stages. This leads to a delicate issue of how many stages to include in the smaller problems used in the RH procedure. This paper addresses this question for, both, finite and infinite horizon MSP problems. For the infinite horizon case with discounted costs, we derive a bound which can be used to prescribe an epsilon sufficient number of stages. For the finite horizon case, we propose a heuristic approach from the perspective of approximate dynamic programming to provide a sufficient number of stages for each roll in the RH procedure. Our numerical experiments on a hydrothermal power generation planning problem show the effectiveness of the proposed approaches.


Counting, equidistribution and entropy gaps at infinity with applications to cusped Hitchin representations. We show that if an eventually positive, non arithmetic, locally H "older continuous potential for a topologically mixing countable Markov shift with (BIP) has an entropy gap at infinity, then one may apply the renewal theorem of Kesseb "ohmer and Kombrink to obtain counting and equidistribution results. We apply these general results to obtain counting and equidistribution results for cusped Hitchin representations, and more generally for cusped Anosov representations of geometrically finite Fuchsian groups.


One shot learning of paired associations by a reservoir computing model with Hebbian plasticity. One shot learning can be achieved by algorithms and animals, but how the latter do it is poorly understood as most of the algorithms are not biologically plausible. Experiments studying one shot learning in rodents have shown that after initial gradual learning of associations between cues and locations, new associations can be learned with just a single exposure to each new cue location pair. Foster, Morris and Dayan (2000) developed a hybrid temporal difference symbolic model that exhibited one shot learning for dead reckoning to displaced single locations. While the temporal difference rule for learning the agent's actual coordinates was biologically plausible, the model's symbolic mechanism for learning target coordinates was not, and one shot learning for multiple target locations was not addressed. Here we extend the model by replacing the symbolic mechanism with a reservoir of recurrently connected neurons resembling cortical microcircuitry. Biologically plausible learning of target coordinates was achieved by subjecting the reservoir's output weights to synaptic plasticity governed by a novel 4 factor variant of the exploratory Hebbian (EH) rule. As with rodents, the reservoir model exhibited one shot learning for multiple paired associations.


PixMatch Unsupervised Domain Adaptation via Pixelwise Consistency Training. Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large scale data annotation is costly and time consuming. In semantic segmentation, it is attractive to train models on annotated images from a simulated (source) domain and deploy them on real (target) domains. In this work, we present a novel framework for unsupervised domain adaptation based on the notion of target domain consistency training. Intuitively, our work is based on the idea that in order to perform well on the target domain, a model's output should be consistent with respect to small perturbations of inputs in the target domain. Specifically, we introduce a new loss term to enforce pixelwise consistency between the model's predictions on a target image and a perturbed version of the same image. In comparison to popular adversarial adaptation methods, our approach is simpler, easier to implement, and more memory efficient during training. Experiments and extensive ablation studies demonstrate that our simple approach achieves remarkably strong results on two challenging synthetic to real benchmarks, GTA5 to Cityscapes and SYNTHIA to Cityscapes. Code is available at https github.com lukemelas pixmatch


Semisimple Algebras and PI Invariants of Finite Dimensional Algebras. Let Gamma be a T ideal of identities of an affine PI algebra over an algebraically closed field F of characteristic zero. Consider the family mathcal M Gamma of finite dimensional algebras Sigma with Id( Sigma) Gamma . By Kemer's theory it is known that such Sigma exists. We show there exists a semisimple algebra U which satisfies the following conditions. (1) There exists an algebra A in mathcal M Gamma with Wedderburn Malcev decomposition A cong U oplus J A , where J A is the Jacobson's radical of A (2) If B in mathcal M Gamma and B cong B ss oplus J B is its Wedderburn Malcev decomposition then U is a direct summand of B ss . We refer to U as the unique minimal semisimple algebra corresponding to Gamma . We fully extend this result to the non affine G graded setting where G is a finite group. In particular we show that if A and B are finite dimensional G 2 mathbb Z 2 times G graded simple algebras then they are G 2 graded isomorphic if and only if E(A) and E(B) are G graded PI equivalent, where E is the unital infinite dimensional Grassmann algebra and E(A) is the Grassmann envelope of A .


PolyDot Coded Privacy Preserving Multi Party Computation at the Edge. We investigate the problem of privacy preserving distributed matrix multiplication in edge networks using multi party computation (MPC). Coded multi party computation (CMPC) is an emerging approach to reduce the required number of workers in MPC by employing coded computation. Existing CMPC approaches usually combine coded computation algorithms designed for efficient matrix multiplication with MPC. We show that this approach is not efficient. We design a novel CMPC algorithm PolyDot coded MPC (PolyDot CMPC) by using a recently proposed coded computation algorithm PolyDot codes. We exploit "garbage terms" that naturally arise when polynomials are constructed in the design of PolyDot CMPC to reduce the number of workers needed for privacy preserving computation. We show that entangled polynomial codes, which are consistently better than PolyDot codes in coded computation setup, are not necessarily better than PolyDot CMPC in MPC setting.


Sharp equivalent for the blowup profile to the gradient of a solution to the semilinear heat equation. In this paper, we consider the standard semilinear heat equation begin eqnarray partial t u Delta u u p 1 u, quad p 1. end eqnarray The determination of the (believed to be) generic blowup profile is well established in the literature, with the solution blowing up only at one point. Though the blow up of the gradient of the solution is a direct consequence of the single point blow up property and the mean value theorem, there is no determination of the final blowup profile for the gradient in the literature, up to our knowledge. In this paper, we refine the construction technique of Bricmont Kupiainen 1994 and Merle Zaag 1997, and derive the following profile for the gradient and derive construct a blowup solution to the above equation with the gradient's asymptotic nabla u(x,T) sim frac sqrt 2b p 1 frac x x sqrt ln x left frac b x 2 2 ln x right frac p 1 2(p 1) text as x to 0, where b frac (p 1) 2 4p , which is as expected the gradient of the well known blowup profile of the solution.


EventPlus A Temporal Event Understanding Pipeline. We present EventPlus, a temporal event understanding pipeline that integrates various state of the art event understanding components including event trigger and type detection, event argument detection, event duration and temporal relation extraction. Event information, especially event temporal knowledge, is a type of common sense knowledge that helps people understand how stories evolve and provides predictive hints for future events. EventPlus as the first comprehensive temporal event understanding pipeline provides a convenient tool for users to quickly obtain annotations about events and their temporal information for any user provided document. Furthermore, we show EventPlus can be easily adapted to other domains (e.g., biomedical domain). We make EventPlus publicly available to facilitate event related information extraction and downstream applications.


On the q analogue of P 'olya's Theorem. We answer a question posed by Michael Aissen in 1979 about the q analogue of a classical theorem of George P 'olya (1922) on the algebraicity of (generalized) diagonals of bivariate rational power series. In particular, we prove that the answer to Aissen's question, in which he considers q as a variable, is negative in general. Moreover, we show that the answer is positive if and only if q is a root of unity.


Deep Embedded K Means Clustering. Recently, deep clustering methods have gained momentum because of the high representational power of deep neural networks (DNNs) such as autoencoder. The key idea is that representation learning and clustering can reinforce each other Good representations lead to good clustering while good clustering provides good supervisory signals to representation learning. Critical questions include 1) How to optimize representation learning and clustering? 2) Should the reconstruction loss of autoencoder be considered always? In this paper, we propose DEKM (for Deep Embedded K Means) to answer these two questions. Since the embedding space generated by autoencoder may have no obvious cluster structures, we propose to further transform the embedding space to a new space that reveals the cluster structure information. This is achieved by an orthonormal transformation matrix, which contains the eigenvectors of the within class scatter matrix of K means. The eigenvalues indicate the importance of the eigenvectors' contributions to the cluster structure information in the new space. Our goal is to increase the cluster structure information. To this end, we discard the decoder and propose a greedy method to optimize the representation. Representation learning and clustering are alternately optimized by DEKM. Experimental results on the real world datasets demonstrate that DEKM achieves state of the art performance.


Urban sprawl and evolution of accessibility profiles in Chinese cities. The development of public transportation networks and associated transit oriented development policies are efficient tools to mitigate urban sprawl and its negative environmental impacts, especially in terms of commuting emissions. We study in this paper the trajectories in terms of sprawl and public transport accessibility of the nine largest Chinese megacities, from 2000 to 2030 with projected transportation networks and populations. Using the radial profile methodology, we compare the evolution of population distribution with the evolution of accessibility profiles. We show a rebalancing of access in time, suggesting the efficiency of transport network growth regarding transit oriented development objectives.


Dynamically Switching Human Prediction Models for Efficient Planning. As environments involving both robots and humans become increasingly common, so does the need to account for people during planning. To plan effectively, robots must be able to respond to and sometimes influence what humans do. This requires a human model which predicts future human actions. A simple model may assume the human will continue what they did previously a more complex one might predict that the human will act optimally, disregarding the robot whereas an even more complex one might capture the robot's ability to influence the human. These models make different trade offs between computational time and performance of the resulting robot plan. Using only one model of the human either wastes computational resources or is unable to handle critical situations. In this work, we give the robot access to a suite of human models and enable it to assess the performance computation trade off online. By estimating how an alternate model could improve human prediction and how that may translate to performance gain, the robot can dynamically switch human models whenever the additional computation is justified. Our experiments in a driving simulator showcase how the robot can achieve performance comparable to always using the best human model, but with greatly reduced computation.


Exploring the Limits of Epistemic Uncertainty Quantification in Low Shot Settings. Uncertainty quantification in neural network promises to increase safety of AI systems, but it is not clear how performance might vary with the training set size. In this paper we evaluate seven uncertainty methods on Fashion MNIST and CIFAR10, as we sub sample and produce varied training set sizes. We find that calibration error and out of distribution detection performance strongly depend on the training set size, with most methods being miscalibrated on the test set with small training sets. Gradient based methods seem to poorly estimate epistemic uncertainty and are the most affected by training set size. We expect our results can guide future research into uncertainty quantification and help practitioners select methods based on their particular available data.


Everything Is All It Takes A Multipronged Strategy for Zero Shot Cross Lingual Information Extraction. Zero shot cross lingual information extraction (IE) describes the construction of an IE model for some target language, given existing annotations exclusively in some other language, typically English. While the advance of pretrained multilingual encoders suggests an easy optimism of "train on English, run on any language", we find through a thorough exploration and extension of techniques that a combination of approaches, both new and old, leads to better performance than any one cross lingual strategy in particular. We explore techniques including data projection and self training, and how different pretrained encoders impact them. We use English to Arabic IE as our initial example, demonstrating strong performance in this setting for event extraction, named entity recognition, part of speech tagging, and dependency parsing. We then apply data projection and self training to three tasks across eight target languages. Because no single set of techniques performs the best across all tasks, we encourage practitioners to explore various configurations of the techniques described in this work when seeking to improve on zero shot training.


On the stability of homogeneous Einstein manifolds. Let g be a G invariant Einstein metric on a compact homogeneous space M G K. We use a formula for the Lichnerowicz Laplacian of g at G invariant TT tensors to study the stability type of g as a critical point of the scalar curvature function. The case when g is naturally reductive is studied in special detail.


A promotion for odd symmetric discrete Fourier transform. DFT is the numerical implementation of Fourier transform (FT), and it has many forms. Ordinary DFT (ODFT) and symmetric DFT (SDFT) are the two main forms of DFT. The most widely used DFT is ODFT, and the phase spectrum of this form is widely used in engineering applications. However, it is found ODFT has the problem of phase aliasing. Moreover, ODFT does not have many FT properties, such as symmetry, integration, and interpolation. When compared with ODFT, SDFT has more FT properties. Theoretically, the more properties a transformation has, the wider its application range. Hence, SDFT is more suitable as the discrete form of FT. In order to promote SDFT, the unique nature of SDFT is demonstrated. The time domain of even point SDFT is not symmetric to zero, and the author corrects it in this study. The author raises a new issue that should the signal length be odd or even when performing SDFT. The answer is odd. However, scientists and engineers are accustomed to using even numbered sequences. At the end of this study, the reasons why the author advocates odd SDFT are given. Besides, even sampling function, discrete frequency Fourier transform, and the Gibbs phenomenon of the SDFT are introduced.


Simple Agent, Complex Environment Efficient Reinforcement Learning with Agent States. We design a simple reinforcement learning (RL) agent that implements an optimistic version of Q learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage concepts from the literature on provably efficient RL, we consider a general agent environment interface and provide a novel agent design and analysis. This level of generality positions our results to inform the design of future agents for operation in complex real environments. We establish that, as time progresses, our agent performs competitively relative to policies that require longer times to evaluate. The time it takes to approach asymptotic performance is polynomial in the complexity of the agent's state representation and the time required to evaluate the best policy that the agent can represent. Notably, there is no dependence on the complexity of the environment. The ultimate per period performance loss of the agent is bounded by a constant multiple of a measure of distortion introduced by the agent's state representation. This work is the first to establish that an algorithm approaches this asymptotic condition within a tractable time frame.


Tanisaki witness relations for harmonic differential forms. Inspired by a series of conjectures related to higher coinvariant algebras, we present two families of relations involving harmonic differential forms of the symmetric group. Our relations, together with a novel bijection, are sufficient to give a filtration of the 1 forms suggested by work of Haglund Rhoades Shimozono with composition factors given by Tanisaki quotients. These are "almost all" of the necessary relations in a certain asymptotic sense we make precise.


Vector Quantized Diffusion Model for Text to Image Synthesis. We present the vector quantized diffusion (VQ Diffusion) model for text to image generation. This method is based on a vector quantized variational autoencoder (VQ VAE) whose latent space is modeled by a conditional variant of the recently developed Denoising Diffusion Probabilistic Model (DDPM). We find that this latent space method is well suited for text to image generation tasks because it not only eliminates the unidirectional bias with existing methods but also allows us to incorporate a mask and replace diffusion strategy to avoid the accumulation of errors, which is a serious problem with existing methods. Our experiments show that the VQ Diffusion produces significantly better text to image generation results when compared with conventional autoregressive (AR) models with similar numbers of parameters. Compared with previous GAN based text to image methods, our VQ Diffusion can handle more complex scenes and improve the synthesized image quality by a large margin. Finally, we show that the image generation computation in our method can be made highly efficient by reparameterization. With traditional AR methods, the text to image generation time increases linearly with the output image resolution and hence is quite time consuming even for normal size images. The VQ Diffusion allows us to achieve a better trade off between quality and speed. Our experiments indicate that the VQ Diffusion model with the reparameterization is fifteen times faster than traditional AR methods while achieving a better image quality.


Removing the deadwood from DFT MRCI wave functions The p DFT MRCI method. The combined density functional theory and multireference configuration interaction (DFT MRCI) method is a powerful tool for the calculation of excited electronic states of large molecules. There exists, however, a large amount of superfluous configurations in a typical DFT MRCI wave function. We show that this deadwood may be effectively removed using a simple configuration pruning algorithm based on second order Epstein Nesbet perturbation theory. The resulting method, which we denote p DFT MRCI, is shown to result in orders of magnitude saving in computational timings, while retaining the accuracy of the original DFT MRCI method.


Alignment Completeness for Relational Hoare Logics. Relational Hoare logics (RHL) provide rules for reasoning about relations between programs. Several RHLs include a rule we call sequential product that infers a relational correctness judgment from judgments of ordinary Hoare logic (HL). Other rules embody sensible patterns of reasoning and have been found useful in practice, but sequential product is relatively complete on its own (with HL). As a more satisfactory way to evaluate RHLs, a notion of alignment completeness is introduced, in terms of the inductive assertion method and product automata. Alignment completeness results are given to account for several different sets of rules. The notion may serve to guide the design of RHLs and relational verifiers for richer programming languages and alignment patterns.


User Response Prediction in Online Advertising. Online advertising, as the vast market, has gained significant attention in various platforms ranging from search engines, third party websites, social media, and mobile apps. The prosperity of online campaigns is a challenge in online marketing and is usually evaluated by user response through different metrics, such as clicks on advertisement (ad) creatives, subscriptions to products, purchases of items, or explicit user feedback through online surveys. Recent years have witnessed a significant increase in the number of studies using computational approaches, including machine learning methods, for user response prediction. However, existing literature mainly focuses on algorithmic driven designs to solve specific challenges, and no comprehensive review exists to answer many important questions. What are the parties involved in the online digital advertising eco systems? What type of data are available for user response prediction? How to predict user response in a reliable and or transparent way? In this survey, we provide a comprehensive review of user response prediction in online advertising and related recommender applications. Our essential goal is to provide a thorough understanding of online advertising platforms, stakeholders, data availability, and typical ways of user response prediction. We propose a taxonomy to categorize state of the art user response prediction methods, primarily focus on the current progress of machine learning methods used in different online platforms. In addition, we also review applications of user response prediction, benchmark datasets, and open source codes in the field.


PP YOLOv2 A Practical Object Detector. Being effective and efficient is essential to an object detector for practical use. To meet these two concerns, we comprehensively evaluate a collection of existing refinements to improve the performance of PP YOLO while almost keep the infer time unchanged. This paper will analyze a collection of refinements and empirically evaluate their impact on the final model performance through incremental ablation study. Things we tried that didn't work will also be discussed. By combining multiple effective refinements, we boost PP YOLO's performance from 45.9 mAP to 49.5 mAP on COCO2017 test dev. Since a significant margin of performance has been made, we present PP YOLOv2. In terms of speed, PP YOLOv2 runs in 68.9FPS at 640x640 input size. Paddle inference engine with TensorRT, FP16 precision, and batch size 1 further improves PP YOLOv2's infer speed, which achieves 106.5 FPS. Such a performance surpasses existing object detectors with roughly the same amount of parameters (i.e., YOLOv4 CSP, YOLOv5l). Besides, PP YOLOv2 with ResNet101 achieves 50.3 mAP on COCO2017 test dev. Source code is at https github.com PaddlePaddle PaddleDetection.


B SMALL A Bayesian Neural Network approach to Sparse Model Agnostic Meta Learning. There is a growing interest in the learning to learn paradigm, also known as meta learning, where models infer on new tasks using a few training examples. Recently, meta learning based methods have been widely used in few shot classification, regression, reinforcement learning, and domain adaptation. The model agnostic meta learning (MAML) algorithm is a well known algorithm that obtains model parameter initialization at meta training phase. In the meta test phase, this initialization is rapidly adapted to new tasks by using gradient descent. However, meta learning models are prone to overfitting since there are insufficient training tasks resulting in over parameterized models with poor generalization performance for unseen tasks. In this paper, we propose a Bayesian neural network based MAML algorithm, which we refer to as the B SMALL algorithm. The proposed framework incorporates a sparse variational loss term alongside the loss function of MAML, which uses a sparsifying approximated KL divergence as a regularizer. We demonstrate the performance of B MAML using classification and regression tasks, and highlight that training a sparsifying BNN using MAML indeed improves the parameter footprint of the model while performing at par or even outperforming the MAML approach. We also illustrate applicability of our approach in distributed sensor networks, where sparsity and meta learning can be beneficial.


Topological phase singularities in atomically thin high refractive index materials. Atomically thin transition metal dichalcogenides (TMDCs) present a promising platform for numerous photonic applications due to excitonic spectral features, possibility to tune their constants by external gating, doping, or light, and mechanical stability. Utilization of such materials for sensing or optical modulation purposes would require a clever optical design, as by itself the 2D materials can offer only a small optical phase delay consequence of the atomic thickness. To address this issue, we combine films of 2D semiconductors which exhibit excitonic lines with the Fabry Perot resonators of the standard commercial SiO 2 Si substrate, in order to realize topological phase singularities in reflection. Around these singularities, reflection spectra demonstrate rapid phase changes while the structure behaves as a perfect absorber. Furthermore, we demonstrate that such topological phase singularities are ubiquitous for the entire class of atomically thin TMDCs and other high refractive index materials, making it a powerful tool for phase engineering in flat optics. As a practical demonstration, we employ PdSe 2 topological phase singularities for a refractive index sensor and demonstrate its superior phase sensitivity compared to typical surface plasmon resonance sensors.


Online Robust Sliding Windowed LiDAR SLAM in Natural Environments. Despite the growing interest for autonomous environmental monitoring, effective SLAM realization in native habitats remains largely unsolved. In this paper, we fill this gap by presenting a novel online graph based SLAM system for 2D LiDAR sensor in natural environments. By taking advantage of robust weighting scheme, sliding windowed optimization, fast scan matcher and parallel computing, our system not only delivers stable performance in cluttered surroudings but also meets real time constraint. Simulated and experimental results confirm the feasibility and efficiency in the overall design of the proposed system.


Extracting single and multiple scattering components in laser speckle contrast imaging of tissue blood flow. Random matrix theory provides new insights into multiple scattering in random media. In a recent study, we demonstrated the statistical separation of single and multiple scattering components based on a Wishart random matrix. The first and second order moments were estimated through a Wishart random matrix constructed using dynamically backscattered speckle images. In this study, this new strategy was applied to laser speckle contrast imaging (LSCI) of in vivo blood flow. The random matrix based method was adapted and parameterized using electric field Monte Carlo simulations and in vitro blood flow phantom experiments. The new method was further applied in in vivo experiments, demonstrating the benefits of separating the single and multiple scattering components, and was compared with the traditional temporal LASCA method. More specifically, the new method captures stimulus induced functional changes in blood flow and tissue perfusion in the superficial and deeper layers. The new method extends the ability of LSCI to image functional and pathological changes.


Spatio Contextual Deep Network Based Multimodal Pedestrian Detection For Autonomous Driving. Pedestrian Detection is the most critical module of an Autonomous Driving system. Although a camera is commonly used for this purpose, its quality degrades severely in low light night time driving scenarios. On the other hand, the quality of a thermal camera image remains unaffected in similar conditions. This paper proposes an end to end multimodal fusion model for pedestrian detection using RGB and thermal images. Its novel spatio contextual deep network architecture is capable of exploiting the multimodal input efficiently. It consists of two distinct deformable ResNeXt 50 encoders for feature extraction from the two modalities. Fusion of these two encoded features takes place inside a multimodal feature embedding module (MuFEm) consisting of several groups of a pair of Graph Attention Network and a feature fusion unit. The output of the last feature fusion unit of MuFEm is subsequently passed to two CRFs for their spatial refinement. Further enhancement of the features is achieved by applying channel wise attention and extraction of contextual information with the help of four RNNs traversing in four different directions. Finally, these feature maps are used by a single stage decoder to generate the bounding box of each pedestrian and the score map. We have performed extensive experiments of the proposed framework on three publicly available multimodal pedestrian detection benchmark datasets, namely KAIST, CVC 14, and UTokyo. The results on each of them improved the respective state of the art performance. A short video giving an overview of this work along with its qualitative results can be seen at https youtu.be FDJdSifuuCs. Our source code will be released upon publication of the paper.


Domain Adaptation with Pre trained Transformers for Query Focused Abstractive Text Summarization. The Query Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled data for training the summarization model. In this paper, we address this challenge by exploring a series of domain adaptation techniques. Given the recent success of pre trained transformer models in a wide range of natural language processing tasks, we utilize such models to generate abstractive summaries for the QFTS task for both single document and multi document scenarios. For domain adaptation, we apply a variety of techniques using pre trained transformer based summarization models including transfer learning, weakly supervised learning, and distant supervision. Extensive experiments on six datasets show that our proposed approach is very effective in generating abstractive summaries for the QFTS task while setting a new state of the art result in several datasets across a set of automatic and human evaluation metrics.


Chemical Reaction Aware Molecule Representation Learning. Molecule representation learning (MRL) methods aim to embed molecules into a real vector space. However, existing SMILES based (Simplified Molecular Input Line Entry System) or GNN based (Graph Neural Networks) MRL methods either take SMILES strings as input that have difficulty in encoding molecule structure information, or over emphasize the importance of GNN architectures but neglect their generalization ability. Here we propose using chemical reactions to assist learning molecule representation. The key idea of our approach is to preserve the equivalence of molecules with respect to chemical reactions in the embedding space, i.e., forcing the sum of reactant embeddings and the sum of product embeddings to be equal for each chemical equation. This constraint is proven effective to 1) keep the embedding space well organized and 2) improve the generalization ability of molecule embeddings. Moreover, our model can use any GNN as the molecule encoder and is thus agnostic to GNN architectures. Experimental results demonstrate that our method achieves state of the art performance in a variety of downstream tasks, e.g., 17.4 absolute Hit 1 gain in chemical reaction prediction, 2.3 absolute AUC gain in molecule property prediction, and 18.5 relative RMSE gain in graph edit distance prediction, respectively, over the best baseline method. The code is available at https github.com hwwang55 MolR.


Odd and even q type Lidstone polynomial sequences. In this paper, we introduce two types of general classes of even and odd q Lidstone polynomial sequences. We prove essential properties related to them like the matrix and determinate form representation, the generating function, recurrence relation, and conjugate sequences. Some illustrative examples are included.


Irreducible meanders. In this article, we introduce a new geometric decomposition of meanders into prime factors (irreducible meanders). This decomposition makes it possible to express the number of meanders with a fixed number of intersections in terms of the number of irreducible meanders with fewer intersections.


Bi Lipschitz embeddings of quasiconformal trees. A quasiconformal tree is a doubling metric tree in which the diameter of each arc is bounded above by a fixed multiple of the distance between its endpoints. In this paper we show that every quasiconformal tree bi Lipschitz embeds in some Euclidean space, with the ambient dimension and the bi Lipschitz constant depending only on the doubling and bounded turning constants of the tree. This answers Question 1.6 in cite DV (arXiv 2007.12297).


Generalization of Jordan Lie of Finite Dimensional Associative Algebras. We generalize Baranov and Shlaka's results about bar minimal Jordan Lie and regular inner ideals of finite dimensional associative algebras. Let A be a finite dimensional 1 perfect associative algebras A over an algebraically closed field mathbb F of characteristic p ge0 and let A' be a subalgebra of A. We prove that for any bar minimal Jordan Lie inner ideal B' a A', there is a bar minimal Jordan Lie inner ideal of A that contains B' and if B' is regular, then is a regular inner ideal of A that contains B'. We also prove that for any strict orthogonal pair (e',f') in A', there is a strict orthogonal idempotent pair (e,f) in A such that e'A'f' subseteq eAf


Communicating Visualizations without Visuals Investigation of Visualization Alternative Text for People with Visual Impairments. Alternative text is critical in communicating graphics to people who are blind or have low vision. Especially for graphics that contain rich information, such as visualizations, poorly written or an absence of alternative texts can worsen the information access inequality for people with visual impairments. In this work, we consolidate existing guidelines and survey current practices to inspect to what extent current practices and recommendations are aligned. Then, to gain more insight into what people want in visualization alternative texts, we interviewed 22 people with visual impairments regarding their experience with visualizations and their information needs in alternative texts. The study findings suggest that participants actively try to construct an image of visualizations in their head while listening to alternative texts and wish to carry out visualization tasks (e.g., retrieve specific values) as sighted viewers would. The study also provides ample support for the need to reference the underlying data instead of visual elements to reduce users' cognitive burden. Informed by the study, we provide a set of recommendations to compose an informative alternative text.


Effective computations of the Atiyah Bott formula. We present an implementation of the Atiyah Bott residue formula for overline M 0,m ( mathbb P n ,d) . We use this implementation to compute a large number of Gromov Witten invariants of genus 0 , including intersection numbers of rational curves on general complete intersections. We also compute some numbers of rational contact curves satisfying suitable Schubert conditions. Our computations confirm known predictions made by Mirror Symmetry. The code we developed for these problems is publicly available and can also be used for other types of computations.


Analysis of the gradual transition from the near to the far field in single slit diffraction. In Optics it is common to split up the formal analysis of diffraction according to two convenient approximations, in the near and far fields (also known as the Fresnel and Fraunhofer regimes, respectively). Within this scenario, geometrical optics, the optics describing the light phenomena observable in our everyday life, is introduced as the short wavelength limit of near field phenomena, assuming that the typical size of the aperture (or obstacle) that light is incident on is much larger than the light wavelength. With the purpose to provide an alternative view on how geometrical optics fits within the context of the diffraction theory, particularly how it emerges, the transition from the near to the far field is revisited here both analytically and numerically. Accordingly, first this transition is investigated in the case of Gaussian beam diffraction, since its full analyticity paves the way for a better understanding of the paradigmatic (and typical) case of diffraction by sharp edged single slits. This latter case is then tackled both analytically, by means of some insightful approximations and guesses, and numerically. As it is shown, this analysis makes explicit the influence of the various parameters involved in diffraction processes, such as the typical size of the input (diffracted) wave or its wavelength, or the distance between the input and output planes. Moreover, analytical expressions have been determined for the critical turnover value of the slit width that separates typical Fraunhofer diffraction regimes from the behaviors eventually leading to the geometrical optics limit, finding a good agreement with both numerically simulated results and experimental data extracted from the literature.


iART A Search Engine for Art Historical Images to Support Research in the Humanities. In this paper, we introduce iART an open Web platform for art historical research that facilitates the process of comparative vision. The system integrates various machine learning techniques for keyword and content based image retrieval as well as category formation via clustering. An intuitive GUI supports users to define queries and explore results. By using a state of the art cross modal deep learning approach, it is possible to search for concepts that were not previously detected by trained classification models. Art historical objects from large, openly licensed collections such as Amsterdam Rijksmuseum and Wikidata are made available to users.


A propagation of chaos result for weakly interacting nonlinear Snell envelopes. In this article, we establish a propagation of chaos result for weakly interacting nonlinear Snell envelopes which converge to a class of mean field reflected backward stochastic differential equations (BSDEs) with jumps and right continuous and left limited obstacle, where the mean field interaction in terms of the distribution of the Y component of the solution enters both the driver and the lower obstacle. Under mild Lipschitz and integrability conditions on the coefficients, we prove existence and uniqueness of the solution to both the mean field reflected BSDEs with jumps and the corresponding system of weakly interacting particles and provide a propagation of chaos result for the whole solution (Y,Z,U,K) , which requires new technical results due to the dependence of the obstacle on the solution and the presence of jumps.


A remark on the discrete spectrum of non self adjoint Jacobi operators. We study the trace class perturbations of the whole line, discrete Laplacian and obtain a new bound for the perturbation determinant of the corresponding non self adjoint Jacobi operator. Based on this bound, we refine the Lieb Thirring inequality due to Hansmann Katriel. The spectral enclosure for such operators is also discussed.


Analysis of centrality measures under differential privacy models. This paper provides the first analysis of the differentially private computation of three centrality measures, namely eigenvector, Laplacian and closeness centralities, on arbitrary weighted graphs, using the smooth sensitivity approach. We do so by finding lower bounds on the amounts of noise that a randomised algorithm needs to add in order to make the output of each measure differentially private. Our results indicate that these computations are either infeasible, in the sense that there are large families of graphs for which smooth sensitivity is unbounded or impractical, in the sense that even for the cases where smooth sensitivity is bounded, the required amounts of noise result in unacceptably large utility losses.


Self Confidence of Undergraduate Students in Designing Software Architecture. Contributions This paper investigates the relations between undergraduate software architecture students' self confidence and their course expectations, cognitive levels, preferred learning methods, and critical thinking. Background these students, often, lack self confidence in their ability to use their knowledge to design software architectures. Intended Outcomes Self confidence is expected to be related to the students' course expectations, cognitive levels, preferred learning methods, and critical thinking. Application Design We developed a questionnaire with open ended questions to assess the self confidence levels and related factors, which was taken by one hundred ten students in two semesters. The students answers were coded and analyzed afterward. Findings We found that self confidence is weakly associated with the students' course expectations and critical thinking and independent from their cognitive levels and preferred learning methods. The results suggest that to improve the self confidence of the students, the instructors should ensure that the students' have "correct" course expectations and work on improving the students' critical thinking capabilities.


A high order fictitious domain method for the advection diffusion equation on time varying domain. We develop a high order finite element method to solve the advection diffusion equation on a time varying domain. The method is based on a characteristic Galerkin formulation combined with the k rm th order backward differentiation formula (BDF k ) and the fictitious domain finite element method. Optimal error estimates of the discrete solutions are proven for 2 le k le 4 by taking account of the errors from interface tracking, temporal discretization, and spatial discretization, provided that the (k 1) rm th order Runge Kutta scheme is used for interface tracking. Numerical experiments demonstrate the optimal convergence of the method for k 3 and 4 .


Synthetic Multidimensional Plasma Electron Hole Equilibria. Methods for constructing synthetic multidimensional electron hole equilibria without using particle simulation are investigated. Previous approaches have various limitations and approximations that make them unsuitable within the context of expected velocity diffusion near the trapped passing boundary. An adjustable model of the distribution function is introduced that avoids unphysical singularities there, and yet is sufficiently tractable analytically to enable prescription of the potential spatial profiles. It is shown why simple models of the charge density as being a function only of potential cannot give solitary multidimensional electron holes, in contradiction of prior suppositions. Fully self consistent axisymmetric electron holes in the drift kinetic limit of electron motion (negligible gyro radius) are constructed and their properties relevant to observational interpretation and finite gyro radius theory are discussed.


The Neumann problem for a type of fully nonlinear complex equations. In this paper we study the Neumann problem for a type of fully nonlinear second order elliptic partial differential equations on domains in mathbb C n without any curvature assumptions on the domain.


Absolute Continuity of Self Similar Measures. We prove that a self similar measure is absolutely continuous providing that it satisfies a condition depending on its Garsia entropy, contraction ratio, and the separation between different points in approximations of the self similar measure. In the special case of Bernoulli convolutions this paper gives a sufficient condition for the Bernoulli convolution with parameter lambda to be absolutely continuous in terms of lambda and its Mahler measure.


A Zero Radiation Pressure Sunshade for Supporting Climate Change Mitigation. Limiting climate change to within the 2 deg C limit requires net zero emissions of CO2 by 2050. However, the window of opportunity is closing fast. Geoengineering as the intentional and large scale manipulation of the environment and in particular the climate is increasingly discussed as a complement to ongoing mitigation efforts. As a particular geoengineering approach, space based geoengineering blocks or dissipates a fraction of incoming sunlight via many occulting membranes, located close to the Sun Earth Lagrange 1 point. However, the mass of the proposed sunshades, around 10 7 10 8 tons, and their associated cost render them about 10 3 times more costly than terrestrial alternatives. In this article, we propose a novel sunshade concept, which is between 10 2 to 10 3 times lighter than the lightest existing sunshade concepts. This is achieved via a net zero radiation pressure design, based on the use of diffractive metamaterials, removing one of the major constraints to reducing sunshade mass. The whole sunshade system has a total mass of approximately 6.2 times 10 5 tons and its deployment requires between 10 2 to 10 3 annual launches during a ten year period. The achieved cost reduction might render space based geoengineering competitive to terrestrial geoengineering approaches.


Reconciling Experimental and Theoretical Vibrational Deactivation in Low Energy O N 2 Collisions. Molecular dynamics calculations of inelastic collisions of atomic oxygen with molecular nitrogen are known to show orders of magnitude discrepancies with experimental results in the range from room temperature to many thousands of degrees Kelvin. In this work, we have achieved an unprecedented quantitative agreement with experiments even at low temperature, by including a non adiabatic treatment involving vibronic states on newly developed potential energy surfaces. This result paves the way to the calculation of accurate and detailed databases of vibrational energy exchange rates for this collisional system. This is bound to have an impact on air plasma simulations in a wide range of conditions and on the development of Very Low Earth Orbit (VLEO) satellites, operating in the low thermosphere, objects of great technological interest due to their potential at a competitive cost.


DeepRA Predicting Joint Damage From Radiographs Using CNN with Attention. Joint damage in Rheumatoid Arthritis (RA) is assessed by manually inspecting and grading radiographs of hands and feet. This is a tedious task which requires trained experts whose subjective assessment leads to low inter rater agreement. An algorithm which can automatically predict the joint level damage in hands and feet can help optimize this process, which will eventually aid the doctors in better patient care and research. In this paper, we propose a two staged approach which amalgamates object detection and convolution neural networks with attention which can efficiently and accurately predict the overall and joint level narrowing and erosion from patients radiographs. This approach has been evaluated on hands and feet radiographs of patients suffering from RA and has achieved a weighted root mean squared error (RMSE) of 1.358 and 1.404 in predicting joint level narrowing and erosion Sharp van der Heijde (SvH) scores which is 31 and 19 improvement with respect to the baseline SvH scores, respectively. The proposed approach achieved a weighted absolute error of 1.456 in predicting the overall damage in hands and feet radiographs for the patients which is a 79 improvement as compared to the baseline. Our method also provides an inherent capability to provide explanations for model predictions using attention weights, which is essential given the black box nature of deep learning models. The proposed approach was developed during the RA2 Dream Challenge hosted by Dream Challenges and secured 4th and 8th position in predicting overall and joint level narrowing and erosion SvH scores from radiographs.


Adversarial Specification Mining. There have been numerous studies on mining temporal specifications from execution traces. These approaches learn finite state automata (FSA) from execution traces when running tests. To learn accurate specifications of a software system, many tests are required. Existing approaches generalize from a limited number of traces or use simple test generation strategies. Unfortunately, these strategies may not exercise uncommon usage patterns of a software system. To address this problem, we propose a new approach, adversarial specification mining, and develop a prototype, DICE (Diversity through Counter Examples). DICE has two components DICE Tester and DICE Miner. After mining Linear Temporal Logic specifications from an input test suite, DICE Tester adversarially guides test generation, searching for counterexamples to these specifications to invalidate spurious properties. These counterexamples represent gaps in the diversity of the input test suite. This process produces execution traces of usage patterns that were unrepresented in the input test suite. Next, we propose a new specification inference algorithm, DICE Miner, to infer FSAs using the traces, guided by the temporal specifications. We find that the inferred specifications are of higher quality than those produced by existing state of the art specification miners. Finally, we use the FSAs in a fuzzer for servers of stateful protocols, increasing its coverage.


Deep Neural Networks for Radar Waveform Classification. We consider the problem of classifying radar pulses given raw I Q waveforms in the presence of noise and absence of synchronization. We also consider the problem of classifying multiple superimposed radar pulses. For both, we design deep neural networks (DNNs) that are robust to synchronization, pulse width, and SNR. Our designs yield more than 100x reduction in error rate over the previous state of the art.