A Novel Deep Parallel Time series Relation Network for Fault Diagnosis. Considering the models that apply the contextual information of time series data could improve the fault diagnosis performance, some neural network structures such as RNN, LSTM, and GRU were proposed to model the fault diagnosis effectively. However, these models are restricted by their serial computation and hence cannot achieve high diagnostic efficiency. Also the parallel CNN is difficult to implement fault diagnosis in an efficient way because it requires larger convolution kernels or deep structure to achieve long term feature extraction capabilities. Besides, BERT model applies absolute position embedding to introduce contextual information to the model, which would bring noise to the raw data and therefore cannot be applied to fault diagnosis directly. In order to address the above problems, a fault diagnosis model named deep parallel time series relation network(DPTRN) has been proposed in this paper. There are mainly three advantages for DPTRN (1) Our proposed time relationship unit is based on full multilayer perceptron(MLP) structure, therefore, DPTRN performs fault diagnosis in a parallel way and improves computing efficiency significantly. (2) By improving the absolute position embedding, our novel decoupling position embedding unit could be applied on the fault diagnosis directly and learn contextual information. (3) Our proposed DPTRN has obvious advantage in feature interpretability. We confirm the effect of the proposed method on four datasets, and the results show the effectiveness, efficiency and interpretability of the proposed DPTRN model.


A generalization of the Brown Halmos theorems for the unit ball. In this paper we generalize the classical theorems of Brown and Halmos about algebraic properties of Toeplitz operators to Bergman spaces over the unit ball in several complex variables. A key result, which is of independent interest, is the characterization of summable functions u on the unit ball whose Berezin transform can be written as a finite sum sum j f j , bar g j with all f j, g j being holomorphic. In particular, we show that such a function must be pluriharmonic if it is sufficiently smooth and bounded. We also settle an open question about mathcal M harmonic functions. Our proofs employ techniques and results from function and operator theory as well as partial differential equations.


Order Effects in Bayesian Updates. Order effects occur when judgments about a hypothesis's probability given a sequence of information do not equal the probability of the same hypothesis when the information is reversed. Different experiments have been performed in the literature that supports evidence of order effects. We proposed a Bayesian update model for order effects where each question can be thought of as a mini experiment where the respondents reflect on their beliefs. We showed that order effects appear, and they have a simple cognitive explanation the respondent's prior belief that two questions are correlated. The proposed Bayesian model allows us to make several predictions (1) we found certain conditions on the priors that limit the existence of order effects (2) we show that, for our model, the QQ equality is not necessarily satisfied (due to symmetry assumptions) and (3) the proposed Bayesian model has the advantage of possessing fewer parameters than its quantum counterpart.


Fuzzy Gaussian mixture optimization of the newsvendor problem mixing online reviews and judgemental demand data. Motivated by the increasing exposition of decision makers to both statistical and judgemental based sources of demand information, we develop in this paper a fuzzy Gaussian Mixture Model (GMM) for the newsvendor permitting to mix probabilistic inputs with a subjective weight modelled as a fuzzy number. The developed framework can model for instance situations where sales are impacted by customers sensitive to online review feedbacks or expert opinions. It can also model situations where a marketing campaign leads to different stochastic alternatives for the demand with a fuzzy weight. Thanks to a tractable mathematical application of the fuzzy machinery on the newsvendor problem, we derived the optimal ordering strategy taking into account both probabilistic and fuzzy components of the demand. We show that the fuzzy GMM can be rewritten as a classical newsvendor problem with an associated density function involving these stochastic and fuzzy components of the demand. The developed model enables to relax the single modality of the demand distribution usually used in the newsvendor literature and to encode the risk attitude of the decision maker.


Point Cloud Upsampling and Normal Estimation using Deep Learning for Robust Surface Reconstruction. The reconstruction of real world surfaces is on high demand in various applications. Most existing reconstruction approaches apply 3D scanners for creating point clouds which are generally sparse and of low density. These points clouds will be triangulated and used for visualization in combination with surface normals estimated by geometrical approaches. However, the quality of the reconstruction depends on the density of the point cloud and the estimation of the surface normals. In this paper, we present a novel deep learning architecture for point cloud upsampling that enables subsequent stable and smooth surface reconstruction. A noisy point cloud of low density with corresponding point normals is used to estimate a point cloud with higher density and appendant point normals. To this end, we propose a compound loss function that encourages the network to estimate points that lie on a surface including normals accurately predicting the orientation of the surface. Our results show the benefit of estimating normals together with point positions. The resulting point cloud is smoother, more complete, and the final surface reconstruction is much closer to ground truth.


Mathematical analysis of a coupling method for the practical computation of homogenized coefficients. We present the mathematical study of a computational approach originally introduced by R. Cottereau in R. Cottereau, IJNME 2013 . The approach aims at evaluating the effective (a.k.a. homogenized) coefficient of a medium with some fine scale structure. It combines, using the Arlequin coupling method, the original fine scale description of the medium with an effective description and optimizes upon the coefficient of the effective medium to best fit the response of an equivalent purely homogeneous medium. We prove here that the approach is mathematically well posed and that it provides, under suitable assumptions, the actual value of the homogenized coefficient of the original medium in the limit of asymptotically infinitely fine structures. The theory presented here therefore usefully complements our numerical developments of O. Gorynina, C. Le Bris and F. Legoll, SIAM J. Sci. Computing 2021 .


Decentralized LTL Enforcement. We consider the runtime enforcement of Linear time Temporal Logic formulas on decentralized systems with no central observation point nor authority. A so called enforcer is attached to each system component and observes its local trace. Should the global trace violate the specification, the enforcers coordinate to correct their local traces. We formalize the decentralized runtime enforcement problem and define the expected properties of enforcers, namely soundness, transparency and optimality. We present two enforcement algorithms. In the first one, the enforcers explore all possible local modifications to find the best global correction. Although this guarantees an optimal correction, it forces the system to synchronize and is more costly, computation and communication wise. In the second one, each enforcer makes a local correction before communicating. The reduced cost of this version comes at the price of the optimality of the enforcer corrections.


MOTIF A Large Malware Reference Dataset with Ground Truth Family Labels. Malware family classification is a significant issue with public safety and research implications that has been hindered by the high cost of expert labels. The vast majority of corpora use noisy labeling approaches that obstruct definitive quantification of results and study of deeper interactions. In order to provide the data needed to advance further, we have created the Malware Open source Threat Intelligence Family (MOTIF) dataset. MOTIF contains 3,095 malware samples from 454 families, making it the largest and most diverse public malware dataset with ground truth family labels to date, nearly 3x larger than any prior expert labeled corpus and 36x larger than the prior Windows malware corpus. MOTIF also comes with a mapping from malware samples to threat reports published by reputable industry sources, which both validates the labels and opens new research opportunities in connecting opaque malware samples to human readable descriptions. This enables important evaluations that are normally infeasible due to non standardized reporting in industry. For example, we provide aliases of the different names used to describe the same malware family, allowing us to benchmark for the first time accuracy of existing tools when names are obtained from differing sources. Evaluation results obtained using the MOTIF dataset indicate that existing tasks have significant room for improvement, with accuracy of antivirus majority voting measured at only 62.10 and the well known AVClass tool having just 46.78 accuracy. Our findings indicate that malware family classification suffers a type of labeling noise unlike that studied in most ML literature, due to the large open set of classes that may not be known from the sample under consideration


Auto Tuning of Hadoop and Spark parameters. Data of the order of terabytes, petabytes, or beyond is known as Big Data. This data cannot be processed using the traditional database software, and hence there comes the need for Big Data Platforms. By combining the capabilities and features of various big data applications and utilities, Big Data Platforms form a single solution. It is a platform that helps to develop, deploy and manage the big data environment. Hadoop and Spark are the two open source Big Data Platforms provided by Apache. Both these platforms have many configurational parameters, which can have unforeseen effects on the execution time, accuracy, etc. Manual tuning of these parameters can be tiresome, and hence automatic ways should be needed to tune them. After studying and analyzing various previous works in automating the tuning of these parameters, this paper proposes two algorithms Grid Search with Finer Tuning and Controlled Random Search. The performance indicator studied in this paper is Execution Time. These algorithms help to tune the parameters automatically. Experimental results have shown a reduction in execution time of about 70 and 50 for Hadoop and 81.19 and 77.77 for Spark by Grid Search with Finer Tuning and Controlled Random Search, respectively.


Homological Lie brackets on moduli spaces and pushforward operations in twisted K theory. Enumerative geometry studies the intersection theory of virtual fundamental classes in the homology of moduli spaces. These usually depend on auxiliary parameters and are then related by wall crossing formulas. We construct a homological graded Lie bracket on the homology of moduli spaces which can be used to express universal wall crossing formulas. For this we develop a new topological theory of pushforward operations for principal bundles with orientations in twisted K theory. We prove that all rational pushforward operations are obtained from a single new projective Euler operation, which also has applications to Chern classes in twisted K theory.


Dissecting the Performance of Chained BFT. Permissioned blockchains employ Byzantine fault tolerant (BFT) state machine replication (SMR) to reach agreement on an ever growing, linearly ordered log of transactions. A new paradigm, combined with decades of research in BFT SMR and blockchain (namely chained BFT, or cBFT), has emerged for directly constructing blockchain protocols. Chained BFT protocols have a unifying propose vote scheme instead of multiple different voting phases with a set of voting and commit rules to guarantee safety and liveness. However, distinct voting and commit rules impose varying impacts on performance under different workloads, network conditions, and Byzantine attacks. Therefore, a fair comparison of the proposed protocols poses a challenge that has not yet been addressed by existing work. We fill this gap by studying a family of cBFT protocols with a two pronged systematic approach. First, we present an evaluation framework, Bamboo, for quick prototyping of cBFT protocols and that includes helpful benchmarking facilities. To validate Bamboo, we introduce an analytic model using queuing theory which also offers a back of the envelope guide for dissecting these protocols. We build multiple cBFT protocols using Bamboo and we are the first to fairly compare three representatives (i.e., HotStuff, two chain HotStuff, and Streamlet). We evaluated these protocols under various parameters and scenarios, including two Byzantine attacks that have not been widely discussed in the literature. Our findings reveal interesting trade offs (e.g., responsiveness vs. forking resilience) between different cBFT protocols and their design choices, which provide developers and researchers with insights into the design and implementation of this protocol family.


What Makes Agile Software Development Agile?. Together with many success stories, promises such as the increase in production speed and the improvement in stakeholders' collaboration have contributed to making agile a transformation in the software industry in which many companies want to take part. However, driven either by a natural and expected evolution or by contextual factors that challenge the adoption of agile methods as prescribed by their creator(s), software processes in practice mutate into hybrids over time. Are these still agile? In this article, we investigate the question what makes a software development method agile? We present an empirical study grounded in a large scale international survey that aims to identify software development methods and practices that improve or tame agility. Based on 556 data points, we analyze the perceived degree of agility in the implementation of standard project disciplines and its relation to used development methods and practices. Our findings suggest that only a small number of participants operate their projects in a purely traditional or agile manner (under 15 ). That said, most project disciplines and most practices show a clear trend towards increasing degrees of agility. Compared to the methods used to develop software, the selection of practices has a stronger effect on the degree of agility of a given discipline. Finally, there are no methods or practices that explicitly guarantee or prevent agility. We conclude that agility cannot be defined solely at the process level. Additional factors need to be taken into account when trying to implement or improve agility in a software company. Finally, we discuss the field of software process related research in the light of our findings and present a roadmap for future research.


Scalable codes for precision calculations of properties of complex atomic systems. High precision atomic data is indispensable for experiments involving studies of fundamental interactions, astrophysics, atomic clocks, plasma science, and others. We develop new parallel atomic structure codes and explore the difficulties of load balancing in these codes. Efficient load balancing of matrix elements for many electron systems is very difficult due to the intrinsic nature of the computational methods used to compute them. By arithmetically selecting determinants for each core, we achieve very even workload distribution, and attain near perfect linear scalability and efficiency with the number of cores. We also implement dynamic memory allocation to minimize memory usage and remove the need for users to set certain array parameters. Our newly developed codes enable computations that were not possible before due to lack of memory or prohibitive computation times, and allow a broader range of correlations to be investigated in a shorter period of time. This includes calculations correlating all 60 electrons in the highly charged Ir 17 ion and calculations predicting the 3C 3D line intensity ratio in Fe 16 . Our new code package will also be used to produce large volumes of high precision atomic data for a new online portal being developed at the University of Delaware.


Learning Meta class Memory for Few Shot Semantic Segmentation. Currently, the state of the art methods treat few shot semantic segmentation task as a conditional foreground background segmentation problem, assuming each class is independent. In this paper, we introduce the concept of meta class, which is the meta information (e.g. certain middle level features) shareable among all classes. To explicitly learn meta class representations in few shot segmentation task, we propose a novel Meta class Memory based few shot segmentation method (MM Net), where we introduce a set of learnable memory embeddings to memorize the meta class information during the base class training and transfer to novel classes during the inference stage. Moreover, for the k shot scenario, we propose a novel image quality measurement module to select images from the set of support images. A high quality class prototype could be obtained with the weighted sum of support image features based on the quality measure. Experiments on both PASCAL 5 i and COCO dataset shows that our proposed method is able to achieve state of the art results in both 1 shot and 5 shot settings. Particularly, our proposed MM Net achieves 37.5 mIoU on the COCO dataset in 1 shot setting, which is 5.1 higher than the previous state of the art.


Progress of microscopic thermoelectric effects studied by micro and nano thermometric techniques. Heat dissipation is one of the most serious problems in modern integrated electronics with the continuously decreasing devices size. Large portion of the consumed power is inevitably dissipated in the form of waste heat which not only restricts the device energy efficiency performance itself, but also leads to severe environment problems and energy crisis. Thermoelectric Seebeck effect is a green energy recycling method, while thermoelectric Peltier effect can be employed for heat management by actively cooling overheated devices, where passive cooling by heat conduction is not sufficiently enough. However, the technological applications of thermoelectricity are limited so far by their very low conversion efficiencies and lack of deep understanding of thermoelectricity in microscopic levels.


Discovering Multi Label Actor Action Association in a Weakly Supervised Setting. Since collecting and annotating data for spatio temporal action detection is very expensive, there is a need to learn approaches with less supervision. Weakly supervised approaches do not require any bounding box annotations and can be trained only from labels that indicate whether an action occurs in a video clip. Current approaches, however, cannot handle the case when there are multiple persons in a video that perform multiple actions at the same time. In this work, we address this very challenging task for the first time. We propose a baseline based on multi instance and multi label learning. Furthermore, we propose a novel approach that uses sets of actions as representation instead of modeling individual action classes. Since computing, the probabilities for the full power set becomes intractable as the number of action classes increases, we assign an action set to each detected person under the constraint that the assignment is consistent with the annotation of the video clip. We evaluate the proposed approach on the challenging AVA dataset where the proposed approach outperforms the MIML baseline and is competitive to fully supervised approaches.


Quasilinear Schr "odinger equations ground state and infinitely many normalized solutions. In the present paper, we study the normalized solutions for the following quasilinear Schr "odinger equations Delta u u Delta u 2 lambda u u p 2 u quad text in mathbb R N, with prescribed mass int mathbb R N u 2 a 2. We first consider the mass supercritical case p 4 frac 4 N , which has not been studied before. By using a perturbation method, we succeed to prove the existence of ground state normalized solutions, and by applying the index theory, we obtain the existence of infinitely many normalized solutions. Then we turn to study the mass critical case, i.e., p 4 frac 4 N , and obtain some new existence results. Moreover, we also observe a concentration behavior of the ground state solutions.


Design and Performance Analysis of a Chaotic Pseudo Orthogonal Carriers Multi Access Communication System. A Chaotic Pseudo Orthogonal Carriers Multi Access (CPOCMA) communication based on Chaotic Pseudo Orthogonal Shape forming Filter (CPOSF) bank, Chaotic Pseudo Orthogonal Matched Filter (CPOMF) bank and Chaotic Pseudo Orthogonal Correlation Filter (CPOCF) bank is proposed in this work. At the transmitter, the multiple CPOSFs are used to generate pseudo orthogonal signals. It provides a good trade off between spectrum efficiency and high bit transmission rate. At the receiver, the CPOMF bank and CPOCF bank are used to maximize the Signal to Noise Ratio (SNR) and extract the received information from each sub channel, respectively. The received signal is demodulated by averaging the sampled sequence from the matched filter bank output and sorting the sampling sequence from the CPOCF bank output to recover the transmitted information bits. The proposed CPOCMA communication system not only offers multiuser access with high reliability and high data transmission rate, but also achieves higher spectrum efficiency. Analytical Bit Error Rate (BER) expression is derived. The proposed communication system performance has been evaluated in Additive White Gaussian Noise (AWGN) channel and wireless channel by both numerical simulations and experiments based on a Wireless open Access Research Platform (WARP), the results show the effectiveness and the superiority of the proposed method.


Fixed Viewpoint Mirror Surface Reconstruction under an Uncalibrated Camera. This paper addresses the problem of mirror surface reconstruction, and proposes a solution based on observing the reflections of a moving reference plane on the mirror surface. Unlike previous approaches which require tedious calibration, our method can recover the camera intrinsics, the poses of the reference plane, as well as the mirror surface from the observed reflections of the reference plane under at least three unknown distinct poses. We first show that the 3D poses of the reference plane can be estimated from the reflection correspondences established between the images and the reference plane. We then form a bunch of 3D lines from the reflection correspondences, and derive an analytical solution to recover the line projection matrix. We transform the line projection matrix to its equivalent camera projection matrix, and propose a cross ratio based formulation to optimize the camera projection matrix by minimizing reprojection errors. The mirror surface is then reconstructed based on the optimized cross ratio constraint. Experimental results on both synthetic and real data are presented, which demonstrate the feasibility and accuracy of our method.


Uniqueness of enhancements for derived and geometric categories. We prove that the derived categories of abelian categories have unique enhancements all of them, the unbounded, bounded, bounded above and bounded below derived categories. The unseparated and left completed derived categories of a Grothendieck abelian category are also shown to have unique enhancements. Finally we show that the derived category of complexes with quasi coherent cohomology and the category of perfect complexes have unique enhancements for quasi compact and quasi separated schemes.


Cubature Method for Stochastic Volterra Integral Equations. In this paper, we introduce the cubature formulas for Stochastic Volterra Integral Equations. We first derive the stochastic Taylor expansion in this setting and provide its tail estimates. We then introduce the cubature measure for such equations, and construct it explicitly in some special cases, including a long memory stochastic volatility model. Finally, we illustrate its efficiency by presenting several numerical examples.


Regularized Sequential Latent Variable Models with Adversarial Neural Networks. The recurrent neural networks (RNN) with richly distributed internal states and flexible non linear transition functions, have overtaken the dynamic Bayesian networks such as the hidden Markov models (HMMs) in the task of modeling highly structured sequential data. These data, such as from speech and handwriting, often contain complex relationships between the underlaying variational factors and the observed data. The standard RNN model has very limited randomness or variability in its structure, coming from the output conditional probability model. This paper will present different ways of using high level latent random variables in RNN to model the variability in the sequential data, and the training method of such RNN model under the VAE (Variational Autoencoder) principle. We will explore possible ways of using adversarial method to train a variational RNN model. Contrary to competing approaches, our approach has theoretical optimum in the model training and provides better model training stability. Our approach also improves the posterior approximation in the variational inference network by a separated adversarial training step. Numerical results simulated from TIMIT speech data show that reconstruction loss and evidence lower bound converge to the same level and adversarial training loss converges to 0.


Stabilising viscous extensional flows using Reinforcement Learning. The four roll mill, wherein four identical cylinders undergo rotation of identical magnitude but alternate signs, was originally proposed by GI Taylor to create local extensional flows and study their ability to deform small liquid drops. Since an extensional flow has an unstable eigendirection, a drop located at the flow stagnation point will have a tendency to escape. This unstable dynamics can however be stabilised using, e.g., a modulation of the rotation rates of the cylinders. Here we use Reinforcement Learning, a branch of Machine Learning devoted to the optimal selection of actions based on cumulative rewards, in order to devise a stabilisation algorithm for the four roll mill flow. The flow is modelled as the linear superposition of four two dimensional rotlets and the drop is treated as a rigid spherical particle smaller than all other length scales in the problem. Unlike previous attempts to devise control, we take a probabilistic approach whereby speed adjustments are drawn from a probability density function whose shape is improved over time via a form of gradient ascent know as Actor Critic method. With enough training, our algorithm is able to precisely control the drop and keep it close to the stagnation point for as long as needed. We explore the impact of the physical and learning parameters on the effectiveness of the control and demonstrate the robustness of the algorithm against thermal noise. We finally show that Reinforcement Learning can provide a control algorithm effective for all initial positions and that can be adapted to limit the magnitude of the flow extension near the position of the drop.


Simplicity of twisted C algebras of Deaconu Renault groupoids. We consider Deaconu Renault groupoids associated to actions of finite rank free abelian monoids by local homeomorphisms of locally compact Hausdorff spaces. We study simplicity of the twisted C algebra of such a groupoid determined by a continuous circle valued groupoid 2 cocycle. When the groupoid is not minimal, this C algebra is never simple, so we focus on minimal groupoids. We describe an action of the quotient of the groupoid by the interior of its isotropy on the spectrum of the twisted C algebra of the interior of the isotropy. We prove that the twisted groupoid C algebra is simple if and only if this action is minimal. We describe applications to crossed products of topological graph C algebras by quasi free actions.


Higher integrability and the number of singular points for the Navier Stokes equations with a scale invariant bound. First, we show that if the pressure p (associated to a weak Leray Hopf solution v of the Navier Stokes equations) satisfies p L infty t (0,T L frac 3 2 , infty ( mathbb R 3)) leq M 2 , then v possesses higher integrability up to the first potential blow up time T . Our method is concise and is based upon energy estimates applied to powers of v and the utilization of a small exponent'. As a consequence, we show that if a weak Leray Hopf solution v first blows up at T and satisfies the Type I condition v L infty t (0,T L 3, infty ( mathbb R 3)) leq M , then nabla v in L 2 O( frac 1 M ) ( mathbb R 3 times ( tfrac 1 2 T ,T )). This is the first result of its kind, improving the integrability exponent of nabla v under the Type I assumption in the three dimensional setting. Finally, we show that if v mathbb R 3 times 1,0 rightarrow mathbb R 3 is a weak Leray Hopf solution to the Navier Stokes equations with s n uparrow 0 such that sup n v( cdot,s n ) L 3, infty ( mathbb R 3) leq M then v possesses at most O(M 20 ) singular points at t 0 . Our method is direct and concise. It is based upon known varepsilon regularity, global bounds on a Navier Stokes solution with initial data in L 3, infty ( mathbb R 3) and rescaling arguments. We do not require arguments based on backward uniqueness nor unique continuation results for parabolic operators.


Deep Fraud Detection on Non attributed Graph. Fraud detection problems are usually formulated as a machine learning problem on a graph. Recently, Graph Neural Networks (GNNs) have shown solid performance on fraud detection. The successes of most previous methods heavily rely on rich node features and high fidelity labels. However, labeled data is scarce in large scale industrial problems, especially for fraud detection where new patterns emerge from time to time. Meanwhile, node features are also limited due to privacy and other constraints. In this paper, two improvements are proposed 1) We design a graph transformation method capturing the structural information to facilitate GNNs on non attributed fraud graphs. 2) We propose a novel graph pre training strategy to leverage more unlabeled data via contrastive learning. Experiments on a large scale industrial dataset demonstrate the effectiveness of the proposed framework for fraud detection.


Reliable Graph Neural Network Explanations Through Adversarial Training. Graph neural network (GNN) explanations have largely been facilitated through post hoc introspection. While this has been deemed successful, many post hoc explanation methods have been shown to fail in capturing a model's learned representation. Due to this problem, it is worthwhile to consider how one might train a model so that it is more amenable to post hoc analysis. Given the success of adversarial training in the computer vision domain to train models with more reliable representations, we propose a similar training paradigm for GNNs and analyze the respective impact on a model's explanations. In instances without ground truth labels, we also determine how well an explanation method is utilizing a model's learned representation through a new metric and demonstrate adversarial training can help better extract domain relevant insights in chemistry.


Error Estimates of a Fully Discrete Multiphysics Finite Element Method for a Nonlinear Poroelasticity Model. In this paper, we propose a multiphysics finite element method for a nonlinear poroelasticity model. To better describe the processes of deformation and diffusion, we firstly reformulate the nonlinear fluid solid coupling problem into a fluid fluid coupling problem by a multiphysics approach. Then we design a fully discrete time stepping scheme to use multiphysics finite element method with P 2 P 1 P 1 element pairs for the space variables and backward Euler method for the time variable, and we adopt the Newton iterative method to deal with the nonlinear term. Also, we derive the discrete energy laws and the optimal convergence order error estimates without any assumption on the nonlinear stress strain relation. Finally, we show some numerical examples to verify the rationality of theoretical analysis and there is no "locking phenomenon".


Operon Dynamics with State Dependent Transcription and or Translation Delays. Transcription and translation retrieve and operationalize gene encoded information in cells. These processes are not instantaneous and incur significant delays. In this paper we study Goodwin models of both inducible and repressible operons with state dependent delays. The paper provides justification and derivation of the model, detailed analysis of the appropriate setting of the corresponding dynamical system, and extensive numerical analysis of its dynamics. Comparison with constant delay models shows significant differences in dynamics that include existence of stable periodic orbits in inducible systems and multistability in repressible systems. A combination of parameter space exploration, numerics, analysis of steady state linearization and bifurcation theory indicates the likely presence of Shilnikov type homoclinic bifurcations in the repressible operon model.


Pursuit evasion games on latin square graphs. We investigate various pursuit evasion parameters on latin square graphs, including the cop number, metric dimension, and localization number. The cop number of latin square graphs is studied, and for k MOLS (n), bounds for the cop number are given. If n (k 1) 2, then the cop number is shown to be k 2. Lower and upper bounds are provided for the metric dimension and localization number of latin square graphs. The metric dimension of back circulant latin squares shows that the lower bound is close to tight. Recent results on covers and partial transversals of latin squares provide the upper bound of n O left( frac log n log log n right) on the localization number of a latin square graph of order n.


Remarks on pseudo vertex transitive graphs with small diameter. Let Gamma denote a Q polynomial distance regular graph with vertex set X and diameter D . Let A denote the adjacency matrix of Gamma . For a vertex x in X and for 0 leq i leq D , let E i(x) denote the projection matrix to the i th subconstituent space of Gamma with respect to x . The Terwilliger algebra T(x) of Gamma with respect to x is the semisimple subalgebra of mathrm Mat X( mathbb C ) generated by A, E 0(x), ldots, E D(x) . Let V mathbb C X denote a mathbb C vector space consisting of complex column vectors with rows indexed by X . We say Gamma is pseudo vertex transitive whenever for any vertices x,y in X , both (i) the Terwilliger algebras T(x) and T(y) of Gamma are isomorphic and (ii) there exists a mathbb C vector space isomorphism rho V to V such that ( rho A A rho)V 0 and ( rho E i(x) E i(y) rho)V 0 for all 0 leq i leq D . In this paper we discuss pseudo vertex transitivity for distance regular graphs with diameter D in 2,3,4 . In the case of diameter two, a strongly regular graph Gamma is thin, and Gamma is pseudo vertex transitive if and only if every local graph of Gamma has the same spectrum. In the case of diameter three, Taylor graphs are thin and pseudo vertex transitive. In the case of diameter four, antipodal tight graphs are thin and pseudo vertex transitive.


Dropout's Dream Land Generalization from Learned Simulators to Reality. A World Model is a generative model used to simulate an environment. World Models have proven capable of learning spatial and temporal representations of Reinforcement Learning environments. In some cases, a World Model offers an agent the opportunity to learn entirely inside of its own dream environment. In this work we explore improving the generalization capabilities from dream environments to real environments (Dream2Real). We present a general approach to improve a controller's ability to transfer from a neural network dream environment to reality at little additional cost. These improvements are gained by drawing on inspiration from Domain Randomization, where the basic idea is to randomize as much of a simulator as possible without fundamentally changing the task at hand. Generally, Domain Randomization assumes access to a pre built simulator with configurable parameters but oftentimes this is not available. By training the World Model using dropout, the dream environment is capable of creating a nearly infinite number of different dream environments. Previous use cases of dropout either do not use dropout at inference time or averages the predictions generated by multiple sampled masks (Monte Carlo Dropout). Dropout's Dream Land leverages each unique mask to create a diverse set of dream environments. Our experimental results show that Dropout's Dream Land is an effective technique to bridge the reality gap between dream environments and reality. Furthermore, we additionally perform an extensive set of ablation studies.


On graded representations of modular Lie algebras over commutative algebras. We develop the theory of a category mathscr C A which is a generalisation to non restricted mathfrak g modules of a category famously studied by Andersen, Jantzen and Soergel for restricted mathfrak g modules, where mathfrak g is the Lie algebra of a reductive group G over an algebraically closed field mathbb K of characteristic p 0 . Its objects are certain graded bimodules. On the left, they are graded modules over an algebra U chi associated to mathfrak g and to chi in mathfrak g in standard Levi form. On the right, they are modules over a commutative Noetherian S( mathfrak h ) algebra A , where mathfrak h is the Lie algebra of a maximal torus of G . We develop here certain important modules Z A, chi ( lambda) , Q A, chi I( lambda) and Q A, chi ( lambda) in mathscr C A which generalise familiar objects when A mathbb K , and we prove some key structural results regarding them.


Towards Robust Human Trajectory Prediction in Raw Videos. Human trajectory prediction has received increased attention lately due to its importance in applications such as autonomous vehicles and indoor robots. However, most existing methods make predictions based on human labeled trajectories and ignore the errors and noises in detection and tracking. In this paper, we study the problem of human trajectory forecasting in raw videos, and show that the prediction accuracy can be severely affected by various types of tracking errors. Accordingly, we propose a simple yet effective strategy to correct the tracking failures by enforcing prediction consistency over time. The proposed "re tracking" algorithm can be applied to any existing tracking and prediction pipelines. Experiments on public benchmark datasets demonstrate that the proposed method can improve both tracking and prediction performance in challenging real world scenarios. The code and data are available at https git.io retracking prediction.


Applications of the Harary Sachs Theorem for Hypergraphs. The Harary Sachs theorem for k uniform hypergraphs equates the codegree d coefficient of the adjacency characteristic polynomial of a uniform hypergraph with a weighted sum of subgraph counts over certain multi hypergraphs with d edges. We begin by showing that the classical Harary Sachs theorem for graphs is indeed a special case of this general theorem. To this end we apply the generalized Harary Sachs theorem to the leading coefficients of the characteristic polynomial of various hypergraphs. In particular, we provide explicit and asymptotic formulas for the contribution of the k uniform simplex to the codegree d coefficient. Moreover, we provide an explicit formula for the leading terms of the characteristic polynomial of a 3 uniform hypergraph and further show how this can be used to determine the complete spectrum of a hypergraph. We conclude with a conjecture concerning the multiplicity of the zero eigenvalue of a hypergraph.


DeFLOCNet Deep Image Editing via Flexible Low level Controls. User intended visual content fills the hole regions of an input image in the image editing scenario. The coarse low level inputs, which typically consist of sparse sketch lines and color dots, convey user intentions for content creation ( ie, free form editing). While existing methods combine an input image and these low level controls for CNN inputs, the corresponding feature representations are not sufficient to convey user intentions, leading to unfaithfully generated content. In this paper, we propose DeFLOCNet which relies on a deep encoder decoder CNN to retain the guidance of these controls in the deep feature representations. In each skip connection layer, we design a structure generation block. Instead of attaching low level controls to an input image, we inject these controls directly into each structure generation block for sketch line refinement and color propagation in the CNN feature space. We then concatenate the modulated features with the original decoder features for structure generation. Meanwhile, DeFLOCNet involves another decoder branch for texture generation and detail enhancement. Both structures and textures are rendered in the decoder, leading to user intended editing results. Experiments on benchmarks demonstrate that DeFLOCNet effectively transforms different user intentions to create visually pleasing content.


The maximum measure of 3 wise t intersecting families. Let mathcal G be a family of subsets of an n element set. The family mathcal G is called 3 wise t intersecting if the intersection of any three subsets in mathcal G is of size at least t . For a real number p in(0,1) we define the measure of the family by the sum of p G (1 p) n G over all G in mathcal G . We prove that if p leq 2 ( sqrt 4t 9 1) then p t is the maximum measure of 3 wise t intersecting families, and the bound for p is sharp. We also present the corresponding stability result.


Direct Behavior Specification via Constrained Reinforcement Learning. The standard formulation of Reinforcement Learning lacks a practical way of specifying what are admissible and forbidden behaviors. Most often, practitioners go about the task of behavior specification by manually engineering the reward function, a counter intuitive process that requires several iterations and is prone to reward hacking by the agent. In this work, we argue that constrained RL, which has almost exclusively been used for safe RL, also has the potential to significantly reduce the amount of work spent for reward specification in applied RL projects. To this end, we propose to specify behavioral preferences in the CMDP framework and to use Lagrangian methods to automatically weigh each of these behavioral constraints. Specifically, we investigate how CMDPs can be adapted to solve goal based tasks while adhering to several constraints simultaneously. We evaluate this framework on a set of continuous control tasks relevant to the application of Reinforcement Learning for NPC design in video games.


Adversarially Trained Models with Test Time Covariate Shift Adaptation. We empirically demonstrate that test time adaptive batch normalization, which re estimates the batch normalization statistics during inference, can provide ell 2 certification as well as improve the commonly occurring corruption robustness of adversarially trained models while maintaining their state of the art empirical robustness against adversarial attacks. Furthermore, we obtain similar ell 2 certification as the current state of the art certification models for CIFAR 10 by learning our adversarially trained model using larger ell 2 bounded adversaries. Therefore our work is a step towards bridging the gap between the state of the art certification and empirical robustness. Our results also indicate that improving the empirical adversarial robustness may be sufficient as we achieve certification and corruption robustness as a by product using test time adaptive batch normalization.


The limiting absorption principle for massless Dirac operators, properties of spectral shift functions, and an application to the Witten index of non Fredholm operators. We derive a limiting absorption principle on any compact interval in mathbb R backslash 0 for the free massless Dirac operator, H 0 alpha cdot ( i nabla) in L 2( mathbb R n) N , n geq 2 , N 2 lfloor(n 1) 2 rfloor , and then prove the absence of singular continuous spectrum of interacting massless Dirac operators H H 0 V , where V decays like O( x 1 varepsilon ) . Expressing the spectral shift function xi( , cdot , H,H 0) as normal boundary values of regularized Fredholm determinants, we prove that for sufficiently decaying V , xi( , cdot , H,H 0) in C(( infty,0) cup (0, infty)) , and that the left and right limits at zero, xi(0 pm H,H 0) , exist. Introducing the non Fredholm operator boldsymbol D boldsymbol A frac d dt boldsymbol A in L 2 big( mathbb R L 2( mathbb R n) N big) , where boldsymbol A boldsymbol A boldsymbol B , boldsymbol A , and boldsymbol B are generated in terms of H, H 0 and V , via A(t) A B(t) , A H 0 , B(t) b(t) V , t in mathbb R , assuming b is smooth, b( infty) 0 , b( infty) 1 , and introducing boldsymbol H 1 boldsymbol D boldsymbol A boldsymbol D boldsymbol A , boldsymbol H 2 boldsymbol D boldsymbol A boldsymbol D boldsymbol A , one of the principal results in this manuscript expresses the k th resolvent regularized Witten index W k,r ( boldsymbol D boldsymbol A ) ( k in mathbb N , k geq lceil n 2 rceil ) in terms of spectral shift functions as W k,r ( boldsymbol D boldsymbol A ) xi(0 boldsymbol H 2 , boldsymbol H 1 ) xi(0 H,H 0) xi(0 H,H 0) 2. Here L 2( mathbb R mathcal H ) int mathbb R oplus dt , mathcal H and boldsymbol T int mathbb R oplus dt , T(t) abbreviate direct integrals.


PAGANI A Parallel Adaptive GPU Algorithm for Numerical. We present a new adaptive parallel algorithm for the challenging problem of multi dimensional numerical integration on massively parallel architectures. Adaptive algorithms have demonstrated the best performance, but efficient many core utilization is difficult to achieve because the adaptive work load can vary greatly across the integration space and is impossible to predict a priori. Existing parallel algorithms utilize sequential computations on independent processors, which results in bottlenecks due to the need for data redistribution and processor synchronization. Our algorithm employs a high throughput approach in which all existing sub regions are processed and sub divided in parallel. Repeated sub region classification and filtering improves upon a brute force approach and allows the algorithm to make efficient use of computation and memory resources. A CUDA implementation shows orders of magnitude speedup over the fastest open source CPU method and extends the achievable accuracy for difficult integrands. Our algorithm typically outperforms other existing deterministic parallel methods.


Meta learning PINN loss functions. We propose a meta learning technique for offline discovery of physics informed neural network (PINN) loss functions. We extend earlier works on meta learning, and develop a gradient based meta learning algorithm for addressing diverse task distributions based on parametrized partial differential equations (PDEs) that are solved with PINNs. Furthermore, based on new theory we identify two desirable properties of meta learned losses in PINN problems, which we enforce by proposing a new regularization method or using a specific parametrization of the loss function. In the computational examples, the meta learned losses are employed at test time for addressing regression and PDE task distributions. Our results indicate that significant performance improvement can be achieved by using a shared among tasks offline learned loss function even for out of distribution meta testing. In this case, we solve for test tasks that do not belong to the task distribution used in meta training, and we also employ PINN architectures that are different from the PINN architecture used in meta training. To better understand the capabilities and limitations of the proposed method, we consider various parametrizations of the loss function and describe different algorithm design options and how they may affect meta learning performance.


Tukey Depth Histograms. The Tukey depth of a flat with respect to a point set is a concept that appears in many areas of discrete and computational geometry. In particular, the study of centerpoints, center transversals, Ham Sandwich cuts, or k edges can all be phrased in terms of depths of certain flats with respect to one or more point sets. In this work, we introduce the Tukey depth histogram of k flats in mathbb R d with respect to a point set P , which is a vector D k,d (P) , whose i 'th entry D k,d i(P) denotes the number of k flats spanned by k 1 points of P that have Tukey depth i with respect to P . As our main result, we give a complete characterization of the depth histograms of points, that is, for any dimension d we give a description of all possible histograms D 0,d (P) . This then allows us to compute the exact number of possible such histograms.


Beam power scale up in MEMS based multi beam ion accelerators. We report on the development of multi beam RF linear ion accelerators that are formed from stacks of low cost wafers and describe the status of beam power scale up using an array of 120 beams. The total argon ion current extracted from the 120 beamlet extraction column was 0.5 mA. The measured energy gain in each RF gap reached as high as 7.25 keV. We present a path of using this technology to achieve ion currents 1 mA and ion energies 100 keV for applications in materials processing.


EviDR Evidence Emphasized Discrete Reasoning for Reasoning Machine Reading Comprehension. Reasoning machine reading comprehension (R MRC) aims to answer complex questions that require discrete reasoning based on text. To support discrete reasoning, evidence, typically the concise textual fragments that describe question related facts, including topic entities and attribute values, are crucial clues from question to answer. However, previous end to end methods that achieve state of the art performance rarely solve the problem by paying enough emphasis on the modeling of evidence, missing the opportunity to further improve the model's reasoning ability for R MRC. To alleviate the above issue, in this paper, we propose an evidence emphasized discrete reasoning approach (EviDR), in which sentence and clause level evidence is first detected based on distant supervision, and then used to drive a reasoning module implemented with a relational heterogeneous graph convolutional network to derive answers. Extensive experiments are conducted on DROP (discrete reasoning over paragraphs) dataset, and the results demonstrate the effectiveness of our proposed approach. In addition, qualitative analysis verifies the capability of the proposed evidence emphasized discrete reasoning for R MRC.


Raven's Progressive Matrices Completion with Latent Gaussian Process Priors. Abstract reasoning ability is fundamental to human intelligence. It enables humans to uncover relations among abstract concepts and further deduce implicit rules from the relations. As a well known abstract visual reasoning task, Raven's Progressive Matrices (RPM) are widely used in human IQ tests. Although extensive research has been conducted on RPM solvers with machine intelligence, few studies have considered further advancing the standard answer selection (classification) problem to a more challenging answer painting (generating) problem, which can verify whether the model has indeed understood the implicit rules. In this paper we aim to solve the latter one by proposing a deep latent variable model, in which multiple Gaussian processes are employed as priors of latent variables to separately learn underlying abstract concepts from RPMs thus the proposed model is interpretable in terms of concept specific latent variables. The latent Gaussian process also provides an effective way of extrapolation for answer painting based on the learned concept changing rules. We evaluate the proposed model on RPM like datasets with multiple continuously changing visual concepts. Experimental results demonstrate that our model requires only few training samples to paint high quality answers, generate novel RPM panels, and achieve interpretability through concept specific latent variables.


DeepLight Robust Unobtrusive Real time Screen Camera Communication for Real World Displays. The paper introduces a novel, holistic approach for robust Screen Camera Communication (SCC), where video content on a screen is visually encoded in a human imperceptible fashion and decoded by a camera capturing images of such screen content. We first show that state of the art SCC techniques have two key limitations for in the wild deployment (a) the decoding accuracy drops rapidly under even modest screen extraction errors from the captured images, and (b) they generate perceptible flickers on common refresh rate screens even with minimal modulation of pixel intensity. To overcome these challenges, we introduce DeepLight, a system that incorporates machine learning (ML) models in the decoding pipeline to achieve humanly imperceptible, moderately high SCC rates under diverse real world conditions. Deep Light's key innovation is the design of a Deep Neural Network (DNN) based decoder that collectively decodes all the bits spatially encoded in a display frame, without attempting to precisely isolate the pixels associated with each encoded bit. In addition, DeepLight supports imperceptible encoding by selectively modulating the intensity of only the Blue channel, and provides reasonably accurate screen extraction (IoU values 83 ) by using state of the art object detection DNN pipelines. We show that a fully functional DeepLight system is able to robustly achieve high decoding accuracy (frame error rate 0.2) and moderately high data goodput ( 0.95Kbps) using a human held smartphone camera, even over larger screen camera distances (approx 2m).


Normalized solutions with positive energies for a coercive problem and application to the cubic quintic nonlinear Schr " o dinger equation. In any dimension N geq 1 , for given mass m 0 and when the C 1 energy functional begin equation I(u) frac 1 2 int mathbb R N nabla u 2 dx int mathbb R N F(u) dx end equation is coercive on the mass constraint begin equation S m left u in H 1( mathbb R N) u 2 L 2( mathbb R N) m right , end equation we are interested in searching for constrained critical points at positive energy levels. Under general conditions on F in C 1( mathbb R , mathbb R ) and for suitable ranges of the mass, we manage to construct such critical points which appear as a local minimizer or correspond to a mountain pass or a symmetric mountain pass level. In particular, our results shed some light on the cubic quintic nonlinear Schr " o dinger equation in mathbb R 3 .


The weak b principle Mumford conjecture. In this note we introduce and study a new class of maps called oriented colored broken submersions. This is the simplest class of maps that satisfies a version of the b principle and in dimension 2 approximates the class of oriented submersions well in the sense that every oriented colored broken submersion of dimension 2 to a closed simply connected manifold is bordant to a submersion. We show that the Madsen Weiss theorem (the standard Mumford Conjecture) fits a general setting of the b principle. Namely, a version of the b principle for oriented colored broken submersions together with the Harer stability theorem and Miller Morita theorem implies the Madsen Weiss theorem.


Characters of infinite dimensional quantum classical groups BCD cases. We study the character theory of inductive limits of q deformed classical compact groups. In particular, we clarify the relationship between the representation theory of Drinfeld Jimbo quantized universal enveloping algebras and our previous work on the quantized characters. We also apply the character theory to construct Markov semigroups on unitary duals of SO q(2N 1) , Sp q(N) , and their inductive limits.


The weak Ramsey property and extreme amenability. We extend the Kechris Pestov Todor v c evi 'c correspondence to weak Fra " i ss ' e categories and automorphism groups of generic objects. The new ingredient is the weak Ramsey property. We demonstrate the theory on several examples including monoid categories, the category of almost linear orders, and categories of strong embeddings of trees.


Incentives in Two sided Matching Markets with Prediction enhanced Preference formation. Two sided matching markets have long existed to pair agents in the absence of regulated exchanges. A common example is school choice, where a matching mechanism uses student and school preferences to assign students to schools. In such settings, forming preferences is both difficult and critical. Prior work has suggested various prediction mechanisms that help agents make decisions about their preferences. Although often deployed together, these matching and prediction mechanisms are almost always analyzed separately. The present work shows that at the intersection of the two lies a previously unexplored type of strategic behavior agents returning to the market (e.g., schools) can attack future predictions by interacting short term non optimally with their matches. Here, we first introduce this type of strategic behavior, which we call an adversarial interaction attack'. Next, we construct a formal economic model that captures the feedback loop between prediction mechanisms designed to assist agents and the matching mechanism used to pair them. This economic model allows us to analyze adversarial interaction attacks. Finally, using school choice as an example, we build a simulation to show that, as the trust in and accuracy of predictions increases, schools gain progressively more by initiating an adversarial interaction attack. We also show that this attack increases inequality in the student population.


Deep Superpixel based Network for Blind Image Quality Assessment. The goal in a blind image quality assessment (BIQA) model is to simulate the process of evaluating images by human eyes and accurately assess the quality of the image. Although many approaches effectively identify degradation, they do not fully consider the semantic content in images resulting in distortion. In order to fill this gap, we propose a deep adaptive superpixel based network, namely DSN IQA, to assess the quality of image based on multi scale and superpixel segmentation. The DSN IQA can adaptively accept arbitrary scale images as input images, making the assessment process similar to human perception. The network uses two models to extract multi scale semantic features and generate a superpixel adjacency map. These two elements are united together via feature fusion to accurately predict image quality. Experimental results on different benchmark databases demonstrate that our algorithm is highly competitive with other approaches when assessing challenging authentic image databases. Also, due to adaptive deep superpixel based network, our model accurately assesses images with complicated distortion, much like the human eye.


Variational Latent State GPT for Semi supervised Task Oriented Dialog Systems. Recently, two approaches, fine tuning large pre trained language models and variational training, have attracted significant interests, separately, for semi supervised end to end task oriented dialog (TOD) systems. In this paper, we propose Variational Latent State GPT model (VLS GPT), which is the first to combine the strengths of the two approaches. Among many options of models, we propose the generative model and the inference model for variational learning of the end to end TOD system, both as auto regressive language models based on GPT 2, which can be further trained over a mix of labeled and unlabeled dialog data in a semi supervised manner. Variational training of VLS GPT is both statistically and computationally more challenging than previous variational learning works for sequential latent variable models, which use turn level first order Markovian. The inference model in VLS GPT is non Markovian due to the use of the Transformer architecture. In this work, we establish Recursive Monte Carlo Approximation (RMCA) to the variational objective with non Markovian inference model and prove its unbiasedness. Further, we develop the computational strategy of sampling then forward computation to realize RMCA, which successfully overcomes the memory explosion issue of using GPT in variational learning and speeds up training. Semi supervised TOD experiments are conducted on two benchmark multi domain datasets of different languages MultiWOZ2.1 and CrossWOZ. VLS GPT is shown to significantly outperform both supervised only and semi supervised self training baselines.


Two Matrix Weighted Inequalities for Commutators with Fractional Integral Operators. In this paper we prove two matrix weighted norm inequalities for the commutator of a fractional integral operator and multiplication by a matrix symbol. More precisely, we extend the recent results of the second author, Pott, and Treil on two matrix weighted norm inequalities for commutators of Calderon Zygmund operators and multiplication by a matrix symbol to the fractional integral operator setting. In particular, we completely extend the fractional Bloom theory of Holmes, Rahm, and Spencer to the two matrix weighted setting with a matrix


Improved Corruption Robust Algorithms for Episodic Reinforcement Learning. We study episodic reinforcement learning under unknown adversarial corruptions in both the rewards and the transition probabilities of the underlying system. We propose new algorithms which, compared to the existing results in (Lykouris et al., 2020), achieve strictly better regret bounds in terms of total corruptions for the tabular setting. To be specific, firstly, our regret bounds depend on more precise numerical values of total rewards corruptions and transition corruptions, instead of only on the total number of corrupted episodes. Secondly, our regret bounds are the first of their kind in the reinforcement learning setting to have the number of corruptions show up additively with respect to min sqrt T , text PolicyGapComplexity rather than multiplicatively. Our results follow from a general algorithmic framework that combines corruption robust policy elimination meta algorithms, and plug in reward free exploration sub algorithms. Replacing the meta algorithm or sub algorithm may extend the framework to address other corrupted settings with potentially more structure.


Unbiased Simulation Estimators for Multivariate Jump Diffusions. We develop and analyze a class of unbiased Monte Carlo estimators for multivariate jump diffusion processes with state dependent drift, volatility, jump intensity and jump size. A change of measure argument is used to extend existing unbiased estimators for the inter arrival diffusion to include state dependent jumps. Under standard regularity conditions on the coefficient and target functions, we prove the unbiasedness and finite variance properties of the resulting jump diffusion estimators. Numerical experiments illustrate the efficiency of our estimators.


Scene Editing as Teleoperation A Case Study in 6DoF Kit Assembly. Studies in robot teleoperation have been centered around action specifications from continuous joint control to discrete end effector pose control. However, these robot centric interfaces often require skilled operators with extensive robotics expertise. To make teleoperation accessible to non expert users, we propose the framework "Scene Editing as Teleoperation" (SEaT), where the key idea is to transform the traditional "robot centric" interface into a "scene centric" interface instead of controlling the robot, users focus on specifying the task's goal by manipulating digital twins of the real world objects. As a result, a user can perform teleoperation without any expert knowledge of the robot hardware. To achieve this goal, we utilize a category agnostic scene completion algorithm that translates the real world workspace (with unknown objects) into a manipulable virtual scene representation and an action snapping algorithm that refines the user input before generating the robot's action plan. To train the algorithms, we procedurally generated a large scale, diverse kit assembly dataset that contains object kit pairs that mimic real world object kitting tasks. Our experiments in simulation and on a real world system demonstrate that our framework improves both the efficiency and success rate for 6DoF kit assembly tasks. A user study demonstrates that SEaT framework participants achieve a higher task success rate and report a lower subjective workload compared to an alternative robot centric interface. Video can be found at https www.youtube.com watch?v NdR3mkPbQQ .


UoT UWF PartAI at SemEval 2021 Task 5 Self Attention Based Bi GRU with Multi Embedding Representation for Toxicity Highlighter. Toxic Spans Detection(TSD) task is defined as highlighting spans that make a text toxic. Many works have been done to classify a given comment or document as toxic or non toxic. However, none of those proposed models work at the token level. In this paper, we propose a self attention based bidirectional gated recurrent unit(BiGRU) with a multi embedding representation of the tokens. Our proposed model enriches the representation by a combination of GPT 2, GloVe, and RoBERTa embeddings, which led to promising results. Experimental results show that our proposed approach is very effective in detecting span tokens.


Finite Sample Analysis of Off Policy Natural Actor Critic with Linear Function Approximation. In this paper, we develop a novel variant of off policy natural actor critic algorithm with linear function approximation and we establish a sample complexity of mathcal O ( epsilon 3 ) , outperforming all the previously known convergence bounds of such algorithms. In order to overcome the divergence due to deadly triad in off policy policy evaluation under function approximation, we develop a critic that employs n step TD learning algorithm with a properly chosen n . We present finite sample convergence bounds on this critic under both constant and diminishing step sizes, which are of independent interest. Furthermore, we develop a variant of natural policy gradient under function approximation, with an improved convergence rate of mathcal O (1 T) after T iterations. Combining the finite sample error bounds of actor and the critic, we obtain the mathcal O ( epsilon 3 ) sample complexity. We derive our sample complexity bounds solely based on the assumption that the behavior policy sufficiently explores all the states and actions, which is a much lighter assumption compared to the related literature.


Branch Prediction as a Reinforcement Learning Problem Why, How and Case Studies. Recent years have seen stagnating improvements to branch predictor (BP) efficacy and a dearth of fresh ideas in branch predictor design, calling for fresh thinking in this area. This paper argues that looking at BP from the viewpoint of Reinforcement Learning (RL) facilitates systematic reasoning about, and exploration of, BP designs. We describe how to apply the RL formulation to branch predictors, show that existing predictors can be succinctly expressed in this formulation, and study two RL based variants of conventional BPs.


Kinetic scale current sheets in the solar wind at 1 AU Scale dependent properties and critical current density. We present analysis of 17,043 proton kinetic scale current sheets collected over 124 days of Wind spacecraft measurements in the solar wind at 11 Samples s magnetic field resolution. The current sheets have thickness lambda from a few tens to one thousand kilometers with typical value around 100 km or from about 0.1 to 10 lambda p in terms of local proton inertial length lambda p . We found that the current density is larger for smaller scale current sheets, J 0 approx 6 rm nA m 2 cdot ( lambda 100 rm km ) 0.56 , but does not statistically exceed critical value J A corresponding to the drift between ions and electrons of local Alv ' e n speed. The observed trend holds in normalized units, J 0 J A approx 0.17 cdot ( lambda lambda p ) 0.51 . The current sheets are statistically force free with magnetic shear angle correlated with current sheet spatial scale, Delta theta approx 19 circ cdot ( lambda lambda p ) 0.5 . The observed correlations are consistent with local turbulence being the source of proton kinetic scale current sheets in the solar wind, while mechanisms limiting the current density remain to be understood.


Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification. In recent years graph neural network (GNN) based approaches have become a popular strategy for processing point cloud data, regularly achieving state of the art performance on a variety of tasks. To date, the research community has primarily focused on improving model expressiveness, with secondary thought given to how to design models that can run efficiently on resource constrained mobile devices including smartphones or mixed reality headsets. In this work we make a step towards improving the efficiency of these models by making the observation that these GNN models are heavily limited by the representational power of their first, feature extracting, layer. We find that it is possible to radically simplify these models so long as the feature extraction layer is retained with minimal degradation to model performance further, we discover that it is possible to improve performance overall on ModelNet40 and S3DIS by improving the design of the feature extractor. Our approach reduces memory consumption by 20 times and latency by up to 9.9 times for graph layers in models such as DGCNN overall, we achieve speed ups of up to 4.5 times and peak memory reductions of 72.5 .


A Survey of Embodied AI From Simulators to Research Tasks. There has been an emerging paradigm shift from the era of "internet AI" to "embodied AI", where AI algorithms and agents no longer learn from datasets of images, videos or text curated primarily from the internet. Instead, they learn through interactions with their environments from an egocentric perception similar to humans. Consequently, there has been substantial growth in the demand for embodied AI simulators to support various embodied AI research tasks. This growing interest in embodied AI is beneficial to the greater pursuit of Artificial General Intelligence (AGI), but there has not been a contemporary and comprehensive survey of this field. This paper aims to provide an encyclopedic survey for the field of embodied AI, from its simulators to its research. By evaluating nine current embodied AI simulators with our proposed seven features, this paper aims to understand the simulators in their provision for use in embodied AI research and their limitations. Lastly, this paper surveys the three main research tasks in embodied AI visual exploration, visual navigation and embodied question answering (QA), covering the state of the art approaches, evaluation metrics and datasets. Finally, with the new insights revealed through surveying the field, the paper will provide suggestions for simulator for task selections and recommendations for the future directions of the field.


Differentiable Stereopsis Meshes from multiple views using differentiable rendering. We propose Differentiable Stereopsis, a multi view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end to end model which predicts textured 3D meshes of objects with varying topologies and shape. We frame stereopsis as an optimization problem and simultaneously update shape and cameras via simple gradient descent. We run an extensive quantitative analysis and compare to traditional multi view stereo techniques and state of the art learning based methods. We show compelling reconstructions on challenging real world scenes and for an abundance of object types with complex shape, topology and texture. Project webpage https shubham goel.github.io ds


Discriminative Noise Robust Sparse Orthogonal Label Regression based Domain Adaptation. Domain adaptation (DA) aims to enable a learning model trained from a source domain to generalize well on a target domain, despite the mismatch of data distributions between the two domains. State of the art DA methods have so far focused on the search of a latent shared feature space where source and target domain data can be aligned either statistically and or geometrically. In this paper, we propose a novel unsupervised DA method, namely Discriminative Noise Robust Sparse Orthogonal Label Regression based Domain Adaptation (DOLL DA). The proposed DOLL DA derives from a novel integrated model which searches a shared feature subspace where source and target domain data are, through optimization of some repulse force terms, discriminatively aligned statistically, while at same time regresses orthogonally data labels thereof using a label embedding trick. Furthermore, in minimizing a novel Noise Robust Sparse Orthogonal Label Regression(NRS OLR) term, the proposed model explicitly accounts for data outliers to avoid negative transfer and introduces the property of sparsity when regressing data labels. Due to the character restriction. Please read our detailed abstract in our paper.


Discriminative Generative Representation Learning for One Class Anomaly Detection. As a kind of generative self supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too much attention to pixel level details, and generator is difficult to learn abstract semantic representations from label prediction pretext tasks as effective as discriminator. In order to improve the representation learning ability of generator, we propose a self supervised learning framework combining generative methods and discriminative methods. The generator no longer learns representation by reconstruction error, but the guidance of discriminator, and could benefit from pretext tasks designed for discriminative methods. Our discriminative generative representation learning method has performance close to discriminative methods and has a great advantage in speed. Our method used in one class anomaly detection task significantly outperforms several state of the arts on multiple benchmark data sets, increases the performance of the top performing GAN based baseline by 6 on CIFAR 10 and 2 on MVTAD.


Almost Gorenstein determinantal rings of symmetric matrices. We provide a characterization of the almost Gorenstein property of determinantal rings of a symmetric matrix of indeterminates over an infinite field. We give an explicit formula for ranks of the last two modules in the resolution of determinantal rings using Schur functors.


Scaling Shared Memory Data Structures as Distributed Global View Data Structures in the Partitioned Global Address Space model. The Partitioned Global Address Space (PGAS), a memory model in which the global address space is explicitly partitioned across compute nodes in a cluster, strives to bridge the gap between shared memory and distributed memory programming. To further bridge this gap, there has been an adoption of global view distributed data structures, such as 'global arrays' or 'distributed arrays'. This work demonstrates how shared memory data structures can be modified to scale in distributed memory. Presented in this work is the Distributed Interlocked Hash Table (DIHT), a global view distributed map data structure inpired by the Interlocked Hash Table (IHT). At 64 nodes with 44 cores per node, DIHT provides upto 110x the performance of the Chapel standard library HashedDist.


What is the market potential for on demand services as a train station access mode?. Ride hailing and other on demand mobility services are often proposed as a solution for improving the accessibility of public transport by offering first last mile connectivity. We study the potential of using on demand services to improve train station access by means of a three step sequential stated preference survey. We compare the preferences for on demand services with the bicycle, car and public transport for accessing two alternative train stations at different access distances. We estimate a joint access mode and train station choice model. By estimating a latent class choice model, we uncover five distinct segments in the population. We describe the classes based on their stated preferences, travel behaviour, attitudes towards new mobility and their socio demographic characteristics. The two largest classes, accounting for over half of the sample, are the most likely to adopt on demand services. Having an average willingness to pay, they would choose these services for longer access distances, competing mainly with the car and local public transport. Applying the model estimates, we observe that while on demand services mainly compete with public transportation (obtaining most of its travellers from it), they are not able to fully substitute a public transport service for train station access, as many users would switch to cycling or driving a car, rather than opting for the on demand service.


Predicting Knowledge Gain during Web Search based on Multimedia Resource Consumption. In informal learning scenarios the popularity of multimedia content, such as video tutorials or lectures, has significantly increased. Yet, the users' interactions, navigation behavior, and consequently learning outcome, have not been researched extensively. Related work in this field, also called search as learning, has focused on behavioral or text resource features to predict learning outcome and knowledge gain. In this paper, we investigate whether we can exploit features representing multimedia resource consumption to predict of knowledge gain (KG) during Web search from in session data, that is without prior knowledge about the learner. For this purpose, we suggest a set of multimedia features related to image and video consumption. Our feature extraction is evaluated in a lab study with 113 participants where we collected data for a given search as learning task on the formation of thunderstorms and lightning. We automatically analyze the monitored log data and utilize state of the art computer vision methods to extract features about the seen multimedia resources. Experimental results demonstrate that multimedia features can improve KG prediction. Finally, we provide an analysis on feature importance (text and multimedia) for KG prediction.


Leaf Image based Plant Disease Identification using Color and Texture Features. Identification of plant disease is usually done through visual inspection or during laboratory examination which causes delays resulting in yield loss by the time identification is complete. On the other hand, complex deep learning models perform the task with reasonable performance but due to their large size and high computational requirements, they are not suited to mobile and handheld devices. Our proposed approach contributes automated identification of plant diseases which follows a sequence of steps involving pre processing, segmentation of diseased leaf area, calculation of features based on the Gray Level Co occurrence Matrix (GLCM), feature selection and classification. In this study, six color features and twenty two texture features have been calculated. Support vector machines is used to perform one vs one classification of plant disease. The proposed model of disease identification provides an accuracy of 98.79 with a standard deviation of 0.57 on 10 fold cross validation. The accuracy on a self collected dataset is 82.47 for disease identification and 91.40 for healthy and diseased classification. The reported performance measures are better or comparable to the existing approaches and highest among the feature based methods, presenting it as the most suitable method to automated leaf based plant disease identification. This prototype system can be extended by adding more disease categories or targeting specific crop or disease categories.


Remarks on symplectic capacities of p products. In this note we study the behavior of symplectic capacities of convex domains in the classical phase space with respect to symplectic p products. As an application, by using a "tensor power trick", we show that it is enough to prove the weak version of Viterbo's volume capacity conjecture in the asymptotic regime, i.e., when the dimension is sent to infinity. In addition, we introduce a conjecture about higher order capacities of p products, and show that if it holds, then there are no non trivial p decompositions of the symplectic ball.


Virtual Reality for Emotion Elicitation A Review. Emotions are multifaceted phenomena that affect our behaviour, perception, and cognition. Increasing evidence indicates that induction mechanisms play a crucial role in triggering emotions by simulating the sensations required for an experimental design. Over the years, many reviews have evaluated a passive elicitation mechanism where the user is an observer, ignoring the importance of self relevance in emotional experience. So, in response to the gap in the literature, this study intends to explore the possibility of using Virtual Reality (VR) as an active mechanism for emotion induction. Furthermore, for the success and quality of research settings, VR must select the appropriate material to effectively evoke emotions. Therefore, in the present review, we evaluated to what extent VR visual and audio visual stimuli, games, and tasks, and 360 degree panoramas and videos can elicit emotions based on the current literature. Further, we present public datasets generated by VR and emotion sensing interfaces that can be used in VR based research. The conclusions of this survey reveal that VR has a great potential to evoke emotions effectively and naturally by generating motivational and empathy mechanisms which makes it an ecologically valid paradigm to study emotions.


Interpretive Blindness. We model here an epistemic bias we call textit interpretive blindness (IB). IB is a special problem for learning from testimony, in which one acquires information only from text or conversation. We show that IB follows from a co dependence between background beliefs and interpretation in a Bayesian setting and the nature of contemporary testimony. We argue that a particular characteristic contemporary testimony, textit argumentative completeness , can preclude learning in hierarchical Bayesian settings, even in the presence of constraints that are designed to promote good epistemic practices.


A Simple Baseline for Low Budget Active Learning. Active learning focuses on choosing a subset of unlabeled data to be labeled. However, most such methods assume that a large subset of the data can be annotated. We are interested in low budget active learning where only a small subset (e.g., 0.2 of ImageNet) can be annotated. Instead of proposing a new query strategy to iteratively sample batches of unlabeled data given an initial pool, we learn rich features by an off the shelf self supervised learning method only once, and then study the effectiveness of different sampling strategies given a low labeling budget on a variety of datasets including ImageNet. We show that although the state of the art active learning methods work well given a large labeling budget, a simple K means clustering algorithm can outperform them on low budgets. We believe this method can be used as a simple baseline for low budget active learning on image classification. Code is available at https github.com UCDvision low budget al


Photoelectron energy peaks shift against the radiation pressure in strong field ionization. The photoelectric effect describes the ejection of an electron upon absorption of one or several photons. The kinetic energy of this electron is determined by the photon energy reduced by the binding energy of the electron and, if strong laser fields are involved, by the ponderomotive potential in addition. It has therefore been widely taken for granted that for atoms and molecules the photoelectron energy does not depend on the electron's emission direction but theoretical studies have questioned this since 1990. Here we provide experimental evidence, that the energies of photoelectrons emitted against the light propagation direction are shifted towards higher values while those electrons that are emitted along the light propagation direction are shifted to lower values. We attribute the energy shift to a nondipole contribution from the interaction of the moving electrons with the incident photons.


Implementing ECC on Data Link Layer of the OSI Reference Model. The Internet, a rapidly expanding communication infrastructure, poses significant cybersecurity challenges. A few techniques have been developed to provide security in the OSI model's application, presentation, and network layers. Instead of using Media Access Control (MAC), this paper recommends using public key Elliptic Curve Cryptography to serve the Data Link Layer. On a microFourQ MSP IAR Embedded Workbench IDE MSP430 7.12.4, a prototype of the architecture was implemented. When the cost of key generation was compared to the curve, it was shown that they are directly related. The cost of key generation time rises in proportion to the bit length of the curve. Because of the large number of connected devices that may be exposed due to a lack of effective security in the data link layer, significant concerns arise in terms of network privacy, governance, and security. As a result, this research suggests using a public key cryptosystem based on an elliptic curve to secure the data link layer for safe data communication in Internet connected devices.


Optimal boundary regularity for some singular Monge Amp ere equations on bounded convex domains. By constructing explicit supersolutions, we obtain the optimal global H "older regularity for several singular Monge Amp ere equations on general bounded open convex domains including those related to complete affine hyperbolic spheres, and proper affine hyperspheres. Our analysis reveals that certain singular looking equations, such as det D 2 u u n 2 k (x cdot Du u) k with zero boundary data, have unexpected degenerate nature.


AppQ Warm starting App Recommendation Based on View Graphs. Current app ranking and recommendation systems are mainly based on user generated information, e.g., number of downloads and ratings. However, new apps often have few (or even no) user feedback, suffering from the classic cold start problem. How to quickly identify and then recommend new apps of high quality is a challenging issue. Here, a fundamental requirement is the capability to accurately measure an app's quality based on its inborn features, rather than user generated features. Since users obtain first hand experience of an app by interacting with its views, we speculate that the inborn features are largely related to the visual quality of individual views in an app and the ways the views switch to one another. In this work, we propose AppQ, a novel app quality grading and recommendation system that extracts inborn features of apps based on app source code. In particular, AppQ works in parallel to perform code analysis to extract app level features as well as dynamic analysis to capture view level layout hierarchy and the switching among views. Each app is then expressed as an attributed view graph, which is converted into a vector and fed to classifiers for recognizing its quality classes. Our evaluation with an app dataset from Google Play reports that AppQ achieves the best performance with accuracy of 85.0 . This shows a lot of promise to warm start app grading and recommendation systems with AppQ.


Post war Civil War Propaganda Techniques and Media Spins in Nigeria and Journalism Practice. In public relations and political communication, a spin is a form of propaganda achieved through knowingly presenting a biased interpretation of an event or issues. It is also the act of presenting narratives to influence public opinion about events, people or and ideas. In war time, various forms of spins are employed by antagonists to push their brigades to victory and wear out the opponents. During the Nigerian civil war, quite a number of these spins were dominant for example GOWON (Go On With One Nigeria) On Aburi We Stand, O Le Ku Ija Ore. Post war years presented different spins and fifty years after the war, different spins continue to push emerging narratives (e.g. marginalization, restructuring. This paper investigates and analyzes the different propaganda techniques and spins in the narratives of the Nigerian civil in the past five years through a content analysis of three national newspapers The Nigerian Tribune, Daily Trust and Sun Newspapers. Findings confirm that propaganda and spins are not limited to war time, but are actively deployed in peace time. This development places additional challenge on journalists to uphold the canons of balance, truth and fairness in reporting sensitive national issues.


Disentangling Hate in Online Memes. Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal hateful content has recently garnered much attention in academic and industry research communities. This paper aims to contribute to this emerging research topic by proposing DisMultiHate, which is a novel framework that performed the classification of multimodal hateful content. Specifically, DisMultiHate is designed to disentangle target entities in multimodal memes to improve hateful content classification and explainability. We conduct extensive experiments on two publicly available hateful and offensive memes datasets. Our experiment results show that DisMultiHate is able to outperform state of the art unimodal and multimodal baselines in the hateful meme classification task. Empirical case studies were also conducted to demonstrate DisMultiHate's ability to disentangle target entities in memes and ultimately showcase DisMultiHate's explainability of the multimodal hateful content classification task.


ZS IL Looking Back on Learned Experiences For Zero Shot Incremental Learning. Classical deep neural networks are limited in their ability to learn from emerging streams of training data. When trained sequentially on new or evolving tasks, their performance degrades sharply, making them inappropriate in real world use cases. Existing methods tackle it by either storing old data samples or only updating a parameter set of DNNs, which, however, demands a large memory budget or spoils the flexibility of models to learn the incremented class distribution. In this paper, we shed light on an on call transfer set to provide past experiences whenever a new class arises in the data stream. In particular, we propose a Zero Shot Incremental Learning not only to replay past experiences the model has learned but also to perform this in a zero shot manner. Towards this end, we introduced a memory recovery paradigm in which we query the network to synthesize past exemplars whenever a new task (class) emerges. Thus, our method needs no fixed sized memory, besides calls the proposed memory recovery paradigm to provide past exemplars, named a transfer set in order to mitigate catastrophically forgetting the former classes. Moreover, in contrast with recently proposed methods, the suggested paradigm does not desire a parallel architecture since it only relies on the learner network. Compared to the state of the art data techniques without buffering past data samples, ZS IL demonstrates significantly better performance on the well known datasets (CIFAR 10, Tiny ImageNet) in both Task IL and Class IL settings.


Liquid Reconfigurable Stealth Window Constructed by Metamaterial Absorber. In this paper, a liquid reconfigurable stealth window constructed by metamaterial absorber at microwave band is proposed. The stealth window consists of an anti reflection glass with indium tin oxide (ITO) as resistive film and a liquid container made of polymethyl methacrylate (PMMA). Since the materials constituting the window are all transparent, the metamaterials that can be switched through the liquid control system can always maintain high light transmission. The proposal can obtain a transmission passband from 2.3 GHz to 5 GHz with low insertion loss, especially at 2.45 GHz and 5 GHz with the insertion loss of the passband reach 0.51 and 0.99 , by alcohol drainage. It can also reflect electromagnetic waves at 2.45 GHz and absorb them from 4.5 GHz to 10.5 GHz with a strong absorptivity over 90 by alcohol injection, exhibiting the reconfigurable electromagnetic characteristic of switching between transmission state and absorption state. Furthermore, the proposed absorber shows its good transmission absorption performance under different polarizations and obtains absorptivity over 90 when alcohol injection in an oblique incidence of 50 deg . Finally, the prototype window has been fabricated to demonstrate the validity of the proposed structure, which indicates that the proposal presents significant implications for smart stealth systems and WLAN communication that require switching of working states in a complex electromagnetic environment.


The calibration method for the Thermal Insulation functional. We provide minimality criteria by construction of calibrations for functionals arising in the theory of Thermal Insulation.


The existential completion. We determine the existential completion of a primary doctrine, and we prove that the 2 monad obtained from it is lax idempotent, and that the 2 category of existential doctrines is isomorphic to the 2 category of algebras for this 2 monad. We also show that the existential completion of an elementary doctrine is again elementary. Finally we extend the notion of exact completion of an elementary existential doctrine to an arbitrary elementary doctrine.


Aldous Broder theorem extension to the non reversible case and new combinatorial proof. Aldous Broder algorithm is a famous algorithm used to sample a uniform spanning tree of any finite connected graph G, but it is more general it states that given a reversible M Markov chain on G started at r, the tree rooted at r formed by the steps of successive first entrance in each node (different from the root) has a probability proportional to prod e (e1,e2) in sf Edges (t,r) M e1,e2 , where the edges are directed toward r. As stated, it allows to sample many distributions on the set of spanning trees. In this paper we extend Aldous Broder theorem by dropping the reversibility condition on M. We highlight that the general statement we prove is not the same as the original one (but it coincides in the reversible case with that of Aldous and Broder). We prove this extension in two ways an adaptation of the classical argument, which is purely probabilistic, and a new proof based on combinatorial arguments. On the way we introduce a new combinatorial object that we call the golf sequences.


Time Discretization Invariant Safe Action Repetition for Policy Gradient Methods. In reinforcement learning, continuous time is often discretized by a time scale delta , to which the resulting performance is known to be highly sensitive. In this work, we seek to find a delta invariant algorithm for policy gradient (PG) methods, which performs well regardless of the value of delta . We first identify the underlying reasons that cause PG methods to fail as delta to 0 , proving that the variance of the PG estimator can diverge to infinity in stochastic environments under a certain assumption of stochasticity. While durative actions or action repetition can be employed to have delta invariance, previous action repetition methods cannot immediately react to unexpected situations in stochastic environments. We thus propose a novel delta invariant method named Safe Action Repetition (SAR) applicable to any existing PG algorithm. SAR can handle the stochasticity of environments by adaptively reacting to changes in states during action repetition. We empirically show that our method is not only delta invariant but also robust to stochasticity, outperforming previous delta invariant approaches on eight MuJoCo environments with both deterministic and stochastic settings. Our code is available at https vision.snu.ac.kr projects sar.