Extract, Integrate, Compete Towards Verification Style Reading Comprehension. In this paper, we present a new verification style reading comprehension dataset named VGaokao from Chinese Language tests of Gaokao. Different from existing efforts, the new dataset is originally designed for native speakers' evaluation, thus requiring more advanced language understanding skills. To address the challenges in VGaokao, we propose a novel Extract Integrate Compete approach, which iteratively selects complementary evidence with a novel query updating mechanism and adaptively distills supportive evidence, followed by a pairwise competition to push models to learn the subtle difference among similar text pieces. Experiments show that our methods outperform various baselines on VGaokao with retrieved complementary evidence, while having the merits of efficiency and explainability. Our dataset and code are released for further research.


What is A Wireless UAV? A Design Blueprint for 6G Flying Wireless Nodes. Wireless Unmanned Aerial Vehicles (UAVs) were introduced in the world of 4th generation networks (4G) as cellular users, and have attracted the interest of the wireless community ever since. In 5G, UAVs operate also as flying Base Stations providing service to ground users. They can also implement independent off the grid UAV networks. In 6G networks, wireless UAVs will connect ground users to in orbit wireless infrastructure. As the design and prototyping of wireless UAVs are on the rise, the time is ripe for introducing a more precise definition of what is a wireless UAV. In doing so, we revise the major design challenges in the prototyping of wireless UAVs for future 6G spectrum research. We then introduce a new wireless UAV prototype that addresses these challenges. The design of our wireless UAV prototype will be made public and freely available to other researchers.


Note on the spread of real symmetric matrices with entries in fixed interval. The spread of a matrix is defined as the maximum of distances between any two eigenvalues of that matrix. In this paper we investigate spread maximization as a function on compact convex subset of the set of real symmetric matrices. We provide some general results and further, we study spread maximizing problem on the set of symmetric matrices with entries restricted to the interval. In particular, we develop some results by X. Zhan, S. M. Fallat and J. J. Xing.


Modelling of ocean waves with the Alber equation application to non parametric spectra and generalization to crossing seas. The Alber equation is a phase averaged second moment model for the statistics of a sea state, which recently has been attracting renewed attention. We extend it in two ways firstly, we derive a generalized Alber system starting from a system of nonlinear Schr "odinger equations, which contains the classical Alber equation as a special case but can also describe crossing seas, i.e. two wavesystems with different wavenumbers crossing. (These can be two completely independent wavenumbers, i.e. in general different directions and different moduli.) We also derive the associated 2 dimensional scalar instability condition. This is the first time that a modulation instability condition applicable to crossing seas has been systematically derived for general spectra. Secondly, we use the classical Alber equation and its associated instability condition to quantify how close a given non parametric spectrum is to being modulationally unstable. We apply this to a dataset of 100 non parametric spectra provided by the Norwegian Meteorological Institute, and find the vast majority of realistic spectra turn out to be stable, but three extreme sea states are found to be unstable (out of 20 sea states chosen for their severity). Moreover, we introduce a novel "proximity to instability" (PTI) metric, inspired by the stability analysis. This is seen to correlate strongly with the steepness and Benjamin Feir Index (BFI) for the sea states in our dataset ( 85 Spearman rank correlation). Furthermore, upon comparing with phase resolved broadband Monte Carlo simulations, the kurtosis and probability of rogue waves for each sea state are also seen to correlate well with its PTI ( 85 Spearman rank correlation).


A polynomial Time Algorithm to Solve The Max atom Problem. In this paper we consider m ( m geq 1 )conjunctions of Max atoms that is atoms of the form max(z,y) r geq x , where the offset r is a real constant and x,y,z are variables. We show that the Max atom problem (MAP) belongs to textsf P . Indeed, we provide an algorithm which solves the MAP in O(n 6 m 2 n 4 m 3 n 2 m 4 ) operations, where n is the number of variables which compose the max atoms. As a by product other problems also known to be in textsf NP cap textsf co NP are in textsf P . P1 the problem to know if a tropical cone is trivial or not. P2 problem of tropical rank of a tropical matrix. P3 parity game problem. P4 scheduling problem with AND OR precedence constraints. P5 problem on hypergraph (shortest path). P6 problem in model checking and mu calculus.


Generation of Gradient Preserving Images allowing HOG Feature Extraction. In this paper, we propose a method for generating visually protected images, referred to as gradient preserving images. The protected images allow us to directly extract Histogram of Oriented Gradients (HOG) features for privacy preserving machine learning. In an experiment, HOG features extracted from gradient preserving images are applied to a face recognition algorithm to demonstrate the effectiveness of the proposed method.


Isoperiodic dynamics in rank 1 affine invariant orbifolds. Let M be a rank 1 affine invariant orbifold in a stratum of the moduli space of flat surfaces. We show that the leaves of the M isoperiodic foliation are either all closed or all dense. In the second case, we establish ergodicity of the foliation with respect to the affine measure on M.


Dynamic Sequential Graph Learning for Click Through Rate Prediction. Click through rate prediction plays an important role in the field of recommender system and many other applications. Existing methods mainly extract user interests from user historical behaviors. However, behavioral sequences only contain users' directly interacted items, which are limited by the system's exposure, thus they are often not rich enough to reflect all the potential interests. In this paper, we propose a novel method, named Dynamic Sequential Graph Learning (DSGL), to enhance users or items' representations by utilizing collaborative information from the local sub graphs associated with users or items. Specifically, we design the Dynamic Sequential Graph (DSG), i.e., a lightweight ego subgraph with timestamps induced from historical interactions. At every scoring moment, we construct DSGs for the target user and the candidate item respectively. Based on the DSGs, we perform graph convolutional operations iteratively in a bottom up manner to obtain the final representations of the target user and the candidate item. As for the graph convolution, we design a Time aware Sequential Encoding Layer that leverages the interaction time information as well as temporal dependencies to learn evolutionary user and item dynamics. Besides, we propose a Target Preference Dual Attention Layer, composed of a preference aware attention module and a target aware attention module, to automatically search for parts of behaviors that are relevant to the target and alleviate the noise from unreliable neighbors. Results on real world CTR prediction benchmarks demonstrate the improvements brought by DSGL.


Indiscriminate Poisoning Attacks Are Shortcuts. Indiscriminate data poisoning attacks, which add imperceptible perturbations to training data to maximize the test error of trained models, have become a trendy topic because they are thought to be capable of preventing unauthorized use of data. In this work, we investigate why these perturbations work in principle. We find that the perturbations of advanced poisoning attacks are almost textbf linear separable when assigned with the target labels of the corresponding samples, which hence can work as emph shortcuts for the learning objective. This important population property has not been unveiled before. Moreover, we further verify that linear separability is indeed the workhorse for poisoning attacks. We synthesize linear separable data as perturbations and show that such synthetic perturbations are as powerful as the deliberately crafted attacks. Our finding suggests that the emph shortcut learning problem is more serious than previously believed as deep learning heavily relies on shortcuts even if they are of an imperceptible scale and mixed together with the normal features. This finding also suggests that pre trained feature extractors would disable these poisoning attacks effectively.


Nonlinear and Linearised Primal and Dual Initial Boundary Value Problems When are they Bounded? How are they Connected?. Linearisation is often used as a first step in the analysis of nonlinear initial boundary value problems. The linearisation procedure frequently results in a confusing contradiction where the nonlinear problem conserves energy and has an energy bound but the linearised version does not (or vice versa). In this paper we attempt to resolve that contradiction and relate nonlinear energy conserving and bounded initial boundary value problems to their linearised versions and the related dual problems. We start by showing that a specific skew symmetric form of the primal nonlinear problem leads to energy conservation and a bound. Next, we show that this specific form together with a non standard linearisation procedure preserves these properties for the new slightly modified linearised problem. We proceed to show that the corresponding linear and nonlinear dual (or self adjoint) problems also have bounds and conserve energy due to this specific formulation. Next, the implication of the new formulation on the choice of boundary conditions is discussed. A straightforward nonlinear and linear analysis may lead to a different number and type of boundary conditions required for an energy bound. We show that the new formulation shed some light on this contradiction. We conclude by illustrating that the new continuous formulation automatically lead to energy stable and energy conserving numerical approximations for both linear and nonlinear primal and dual problems if the approximations are formulated on summation by parts form.


Evaluating Adversarial Attacks on ImageNet A Reality Check on Misclassification Classes. Although ImageNet was initially proposed as a dataset for performance benchmarking in the domain of computer vision, it also enabled a variety of other research efforts. Adversarial machine learning is one such research effort, employing deceptive inputs to fool models in making wrong predictions. To evaluate attacks and defenses in the field of adversarial machine learning, ImageNet remains one of the most frequently used datasets. However, a topic that is yet to be investigated is the nature of the classes into which adversarial examples are misclassified. In this paper, we perform a detailed analysis of these misclassification classes, leveraging the ImageNet class hierarchy and measuring the relative positions of the aforementioned type of classes in the unperturbed origins of the adversarial examples. We find that 71 of the adversarial examples that achieve model to model adversarial transferability are misclassified into one of the top 5 classes predicted for the underlying source images. We also find that a large subset of untargeted misclassifications are, in fact, misclassifications into semantically similar classes. Based on these findings, we discuss the need to take into account the ImageNet class hierarchy when evaluating untargeted adversarial successes. Furthermore, we advocate for future research efforts to incorporate categorical information.


Order Cancellation Law in a Semigroup of Closed Convex Sets. In this paper generalize Robinson's version of an order cancellation law for subsets of vector spaces in which we cancel by unbounded sets. We introduce the notion of weakly narrow sets in normed spaces, study their properties and prove the order cancellation law where the canceled set is weakly narrow. Also we prove the order cancellation law for closed convex subsets of topological vector space where the canceled set has bounded Hausdorff like distance from its recession cone. We topologically embed the semigroup of closed convex sets sharing a recession cone having bounded Hausdorff like distance from it into a topological vector space. This result extends Bielawski and Tabor's generalization of Radstrom theorem.


Creative Compensation (CC) Future of Jobs with Creative Works in 3D Printing. With the continuous growth of online 3D printing community and the democratization of 3D printers, growing number of users start sharing their own 3D designs on open platforms, enabling a wide audience to search, download, and 3D print models for free. Although sharing is mostly for altruistic reasons at first, open platforms had also created potential job opportunities to compensate creative labors. This paper analyzes new job opportunities emerged in online 3D printing social platforms and patterns of seeking compensations, and reveals various motivations for posting creative content online. We find that offering exclusive membership through subscriptions, selling final products or printing services through web stores, and using affiliate links are primary means of earning profits, while there exist gaps between creators' expectations and realities. We show that various socio economic promises emerged, leading to a win win situation for both creators to gain extra income and audiences to have access to more quality content. We also discuss future challenges that need to be addressed, such as ethical use of opensource content.


Coupled embeddability. We introduce the notion of coupled embeddability, defined for maps on products of topological spaces. We use known results for nonsingular biskew and bilinear maps to generate simple examples and nonexamples of coupled embeddings. We study genericity properties for coupled embeddings of smooth manifolds, extend the Whitney embedding theorems to statements about coupled embeddability, and we discuss a Haefliger type result for coupled embeddings. We relate the notion of coupled embeddability to the mathbb Z 2 coindex of embedding spaces, recently introduced and studied by the authors. With a straightforward generalization of these results, we obtain strong obstructions to the existence of coupled embeddings in terms of the combinatorics of triangulations. In particular, we generalize nonembeddability results for certain simplicial complexes to sharp coupled nonembeddability results for certain pairs of simplicial complexes.


Near field Perception for Low Speed Vehicle Automation using Surround view Fisheye Cameras. Cameras are the primary sensor in automated driving systems. They provide high information density and are optimal for detecting road infrastructure cues laid out for human vision. Surround view camera systems typically comprise of four fisheye cameras with 190 deg field of view covering the entire 360 deg around the vehicle focused on near field sensing. They are the principal sensors for low speed, high accuracy, and close range sensing applications, such as automated parking, traffic jam assistance, and low speed emergency braking. In this work, we provide a detailed survey of such vision systems, setting up the survey in the context of an architecture that can be decomposed into four modular components namely Recognition, Reconstruction, Relocalization, and Reorganization. We jointly call this the 4R Architecture. We discuss how each component accomplishes a specific aspect and provide a positional argument that they can be synergized to form a complete perception system for low speed automation. We support this argument by presenting results from previous works and by presenting architecture proposals for such a system. Qualitative results are presented in the video at https youtu.be ae8bCOF77uY.


OCHADAI KYOTO at SemEval 2021 Task 1 Enhancing Model Generalization and Robustness for Lexical Complexity Prediction. We propose an ensemble model for predicting the lexical complexity of words and multiword expressions (MWEs). The model receives as input a sentence with a target word or MWEand outputs its complexity score. Given that a key challenge with this task is the limited size of annotated data, our model relies on pretrained contextual representations from different state of the art transformer based language models (i.e., BERT and RoBERTa), and on a variety of training methods for further enhancing model generalization and robustness multi step fine tuning and multi task learning, and adversarial training. Additionally, we propose to enrich contextual representations by adding hand crafted features during training. Our model achieved competitive results and ranked among the top 10 systems in both sub tasks.


PASS An ImageNet replacement for self supervised pretraining without humans. Computer vision has long relied on ImageNet and other large datasets of images sampled from the Internet for pretraining models. However, these datasets have ethical and technical shortcomings, such as containing personal information taken without consent, unclear license usage, biases, and, in some cases, even problematic image content. On the other hand, state of the art pretraining is nowadays obtained with unsupervised methods, meaning that labelled datasets such as ImageNet may not be necessary, or perhaps not even optimal, for model pretraining. We thus propose an unlabelled dataset PASS Pictures without humAns for Self Supervision. PASS only contains images with CC BY license and complete attribution metadata, addressing the copyright issue. Most importantly, it contains no images of people at all, and also avoids other types of images that are problematic for data protection or ethics. We show that PASS can be used for pretraining with methods such as MoCo v2, SwAV and DINO. In the transfer learning setting, it yields similar downstream performances to ImageNet pretraining even on tasks that involve humans, such as human pose estimation. PASS does not make existing datasets obsolete, as for instance it is insufficient for benchmarking. However, it shows that model pretraining is often possible while using safer data, and it also provides the basis for a more robust evaluation of pretraining methods.


UMG silicon for solar PV from defects detection to PV module degradation. Upgraded metallurgical grade silicon (UMG Si) for photovoltaic (PV) solar applications has been manufactured through the metallurgical route by means of the process developed by Ferrosolar. In an ambitious mass production test, performed in commercial solar cells and modules production lines, the silicon was proven to be appropriate for photovoltaics applications (Fornies et al., 2019 Mass production test of solar cells and modules made of 100 umg silicon. 20.76 record efficiency. Energies 12), reaching, in a conventional production line, up to 20.76 of solar cell efficiency with multicrystalline cells made of 100 UMG silicon. In this paper we present more results from the mentioned massive test. Defect engineering is being applied to improve the bulk lifetime of the UMG wafers and to guide in the identification of the limiting defects in the material. Moreover, the modules produced with 100 UMG silicon solar cells were installed together with the modules produced in the same production line with polysilicon material to assess the degradation of the UMG silicon when compared to polysilicon. After 24 months of outdoor PV generation, the degradation, in terms of Performance Ratio at 25C (25PR) diminution, has been the same for both types of modules. Additionally, a Life Cycle Assessment (LCA) has been performed for this UMG silicon and state of the art Siemens polysilicon to compare the environmental impact of both silicon feedstocks. The results presented in this paper chemical analysis of wafers, defect engineering, low degradation, average efficiency and environmental assessment, lead to a complete study of UMG silicon, confirming its potential to be used as raw material for PV applications.


Collaboration among Image and Object Level Features for Image Colourisation. Image colourisation is an ill posed problem, with multiple correct solutions which depend on the context and object instances present in the input datum. Previous approaches attacked the problem either by requiring intense user interactions or by exploiting the ability of convolutional neural networks (CNNs) in learning image level (context) features. However, obtaining human hints is not always feasible and CNNs alone are not able to learn object level semantics unless multiple models pretrained with supervision are considered. In this work, we propose a single network, named UCapsNet, that separate image level features obtained through convolutions and object level features captured by means of capsules. Then, by skip connections over different layers, we enforce collaboration between such disentangling factors to produce high quality and plausible image colourisation. We pose the problem as a classification task that can be addressed by a fully self supervised approach, thus requires no human effort. Experimental results on three benchmark datasets show that our approach outperforms existing methods on standard quality metrics and achieves a state of the art performances on image colourisation. A large scale user study shows that our method is preferred over existing solutions.


On the Complexity of Two Party Differential Privacy. In distributed differential privacy, the parties perform analysis over their joint data while preserving the privacy for both datasets. Interestingly, for a few fundamental two party functions such as inner product and Hamming distance, the accuracy of the distributed solution lags way behind what is achievable in the client server setting. McGregor, Mironov, Pitassi, Reingold, Talwar, and Vadhan FOCS '10 proved that this gap is inherent, showing upper bounds on the accuracy of (any) distributed solution for these functions. These limitations can be bypassed when settling for computational differential privacy, where the data is differentially private only in the eyes of a computationally bounded observer, using public key cryptography primitives. We prove that the use of public key cryptography is necessary for bypassing the limitation of McGregor et al., showing that a non trivial solution for the inner product, or the Hamming distance, implies the existence of a key agreement protocol. Our bound implies a combinatorial proof for the fact that non Boolean inner product of independent (strong) Santha Vazirani sources is a good condenser. We obtain our main result by showing that the inner product of a (single, strong) SV source with a uniformly random seed is a good condenser, even when the seed and source are dependent.


SuaCode Africa Teaching Coding Online to Africans using Smartphones. There is a burgeoning trend of smartphone ownership in Africa due to the low costs of Android smartphones and the global increase in social media usage. Building upon previous works that introduced a smartphone based coding course to secondary and tertiary students in Ghana via an in person program and an online course, this work introduced Africans in 37 countries to our online smartphone based course in 2019. Students in this 8 week course read lesson notes, submitted assignments, collaborated with peers, and facilitators in an online forum and completed open and closed ended surveys after the course. We performed qualitative and quantitative analyses on the data from the course. Out of the 709 students that applied, 210 were officially admitted to the course after passing the preliminary assignments. And at the end of the course, 72 of the 210 students completed the course. Additionally, students' assignment submissions and self reports showed an understanding of the programming concepts, with comparable performance between males and females and across educational levels. Also, students mentioned that the lesson notes were easy to understand and they enjoyed the experience of writing code on their smartphones. Moreover, students adequately received help from peers and facilitators in the course forum. Lastly, results of a survey sent to students a year after completing this program showed that they had developed various applications, wrote online tutorials, and learned several tools and technologies. We were successful at introducing coding skills to Africans using smartphones through SuaCode Africa.


ROSITA Refined BERT cOmpreSsion with InTegrAted techniques. Pre trained language models of the BERT family have defined the state of the arts in a wide range of NLP tasks. However, the performance of BERT based models is mainly driven by the enormous amount of parameters, which hinders their application to resource limited scenarios. Faced with this problem, recent studies have been attempting to compress BERT into a small scale model. However, most previous work primarily focuses on a single kind of compression technique, and few attention has been paid to the combination of different methods. When BERT is compressed with integrated techniques, a critical question is how to design the entire compression framework to obtain the optimal performance. In response to this question, we integrate three kinds of compression methods (weight pruning, low rank factorization and knowledge distillation (KD)) and explore a range of designs concerning model architecture, KD strategy, pruning frequency and learning rate schedule. We find that a careful choice of the designs is crucial to the performance of the compressed model. Based on the empirical findings, our best compressed model, dubbed Refined BERT cOmpreSsion with InTegrAted techniques (ROSITA), is 7.5 times smaller than BERT while maintains 98.5 of the performance on five tasks of the GLUE benchmark, outperforming the previous BERT compression methods with similar parameter budget. The code is available at https github.com llyx97 Rosita.


Transformer based unsupervised patient representation learning based on medical claims for risk stratification and analysis. The claims data, containing medical codes, services information, and incurred expenditure, can be a good resource for estimating an individual's health condition and medical risk level. In this study, we developed Transformer based Multimodal AutoEncoder (TMAE), an unsupervised learning framework that can learn efficient patient representation by encoding meaningful information from the claims data. TMAE is motivated by the practical needs in healthcare to stratify patients into different risk levels for improving care delivery and management. Compared to previous approaches, TMAE is able to 1) model inpatient, outpatient, and medication claims collectively, 2) handle irregular time intervals between medical events, 3) alleviate the sparsity issue of the rare medical codes, and 4) incorporate medical expenditure information. We trained TMAE using a real world pediatric claims dataset containing more than 600,000 patients and compared its performance with various approaches in two clustering tasks. Experimental results demonstrate that TMAE has superior performance compared to all baselines. Multiple downstream applications are also conducted to illustrate the effectiveness of our framework. The promising results confirm that the TMAE framework is scalable to large claims data and is able to generate efficient patient embeddings for risk stratification and analysis.


Defeating Catastrophic Forgetting via Enhanced Orthogonal Weights Modification. The ability of neural networks (NNs) to learn and remember multiple tasks sequentially is facing tough challenges in achieving general artificial intelligence due to their catastrophic forgetting (CF) issues. Fortunately, the latest OWM Orthogonal Weights Modification) and other several continual learning (CL) methods suggest some promising ways to overcome the CF issue. However, none of existing CL methods explores the following three crucial questions for effectively overcoming the CF issue that is, what knowledge does it contribute to the effective weights modification of the NN during its sequential tasks learning? When the data distribution of a new learning task changes corresponding to the previous learned tasks, should a uniform specific weight modification strategy be adopted or not? what is the upper bound of the learningable tasks sequentially for a given CL method? ect. To achieve this, in this paper, we first reveals the fact that of the weight gradient of a new learning task is determined by both the input space of the new task and the weight space of the previous learned tasks sequentially. On this observation and the recursive least square optimal method, we propose a new efficient and effective continual learning method EOWM via enhanced OWM. And we have theoretically and definitively given the upper bound of the learningable tasks sequentially of our EOWM. Extensive experiments conducted on the benchmarks demonstrate that our EOWM is effectiveness and outperform all of the state of the art CL baselines.


On some symmetries of the base n expansion of 1 m Comments on Artin's Primitive root conjecture. Suppose m,n geq 2 are co prime integers. We prove certain new symmetries of the base n representation of 1 m , and in particular characterize the subgroup generated by n inside ( mathbb Z m mathbb Z ) times . As an application we give a sufficient condition for a prime p such that a non square number n is a primitive root modulo p .


Higher Lelong numbers versus full Monge Amp ere mass. We prove a recent conjecture of Chi Li relating the notion of higher Lelong numbers to that of full Monge Amp ere mass.


Oblivious Online Contention Resolution Schemes. Contention resolution schemes (CRSs) are powerful tools for obtaining "ex post feasible" solutions from candidates that are drawn from "ex ante feasible" distributions. Online contention resolution schemes (OCRSs), the online version, have found myriad applications in Bayesian and stochastic problems, such as prophet inequalities and stochastic probing. When the ex ante distribution is unknown, it was unknown whether good CRSs OCRSs exist with no sample (in which case the scheme is oblivious) or few samples from the distribution. In this work, we give a simple frac 1 e selectable oblivious single item OCRS by mixing two simple schemes evenly, and show, via a Ramsey theory argument, that it is optimal. On the negative side, we show that no CRS or OCRS with O(1) samples can be Omega(1) balanced selectable (i.e., preserve every active candidate with a constant probability) for graphic or transversal matroids.


Reinforcement Learning on Encrypted Data. The growing number of applications of Reinforcement Learning (RL) in real world domains has led to the development of privacy preserving techniques due to the inherently sensitive nature of data. Most existing works focus on differential privacy, in which information is revealed in the clear to an agent whose learned model should be robust against information leakage to malicious third parties. Motivated by use cases in which only encrypted data might be shared, such as information from sensitive sites, in this work we consider scenarios in which the inputs themselves are sensitive and cannot be revealed. We develop a simple extension to the MDP framework which provides for the encryption of states. We present a preliminary, experimental study of how a DQN agent trained on encrypted states performs in environments with discrete and continuous state spaces. Our results highlight that the agent is still capable of learning in small state spaces even in presence of non deterministic encryption, but performance collapses in more complex environments.


On Pure k sparse gapsets. In this paper, we study gapsets and we focus on obtaining information on how the maximum distance between to consecutive elements influences the behaviour of the set. In particular, we prove that the cardinality of the set of gapsets with genus g such that the maximum distance between two consecutive elements is kappa is equal to the cardinality of the set of gapsets with genus g 1 such that the maximum distance between two consecutive elements is kappa 1 , when 2g leq 3 kappa .


Optimal linear response for Markov Hilbert Schmidt integral operators and stochastic dynamical systems. We consider optimal control problems for discrete time random dynamical systems, finding unique perturbations that provoke maximal responses of statistical properties of the system. We treat systems whose transfer operator has an L 2 kernel, and we consider the problems of finding (i) the infinitesimal perturbation maximising the expectation of a given observable and (ii) the infinitesimal perturbation maximising the spectral gap, and hence the exponential mixing rate of the system. Our perturbations are either (a) perturbations of the kernel or (b) perturbations of a deterministic map subjected to additive noise. We develop a general setting in which these optimisation problems have a unique solution and construct explicit formulae for the unique optimal perturbations. We apply our results to a Pomeau Manneville map and an interval exchange map, both subjected to additive noise, to explicitly compute the perturbations provoking maximal responses.


Approximation and Error Analysis of Forward Backward SDEs driven by General L 'evy Processes using Shot Noise Series Representations. We consider the simulation of a system of decoupled forward backward stochastic differential equations (FBSDEs) driven by a pure jump L 'evy process L and an independent Brownian motion B . We allow the L 'evy process L to have an infinite jump activity. Therefore, it is necessary for the simulation to employ a finite approximation of its L 'evy measure. We use the generalized shot noise series representation method by Rosinski (2001) to approximate the driving L 'evy process L . We compute the L p error, p ge2 , between the true and the approximated FBSDEs which arises from the finite truncation of the shot noise series (given sufficient conditions for existence and uniqueness of the FBSDE). We also derive the L p error between the true solution and the discretization of the approximated FBSDE using an appropriate backward Euler scheme.


The Legislative Recipe Syntax for Machine Readable Legislation. Legal interpretation is a linguistic venture. In judicial opinions, for example, courts are often asked to interpret the text of statutes and legislation. As time has shown, this is not always as easy as it sounds. Matters can hinge on vague or inconsistent language and, under the surface, human biases can impact the decision making of judges. This raises an important question what if there was a method of extracting the meaning of statutes consistently? That is, what if it were possible to use machines to encode legislation in a mathematically precise form that would permit clearer responses to legal questions? This article attempts to unpack the notion of machine readability, providing an overview of both its historical and recent developments. The paper will reflect on logic syntax and symbolic language to assess the capacity and limits of representing legal knowledge. In doing so, the paper seeks to move beyond existing literature to discuss the implications of various approaches to machine readable legislation. Importantly, this study hopes to highlight the challenges encountered in this burgeoning ecosystem of machine readable legislation against existing human readable counterparts.


Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRL. Despite a series of recent successes in reinforcement learning (RL), many RL algorithms remain sensitive to hyperparameters. As such, there has recently been interest in the field of AutoRL, which seeks to automate design decisions to create more general algorithms. Recent work suggests that population based approaches may be effective AutoRL algorithms, by learning hyperparameter schedules on the fly. In particular, the PB2 algorithm is able to achieve strong performance in RL tasks by formulating online hyperparameter optimization as time varying GP bandit problem, while also providing theoretical guarantees. However, PB2 is only designed to work for continuous hyperparameters, which severely limits its utility in practice. In this paper we introduce a new (provably) efficient hierarchical approach for optimizing both continuous and categorical variables, using a new time varying bandit algorithm specifically designed for the population based training regime. We evaluate our approach on the challenging Procgen benchmark, where we show that explicitly modelling dependence between data augmentation and other hyperparameters improves generalization.


Amodal segmentation just like doing a jigsaw. Amodal segmentation is a new direction of instance segmentation while considering the segmentation of the visible and occluded parts of the instance. The existing state of the art method uses multi task branches to predict the amodal part and the visible part separately and subtract the visible part from the amodal part to obtain the occluded part. However, the amodal part contains visible information. Therefore, the separated prediction method will generate duplicate information. Different from this method, we propose a method of amodal segmentation based on the idea of the jigsaw. The method uses multi task branches to predict the two naturally decoupled parts of visible and occluded, which is like getting two matching jigsaw pieces. Then put the two jigsaw pieces together to get the amodal part. This makes each branch focus on the modeling of the object. And we believe that there are certain rules in the occlusion relationship in the real world. This is a kind of occlusion context information. This jigsaw method can better model the occlusion relationship and use the occlusion context information, which is important for amodal segmentation. Experiments on two widely used amodally annotated datasets prove that our method exceeds existing state of the art methods. The source code of this work will be made public soon.


Distantly Supervised Relation Extraction via Recursive Hierarchy Interactive Attention and Entity Order Perception. Wrong labeling problem and long tail relations severely affect the performance of distantly supervised relation extraction task. Many studies mitigate the effect of wrong labeling through selective attention mechanism and handle long tail relations by introducing relation hierarchies to share knowledge. However, almost all existing studies ignore the fact that, in a sentence, the appearance order of two entities contributes to the understanding of its semantics. Furthermore, they only utilize each relation level of relation hierarchies separately, but do not exploit the heuristic effect between relation levels, i.e., higher level relations can give useful information to the lower ones. Based on the above, in this paper, we design a novel Recursive Hierarchy Interactive Attention network (RHIA) to further handle long tail relations, which models the heuristic effect between relation levels. From the top down, it passes relation related information layer by layer, which is the most significant difference from existing models, and generates relation augmented sentence representations for each relation level in a recursive structure. Besides, we introduce a newfangled training objective, called Entity Order Perception (EOP), to make the sentence encoder retain more entity appearance information. Substantial experiments on the popular (NYT) dataset are conducted. Compared to prior baselines, our RHIA EOP achieves state of the art performance in terms of precision recall (P R) curves, AUC, Top N precision and other evaluation metrics. Insightful analysis also demonstrates the necessity and effectiveness of each component of RHIA EOP.


DOVE Learning Deformable 3D Objects by Watching Videos. Learning deformable 3D objects from 2D images is an extremely ill posed problem. Existing methods rely on explicit supervision to establish multi view correspondences, such as template shape models and keypoint annotations, which restricts their applicability on objects "in the wild". In this paper, we propose to use monocular videos, which naturally provide correspondences across time, allowing us to learn 3D shapes of deformable object categories without explicit keypoints or template shapes. Specifically, we present DOVE, which learns to predict 3D canonical shape, deformation, viewpoint and texture from a single 2D image of a bird, given a bird video collection as well as automatically obtained silhouettes and optical flows as training data. Our method reconstructs temporally consistent 3D shape and deformation, which allows us to animate and re render the bird from arbitrary viewpoints from a single image.


Blockchain Enabled End to End Encryption for Instant Messaging Applications. In the era of social media and messaging applications, people are becoming increasingly aware of data privacy issues associated with such apps. Major messaging applications are moving towards end to end encryption (E2EE) to give their users the privacy they are demanding. However the current security mechanisms employed by different service providers are not unfeigned E2EE implementations, and are blended with many vulnerabilities. In the present scenario, the major part of the E2EE mechanism is controlled by the service provider's servers, and the decryption keys are stored by them in case of backup restoration. These shortcomings diminish the user's confidence in the privacy of their data while using these apps. A public Key infrastructure (PKI) mechanism can be used to circumvent some of these issues, but it comes with high monetary costs, which makes it impossible to roll out for millions of users. The paper proposes a blockchain based E2EE framework that can mitigate the contemporary vulnerabilities in messaging applications. The user's device generates the public private key pair during application installation, and asks its mobile network operator (MNO) to issue a digital certificate and store it on the blockchain. A user can fetch a certificate for another user from the chat server and communicate securely with them using a ratchet forward encryption mechanism.


RPPLNS Pay per last N shares with a Randomised Twist. "Pay per last N shares" (PPLNS) is one of the most common payout strategies used by mining pools in Proof of Work (PoW) cryptocurrencies. As with any payment scheme, it is imperative to study issues of incentive compatibility of miners within the pool. For PPLNS this question has only been partially answered we know that reasonably sized miners within a PPLNS pool prefer following the pool protocol over employing specific deviations. In this paper, we present a novel modification to PPLNS where we randomise the protocol in a natural way. We call our protocol "Randomised pay per last N shares" (RPPLNS), and note that the randomised structure of the protocol greatly simplifies the study of its incentive compatibility. We show that RPPLNS maintains the strengths of PPLNS (i.e., fairness, variance reduction, and resistance to pool hopping), while also being robust against a richer class of strategic mining than what has been shown for PPLNS.


Large scale Machine Learning Cluster Scheduling via Multi agent Graph Reinforcement Learning. Efficient scheduling of distributed deep learning (DL) jobs in large GPU clusters is crucial for resource efficiency and job performance. While server sharing among jobs improves resource utilization, interference among co located DL jobs occurs due to resource contention. Interference aware job placement has been studied, with white box approaches based on explicit interference modeling and black box schedulers with reinforcement learning. In today's clusters containing thousands of GPU servers, running a single scheduler to manage all arrival jobs in a timely and effective manner is challenging, due to the large workload scale. We adopt multiple schedulers in a large scale cluster data center, and propose a multi agent reinforcement learning (MARL) scheduling framework to cooperatively learn fine grained job placement policies, towards the objective of minimizing job completion time (JCT). To achieve topology aware placements, our proposed framework uses hierarchical graph neural networks to encode the data center topology and server architecture. In view of a common lack of precise reward samples corresponding to different placements, a job interference model is further devised to predict interference levels in face of various co locations, for training of the MARL schedulers. Testbed and trace driven evaluations show that our scheduler framework outperforms representative scheduling schemes by more than 20 in terms of average JCT, and is adaptive to various machine learning cluster topologies.


Finite dimensional approximations and semigroup coactions for operator algebras. The residual finite dimensionality of a mathrm C algebra is known to be encoded in a topological property of its space of representations, stating that finite dimensional representations should be dense therein. We extend this paradigm to general (possibly non self adjoint) operator algebras. While numerous subtleties emerge in this greater generality, we exhibit novel tools for constructing finite dimensional approximations. One such tool is a notion of a residually finite dimensional coaction of a semigroup on an operator algebra, which allows us to construct finite dimensional approximations for operator algebras of functions and operator algebras of semigroups. Our investigation is intimately related to the question of whether residual finite dimensionality of an operator algebra is inherited by its maximal mathrm C cover, which we resolve in many cases of interest.


Moment polytopes in real symplectic geometry II applications to singular value inequalities. In this work, we study some convex cones associated to isotropic representations of symmetric spaces. We explain the inequalities that describe them by means of cohomological conditions. In particular, we study the singular Horn cone which is the counterpart of the classical Horn cone, where the eigenvalues of Hermitian square matrices are replaced by the singular values of rectangular matrices.


Modular Information Flow through Ownership. Statically analyzing information flow, or how data influences other data within a program, is a challenging task in imperative languages. Analyzing pointers and mutations requires access to a program's complete source. However, programs often use pre compiled dependencies where only type signatures are available. We demonstrate that ownership types can be used to soundly and precisely analyze information flow through function calls given only their type signature. From this insight, we built Flowistry, a system for analyzing information flow in Rust, an ownership based language. We prove the system's soundness as a form of noninterference using the Oxide formal model of Rust. Then we empirically evaluate the precision of Flowistry, showing that modular flows are identical to whole program flows in 94 of cases drawn from large Rust codebases. We illustrate the applicability of Flowistry by using it to implement prototypes of a program slicer and an information flow control system.


Finite mean dimesnion and marker property. In this paper, we develop the theory of mathbb Z p index which has been introduced by Tsukamoto, Tsutaya and Yoshinaga. As an application, we show that given any positive number, there exists a dynamical system with mean dimension equal to such number such that it does not have the marker property.


Optimally Hiding Object Sizes with Constrained Padding. Among the most challenging traffic analysis attacks to confound are those leveraging the sizes of objects downloaded over the network. In this paper we systematically analyze this problem under realistic constraints regarding the padding overhead that the object store is willing to incur. We give algorithms to compute privacy optimal padding schemes specifically that minimize the network observer's information gain from a downloaded object's padded size in several scenarios of interest per object padding, in which the object store responds to each request for an object with the same padded copy per request padding, in which the object store pads an object anew each time it serves that object and a scenario unlike the previous ones in that the object store is unable to leverage a known distribution over the object queries. We provide constructions for privacy optimal padding in each case, compare them to recent contenders in the research literature, and evaluate their performance on practical datasets.


Mind the Gap Reimagining an Interactive Programming Course for the Synchronous Hybrid Classroom. COVID 19 has significantly affected universities, forcing many courses to be delivered entirely online. As countries bring the pandemic under control, a potential way to safely resume some face to face teaching is the synchronous hybrid classroom, in which physically and remotely attending students are taught simultaneously. This comes with challenges, however, including the risk that remotely attending students perceive a 'gap' between their engagement and that of their physical peers. In this experience report, we describe how an interactive programming course was adapted to hybrid delivery in a way that mitigated this risk. Our solution centred on the use of a professional communication platform Slack to equalise participation opportunities and to facilitate peer learning. Furthermore, to mitigate 'Zoom fatigue', we implemented a semi flipped classroom, covering concepts in videos and using shorter lessons to consolidate them. Finally, we critically reflect on the results of a student survey and our own experiences of implementing the solution.


Non coercive unbounded first order Mean Field Games the Heisenberg example. In this paper we study evolutive first order Mean Field Games in the Heisenberg group each agent can move in the whole space but it has to follow "horizontal" trajectories which are given in terms of the vector fields generating the group and the kinetic part of the cost depends only on the horizontal velocity. The Hamiltonian is not coercive in the gradient term and the coefficients of the first order term in the continuity equation may have a quadratic growth at infinity. The main results of this paper are two the former is to establish the existence of a weak solution to the Mean Field Game systems while the latter is to represent this solution following the Lagrangian formulation of the Mean Field Games. We also provide some generalizations to Heisenberg type structures.


Lower Bounds for the Minimum Mean Square Error via Neural Network based Estimation. The minimum mean square error (MMSE) achievable by optimal estimation of a random variable Y in mathbb R given another random variable X in mathbb R d is of much interest in a variety of statistical contexts. In this paper we propose two estimators for the MMSE, one based on a two layer neural network and the other on a special three layer neural network. We derive lower bounds for the MMSE based on the proposed estimators and the Barron constant of an appropriate function of the conditional expectation of Y given X . Furthermore, we derive a general upper bound for the Barron constant that, when X in mathbb R is post processed by the additive Gaussian mechanism, produces order optimal estimates in the large noise regime.


The p adic Corlette Simpson correspondence for abeloids. For an abeloid variety A over a complete algebraically closed field extension K of mathbb Q p , we construct a p adic Corlette Simpson correspondence, namely an equivalence between finite dimensional continuous K linear representations of the Tate module and a certain subcategory of the Higgs bundles on A . To do so, our central object of study is the category of vector bundles for the v topology on the diamond associated to A . We prove that any pro finite 'etale v vector bundle can be built from pro finite 'etale v line bundles and unipotent v bundles. To describe the latter, we extend the theory of universal vector extensions to the v topology and use this to generalise a result of Brion by relating unipotent v bundles on abeloids to representations of vector groups.


A Brain Inspired Learning Algorithm for the Perception of a Quadrotor in Wind. The quest for a brain inspired learning algorithm for robots has culminated in the free energy principle from neuroscience that models the brain's perception and action as an optimization over its free energy objectives. Based on this idea, we propose an estimation algorithm for accurate output prediction of a quadrotor flying under unmodelled wind conditions. The key idea behind this work is the handling of unmodelled wind dynamics and the model's non linearity errors as coloured noise in the system, and leveraging it for accurate output predictions. This paper provides the first experimental validation for the usefulness of generalized coordinates for robot perception using Dynamic Expectation Maximization (DEM). Through real flight experiments, we show that the estimator outperforms classical estimators with the least error in output predictions. Based on the experimental results, we extend the DEM algorithm for model order selection for complete black box identification. With this paper, we provide the first experimental validation of DEM applied to robot learning.


Learning Indoor Layouts from Simple Point Clouds. Reconstructing a layout of indoor spaces has been a crucial part of growing indoor location based services. One of the key challenges in the proliferation of indoor location based services is the unavailability of indoor spatial maps due to the complex nature of capturing an indoor space model (e.g., floor plan) of an existing building. In this paper, we propose a system to automatically generate floor plans that can recognize rooms from the point clouds obtained through smartphones like Google's Tango. In particular, we propose two approaches a Recurrent Neural Network based approach using Pointer Network and a Convolutional Neural Network based approach using Mask RCNN to identify rooms (and thereby floor plans) from point clouds. Experimental results on different datasets demonstrate approximately 0.80 0.90 Intersection over Union scores, which show that our models can effectively identify the rooms and regenerate the shapes of the rooms in heterogeneous environment.


Modeling change in public sentiment with nonlocal reaction diffusion equations. In this article, we introduce the notion of nonlocal diffusion as a means to describe the change, and possible polarization, that occurs in some public sentiment.


An explicit formula of powers of the 2 times 2 quantum matrices and its applications. We present an explicit formula of the powers for the 2 times 2 quantum matrices, that is a natural quantum analogue of the powers of the usual 2 times 2 matrices. As applications, we give some non commutative relations of the entries of the powers for the 2 times 2 quantum matrices, which is a simple proof of the results of Vokos Zumino Wess (1990).


FastNeRF High Fidelity Neural Rendering at 200FPS. Recent work on Neural Radiance Fields (NeRF) showed how neural networks can be used to encode complex 3D environments that can be rendered photorealistically from novel viewpoints. Rendering these images is very computationally demanding and recent improvements are still a long way from enabling interactive rates, even on high end hardware. Motivated by scenarios on mobile and mixed reality devices, we propose FastNeRF, the first NeRF based system capable of rendering high fidelity photorealistic images at 200Hz on a high end consumer GPU. The core of our method is a graphics inspired factorization that allows for (i) compactly caching a deep radiance map at each position in space, (ii) efficiently querying that map using ray directions to estimate the pixel values in the rendered image. Extensive experiments show that the proposed method is 3000 times faster than the original NeRF algorithm and at least an order of magnitude faster than existing work on accelerating NeRF, while maintaining visual quality and extensibility.


Deep learning in biomedical optics. This article reviews deep learning applications in biomedical optics with a particular emphasis on image formation. The review is organized by imaging domains within biomedical optics and includes microscopy, fluorescence lifetime imaging, in vivo microscopy, widefield endoscopy, optical coherence tomography, photoacoustic imaging, diffuse tomography, and functional optical brain imaging. For each of these domains, we summarize how deep learning has been applied and highlight methods by which deep learning can enable new capabilities for optics in medicine. Challenges and opportunities to improve translation and adoption of deep learning in biomedical optics are also summarized.


Fixed Point Constructions in Tilings and Cellular Automata. The fixed point construction is a method for designing tile sets and cellular automata with highly nontrivial dynamical and computational properties. It produces an infinite hierarchy of systems where each layer simulates the next one. The simulations are implemented entirely by computations of Turing machines embedded in the tilings or spacetime diagrams. We present an overview of the construction and list its applications in the literature.


Bi eigenmaps and biharmonic submanifolds in a sphere. In this note, we classify biharmonic submanifolds in a sphere defined by bi eigenmaps ( Delta 2 phi lambda phi ) or buckling eigenmaps ( Delta 2 phi mu Delta phi ). We then classify biharmonic bi eigenmaps and buckling eigenmaps into spheres with constant energy density. The results can be viewed as generalizations of Takahashi's characterization of minimal submanifolds in a sphere by eigenmaps.


Kinetics and Nucleation Dynamics in Ion Seeded Atomic Clusters. The time dependent kinetics of formation and evolution of nano size atomic clusters is investigated and illustrated with the nucleation dynamics of ion seed Ar n H particles. The rates of growth and degradation of Ar atomic shells around the seed ion are inferred from Molecular Dynamics (MD) simulations. Simulations of cluster formation have been performed with accurate quantum mechanical binary interaction potentials. Both the nonequilibrium and equilibrium growth of Ar n H are investigated at different temperature and densities of the atomic gas and seed ions. Formation of Ar n leq 40 shells is the main mechanism which regulates the kinetics of nano cluster growth and the diffusive fluctuations of the cluster size distribution. The time evolution of the cluster intrinsic energy and cluster size distributions are analyzed at the non thermal, quasi equilibrium, and thermal equilibrium stages of Ar n H formation. We've determined the self consistent model parameters for the temporal fluctuations of the cluster size and found coefficients of the diffusive growth mechanism describing the equilibrium distribution of nano clusters. Nucleation of haze and nano dust particles in astrophysical and atmospheric ionized gases are discussed.


A new gap for CMC biharmonic hypersurfaces in Euclidean spheres. In this note we improve a gap result concerning the range of the mean curvature of complete CMC proper biharmonic hypersurfaces in unit Euclidean spheres.


Deep Reinforcement Learning based Methods for Resource Scheduling in Cloud Computing A Review and Future Directions. As the quantity and complexity of information processed by software systems increase, large scale software systems have an increasing requirement for high performance distributed computing systems. With the acceleration of the Internet in Web 2.0, Cloud computing as a paradigm to provide dynamic, uncertain and elastic services has shown superiorities to meet the computing needs dynamically. Without an appropriate scheduling approach, extensive Cloud computing may cause high energy consumptions and high cost, in addition that high energy consumption will cause massive carbon dioxide emissions. Moreover, inappropriate scheduling will reduce the service life of physical devices as well as increase response time to users' request. Hence, efficient scheduling of resource or optimal allocation of request, that usually a NP hard problem, is one of the prominent issues in emerging trends of Cloud computing. Focusing on improving quality of service (QoS), reducing cost and abating contamination, researchers have conducted extensive work on resource scheduling problems of Cloud computing over years. Nevertheless, growing complexity of Cloud computing, that the super massive distributed system, is limiting the application of scheduling approaches. Machine learning, a utility method to tackle problems in complex scenes, is used to resolve the resource scheduling of Cloud computing as an innovative idea in recent years. Deep reinforcement learning (DRL), a combination of deep learning (DL) and reinforcement learning (RL), is one branch of the machine learning and has a considerable prospect in resource scheduling of Cloud computing. This paper surveys the methods of resource scheduling with focus on DRL based scheduling approaches in Cloud computing, also reviews the application of DRL as well as discusses challenges and future directions of DRL in scheduling of Cloud computing.


A Novel Model for Vulnerability Analysis through Enhanced Directed Graphs and Quantitative Metrics. Industrial components are of high importance because they control critical infrastructures that form the lifeline of modern societies. However, the rapid evolution of industrial components, together with the new paradigm of Industry 4.0, and the new connectivity features that will be introduced by the 5G technology, all increase the likelihood of security incidents. These incidents are caused by the vulnerabilities present in these devices. In addition, although international standards define tasks to assess vulnerabilities, they do not specify any particular method. Having a secure design is important, but is also complex, costly, and an extra factor to manage during the lifespan of the device. This paper presents a model to analyze the known vulnerabilities of industrial components over time. The proposed model is based on two main elements a directed graph representation of the internal structure of the component, and a set of quantitative metrics that are based on international security standards such as, the Common Vulnerability Scoring System (CVSS). This model is applied throughout the entire lifespan of a device to track vulnerabilities, identify new requirements, root causes, and test cases. The proposed model also helps to prioritize patching activities. To test its potential, the proposed model is applied to the OpenPLC project. The results show that most of the root causes of these vulnerabilities are related to memory buffer operations and are concentrated in the textit libssl library. Consequently, new requirements and test cases were generated from the obtained data.


CLTR An End to End, Transformer Based System for Cell Level Table Retrieval and Table Question Answering. We present the first end to end, transformer based table question answering (QA) system that takes natural language questions and massive table corpus as inputs to retrieve the most relevant tables and locate the correct table cells to answer the question. Our system, CLTR, extends the current state of the art QA over tables model to build an end to end table QA architecture. This system has successfully tackled many real world table QA problems with a simple, unified pipeline. Our proposed system can also generate a heatmap of candidate columns and rows over complex tables and allow users to quickly identify the correct cells to answer questions. In addition, we introduce two new open domain benchmarks, E2E WTQ and E2E GNQ, consisting of 2,005 natural language questions over 76,242 tables. The benchmarks are designed to validate CLTR as well as accommodate future table retrieval and end to end table QA research and experiments. Our experiments demonstrate that our system is the current state of the art model on the table retrieval task and produces promising results for end to end table QA.


Isochronous space time wave packets. The group delay incurred by an optical wave packet depends on its path length. Therefore, when a wave packet is obliquely incident on a planar homogeneous slab, the group delay upon traversing it inevitably increases with the angle of incidence. Here we confirm the existence of isochronous space time' (ST) wave packets pulsed beams whose spatio temporal structure enables them to traverse the layer with a fixed group delay over a wide span of incident angles. This unique behavior stems from the dependence of the group velocity of a refracted ST wave packet on its angle of incidence. Isochronous ST wave packets are observed in slabs of optical materials with indices in the range from 1.38 to 2.5 for angles up to 50 circ away from normal incidence.


Maximal distance spectral radius of 4 chromatic planar graphs. We show that the kite graph K 4 (n) uniquely maximizes the distance spectral radius among all connected 4 chromatic planar graphs on n vertices.


Explainable Deep Few shot Anomaly Detection with Deviation Networks. Existing anomaly detection paradigms overwhelmingly focus on training detection models using exclusively normal data or unlabeled data (mostly normal samples). One notorious issue with these approaches is that they are weak in discriminating anomalies from normal samples due to the lack of the knowledge about the anomalies. Here, we study the problem of few shot anomaly detection, in which we aim at using a few labeled anomaly examples to train sample efficient discriminative detection models. To address this problem, we introduce a novel weakly supervised anomaly detection framework to train detection models without assuming the examples illustrating all possible classes of anomaly. Specifically, the proposed approach learns discriminative normality (regularity) by leveraging the labeled anomalies and a prior probability to enforce expressive representations of normality and unbounded deviated representations of abnormality. This is achieved by an end to end optimization of anomaly scores with a neural deviation learning, in which the anomaly scores of normal samples are imposed to approximate scalar scores drawn from the prior while that of anomaly examples is enforced to have statistically significant deviations from these sampled scores in the upper tail. Furthermore, our model is optimized to learn fine grained normality and abnormality by top K multiple instance learning based feature subspace deviation learning, allowing more generalized representations. Comprehensive experiments on nine real world image anomaly detection benchmarks show that our model is substantially more sample efficient and robust, and performs significantly better than state of the art competing methods in both closed set and open set settings. Our model can also offer explanation capability as a result of its prior driven anomaly score learning. Code and datasets are available at https git.io DevNet.


Untangling Circular Drawings Algorithms and Complexity. We consider the problem of untangling a given (non planar) straight line circular drawing delta G of an outerplanar graph G (V, E) into a planar straight line circular drawing by shifting a minimum number of vertices to a new position on the circle. For an outerplanar graph G , it is clear that such a crossing free circular drawing always exists and we define the circular shifting number shift ( delta G) as the minimum number of vertices that are required to be shifted in order to resolve all crossings of delta G . We show that the problem Circular Untangling, asking whether shift ( delta G) le K for a given integer K , is NP complete. For n vertex outerplanar graphs, we obtain a tight upper bound of shift ( delta G) le n lfloor sqrt n 2 rfloor 2 . Based on these results we study Circular Untangling for almost planar circular drawings, in which a single edge is involved in all the crossings. In this case, we provide a tight upper bound shift ( delta G) le lfloor frac n 2 rfloor 1 and present a constructive polynomial time algorithm to compute the circular shifting number of almost planar drawings.


Self similar solutions preventing finite time blow up for reaction diffusion equations with singular potential. We prove existence and uniqueness of a global in time self similar solution growing up as t to infty for the following reaction diffusion equation with a singular potential u t Delta u m x sigma u p, posed in dimension N geq2 , with m 1 , sigma in( 2,0) and 1 p 1 sigma(m 1) 2 . For the special case of dimension N 1 , the same holds true for sigma in( 1,0) and similar ranges for m and p . The existence of this global solution prevents finite time blow up even with m 1 and p 1 , showing an interesting effect induced by the singular potential x sigma . This result is also applied to reaction diffusion equations with general potentials V(x) to prevent finite time blow up via comparison.


Towards Robust Object Detection Bayesian RetinaNet for Homoscedastic Aleatoric Uncertainty Modeling. According to recent studies, commonly used computer vision datasets contain about 4 of label errors. For example, the COCO dataset is known for its high level of noise in data labels, which limits its use for training robust neural deep architectures in a real world scenario. To model such a noise, in this paper we have proposed the homoscedastic aleatoric uncertainty estimation, and present a series of novel loss functions to address the problem of image object detection at scale. Specifically, the proposed functions are based on Bayesian inference and we have incorporated them into the common community adopted object detection deep learning architecture RetinaNet. We have also shown that modeling of homoscedastic aleatoric uncertainty using our novel functions allows to increase the model interpretability and to improve the object detection performance being evaluated on the COCO dataset.


Predictive and Prescriptive Performance of Bike Sharing Demand Forecasts for Inventory Management. Bike sharing systems are a rapidly developing mode of transportation and provide an efficient alternative to passive, motorized personal mobility. The asymmetric nature of bike demand causes the need for rebalancing bike stations, which is typically done during night time. To determine the optimal starting inventory level of a station for a given day, a User Dissatisfaction Function (UDF) models user pickups and returns as non homogeneous Poisson processes with piece wise linear rates. In this paper, we devise a deep generative model directly applicable in the UDF by introducing a variational Poisson recurrent neural network model (VP RNN) to forecast future pickup and return rates. We empirically evaluate our approach against both traditional and learning based forecasting methods on real trip travel data from the city of New York, USA, and show how our model outperforms benchmarks in terms of system efficiency and demand satisfaction. By explicitly focusing on the combination of decision making algorithms with learning based forecasting methods, we highlight a number of shortcomings in literature. Crucially, we show how more accurate predictions do not necessarily translate into better inventory decisions. By providing insights into the interplay between forecasts, model assumptions, and decisions, we point out that forecasts and decision models should be carefully evaluated and harmonized to optimally control shared mobility systems.


Should I Stay or Should I Go Predicting Changes in Cluster Membership. Most research on predicting community evolution focuses on changes in the states of communities. Instead, we focus on individual nodes and define the novel problem of predicting whether a specific node stays in the same cluster, moves to another cluster or drops out of the network. We explore variations of the problem and propose appropriate classification features based on local and global node measures. Motivated by the prevalence of machine learning approaches based on embeddings, we also introduce efficiently computed distance based features using appropriate node embeddings. In addition, we consider chains of features to capture the history of the nodes. Our experimental results depict the complexity of the different formulations of the problem and the suitability of the selected features and chain lengths.


KVT k NN Attention for Boosting Vision Transformers. Convolutional Neural Networks (CNNs) have dominated computer vision for years, due to its ability in capturing locality and translation invariance. Recently, many vision transformer architectures have been proposed and they show promising performance. A key component in vision transformers is the fully connected self attention which is more powerful than CNNs in modelling long range dependencies. However, since the current dense self attention uses all image patches (tokens) to compute attention matrix, it may neglect locality of images patches and involve noisy tokens (e.g., clutter background and occlusion), leading to a slow training process and potential degradation of performance. To address these problems, we propose the k NN attention for boosting vision transformers. Specifically, instead of involving all the tokens for attention matrix calculation, we only select the top k similar tokens from the keys for each query to compute the attention map. The proposed k NN attention naturally inherits the local bias of CNNs without introducing convolutional operations, as nearby tokens tend to be more similar than others. In addition, the k NN attention allows for the exploration of long range correlation and at the same time filters out irrelevant tokens by choosing the most similar tokens from the entire image. Despite its simplicity, we verify, both theoretically and empirically, that k NN attention is powerful in speeding up training and distilling noise from input tokens. Extensive experiments are conducted by using 11 different vision transformer architectures to verify that the proposed k NN attention can work with any existing transformer architectures to improve its prediction performance.


Medical Image Segmentation with Limited Supervision A Review of Deep Network Models. Despite the remarkable performance of deep learning methods on various tasks, most cutting edge models rely heavily on large scale annotated training examples, which are often unavailable for clinical and health care tasks. The labeling costs for medical images are very high, especially in medical image segmentation, which typically requires intensive pixel voxel wise labeling. Therefore, the strong capability of learning and generalizing from limited supervision, including a limited amount of annotations, sparse annotations, and inaccurate annotations, is crucial for the successful application of deep learning models in medical image segmentation. However, due to its intrinsic difficulty, segmentation with limited supervision is challenging and specific model design and or learning strategies are needed. In this paper, we provide a systematic and up to date review of the solutions above, with summaries and comments about the methodologies. We also highlight several problems in this field, discussed future directions observing further investigations.


Quasi processes for branching Markov chains. Potential theory is a central tool to understand and analyse Markov processes. In this article, we develop its probabilistic counterpart for branching Markov chains. More explicitly, we consider analogues of quasi processes that involve branching (branching quasi processes). Branching quasi processes can be characterized in terms of their occupation measures. In the case where a particular decorability condition is satisfied, there is an isomorphism between the cone of branching quasi processes and the cone of excessive measures, where the respective excessive measures are the occupation measures of the branching quasi processes. Taking a branching quasi process as intensity measure for a Poison point process we obtain random interlacements that incorporate branching. In the particular case, where individuals produce offspring with mean less than or equal to one, we provide an explicit construction based on classical interlacements. We make strong use of the particular additive structure of branching Markov chains and a main technical tool will be a spinal representation for the involved branching processes.


Some Questions of Uniformity in Algorithmic Randomness. The Omega numbers the halting probabilities of universal prefix free machines are known to be exactly the Martin L "o f random left c.e. reals. We show that one cannot uniformly produce, from a Martin L "o f random left c.e. real alpha , a universal prefix free machine U whose halting probability is alpha . We also answer a question of Barmpalias and Lewis Pye by showing that given a left c.e. real alpha , one cannot uniformly produce a left c.e. real beta such that alpha beta is neither left c.e. nor right c.e.


Memory Capacity of Neural Turing Machines with Matrix Representation. It is well known that recurrent neural networks (RNNs) faced limitations in learning long term dependencies that have been addressed by memory structures in long short term memory (LSTM) networks. Matrix neural networks feature matrix representation which inherently preserves the spatial structure of data and has the potential to provide better memory structures when compared to canonical neural networks that use vector representation. Neural Turing machines (NTMs) are novel RNNs that implement notion of programmable computers with neural network controllers to feature algorithms that have copying, sorting, and associative recall tasks. In this paper, we study the augmentation of memory capacity with a matrix representation of RNNs and NTMs (MatNTMs). We investigate if matrix representation has a better memory capacity than the vector representations in conventional neural networks. We use a probabilistic model of the memory capacity using Fisher information and investigate how the memory capacity for matrix representation networks are limited under various constraints, and in general, without any constraints. In the case of memory capacity without any constraints, we found that the upper bound on memory capacity to be N 2 for an N times N state matrix. The results from our experiments using synthetic algorithmic tasks show that MatNTMs have a better learning capacity when compared to its counterparts.


Sparse Fuzzy Attention for Structured Sentiment Analysis. Attention scorers have achieved success in parsing tasks like semantic and syntactic dependency parsing. However, in tasks modeled into parsing, like structured sentiment analysis, "dependency edges" are very sparse which hinders parser performance. Thus we propose a sparse and fuzzy attention scorer with pooling layers which improves parser performance and sets the new state of the art on structured sentiment analysis. We further explore the parsing modeling on structured sentiment analysis with second order parsing and introduce a novel sparse second order edge building procedure that leads to significant improvement in parsing performance.


A deep learning model for data driven discovery of functional connectivity. Functional connectivity (FC) studies have demonstrated the overarching value of studying the brain and its disorders through the undirected weighted graph of fMRI correlation matrix. Most of the work with the FC, however, depends on the way the connectivity is computed, and further depends on the manual post hoc analysis of the FC matrices. In this work we propose a deep learning architecture BrainGNN that learns the connectivity structure as part of learning to classify subjects. It simultaneously applies a graphical neural network to this learned graph and learns to select a sparse subset of brain regions important to the prediction task. We demonstrate the model's state of the art classification performance on a schizophrenia fMRI dataset and demonstrate how introspection leads to disorder relevant findings. The graphs learned by the model exhibit strong class discrimination and the sparse subset of relevant regions are consistent with the schizophrenia literature.


Regularity of solutions to degenerate fully nonlinear elliptic equations with variable exponent. We consider the fully nonlinear equation with variable exponent double phase type degeneracies big Du p(x) a(x) Du q(x) big F(D 2u) f(x). Under some appropriate assumptions, by making use of geometric tangential methods and combing a refined improvement of flatness approach with compactness and scaling techniques we obtain the sharp local C 1, alpha regularity of viscosity solutions to such equations.


Real topological Hochschild homology via the norm and Real Witt vectors. We prove that Real topological Hochschild homology can be characterized as the norm from the cyclic group of order 2 to the orthogonal group O(2) . From this perspective, we then prove a multiplicative double coset formula for the restriction of this norm to dihedral groups of order 2m . This informs our new definition of Real Hochschild homology of rings with anti involution, which we show is the algebraic analogue of Real topological Hochschild homology. Using extra structure on Real Hochschild homology, we define a new theory of p typical Witt vectors of rings with anti involution. We end with an explicit computation of the degree zero D 2m Mackey functor homotopy groups of operatorname THR ( underline mathbb Z ) for m odd. This uses a Tambara reciprocity formula for sums for general finite groups, which may be of independent interest.


Investigating the exceptionality of scattered polynomials. Scattered polynomials over a finite field mathbb F q n have been introduced by Sheekey in 2016, and a central open problem regards the classification of those that are exceptional. So far, only two families of exceptional scattered polynomials are known. Very recently, Longobardi and Zanella weakened the property of being scattered by introducing the notion of L q t partially scattered and R q t partially scattered polynomials, for t a divisor of n . Indeed, a polynomial is scattered if and only if it is both L q t partially scattered and R q t partially scattered. In this paper, by using techniques from algebraic geometry over finite fields and function fields theory, we show that the property which is is the hardest to be preserved is the L q t partially scattered one. On the one hand, we are able to extend the classification results of exceptional scattered polynomials to exceptional L q t partially scattered polynomials. On the other hand, the R q t partially scattered property seems more stable. We present a large family of R q t partially scattered polynomials, containing examples of exceptional R q t partially scattered polynomials, which turn out to be connected with linear sets of so called pseudoregulus type. In order to detect new examples of polynomials which are R q t partially scattered, we introduce two different notions of equivalence preserving this property and concerning natural actions of the groups rm Gamma L (2,q n) and rm Gamma L (2n t,q t) . In particular, our family contains many examples of inequivalent polynomials, and geometric arguments are used to determine the equivalence classes under the action of rm Gamma L (2n t,q t) .


A Decomposition Theorem of Varadhan Type for Co local Forms on Large Scale Interacting Systems. In our previous article with Yukio Kametani, we investigated the geometric structure underlying a large scale interacting system on infinite graphs, via constructing a suitable cohomology theory called uniformly local cohomology, which reflects the geometric property of the microscopic model, using a class of functions called the uniformly local functions. In this article, we introduce the co local functions on the geometric structure associated to a large scale interacting system. We may similarly define the notion of uniformly local functions for co local functions. However, contrary to the functions appearing in our previous article, the co local functions reflect the stochastic property of the model, namely the probability measure on the configuration space. We then prove a decomposition theorem of Varadhan type for closed co local forms. The space of co local functions and forms contain the space of L 2 functions and forms. In the last section, we state a conjecture concerning the decomposition theorem for the L 2 case.


The space of non extendable quasimorphisms. For a pair (G,N) of a group G and its normal subgroup N , we consider the space of quasimorphisms and quasi cocycles on N non extendable to G . To treat this space, we establish the five term exact sequence of cohomology relative to the bounded subcomplex. As its application, we study the spaces associated with the kernel of the (volume) flux homomorphism, the IA automorphism group of a free group, and certain normal subgroups of Gromov hyperbolic groups. Furthermore, we employ this space to prove that the stable commutator length is equivalent to the stable mixed commutator length for certain pairs of a group and its normal subgroup.


RFID based Article to Fixture Predictions in Real World Fashion Stores. In recent years, Radio Frequency Identification (RFID) technology has been applied to improve numerous processes, such as inventory management in retail stores. However, automatic localization of RFID tagged goods in stores is still a challenging problem. To address this issue, we equip fixtures (e.g., shelves) with reference tags and use data we collect during RFID based stocktakes to map articles to fixtures. Knowing the location of goods enables the implementation of several practical applications, such as automated Money Mapping (i.e., a heat map of sales across fixtures). Specifically, we conduct controlled lab experiments and a case study in two fashion retail stores to evaluate our article to fixture prediction approaches. The approaches are based on calculating distances between read event time series using DTW, and clustering of read events using DBSCAN. We find that, read events collected during RFID based stocktakes can be used to assign articles to fixtures with an accuracy of more than 90 . Additionally, we conduct a pilot to investigate the challenges related to the integration of such a localization system in the day to day business of retail stores. Hence, in this paper we present an exploratory venture into novel and practical RFID based applications in fashion retails stores, beyond the scope of stock management.


Distributionally Robust Optimization with Expected Constraints via Optimal Transport. We consider a stochastic program with expected value constraints. We analyze this problem in a general context via Distributionally Robust Optimization (DRO) approach using 1 or 2 Wasserstein metrics where the ambiguity set depends on the decision. We show that this approach can be reformulated as a finite dimensional optimization problem, and, in some cases, this can be convex. Additionally, we establish criteria to determine the feasibility of the problem in terms of the Wasserstein radius and the level of the constraint. Finally, we present numerical results in the context of management inventory and portfolio optimization. In portfolio optimization context, we present the advantages that our approach has over some existing non robust methods using real financial market data.


Effects of sweeps and ejections on amplitude modulation in a turbulent channel flow. Conditional averages are used to evaluate the effect of sweeps and ejections on amplitude modulation. This is done numerically with a direct numerical simulation (DNS) of a channel flow at friction Reynolds number Re tau 1000 in a minimal stream wise unit (MSU). The amplitude modulation map of such DNS is also compared to the one of a regular channel flow in a longer streamwise domain (LSD), in order to assess its validity for this study. The cheaper MSU is found to provide a good representation of the modulation phenomena in the LSD. As for conditional averages, the amplitude modulation coefficient is conditioned on the sign of the large scale fluctuations. Care must be exerted in defining such a coefficient, as the conditioned large scale fluctuation has non zero average, indeed as a consequence of conditioning. Both sweeps and ejections (positive and negative large scale fluctuation events) are found to have a positive contribution to amplitude modulation in the buffer layer, and a negative one in the outer layer. The negative modulation region is found to shrink in case of ejections, so that the positive modulation region extends farther away from the wall. Two more conditional statistics are used to provide an alternative representation of amplitude modulation and insights into the characteristics of the large scale structures.


Boundary of the boundary for random walks on groups. We study fine structure related to finitely supported random walks on infinite finitely generated discrete groups, largely motivated by dimension group techniques. The unfaithful extreme harmonic functions (defined only on proper space time cones), aka unfaithful pure traces, can be represented on systems of finite support, avoiding dead ends. This motivates properties of the random walk (WC) and of the group (SWC) which become of interest in their own right. While all abelian groups satisfy WC, the do not satisfy SWC however some abelian by finite groups do satisfy the latter, and we characterize when this occurs. In general, we determine the maximal order ideals, aka, maximal proper space time subcones of that generated by the group element 1 at time zero), and show that the corresponding quotients are stationary simple dimension groups, and that all such can occur for the free group on two generators. We conclude with a case study of the discrete Heisenberg group, determining among other things, the pure traces (these are the unfaithful ones, not arising from characters).


Plot guided Adversarial Example Construction for Evaluating Open domain Story Generation. With the recent advances of open domain story generation, the lack of reliable automatic evaluation metrics becomes an increasingly imperative issue that hinders the fast development of story generation. According to conducted researches in this regard, learnable evaluation metrics have promised more accurate assessments by having higher correlations with human judgments. A critical bottleneck of obtaining a reliable learnable evaluation metric is the lack of high quality training data for classifiers to efficiently distinguish plausible and implausible machine generated stories. Previous works relied on textit heuristically manipulated plausible examples to mimic possible system drawbacks such as repetition, contradiction, or irrelevant content in the text level, which can be textit unnatural and textit oversimplify the characteristics of implausible machine generated stories. We propose to tackle these issues by generating a more comprehensive set of implausible stories using em plots , which are structured representations of controllable factors used to generate stories. Since these plots are compact and structured, it is easier to manipulate them to generate text with targeted undesirable properties, while at the same time maintain the grammatical correctness and naturalness of the generated sentences. To improve the quality of generated implausible stories, we further apply the adversarial filtering procedure presented by citet zellers2018swag to select a more nuanced set of implausible texts. Experiments show that the evaluation metrics trained on our generated data result in more reliable automatic assessments that correlate remarkably better with human judgments compared to the baselines.


On tracial mathcal Z stability of simple non unital C algebras. We investigate the notion of tracial mathcal Z stability beyond unital C algebras, and we prove that this notion is equivalent to mathcal Z stability in the class of separable simple nuclear C algebras.


The Complexity of Growing a Graph. We study a new algorithmic process of graph growth. The process starts from a single initial vertex u 0 and operates in discrete time steps, called emph slots . In every slot t geq 1, the process updates the current graph instance to generate the next graph instance G t, according to the following vertex and edge update rules. The process first sets G t G t 1 . Then, for every u in V(G t 1 ), it adds at most one new vertex u' to V(G t ) and adds the edge uu' to E(G t ) alongside any subset of the edges vu' v in V(G t 1 ) is at distance at most d 1 from u in G t 1 , for some integer d geq 1 fixed in advance. The process completes slot t after removing any (possibly empty) subset of edges from E(G t ). Removed edges are called emph excess edges . Graph Growth Problem Given a graph family F, we are asked to design a emph centralized algorithm that on any input emph target graph G in F, will output such a process growing G, called a emph growth schedule for G. Additionally, the algorithm should try to minimize the total number of slots k and of excess edges ell used by the process. We show that the most interesting case is when d 2 and that there is a natural trade off between k and ell. On the positive side, we provide polynomial time algorithms that decide whether a graph has growth schedules of k log n or k n 1 slots. Along the way, interesting connections to cop win graphs are being revealed. On the negative side, we establish strong hardness results for determining the minimum number of slots required to grow a graph with zero excess edges. We then show that trees can be grown in a polylogarithmic number of slots using linearly many excess edges, while planar graphs can be grown in a logarithmic number of slots using O(n log n) excess edges. We also give lower bounds on the number of excess edges, when the number of slots is fixed to log n.


A Reinforcement Learning based Path Planning Approach in 3D Environment. Optimal motion planning involves obstacles avoidance where path planning is the key to success in optimal motion planning. Due to the computational demands, most of the path planning algorithms can not be employed for real time based applications. Model based reinforcement learning approaches for path planning have received certain success in the recent past. Yet, most of such approaches do not have deterministic output due to the randomness. We analyzed several types of reinforcement learning based approaches for path planning. One of them is a deterministic tree based approach and other two approaches are based on Q learning and approximate policy gradient, respectively. We tested preceding approaches on two different simulators, each of which consists of a set of random obstacles that can be changed or moved dynamically. After analysing the result and computation time, we concluded that the deterministic tree search approach provides highly stable result. However, the computational time is considerably higher than the other two approaches. Finally, the comparative results are provided in terms of accuracy and computational time as evidence.


Bootstrapping Concept Formation in Small Neural Networks. The question how neural systems (of humans) can perform reasoning is still far from being solved. We posit that the process of forming Concepts is a fundamental step required for this. We argue that, first, Concepts are formed as closed representations, which are then consolidated by relating them to each other. Here we present a model system (agent) with a small neural network that uses realistic learning rules and receives only feedback from the environment in which the agent performs virtual actions. First, the actions of the agent are reflexive. In the process of learning, statistical regularities in the input lead to the formation of neuronal pools representing relations between the entities observed by the agent from its artificial world. This information then influences the behavior of the agent via feedback connections replacing the initial reflex by an action driven by these relational representations. We hypothesize that the neuronal pools representing relational information can be considered as primordial Concepts, which may in a similar way be present in some pre linguistic animals, too. This system provides formal grounds for further discussions on what could be understood as a Concept and shows that associative learning is enough to develop concept like structures.


Game values of arithmetic functions. Arithmetic functions in Number Theory meet the Sprague Grundy function from Combinatorial Game Theory. We study a variety of 2 player games induced by standard arithmetic functions, such as Euclidian division, divisors, remainders and relatively prime numbers, and their negations.