VILA Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups. Accurately extracting structured content from PDFs is a critical first step for NLP over scientific papers. Recent work has improved extraction accuracy by incorporating elementary layout information, e.g., each token's 2D position on the page, into language model pretraining. We introduce new methods that explicitly model VIsual LAyout (VILA) groups, i.e., text lines or text blocks, to further improve performance. In our I VILA approach, we show that simply inserting special tokens denoting layout group boundaries into model inputs can lead to a 1.9 Macro F1 improvement in token classification. In the H VILA approach, we show that hierarchical encoding of layout groups can result in up to 47 inference time reduction with less than 0.8 Macro F1 loss. Unlike prior layout aware approaches, our methods do not require expensive additional pretraining, only fine tuning, which we show can reduce training cost by up to 95 . Experiments are conducted on a newly curated evaluation suite, S2 VLUE, that unifies existing automatically labeled datasets and includes a new dataset of manual annotations covering diverse papers from 19 scientific disciplines. Pre trained weights, benchmark datasets, and source code are available at https github.com allenai VILA.


An algorithm for a fairer and better voting system. The major finding, of this article, is an ensemble method, but more exactly, a novel, better ranked voting system (and other variations of it), that aims to solve the problem of finding the best candidate to represent the voters. We have the source code on GitHub, for making realistic simulations of elections, based on artificial intelligence for comparing different variations of the algorithm, and other already known algorithms. We have convincing evidence that our algorithm is better than Instant Runoff Voting, Preferential Block Voting, Single Transferable Vote, and First Past The Post (if certain, natural conditions are met, to support the wisdom of the crowds). By also comparing with the best voter, we demonstrated the wisdom of the crowds, suggesting that democracy (distributed system) is a better option than dictatorship (centralized system), if those certain, natural conditions are met. Voting systems are not restricted to politics, they are ensemble methods for artificial intelligence, but the context of this article is natural intelligence. It is important to find a system that is fair (e.g. freedom of expression on the ballot exists), especially when the outcome of the voting system has social impact some voting systems have the unfair inevitability to trend (over time) towards the same two major candidates (Duverger's law).


Language Models Use Monotonicity to Assess NPI Licensing. We investigate the semantic knowledge of language models (LMs), focusing on (1) whether these LMs create categories of linguistic environments based on their semantic monotonicity properties, and (2) whether these categories play a similar role in LMs as in human language understanding, using negative polarity item licensing as a case study. We introduce a series of experiments consisting of probing with diagnostic classifiers (DCs), linguistic acceptability tasks, as well as a novel DC ranking method that tightly connects the probing results to the inner workings of the LM. By applying our experimental pipeline to LMs trained on various filtered corpora, we are able to gain stronger insights into the semantic generalizations that are acquired by these models.


Transformer F A Transformer network with effective methods for learning universal sentence representation. The Transformer model is widely used in natural language processing for sentence representation. However, the previous Transformer based models focus on function words that have limited meaning in most cases and could merely extract high level semantic abstraction features. In this paper, two approaches are introduced to improve the performance of Transformers. We calculated the attention score by multiplying the part of speech weight vector with the correlation coefficient, which helps extract the words with more practical meaning. The weight vector is obtained by the input text sequence based on the importance of the part of speech. Furthermore, we fuse the features of each layer to make the sentence representation results more comprehensive and accurate. In experiments, we demonstrate the effectiveness of our model Transformer F on three standard text classification datasets. Experimental results show that our proposed model significantly boosts the performance of text classification as compared to the baseline model. Specifically, we obtain a 5.28 relative improvement over the vanilla Transformer on the simple tasks.


Hierarchical Reinforcement Learning By Discovering Intrinsic Options. We propose a hierarchical reinforcement learning method, HIDIO, that can learn task agnostic options in a self supervised manner while jointly learning to utilize them to solve sparse reward tasks. Unlike current hierarchical RL approaches that tend to formulate goal reaching low level tasks or pre define ad hoc lower level policies, HIDIO encourages lower level option learning that is independent of the task at hand, requiring few assumptions or little knowledge about the task structure. These options are learned through an intrinsic entropy minimization objective conditioned on the option sub trajectories. The learned options are diverse and task agnostic. In experiments on sparse reward robotic manipulation and navigation tasks, HIDIO achieves higher success rates with greater sample efficiency than regular RL baselines and two state of the art hierarchical RL methods.


Normal Tempered Stable Processes and the Pricing of Energy Derivatives. In this study we consider the pricing of energy derivatives when the evolution of spot prices is modeled with a normal tempered stable driven Ornstein Uhlenbeck process. Such processes are the generalization of normal inverse Gaussian processes that are widely used in energy finance applications. We first specify their statistical properties calculating their characteristic function in closed form. This result is instrumental for the derivation of non arbitrage conditions such that the spot dynamics is consistent with the forward curve without relying on numerical approximations or on numerical integration. Moreover, we conceive an efficient algorithm for the exact generation of the trajectories which gives the possibility to implement Monte Carlo simulations without approximations or bias. We illustrate the applicability of the theoretical findings and the simulation algorithms in the context of the pricing of different contracts, namely, strips of daily call options, Asian options with European style and swing options. Finally, we present an extension to future markets.


Investigation of Topic Modelling Methods for Understanding the Reports of the Mining Projects in Queensland. In the mining industry, many reports are generated in the project management process. These past documents are a great resource of knowledge for future success. However, it would be a tedious and challenging task to retrieve the necessary information if the documents are unorganized and unstructured. Document clustering is a powerful approach to cope with the problem, and many methods have been introduced in past studies. Nonetheless, there is no silver bullet that can perform the best for any types of documents. Thus, exploratory studies are required to apply the clustering methods for new datasets. In this study, we will investigate multiple topic modelling (TM) methods. The objectives are finding the appropriate approach for the mining project reports using the dataset of the Geological Survey of Queensland, Department of Resources, Queensland Government, and understanding the contents to get the idea of how to organise them. Three TM methods, Latent Dirichlet Allocation (LDA), Nonnegative Matrix Factorization (NMF), and Nonnegative Tensor Factorization (NTF) are compared statistically and qualitatively. After the evaluation, we conclude that the LDA performs the best for the dataset however, the possibility remains that the other methods could be adopted with some improvements.


Large deviation principles for SDEs under locally weak monotonicity conditions. This paper establishes a Freidlin Wentzell large deviation principle for stochastic differential equations(SDEs) under locally weak monotonicity conditions and Lyapunov conditions. We illustrate the main result of the paper by showing that it can be applied to SDEs with non Lipschitzian coefficients, which can not be covered in the existing literature. These include the interesting biological models like stochastic Duffing van der Pol oscillator model, stochastic SIR model, etc.


Task Agnostic Morphology Evolution. Deep reinforcement learning primarily focuses on learning behavior, usually overlooking the fact that an agent's function is largely determined by form. So, how should one go about finding a morphology fit for solving tasks in a given environment? Current approaches that co adapt morphology and behavior use a specific task's reward as a signal for morphology optimization. However, this often requires expensive policy optimization and results in task dependent morphologies that are not built to generalize. In this work, we propose a new approach, Task Agnostic Morphology Evolution (TAME), to alleviate both of these issues. Without any task or reward specification, TAME evolves morphologies by only applying randomly sampled action primitives on a population of agents. This is accomplished using an information theoretic objective that efficiently ranks agents by their ability to reach diverse states in the environment and the causality of their actions. Finally, we empirically demonstrate that across 2D, 3D, and manipulation environments TAME can evolve morphologies that match the multi task performance of those learned with task supervised algorithms. Our code and videos can be found at https sites.google.com view task agnostic evolution.


On the instability of embeddings for recommender systems the case of Matrix Factorization. Most state of the art top N collaborative recommender systems work by learning embeddings to jointly represent users and items. Learned embeddings are considered to be effective to solve a variety of tasks. Among others, providing and explaining recommendations. In this paper we question the reliability of the embeddings learned by Matrix Factorization (MF). We empirically demonstrate that, by simply changing the initial values assigned to the latent factors, the same MF method generates very different embeddings of items and users, and we highlight that this effect is stronger for less popular items. To overcome these drawbacks, we present a generalization of MF, called Nearest Neighbors Matrix Factorization (NNMF). The new method propagates the information about items and users to their neighbors, speeding up the training procedure and extending the amount of information that supports recommendations and representations. We describe the NNMF variants of three common MF approaches, and with extensive experiments on five different datasets we show that they strongly mitigate the instability issues of the original MF versions and they improve the accuracy of recommendations on the long tail.


Network Environment Design for Autonomous Cyberdefense. Reinforcement learning (RL) has been demonstrated suitable to develop agents that play complex games with human level performance. However, it is not understood how to effectively use RL to perform cybersecurity tasks. To develop such understanding, it is necessary to develop RL agents using simulation and emulation systems allowing researchers to model a broad class of realistic threats and network conditions. Demonstrating that a specific RL algorithm can be effective for defending a network under certain conditions may not necessarily give insight about the performance of the algorithm when the threats, network conditions, and security goals change. This paper introduces a novel approach for network environment design and a software framework to address the fundamental problem that network defense cannot be defined as a single game with a simple set of fixed rules. We show how our approach is necessary to facilitate the development of RL network defenders that are robust against attacks aimed at the agent's learning. Our framework enables the development and simulation of adversaries with sophisticated behavior that includes poisoning and evasion attacks on RL network defenders.


Instability and nonuniqueness for the 2d Euler equations in vorticity form, after M. Vishik. In this expository work, we present Vishik's theorem on non unique weak solutions to the two dimensional Euler equations on the whole space, partial t omega u cdot nabla omega f , , quad u frac 1 2 pi frac x perp x 2 ast omega , , with initial vorticity omega 0 in L 1 cap L p and f in L 1 t (L 1 cap L p) x , p infty . His theorem demonstrates, in particular, the sharpness of the Yudovich class. An important intermediate step is the rigorous construction of an unstable vortex, which is of independent physical and mathematical interest. We follow the strategy of Vishik but allow ourselves certain deviations in the proof and substantial deviations in our presentation, which emphasizes the underlying dynamical point of view.


On the unique ergodicity for a class of 2 dimensional stochastic wave equations. We study the global in time dynamics for a stochastic semilinear wave equation with cubic defocusing nonlinearity and additive noise, posed on the 2 dimensional torus. The noise is taken to be slightly more regular than space time white noise. In this setting, we show existence and uniqueness of an invariant measure for the Markov semigroup generated by the flow over an appropriately chosen Banach space. This extends a result of the second author to a situation where the invariant measure is not explicitly known.


OESense Employing Occlusion Effect for In ear Human Sensing. Smart earbuds are recognized as a new wearable platform for personal scale human motion sensing. However, due to the interference from head movement or background noise, commonly used modalities (e.g. accelerometer and microphone) fail to reliably detect both intense and light motions. To obviate this, we propose OESense, an acoustic based in ear system for general human motion sensing. The core idea behind OESense is the joint use of the occlusion effect (i.e., the enhancement of low frequency components of bone conducted sounds in an occluded ear canal) and inward facing microphone, which naturally boosts the sensing signal and suppresses external interference. We prototype OESense as an earbud and evaluate its performance on three representative applications, i.e., step counting, activity recognition, and hand to face gesture interaction. With data collected from 31 subjects, we show that OESense achieves 99.3 step counting recall, 98.3 recognition recall for 5 activities, and 97.0 recall for five tapping gestures on human face, respectively. We also demonstrate that OESense is compatible with earbuds' fundamental functionalities (e.g. music playback and phone calls). In terms of energy, OESense consumes 746 mW during data recording and recognition and it has a response latency of 40.85 ms for gesture recognition. Our analysis indicates such overhead is acceptable and OESense is potential to be integrated into future earbuds.


SOCCER An Information Sparse Discourse State Tracking Collection in the Sports Commentary Domain. In the pursuit of natural language understanding, there has been a long standing interest in tracking state changes throughout narratives. Impressive progress has been made in modeling the state of transaction centric dialogues and procedural texts. However, this problem has been less intensively studied in the realm of general discourse where ground truth descriptions of states may be loosely defined and state changes are less densely distributed over utterances. This paper proposes to turn to simplified, fully observable systems that show some of these properties Sports events. We curated 2,263 soccer matches including time stamped natural language commentary accompanied by discrete events such as a team scoring goals, switching players or being penalized with cards. We propose a new task formulation where, given paragraphs of commentary of a game at different timestamps, the system is asked to recognize the occurrence of in game events. This domain allows for rich descriptions of state while avoiding the complexities of many other real world settings. As an initial point of performance measurement, we include two baseline methods from the perspectives of sentence classification with temporal dependence and current state of the art generative model, respectively, and demonstrate that even sophisticated existing methods struggle on the state tracking task when the definition of state broadens or non event chatter becomes prevalent.


Learning with Memory based Virtual Classes for Deep Metric Learning. The core of deep metric learning (DML) involves learning visual similarities in high dimensional embedding space. One of the main challenges is to generalize from seen classes of training data to unseen classes of test data. Recent works have focused on exploiting past embeddings to increase the number of instances for the seen classes. Such methods achieve performance improvement via augmentation, while the strong focus on seen classes still remains. This can be undesirable for DML, where training and test data exhibit entirely different classes. In this work, we present a novel training strategy for DML called MemVir. Unlike previous works, MemVir memorizes both embedding features and class weights to utilize them as additional virtual classes. The exploitation of virtual classes not only utilizes augmented information for training but also alleviates a strong focus on seen classes for better generalization. Moreover, we embed the idea of curriculum learning by slowly adding virtual classes for a gradual increase in learning difficulty, which improves the learning stability as well as the final performance. MemVir can be easily applied to many existing loss functions without any modification. Extensive experimental results on famous benchmarks demonstrate the superiority of MemVir over state of the art competitors. Code of MemVir is publicly available.


Engineering Uniform Sampling of Graphs with a Prescribed Power law Degree Sequence. We consider the following common network analysis problem given a degree sequence mathbf d (d 1, dots, d n) in mathbb N n return a uniform sample from the ensemble of all simple graphs with matching degrees. In practice, the problem is typically solved using Markov Chain Monte Carlo approaches, such as Edge Switching or Curveball, even if no practical useful rigorous bounds are known on their mixing times. In contrast, Arman et al. sketch Inc Powerlaw, a novel and much more involved algorithm capable of generating graphs for power law bounded degree sequences with gamma gtrapprox 2.88 in expected linear time. For the first time, we give a complete description of the algorithm and add novel switchings. To the best of our knowledge, our open source implementation of Inc Powerlaw is the first practical generator with rigorous uniformity guarantees for the aforementioned degree sequences. In an empirical investigation, we find that for small average degrees Inc Powerlaw is very efficient and generates graphs with one million nodes in less than a second. For larger average degrees, parallelism can partially mitigate the increased running time.


Occlusion Aware Video Object Inpainting. Conventional video inpainting is neither object oriented nor occlusion aware, making it liable to obvious artifacts when large occluded object regions are inpainted. This paper presents occlusion aware video object inpainting, which recovers both the complete shape and appearance for occluded objects in videos given their visible mask segmentation. To facilitate this new research, we construct the first large scale video object inpainting benchmark YouTube VOI to provide realistic occlusion scenarios with both occluded and visible object masks available. Our technical contribution VOIN jointly performs video object shape completion and occluded texture generation. In particular, the shape completion module models long range object coherence while the flow completion module recovers accurate flow with sharp motion boundary, for propagating temporally consistent texture to the same moving object across frames. For more realistic results, VOIN is optimized using both T PatchGAN and a new spatio temporal attention based multi class discriminator. Finally, we compare VOIN and strong baselines on YouTube VOI. Experimental results clearly demonstrate the efficacy of our method including inpainting complex and dynamic objects. VOIN degrades gracefully with inaccurate input visible mask.


Characterizing slopes for torus knots, II. A slope frac pq is called a characterizing slope for a given knot K 0 subset S 3 if whenever the frac pq surgery on a knot K subset S 3 is homeomorphic to the frac pq surgery on K 0 via an orientation preserving homeomorphism, then K K 0 . In a previous paper, we showed that, outside a certain finite set of slopes, only the negative integers could possibly be non characterizing slopes for the torus knot T 5,2 . Applying recent work of Baldwin Hu Sivek, we improve our result by showing that a nontrivial slope frac pq is a characterizing slope for T 5,2 if frac pq 1 and frac pq notin 0,1, pm frac12, pm frac13 . In particular, every nontrivial L space slope of T 5,2 is characterizing for T 5,2 . As a consequence, if a nontrivial frac pq surgery on a non torus knot in S 3 yields a manifold of finite fundamental group, then p 9 .


Pruning Attention Heads of Transformer Models Using A Search A Novel Approach to Compress Big NLP Architectures. Recent years have seen a growing adoption of Transformer models such as BERT in Natural Language Processing and even in Computer Vision. However, due to their size, there has been limited adoption of such models within resource constrained computing environments. This paper proposes novel pruning algorithm to compress transformer models by eliminating redundant Attention Heads. We apply the A search algorithm to obtain a pruned model with strict accuracy guarantees. Our results indicate that the method could eliminate as much as 40 of the attention heads in the BERT transformer model with no loss in accuracy.


Train Short, Test Long Attention with Linear Biases Enables Input Length Extrapolation. Since the introduction of the transformer model by Vaswani et al. (2017), a fundamental question has yet to be answered how does a model achieve extrapolation at inference time for sequences that are longer than it saw during training? We first show that extrapolation can be enabled by simply changing the position representation method, though we find that current methods do not allow for efficient extrapolation. We therefore introduce a simpler and more efficient position method, Attention with Linear Biases (ALiBi). ALiBi does not add positional embeddings to word embeddings instead, it biases query key attention scores with a penalty that is proportional to their distance. We show that this method trains a 1.3 billion parameter model on input sequences of length 1024 that extrapolates to input sequences of length 2048, achieving the same perplexity as a sinusoidal position embedding model trained on inputs of length 2048 but training 11 faster and using 11 less memory. ALiBi's inductive bias towards recency also leads it to outperform multiple strong position methods on the WikiText 103 benchmark.


Connections on moduli spaces and infinitesimal Hecke modifications. Let X be a proper scheme and Z a prestack over X equipped with a flat connection. We give a local to global description of D modules on the prestack S(Z) of flat sections of Z. Examples of S(Z) include the moduli stacks of principal G bundles and de Rham local systems on X. We show that the category of D modules is equivalent to the category of ind coherent sheaves which are equivariant with respect to infinitesimal Hecke groupoids parametrized by finite subsets of X. We describe a number of applications to geometric representation theory and conformal field theory, including a derived enhancement of the Verlinde formula the derived space of conformal blocks (a.k.a. chiral homology) of the WZW model is isomorphic to the cohomology of the corresponding line bundle on Bun G, the moduli stack of G bundles.


Reducing the Deployment Time Inference Control Costs of Deep Reinforcement Learning Agents via an Asymmetric Architecture. Deep reinforcement learning (DRL) has been demonstrated to provide promising results in several challenging decision making and control tasks. However, the required inference costs of deep neural networks (DNNs) could prevent DRL from being applied to mobile robots which cannot afford high energy consuming computations. To enable DRL methods to be affordable in such energy limited platforms, we propose an asymmetric architecture that reduces the overall inference costs via switching between a computationally expensive policy and an economic one. The experimental results evaluated on a number of representative benchmark suites for robotic control tasks demonstrate that our method is able to reduce the inference costs while retaining the agent's overall performance.


Collaborative Radio SLAM for Multiple Robots based on WiFi Fingerprint Similarity. Simultaneous Localization and Mapping (SLAM) enables autonomous robots to navigate and execute their tasks through unknown environments. However, performing SLAM in large environments with a single robot is not efficient, and visual or LiDAR based SLAM requires feature extraction and matching algorithms, which are computationally expensive. In this paper, we present a collaborative SLAM approach with multiple robots using the pervasive WiFi radio signals. A centralized solution is proposed to optimize the trajectory based on the odometry and radio fingerprints collected from multiple robots. To improve the localization accuracy, a novel similarity model is introduced that combines received signal strength (RSS) and detection likelihood of an access point (AP). We perform extensive experiments to demonstrate the effectiveness of the proposed similarity model and collaborative SLAM framework.


Discrete Approximation of Pressure Field Contact Patches. Rich interaction with the world requires extensive contact between robots and the objects in their environment. Most such contacts involve significant compliance between the contacting surfaces due to rubber pads or inflated grippers, soft objects to be manipulated, and soft surfaces for safe human robot interaction. Accurate simulation of these contacts is critical for meaningful sim to real transfer. Compliant contact interactions generate contact surfaces of considerable extent, over which contact forces are distributed with varying pressure. Finite element methods can capture these effects but are too slow for most robotics applications. Consequently, in order to enable real time simulation rates, most current simulation tools model contact as occurring between rigid bodies at a point or set of points using ad hoc methods to incorporate localized compliance. However, point contact is non smooth, hard to extend to arbitrary geometry, and often introduces non physical artifacts. Moreover, point contact misses important area dependent phenomena critical for robust manipulation, such as net contact moment and slip control. Pressure Field Contact (PFC) was recently introduced as a method for detailed modeling of contact interface regions at rates much faster than elasticity theory models, while at the same time predicting essential trends and capturing rich contact behavior. PFC was designed to work with coarsely meshed objects while preserving continuity to permit use with error controlled integrators. Here we introduce a discrete approximation of PFC suitable for use with velocity level time steppers that enables execution at real time rates. We evaluate the accuracy and performance gains of our approach and demonstrate its effectiveness in simulation of relevant manipulation tasks. The method is available in open source as part of Drake's Hydroelastic Contact model.


Soft Calibration Objectives for Neural Networks. Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under or over confident in their predictions. Consequently, methods have been developed to improve the calibration of their predictive uncertainty both during training and post hoc. In this work, we propose differentiable losses to improve calibration based on a soft (continuous) version of the binning operation underlying popular calibration error estimators. When incorporated into training, these soft calibration losses achieve state of the art single model ECE across multiple datasets with less than 1 decrease in accuracy. For instance, we observe an 82 reduction in ECE (70 relative to the post hoc rescaled ECE) in exchange for a 0.7 relative decrease in accuracy relative to the cross entropy baseline on CIFAR 100. When incorporated post training, the soft binning based calibration error objective improves upon temperature scaling, a popular recalibration method. Overall, experiments across losses and datasets demonstrate that using calibration sensitive procedures yield better uncertainty estimates under dataset shift than the standard practice of using a cross entropy loss and post hoc recalibration methods.


Sharp Bounds on Eigenvalues via Spectral Embedding Based on Signless Laplacians. Using spectral embedding based on the signless Laplacian, we obtain bounds on the spectrum of transition matrices on graphs. As a consequence, we bound return probabilities and the uniform mixing time of simple random walk on graphs. In addition, spectral embedding is used in this article to bound the spectrum of graph adjacency matrices. Our method is adapted from Lyons and Oveis Gharan, 2018 .


User Association in Scalable Cell Free Massive MIMO Systems. In this work, we consider the uplink of a scalable cell free massive MIMO system where the users are served only by a subset of access points (APs) in the network. The APs are physically grouped into predetermined "cell centric clusters", which are connected to different cooperative central processing units (CPUs). Given the cooperative nature of the considered communications network, we assume that each user is associated with a "virtual cluster", that, in general, involves some APs belonging to different cell centric clusters. Assuming the maximum ratio combining at the APs, we propose a user association procedure aimed at the maximization of the sum rate of the users in the system. The proposed procedure is based on the Hungarian Algorithm and exploits only the knowledge of the position of the APs in the network. Numerical results reveal that the performance of the proposed approach is not always better than the alternatives but it offers a considerably lower backhaul load with a negligible performance loss compared to full cell free approaches.


Beyond Model Extraction Imitation Attack for Black Box NLP APIs. Machine learning as a service (MLaaS) has attracted millions of users to their outperforming sophisticated models. Although published as black box APIs, the valuable models behind these services are still vulnerable to imitation attacks. Recently, a series of works have demonstrated that attackers manage to steal or extract the victim models. Nonetheless, none of the previous stolen models can outperform the original black box APIs. In this work, we take the first step of showing that attackers could potentially surpass victims via unsupervised domain adaptation and multi victim ensemble. Extensive experiments on benchmark datasets and real world APIs validate that the imitators can succeed in outperforming the original black box models. We consider this as a milestone in the research of imitation attack, especially on NLP APIs, as the superior performance could influence the defense or even publishing strategy of API providers.


PlaneTR Structure Guided Transformers for 3D Plane Recovery. This paper presents a neural network built upon Transformers, namely PlaneTR, to simultaneously detect and reconstruct planes from a single image. Different from previous methods, PlaneTR jointly leverages the context information and the geometric structures in a sequence to sequence way to holistically detect plane instances in one forward pass. Specifically, we represent the geometric structures as line segments and conduct the network with three main components (i) context and line segments encoders, (ii) a structure guided plane decoder, (iii) a pixel wise plane embedding decoder. Given an image and its detected line segments, PlaneTR generates the context and line segment sequences via two specially designed encoders and then feeds them into a Transformers based decoder to directly predict a sequence of plane instances by simultaneously considering the context and global structure cues. Finally, the pixel wise embeddings are computed to assign each pixel to one predicted plane instance which is nearest to it in embedding space. Comprehensive experiments demonstrate that PlaneTR achieves a state of the art performance on the ScanNet and NYUv2 datasets.


From Heatmaps to Structural Explanations of Image Classifiers. This paper summarizes our endeavors in the past few years in terms of explaining image classifiers, with the aim of including negative results and insights we have gained. The paper starts with describing the explainable neural network (XNN), which attempts to extract and visualize several high level concepts purely from the deep network, without relying on human linguistic concepts. This helps users understand network classifications that are less intuitive and substantially improves user performance on a difficult fine grained classification task of discriminating among different species of seagulls. Realizing that an important missing piece is a reliable heatmap visualization tool, we have developed I GOS and iGOS utilizing integrated gradients to avoid local optima in heatmap generation, which improved the performance across all resolutions. During the development of those visualizations, we realized that for a significant number of images, the classifier has multiple different paths to reach a confident prediction. This has lead to our recent development of structured attention graphs (SAGs), an approach that utilizes beam search to locate multiple coarse heatmaps for a single image, and compactly visualizes a set of heatmaps by capturing how different combinations of image regions impact the confidence of a classifier. Through the research process, we have learned much about insights in building deep network explanations, the existence and frequency of multiple explanations, and various tricks of the trade that make explanations work. In this paper, we attempt to share those insights and opinions with the readers with the hope that some of them will be informative for future researchers on explainable deep learning.


A Layer Wise Information Reinforcement Approach to Improve Learning in Deep Belief Networks. With the advent of deep learning, the number of works proposing new methods or improving existent ones has grown exponentially in the last years. In this scenario, "very deep" models were emerging, once they were expected to extract more intrinsic and abstract features while supporting a better performance. However, such models suffer from the gradient vanishing problem, i.e., backpropagation values become too close to zero in their shallower layers, ultimately causing learning to stagnate. Such an issue was overcome in the context of convolution neural networks by creating "shortcut connections" between layers, in a so called deep residual learning framework. Nonetheless, a very popular deep learning technique called Deep Belief Network still suffers from gradient vanishing when dealing with discriminative tasks. Therefore, this paper proposes the Residual Deep Belief Network, which considers the information reinforcement layer by layer to improve the feature extraction and knowledge retaining, that support better discriminative performance. Experiments conducted over three public datasets demonstrate its robustness concerning the task of binary image classification.


CNewSum A Large scale Chinese News Summarization Dataset with Human annotated Adequacy and Deducibility Level. Automatic text summarization aims to produce a brief but crucial summary for the input documents. Both extractive and abstractive methods have witnessed great success in English datasets in recent years. However, there has been a minimal exploration of text summarization in Chinese, limited by the lack of large scale datasets. In this paper, we present a large scale Chinese news summarization dataset CNewSum, which consists of 304,307 documents and human written summaries for the news feed. It has long documents with high abstractive summaries, which can encourage document level understanding and generation for current summarization models. An additional distinguishing feature of CNewSum is that its test set contains adequacy and deducibility annotations for the summaries. The adequacy level measures the degree of summary information covered by the document, and the deducibility indicates the reasoning ability the model needs to generate the summary. These annotations can help researchers analyze and target their model performance bottleneck. We examine recent methods on CNewSum and release our dataset to provide a solid testbed for automatic Chinese summarization research.


High Level Synthesis of Security Properties via Software Level Abstractions. High level synthesis (HLS) is a key component for the hardware acceleration of applications, especially thanks to the diffusion of reconfigurable devices in many domains, from data centers to edge devices. HLS reduces development times by allowing designers to raise the abstraction level and use automated methods for hardware generation. Since security concerns are becoming more and more relevant for data intensive applications, we investigate how to abstract security properties and use HLS for their integration with the accelerator functionality. We use the case of dynamic information flow tracking, showing how classic software level abstractions can be efficiently used to hide implementation details to the designers.


Machine Learning for User Partitioning and Phase Shifters Design in RIS Aided NOMA Networks. A novel reconfigurable intelligent surface (RIS) aided non orthogonal multiple access (NOMA) downlink transmission framework is proposed. We formulate a long term stochastic optimization problem that involves a joint optimization of NOMA user partitioning and RIS phase shifting, aiming at maximizing the sum data rate of the mobile users (MUs) in NOMA downlink networks. To solve the challenging joint optimization problem, we invoke a modified object migration automation (MOMA) algorithm to partition the users into equal size clusters. To optimize the RIS phase shifting matrix, we propose a deep deterministic policy gradient (DDPG) algorithm to collaboratively control multiple reflecting elements (REs) of the RIS. Different from conventional training then testing processing, we consider a long term self adjusting learning model where the intelligent agent is capable of learning the optimal action for every given state through exploration and exploitation. Extensive numerical results demonstrate that 1) The proposed RIS aided NOMA downlink framework achieves an enhanced sum data rate compared with the conventional orthogonal multiple access (OMA) framework. 2) The proposed DDPG algorithm is capable of learning a dynamic resource allocation policy in a long term manner. 3) The performance of the proposed RIS aided NOMA framework can be improved by increasing the granularity of the RIS phase shifts. The numerical results also show that reducing the granularity of the RIS phase shifts and increasing the number of REs are two efficient methods to improve the sum data rate of the MUs.


On the definition of higher Gamma functions. We generalize our previous new definition of Euler Gamma function to higher Gamma functions. With this unified approach, we characterize Barnes higher Gamma functions, Mellin Gamma functions, Barnes multiple Gamma functions, Jackson q Gamma function, and Nishizawa higher q Gamma functions. This approach extends to more general functional equations. This generalization reveals the multiplicative group structure of solutions of the functional equation that appears as a cocycle equation. We also generalize Barnes hierarchy of higher Gamma function and multiple Gamma functions. In this new approach, Barnes Hurwitz zeta functions are no longer required for the definition of Barnes multiple Gamma functions. This simplifies the classical definition, without the necessary analytic preliminaries about the meromorphic extension of Barnes Hurwitz zeta functions, and defines a larger class of Gamma functions. For some algebraic independence conditions on the parameters, we have uniqueness of the solutions, which implies the coincidence of our multiple Gamma functions with Barnes multiple Gamma functions.


Vanishing capillarity limit of the Navier Stokes Korteweg system in one dimension with degenerate viscosity coefficient and discontinuous initial density. In the first main result of this paper we prove that one can approximate discontinious solutions of the 1d Navier Stokes system with solutions of the 1d Navier Stokes Korteweg system as the capilarity parameter tends to 0. Moreover, we allow the viscosity coefficients mu mu ( rho ) to degenerate near vaccum. In order to obtain this result, we propose two main technical novelties. First of all, we provide an upper bound for the density verifing NSK that does not degenerate when the capillarity coefficient tends to 0. Second of all, we are able to show that the positive part of the effective velocity is bounded uniformly w.r.t. the capillary coefficient. This turns out to be crucial in providing a lower bound for the density. The second main result states the existene of unique finite energy global strong solutions for the 1d Navier Stokes system assuming only that rho 0, 1 rho 0 in L infty . This last result finds itself a natural application in the context of the mathematical modeling of multiphase flows.


PyMAF 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop. Regression based methods have recently shown promising results in reconstructing human meshes from monocular images. By directly mapping raw pixels to model parameters, these methods can produce parametric models in a feed forward manner via neural networks. However, minor deviation in parameters may lead to noticeable misalignment between the estimated meshes and image evidences. To address this issue, we propose a Pyramidal Mesh Alignment Feedback (PyMAF) loop to leverage a feature pyramid and rectify the predicted parameters explicitly based on the mesh image alignment status in our deep regressor. In PyMAF, given the currently predicted parameters, mesh aligned evidences will be extracted from finer resolution features accordingly and fed back for parameter rectification. To reduce noise and enhance the reliability of these evidences, an auxiliary pixel wise supervision is imposed on the feature encoder, which provides mesh image correspondence guidance for our network to preserve the most related information in spatial features. The efficacy of our approach is validated on several benchmarks, including Human3.6M, 3DPW, LSP, and COCO, where experimental results show that our approach consistently improves the mesh image alignment of the reconstruction. The project page with code and video results can be found at https hongwenzhang.github.io pymaf.


Discovery and Equilibrium in Games with Unawareness. Equilibrium notions for games with unawareness in the literature cannot be interpreted as steady states of a learning process because players may discover novel actions during play. In this sense, many games with unawareness are "self destroying" as a player's representation of the game may change after playing it once. We define discovery processes where at each state there is an extensive form game with unawareness that together with the players' play determines the transition to possibly another extensive form game with unawareness in which players are now aware of actions that they have discovered. A discovery process is rationalizable if players play extensive form rationalizable strategies in each game with unawareness. We show that for any game with unawareness there is a rationalizable discovery process that leads to a self confirming game that possesses a self confirming equilibrium in extensive form rationalizable conjectures. This notion of equilibrium can be interpreted as steady state of both a discovery and learning process.


Psycho linguistic differences among competing vaccination communities on social media. Currently, the significance of social media in disseminating noteworthy information on topics such as health, politics, and the economy is indisputable. During the COVID 19 pandemic, anti vaxxers use social media to distribute fake news and anxiety provoking information about the vaccine, which may harm the public. Here, we characterize the psycho linguistic features of anti vaxxers on the online social network Twitter. For this, we collected COVID 19 related tweets from February 2020 to June 2021 to analyse vaccination stance, linguistic features, and social network characteristics. Our results demonstrated that, compared to pro vaxxers, anti vaxxers tend to have more negative emotions, narrative thinking, and worse moral tendencies. This study can advance our understanding of the online anti vaccination movement, and become critical for social media management and policy action during and after the pandemic.


LIGS Learnable Intrinsic Reward Generation Selection for Multi Agent Learning. Efficient exploration is important for reinforcement learners to achieve high rewards. In multi agent systems, coordinated exploration and behaviour is critical for agents to jointly achieve optimal outcomes. In this paper, we introduce a new general framework for improving coordination and performance of multi agent reinforcement learners (MARL). Our framework, named Learnable Intrinsic Reward Generation Selection algorithm (LIGS) introduces an adaptive learner, Generator that observes the agents and learns to construct intrinsic rewards online that coordinate the agents' joint exploration and joint behaviour. Using a novel combination of MARL and switching controls, LIGS determines the best states to learn to add intrinsic rewards which leads to a highly efficient learning process. LIGS can subdivide complex tasks making them easier to solve and enables systems of MARL agents to quickly solve environments with sparse rewards. LIGS can seamlessly adopt existing MARL algorithms and, our theory shows that it ensures convergence to policies that deliver higher system performance. We demonstrate its superior performance in challenging tasks in Foraging and StarCraft II.


Near Optimal Distance Oracles for Vertex Labeled Planar Graphs. Given an undirected n vertex planar graph G (V,E, omega) with non negative edge weight function omega E rightarrow mathbb R and given an assigned label to each vertex, a vertex labeled distance oracle is a data structure which for any query consisting of a vertex u and a label lambda reports the shortest path distance from u to the nearest vertex with label lambda . We show that if there is a distance oracle for undirected n vertex planar graphs with non negative edge weights using s(n) space and with query time q(n) , then there is a vertex labeled distance oracle with tilde O (s(n)) space and tilde O (q(n)) query time. Using the state of the art distance oracle of Long and Pettie, our construction produces a vertex labeled distance oracle using n 1 o(1) space and query time tilde O(1) at one extreme, tilde O(n) space and n o(1) query time at the other extreme, as well as such oracles for the full tradeoff between space and query time obtained in their paper. This is the first non trivial exact vertex labeled distance oracle for planar graphs and, to our knowledge, for any interesting graph class other than trees.


Implicit Communication as Minimum Entropy Coupling. In many common payoff games, achieving good performance requires players to develop protocols for communicating their private information implicitly i.e., using actions that have non communicative effects on the environment. Multi agent reinforcement learning practitioners typically approach this problem using independent learning methods in the hope that agents will learn implicit communication as a byproduct of expected return maximization. Unfortunately, independent learning methods are incapable of doing this in many settings. In this work, we isolate the implicit communication problem by identifying a class of partially observable common payoff games, which we call implicit referential games, whose difficulty can be attributed to implicit communication. Next, we introduce a principled method based on minimum entropy coupling that leverages the structure of implicit referential games, yielding a new perspective on implicit communication. Lastly, we show that this method can discover performant implicit communication protocols in settings with very large spaces of messages.


Automated Recovery of Issue Commit Links Leveraging Both Textual and Non textual Data. An issue documents discussions around required changes in issue tracking systems, while a commit contains the change itself in the version control systems. Recovering links between issues and commits can facilitate many software evolution tasks such as bug localization, and software documentation. A previous study on over half a million issues from GitHub reports only about 42.2 of issues are manually linked by developers to their pertinent commits. Automating the linking of commit issue pairs can contribute to the improvement of the said tasks. By far, current state of the art approaches for automated commit issue linking suffer from low precision, leading to unreliable results, sometimes to the point that imposes human supervision on the predicted links. The low performance gets even more severe when there is a lack of textual information in either commits or issues. Current approaches are also proven computationally expensive. We propose Hybrid Linker to overcome such limitations by exploiting two information channels (1) a non textual based component that operates on non textual, automatically recorded information of the commit issue pairs to predict a link, and (2) a textual based one which does the same using textual information of the commit issue pairs. Then, combining the results from the two classifiers, Hybrid Linker makes the final prediction. Thus, every time one component falls short in predicting a link, the other component fills the gap and improves the results. We evaluate Hybrid Linker against competing approaches, namely FRLink and DeepLink on a dataset of 12 projects. Hybrid Linker achieves 90.1 , 87.8 , and 88.9 based on recall, precision, and F measure, respectively. It also outperforms FRLink and DeepLink by 31.3 , and 41.3 , regarding the F measure. Moreover, Hybrid Linker exhibits extensive improvements in terms of performance as well.


Analyzing movies to predict their commercial viability for producers. Upon film premiere, a major form of speculation concerns the relative success of the film. This relativity is in particular regards to the film's original budget, as many a time have big budget blockbusters been met with exceptional success as met with abject failure. So how does one predict the success of an upcoming film? In this paper, we explored a vast array of film data in an attempt to develop a model that could predict the expected return of an upcoming film. The approach to this development is as follows First, we began with the MovieLens dataset having common movie attributes along with genome tags per each film. Genome tags give insight into what particular characteristics of the film are most salient. We then included additional features regarding film content, cast crew, audience perception, budget, and earnings from TMDB, IMDB, and Metacritic websites. Next, we performed exploratory data analysis and engineered a wide range of new features capturing historical information for the available features. Thereafter, we used singular value decomposition (SVD) for dimensionality reduction of the high dimensional features (ex. genome tags). Finally, we built a Random Forest Classifier and performed hyper parameter tuning to optimize for model accuracy. A future application of our model could be seen in the film industry, allowing production companies to better predict the expected return of their projects based on their envisioned outline for their production procedure, thereby allowing them to revise their plan in an attempt to achieve optimal returns.


Semantic Parsing in Task Oriented Dialog with Recursive Insertion based Encoder. We introduce a Recursive INsertion based Encoder (RINE), a novel approach for semantic parsing in task oriented dialog. Our model consists of an encoder network that incrementally builds the semantic parse tree by predicting the non terminal label and its positions in the linearized tree. At the generation time, the model constructs the semantic parse tree by recursively inserting the predicted non terminal labels at the predicted positions until termination. RINE achieves state of the art exact match accuracy on low and high resource versions of the conversational semantic parsing benchmark TOP (Gupta et al., 2018 Chen et al., 2020), outperforming strong sequence to sequence models and transition based parsers. We also show that our model design is applicable to nested named entity recognition task, where it performs on par with state of the art approach designed for that task. Finally, we demonstrate that our approach is 2 3.5 times faster than the sequence to sequence model at inference time.


Fast Decoding of Union free Codes. Union free codes and disjunctive codes are two combinatorial structures, which are used in nonadaptive group testing to find a set of d defective elements among n samples by carrying out the minimal number of tests t . It is known that union free codes have a larger rate, whereas disjunctive codes provide a more efficient decoding algorithm. In this paper we introduce a new family of codes for nonadaptive group testing with fast decoding. The rate of these codes is larger than the rate of disjunctive codes, while the decoding algorithm has the same complexity. In addition, we derive a lower bound on the rate of new codes for the case of d 2 defectives, which is significantly better than the bound for disjunctive codes and almost as good as the bound for union free codes.


Laplace Beltrami based Multi Resolution Shape Reconstruction on Subdivision Surfaces. The eigenfunctions of the Laplace Beltrami operator have widespread applications in a number of disciplines of engineering, computer vision graphics, machine learning, etc. These eigenfunctions or manifold harmonics, provide the means to smoothly interpolate data on a manifold. They are highly effective, specifically as it relates to geometry representation and editing manifold harmonics form a natural basis for multi resolution representation (and editing) of complex surfaces and functioned defined therein. In this paper, we seek to develop the framework to exploit the benefits of manifold harmonics for shape reconstruction. To this end, we develop a highly compressible, multi resolution shape reconstruction scheme using manifold harmonics. The method relies on subdivision basis sets to construct both boundary element isogeometric methods for analysis and surface finite elements to construct manifold harmonics. We pair this technique with the volumetric source reconstruction method to determine an initial starting point. Examples presented highlight efficacy of the approach in the presence of noisy data, including significant reduction in the number of degrees of freedom for complex objects, the accuracy of reconstruction, and multi resolution capabilities.


Multistage onset of epidemics in heterogeneous networks. We develop a theory for the susceptible infected susceptible (SIS) epidemic model on networks that incorporate both network structure and dynamic correlations. This theory can account for the multistage onset of the epidemic phase in scale free networks. This phenomenon is characterized by multiple peaks in the susceptibility as a function of the infection rate. It can be explained by that, even under the global epidemic threshold, a hub can sustain the epidemics for an extended period. Moreover, our approach improves theoretical calculations of prevalence close to the threshold in heterogeneous networks and also can predict the average risk of infection for neighbors of nodes with different degree and state on uncorrelated static networks.


Convex cocompactness for Coxeter groups. We investigate representations of Coxeter groups into mathrm GL (n, mathbb R ) as geometric reflection groups which are convex cocompact in the projective space mathbb P ( mathbb R n) . We characterize which Coxeter groups admit such representations, and we fully describe the corresponding spaces of convex cocompact representations as reflection groups, in terms of the associated Cartan matrices. The Coxeter groups that appear include all infinite, word hyperbolic, irreducible Coxeter groups for such groups the representations as reflection groups that we describe are exactly the projective Anosov ones. We also obtain a large class of nonhyperbolic irreducible Coxeter groups, thus providing many examples for the theory of nonhyperbolic convex cocompact subgroups in mathbb P ( mathbb R n) developed in arXiv 1704.08711.


Chow rings of matroids are Koszul. Chow rings of matroids were instrumental in the resolution of the Heron Rota Welsh Conjecture by Adiprasito, Huh, and Katz and in the resolution of the Top Heavy Conjecture by Braden, Huh, Matherne, Proudfoot, and Wang. The Chow ring of a matroid is a commutative, graded, Artinian, Gorenstein algebra with linear and quadratic relations defined by the matroid. Dotsenko conjectured that the Chow ring of any matroid is Koszul. The purpose of this paper is to prove Dotsenko's conjecture. We also show that the augmented Chow ring of a matroid is Koszul. As a corollary, we show that the Chow rings and augmented Chow rings of matroids have rational Poincar ' e series.


Catacondensed Chemical Hexagonal Complexes A Natural Generalisation of Benzenoids. Catacondensed benzenoids (those benzenoids having no carbon atom belonging to three hexagonal rings) form the simplest class of polycyclic aromatic hydrocarbons (PAH). They have a long history of study and are of wide chemical importance. In this paper, mathematical possibilities for natural extension of the notion of a catacondensed benzenoid are discussed, leading under plausible chemically and physically motivated restrictions to the notion of a catacondensed chemical hexagonal complex (CCHC). A general polygonal complex is a topological structure composed of polygons that are glued together along certain edges. A polygonal complex is flat if none of its edges belong to more than two polygons. A connected flat polygonal complex determines an orientable or nonorientable surface, possibly with boundary. A CCHC is then a connected flat polygonal complex all of whose polygons are hexagons and each of whose vertices belongs to at most two hexagonal faces. We prove that all CCHC are Kekulean and give formulas for counting the perfect matchings in a series of examples based on expansion of cubic graphs in which the edges are replaced by linear polyacenes of equal length. As a preliminary assessment of the likely stability of molecules with CCHC structure, all electron quantum chemical calculations are applied to molecular structures based on several CCHC, using either linear or kinked unbranched catafused polyacenes as the expansion motif. The systems examined all have closed shells according to H "uckel theory and all correspond to minima on the potential surface, thus passing the most basic test for plausibility as a chemical species.


Dvoretzky type theorem for Ahlfors regular spaces. It is proved that for any 0 beta alpha , any bounded Ahlfors alpha regular space contains a beta regular compact subset that embeds biLipschitzly in an ultrametric with distortion at most O( alpha ( alpha beta)) . The bound on the distortion is asymptotically tight when beta to alpha . The main tool used in the proof is a regular form of the ultrametric skeleton theorem.


Stability in the Marcinkiewicz theorem. Ostrovskii's generalization of the Marcinkiewicz theorem implies that if an entire characteristic functions of a probability distribution satisfies log log f(z) o( z ), z to infty, and is zero free then the distribution is normal. We show that under the same growth condition, absence of zeros in a wide vertical strip implies that the distribution is close to a normal one. This generalizes and simplifies a recent result of Michelen and Sahasrabudhe.


Most probable transition paths in piecewise smooth stochastic differential equations. We develop a path integral framework for determining most probable paths in a class of systems of stochastic differential equations with piecewise smooth drift and additive noise. This approach extends the Freidlin Wentzell theory of large deviations to cases where the system is piecewise smooth and may be non autonomous. In particular, we consider an n dimensional system with a switching manifold in the drift that forms an (n 1) dimensional hyperplane and investigate noise induced transitions between metastable states on either side of the switching manifold. To do this, we mollify the drift and use Gamma convergence to derive an appropriate rate functional for the system in the piecewise smooth limit. The resulting functional consists of the standard Freidlin Wentzell rate functional, with an additional contribution due to times when the most probable path slides in a crossing region of the switching manifold. We explore implications of the derived functional through two case studies, which exhibit notable phenomena such as non unique most probable paths and noise induced sliding in a crossing region.


Neural dSCA demixing multimodal interaction among brain areas during naturalistic experiments. Multi regional interaction among neuronal populations underlies the brain's processing of rich sensory information in our daily lives. Recent neuroscience and neuroimaging studies have increasingly used naturalistic stimuli and experimental design to identify such realistic sensory computation in the brain. However, existing methods for cross areal interaction analysis with dimensionality reduction, such as reduced rank regression and canonical correlation analysis, have limited applicability and interpretability in naturalistic settings because they usually do not appropriately 'demix' neural interactions into those associated with different types of task parameters or stimulus features (e.g., visual or audio). In this paper, we develop a new method for cross areal interaction analysis that uses the rich task or stimulus parameters to reveal how and what types of information are shared by different neural populations. The proposed neural demixed shared component analysis combines existing dimensionality reduction methods with a practical neural network implementation of functional analysis of variance with latent variables, thereby efficiently demixing nonlinear effects of continuous and multimodal stimuli. We also propose a simplifying alternative under the assumptions of linear effects and unimodal stimuli. To demonstrate our methods, we analyzed two human neuroimaging datasets of participants watching naturalistic videos of movies and dance movements. The results demonstrate that our methods provide new insights into multi regional interaction in the brain during naturalistic sensory inputs, which cannot be captured by conventional techniques.


Construction of quasi canonical liftings of K3 surfaces of finite height in odd characteristic. We construct a quasi canonical lifting of a K3 surface of finite height over a finite field of characteristic p geq3 . Such results are previously obtained by Nygaard Ogus when p geq5 . For this purpose, we use the display theoretic deformation theory developed by Langer, Zink, and Lau. We study the display structure of the crystalline cohomology of deformations of a K3 surface of finite height in terms of the Dieudonn 'e display of the enlarged formal Brauer group.


Radar based Automotive Localization using Landmarks in a Multimodal Sensor Graph based Approach. Highly automated driving functions currently often rely on a priori knowledge from maps for planning and prediction in complex scenarios like cities. This makes map relative localization an essential skill. In this paper, we address the problem of localization with automotive grade radars, using a real time graph based SLAM approach. The system uses landmarks and odometry information as an abstraction layer. This way, besides radars, all kind of different sensor modalities including cameras and lidars can contribute. A single, semantic landmark map is used and maintained for all sensors. We implemented our approach using C and thoroughly tested it on data obtained with our test vehicles, comprising cars and trucks. Test scenarios include inner cities and industrial areas like container terminals. The experiments presented in this paper suggest that the approach is able to provide a precise and stable pose in structured environments, using radar data alone. The fusion of additional sensor information from cameras or lidars further boost performance, providing reliable semantic information needed for automated mapping.


Robust Adaptive Filtering Based on Exponential Functional Link Network. The exponential functional link network (EFLN) has been recently investigated and applied to nonlinear filtering. This brief proposes an adaptive EFLN filtering algorithm based on a novel inverse square root (ISR) cost function, called the EFLN ISR algorithm, whose learning capability is robust under impulsive interference. The steady state performance of EFLN ISR is rigorously derived and then confirmed by numerical simulations. Moreover, the validity of the proposed EFLN ISR algorithm is justified by the actually experimental results with the application to hysteretic nonlinear system identification.


GuidedMix Net Semi supervised Semantic Segmentation by Using Labeled Images as Reference. Semi supervised learning is a challenging problem which aims to construct a model by learning from limited labeled examples. Numerous methods for this task focus on utilizing the predictions of unlabeled instances consistency alone to regularize networks. However, treating labeled and unlabeled data separately often leads to the discarding of mass prior knowledge learned from the labeled examples. , and failure to mine the feature interaction between the labeled and unlabeled image pairs. In this paper, we propose a novel method for semi supervised semantic segmentation named GuidedMix Net, by leveraging labeled information to guide the learning of unlabeled instances. Specifically, GuidedMix Net employs three operations 1) interpolation of similar labeled unlabeled image pairs 2) transfer of mutual information 3) generalization of pseudo masks. It enables segmentation models can learning the higher quality pseudo masks of unlabeled data by transfer the knowledge from labeled samples to unlabeled data. Along with supervised learning for labeled data, the prediction of unlabeled data is jointly learned with the generated pseudo masks from the mixed data. Extensive experiments on PASCAL VOC 2012, and Cityscapes demonstrate the effectiveness of our GuidedMix Net, which achieves competitive segmentation accuracy and significantly improves the mIoU by 7 compared to previous approaches.


Wave encoding and Shuffling Enables Rapid Time Resolved Structural Imaging. T2 Shuffling reconstructs multiple sharp T2 weighted images from a single volumetric fast spin echo (3D FSE) scan. Wave CAIPI is a parallel imaging technique that achieves good reconstruction at high accelerations through additional sinusoidal gradients that induce a voxel spreading effect in the readout direction to better take advantage of coil sensitivity information. In this work, the Shuffling model in T2 Shuffling is augmented with wave encoding to achieve higher acceleration capability. The resulting "Wave Shuffling" approach is applied to 3D FSE and Magnetization Prepared Rapid Gradient Echo (MPRAGE) to achieve rapid, 1 mm isotropic resolution, time resolved structural imaging.


Time Aware Q Networks Resolving Temporal Irregularity for Deep Reinforcement Learning. Deep Reinforcement Learning (DRL) has shown outstanding performance on inducing effective action policies that maximize expected long term return on many complex tasks. Much of DRL work has been focused on sequences of events with discrete time steps and ignores the irregular time intervals between consecutive events. Given that in many real world domains, data often consists of temporal sequences with irregular time intervals, and it is important to consider the time intervals between temporal events to capture latent progressive patterns of states. In this work, we present a general Time Aware RL framework Time aware Q Networks (TQN), which takes into account physical time intervals within a deep RL framework. TQN deals with time irregularity from two aspects 1) elapsed time in the past and an expected next observation time for time aware state approximation, and 2) action time window for the future for time aware discounting of rewards. Experimental results show that by capturing the underlying structures in the sequences with time irregularities from both aspects, TQNs significantly outperform DQN in four types of contexts with irregular time intervals. More specifically, our results show that in classic RL tasks such as CartPole and MountainCar and Atari benchmark with randomly segmented time intervals, time aware discounting alone is more important while in the real world tasks such as nuclear reactor operation and septic patient treatment with intrinsic time intervals, both time aware state and time aware discounting are crucial. Moreover, to improve the agent's learning capacity, we explored three boosting methods Double networks, Dueling networks, and Prioritized Experience Replay, and our results show that for the two real world tasks, combining all three boosting methods with TQN is especially effective.


Doubly Contrastive Deep Clustering. Deep clustering successfully provides more effective features than conventional ones and thus becomes an important technique in current unsupervised learning. However, most deep clustering methods ignore the vital positive and negative pairs introduced by data augmentation and further the significance of contrastive learning, which leads to suboptimal performance. In this paper, we present a novel Doubly Contrastive Deep Clustering (DCDC) framework, which constructs contrastive loss over both sample and class views to obtain more discriminative features and competitive results. Specifically, for the sample view, we set the class distribution of the original sample and its augmented version as positive sample pairs and set one of the other augmented samples as negative sample pairs. After that, we can adopt the sample wise contrastive loss to pull positive sample pairs together and push negative sample pairs apart. Similarly, for the class view, we build the positive and negative pairs from the sample distribution of the class. In this way, two contrastive losses successfully constrain the clustering results of mini batch samples in both sample and class level. Extensive experimental results on six benchmark datasets demonstrate the superiority of our proposed model against state of the art methods. Particularly in the challenging dataset Tiny ImageNet, our method leads 5.6 against the latest comparison method. Our code will be available at url https github.com ZhiyuanDang DCDC .


Bias Variance Reduced Local SGD for Less Heterogeneous Federated Learning. Recently, local SGD has got much attention and been extensively studied in the distributed learning community to overcome the communication bottleneck problem. However, the superiority of local SGD to minibatch SGD only holds in quite limited situations. In this paper, we study a new local algorithm called Bias Variance Reduced Local SGD (BVR L SGD) for nonconvex distributed optimization. Algorithmically, our proposed bias and variance reduced local gradient estimator fully utilizes small second order heterogeneity of local objectives and suggests randomly picking up one of the local models instead of taking the average of them when workers are synchronized. Theoretically, under small heterogeneity of local objectives, we show that BVR L SGD achieves better communication complexity than both the previous non local and local methods under mild conditions, and particularly BVR L SGD is the first method that breaks the barrier of communication complexity Theta(1 varepsilon) for general nonconvex smooth objectives when the heterogeneity is small and the local computation budget is large. Numerical results are given to verify the theoretical findings and give empirical evidence of the superiority of our method.


Recurrent Sums and Partition Identities. Sums of the form sum N m q n cdots sum N 1 q N 2 a (m) N m cdots a (1) N 1 where the a (k) N k 's are same or distinct sequences appear quite often in mathematics. We will refer to them as recurrent sums. In this paper, we introduce a variety of formulas to help manipulate and work with this type of sums. We begin by developing variation formulas that allow the variation of a recurrent sum of order m to be expressed in terms of lower order recurrent sums. We then proceed to derive theorems (which we will call inversion formulas) which show how to interchange the order of summation in a multitude of ways. Later, we introduce a set of new partition identities in order to then prove a reduction theorem which permits the expression of a recurrent sum in terms of a combination of non recurrent sums. Finally, we apply this reduction theorem to a recurrent form of two famous types of sums The p series and the sum of powers.


The VMT LIB Language and Tools. We present VMT LIB, a language for the representation of verification problems of linear time temporal properties on infinite state symbolic transition systems. VMT LIB is an extension of the standard SMT LIB language for SMT solvers, developed with the goal of facilitating the interoperability and exchange of benchmark problems among different verification tools. Besides describing its syntax and semantics, we also present a set of open source tools to work with the language.


How Not to Protect Your IP An Industry Wide Break of IEEE 1735 Implementations. Modern hardware systems are composed of a variety of third party Intellectual Property (IP) cores to implement their overall functionality. Since hardware design is a globalized process involving various (untrusted) stakeholders, a secure management of the valuable IP between authors and users is inevitable to protect them from unauthorized access and modification. To this end, the widely adopted IEEE standard 1735 2014 was created to ensure confidentiality and integrity. In this paper, we outline structural weaknesses in IEEE 1735 that cannot be fixed with cryptographic solutions (given the contemporary hardware design process) and thus render the standard inherently insecure. We practically demonstrate the weaknesses by recovering the private keys of IEEE 1735 implementations from major Electronic Design Automation (EDA) tool vendors, namely Intel, Xilinx, Cadence, Siemens, Microsemi, and Lattice, while results on a seventh case study are withheld. As a consequence, we can decrypt, modify, and re encrypt all allegedly protected IP cores designed for the respective tools, thus leading to an industry wide break. As part of this analysis, we are the first to publicly disclose three RSA based white box schemes that are used in real world products and present cryptanalytical attacks for all of them, finally resulting in key recovery.


Spectral reciprocity for mathrm GL (n) and simultaneous non vanishing of central L values. We prove a reciprocity formula for the average of the product of Rankin Selberg L functions L(1 2, Pi times widetilde sigma )L(1 2, sigma times widetilde pi ) as sigma varies over automorphic representations of mathrm PGL (n) over a number field F , where Pi and pi are cuspidal automorphic representations of mathrm PGL (n 1) and mathrm PGL (n 1) over F , respectively. If F is totally real, and Pi and pi are tempered everywhere, we deduce simultaneous non vanishing of these L values for certain sequences of sigma with conductor tending to infinity in the level aspect and bearing certain local conditions.


The combinatorial game nofil played on Steiner Triple Systems. We introduce an impartial combinatorial game on Steiner triple systems called Nofil. Players move alternately, choosing points of the triple system. If a player is forced to fill a block on their turn, they lose. We explore the play of Nofil on all Steiner triple systems up to order 15 and a sampling for orders 19, 21, and 25. We determine the optimal strategies by computing the nim values for each game and its subgames. The game Nofil can be thought of in terms of play on a corresponding hypergraph. As game play progresses, the hypergraph shrinks and will eventually be equivalent to playing the game Node Kayles on an isomorphic graph. Node Kayles is well studied and understood. Motivated by this, we study which Node Kayles positions can be reached, i.e. embedded into a Steiner triple system. We prove necessary conditions and sufficient conditions for the existence of such graph embeddings and conclude that the complexity of determining the outcome of the game Nofil on Steiner triple systems is PSPACE complete.


A Theory of Heap for Constrained Horn Clauses (Extended Technical Report). Constrained Horn Clauses (CHCs) are an intermediate program representation that can be generated by several verification tools, and that can be processed and solved by a number of Horn solvers. One of the main challenges when using CHCs in verification is the encoding of heap allocated data structures such data structures are today either represented explicitly using the theory of arrays, or transformed away with the help of invariants or refinement types, defeating the purpose of CHCs as a representation that is language independent as well as agnostic of the algorithm implemented by the Horn solver. This paper presents an SMT LIB theory of heap tailored to CHCs, with the goal of enabling a standard interchange format for programs with heap data structures. We introduce the syntax of the theory of heap, define its semantics in terms of axioms and using a reduction to SMT LIB arrays and data types, and discuss its properties and outline possible extensions and future work.


Lipschitz Stability and Hadamard Directional Differentiability for Elliptic and Parabolic Obstacle Type Quasi Variational Inequalities. This paper is concerned with the sensitivity analysis of a class of parameterized fixed point problems that arise in the context of obstacle type quasi variational inequalities. We prove that, if the operators in the considered fixed point equation satisfy a positive superhomogeneity condition, then the maximal and minimal element of the solution set of the problem depend locally Lipschitz continuously on the involved parameters. We further show that, if certain concavity conditions hold, then the maximal solution mapping is Hadamard directionally differentiable and its directional derivatives are precisely the minimal solutions of suitably defined linearized fixed point equations. In contrast to prior results, our analysis requires neither a Dirichlet space structure, nor restrictive assumptions on the mapping behavior and regularity of the involved operators, nor sign conditions on the directions that are considered in the directional derivatives. Our approach further covers the elliptic and parabolic setting simultaneously and also yields Hadamard directional differentiability results in situations in which the solution set of the fixed point equation is a continuum and a characterization of directional derivatives via linearized auxiliary problems is provably impossible. To illustrate that our results can be used to study interesting problems arising in practice, we apply them to establish the Hadamard directional differentiability of the solution operator of a nonlinear elliptic quasi variational inequality, which emerges in impulse control and in which the obstacle mapping is obtained by taking essential infima over certain parts of the underlying domain, and of the solution mapping of a parabolic quasi variational inequality, which involves boundary controls and in which the state to obstacle relationship is described by a partial differential equation.


The boundary Harnack principle on optimal domains. We give a short and self contained proof of the Boundary Harnack inequality for a class of domains satisfying some geometric conditions given in terms of a state function that behaves as the distance function to the boundary, is subharmonic inside the domain and satisfies some suitable estimates on the measure of its level sets. We also discuss the applications of this result to some shape optimization and free boundary problems.


Well posedness of the Dean Kawasaki and the nonlinear Dawson Watanabe equation with correlated noise. In this paper we prove the well posedness of the generalized Dean Kawasaki equation driven by noise that is white in time and colored in space. The results treat diffusion coefficients that are only locally 1 2 H "older continuous, including the square root. This solves several open problems, including the well posedness of the Dean Kawasaki equation and the nonlinear Dawson Watanabe equation with correlated noise.


Reframing demand forecasting a two fold approach for lumpy and intermittent demand. Demand forecasting is a crucial component of demand management. While shortening the forecasting horizon allows for more recent data and less uncertainty, this frequently means lower data aggregation levels and a more significant data sparsity. Sparse demand data usually results in lumpy or intermittent demand patterns, which have sparse and irregular demand intervals. Usual statistical and machine learning models fail to provide good forecasts in such scenarios. Our research shows that competitive demand forecasts can be obtained through two models predicting the demand occurrence and estimating the demand size. We analyze the usage of local and global machine learning models for both cases and compare results against baseline methods. Finally, we propose a novel evaluation criterion of lumpy and intermittent demand forecasting models' performance. Our research shows that global classification models are the best choice when predicting demand event occurrence. When predicting demand sizes, we achieved the best results using Simple Exponential Smoothing forecast. We tested our approach on real world data consisting of 516 three year long time series corresponding to European automotive original equipment manufacturers' daily demand.


On Negative Dependence Properties of Latin Hypercube Samples and Scrambled Nets. We study the notion of gamma negative dependence of random variables. This notion is a relaxation of the notion of negative orthant dependence (which corresponds to 1 negative dependence), but nevertheless it still ensures concentration of measure and allows to use large deviation bounds of Chernoff Hoeffding or Bernstein type. We study random variables based on random points P . These random variables appear naturally in the analysis of the discrepancy of P or, equivalently, of a suitable worst case integration error of the quasi Monte Carlo cubature that uses the points in P as integration nodes. We introduce the correlation number, which is the smallest possible value of gamma that ensures gamma negative dependence. We prove that the random variables of interest based on Latin hypercube sampling or on (t,m,d) nets do, in general, not have a correlation number of 1 , i.e., they are not negative orthant dependent. But it is known that the random variables based on Latin hypercube sampling in dimension d are actually gamma negatively dependent with gamma le e d , and the resulting probabilistic discrepancy bounds do only mildly depend on the gamma value.


Personal information self management A survey of technologies supporting administrative services. This paper presents a survey of technologies for personal data self management interfacing with administrative and territorial public service providers. It classifies a selection of scientific technologies into four categories of solutions Personal Data Store (PDS), Identity Manager (IdM), Anonymous Certificate System and Access Control Delegation Architecture. Each category, along with its technological approach, is analyzed thanks to eighteen identified functional criteria that encompass architectural and communication aspects, as well as user data lifecycle considerations. The originality of the survey is multifold. First, as far as we know, there is no such thorough survey covering such a panel of a dozen of existing solutions. Second, it is the first survey addressing Personally Identifiable Information (PII) management for both administrative and private service providers. Third, this paper achieves a functional comparison of solutions of very different technical natures. The outcome of this paper is the clear identification of functional gaps of each solution. As a result, this paper establishes the research directions to follow in order to fill these functional gaps.


Efficient Learning of a Linear Dynamical System with Stability Guarantees. We propose a principled method for projecting an arbitrary square matrix to the non convex set of asymptotically stable matrices. Leveraging ideas from large deviations theory, we show that this projection is optimal in an information theoretic sense and that it simply amounts to shifting the initial matrix by an optimal linear quadratic feedback gain, which can be computed exactly and highly efficiently by solving a standard linear quadratic regulator problem. The proposed approach allows us to learn the system matrix of a stable linear dynamical system from a single trajectory of correlated state observations. The resulting estimator is guaranteed to be stable and offers explicit statistical bounds on the estimation error.


Fluctuations of Subgraph Counts in Graphon Based Random Graphs. Given a graphon W and a finite simple graph H , with vertex set V(H) , denote by X n(H, W) the number of copies of H in a W random graph on n vertices. The asymptotic distribution of X n(H, W) was recently obtained by Hladk 'y, Pelekis, and v S ileikis (2021) in the case where H is a clique. In this paper, we extend this result to any fixed graph H . Towards this we introduce a notion of H regularity of graphons and show that if the graphon W is not H regular, then X n(H, W) has Gaussian fluctuations with scaling n V(H) frac 1 2 . On the other hand, if W is H regular, then the fluctuations are of order n V(H) 1 and the limiting distribution of X n(H, W) can have both Gaussian and non Gaussian components, where the non Gaussian component is a (possibly) infinite weighted sum of centered chi squared random variables with the weights determined by the spectral properties of a graphon derived from W . Our proofs use the asymptotic theory of generalized U statistics developed by Janson and Nowicki (1991). We also investigate the structure of H regular graphons for which either the Gaussian or the non Gaussian component of the limiting distribution (but not both) is degenerate. Interestingly, there are also H regular graphons W for which both the Gaussian or the non Gaussian components are degenerate, that is, X n(H, W) has a degenerate limit even under the scaling n V(H) 1 . We give an example of this degeneracy with H K 1, 3 (the 3 star) and also establish non degeneracy in a few examples. This naturally leads to interesting open questions on higher order degeneracies.


New binary self dual codes of lengths 56, 62, 78, 92 and 94 from a bordered construction. In this paper, we present a new bordered construction for self dual codes which employs lambda circulant matrices. We give the necessary conditions for our construction to produce self dual codes over a finite commutative Frobenius ring of characteristic 2. Moreover, using our bordered construction together with the well known building up and neighbour methods, we construct many binary self dual codes of lengths 56, 62, 78, 92 and 94 with parameters in their weight enumerators that were not known in the literature before.


Weak amenability of free products of hyperbolic and amenable groups. We show that, if G is an amenable group and H is a hyperbolic group, then the free product G ast H is weakly amenable. A key ingredient in the proof is the fact that G ast H is orbit equivalent to mathbb Z ast H .


Neural Population Geometry Reveals the Role of Stochasticity in Robust Perception. Adversarial examples are often cited by neuroscientists and machine learning researchers as an example of how computational models diverge from biological sensory systems. Recent work has proposed adding biologically inspired components to visual neural networks as a way to improve their adversarial robustness. One surprisingly effective component for reducing adversarial vulnerability is response stochasticity, like that exhibited by biological neurons. Here, using recently developed geometrical techniques from computational neuroscience, we investigate how adversarial perturbations influence the internal representations of standard, adversarially trained, and biologically inspired stochastic networks. We find distinct geometric signatures for each type of network, revealing different mechanisms for achieving robust representations. Next, we generalize these results to the auditory domain, showing that neural stochasticity also makes auditory models more robust to adversarial perturbations. Geometric analysis of the stochastic networks reveals overlap between representations of clean and adversarially perturbed stimuli, and quantitatively demonstrates that competing geometric effects of stochasticity mediate a tradeoff between adversarial and clean performance. Our results shed light on the strategies of robust perception utilized by adversarially trained and stochastic networks, and help explain how stochasticity may be beneficial to machine and biological computation.


A Reinforcement Learning Approach for Re allocating Drone Swarm Services. We propose a novel framework for the re allocation of drone swarms for delivery services known as Swarm based Drone as a Service (SDaaS). The re allocation framework ensures maximum profit to drone swarm providers while meeting the time requirement of service consumers. The constraints in the delivery environment (e.g., limited recharging pads) are taken into consideration. We utilize reinforcement learning (RL) to select the best allocation and scheduling of drone swarms given a set of requests from multiple consumers. We conduct a set of experiments to evaluate and compare the efficiency of the proposed approach considering the provider's profit and run time efficiency.


Fermi level equilibration at the metal molecule interface in plasmonic systems. We highlight a new metal molecule charge transfer process by tuning the Fermi energy of plasmonic silver nanoparticles (AgNPs) in situ. The strong adsorption of halide ions upshifts the Fermi level of AgNPs by up to 0.3 eV in the order Cl Br I , favoring the spontaneous charge transfer to aligned molecular acceptor orbitals until charge neutrality across the interface is achieved. By carefully quantifying experimentally and theoretically the Fermi level upshift, we show for the first time that this effect is comparable in energy to different plasmonic effects such as the plasmoelectric effect or hot carriers production. Moreover, by monitoring in situ the adsorption dynamic of halide ions in different AgNP molecule systems, we show for the first time that the catalytic role of halide ions in plasmonic nanostructures depends on the surface affinity of halide ions compared to that of the target molecule.


The growing topology of the C. elegans connectome. Probing the developing neural circuitry in Caenorhabditis elegans has enhanced our understanding of nervous systems. The C. elegans connectome, like those of other species, is characterized by a rich club of densely connected neurons embedded within a small world architecture. This organization of neuronal connections, captured by quantitative network statistics, provides insight into the system's capacity to perform integrative computations. Yet these network measures are limited in their ability to detect weakly connected motifs, such as topological cavities, that may support the systems capacity to perform segregated computations. We address this limitation by using persistent homology to track the evolution of topological cavities in the growing C. elegans connectome throughout neural development, and assess the degree to which the growing connectomes topology is resistant to biological noise. We show that the developing connectome topology is both relatively robust to changes in neuron birth times and not captured by similar growth models. Additionally, we quantify the consequence of a neurons specific birth time and ask if this metric tracks other biological properties of neurons. Our results suggest that the connectomes growing topology is a robust feature of the developing connectome that is distinct from other network properties, and that the growing topology is particularly sensitive to the exact birth times of a small set of predominantly motor neurons. By utilizing novel measurements that track biological features, we anticipate that our study will be helpful in the construction of more accurate models of neuronal development in C. elegans


Efficient simulation of non classical liquid vapour phase transition flows a method of fundamental solutions. Classical continuum based liquid vapour phase change models typically assume continuity of temperature at phase interfaces along with a relation which describes the rate of evaporation at the interface (Hertz Knudsen Schrage, for example). However, for phase transitions processes at small scales, such as the evaporation of nanodroplets, the assumption that the temperature is continuous across the liquid vapour interface leads to significant inaccuracies (McGaughey Ward 2002 Rana et al. 2019), as may the adoption of classical constitutive relations that lead to the Navier Stokes Fourier equations (NSF). In this article, to capture the notable effects of rarefaction at small scales, we adopt an extended continuum based approach utilizing the coupled constitutive relations (CCR). In CCR theory, additional terms are invoked in the constitutive relations of NSF equations originating from the arguments of irreversible thermodynamics as well as consistent with kinetic theory of gases. The modelling approach allows us to derive new fundamental solutions for the linearised CCR model and to develop a numerical framework based upon the method of fundamental solutions (MFS) and enables threedimensional multiphase micro flow simulations to be performed at remarkably low computational cost. The new framework is benchmarked against classical results and then explored as an efficient tool for solving three dimensional phase change events involving droplets.


Perspective The dusty plasma experiments a learning tool for physics graduate students. The plasma is an ionized gas that responses collectively to any external (or internal) perturbations. Introducing micron sized solid dust grains into plasma makes it more interesting. The solid grains acquire large negative charges on their surface and exhibits collective behavior similar to the ambient plasma medium. Some remarkable features of the charged dust grain medium (dusty plasma) allow us to use it as a model system to understand some complex phenomena at a microscopic level. In this perspective paper, the author highlights the role of dusty plasma experiments as a learning tool at undergraduate and post graduate physics programs. The students could have great opportunities to understand some basic physical phenomena as well as to learn many advanced data analysis tools and techniques by performing dusty plasma experiments. How a single dusty plasma experimental device at a physics laboratory can help undergraduate and post graduate students in the learning process is discussed.


Episome partitioning and symmetric cell divisions quantifying the role of random events in the persistence of HPV infections. Human Papillomaviruses (HPV) are one of the most prevalent sexually transmitted infections (STI) and the most oncogenic viruses known to humans. The vast majority of HPV infections clear in less than 3 years, but the underlying mechanisms, especially the involvement of the immune response, are still poorly known. Building on earlier work stressing the potential importance of stochasticity in HPV infection clearance, we develop a stochastic mathematical model of HPV dynamics with an explicit description of the intracellular level. We show that the random partitioning of virus episomes upon stem cell division and the occurrence of symmetric divisions greatly affect viral persistence. These results call for more detailed within host studies to better understand the relative importance of stochasticity and immunity in HPV infection clearance.