OTTR Off Road Trajectory Tracking using Reinforcement Learning. In this work, we present a novel Reinforcement Learning (RL) algorithm for the off road trajectory tracking problem. Off road environments involve varying terrain types and elevations, and it is difficult to model the interaction dynamics of specific off road vehicles with such a diverse and complex environment. Standard RL policies trained on a simulator will fail to operate in such challenging real world settings. Instead of using a naive domain randomization approach, we propose an innovative supervised learning based approach for overcoming the sim to real gap problem. Our approach efficiently exploits the limited real world data available to adapt the baseline RL policy obtained using a simple kinematics simulator. This avoids the need for modeling the diverse and complex interaction of the vehicle with off road environments. We evaluate the performance of the proposed algorithm using two different off road vehicles, Warthog and Moose. Compared to the standard ILQR approach, our proposed approach achieves a 30 and 50 reduction in cross track error in Warthog and Moose, respectively, by utilizing only 30 minutes of real world driving data.


A simulation framework for the design of a station based bike sharing system. Many cities and towns offer nowadays to citizens a bike sharing system (BSS). When a company starts the service, several decisions have to be taken on the location and size of the rental stations, and the number of vehicles to use to re balance the bikes in the stations, in addition to the cost and policies for the payment of the service. Also, when the service is in place, it is often necessary to modify it, in many cases to expand it. In this paper, starting from the experience gained in a real case application, we present a simulation framework to support the tactical decisions in the design or revision of a BSS. We will also present the application of the framework to the case of Bicimia in Brescia, Italy.


Absence of mixing for interval translation mappings and some generalizations. We consider piecewise monotone maps, we show that an ergodic measure for which the map is invertible almost everywhere can not be mixing. It follows that every ergodic measure for an interval translation mapping is not mixing. We also show that double rotations without periodic points have an ergodic but not weakly mixing invariant measure. This article is dedicated to the memory of Anatoly Mikhailovich Stepin.


Efficient Computation of Spatially Discrete Traveling Wave Modulated Structures. Traveling wave modulation is a form of space time modulation which has been shown to enable unique electromagnetic phenomena such as non reciprocity, beam steering, frequency conversion, and amplification. In practice, traveling wave modulation is achieved by applying a staggered time modulation signal to a spatially discrete array of unit cells. Therefore, the capability to accurately simulate spatially discrete traveling wave modulated structures is critical to design. However, simulating these structures is challenging due to the complex space time dependence of the constituent unit cells. In this paper, a field relation (referred to as the interpath relation) is derived for spatially discrete traveling wave modulated structures. The interpath relation reveals that the field within a single time modulated unit cell (rather than an entire spatial period) is sufficient to determine the field solution throughout space. It will be shown that the interpath relation can be incorporated into existing periodic method of moments solvers simply by modifying the source basis functions. As a result, the computational domain is reduced from an entire spatial period to a single time modulated unit cell, dramatically reducing the number of unknowns. In the context of traveling wave modulation, this enables researchers to efficiently simulate both complex structures with patterned unit cells in addition to continuous structures with infinitesimal unit cells.


A unified interpretation of the Gaussian mechanism for differential privacy through the sensitivity index. The Gaussian mechanism (GM) represents a universally employed tool for achieving differential privacy (DP), and a large body of work has been devoted to its analysis. We argue that the three prevailing interpretations of the GM, namely ( varepsilon, delta) DP, f DP and R 'enyi DP can be expressed by using a single parameter psi , which we term the sensitivity index. psi uniquely characterises the GM and its properties by encapsulating its two fundamental quantities the sensitivity of the query and the magnitude of the noise perturbation. With strong links to the ROC curve and the hypothesis testing interpretation of DP, psi offers the practitioner a powerful method for interpreting, comparing and communicating the privacy guarantees of Gaussian mechanisms.


Learning Multi Granular Spatio Temporal Graph Network for Skeleton based Action Recognition. The task of skeleton based action recognition remains a core challenge in human centred scene understanding due to the multiple granularities and large variation in human motion. Existing approaches typically employ a single neural representation for different motion patterns, which has difficulty in capturing fine grained action classes given limited training data. To address the aforementioned problems, we propose a novel multi granular spatio temporal graph network for skeleton based action classification that jointly models the coarse and fine grained skeleton motion patterns. To this end, we develop a dual head graph network consisting of two interleaved branches, which enables us to extract features at two spatio temporal resolutions in an effective and efficient manner. Moreover, our network utilises a cross head communication strategy to mutually enhance the representations of both heads. We conducted extensive experiments on three large scale datasets, namely NTU RGB D 60, NTU RGB D 120, and Kinetics Skeleton, and achieves the state of the art performance on all the benchmarks, which validates the effectiveness of our method.


A step towards a reinforcement learning de novo genome assembler. The use of reinforcement learning has proven to be very promising for solving complex activities without human supervision during their learning process. However, their successful applications are predominantly focused on fictional and entertainment problems such as games. Based on the above, this work aims to shed light on the application of reinforcement learning to solve this relevant real world problem, the genome assembly. By expanding the only approach found in the literature that addresses this problem, we carefully explored the aspects of intelligent agent learning, performed by the Q learning algorithm, to understand its suitability to be applied in scenarios whose characteristics are more similar to those faced by real genome projects. The improvements proposed here include changing the previously proposed reward system and including state space exploration optimization strategies based on dynamic pruning and mutual collaboration with evolutionary computing. These investigations were tried on 23 new environments with larger inputs than those used previously. All these environments are freely available on the internet for the evolution of this research by the scientific community. The results suggest consistent performance progress using the proposed improvements, however, they also demonstrate the limitations of them, especially related to the high dimensionality of state and action spaces. We also present, later, the paths that can be traced to tackle genome assembly efficiently in real scenarios considering recent, successfully reinforcement learning applications including deep reinforcement learning from other domains dealing with high dimensional inputs.


Label Ranking through Nonparametric Regression. Label Ranking (LR) corresponds to the problem of learning a hypothesis that maps features to rankings over a finite set of labels. We adopt a nonparametric regression approach to LR and obtain theoretical performance guarantees for this fundamental practical problem. We introduce a generative model for Label Ranking, in noiseless and noisy nonparametric regression settings, and provide sample complexity bounds for learning algorithms in both cases. In the noiseless setting, we study the LR problem with full rankings and provide computationally efficient algorithms using decision trees and random forests in the high dimensional regime. In the noisy setting, we consider the more general cases of LR with incomplete and partial rankings from a statistical viewpoint and obtain sample complexity bounds using the One Versus One approach of multiclass classification. Finally, we complement our theoretical contributions with experiments, aiming to understand how the input regression noise affects the observed output.


Understanding surrogate explanations the interplay between complexity, fidelity and coverage. This paper analyses the fundamental ingredients behind surrogate explanations to provide a better understanding of their inner workings. We start our exposition by considering global surrogates, describing the trade off between complexity of the surrogate and fidelity to the black box being modelled. We show that transitioning from global to local reducing coverage allows for more favourable conditions on the Pareto frontier of fidelity complexity of a surrogate. We discuss the interplay between complexity, fidelity and coverage, and consider how different user needs can lead to problem formulations where these are either constraints or penalties. We also present experiments that demonstrate how the local surrogate interpretability procedure can be made interactive and lead to better explanations.


Time series analysis with dynamic law exploration. In this paper we examine, how the dynamic laws governing the time evolution of a time series can be identified. We give a finite difference equation as well as a differential equation representation for that. We also study, how the required symmetries, like time reversal can be imposed on the laws. We study the compression performance of linear laws on sound data.


Faraday rotation study of plasma bubbles in GeV wakefield accelerators. We visualize plasma bubbles driven by 0.67 PW laser pulses in plasma of density n e approx 5 times10 17 rm cm 3 by imaging Faraday rotation patterns imprinted on linearly polarized probe pulses of wavelength lambda pr 1.05 mu m and duration tau pr 2 ps or 1 ps that cross the bubble's path at right angles. When the bubble captures and accelerates tens to hundreds of pC of electron charge, we observe two parallel streaks of length c tau pr straddling the drive pulse propagation axis, separated by sim45 mu m, in which probe polarization rotates by 0.3 circ to more than 5 circ in opposite directions. Accompanying simulations show that they result from Faraday rotation within portions of dense bubble side walls that are pervaded by the azimuthal magnetic field of accelerating electrons during the probe transit across the bubble. Analysis of the width of the streaks shows that quasi monoenergetic high energy electrons and trailing lower energy electrons inside the bubble contribute distinguishable portions of the observed signals, and that relativistic flow of sheath electrons suppresses Faraday rotation from the rear of the bubble. The results demonstrate favorable scaling of Faraday rotation diagnostics to 40 times lower plasma density than previously demonstrated.


Detecting Cross Geographic Biases in Toxicity Modeling on Social Media. Online social media platforms increasingly rely on Natural Language Processing (NLP) techniques to detect abusive content at scale in order to mitigate the harms it causes to their users. However, these techniques suffer from various sampling and association biases present in training data, often resulting in sub par performance on content relevant to marginalized groups, potentially furthering disproportionate harms towards them. Studies on such biases so far have focused on only a handful of axes of disparities and subgroups that have annotations lexicons available. Consequently, biases concerning non Western contexts are largely ignored in the literature. In this paper, we introduce a weakly supervised method to robustly detect lexical biases in broader geocultural contexts. Through a case study on a publicly available toxicity detection model, we demonstrate that our method identifies salient groups of cross geographic errors, and, in a follow up, demonstrate that these groupings reflect human judgments of offensive and inoffensive language in those geographic contexts. We also conduct analysis of a model trained on a dataset with ground truth labels to better understand these biases, and present preliminary mitigation experiments.


A Safety and Passivity Filter for Robot Teleoperation Systems. In this paper, we present a way of enforcing safety and passivity properties of robot teleoperation systems, where a human operator interacts with a dynamical system modeling the robot. The approach does so in a holistic fashion, by combining safety and passivity constraints in a single optimization based controller which effectively filters the desired control input before supplying it to the system. The result is a safety and passivity filter implemented as a convex quadratic program which can be solved efficiently and employed in an online fashion in many robotic teleoperation applications. Simulation results show the benefits of the approach developed in this paper applied to the human teleoperation of a second order dynamical system.


Learning Topology from Synthetic Data for Unsupervised Depth Completion. We present a method for inferring dense depth maps from images and sparse depth measurements by leveraging synthetic data to learn the association of sparse point clouds with dense natural shapes, and using the image as evidence to validate the predicted depth map. Our learned prior for natural shapes uses only sparse depth as input, not images, so the method is not affected by the covariate shift when attempting to transfer learned models from synthetic data to real ones. This allows us to use abundant synthetic data with ground truth to learn the most difficult component of the reconstruction process, which is topology estimation, and use the image to refine the prediction based on photometric evidence. Our approach uses fewer parameters than previous methods, yet, achieves the state of the art on both indoor and outdoor benchmark datasets. Code available at https github.com alexklwong learning topology synthetic data.


Heat and mass transfer during a sudden loss of vacuum in a liquid helium cooled tube Part III. A sudden loss of vacuum can be catastrophic for particle accelerators. In such an event, air leaks into the liquid helium cooled accelerator beamline tube and condenses on its inner surface, causing rapid boiling of the helium and dangerous pressure build up. Understanding the coupled heat and mass transfer processes is important for the design of beamline cryogenic systems. Our past experimental study on nitrogen gas propagating in a copper tube cooled by normal liquid helium (He I) has revealed a nearly exponential slowing down of the gas front. A theoretical model that accounts for the interplay of the gas dynamics and the condensation was developed, which successfully reproduced various key observations. However, since many accelerator beamlines are actually cooled by the superfluid phase of helium (He II) in which the heat transfer is via a non classical thermal counterflow mode, we need to extend our work to the He II cooled tube. This paper reports our systematic measurements using He II and the numerical simulations based on a modified model that accounts for the He II heat transfer characteristics. By tuning the He II peak heat flux parameter in our model, we have reproduced the observed gas dynamics in all experimental runs. The fine tuned model is then utilized to reliably evaluate the heat deposition in He II. This work not only advances our understanding of condensing gas dynamics but also has practical implications to the design codes for beamline safety.


An optimal partition problem for the localization of eigenfunctions. We study the minimizers of a functional on the set of partitions of a domain Omega subset R n into N subsets W j of locally finite perimeter in Omega , whose main term is sum j 1 N int Omega cap partial W j a(x) dH n 1 (x) . Here the positive bounded function a may for instance be related to the Landscape function of some Schr "o dinger operator. We prove the existence of minimizers through the equivalence with a weak formulation, and the local Ahlfors regularity and uniform rectifiability of the boundaries Omega cap partial W j .


Towards a Federated Learning Framework for Heterogeneous Devices of Internet of Things. Federated Learning (FL) has received a significant amount of attention in the industry and research community due to its capability of keeping data on local devices. To aggregate the gradients of local models to train the global model, existing works require that the global model and the local models are the same. However, Internet of Things (IoT) devices are inherently diverse regarding computation speed and onboard memory. In this paper, we propose an FL framework targeting the heterogeneity of IoT devices. Specifically, local models are compressed from the global model, and the gradients of the compressed local models are used to update the global model. We conduct preliminary experiments to illustrate that our framework can facilitate the design of IoT aware FL.


Gluing n tilting and n cotilting subcategories. Recently, Wang, Wei and Zhang define the recollement of extriangulated categories, which is a generalization of both recollement of abelian categories and recollement of triangulated categories. For a recollement ( mathcal A , mathcal B, mathcal C) of extriangulated categories, we show that n tilting (resp. n cotilting) subcategories in mathcal A and mathcal C can be glued to get n tilting (resp. n cotilting) subcategories in mathcal B under certain conditions.


A Survey on Limitation, Security and Privacy Issues on Additive Manufacturing. Additive manufacturing (AM) is growing as fast as anyone can imagine, and it is now a multi billion dollar industry. AM becomes popular in a variety of sectors, such as automotive, aerospace, biomedical, and pharmaceutical, for producing parts components subsystems. However, current AM technologies can face vast risks of security issues and privacy loss. For the security of AM process, many researchers are working on the defense mechanism to countermeasure such security concerns and finding efficient ways to eliminate those risks. Researchers have also been conducting experiments to establish a secure framework for the user's privacy and security components. This survey consists of four sections. In the first section, we will explore the relevant limitations of additive manufacturing in terms of printing capability, security, and possible solutions. The second section will present different kinds of attacks on AM and their effects. The next part will analyze and discuss the mechanisms and frameworks for access control and authentication for AM devices. The final section examines the security issues in various industrial sectors and provides the observations on the security of the additive manufacturing process.


Presenting an extensive lab and field image dataset of crops and weeds for computer vision tasks in agriculture. We present two large datasets of labelled plant images that are suited towards the training of machine learning and computer vision models. The first dataset encompasses as the day of writing over 1.2 million images of indoor grown crops and weeds common to the Canadian Prairies and many US states. The second dataset consists of over 540,000 images of plants imaged in farmland. All indoor plant images are labelled by species and we provide rich etadata on the level of individual images. This comprehensive database allows to filter the datasets under user defined specifications such as for example the crop type or the age of the plant. Furthermore, the indoor dataset contains images of plants taken from a wide variety of angles, including profile shots, top down shots, and angled perspectives. The images taken from plants in fields are all from a top down perspective and contain usually multiple plants per image. For these images metadata is also available. In this paper we describe both datasets' characteristics with respect to plant variety, plant age, and number of images. We further introduce an open access sample of the indoor dataset that contains 1,000 images of each species covered in our dataset. These, in total 14,000 images, had been selected, such that they form a representative sample with respect to plant age and ndividual plants per species. This sample serves as a quick entry point for new users to the dataset, allowing them to explore the data on a small scale and find the parameters of data most useful for their application without having to deal with hundreds of thousands of individual images.


Weighted estimates for generalized Riesz potentials. We obtain H p w L q w q p estimates for certain fractional operators.


Weighted and shifted BDF2 methods on variable grids. Variable steps implicit explicit multistep methods for PDEs have been presented in 17 , where the zero stability is studied for ODEs however, the stability analysis still remains an open question for PDEs. Based on the idea of linear multistep methods, we present a simple weighted and shifted BDF2 methods with variable steps for the parabolic problems, which serve as a bridge between BDF2 and Crank Nicolson scheme. The contributions of this paper are as follows we first prove that the optimal adjacent time step ratios for the weighted and shifted BDF2, which greatly improve the maximum time step ratios for BDF2 in 11,15 . Moreover, the unconditional stability and optimal convergence are rigorous proved, which make up for the vacancy of the theory for PDEs in 17 . Finally, numerical experiments are given to illustrate theoretical results.


Representation Learning by Ranking under multiple tasks. In recent years, representation learning has become the research focus of the machine learning community. Large scale pre training neural networks have become the first step to realize general intelligence. The key to the success of neural networks lies in their abstract representation capabilities for data. Several learning fields are actually discussing how to learn representations and there lacks a unified perspective. We convert the representation learning problem under multiple tasks into a ranking problem, taking the ranking problem as a unified perspective, the representation learning under different tasks is solved by optimizing the approximate NDCG loss. Experiments under different learning tasks like classification, retrieval, multi label learning, regression, self supervised learning prove the superiority of approximate NDCG loss. Further, under the self supervised learning task, the training data is transformed by data augmentation method to improve the performance of the approximate NDCG loss, which proves that the approximate NDCG loss can make full use of the information of the unsupervised training data.


El Volumen Louder Por Favor Code switching in Task oriented Semantic Parsing. Being able to parse code switched (CS) utterances, such as Spanish English or Hindi English, is essential to democratize task oriented semantic parsing systems for certain locales. In this work, we focus on Spanglish (Spanish English) and release a dataset, CSTOP, containing 5800 CS utterances alongside their semantic parses. We examine the CS generalizability of various Cross lingual (XL) models and exhibit the advantage of pre trained XL language models when data for only one language is present. As such, we focus on improving the pre trained models for the case when only English corpus alongside either zero or a few CS training instances are available. We propose two data augmentation methods for the zero shot and the few shot settings fine tune using translate and align and augment using a generation model followed by match and filter. Combining the few shot setting with the above improvements decreases the initial 30 point accuracy gap between the zero shot and the full data settings by two thirds.


Thin films of diblock copolymers existence and two dimensional regularity of minimizing configurations. We introduce a variational model for the study of thin films of diblock copolymers. We establish existence of minimizing configurations via relaxation of the energy involved. Moreover, we prove partial regularity results for mass constrained minimizers in two space dimensions. To show this last result, we develop a two dimensional regularity theory for partitions with quasi minimal surface area, subject to an additional graph constraint.


Weak approximations of nonlinear SDEs with non globally Lipschitz continuous coefficients. As opposed to an overwhelming number of works on strong approximations, weak approximations of stochastic differential equations (SDEs), sometimes more relevant in applications, are less studied in the literature. Most of the weak error analysis among them relies on a fundamental weak approximation theorem originally proposed by Milstein in 1986, which requires the coefficients of SDEs to be globally Lipschitz continuous. However, SDEs from applications rarely obey such a restrictive condition and the study of weak approximations in a non globally Lipschitz setting turns out to be a challenging problem. This paper aims to carry out the weak error analysis of discrete time approximations for SDEs with non globally Lipschitz coefficients. Under certain board assumptions on the analytical and numerical solutions of SDEs, a general weak convergence theorem is formulated for one step numerical approximations of SDEs. Explicit conditions on coefficients of SDEs are also offered to guarantee the aforementioned board assumptions, which allows coefficients to grow super linearly. As applications of the obtained weak convergence theorems, we prove the expected weak convergence rate of two well known types of schemes such as the tamed Euler method and the backward Euler method, in the non globally Lipschitz setting. Numerical examples are finally provided to confirm the previous findings.


Sparse Needlets for Lighting Estimation with Spherical Transport Loss. Accurate lighting estimation is challenging yet critical to many computer vision and computer graphics tasks such as high dynamic range (HDR) relighting. Existing approaches model lighting in either frequency domain or spatial domain which is insufficient to represent the complex lighting conditions in scenes and tends to produce inaccurate estimation. This paper presents NeedleLight, a new lighting estimation model that represents illumination with needlets and allows lighting estimation in both frequency domain and spatial domain jointly. An optimal thresholding function is designed to achieve sparse needlets which trims redundant lighting parameters and demonstrates superior localization properties for illumination representation. In addition, a novel spherical transport loss is designed based on optimal transport theory which guides to regress lighting representation parameters with consideration of the spatial information. Furthermore, we propose a new metric that is concise yet effective by directly evaluating the estimated illumination maps rather than rendered images. Extensive experiments show that NeedleLight achieves superior lighting estimation consistently across multiple evaluation metrics as compared with state of the art methods.


Universal properties of multimodal human mobility a statistical physics point of view. The statistical properties of human mobility have been studied in the framework of complex systems physics. Taking advantage from the new datasets made available by the information and communication technologies, the distributions of mobility path lengths and of trip duration have been considered to discover the fingerprints of complexity characters, but the role of the different transportation means on the statistical properties of urban mobility has not been studied in deep. In this paper we cope with the problem of pointing out the existence of universal features for different type of individual mobility pedestrian, cycling and vehicular urban mobility. In particular, we propose the use of travel time as universal 'energy' for the mobility and we define a simple survival model that explains the travel time distribution of the different types of mobility. the analysis is performed in the metropolitan area of Bologna (Italy), where GPS datasets were available on individual trips using different transport means. Our results could suggest how to plan the different transportation networks to realize a multimodal mobility compatibly with the citizens propensities to use the different transport means.


UPRec User Aware Pre training for Recommender Systems. Existing sequential recommendation methods rely on large amounts of training data and usually suffer from the data sparsity problem. To tackle this, the pre training mechanism has been widely adopted, which attempts to leverage large scale data to perform self supervised learning and transfer the pre trained parameters to downstream tasks. However, previous pre trained models for recommendation focus on leverage universal sequence patterns from user behaviour sequences and item information, whereas ignore capturing personalized interests with the heterogeneous user information, which has been shown effective in contributing to personalized recommendation. In this paper, we propose a method to enhance pre trained models with heterogeneous user information, called User aware Pre training for Recommendation (UPRec). Specifically, UPRec leverages the user attributes andstructured social graphs to construct self supervised objectives in the pre training stage and proposes two user aware pre training tasks. Comprehensive experimental results on several real world large scale recommendation datasets demonstrate that UPRec can effectively integrate user information into pre trained models and thus provide more appropriate recommendations for users.


Variation of constants formulae for forward and backward stochastic Volterra integral equations. In this paper, we provide variation of constants formulae for linear (forward) stochastic Volterra integral equations (SVIEs, for short) and linear Type II backward stochastic Volterra integral equations (BSVIEs, for short) in the usual It o 's framework. For these purposes, we define suitable classes of stochastic Volterra kernels and introduce new notions of the products of adapted L 2 processes. Observing the algebraic properties of the products, we obtain the variation of constants formulae by means of the corresponding resolvent. Our framework includes SVIEs with singular kernels such as fractional stochastic differential equations. Also, our results can be applied to general classes of SVIEs and BSVIEs with infinitely many iterated stochastic integrals. The duality principle between generalized SVIEs and generalized BSVIEs is also proved.


Sharp Elements and the Scott Topology of Continuous Dcpos. Working constructively, we study continuous directed complete posets (dcpos) and the Scott topology. Our two primary novelties are a notion of intrinsic apartness and a notion of sharp elements. Being apart is a positive formulation of being unequal, similar to how inhabitedness is a positive formulation of nonemptiness. To exemplify sharpness, we note that a lower real is sharp if and only if it is located. Our first main result is that for a large class of continuous dcpos, the Bridges V i c t v a apartness topology and the Scott topology coincide. Although we cannot expect a tight or cotransitive apartness on nontrivial dcpos, we prove that the intrinsic apartness is both tight and cotransitive when restricted to the sharp elements of a continuous dcpo. These include the strongly maximal elements, as studied by Smyth and Heckmann. We develop the theory of strongly maximal elements highlighting its connection to sharpness and the Lawson topology. Finally, we illustrate the intrinsic apartness, sharpness and strong maximality by considering several natural examples of continuous dcpos the Cantor and Baire domains, the partial Dedekind reals, the lower reals and finally, an embedding of Cantor space into an exponential of lifted sets.


Acceleration Methods. This monograph covers some recent advances in a range of acceleration techniques frequently used in convex optimization. We first use quadratic optimization problems to introduce two key families of methods, namely momentum and nested optimization schemes. They coincide in the quadratic case to form the Chebyshev method. We discuss momentum methods in detail, starting with the seminal work of Nesterov and structure convergence proofs using a few master templates, such as that for optimized gradient methods, which provide the key benefit of showing how momentum methods optimize convergence guarantees. We further cover proximal acceleration, at the heart of the Catalyst and Accelerated Hybrid Proximal Extragradient frameworks, using similar algorithmic patterns. Common acceleration techniques rely directly on the knowledge of some of the regularity parameters in the problem at hand. We conclude by discussing restart schemes, a set of simple techniques for reaching nearly optimal convergence rates while adapting to unobserved regularity parameters.


Sketch and Customize A Counterfactual Story Generator. Recent text generation models are easy to generate relevant and fluent text for the given text, while lack of causal reasoning ability when we change some parts of the given text. Counterfactual story rewriting is a recently proposed task to test the causal reasoning ability for text generation models, which requires a model to predict the corresponding story ending when the condition is modified to a counterfactual one. Previous works have shown that the traditional sequence to sequence model cannot well handle this problem, as it often captures some spurious correlations between the original and counterfactual endings, instead of the causal relations between conditions and endings. To address this issue, we propose a sketch and customize generation model guided by the causality implicated in the conditions and endings. In the sketch stage, a skeleton is extracted by removing words which are conflict to the counterfactual condition, from the original ending. In the customize stage, a generation model is used to fill proper words in the skeleton under the guidance of the counterfactual condition. In this way, the obtained counterfactual ending is both relevant to the original ending and consistent with the counterfactual condition. Experimental results show that the proposed model generates much better endings, as compared with the traditional sequence to sequence model.


Stronger Trickling Down in Posets Implies Expanding Sparsification of the Grassmanian Complex. In simplicial complexes it is well known that many of the global properties of the complex, can be deduced from expansion properties of its links. This phenomenon was first discovered by Garland G . In this work we develop a local to global machinery for general posets. We first show that the basic localization principle of Garland generalizes to more general posets. We then show that notable local to global theorems for simplicial complexes arise from general principles for general posets with expanding links. Specifically, we prove the following theorems for general posets satisfying some assumptions Expanding links (one sided expansion) imply fast convergence of high dimensional random walks (generalization KO,AL ) Expanding links imply Trickling down theorem (generalizing O ) and a poset has expanding links (with two sided expansion) iff it satisfies a global random walk convergence property (generalization DDFH ). We axiomatize general conditions on posets that imply local to global theorems. By developing this local to global machinery for general posets we discover that some posets behave better than simplicial complexes with respect to local to global implications. Specifically, we get a trickling down theorem for some posets (e.g. the Grassmanian poset) which is better behaved than the trickling down theorem known for simplicial complexes. In addition to this machinery, we also present a method to construct a new poset out of a pair of an initial poset and an auxiliary simplicial complex. By applying this procedure to the case where the pair is the Grassmanian poset and a bounded degree high dimensional expander, we obtain a bounded degree Grassmanian poset. We prove, using the tools described above, that this poset is a bounded degree expanding Grassmanian poset, partially proving a conjecture of DDFH .


Abordagem probabil 'istica para an 'alise de confiabilidade de dados gerados em sequenciamentos multiplex na plataforma ABI SOLiD. The next generation sequencers such as Illumina and SOLiD platforms generate a large amount of data, commonly above 10 Gigabytes of text files. Particularly, the SOLiD platform allows the sequencing of multiple samples in a single run, called multiplex run, through a tagging system called Barcode. This feature requires a computational process for separation of the data sample because the sequencer provides a mixture of all samples in a single output. This process must be secure to avoid any harm that may scramble further analysis. In this context, realized the need to develop a probabilistic model capable of assigning a degree of confidence in the marking system used in multiplex sequencing. The results confirmed the adequacy of the model obtained, which allows, among other things, to guide a process of filtering the data and evaluation of the sequencing protocol used.


IronMask Modular Architecture for Protecting Deep Face Template. Convolutional neural networks have made remarkable progress in the face recognition field. The more the technology of face recognition advances, the greater discriminative features into a face template. However, this increases the threat to user privacy in case the template is exposed. In this paper, we present a modular architecture for face template protection, called IronMask, that can be combined with any face recognition system using angular distance metric. We circumvent the need for binarization, which is the main cause of performance degradation in most existing face template protections, by proposing a new real valued error correcting code that is compatible with real valued templates and can therefore, minimize performance degradation. We evaluate the efficacy of IronMask by extensive experiments on two face recognitions, ArcFace and CosFace with three datasets, CMU Multi PIE, FEI, and Color FERET. According to our experimental results, IronMask achieves a true accept rate (TAR) of 99.79 at a false accept rate (FAR) of 0.0005 when combined with ArcFace, and 95.78 TAR at 0 FAR with CosFace, while providing at least 115 bit security against known attacks.


Hate Speech Detection in Roman Urdu. Hate speech is a specific type of controversial content that is widely legislated as a crime that must be identified and blocked. However, due to the sheer volume and velocity of the Twitter data stream, hate speech detection cannot be performed manually. To address this issue, several studies have been conducted for hate speech detection in European languages, whereas little attention has been paid to low resource South Asian languages, making the social media vulnerable for millions of users. In particular, to the best of our knowledge, no study has been conducted for hate speech detection in Roman Urdu text, which is widely used in the sub continent. In this study, we have scrapped more than 90,000 tweets and manually parsed them to identify 5,000 Roman Urdu tweets. Subsequently, we have employed an iterative approach to develop guidelines and used them for generating the Hate Speech Roman Urdu 2020 corpus. The tweets in the this corpus are classified at three levels Neutral Hostile, Simple Complex, and Offensive Hate speech. As another contribution, we have used five supervised learning techniques, including a deep learning technique, to evaluate and compare their effectiveness for hate speech detection. The results show that Logistic Regression outperformed all other techniques, including deep learning techniques for the two levels of classification, by achieved an F1 score of 0.906 for distinguishing between Neutral Hostile tweets, and 0.756 for distinguishing between Offensive Hate speech tweets.


Towards Consistent Predictive Confidence through Fitted Ensembles. Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out of distribution (OOD) examples or making a wrong prediction. This inconsistent predictive confidence limits the integration of independently trained learning models into a larger system. This paper introduces separable concept learning framework to realistically measure the performance of classifiers in presence of OOD examples. In this setup, several instances of a classifier are trained on different parts of a partition of the set of classes. Later, the performance of the combination of these models is evaluated on a separate test set. Unlike current OOD detection techniques, this framework does not require auxiliary OOD datasets and does not separate classification from detection performance. Furthermore, we present a new strong baseline for more consistent predictive confidence in deep models, called fitted ensembles, where overconfident predictions are rectified by transformed versions of the original classification task. Fitted ensembles can naturally detect OOD examples without requiring auxiliary data by observing contradicting predictions among its components. Experiments on MNIST, SVHN, CIFAR 10 100, and ImageNet show fitted ensemble significantly outperform conventional ensembles on OOD examples and are possible to scale.


Simpler is Better Few shot Semantic Segmentation with Classifier Weight Transformer. A few shot semantic segmentation model is typically composed of a CNN encoder, a CNN decoder and a simple classifier (separating foreground and background pixels). Most existing methods meta learn all three model components for fast adaptation to a new class. However, given that as few as a single support set image is available, effective model adaption of all three components to the new class is extremely challenging. In this work we propose to simplify the meta learning task by focusing solely on the simplest component, the classifier, whilst leaving the encoder and decoder to pre training. We hypothesize that if we pre train an off the shelf segmentation model over a set of diverse training classes with sufficient annotations, the encoder and decoder can capture rich discriminative features applicable for any unseen classes, rendering the subsequent meta learning stage unnecessary. For the classifier meta learning, we introduce a Classifier Weight Transformer (CWT) designed to dynamically adapt the supportset trained classifier's weights to each query image in an inductive way. Extensive experiments on two standard benchmarks show that despite its simplicity, our method outperforms the state of the art alternatives, often by a large margin.Code is available on https github.com zhiheLu CWT for FSS.


Pulsating propagation and extinction of hydrogen detonations in ultrafine water sprays. The Eulerian Lagrangian method is applied to simulate pulsating propagation and extinction of stoichiometric hydrogen oxygen argon detonations in ultrafine water sprays. Three detonation propagation modes are found (1) pulsating propagation, (2) propagation followed by extinction, and (3) immediate extinction. For pulsating detonation, within one cycle, the propagation speeds and the distance between reaction front (RF) and shock front (SF) change periodically. The pulsating phenomenon originates from the interactions between gas dynamics, chemical kinetics, and droplet dynamics inside the induction zone. Multiple pressure waves are emanated from the RF within one cycle, which overtake and intensify the lead SF. An autoigniting spot arises in the shocked gas after the contact surface. The relative locations of SF, RF, shock frame sonic point, and two phase contact surface remain unchanged in a pulsating cycle, but their distances have periodic variations. Moreover, the unsteady behaviors of detonation extinction include continuously increased distance between the RF and SF and quickly reduced pressure peaks, temperature, and combustion heat release. The decoupling of RF and SF leads to significantly increasing chemical timescale of the shocked mixture. The hydrodynamic structure also changes considerably when detonation extinction occurs. Moreover, the predicted map of detonation propagation and extinction illustrates that the critical mass loading for detonation extinction reduces significantly when the droplet size becomes smaller. It is also found that for the same droplet size, the average detonation speed monotonically decreases with water mass loading. However, detonation speed and pulsating frequency have a non monotonic dependence on droplet size under a constant water mass loading.


Learning Domain Invariant Representations for Generalizable Person Re Identification. Generalizable person Re Identification (ReID) has attracted growing attention in recent computer vision community. In this work, we construct a structural causal model among identity labels, identity specific factors (clothes shoes color etc), and domain specific factors (background, viewpoints etc). According to the causal analysis, we propose a novel Domain Invariant Representation Learning for generalizable person Re Identification (DIR ReID) framework. Specifically, we first propose to disentangle the identity specific and domain specific feature spaces, based on which we propose an effective algorithmic implementation for backdoor adjustment, essentially serving as a causal intervention towards the SCM. Extensive experiments have been conducted, showing that DIR ReID outperforms state of the art methods on large scale domain generalization ReID benchmarks.


Generalization in NLI Ways (Not) To Go Beyond Simple Heuristics. Much of recent progress in NLU was shown to be due to models' learning dataset specific heuristics. We conduct a case study of generalization in NLI (from MNLI to the adversarially constructed HANS dataset) in a range of BERT based architectures (adapters, Siamese Transformers, HEX debiasing), as well as with subsampling the data and increasing the model size. We report 2 successful and 3 unsuccessful strategies, all providing insights into how Transformer based models learn to generalize.


What Truly Matters? Using Linguistic Cues for Analyzing the BlackLivesMatter Movement and its Counter Protests 2013 to 2020. Since the fatal shooting of 17 year old Black teenager Trayvon Martin in February 2012 by a White neighborhood watchman, George Zimmerman in Sanford, Florida, there has been a significant increase in digital activism addressing police brutality related and racially motivated incidents in the United States. In this work, we administer an innovative study of digital activism by exploiting social media as an authoritative tool to examine and analyze the linguistic cues and thematic relationships in these three mediums. We conduct a multi level text analysis on 36,984,559 tweets to investigate users' behaviors to examine the language used and understand the impact of digital activism on social media within each social movement on a sentence level, word level, and topic level. Our results show that excessive use of racially related or prejudicial hashtags were used by the counter protests which portray potential discriminatory tendencies. Consequently, our findings highlight that social activism done by Black Lives Matter activists does not diverge from the social issues and topics involving police brutality related and racially motivated killings of Black individuals due to the shape of its topical graph that topics and conversations encircling the largest component directly relate to the topic of Black Lives Matter. Finally, we see that both Blue Lives Matter and All Lives Matter movements depict a different directive, as the topics of Blue Lives Matter or All Lives Matter do not reside in the center. These findings suggest that topics and conversations within each social movement are skewed, random or possessed racially related undertones, and thus, deviating from the prominent social injustice issues.


Anomaly Detection Support Using Process Classification. Anomaly detection systems need to consider a lot of information when scanning for anomalies. One example is the context of the process in which an anomaly might occur, because anomalies for one process might not be anomalies for a different one. Therefore data such as system events need to be assigned to the program they originate from. This paper investigates whether it is possible to infer from a list of system events the program whose behavior caused the occurrence of these system events. To that end, we model transition probabilities between non equivalent events and apply the k nearest neighbors algorithm. This system is evaluated on non malicious, real world data using four different evaluation scores. Our results suggest that the approach proposed in this paper is capable of correctly inferring program names from system events.


The Lov ' a sz Cherkassky theorem for locally finite graphs with ends. Lov ' a sz and Cherkassky discovered independently that, if G is a finite graph and T subseteq V(G) such that the degree d G(v) is even for every vertex v in V(G) setminus T , then the maximum number of edge disjoint paths which are internally disjoint from T and connect distinct vertices of T is equal to frac 1 2 sum t in T lambda G(t, T setminus t ) (where lambda G(t, T setminus t ) is the size of a smallest cut that separates t and T setminus t ). From another perspective, this means that for every vertex t in T , in any optimal path system there are lambda G(t, T setminus t ) many paths between t and T setminus t . We extend the theorem of Lov ' a sz and Cherkassky based on this reformulation to all locally finite infinite graphs and their ends. In our generalisation, T may contain not just vertices but ends as well, and paths are one way (two way) infinite when they establish a vertex end (end end) connection.


Robust Cell Load Learning with a Small Sample Set. Learning of the cell load in radio access networks (RANs) has to be performed within a short time period. Therefore, we propose a learning framework that is robust against uncertainties resulting from the need for learning based on a relatively small training sample set. To this end, we incorporate prior knowledge about the cell load in the learning framework. For example, an inherent property of the cell load is that it is monotonic in downlink (data) rates. To obtain additional prior knowledge we first study the feasible rate region, i.e., the set of all vectors of user rates that can be supported by the network. We prove that the feasible rate region is compact. Moreover, we show the existence of a Lipschitz function that maps feasible rate vectors to cell load vectors. With these results in hand, we present a learning technique that guarantees a minimum approximation error in the worst case scenario by using prior knowledge and a small training sample set. Simulations in the network simulator NS3 demonstrate that the proposed method exhibits better robustness and accuracy than standard multivariate learning techniques, especially for small training sample sets.


Energetic Electron Precipitation Occurrence Rates Determined Using the Syowa East SuperDARN Radar. We demonstrate that the Super Dual Auroral Radar Network (SuperDARN) radar at Syowa station, Antarctica, can be used to detect high frequency radio wave attenuation in the D region ionosphere during energetic electron precipitation (EEP) events. EEP related attenuation is identified in the radar data as a sudden reduction in the backscatter power and background noise parameters.We focus initially on EEP associated with pulsating aurora and use images from a colocated all sky camera as a validation data set for the radar based EEP event detection method. Our results show that high frequency attenuation that commences during periods of optical pulsating aurora typically continues for 2 4 hr after the camera stops imaging at dawn.We then use the radar data to determine EEP occurrence rates as a function of magnetic local time (MLT) using a database of 555 events detected in 2011. EEP occurrence rates are highest in the early morning sector and lowest at around 15 00 18 00 MLT. The postmidnight and morning sector occurrence rates exhibit significant seasonal variations, reaching approximately 50 in the winter and 15 in the summer, whereas no seasonal variations were observed in other MLT sectors. The mean event lifetime determined from the radar data was 2.25 hr, and 10 of events had lifetimes exceeding 5 hr.


Relaxed phase matching constraints in zero index waveguides. The nonlinear optical response of materials is the foundation upon which applications such as frequency conversion, all optical signal processing, molecular spectroscopy, and nonlinear microscopy are built. However, the utility of all such parametric nonlinear optical processes is hampered by phase matching requirements. Quasi phase matching, birefringent phase matching, and higher order mode phase matching have all been developed to address this constraint, but the methods demonstrated to date suffer from the inconvenience of only being phase matched for a single, specific arrangement of beams, typically co propagating, resulting in cumbersome experimental configurations and large footprints for integrated devices. Here, we experimentally demonstrate that these phase matching requirements may be satisfied in a parametric nonlinear optical process for multiple, if not all, configurations of input and output beams when using low index media. Our measurement constitutes the first experimental observation of direction independent phase matching for a medium sufficiently long for phase matching concerns to be relevant. We demonstrate four wave mixing from spectrally distinct co and counter propagating pump and probe beams, the backward generation of a nonlinear signal, and excitation by an out of plane probe beam. These results explicitly show that the unique properties of low index media relax traditional phase matching constraints, which can be exploited to facilitate nonlinear interactions and miniaturize nonlinear devices, thus adding to the established exceptional properties of low index materials.


Real Time Tactile Grasp Force Sensing Using Fingernail Imaging via Deep Neural Networks. This paper has introduced a novel approach for the real time estimation of 3D tactile forces exerted by human fingertips via vision only. The introduced approach is entirely monocular vision based and does not require any physical force sensor. Therefore, it is scalable, non intrusive, and easily fused with other perception systems such as body pose estimation, making it ideal for HRI applications where force sensing is necessary. The introduced approach consists of three main modules finger tracking for detection and tracking of each individual finger, image alignment for preserving the spatial information in the images, and the force model for estimating the 3D forces from coloration patterns in the images. The model has been implemented experimentally, and the results have shown a maximum RMS error of 8.4 (for the entire range of force levels) along all three directions. The estimation accuracy is comparable to the offline models in the literature, such as EigneNail, while, this model is capable of performing force estimation at 30 frames per second.


Modular proximal gradient algorithms in variable exponent Lebesgue spaces. We consider structured optimisation problems defined in terms of the sum of a smooth and convex function, and a proper, l.s.c., convex (typically non smooth) one in reflexive variable exponent Lebesgue spaces L p( cdot) ( Omega) . Due to their intrinsic space variant properties, such spaces can be naturally used as solution space and combined with space variant functionals for the solution of ill posed inverse problems. For this purpose, we propose and analyse two instances (primal and dual) of proximal gradient algorithms in L p( cdot) ( Omega) , where the proximal step, rather than depending on the natural (non separable) L p( cdot) ( Omega) norm, is defined in terms of its modular function, which, thanks to its separability, allows for the efficient computation of algorithmic iterates. Convergence in function values is proved for both algorithms, with convergence rates depending on problem space smoothness. To show the effectiveness of the proposed modelling, some numerical tests highlighting the flexibility of the space L p( cdot) ( Omega) are shown for exemplar deconvolution and mixed noise removal problems. Finally, a numerical verification on the convergence speed and computational costs of both algorithms in comparison with analogous ones defined in standard L p ( Omega) spaces is presented.


Analytic characterization of high dimension weighted special atom spaces. Special atom spaces have been around for quite awhile since the introduction of atoms by R. Coifman in his seminal paper who led to another proof that the dual of the Hardy space H 1 is in fact the space of functions of bounded means oscillations (BMO). Special atom spaces enjoy quite a few attributes of their own, among which the fact that they have an analytic extension to the unit disc. Recently, an extension of special atom spaces to higher dimensions was proposed, making ripe the possible exploration of the above extension in higher dimensions. In this paper we propose an analytic characterization of special atom spaces in higher dimensions.


GR RNN Global Context Residual Recurrent Neural Networks for Writer Identification. This paper presents an end to end neural network system to identify writers through handwritten word images, which jointly integrates global context information and a sequence of local fragment based features. The global context information is extracted from the tail of the neural network by a global average pooling step. The sequence of local and fragment based features is extracted from a low level deep feature map which contains subtle information about the handwriting style. The spatial relationship between the sequence of fragments is modeled by the recurrent neural network (RNN) to strengthen the discriminative ability of the local fragment features. We leverage the complementary information between the global context and local fragments, resulting in the proposed global context residual recurrent neural network (GR RNN) method. The proposed method is evaluated on four public data sets and experimental results demonstrate that it can provide state of the art performance. In addition, the neural networks trained on gray scale images provide better results than neural networks trained on binarized and contour images, indicating that texture information plays an important role for writer identification. The source code will be available url https github.com shengfly writer identification .


A note on mathcal F n multiple zeta values. For several evaluations of special values and several relations known only in mathcal A n multiple zeta values or mathcal S n multiple zeta values, we prove that they are uniformly valid in mathcal F n multiple zeta values for both the case where mathcal F mathcal A and mathcal F mathcal S . In particular, the Bowman Bradley type theorem and sum formulas for mathcal S 2 multiple zeta values are proved.


An affordable tool based on a pedestrian vehicle collision model to support the fieldwork and reconstruction. A Free access tool based on a pedestrian vehicle collision model is presented. The model permitted the qualitative and quantitative description of the events whole dynamic by segments called pre collision, collision, and post collision. Furthermore, it enabled the determination of the magnitude of the vehicles initial speed before the collision with a pedestrian and the location of the point position of impact on the road where the accident occurred. The models inputs are related to the evidence collected at the scene, which provides a checklist platform for supporting investigators fieldwork. Additionally, the pre collision segment permitted the investigators to develop an avoidability study that may contribute to road safety evaluation. The model was validated, comparing the results statistically with experimental cases developed with dummies, bodies, and reconstructed cases. It is shown that there is no significant difference, thus verifying its functionality. The tool is available as a mobile app in Spanish and English, allowing significant affordability to investigators from some low and middle income countries.


The compressible granular collapse in a fluid as a continuum validity of a Navier Stokes model with mu(J) phi(J) rheology. The incompressible mu(I) rheology has been used to study subaerial granular flows with remarkable success. For subaquatic granular flows, drag between grains and the pore fluid is substantially higher and the physical behaviour is more complex. High drag forces constrain the rearrangement of grains and dilatancy, leading to a considerable build up of pore pressure. Its transient and dynamic description is the key to modelling subaquatic granular flows but out of the scope of incompressible models. In this work, we advance from the incompressible mu(I) rheology to the compressible mu(J) phi(J) rheology to account for pore pressure, dilatancy, and the scaling laws under subaquatic conditions. The model is supplemented with critical state theory to yield the correct properties in the quasi static limit. The pore fluid is described by an additional set of conservation equations and the interaction with grains is described by a drag model. This new implementation enables us to include most of the physical processes relevant for submerged granular flows in a highly transparent manner. Both, the incompressible and compressible rheologies are implemented into OpenFOAM and various simulations at low and high Stokes numbers are conducted with both frameworks. We found a good agreement of the mu(J) phi(J) rheology with low Stokes number experiments, that incompressible models fail to describe. The combination of granular rheology, pore pressure, and drag model leads to complex phenomena such as apparent cohesion, remoulding, hydroplaning, and turbidity currents. The simulations give remarkable insights into these phenomena and increase our understanding of subaquatic mass transports.


Report From The Trenches A Case Study In Modernizing Software Development Practices. One factor of success in software development companies is their ability to deliver good quality products, fast. For this, they need to improve their software development practices. We work with a medium sized company modernizing its development practices. The company introduced several practices recommended in agile development. If the benefits of these practices are well documented, the impact of such changes on the developers is less well known. We follow this modernization before and during the COVID 19 outbreak. This paper presents an empirical study of the perceived benefit and drawback of these practices as well as the impact of COVID 19 on the company's employees. One of the conclusions, is the additional difficulties created by obsolete technologies to adapt the technology itself and the development practices it encourages to modern standards.


ROME A Multi Resource Job Scheduling Framework for Exascale HPC Systems. High performance computing (HPC) is undergoing significant changes. Next generation HPC systems are equipped with diverse global and local resources, such as I O burst buffer resources, memory resources (e.g., on chip and off chip RAM, external RAM NVRA), network resources, and possibly other resources. Job schedulers play a crucial role in efficient use of resources. However, traditional job schedulers are single objective and fail to efficient use of other resources. In this paper, we propose ROME, a novel multi dimensional job scheduling framework to explore potential tradeoffs among multiple resources and provides balanced scheduling decision. Our design leverages genetic algorithm as the multi dimensional optimization engine to generate fast scheduling decision and to support effective resource utilization.


Proofs, generalizations and analogs of Menon's identity a survey. Menon's identity states that for every positive integer n one has sum (a 1,n) varphi(n) tau(n) , where a runs through a reduced residue system (mod n ), (a 1,n) stands for the greatest common divisor of a 1 and n , varphi(n) is Euler's totient function and tau(n) is the number of divisors of n . Menon's identity has been the subject of many research papers, also in the last years. We present detailed, self contained proofs of this identity by using different methods, and point out those that we could not identify in the literature. We survey the generalizations and analogs, and overview the results and proofs given by Menon in his original paper. Some historical remarks and an updated list of references are included as well.


Simple Relationships Between Lozenge Tiling Functions of Related Regions. We give a formula for the number of symmetric tilings of hexagons on the triangular lattice with unit triangles removed from arbitrary positions along two non adjacent non opposite sides. We show that for certain families of such regions, the ratios of their numbers of symmetric tilings are given by simple product formulas. We also prove that for certain weighted regions which arise when applying Ciucu's Factorization Theorem, the formulas for the weighted and unweighted counts of tilings have a simple explicit relationship.


q Polymatroids and Their Relation to Rank Metric Codes. It is well known that linear rank metric codes give rise to q polymatroids. Analogously to matroid theory one may ask whether a given q polymatroid is representable by a rank metric code. We provide an answer by presenting an example of a q matroid that is not representable by any linear rank metric code and, via a relation to paving matroids, provide examples of various q matroids that are not representable by F q m linear rank metric codes. We then go on and introduce deletion and contraction for q polymatroids and show that they are mutually dual and correspond to puncturing and shortening of rank metric codes. Finally, we introduce a closure operator along with the notion of flats and show that the generalized rank weights of a rank metric code are fully determined by the flats of the associated q polymatroid.


Towards an efficient approach for the nonconvex ell p ball projection algorithm and analysis. This paper primarily focuses on computing the Euclidean projection of a vector onto the ell p ball in which p in(0,1) . Such a problem emerges as the core building block in statistical machine learning and signal processing tasks because of its ability to promote sparsity. However, efficient numerical algorithms for finding the projections are still not available, particularly in large scale optimization. To meet this challenge, we first derive the first order necessary optimality conditions of this problem. Based on this characterization, we develop a novel numerical approach for computing the stationary point through solving a sequence of projections onto the reweighted ell 1 balls. This method is practically simple to implement and computationally efficient. Moreover, the proposed algorithm is shown to converge uniquely under mild conditions and has a worst case O(1 sqrt k ) convergence rate. Numerical experiments demonstrate the efficiency of our proposed algorithm.


Tilting preenvelopes and cotilting precovers in general Abelian categories. We consider an arbitrary Abelian category mathcal A and a subcategory mathcal T closed under extensions and direct summands, and characterize those mathcal T that are (semi )special preenveloping in mathcal A as a byproduct, we generalize to this setting several classical results for categories of modules. For instance, we get that the special preenveloping subcategories mathcal T of mathcal A closed under extensions and direct summands are precisely those for which ( perp 1 mathcal T , mathcal T ) is a right complete cotorsion pair, where perp 1 mathcal T text Ker ( text Ext mathcal A 1( , mathcal T )) . Particular cases appear when mathcal T V perp 1 text Ker ( text Ext mathcal A 1(V, )) , for an text Ext 1 universal object V such that text Ext mathcal A 1(V, ) vanishes on all (existing) coproducts of copies of V . For many choices of mathcal A , we show that these latter examples exhaust all the possibilities. We then show that, when mathcal A has an epi generator, the (semi )special preenveloping torsion classes mathcal T given by (quasi )tilting objects are exactly those for which any object T in mathcal T is the epimorphic image of some object in perp 1 mathcal T (and the subcategory mathcal B text Sub ( mathcal T ) of subobjects of objects in mathcal T is reflective) and they are, in turn, the right constituents of complete cotorsion pairs in mathcal A (resp., mathcal B ). In a final section, we apply the results when mathcal A mathrm mod text R is the category of finitely presented modules over a right coherent ring R , something that gives new results and raises new questions even at the level of classical tilting theory in categories of modules.


On the probability of generating a primitive matrix. Given a k times n integer primitive matrix A (i.e., a matrix can be extended to an n times n unimodular matrix over the integers) with size of entries bounded by lambda , we study the probability that the m times n matrix extended from A by choosing other m k vectors uniformly at random from 0, 1, ldots, lambda 1 is still primitive. We present a complete and rigorous proof that the probability is at least a constant for the case of m le n 4 . Previously, only the limit case for lambda rightarrow infty with k 0 was analysed in Maze et al. (2011), known as the natural density. As an application, we prove that there exists a fast Las Vegas algorithm that completes a k times n primitive matrix A to an n times n unimodular matrix within expected tilde O (n omega log A ) bit operations, where tilde O is big O but without log factors, omega is the exponent on the arithmetic operations of matrix multiplication and A is the maximal absolute value of entries of A .


Cellular Formation Maintenance and Collision Avoidance Using Centroid Based Point Set Registration in a Swarm of Drones. This work focuses on low energy collision avoidance and formation maintenance in autonomous swarms of drones. Here, the two main problems are 1) how to avoid collisions by temporarily breaking the formation, i.e., collision avoidance reformation, and 2) how do such reformation while minimizing the deviation resulting in minimization of the overall time and energy consumption of the drones. To address the first question, we use cellular automata based technique to find an efficient formation that avoids the obstacle while minimizing the time and energy. Concerning the second question, a near optimal reformation of the swarm after successful collision avoidance is achieved by applying a temperature function reduction technique, originally used in the point set registration process. The goal of the reformation process is to remove the disturbance while minimizing the overall time it takes for the swarm to reach the destination and consequently reducing the energy consumption required by this operation. To measure the degree of formation disturbance due to collision avoidance, deviation of the centroid of the swarm formation is used, inspired by the concept of the center of mass in classical mechanics. Experimental results show the efficiency of the proposed technique, in terms of performance and energy.


Shape, Size, and Fabrication Effects in 3D Printed Granular Jamming Grippers. Granular jamming is a popular soft actuation mechanism that provides high stiffness variability with minimum volume variation. Jamming is particularly interesting from a design perspective, as a myriad of design parameters can potentially be exploited to induce a diverse variety of useful behaviours. To date, grain shape has been largely ignored. Here, we focus on the use of 3D printing to expose design variables related to grain shape and size. Grains are represented by parameterised superquadrics (superellipsoids) four diverse shapes are investigated along with three size variations. Grains are 3D printed at high resolution and performance is assessed in experimental pull off testing on a variety of benchmark test objects. We show that grain shape and size are key determinants in granular gripping performance. Moreover, there is no universally optimal grain shape for gripping. Optical imaging assesses the accuracy of printed shapes compared to their ideal models. Results suggest that optimisation of grain shape is a key enabler for high performance, bespoke, actuation behaviour and can be exploited to expand the range and performance of granular grippers across a range of diverse usage scenarios.


The Anthropocene by the Numbers A Quantitative Snapshot of Humanity's Influence on the Planet. The presence and action of humans on Earth has exerted a strong influence on the evolution of the planet over the past approx 10,000 years, the consequences of which are now becoming broadly evident. Despite a deluge of tightly focused and necessarily technical studies exploring each facet of "human impacts" on the planet, their integration into a complete picture of the human Earth system lags far behind. Here, we quantify twelve dimensionless ratios which put the magnitude of human impacts in context, comparing the magnitude of anthropogenic processes to their natural analogues. These ratios capture the extent to which humans alter the terrestrial surface, hydrosphere, biosphere, atmosphere, and biogeochemistry of Earth. In almost all twelve cases, the impact of human processes rivals or exceeds their natural counterparts. The values and corresponding uncertainties for these impacts at global and regional resolution are drawn from the primary scientific literature, governmental and international databases, and industry reports. We present this synthesis of the current "state of affairs" as a graphical snapshot designed to be used as a reference. Furthermore, we establish a searchable database termed the Human Impacts Database (www.anthroponumbers.org) which houses all quantities reported here and many others with extensive curation and annotation. While necessarily incomplete, this work collates and contextualizes a set of essential numbers summarizing the broad impacts of human activities on Earth's atmosphere, land, water, and biota.


A Material Mask Overlay Strategy for Close to Binary Design dependent Pressure loaded Optimized Topologies. This paper presents a Material Mask Overlay Strategy topology optimization approach with improved material assignment at the element level for achieving close to black and white designs for pressure loaded problems. Hexagonal elements are employed to parametrize the design domain as this tessellation provides nonsingular local connectivity. Elliptical negative masks are used to find the optimized material layout. The material dilation and material erosion variables of each mask are systematically varied in association with a gray scale measure constraint to achieve designs close to 0 1. Darcy's law in association with a drainage term is used to formulate the pressure field. The obtained pressure field is converted into the consistent nodal forces using Wachspress shape functions. Sensitivities of the objective and pressure load are evaluated using the adjoint variable method. The approach is demonstrated by solving various pressure loaded structures and pressure actuated compliant mechanisms. Compliance is minimized for loadbearing structures, whereas a multicriteria objective is minimized for mechanism designs.


ROSITA Enhancing Vision and Language Semantic Alignments via Cross and Intra modal Knowledge Integration. Vision and language pretraining (VLP) aims to learn generic multimodal representations from massive image text pairs. While various successful attempts have been proposed, learning fine grained semantic alignments between image text pairs plays a key role in their approaches. Nevertheless, most existing VLP approaches have not fully utilized the intrinsic knowledge within the image text pairs, which limits the effectiveness of the learned alignments and further restricts the performance of their models. To this end, we introduce a new VLP method called ROSITA, which integrates the cross and intra modal knowledge in a unified scene graph to enhance the semantic alignments. Specifically, we introduce a novel structural knowledge masking (SKM) strategy to use the scene graph structure as a priori to perform masked language (region) modeling, which enhances the semantic alignments by eliminating the interference information within and across modalities. Extensive ablation studies and comprehensive analysis verifies the effectiveness of ROSITA in semantic alignments. Pretrained with both in domain and out of domain datasets, ROSITA significantly outperforms existing state of the art VLP methods on three typical vision and language tasks over six benchmark datasets.


Training Mixed Objective Pointing Decoders for Block Level Optimization in Search Recommendation. Related or ideal follow up suggestions to a web query in search engines are often optimized based on several different parameters relevance to the original query, diversity, click probability etc. One or many rankers may be trained to score each suggestion from a candidate pool based on these factors. These scorers are usually pairwise classification tasks where each training example consists of a user query and a single suggestion from the list of candidates. We propose an architecture that takes all candidate suggestions associated with a given query and outputs a suggestion block. We discuss the benefits of such an architecture over traditional approaches and experiment with further enforcing each individual metric through mixed objective training.


Interpreting A Pre trained Model Is A Key For Model Architecture Optimization A Case Study On Wav2Vec 2.0. A deep Transformer model with good evaluation score does not mean each subnetwork (a.k.a transformer block) learns reasonable representation. Diagnosing abnormal representation and avoiding it can contribute to achieving a better evaluation score. We propose an innovative perspective for analyzing attention patterns summarize block level patterns and assume abnormal patterns contribute negative influence. We leverage Wav2Vec 2.0 as a research target and analyze a pre trained model's pattern. All experiments leverage Librispeech 100 clean as training data. Through avoiding diagnosed abnormal ones, our custom Wav2Vec 2.0 outperforms the original version about 4.8 absolute word error rate (WER) on test clean with viterbi decoding. Our version is still 0.9 better when decoding with a 4 gram language model. Moreover, we identify that avoiding abnormal patterns is the main contributor for performance boosting.


WikiContradiction Detecting Self Contradiction Articles on Wikipedia. While Wikipedia has been utilized for fact checking and claim verification to debunk misinformation and disinformation, it is essential to either improve article quality and rule out noisy articles. Self contradiction is one of the low quality article types in Wikipedia. In this work, we propose a task of detecting self contradiction articles in Wikipedia. Based on the "self contradictory" template, we create a novel dataset for the self contradiction detection task. Conventional contradiction detection focuses on comparing pairs of sentences or claims, but self contradiction detection needs to further reason the semantics of an article and simultaneously learn the contradiction aware comparison from all pairs of sentences. Therefore, we present the first model, Pairwise Contradiction Neural Network (PCNN), to not only effectively identify self contradiction articles, but also highlight the most contradiction pairs of contradiction sentences. The main idea of PCNN is two fold. First, to mitigate the effect of data scarcity on self contradiction articles, we pre train the module of pairwise contradiction learning using SNLI and MNLI benchmarks. Second, we select top K sentence pairs with the highest contradiction probability values and model their correlation to determine whether the corresponding article belongs to self contradiction. Experiments conducted on the proposed WikiContradiction dataset exhibit that PCNN can generate promising performance and comprehensively highlight the sentence pairs the contradiction locates.


Kummer Rigidity for Hyperk "ahler Automorphisms. We show that a holomorphic automorphism on a projective hyperk "ahler manifold that has positive topological entropy and has volume measure as the measure of maximal entropy, is necessarily a Kummer example, partially extending the analogous results in (Cantat Dupont 2020)(Filip Tosatti 2018) for complex surfaces. A trick with Jensen's inequality is used to show that stable and unstable distributions exhibit uniform rate of contraction and expansion, and with them our hyperk "ahler manifold is shown to be flat. A recent result in (Claudon Graf Guenancia Naumann 2020) then implies that our hyperk "ahler manifold is birational to a torus quotient, giving the Kummer example structure.


A hidden Markov model for describing turbostratic disorder applied to carbon blacks and graphene. We present a mathematical framework to represent turbostratic disorder in materials like carbon blacks, smectites, and twisted n layer graphene. In particular, the set of all possible disordered layers, including rotated, shifted, and curved layers form a stochastic sequence governed by a hidden Markov model. The probability distribution over the set of layer types is treated as an element of a Hilbert space, and using tools of Fourier analysis and functional analysis, we develop expressions for the scattering cross sections of a broad class of disordered materials.


On growth monotonicity estimates of the principal Dirichlet Laplacian eigenvalue. In the present paper we obtain growth monotonicity estimates of the principal Dirichlet Laplacian eigenvalue in bounded non Lipschitz domains. The proposed method is based on composition operators generated by quasiconformal mappings and their applications to weighted Sobolev inequalities.


The Benchmark Lottery. The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods. This paper proposes the notion of "a benchmark lottery" that describes the overall fragility of the ML benchmarking process. The benchmark lottery postulates that many factors, other than fundamental algorithmic superiority, may lead to a method being perceived as superior. On multiple benchmark setups that are prevalent in the ML community, we show that the relative performance of algorithms may be altered significantly simply by choosing different benchmark tasks, highlighting the fragility of the current paradigms and potential fallacious interpretation derived from benchmarking ML methods. Given that every benchmark makes a statement about what it perceives to be important, we argue that this might lead to biased progress in the community. We discuss the implications of the observed phenomena and provide recommendations on mitigating them using multiple machine learning domains and communities as use cases, including natural language processing, computer vision, information retrieval, recommender systems, and reinforcement learning.


Adversarial Training for a Hybrid Approach to Aspect Based Sentiment Analysis. The increasing popularity of the Web has subsequently increased the abundance of reviews on products and services. Mining these reviews for expressed sentiment is beneficial for both companies and consumers, as quality can be improved based on this information. In this paper, we consider the state of the art HAABSA algorithm for aspect based sentiment analysis tasked with identifying the sentiment expressed towards a given aspect in review sentences. Specifically, we train the neural network part of this algorithm using an adversarial network, a novel machine learning training method where a generator network tries to fool the classifier network by generating highly realistic new samples, as such increasing robustness. This method, as of yet never in its classical form applied to aspect based sentiment analysis, is found to be able to considerably improve the out of sample accuracy of HAABSA for the SemEval 2015 dataset, accuracy was increased from 81.7 to 82.5 , and for the SemEval 2016 task, accuracy increased from 84.4 to 87.3 .


A comparison of data driven approaches to build low dimensional ocean models. We present a comprehensive inter comparison of linear regression (LR), stochastic, and deep learning approaches for reduced order statistical emulation of ocean circulation. The reference dataset is provided by an idealized, eddy resolving, double gyre ocean circulation model. Our goal is to conduct a systematic and comprehensive assessment and comparison of skill, cost, and complexity of statistical models from the three methodological classes. The model based on LR is considered as a baseline. Additionally, we investigate its additive white noise augmentation and a multi level stochastic approach, deep learning methods, hybrid frameworks (LR plus deep learning), and simple stochastic extensions of deep learning and hybrid methods. The assessment metrics considered are root mean squared error, anomaly cross correlation, climatology, variance, frequency map, forecast horizon, and computational cost. We found that the multi level linear stochastic approach performs the best for both short and long timescale forecasts. The deep learning hybrid models augmented by additive state dependent white noise came second, while their deterministic counterparts failed to reproduce the characteristic frequencies in climate range forecasts. Pure deep learning implementations performed worse than LR and its noise augmentations. Skills of LR and its white noise extension were similar on short timescales, but the latter performed better on long timescales, while LR only outputs decay to zero for long simulations. Overall, our analysis promotes multi level LR stochastic models with memory effects, and hybrid models with linear dynamical core augmented by additive stochastic terms learned via deep learning, as a more practical, accurate, and cost effective option for ocean emulation than pure deep learning solutions.


Spectral deviation of concentration operators for the short time Fourier transform. Time frequency concentration operators restrict the integral analysis synthesis formula for the short time Fourier transform to a given compact domain. We estimate how much the corresponding eigenvalue counting function deviates from the Lebesgue measure of the time frequency domain. For window functions in the Gelfand Shilov class, the bounds almost match known asymptotics, with the advantage of being effective for concrete domains and spectral thresholds. As such our estimates allow for applications where the spectral threshold depends on the geometry of the time frequency concentration domain. We also consider window functions that decay only polynomially in time and frequency.


Minimal Schedule with Minimal Number of Agents in Attack Defence Trees. Expressing attack defence trees in a multi agent setting allows for studying a new aspect of security scenarios, namely how the number of agents and their task assignment impact the performance, e.g. attack time, of strategies executed by opposing coalitions. Optimal scheduling of agents' actions, a non trivial problem, is thus vital. We discuss associated caveats and propose an algorithm that synthesises such an assignment, targeting minimal attack time and using minimal number of agents for a given attack defence tree.


Almost G 2 manifolds with almost twistorial structures. We give the necessary and sufficient conditions for the Penrose Ward transformation to work on almost G 2 manifolds, endowed with natural almost twistorial structures.


Bounds in the Lee Metric and Optimal Codes. In this paper we investigate known Singleton like bounds in the Lee metric and characterize optimal codes, which turn out to be very few. We then focus on Plotkin like bounds in the Lee metric and present a new bound that extends and refines a previously known, and out performs it in the case of non free codes. We then compute the density of optimal codes with regard to the new bound. Finally we fill a gap in the characterization of Lee equidistant codes.


PP Rec News Recommendation with Personalized User Interest and Time aware News Popularity. Personalized news recommendation methods are widely used in online news services. These methods usually recommend news based on the matching between news content and user interest inferred from historical behaviors. However, these methods usually have difficulties in making accurate recommendations to cold start users, and tend to recommend similar news with those users have read. In general, popular news usually contain important information and can attract users with different interests. Besides, they are usually diverse in content and topic. Thus, in this paper we propose to incorporate news popularity information to alleviate the cold start and diversity problems for personalized news recommendation. In our method, the ranking score for recommending a candidate news to a target user is the combination of a personalized matching score and a news popularity score. The former is used to capture the personalized user interest in news. The latter is used to measure time aware popularity of candidate news, which is predicted based on news content, recency, and real time CTR using a unified framework. Besides, we propose a popularity aware user encoder to eliminate the popularity bias in user behaviors for accurate interest modeling. Experiments on two real world datasets show our method can effectively improve the accuracy and diversity for news recommendation.


Surgery on Anosov flows using bi contact geometry. We describe a Dehn type surgery along a Legendrian transverse knot K in a bi contact structure. We show that, when the bi contact structure defines an Anosov flow, there is a strong connection between the Anosovity of the new flow and contact geometry. We give an application to the geodesic flow on the unit tangent bundle of an hyperbolic surface. In contrast to the existing Dehn type surgeries on contact Anosov flows, for a vast class of knots our procedure does not require any restriction on the slope of the twist to generate new contact Anosov flows. We finally show that there are connections between our construction and the ones defined by Handel Thurston, Fried Goodman and Foulon Hasselblatt.


Parameterization of Forced Isotropic Turbulent Flow using Autoencoders and Generative Adversarial Networks. Autoencoders and generative neural network models have recently gained popularity in fluid mechanics due to their spontaneity and low processing time instead of high fidelity CFD simulations. Auto encoders are used as model order reduction tools in applications of fluid mechanics by compressing input high dimensional data using an encoder to map the input space into a lower dimensional latent space. Whereas, generative models such as Variational Auto encoders (VAEs) and Generative Adversarial Networks (GANs) are proving to be effective in generating solutions to chaotic models with high 'randomness' such as turbulent flows. In this study, forced isotropic turbulence flow is generated by parameterizing into some basic statistical characteristics. The models trained on pre simulated data from dependencies on these characteristics and the flow generation is then affected by varying these parameters. The latent vectors pushed along the generator models like the decoders and generators contain independent entries which can be used to create different outputs with similar properties. The use of neural network based architecture removes the need for dependency on the classical mesh based Navier Stoke equation estimation which is prominent in many CFD softwares.


One press control a tactile input method for pressure sensitive computer keyboards. This work presents One press control, a tactile input method for pressure sensitive keyboards based on the detection and classification of pressing movements on the already held down key. To seamlessly integrate the added control input with existing practices for ordinary computer keyboards, the redefined notion of virtual modifier keys is introduced. A number of application examples are given, especially to point out a potential for simplifying existing interactions by replacing modifier key combinations with single key presses. Also, a new class of interaction scenarios employing the technique is proposed, based on an interaction model named "What You Touch Is What You Get (WYTIWYG)". Here, the proposed tactile input method is used to navigate interaction options, get full previews of potential outcomes, and then either commit to one or abort altogether all in the space of one key depress release cycle. The results of user testing indicate some remaining implementation issues, as well as that the technique can be learned within about a quarter of an hour of hands on operating practice time.


Towards Crowd aware Indoor Path Planning (Extended Version). Indoor venues accommodate many people who collectively form crowds. Such crowds in turn influence people's routing choices, e.g., people may prefer to avoid crowded rooms when walking from A to B. This paper studies two types of crowd aware indoor path planning queries. The Indoor Crowd Aware Fastest Path Query (FPQ) finds a path with the shortest travel time in the presence of crowds, whereas the Indoor Least Crowded Path Query (LCPQ) finds a path encountering the least objects en route. To process the queries, we design a unified framework with three major components. First, an indoor crowd model organizes indoor topology and captures object flows between rooms. Second, a time evolving population estimator derives room populations for a future timestamp to support crowd aware routing cost computations in query processing. Third, two exact and two approximate query processing algorithms process each type of query. All algorithms are based on graph traversal over the indoor crowd model and use the same search framework with different strategies of updating the populations during the search process. All proposals are evaluated experimentally on synthetic and real data. The experimental results demonstrate the efficiency and scalability of our framework and query processing algorithms.


Large Scale Visual Food Recognition. Food recognition plays an important role in food choice and intake, which is essential to the health and well being of humans. It is thus of importance to the computer vision community, and can further support many food oriented vision and multimodal tasks. Unfortunately, we have witnessed remarkable advancements in generic visual recognition for released large scale datasets, yet largely lags in the food domain. In this paper, we introduce Food2K, which is the largest food recognition dataset with 2,000 categories and over 1 million images.Compared with existing food recognition datasets, Food2K bypasses them in both categories and images by one order of magnitude, and thus establishes a new challenging benchmark to develop advanced models for food visual representation learning. Furthermore, we propose a deep progressive region enhancement network for food recognition, which mainly consists of two components, namely progressive local feature learning and region feature enhancement. The former adopts improved progressive training to learn diverse and complementary local features, while the latter utilizes self attention to incorporate richer context with multiple scales into local features for further local feature enhancement. Extensive experiments on Food2K demonstrate the effectiveness of our proposed method. More importantly, we have verified better generalization ability of Food2K in various tasks, including food recognition, food image retrieval, cross modal recipe retrieval, food detection and segmentation. Food2K can be further explored to benefit more food relevant tasks including emerging and more complex ones (e.g., nutritional understanding of food), and the trained models on Food2K can be expected as backbones to improve the performance of more food relevant tasks. We also hope Food2K can serve as a large scale fine grained visual recognition benchmark.