Demographic Fairness in Biometric Systems What do the Experts say?. Algorithmic decision systems have frequently been labelled as "biased", "racist", "sexist", or "unfair" by numerous media outlets, organisations, and researchers. There is an ongoing debate about whether such assessments are justified and whether citizens and policymakers should be concerned. These and other related matters have recently become a hot topic in the context of biometric technologies, which are ubiquitous in personal, commercial, and governmental applications. Biometrics represent an essential component of many surveillance, access control, and operational identity management systems, thus directly or indirectly affecting billions of people all around the world. Recently, the European Association for Biometrics organised an event series with "demographic fairness in biometric systems" as an overarching theme. The events featured presentations by international experts from academic, industry, and governmental organisations and facilitated interactions and discussions between the experts and the audience. Further consultation of experts was undertaken by means of a questionnaire. This work summarises opinions of experts and findings of said events on the topic of demographic fairness in biometric systems including several important aspects such as the developments of evaluation metrics and standards as well as related issues, e.g. the need for transparency and explainability in biometric systems or legal and ethical issues.


Formation of Social Ties Influences Food Choice A Campus Wide Longitudinal Study. Nutrition is a key determinant of long term health, and social influence has long been theorized to be a key determinant of nutrition. It has been difficult to quantify the postulated role of social influence on nutrition using traditional methods such as surveys, due to the typically small scale and short duration of studies. To overcome these limitations, we leverage a novel source of data logs of 38 million food purchases made over an 8 year period on the Ecole Polytechnique Federale de Lausanne (EPFL) university campus, linked to anonymized individuals via the smartcards used to make on campus purchases. In a longitudinal observational study, we ask How is a person's food choice affected by eating with someone else whose own food choice is healthy vs. unhealthy? To estimate causal effects from the passively observed log data, we control confounds in a matched quasi experimental design we identify focal users who at first do not have any regular eating partners but then start eating with a fixed partner regularly, and we match focal users into comparison pairs such that paired users are nearly identical with respect to covariates measured before acquiring the partner, where the two focal users' new eating partners diverge in the healthiness of their respective food choice. A difference in differences analysis of the paired data yields clear evidence of social influence focal users acquiring a healthy eating partner change their habits significantly more toward healthy foods than focal users acquiring an unhealthy eating partner. We further identify foods whose purchase frequency is impacted significantly by the eating partner's healthiness of food choice. Beyond the main results, the work demonstrates the utility of passively sensed food purchase logs for deriving insights, with the potential of informing the design of public health interventions and food offerings.


Globally rigid graphs are fully reconstructible. A d dimensional framework is a pair (G,p) , where G (V,E) is a graph and p is a map from V to mathbb R d . The length of an edge uv in E in (G,p) is the distance between p(u) and p(v) . The framework is said to be globally rigid in mathbb R d if the graph G and its edge lengths uniquely determine (G,p) , up to congruence. A graph G is called globally rigid in mathbb R d if every d dimensional generic framework (G,p) is globally rigid. In this paper, we consider the problem of reconstructing a graph from the set of edge lengths arising from a generic framework. Roughly speaking, a graph G is strongly reconstructible in mathbb C d if it is uniquely determined by the set of (unlabeled) edge lengths of any generic framework (G,p) in d space, along with the number of its vertices. It is known that if G is globally rigid in mathbb R d on at least d 2 vertices, then it is strongly reconstructible in mathbb C d . We strengthen this result and show that under the same conditions, G is in fact fully reconstructible in mathbb C d , which means that the set of edge lengths alone is sufficient to uniquely reconstruct G , without any constraint on the number of vertices. We also prove that if G is globally rigid in mathbb R d on at least d 2 vertices, then the d dimensional generic rigidity matroid of G is connected. This result generalizes Hendrickson's necessary condition for global rigidity and gives rise to a new combinatorial necessary condition. Finally, we provide new families of fully reconstructible graphs and use them to answer some questions regarding unlabeled reconstructibility posed in recent papers.


Parallel Deep Learning Driven Sarcasm Detection from Pop Culture Text and English Humor Literature. Sarcasm is a sophisticated way of wrapping any immanent truth, mes sage, or even mockery within a hilarious manner. The advent of communications using social networks has mass produced new avenues of socialization. It can be further said that humor, irony, sarcasm, and wit are the four chariots of being socially funny in the modern days. In this paper, we manually extract the sarcastic word distribution features of a benchmark pop culture sarcasm corpus, containing sarcastic dialogues and monologues. We generate input sequences formed of the weighted vectors from such words. We further propose an amalgamation of four parallel deep long short term networks (pLSTM), each with distinctive activation classifier. These modules are primarily aimed at successfully detecting sarcasm from the text corpus. Our proposed model for detecting sarcasm peaks a training accuracy of 98.95 when trained with the discussed dataset. Consecutively, it obtains the highest of 98.31 overall validation accuracy on two handpicked Project Gutenberg English humor literature among all the test cases. Our approach transcends previous state of the art works on several sarcasm corpora and results in a new gold standard performance for sarcasm detection.


Mixing Human Demonstrations with Self Exploration in Experience Replay for Deep Reinforcement Learning. We investigate the effect of using human demonstration data in the replay buffer for Deep Reinforcement Learning. We use a policy gradient method with a modified experience replay buffer where a human demonstration experience is sampled with a given probability. We analyze different ratios of using demonstration data in a task where an agent attempts to reach a goal while avoiding obstacles. Our results suggest that while the agents trained by pure self exploration and pure demonstration had similar success rates, the pure demonstration model converged faster to solutions with less number of steps.


A theoretical model of Surtseyan bomb fragmentation. Surtseyan eruptions are an important class of mostly basaltic volcanic eruptions first identified in the 1960s, where erupting magma at an air water interface interacts with large quantities of slurry, a mixture of previously ejected tephra that re enters the crater together with water. During a Surtseyan eruption, hot magma bombs are ejected that initially contain pockets of slurry. Despite the formation of steam and anticipated subsequent high pressures inside these bombs, many survive to land without exploding. We seek to explain this by building and solving a simplified spherical mathematical model that describes the coupled evolution of pressure and temperature due to the flashing of liquid to vapour within a Surtseyan bomb while it is in flight. Analysis of the model provides a criterion for fragmentation of the bomb due to steam pressure buildup, and predicts that if diffusive steam flow through the porous bomb is sufficiently rapid, the bomb will survive the flight intact. This criterion explicitly relates fragmentation to bomb properties, and describes how a Surtseyan bomb can survive in flight despite containing flashing liquid water, contributing to an ongoing discussion in volcanology about the origins of the inclusions found inside bombs.


On an integral representation of the normalized trace of the k th symmetric tensor power of matrices and some applications. Let A be an n times n matrix and let vee k A be its k th symmetric tensor product. We express the normalized trace of vee k A as an integral of the k th powers of the numerical values of A over the unit sphere mathbb S n of mathbb C n with respect to the normalized Euclidean surface measure. Equivalently, this expression in turn can be interpreted as an integral representation for the (normalized) complete symmetric polynomials over mathbb C n . As applications, we present a new proof for the MacMahon Master Theorem in enumerative combinatorics. Then, our next application deals with a generalization of the work of Cuttler et al. in cite cuttler concerning the monotonicity of products of complete symmetric polynomials. In the process, we give a solution to an open problem that was raised by I. Roven c t a and L. E. Temereanca in cite roventa .


Robust Sensor Fusion Algorithms Against Voice Command Attacks in Autonomous Vehicles. With recent advances in autonomous driving, Voice Control Systems have become increasingly adopted as human vehicle interaction methods. This technology enables drivers to use voice commands to control the vehicle and will be soon available in Advanced Driver Assistance Systems (ADAS). Prior work has shown that Siri, Alexa and Cortana, are highly vulnerable to inaudible command attacks. This could be extended to ADAS in real world applications and such inaudible command threat is difficult to detect due to microphone nonlinearities. In this paper, we aim to develop a more practical solution by using camera views to defend against inaudible command attacks where ADAS are capable of detecting their environment via multi sensors. To this end, we propose a novel multimodal deep learning classification system to defend against inaudible command attacks. Our experimental results confirm the feasibility of the proposed defense methods and the best classification accuracy reaches 89.2 . Code is available at https github.com ITSEG MQ Sensor Fusion Against VoiceCommand Attacks.


The Mixed Observable Constrained Linear Quadratic Regulator Problem the Exact Solution and Practical Algorithms. This paper studies the problem of steering a linear time invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed observable settings, where the system's state is fully observable and the environment's state defining the goal location is only partially observed. In these settings, the planning problem is an infinite dimensional optimization problem where the objective is to minimize the expected cost. We show how to reformulate the control problem as a finite dimensional deterministic problem by optimizing over a trajectory tree. Leveraging this result, we demonstrate that when the environment is static, the observation model piecewise, and cost function convex, the original control problem can be reformulated as a Mixed Integer Convex Program (MICP) that can be solved to global optimality using a branch and bound algorithm. The effectiveness of the proposed approach is demonstrated on navigation tasks, where the system has to reach a goal location identified from partial observations.


Combinatorics of Serre weights in the potentially Barsotti Tate setting. Let F be a finite unramified extension of mathbb Q p and bar rho be an absolutely irreducible mod p 2 dimensional representation of the absolute Galois group of F . Let t be a tame inertial type of F . We conjecture that the deformation space parametrizing the potentially Barsotti Tate liftings of bar rho having type t depends only on the Kisin variety attached to the situation, enriched with its canonical embedding into ( mathbb P 1) f and its shape stratification. We give evidences towards this conjecture by proving that the Kisin variety determines the cardinality of the set of common Serre weights D(t, bar rho) D(t) cap D( bar rho) . Besides, we prove that this dependance is nondecreasing (the smaller is the Kisin variety, the smaller is the number of common Serre weights) and compatible with products (if the Kisin variety splits as a product, so does the number of weights).


MongeNet Efficient Sampler for Geometric Deep Learning. Recent advances in geometric deep learning introduce complex computational challenges for evaluating the distance between meshes. From a mesh model, point clouds are necessary along with a robust distance metric to assess surface quality or as part of the loss function for training models. Current methods often rely on a uniform random mesh discretization, which yields irregular sampling and noisy distance estimation. In this paper we introduce MongeNet, a fast and optimal transport based sampler that allows for an accurate discretization of a mesh with better approximation properties. We compare our method to the ubiquitous random uniform sampling and show that the approximation error is almost half with a very small computational overhead.


Cellular chain complexes of universal covers of some 3 manifolds. For a closed 3 manifold M in a certain class, we give a presentation of the cellular chain complex of the universal cover of M . The class includes all surface bundles, some surgeries of knots in S 3 , some cyclic branched cover of S 3 , and some Seifert manifolds. In application, we establish a formula for calculating the linking form of a cyclic branched cover of S 3 , and develop procedures of computing some Dijkgraaf Witten invariants.


Multi Tailed, Multi Headed, Spatial Dynamic Memory refined Text to Image Synthesis. Synthesizing high quality, realistic images from text descriptions is a challenging task, and current methods synthesize images from text in a multi stage manner, typically by first generating a rough initial image and then refining image details at subsequent stages. However, existing methods that follow this paradigm suffer from three important limitations. Firstly, they synthesize initial images without attempting to separate image attributes at a word level. As a result, object attributes of initial images (that provide a basis for subsequent refinement) are inherently entangled and ambiguous in nature. Secondly, by using common text representations for all regions, current methods prevent us from interpreting text in fundamentally different ways at different parts of an image. Different image regions are therefore only allowed to assimilate the same type of information from text at each refinement stage. Finally, current methods generate refinement features only once at each refinement stage and attempt to address all image aspects in a single shot. This single shot refinement limits the precision with which each refinement stage can learn to improve the prior image. Our proposed method introduces three novel components to address these shortcomings (1) An initial generation stage that explicitly generates separate sets of image features for each word n gram. (2) A spatial dynamic memory module for refinement of images. (3) An iterative multi headed mechanism to make it easier to improve upon multiple image aspects. Experimental results demonstrate that our Multi Headed Spatial Dynamic Memory image refinement with our Multi Tailed Word level Initial Generation (MSMT GAN) performs favourably against the previous state of the art on the CUB and COCO datasets.


An Errata for Torsion subgroups of rational elliptic curves over the compositum of all D 4 extensions of the rational numbers. In 2 , the author claims that the fields mathbb Q (D 4 infty) defined in the paper and the compositum of all D 4 extensions of mathbb Q coincide. The proof of this claim depends on a misreading of a celebrated result by Shafarevich. The purpose is to salvage the main results of 2 . That is, the classification of torsion structures of E defined over mathbb Q when base changed to the compositum of all D 4 extensions of mathbb Q main results of 2 . All the main results in 2 are still correct except that we are no longer able to prove that these two fields are equal.


Leveraging EfficientNet and Contrastive Learning for Accurate Global scale Location Estimation. In this paper, we address the problem of global scale image geolocation, proposing a mixed classification retrieval scheme. Unlike other methods that strictly tackle the problem as a classification or retrieval task, we combine the two practices in a unified solution leveraging the advantages of each approach with two different modules. The first leverages the EfficientNet architecture to assign images to a specific geographic cell in a robust way. The second introduces a new residual architecture that is trained with contrastive learning to map input images to an embedding space that minimizes the pairwise geodesic distance of same location images. For the final location estimation, the two modules are combined with a search within cell scheme, where the locations of most similar images from the predicted geographic cell are aggregated based on a spatial clustering scheme. Our approach demonstrates very competitive performance on four public datasets, achieving new state of the art performance in fine granularity scales, i.e., 15.0 at 1km range on Im2GPS3k.


PreSizE Predicting Size in E Commerce using Transformers. Recent advances in the e commerce fashion industry have led to an exploration of novel ways to enhance buyer experience via improved personalization. Predicting a proper size for an item to recommend is an important personalization challenge, and is being studied in this work. Earlier works in this field either focused on modeling explicit buyer fitment feedback or modeling of only a single aspect of the problem (e.g., specific category, brand, etc.). More recent works proposed richer models, either content based or sequence based, better accounting for content based aspects of the problem or better modeling the buyer's online journey. However, both these approaches fail in certain scenarios either when encountering unseen items (sequence based models) or when encountering new users (content based models). To address the aforementioned gaps, we propose PreSizE a novel deep learning framework which utilizes Transformers for accurate size prediction. PreSizE models the effect of both content based attributes, such as brand and category, and the buyer's purchase history on her size preferences. Using an extensive set of experiments on a large scale e commerce dataset, we demonstrate that PreSizE is capable of achieving superior prediction performance compared to previous state of the art baselines. By encoding item attributes, PreSizE better handles cold start cases with unseen items, and cases where buyers have little past purchase data. As a proof of concept, we demonstrate that size predictions made by PreSizE can be effectively integrated into an existing production recommender system yielding very effective features and significantly improving recommendations.


Random Formula Generators. In this article, we provide three generators of propositional formulae for arbitrary languages, which uniformly sample three different formulae spaces. They take the same three parameters as input, namely, a desired depth, a set of atomics and a set of logical constants (with specified arities). The first generator returns formulae of exactly the given depth, using all or some of the propositional letters. The second does the same but samples up to the given depth. The third generator outputs formulae with exactly the desired depth and all the atomics in the set. To make the generators uniform (i.e. to make them return every formula in their space with the same probability), we will prove various cardinality results about those spaces.


Differentiable Factor Graph Optimization for Learning Smoothers. A recent line of work has shown that end to end optimization of Bayesian filters can be used to learn state estimators for systems whose underlying models are difficult to hand design or tune, while retaining the core advantages of probabilistic state estimation. As an alternative approach for state estimation in these settings, we present an end to end approach for learning state estimators modeled as factor graph based smoothers. By unrolling the optimizer we use for maximum a posteriori inference in these probabilistic graphical models, we can learn probabilistic system models in the full context of an overall state estimator, while also taking advantage of the distinct accuracy and runtime advantages that smoothers offer over recursive filters. We study this approach using two fundamental state estimation problems, object tracking and visual odometry, where we demonstrate a significant improvement over existing baselines. Our work comes with an extensive code release, which includes training and evaluation scripts, as well as Python libraries for Lie theory and factor graph optimization https sites.google.com view diffsmoothing


A variational interpretation of Restricted Additive Schwarz with impedance transmission condition for the Helmholtz problem. In this paper we revisit the Restricted Additive Schwarz method for solving discretized Helmholtz problems, using impedance boundary conditions on subdomains (sometimes called ORAS). We present this method in its variational form and show that it can be seen as a finite element discretization of a parallel overlapping domain decomposition method defined at the PDE level. In a fourthcoming paper, the authors have proved certain contractive properties of the error propagation operator for this method at the PDE level, under certain geometrical assumptions. We illustrate computationally that these properties are also enjoyed by its finite element approximation, i.e., the ORAS method.


Language Models are not Models of Language. Natural Language Processing (NLP) has become one of the leading application areas in the current Artificial Intelligence boom. Transfer learning has enabled large deep learning neural networks trained on the language modeling task to vastly improve performance in almost all language tasks. Interestingly, when the models are trained with data that includes software code, they demonstrate remarkable abilities in generating functioning computer code from natural language specifications. We argue that this creates a conundrum for claims that neural models provide an alternative theory to generative phrase structure grammars in explaining how language works. Since the syntax of programming languages is determined by phrase structure grammars, successful neural models are apparently uninformative about the theoretical foundations of programming languages, and by extension, natural languages. We argue that the term language model is misleading because deep learning models are not theoretical models of language and propose the adoption of corpus model instead, which better reflects the genesis and contents of the model.


Spatial Temporal Analysis of 40,000,000,000,000 Internet Darkspace Packets. The Internet has never been more important to our society, and understanding the behavior of the Internet is essential. The Center for Applied Internet Data Analysis (CAIDA) Telescope observes a continuous stream of packets from an unsolicited darkspace representing 1 256 of the Internet. During 2019 and 2020 over 40,000,000,000,000 unique packets were collected representing the largest ever assembled public corpus of Internet traffic. Using the combined resources of the Supercomputing Centers at UC San Diego, Lawrence Berkeley National Laboratory, and MIT, the spatial temporal structure of anonymized source destination pairs from the CAIDA Telescope data has been analyzed with GraphBLAS hierarchical hypersparse matrices. These analyses provide unique insight on this unsolicited Internet darkspace traffic with the discovery of many previously unseen scaling relations. The data show a significant sustained increase in unsolicited traffic corresponding to the start of the COVID19 pandemic, but relatively little change in the underlying scaling relations associated with unique sources, source fan outs, unique links, destination fan ins, and unique destinations. This work provides a demonstration of the practical feasibility and benefit of the safe collection and analysis of significant quantities of anonymized Internet traffic.


Adversarial training in communication constrained federated learning. Federated learning enables model training over a distributed corpus of agent data. However, the trained model is vulnerable to adversarial examples, designed to elicit misclassification. We study the feasibility of using adversarial training (AT) in the federated learning setting. Furthermore, we do so assuming a fixed communication budget and non iid data distribution between participating agents. We observe a significant drop in both natural and adversarial accuracies when AT is used in the federated setting as opposed to centralized training. We attribute this to the number of epochs of AT performed locally at the agents, which in turn effects (i) drift between local models and (ii) convergence time (measured in number of communication rounds). Towards this end, we propose FedDynAT, a novel algorithm for performing AT in federated setting. Through extensive experimentation we show that FedDynAT significantly improves both natural and adversarial accuracy, as well as model convergence time by reducing the model drift.


Powered Hawkes Dirichlet Process Challenging Textual Clustering using a Flexible Temporal Prior. The textual content of a document and its publication date are intertwined. For example, the publication of a news article on a topic is influenced by previous publications on similar issues, according to underlying temporal dynamics. However, it can be challenging to retrieve meaningful information when textual information conveys little information or when temporal dynamics are hard to unveil. Furthermore, the textual content of a document is not always linked to its temporal dynamics. We develop a flexible method to create clusters of textual documents according to both their content and publication time, the Powered Dirichlet Hawkes process (PDHP). We show PDHP yields significantly better results than state of the art models when temporal information or textual content is weakly informative. The PDHP also alleviates the hypothesis that textual content and temporal dynamics are always perfectly correlated. PDHP allows retrieving textual clusters, temporal clusters, or a mixture of both with high accuracy when they are not. We demonstrate that PDHP generalizes previous work such as the Dirichlet Hawkes process (DHP) and Uniform process (UP). Finally, we illustrate the changes induced by PDHP over DHP and UP in a real world application using Reddit data.


An Update based Maximum Column Distance Coding Scheme for Index Coding. In this paper, we propose a new scalar linear coding scheme for the index coding problem called update based maximum column distance (UMCD) coding scheme. The central idea in each transmission is to code messages such that one of the receivers with the minimum size of side information is instantaneously eliminated from unsatisfied receivers. One main contribution of the paper is to prove that the other satisfied receivers can be identified after each transmission, using a polynomial time algorithm solving the well known maximum cardinality matching problem in graph theory. This leads to determining the total number of transmissions without knowing the coding coefficients. Once this number and what messages to transmit in each round are found, we then propose a method to determine all coding coefficients from a sufficiently large finite field. We provide concrete instances where the proposed UMCD coding scheme has a better broadcast performance compared to the most efficient existing coding schemes, including the recursive scheme (Arbabjolfaei and Kim, 2014) and the interlinked cycle cover (ICC) scheme (Thapa et al., 2017). We prove that the proposed UMCD coding scheme performs at least as well as the MDS coding scheme in terms of broadcast rate. By characterizing two classes of index coding instances, we show that the gap between the broadcast rates of the recursive and ICC schemes and the UMCD scheme grows linearly with the number of messages. Then, we extend the UMCD coding scheme to its vector version by applying it as a basic coding block to solve the subinstances.


Legendre pair of length 77 using complementary binary matrices with fixed marginals. We provide a search method for Legendre pairs of composite length based on generating binary matrices with fixed row and column sums from compressed, complementary integer vectors. This approach yielded the first construction of a Legendre pair of length 77 , as well as the first exhaustive generation of Legendre pairs of length 55 .


Modeling Collective Anticipation and Response on Wikipedia. The dynamics of popularity in online media are driven by a combination of endogenous spreading mechanisms and response to exogenous shocks including news and events. However, little is known about the dependence of temporal patterns of popularity on event related information, e.g. which types of events trigger long lasting activity. Here we propose a simple model that describes the dynamics around peaks of popularity by incorporating key features, i.e., the anticipatory growth and the decay of collective attention together with circadian rhythms. The proposed model allows us to develop a new method for predicting the future page view activity and for clustering time series. To validate our methodology, we collect a corpus of page view data from Wikipedia associated to a range of planned events, that are events which we know in advance will have a fixed date in the future, such as elections and sport events. Our methodology is superior to existing models in both prediction and clustering tasks. Furthermore, restricting to Wikipedia pages associated to association football, we observe that the specific realization of the event, in our case which team wins a match or the type of the match, has a significant effect on the response dynamics after the event. Our work demonstrates the importance of appropriately modeling all phases of collective attention, as well as the connection between temporal patterns of attention and characteristic underlying information of the events they represent.


Seasonal Predictability of Lightning over the Global Hotspot Regions. Skillful seasonal prediction of lightning is crucial over several global hotspot regions, as it causes severe damages to infrastructures and losses of human life. While major emphasis has been given for predicting rainfall, prediction of lightning in one season advance remained uncommon, owing to the nature of the problem, which is short lived local phenomenon. Here we show that on the seasonal time scale, lightning over the major global hot spot regions is strongly tied with slowly varying global predictors (e.g., El Nino and Southern Oscillation). Moreover, the sub seasonal variance of lightning is highly correlated with global predictors, suggesting a seminal role played by the global climate mode in shaping the local land atmosphere interactions, which eventually affects seasonal lightning variability. It is shown that the seasonal predictability of lightning over the hotspot is comparable to that of seasonal rainfall, which opens up an avenue for reliable seasonal forecasting of lightning for special awareness and preventive measures. Keywords Lightning, Seasonal forecasting, SST, Global predictors


Needmining Designing Digital Support to Elicit Needs from Social Media. Today's businesses face a high pressure to innovate in order to succeed in highly competitive markets. Successful innovations, though, typically require the identification and analysis of customer needs. While traditional, established need elicitation methods are time proven and have demonstrated their capabilities to deliver valuable insights, they lack automation and scalability and, thus, are expensive and time consuming. In this article, we propose an approach to automatically identify and quantify customer needs by utilizing a novel data source Users voluntarily and publicly expose information about themselves via social media, as for instance Facebook or Twitter. These posts may contain valuable information about the needs, wants, and demands of their authors. We apply a Design Science Research (DSR) methodology to add design knowledge and artifacts for the digitalization of innovation processes, in particular to provide digital support for the elicitation of customer needs. We want to investigate whether automated, speedy, and scalable need elicitation from social media is feasible. We concentrate on Twitter as a data source and on e mobility as an application domain. In a first design cycle we conceive, implement and evaluate a method to demonstrate the feasibility of identifying those social media posts that actually express customer needs. In a second cycle, we build on this artifact to additionally quantify the need information elicited, and prove its feasibility. Third, we integrate both developed methods into an end user software artifact and test usability in an industrial use case. Thus, we add new methods for need elicitation to the body of knowledge, and introduce concrete tooling for innovation management in practice.


Thermodynamical Material Networks for Modeling, Planning and Control of Circular Material Flows. Waste production, carbon dioxide atmospheric accumulation and dependence on finite natural resources are expressions of the unsustainability of the current industrial networks that supply fuels, energy and manufacturing products. In particular, circular manufacturing supply chains and carbon control networks are urgently needed. To model and design these and, in general, any material networks, we propose to generalize the approach used for traditional networks such as water and thermal power systems using compartmental dynamical systems thermodynamics, graph theory and the force voltage analogy. The generalized modeling methodology is explained, then challenges and future research directions are discussed. We hope this paper inspires to use dynamical systems and control, which are typically techniques used for industrial automation, for closing material flows, which is an issue of primary concern in industrial ecology and circular economy.


The ComMA Dataset V0.2 Annotating Aggression and Bias in Multilingual Social Media Discourse. In this paper, we discuss the development of a multilingual dataset annotated with a hierarchical, fine grained tagset marking different types of aggression and the "context" in which they occur. The context, here, is defined by the conversational thread in which a specific comment occurs and also the "type" of discursive role that the comment is performing with respect to the previous comment. The initial dataset, being discussed here (and made available as part of the ComMA ICON shared task), consists of a total 15,000 annotated comments in four languages Meitei, Bangla, Hindi, and Indian English collected from various social media platforms such as YouTube, Facebook, Twitter and Telegram. As is usual on social media websites, a large number of these comments are multilingual, mostly code mixed with English. The paper gives a detailed description of the tagset being used for annotation and also the process of developing a multi label, fine grained tagset that can be used for marking comments with aggression and bias of various kinds including gender bias, religious intolerance (called communal bias in the tagset), class caste bias and ethnic racial bias. We also define and discuss the tags that have been used for marking different the discursive role being performed through the comments, such as attack, defend, etc. We also present a statistical analysis of the dataset as well as results of our baseline experiments with developing an automatic aggression identification system using the dataset developed.


q-bio.BM cs.IT math.IT physics.bio-ph q-bio.PE

Emergence of functional information from multivariate correlations. The information content of symbolic sequences (such as nucleic or amino acid sequences, but also neuronal firings or strings of letters) can be calculated from an ensemble of such sequences, but because information cannot be assigned to single sequences, we cannot correlate information to other observables attached to the sequence. Here we show that an information score obtained from multivariate (multiple variable) correlations within sequences of a "training" ensemble can be used to predict observables of out of sample sequences with an accuracy that scales with the complexity of correlations, showing that functional information emerges from a hierarchy of multi variable correlations.


Scale Net Learning to Reduce Scale Differences for Large Scale Invariant Image Matching. Most image matching methods perform poorly when encountering large scale changes in images. To solve this problem, firstly, we propose a scale difference aware image matching method (SDAIM) that reduces image scale differences before local feature extraction, via resizing both images of an image pair according to an estimated scale ratio. Secondly, in order to accurately estimate the scale ratio, we propose a covisibility attention reinforced matching module (CVARM) and then design a novel neural network, termed as Scale Net, based on CVARM. The proposed CVARM can lay more stress on covisible areas within the image pair and suppress the distraction from those areas visible in only one image. Quantitative and qualitative experiments confirm that the proposed Scale Net has higher scale ratio estimation accuracy and much better generalization ability compared with all the existing scale ratio estimation methods. Further experiments on image matching and relative pose estimation tasks demonstrate that our SDAIM and Scale Net are able to greatly boost the performance of representative local features and state of the art local feature matching methods.


Faster Maximum Feasible Subsystem Solutions for Dense Constraint Matrices. Finding the largest cardinality feasible subset of an infeasible set of linear constraints is the Maximum Feasible Subsystem problem (MAX FS). Solving this problem is crucial in a wide range of applications such as machine learning and compressive sensing. Although MAX FS is NP hard, useful heuristic algorithms exist, but these can be slow for large problems. We extend the existing heuristics for the case of dense constraint matrices to greatly increase their speed while preserving or improving solution quality. We test the extended algorithms on two applications that have dense constraint matrices binary classification, and sparse recovery in compressive sensing. In both cases, speed is greatly increased with no loss of accuracy.


The Auslander Reiten quivers of string algebras of affine type widetilde C and a conjecture by Geiss Leclerc Schr " o er. In this paper, we study representations of certain string algebras, which are referred to as of affine type widetilde C . We introduce minimal string modules and apply them to explicitly describe components of the Auslander Reiten quivers of the string algebras and tau locally free modules defined by Geiss Lerclerc Schr " o er. As an application, we prove Geiss Leclerc Schr " o er's conjecture on the correspondence between positive roots of type widetilde C and tau locally free modules of the corresponding string algebras.


Towards Unsupervised Domain Generalization. Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or unavailable, however. Since unlabeled data are far more accessible, we seek to explore how unsupervised learning can help deep models generalize across domains. Specifically, we study a novel generalization problem called unsupervised domain generalization (UDG), which aims to learn generalizable models with unlabeled data and analyze the effects of pre training on DG. In UDG, models are pretrained with unlabeled data from various source domains before being trained on labeled source data and eventually tested on unseen target domains. Then we propose a method named Domain Aware Representation LearnING (DARLING) to cope with the significant and misleading heterogeneity within unlabeled pretraining data and severe distribution shifts between source and target data. Surprisingly we observe that DARLING can not only counterbalance the scarcity of labeled data but also further strengthen the generalization ability of models when the labeled data are insufficient. As a pretraining approach, DARLING shows superior or comparable performance compared with ImageNet pretraining protocol even when the available data are unlabeled and of a vastly smaller amount compared to ImageNet, which may shed light on improving generalization with large scale unlabeled data.


CloudChain A Cloud Blockchain Using Shared Memory Consensus and RDMA. Blockchain technologies can enable secure computing environments among mistrusting parties. Permissioned blockchains are particularly enlightened by companies, enterprises, and government agencies due to their efficiency, customizability, and governance friendly features. Obviously, seamlessly fusing blockchain and cloud computing can significantly benefit permissioned blockchains nevertheless, most blockchains implemented on clouds are originally designed for loosely coupled networks where nodes communicate asynchronously, failing to take advantages of the closely coupled nature of cloud servers. In this paper, we propose an innovative cloud oriented blockchain CloudChain, which is a modularized three layer system composed of the network layer, consensus layer, and blockchain layer. CloudChain is based on a shared memory model where nodes communicate synchronously by direct memory accesses. We realize the shared memory model with the Remote Direct Memory Access technology, based on which we propose a shared memory consensus algorithm to ensure presistence and liveness, the two crucial blockchain security properties countering Byzantine nodes. We also implement a CloudChain prototype based on a RoCEv2 based testbed to experimentally validate our design, and the results verify the feasibility and efficiency of CloudChain.


General Measure Extensions of Projection Bodies. The inequalities of Petty and Zhang are affine isoperimetric type inequalities providing sharp bounds for text vol n 1 n (K) text vol n( Pi circ K), where Pi K is a projection body of a convex body K . In this paper, we present a number of generalizations of Zhang's inequality to the setting of arbitrary measures. In addition, we introduce extensions of the projection body operator Pi to the setting of arbitrary measures and functions, while providing associated inequalities for this operator in particular, Zhang type inequalities. Throughout, we apply shown results to the standard Gaussian measure.


Schr "odinger's Ballot Quantum Information and the Violation of Arrow's Impossibility Theorem. In this paper we study Arrow's Impossibility Theorem in the quantum setting. Our work is based on the work of Bao and Halpern, in which it is proved that the quantum analogue of Arrow's Impossibility Theorem is not valid. However, we feel unsatisfied about the proof presented there. Moreover, the definition of Quantum Independence of Irrelevant Alternatives (QIIA) seems not appropriate to us. In this paper, we give a better definition of QIIA, which properly captures the idea of the independence of irrelevant alternatives, and a detailed proof of the violation of Arrow's Impossibility Theorem in the quantum setting with the modified definition.


UIUC BioNLP at SemEval 2021 Task 11 A Cascade of Neural Models for Structuring Scholarly NLP Contributions. We propose a cascade of neural models that performs sentence classification, phrase recognition, and triple extraction to automatically structure the scholarly contributions of NLP publications. To identify the most important contribution sentences in a paper, we used a BERT based classifier with positional features (Subtask 1). A BERT CRF model was used to recognize and characterize relevant phrases in contribution sentences (Subtask 2). We categorized the triples into several types based on whether and how their elements were expressed in text, and addressed each type using separate BERT based classifiers as well as rules (Subtask 3). Our system was officially ranked second in Phase 1 evaluation and first in both parts of Phase 2 evaluation. After fixing a submission error in Pharse 1, our approach yields the best results overall. In this paper, in addition to a system description, we also provide further analysis of our results, highlighting its strengths and limitations. We make our code publicly available at https github.com Liu Hy nlp contrib graph.


Seismic Tomography with Random Batch Gradient Reconstruction. Seismic tomography solves high dimensional optimization problems to image subsurface structures of Earth. In this paper, we propose to use random batch methods to construct the gradient used for iterations in seismic tomography. Specifically, we use the frozen Gaussian approximation to compute seismic wave propagation, and then construct stochastic gradients by random batch methods. The method inherits the spirit of stochastic gradient descent methods for solving high dimensional optimization problems. The proposed idea is general in the sense that it does not rely on the usage of the frozen Gaussian approximation, and one can replace it with any other efficient wave propagation solvers, e.g., Gaussian beam methods. We prove the convergence of the random batch method in the mean square sense, and show the numerical performance of the proposed method by two dimensional and three dimensional examples of wave equation based travel time inversion and full waveform inversion, respectively.


How does fake news spread? Understanding pathways of disinformation spread through APIs. What are the pathways for spreading disinformation on social media platforms? This article addresses this question by collecting, categorising, and situating an extensive body of research on how application programming interfaces (APIs) provided by social media platforms facilitate the spread of disinformation. We first examine the landscape of official social media APIs, then perform quantitative research on the open source code repositories GitHub and GitLab to understand the usage patterns of these APIs. By inspecting the code repositories, we classify developers' usage of the APIs as official and unofficial, and further develop a four stage framework characterising pathways for spreading disinformation on social media platforms. We further highlight how the stages in the framework were activated during the 2016 US Presidential Elections, before providing policy recommendations for issues relating to access to APIs, algorithmic content, advertisements, and suggest rapid response to coordinate campaigns, development of collaborative, and participatory approaches as well as government stewardship in the regulation of social media platforms.


Can Active Learning Preemptively Mitigate Fairness Issues?. Dataset bias is one of the prevailing causes of unfairness in machine learning. Addressing fairness at the data collection and dataset preparation stages therefore becomes an essential part of training fairer algorithms. In particular, active learning (AL) algorithms show promise for the task by drawing importance to the most informative training samples. However, the effect and interaction between existing AL algorithms and algorithmic fairness remain under explored. In this paper, we study whether models trained with uncertainty based AL heuristics such as BALD are fairer in their decisions with respect to a protected class than those trained with identically independently distributed (i.i.d.) sampling. We found a significant improvement on predictive parity when using BALD, while also improving accuracy compared to i.i.d. sampling. We also explore the interaction of algorithmic fairness methods such as gradient reversal (GRAD) and BALD. We found that, while addressing different fairness issues, their interaction further improves the results on most benchmarks and metrics we explored.


Use of Machine Learning Technique to maximize the signal over background for H rightarrow tau tau . In recent years, artificial neural networks (ANNs) have won numerous contests in pattern recognition and machine learning. ANNS have been applied to problems ranging from speech recognition to prediction of protein secondary structure, classification of cancers, and gene prediction. Here, we intend to maximize the chances of finding the Higgs boson decays to two tau leptons in the pseudo dataset using a Machine Learning technique to classify the recorded events as signal or background.


Style Aware Normalized Loss for Improving Arbitrary Style Transfer. Neural Style Transfer (NST) has quickly evolved from single style to infinite style models, also known as Arbitrary Style Transfer (AST). Although appealing results have been widely reported in literature, our empirical studies on four well known AST approaches (GoogleMagenta, AdaIN, LinearTransfer, and SANet) show that more than 50 of the time, AST stylized images are not acceptable to human users, typically due to under or over stylization. We systematically study the cause of this imbalanced style transferability (IST) and propose a simple yet effective solution to mitigate this issue. Our studies show that the IST issue is related to the conventional AST style loss, and reveal that the root cause is the equal weightage of training samples irrespective of the properties of their corresponding style images, which biases the model towards certain styles. Through investigation of the theoretical bounds of the AST style loss, we propose a new loss that largely overcomes IST. Theoretical analysis and experimental results validate the effectiveness of our loss, with over 80 relative improvement in style deception rate and 98 relatively higher preference in human evaluation.


D REX Dialogue Relation Extraction with Explanations. Existing research studies on cross sentence relation extraction in long form multi party conversations aim to improve relation extraction without considering the explainability of such methods. This work addresses that gap by focusing on extracting explanations that indicate that a relation exists while using only partially labeled data. We propose our model agnostic framework, D REX, a policy guided semi supervised algorithm that explains and ranks relations. We frame relation extraction as a re ranking task and include relation and entity specific explanations as an intermediate step of the inference process. We find that about 90 of the time, human annotators prefer D REX's explanations over a strong BERT based joint relation extraction and explanation model. Finally, our evaluations on a dialogue relation extraction dataset show that our method is simple yet effective and achieves a state of the art F1 score on relation extraction, improving upon existing methods by 13.5 .


Selective Ensembles for Consistent Predictions. Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in high stakes contexts, such as medical diagnosis and finance. We show that this inconsistent behavior extends beyond predictions to feature attributions, which may likewise have negative implications for the intelligibility of a model, and one's ability to find recourse for subjects. We then introduce selective ensembles to mitigate such inconsistencies by applying hypothesis testing to the predictions of a set of models trained using randomly selected starting conditions importantly, selective ensembles can abstain in cases where a consistent outcome cannot be achieved up to a specified confidence level. We prove that that prediction disagreement between selective ensembles is bounded, and empirically demonstrate that selective ensembles achieve consistent predictions and feature attributions while maintaining low abstention rates. On several benchmark datasets, selective ensembles reach zero inconsistently predicted points, with abstention rates as low 1.5 .


Centralizers of torsion in 3 manifold groups. We show that if P is a PD 3 complex and g in pi 1(P) has finite order 1 and infinite centraliser then pi 1(P) retracts onto Z 2Z oplus mathbb Z . If P is an irreducible closed 3 manifold then it follows from the Projective Plane Theorem that P cong RP 2 times S 1 .


Towards Multi Agent Reinforcement Learning using Quantum Boltzmann Machines. Reinforcement learning has driven impressive advances in machine learning. Simultaneously, quantum enhanced machine learning algorithms using quantum annealing underlie heavy developments. Recently, a multi agent reinforcement learning (MARL) architecture combining both paradigms has been proposed. This novel algorithm, which utilizes Quantum Boltzmann Machines (QBMs) for Q value approximation has outperformed regular deep reinforcement learning in terms of time steps needed to converge. However, this algorithm was restricted to single agent and small 2x2 multi agent grid domains. In this work, we propose an extension to the original concept in order to solve more challenging problems. Similar to classic DQNs, we add an experience replay buffer and use different networks for approximating the target and policy values. The experimental results show that learning becomes more stable and enables agents to find optimal policies in grid domains with higher complexity. Additionally, we assess how parameter sharing influences the agents behavior in multi agent domains. Quantum sampling proves to be a promising method for reinforcement learning tasks, but is currently limited by the QPU size and therefore by the size of the input and Boltzmann machine.


A survey on the Koszul homology algebra. The Koszul homology algebra of a commutative local (or graded) ring R tends to reflect important information about the ring R and its properties. In fact, certain classes of rings are characterized by the algebra structure on their Koszul homologies. In this paper we survey some classical results on the Koszul homology algebras of such rings and highlight some applications. We report on recent progress on the Koszul homology algebras of Koszul algebras and examine some open questions on the topic.


A possible link between turbulence and plasma heating. Numerical simulations and experimental results have shown that current sheets formation in space plasmas can be associated with enhanced vorticity. Also, in simulations the generation of such structures is associated with strong plasma heating. Here, we compare four point measurements in the terrestrial magnetosheath turbulence from the Multiscale magnetospheric mission (MMS) of the flow vorticity and the magnetic field curlometer versus their corresponding one point proxies PVI(V) and PVI(B) based on the Partial Variance of Increments (PVI) method. We show that the one point proxies are sufficiently precise in identifying not only the generic features of the current sheets and vortices statistically, but also their appearance in groups associated with plasma heating. The method has been further applied to the region of the turbulent sheath of an interplanetary coronal mass ejection (ICME) observed at L1 by WIND spacecraft. We observe current sheets and vorticity associated heating in larger groups (blobs), which so far have not been considered in the literature on turbulent data analysis. The blobs represent extended spatial regions of activity with enhanced regional correlations between the occurrence of conditioned currents and vorticity, which at the same time are also correlated with enhanced temperatures. This heating mechanism is substantially different from the plasma heating in the vicinity of the ICME shock, where plasma beta is strongly fluctuating and there is no vorticity. The proposed method describes a new pathway for linking the plasma heating and plasma turbulence, and it is relevant to in situ observations when only single spacecraft measurements are available.


End to End Referring Video Object Segmentation with Multimodal Transformers. The referring video object segmentation task (RVOS) involves segmentation of a text referred object instance in the frames of a given video. Due to the complex nature of this multimodal task, which combines text reasoning, video understanding, instance segmentation and tracking, existing approaches typically rely on sophisticated pipelines in order to tackle it. In this paper, we propose a simple Transformer based approach to RVOS. Our framework, termed Multimodal Tracking Transformer (MTTR), models the RVOS task as a sequence prediction problem. Following recent advancements in computer vision and natural language processing, MTTR is based on the realization that video and text can be processed together effectively and elegantly by a single multimodal Transformer model. MTTR is end to end trainable, free of text related inductive bias components and requires no additional mask refinement post processing steps. As such, it simplifies the RVOS pipeline considerably compared to existing methods. Evaluation on standard benchmarks reveals that MTTR significantly outperforms previous art across multiple metrics. In particular, MTTR shows impressive 5.7 and 5.0 mAP gains on the A2D Sentences and JHMDB Sentences datasets respectively, while processing 76 frames per second. In addition, we report strong results on the public validation set of Refer YouTube VOS, a more challenging RVOS dataset that has yet to receive the attention of researchers. The code to reproduce our experiments is available at https github.com mttr2021 MTTR


A Moving Discontinuous Galerkin Finite Element Method with Interface Conservation Enforcement for Compressible Flows. A moving discontinuous Galerkin finite element method with interface conservation enforcement (MDG ICE) is developed for solving the compressible Euler equations. The MDG ICE method is based on the space time DG formulation, where both flow field and grid geometry are considered as independent variables and the conservation laws are enforced both on discrete elements and element interfaces. The element conservation laws are solved in the standard discontinuous solution space to determine conservative quantities, while the interface conservation is enforced using a variational formulation in a continuous space to determine discrete grid geometry. The resulting over determined system of nonlinear equations arising from the MDG ICE formulation can then be solved in a least squares sense, leading to an unconstrained nonlinear least squares problem that is regularized and solved by Levenberg Marquardt method. A number of numerical experiments for compressible flows are conducted to assess the accuracy and robustness of the MDG ICE method. Numerical results obtained indicate that the MDG ICE method is able to implicitly detect and track all types of discontinuities via interface conservation enforcement and satisfy the conservation law on both elements and interfaces via grid movement and grid management, demonstrating that an exponential rate of convergence for Sod and Lax Harden shock tube problems can be achieved and highly accurate solutions without overheating to both double rarefaction wave and Noh problems can be obtained.


AStitchInLanguageModels Dataset and Methods for the Exploration of Idiomaticity in Pre Trained Language Models. Despite their success in a variety of NLP tasks, pre trained language models, due to their heavy reliance on compositionality, fail in effectively capturing the meanings of multiword expressions (MWEs), especially idioms. Therefore, datasets and methods to improve the representation of MWEs are urgently needed. Existing datasets are limited to providing the degree of idiomaticity of expressions along with the literal and, where applicable, (a single) non literal interpretation of MWEs. This work presents a novel dataset of naturally occurring sentences containing MWEs manually classified into a fine grained set of meanings, spanning both English and Portuguese. We use this dataset in two tasks designed to test i) a language model's ability to detect idiom usage, and ii) the effectiveness of a language model in generating representations of sentences containing idioms. Our experiments demonstrate that, on the task of detecting idiomatic usage, these models perform reasonably well in the one shot and few shot scenarios, but that there is significant scope for improvement in the zero shot scenario. On the task of representing idiomaticity, we find that pre training is not always effective, while fine tuning could provide a sample efficient method of learning representations of sentences containing MWEs.


Promoting the Acquisition of Hardware Reverse Engineering Skills. This full research paper focuses on skill acquisition in Hardware Reverse Engineering (HRE) an important field of cyber security. HRE is a prevalent technique routinely employed by security engineers (i) to detect malicious hardware manipulations, (ii) to conduct VLSI failure analysis, (iii) to identify IP infringements, and (iv) to perform competitive analyses. Even though the scientific community and industry have a high demand for HRE experts, there is a lack of educational courses. We developed a university level HRE course based on general cognitive psychological research on skill acquisition, as research on the acquisition of HRE skills is lacking thus far. To investigate how novices acquire HRE skills in our course, we conducted two studies with students on different levels of prior knowledge. Our results show that cognitive factors (e.g., working memory), and prior experiences (e.g., in symmetric cryptography) influence the acquisition of HRE skills. We conclude by discussing implications for future HRE courses and by outlining ideas for future research that would lead to a more comprehensive understanding of skill acquisition in this important field of cyber security.


PD 3 complexes bound. We show that every PD 3 complex P is the boundary of a PD 4 pair (Z,P) . If P is orientable we may assume that pi 1(Z) 1 . We show also that if P has a manifold 1 skeleton the it is homotopy equivalent to a closed 3 manifold.


Understanding Barriers and Design Opportunities to Improve Healthcare and QOL for Older Adults through Voice Assistants. Voice based Intelligent Virtual Assistants (IVAs) promise to improve healthcare management and Quality of Life (QOL) by introducing the paradigm of hands free and eye free interactions. However, there has been little understanding regarding the challenges for designing such systems for older adults, especially when it comes to healthcare related tasks. To tackle this, we consider the processes of care delivery and QOL enhancements for older adults as a collaborative task between patients and providers. By interviewing 16 older adults living independently or semi independently and 5 providers, we identified 12 barriers that older adults might encounter during daily routine and while managing health. We ultimately highlighted key design challenges and opportunities that might be introduced when integrating voice based IVAs into the life of older adults. Our work will benefit practitioners who study and attempt to create full fledged IVA powered smart devices to deliver better care and support an increased QOL for aging populations.


ChineseBERT Chinese Pretraining Enhanced by Glyph and Pinyin Information. Recent pretraining models in Chinese neglect two important aspects specific to the Chinese language glyph and pinyin, which carry significant syntax and semantic information for language understanding. In this work, we propose ChineseBERT, which incorporates both the it glyph and it pinyin information of Chinese characters into language model pretraining. The glyph embedding is obtained based on different fonts of a Chinese character, being able to capture character semantics from the visual features, and the pinyin embedding characterizes the pronunciation of Chinese characters, which handles the highly prevalent heteronym phenomenon in Chinese (the same character has different pronunciations with different meanings). Pretrained on large scale unlabeled Chinese corpus, the proposed ChineseBERT model yields significant performance boost over baseline models with fewer training steps. The porpsoed model achieves new SOTA performances on a wide range of Chinese NLP tasks, including machine reading comprehension, natural language inference, text classification, sentence pair matching, and competitive performances in named entity recognition. Code and pretrained models are publicly available at https github.com ShannonAI ChineseBert.


Real time Instance Segmentation with Discriminative Orientation Maps. Although instance segmentation has made considerable advancement over recent years, it's still a challenge to design high accuracy algorithms with real time performance. In this paper, we propose a real time instance segmentation framework termed OrienMask. Upon the one stage object detector YOLOv3, a mask head is added to predict some discriminative orientation maps, which are explicitly defined as spatial offset vectors for both foreground and background pixels. Thanks to the discrimination ability of orientation maps, masks can be recovered without the need for extra foreground segmentation. All instances that match with the same anchor size share a common orientation map. This special sharing strategy reduces the amortized memory utilization for mask predictions but without loss of mask granularity. Given the surviving box predictions after NMS, instance masks can be concurrently constructed from the corresponding orientation maps with low complexity. Owing to the concise design for mask representation and its effective integration with the anchor based object detector, our method is qualified under real time conditions while maintaining competitive accuracy. Experiments on COCO benchmark show that OrienMask achieves 34.8 mask AP at the speed of 42.7 fps evaluated with a single RTX 2080 Ti. The code is available at https github.com duwt OrienMask.


GMRES algorithms over 35 years. This paper is about GMRES algorithms for the solution of nonsingular linear systems. We first consider basic algorithms and study their convergence. We then focus on acceleration strategies and parallel algorithms that are useful for solving challenging systems. We also briefly discuss other problems, such as systems with multiple right hand sides, shifted systems, and singular systems.


CogNet Bridging Linguistic Knowledge, World Knowledge and Commonsense Knowledge. In this paper, we present CogNet, a knowledge base (KB) dedicated to integrating three types of knowledge (1) linguistic knowledge from FrameNet, which schematically describes situations, objects and events. (2) world knowledge from YAGO, Freebase, DBpedia and Wikidata, which provides explicit knowledge about specific instances. (3) commonsense knowledge from ConceptNet, which describes implicit general facts. To model these different types of knowledge consistently, we introduce a three level unified frame styled representation architecture. To integrate free form commonsense knowledge with other structured knowledge, we propose a strategy that combines automated labeling and crowdsourced annotation. At present, CogNet integrates 1,000 semantic frames from linguistic KBs, 20,000,000 frame instances from world KBs, as well as 90,000 commonsense assertions from commonsense KBs. All these data can be easily queried and explored on our online platform, and free to download in RDF format for utilization under a CC BY SA 4.0 license. The demo and data are available at http cognet.top .


Dihedral and cyclic symmetric maps on surfaces. If the face mbox cycles at all the vertices in a map are of the same type, then the map is said to be a semi equivelar map. Automorphism (symmetry) of a map can be thought of as a permutation of the vertices which preserves the vertex mbox edge mbox face incidences in the embedding. The set of all symmetries forms the symmetry group. In this article, we discuss the maps' symmetric groups on higher genus surfaces. In particular, we show that there are at least 39 types of the semi equivelar maps on the surface with Euler char. 2m, m ge 2 and the symmetry groups of the maps are isomorphic to the dihedral group or cyclic group. Further, we prove that these 39 types of semi equivelar maps are the only types on the surface with Euler char. 2 . Moreover, we know the complete list of semi equivelar maps (up to isomorphism) for a few types. We extend this list to one more type and can classify others similarly. We skip this part in this article.


Efficient Spiking Neural Networks with Radix Encoding. Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event driven computation mechanism and replacement of energy consuming weight multiplications with additions. However, in order to reach accuracy of its ANN counterpart, it usually requires long spike trains to ensure the accuracy. Traditionally, a spike train needs around one thousand time steps to approach similar accuracy as its ANN counterpart. This offsets the computation efficiency brought by SNNs because longer spike trains mean a larger number of operations and longer latency. In this paper, we propose a radix encoded SNN with ultra short spike trains. In the new model, the spike train takes less than ten time steps. Experiments show that our method demonstrates 25X speedup and 1.1 increment on accuracy, compared with the state of the art work on VGG 16 network architecture and CIFAR 10 dataset.


Non degeneracy and existence of new solutions for the Schr "odinger equations. We consider the following nonlinear problem (P) quad quad Delta u V( y )u u p , quad u 0 quad mbox in mathbb R N, quad u in H 1( mathbb R N), where V(r) is a positive function, 1 p frac N 2 N 2 . We show that the multi bump solutions constructed in 20 is non degenerate in a suitable symmetric space. We also use this non degenerate result to construct new solutions for (P).


Uncertainty quantification in non rigid image registration via stochastic gradient Markov chain Monte Carlo. We develop a new Bayesian model for non rigid registration of three dimensional medical images, with a focus on uncertainty quantification. Probabilistic registration of large images with calibrated uncertainty estimates is difficult for both computational and modelling reasons. To address the computational issues, we explore connections between the Markov chain Monte Carlo by backpropagation and the variational inference by backpropagation frameworks, in order to efficiently draw samples from the posterior distribution of transformation parameters. To address the modelling issues, we formulate a Bayesian model for image registration that overcomes the existing barriers when using a dense, high dimensional, and diffeomorphic transformation parametrisation. This results in improved calibration of uncertainty estimates. We compare the model in terms of both image registration accuracy and uncertainty quantification to VoxelMorph, a state of the art image registration model based on deep learning.


Improving Latency with Active Queue Management (AQM) During COVID 19. During the COVID 19 pandemic the Comcast network performed well in response to unprecedented changes in Internet usage and video communications applications that are sensitive to network latency have exploded in popularity. However, in today's typical networks such as a home network those applications often degrade if they are sharing a network link with other network traffic. This is a problem caused by a network design flaw often described using the term 'buffer bloat'. Several years ago, Comcast helped to fund research and development in the technical community into new Active Queue Management (AQM) techniques to eliminate this issue and AQM was later built into Data Over Cable Service Interface Specification (DOCSIS) standards. Just prior to the pandemic, Comcast also deployed a large scale network performance measurement system that included a latency under load test. In addition, Comcast happened to deploy two otherwise identical cable modems one with upstream AQM enabled, and the other without. This fortuitous confluence of events has enabled Comcast to perform a comparative analysis of the differences between cable modem gateways using AQM with those that lack that enhancement, at a unique level of scale across many months of time and millions of devices. The data reveals significantly better upstream latency under load performance when AQM is used. For the device with AQM, most of the latency under load tests resulted in 15 30 milliseconds of latency. In comparison, the device without AQM averaged roughly 250 milliseconds of latency, between 8 16 times higher, a highly significant difference to the end user quality of experience. These large scale measurement comparisons should provide additional data to justify accelerated deployment of AQM in DOCSIS and other Internet Service Provider networks and user purchased home network equipment.


Deformable Capsules for Object Detection. Capsule networks promise significant benefits over convolutional networks by storing stronger internal representations, and routing information based on the agreement between intermediate representations' projections. Despite this, their success has been mostly limited to small scale classification datasets due to their computationally expensive nature. Recent studies have partially overcome this burden by locally constraining the dynamic routing of features with convolutional capsules. Though memory efficient, convolutional capsules impose geometric constraints which fundamentally limit the ability of capsules to model the pose deformation of objects. Further, they do not address the bigger memory concern of class capsules scaling up to bigger tasks such as detection or large scale classification. In this study, we introduce deformable capsules (DeformCaps), a new capsule structure (SplitCaps), and a novel dynamic routing algorithm (SE Routing) to balance computational efficiency with the need for modeling a large number of objects and classes. We demonstrate that the proposed methods allow capsules to efficiently scale up to large scale computer vision tasks for the first time, and create the first ever capsule network for object detection in the literature. Our proposed architecture is a one stage detection framework and obtains results on MS COCO which are on par with state of the art one stage CNN based methods, while producing fewer false positive detections.


Optimal strategies in fractional games vertex cover and domination. In a hypergraph with vertex set V and edge set E , a real valued function f V to 0, 1 is a fractional transversal if sum v in e f(v) ge 1 for every edge e in E . Its size is f sum v in V f(v) , and the fractional transversal number is the smallest possible f . We consider a game scenario where two players with opposite goals construct a fractional transversal incrementally, trying to minimize and maximize f , respectively. We prove that both players have strategies to achieve their common optimum, and they can reach their goals using rational weights.


SwissDial Parallel Multidialectal Corpus of Spoken Swiss German. Swiss German is a dialect continuum whose natively acquired dialects significantly differ from the formal variety of the language. These dialects are mostly used for verbal communication and do not have standard orthography. This has led to a lack of annotated datasets, rendering the use of many NLP methods infeasible. In this paper, we introduce the first annotated parallel corpus of spoken Swiss German across 8 major dialects, plus a Standard German reference. Our goal has been to create and to make available a basic dataset for employing data driven NLP applications in Swiss German. We present our data collection procedure in detail and validate the quality of our corpus by conducting experiments with the recent neural models for speech synthesis.


Computer vision in automated parking systems Design, implementation and challenges. Automated driving is an active area of research in both industry and academia. Automated Parking, which is automated driving in a restricted scenario of parking with low speed manoeuvring, is a key enabling product for fully autonomous driving systems. It is also an important milestone from the perspective of a higher end system built from the previous generation driver assistance systems comprising of collision warning, pedestrian detection, etc. In this paper, we discuss the design and implementation of an automated parking system from the perspective of computer vision algorithms. Designing a low cost system with functional safety is challenging and leads to a large gap between the prototype and the end product, in order to handle all the corner cases. We demonstrate how camera systems are crucial for addressing a range of automated parking use cases and also, to add robustness to systems based on active distance measuring sensors, such as ultrasonics and radar. The key vision modules which realize the parking use cases are 3D reconstruction, parking slot marking recognition, freespace and vehicle pedestrian detection. We detail the important parking use cases and demonstrate how to combine the vision modules to form a robust parking system. To the best of the authors' knowledge, this is the first detailed discussion of a systemic view of a commercial automated parking system.


Bilinear Optimal Control of an Advection reaction diffusion System. We consider the bilinear optimal control of an advection reaction diffusion system, where the control arises as the velocity field in the advection term. Such a problem is generally challenging from both theoretical analysis and algorithmic design perspectives mainly because the state variable depends nonlinearly on the control variable and an additional divergence free constraint on the control is coupled together with the state equation. Mathematically, the proof of the existence of optimal solutions is delicate, and up to now, only some results are known for a few special cases where additional restrictions are imposed on the space dimension and the regularity of the control. We prove the existence of optimal controls and derive the first order optimality conditions in general settings without any extra assumption. Computationally, the well known conjugate gradient (CG) method can be applied conceptually. However, due to the additional divergence free constraint on the control variable and the nonlinear relation between the state and control variables, it is challenging to compute the gradient and the optimal stepsize at each CG iteration, and thus nontrivial to implement the CG method. To address these issues, we advocate a fast inner preconditioned CG method to ensure the divergence free constraint and an efficient inexactness strategy to determine an appropriate stepsize. An easily implementable nested CG method is thus proposed for solving such a complicated problem. For the numerical discretization, we combine finite difference methods for the time discretization and finite element methods for the space discretization. Efficiency of the proposed nested CG method is promisingly validated by the results of some preliminary numerical experiments.


Influential Node Ranking in Complex Networks Using A Randomized DynamicsSensitive Approach. Identifying the most influential nodes in information networks has been the focus of many research studies. This problem has crucial applications in various contexts including biology, medicine, and social science, such as controlling the propagation of viruses or rumours in real world networks. While existing methods mostly employ local neighbourhood features which heavily rely on the network structure and disregard the underlying diffusion dynamics, in this work we present a randomized sampling algorithm that not only takes into account the local and global structural features of the network but also considers the underlying diffusion dynamics and its parameters. The main idea is to compute the influentiality of a node through reachability from that node in a set of random graphs. We use a hyper graph to capture the reachability from nodes in the original network, and theoretically argue that the hypergraph can be used to approximate the theoretical influentiality of nodes in the original graph with a factor of 1 epsilon. The performance of the proposed model is also evaluated empirically by measuring the correlation between the ranking generated by the proposed method and the ground truth ranking. Our results show that the proposed method substantially outperforms state of the art methods and achieves the highest correlation with the ground truth ranking, while the generated ranking has a high level of uniqueness and uniformity. Theoretical and practical analysis of the running time of the algorithm also confirms that the proposed method maintains a competitive running time in comparison to the state of the art methods.


Telegraph process with elastic boundary at the origin. We investigate the one dimensional telegraph random process in the presence of an elastic boundary at the origin. This process describes a finite velocity random motion that alternates between two possible directions of motion (positive or negative). When the particle hits the origin, it is either absorbed, with probability alpha , or reflected upwards, with probability 1 alpha . In the case of exponentially distributed random times between consecutive changes of direction, we obtain the distribution of the renewal cycles and of the absorption time at the origin. This investigation is performed both in the case of motion starting from the origin and non zero initial state. We also study the probability law of the process within a renewal cycle.


Integrable LCK manifolds. We study a natural class of LCK manifolds that we call integrable LCK manifolds those where the anti Lee form eta corresponds to an integrable distribution. As an application we obtain a characterization of unimodular integrable LCK Lie algebras as K "ahler Lie algebras equipped with suitable derivations.


UA GEC Grammatical Error Correction and Fluency Corpus for the Ukrainian Language. We present a corpus professionally annotated for grammatical error correction (GEC) and fluency edits in the Ukrainian language. To the best of our knowledge, this is the first GEC corpus for the Ukrainian language. We collected texts with errors (20,715 sentences) from a diverse pool of contributors, including both native and non native speakers. The data cover a wide variety of writing domains, from text chats and essays to formal writing. Professional proofreaders corrected and annotated the corpus for errors relating to fluency, grammar, punctuation, and spelling. This corpus can be used for developing and evaluating GEC systems in Ukrainian. More generally, it can be used for researching multilingual and low resource NLP, morphologically rich languages, document level GEC, and fluency correction. The corpus is publicly available at https github.com grammarly ua gec


A remark on conductor, depth and principal congruence subgroups. In this paper we study a relation between conductor, depth, and the level of principal congruence subgroups for irreducible admissible representations of rm GL n(F) for a non archimedean local field F of characteristic zero. Some global and local applications are also discussed.


cs.LG cs.AI physics.comp-ph physics.data-an

Uniform in Phase Space Data Selection with Iterative Normalizing Flows. Improvements in computational and experimental capabilities are rapidly increasing the amount of scientific data that is routinely generated. In applications that are constrained by memory and computational intensity, excessively large datasets may hinder scientific discovery, making data reduction a critical component of data driven methods. Datasets are growing in two directions the number of data points and their dimensionality. Whereas data compression techniques are concerned with reducing dimensionality, the focus here is on reducing the number of data points. A strategy is proposed to select data points such that they uniformly span the phase space of the data. The algorithm proposed relies on estimating the probability map of the data and using it to construct an acceptance probability. An iterative method is used to accurately estimate the probability of the rare data points when only a small subset of the dataset is used to construct the probability map. Instead of binning the phase space to estimate the probability map, its functional form is approximated with a normalizing flow. Therefore, the method naturally extends to high dimensional datasets. The proposed framework is demonstrated as a viable pathway to enable data efficient machine learning when abundant data is available. An implementation of the method is available in a companion repository (https github.com NREL Phase space sampling).


Dehn functions of coabelian subgroups of direct products of groups. We develop new methods for computing the precise Dehn functions of coabelian subgroups of direct products of groups, that is, subgroups which arise as kernels of homomorphisms from the direct product onto a free abelian group. These improve and generalise previous results by Carter and Forester on Dehn functions of level sets in products of simply connected cube complexes, by Bridson on Dehn functions of cocyclic groups and by Dison on Dehn functions of coabelian groups. We then provide several applications of our methods to subgroups of direct products of free groups, to groups with interesting geometric finiteness properties and to subgroups of direct products of right angled Artin groups.


A Comprehensive Survey on the Multiple Travelling Salesman Problem Applications, Approaches and Taxonomy. The Multiple Travelling Salesman Problem (MTSP) is among the most interesting combinatorial optimization problems because it is widely adopted in real life applications, including robotics, transportation, networking, etc. Although the importance of this optimization problem, there is no survey dedicated to reviewing recent MTSP contributions. In this paper, we aim to fill this gap by providing a comprehensive review of existing studies on MTSP. In this survey, we focus on MTSP's recent contributions to both classical vehicles robots and unmanned aerial vehicles. We highlight the approaches applied to solve the MTSP as well as its application domains. We analyze the MTSP variants and propose a taxonomy and a classification of recent studies.


Meta Learning to Improve Pre Training. Pre training (PT) followed by fine tuning (FT) is an effective method for training neural networks, and has led to significant performance improvements in many domains. PT can incorporate various design choices such as task and data reweighting strategies, augmentation policies, and noise models, all of which can significantly impact the quality of representations learned. The hyperparameters introduced by these strategies therefore must be tuned appropriately. However, setting the values of these hyperparameters is challenging. Most existing methods either struggle to scale to high dimensions, are too slow and memory intensive, or cannot be directly applied to the two stage PT and FT learning process. In this work, we propose an efficient, gradient based algorithm to meta learn PT hyperparameters. We formalize the PT hyperparameter optimization problem and propose a novel method to obtain PT hyperparameter gradients by combining implicit differentiation and backpropagation through unrolled optimization. We demonstrate that our method improves predictive performance on two real world domains. First, we optimize high dimensional task weighting hyperparameters for multitask pre training on protein protein interaction graphs and improve AUROC by up to 3.9 . Second, we optimize a data augmentation neural network for self supervised PT with SimCLR on electrocardiography data and improve AUROC by up to 1.9 .


Effect of density control in partially observable asymmetric exit evacuation under guidance Strategic suggestion under time delay. To enhance the evacuation efficiency in partially observable asymmetric exit evacuation under guidance, a general framework of the dynamic guiding assistant system is presented to investigate the effect of density control. In this framework, several evacuation assistants are established to observe the partial information of pedestrians' location and adjust the guiding signals of the dynamic guiding assistant systems. A simple on off based density control algorithm is proposed for the evacuation assistants according to the delayed data of the observed information (i.e., pedestrian densities in the observed regions near the corresponding exits). This paper provides strategic suggestions on how to set the observed region and the target density by involving a force driven cellular automaton model. It is observed that the proposed density control algorithm can control (positively affect) the global distribution of the pedestrians' locations and suppress arching phenomena in the evacuation process even using the observed partial information under time delays. By imposing a moderate target density, the dynamic guiding assistant system also suppresses the triggers of collisions around the exits and avoids inefficiently separating the pedestrians. To enhance evacuation efficiency, we reveal an interesting fact without loss of generality that we only need to observe the pedestrians' location from a small region near the exit instead of a large region when the time delay of the observed information is slight enough. Our numerical findings are expected to provide new insights into designing computer aided guiding strategies in real evacuations.


Householder orthogonalization with a non standard inner product. Householder orthogonalization plays an important role in numerical linear algebra. It attains perfect orthogonality regardless of the conditioning of the input. However, in the context of a non standard inner product, it becomes difficult to apply Householder orthogonalization due to the lack of an initial orthogonal basis. We propose strategies to overcome this obstacle and discuss algorithms and variants of Householder orthogonalization with a non standard inner product. Rounding error analysis and numerical experiments demonstrate that our approach is numerically stable.


A Sub band Approach to Deep Denoising Wavelet Networks and a Frequency adaptive Loss for Perceptual Quality. In this paper, we propose two contributions to neural network based denoising. First, we propose applying separate convolutional layers to each sub band of discrete wavelet transform (DWT) as opposed to the common usage of DWT which concatenates all sub bands and applies a single convolution layer. We show that our approach to using DWT in neural networks improves the accuracy notably, due to keeping the sub band order uncorrupted prior to inverse DWT. Our second contribution is a denoising loss based on top k percent of errors in frequency domain. A neural network trained with this loss, adaptively focuses on frequencies that it fails to recover the most in each iteration. We show that this loss results into better perceptual quality by providing an image that is more balanced in terms of the errors in frequency components.


Two Grid Domain Decomposition Methods for the Coupled Stokes Darcy System. In this paper, we propose two novel Robin type domain decomposition methods based on the two grid techniques for the coupled Stokes Darcy system. Our schemes firstly adopt the existing Robin type domain decomposition algorithm to obtain the coarse grid approximate solutions. Then two modified domain decomposition methods are further constructed on the fine grid by utilizing the framework of two grid methods to enhance computational efficiency, via replacing some interface terms by the coarse grid information. The natural idea of using the two grid frame to optimize the domain decomposition method inherits the best features of both methods and can overcome some of the domain decomposition deficits. The resulting schemes can be implemented easily using many existing mature solvers or codes in a flexible way, which are much effective under smaller mesh sizes or some realistic physical parameters. Moreover, several error estimates are carried out to show the stability and convergence of the schemes. Finally, three numerical experiments are performed and compared with the classical two grid method, which verifies the validation and efficiency of the proposed algorithms.


Homogenization of Griffith's Criterion for brittle Laminates. We consider a periodic, linear elastic laminate with a brittle crack, evolving along a prescribed path according to Griffith's criterion. We study the homogenized limit of this evolution, as the size of the layers vanishes. The limit evolution is governed again by Griffith's criterion, in terms of the energy release (of the homogenized elastic energy) and an effective toughness, which in general differs from the weak limit of the periodic toughness. We provide a variational characterization of the effective toughness and, by the energy identity, we link the toughening effect (in the limit) to the micro instabilities of the evolution (in the periodic laminate). Finally, we provide a couple of explicit calculations of the effective toughness in the anti plane setting, showing in particular an example of toughening by elastic contrast.


UoB at SemEval 2021 Task 5 Extending Pre Trained Language Models to Include Task and Domain Specific Information for Toxic Span Prediction. Toxicity is pervasive in social media and poses a major threat to the health of online communities. The recent introduction of pre trained language models, which have achieved state of the art results in many NLP tasks, has transformed the way in which we approach natural language processing. However, the inherent nature of pre training means that they are unlikely to capture task specific statistical information or learn domain specific knowledge. Additionally, most implementations of these models typically do not employ conditional random fields, a method for simultaneous token classification. We show that these modifications can improve model performance on the Toxic Spans Detection task at SemEval 2021 to achieve a score within 4 percentage points of the top performing team.


Geometric decompositions of the simplicial lattice and smooth finite elements in arbitrary dimension. Recently C m conforming finite elements on simplexes in arbitrary dimension are constructed by Hu, Lin and Wu. The key in the construction is a non overlapping decomposition of the simplicial lattice in which each component will be used to determine the normal derivatives at each lower dimensional sub simplex. A geometric approach is proposed in this paper and a geometric decomposition of the finite element spaces is given. Our geometric decomposition using the graph distance not only simplifies the construction but also provides an easy way of implementation.


A General Purpose Crowdsourcing Computational Quality Control Toolkit for Python. Quality control is a crux of crowdsourcing. While most means for quality control are organizational and imply worker selection, golden tasks, and post acceptance, computational quality control techniques allow parameterizing the whole crowdsourcing process of workers, tasks, and labels, inferring and revealing relationships between them. In this paper, we demonstrate Crowd Kit, a general purpose crowdsourcing computational quality control toolkit. It provides efficient implementations in Python of computational quality control algorithms for crowdsourcing, including uncertainty measures and crowd consensus methods. We focus on aggregation methods for all the major annotation tasks, from the categorical annotation in which latent label assumption is met to more complex tasks like image and sequence aggregation. We perform an extensive evaluation of our toolkit on several datasets of different nature, enabling benchmarking computational quality control methods in a uniform, systematic, and reproducible way using the same codebase. We release our code and data under an open source license at https github.com Toloka crowd kit.


Stable vector bundles on a hyper Kahler manifold with a rank 1 obstruction map are modular. Let X be an irreducible 2n dimensional holomorphic symplectic manifold. A reflexive sheaf F is modular, if its Azumaya algebra End(F) deforms with X to every Kahler deformation of X. We show that if F is a slope stable reflexive sheaf of positive rank and the obstruction map from the second Hochschild cohomology of X to Ext 2(F,F) has rank 1, then F is modular. We associate to such a sheaf a vector in the Looijenga Lunts Verbitsky lattice of rank equal to the second Betti number of X plus 2. Three sources of examples of such modular sheaves emerge. The first source consists of slope stable reflexive sheaves F of positive rank which are isomorphic to the image of the structure sheaf via an equivalence of the derived categories of two irreducible holomorphic symplectic manifolds. The second source consists of such F, which are isomorphic to the image of a sky scraper sheaf via a derived equivalence. The third source consists of images of torsion sheaves L supported as line bundles on holomorphic lagrangian submanifolds Z, such that Z deforms with X in co dimension one in moduli and L is a rational power of the canonical line bundle of Z.