New stationarity conditions between strong and M stationarity for mathematical programs with complementarity constraints. We introduce new first order necessary conditions for mathematical programs with complementarity constraints (MPCCs), which lie between strong and M stationarity and have a relatively simple description. We show that they hold for local minimizers under the rather weak constraint qualification MPCC GCQ. As a generalization, we also get a class of stationarity conditions that lie between strong and C stationarity and show that they also hold for local minimizers under MPCC GCQ. We also present similar results for mathematical programs with vanishing constraints (MPVCs), and a very simple and elementary proof of M stationarity for local minimizers of MPVCs.


Blockchain Privacy Through Merge Avoidance and Mixing Services a Hardness and an Impossibility Result. Cryptocurrencies typically aim at preserving the privacy of their users. Different cryptocurrencies preserve privacy at various levels, some of them requiring users to rely on strategies to raise the privacy level to their needs. Among those strategies, we focus on two of them merge avoidance and mixing services. Such strategies may be adopted on top of virtually any blockchain based cryptocurrency. In this paper, we show that whereas optimal merge avoidance leads to an NP hard optimization problem, incentive compatible mixing services are subject to a certain class of impossibility results. Together, our results contribute to the body of work on fundamental limits of privacy mechanisms in blockchain based cryptocurrencies.


Structural Guidance for Transformer Language Models. Transformer based language models pre trained on large amounts of text data have proven remarkably successful in learning generic transferable linguistic representations. Here we study whether structural guidance leads to more human like systematic linguistic generalization in Transformer language models without resorting to pre training on very large amounts of data. We explore two general ideas. The "Generative Parsing" idea jointly models the incremental parse and word sequence as part of the same sequence modeling task. The "Structural Scaffold" idea guides the language model's representation via additional structure loss that separately predicts the incremental constituency parse. We train the proposed models along with a vanilla Transformer language model baseline on a 14 million token and a 46 million token subset of the BLLIP dataset, and evaluate models' syntactic generalization performances on SG Test Suites and sized BLiMP. Experiment results across two benchmarks suggest converging evidence that generative structural supervisions can induce more robust and humanlike linguistic generalization in Transformer language models without the need for data intensive pre training.


Partitioned Graph Convolution Using Adversarial and Regression Networks for Road Travel Speed Prediction. Access to quality travel time information for roads in a road network has become increasingly important with the rising demand for real time travel time estimation for paths within road networks. In the context of the Danish road network (DRN) dataset used in this paper, the data coverage is sparse and skewed towards arterial roads, with a coverage of 23.88 across 850,980 road segments, which makes travel time estimation difficult. Existing solutions for graph based data processing often neglect the size of the graph, which is an apparent problem for road networks with a large amount of connected road segments. To this end, we propose a framework for predicting road segment travel speed histograms for dataless edges, based on a latent representation generated by an adversarially regularized convolutional network. We apply a partitioning algorithm to divide the graph into dense subgraphs, and then train a model for each subgraph to predict speed histograms for the nodes. The framework achieves an accuracy of 71.5 intersection and 78.5 correlation on predicting travel speed histograms using the DRN dataset. Furthermore, experiments show that partitioning the dataset into clusters increases the performance of the framework. Specifically, partitioning the road network dataset into 100 clusters, with approximately 500 road segments in each cluster, achieves a better performance than when using 10 and 20 clusters.


Self supervised Point Cloud Prediction Using 3D Spatio temporal Convolutional Networks. Exploiting past 3D LiDAR scans to predict future point clouds is a promising method for autonomous mobile systems to realize foresighted state estimation, collision avoidance, and planning. In this paper, we address the problem of predicting future 3D LiDAR point clouds given a sequence of past LiDAR scans. Estimating the future scene on the sensor level does not require any preceding steps as in localization or tracking systems and can be trained self supervised. We propose an end to end approach that exploits a 2D range image representation of each 3D LiDAR scan and concatenates a sequence of range images to obtain a 3D tensor. Based on such tensors, we develop an encoder decoder architecture using 3D convolutions to jointly aggregate spatial and temporal information of the scene and to predict the future 3D point clouds. We evaluate our method on multiple datasets and the experimental results suggest that our method outperforms existing point cloud prediction architectures and generalizes well to new, unseen environments without additional fine tuning. Our method operates online and is faster than the common LiDAR frame rate of 10 Hz.


Tits type alternative for certain groups acting on algebraic surfaces. A theorem of Cantat and Urech says that an analog of the classical Tits alternative holds for the group of birational automorphisms of a compact complex Kaehler surface. We established in our previous paper the following Tits type alternative if X is a toric affine variety and G is a subgroup of Aut(X) generated by a finite set of unipotent subgroups normalized by the acting torus then either G contains a nonabelian free subgroup or G is a unipotent affine algebraic group. In the present paper we extend the latter result to any group G of automorphisms of a complex affine surface generated by a finite collection of unipotent algebraic subgroups. It occurs that either G contains a nonabelian free subgroup or G is a metabelian unipotent algebraic group.


Urban Driver Learning to Drive from Real world Demonstrations Using Policy Gradients. In this work we are the first to present an offline policy gradient method for learning imitative policies for complex urban driving from a large corpus of real world demonstrations. This is achieved by building a differentiable data driven simulator on top of perception outputs and high fidelity HD maps of the area. It allows us to synthesize new driving experiences from existing demonstrations using mid level representations. Using this simulator we then train a policy network in closed loop employing policy gradients. We train our proposed method on 100 hours of expert demonstrations on urban roads and show that it learns complex driving policies that generalize well and can perform a variety of driving maneuvers. We demonstrate this in simulation as well as deploy our model to self driving vehicles in the real world. Our method outperforms previously demonstrated state of the art for urban driving scenarios all this without the need for complex state perturbations or collecting additional on policy data during training. We make code and data publicly available.


Robust a posteriori error estimates for weak Galerkin method for the convection diffusion problem. We present a robust a posteriori error estimator for the weak Galerkin finite element method applied to stationary convection diffusion equations in the convection dominated regime. The estimator provides global upper and lower bounds of the error measured in a suitable norm and is robust in the sense that upper and lower bounds are uniformly bounded with respect to the diffusion coefficient. Results of the numerical experiments are presented to illustrate the performance of the error estimator.


A (Slightly) Improved Bound on the Integrality Gap of the Subtour LP for TSP. We show that for some epsilon 10 36 and any metric TSP instance, the max entropy algorithm returns a solution of expected cost at most frac 3 2 epsilon times the cost of the optimal solution to the subtour elimination LP. This implies that the integrality gap of the subtour LP is at most frac 3 2 epsilon . This analysis also shows that there is a randomized frac 3 2 epsilon approximation for the 2 edge connected multi subgraph problem, improving upon Christofides' algorithm.


How Transferable are Reasoning Patterns in VQA?. Since its inception, Visual Question Answering (VQA) is notoriously known as a task, where models are prone to exploit biases in datasets to find shortcuts instead of performing high level reasoning. Classical methods address this by removing biases from training data, or adding branches to models to detect and remove biases. In this paper, we argue that uncertainty in vision is a dominating factor preventing the successful learning of reasoning in vision and language problems. We train a visual oracle and in a large scale study provide experimental evidence that it is much less prone to exploiting spurious dataset biases compared to standard models. We propose to study the attention mechanisms at work in the visual oracle and compare them with a SOTA Transformer based model. We provide an in depth analysis and visualizations of reasoning patterns obtained with an online visualization tool which we make publicly available (https reasoningpatterns.github.io). We exploit these insights by transferring reasoning patterns from the oracle to a SOTA Transformer based VQA model taking standard noisy visual inputs via fine tuning. In experiments we report higher overall accuracy, as well as accuracy on infrequent answers for each question type, which provides evidence for improved generalization and a decrease of the dependency on dataset biases.


Reverb A Framework For Experience Replay. A central component of training in Reinforcement Learning (RL) is Experience the data used for training. The mechanisms used to generate and consume this data have an important effect on the performance of RL algorithms. In this paper, we introduce Reverb an efficient, extensible, and easy to use system designed specifically for experience replay in RL. Reverb is designed to work efficiently in distributed configurations with up to thousands of concurrent clients. The flexible API provides users with the tools to easily and accurately configure the replay buffer. It includes strategies for selecting and removing elements from the buffer, as well as options for controlling the ratio between sampled and inserted elements. This paper presents the core design of Reverb, gives examples of how it can be applied, and provides empirical results of Reverb's performance characteristics.


Random walks on SL 2(C) spectral gap and limit theorems. We obtain various new limit theorems for random walks on SL 2(C) under low moment conditions. For non elementary measures with a finite second moment, we prove a Local Limit Theorem for the norm cocycle, yielding the optimal version of a theorem of E. Le Page. For measures with a finite third moment, we obtain the Local Limit Theorem for the matrix coefficients, improving a recent result of Grama Quint Xiao and the authors, and Berry Esseen bounds with optimal rate O(1 sqrt n) for the norm cocycle and the matrix coefficients. The main tool is a detailed study of the spectral properties of the Markov operator and its purely imaginary perturbations acting on different function spaces. We introduce, in particular, a new function space derived from the Sobolev space W 1,2 that provides uniform estimates.


Quasimorphisms on nonorientable surface diffeomorphism groups. Bowden, Hensel, and Webb constructed infinitely many quasimophisms on the diffeomorphism groups of orientable surfaces. In this paper, we extend their result to nonorientable surfaces.


How to Evaluate Your Dialogue Models A Review of Approaches. Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to divide the evaluation methods into three classes, i.e., automatic evaluation, human involved evaluation and user simulator based evaluation. Then, each class is covered with main features and the related evaluation metrics. The existence of benchmarks, suitable for the evaluation of dialogue techniques are also discussed in detail. Finally, some open issues are pointed out to bring the evaluation method into a new frontier.


A Bayesian model of information cascades. An information cascade is a circumstance where agents make decisions in a sequential fashion by following other agents. Bikhchandani et al., predict that once a cascade starts it continues, even if it is wrong, until agents receive an external input such as public information. In an information cascade, even if an agent has its own personal choice, it is always overridden by observation of previous agents' actions. This could mean agents end up in a situation where they may act without valuing their own information. As information cascades can have serious social consequences, it is important to have a good understanding of what causes them. We present a detailed Bayesian model of the information gained by agents when observing the choices of other agents and their own private information. Compared to prior work, we remove the high impact of the first observed agent's action by incorporating a prior probability distribution over the information of unobserved agents and investigate an alternative model of choice to that considered in prior work weighted random choice. Our results show that, in contrast to Bikhchandani's results, cascades will not necessarily occur and adding prior agents' information will delay the effects of cascades.


A coevolutionary approach to deep multi agent reinforcement learning. Traditionally, Deep Artificial Neural Networks (DNN's) are trained through gradient descent. Recent research shows that Deep Neuroevolution (DNE) is also capable of evolving multi million parameter DNN's, which proved to be particularly useful in the field of Reinforcement Learning (RL). This is mainly due to its excellent scalability and simplicity compared to the traditional MDP based RL methods. So far, DNE has only been applied to complex single agent problems. As evolutionary methods are a natural choice for multi agent problems, the question arises whether DNE can also be applied in a complex multi agent setting. In this paper, we describe and validate a new approach based on Coevolution. To validate our approach, we benchmark two Deep Coevolutionary Algorithms on a range of multi agent Atari games and compare our results against the results of Ape X DQN. Our results show that these Deep Coevolutionary algorithms (1) can be successfully trained to play various games, (2) outperform Ape X DQN in some of them, and therefore (3) show that Coevolution can be a viable approach to solving complex multi agent decision making problems.


Approximating the Earth Mover's Distance between sets of geometric objects. Given two distributions P and S of equal total mass, the Earth Mover's Distance measures the cost of transforming one distribution into the other, where the cost of moving a unit of mass is equal to the distance over which it is moved. We give approximation algorithms for the Earth Mover's Distance between various sets of geometric objects. We give a (1 varepsilon) approximation when P is a set of weighted points and S is a set of line segments, triangles or d dimensional simplices. When P and S are both sets of line segments, sets of triangles or sets of simplices, we give a (1 varepsilon) approximation with a small additive term. All algorithms run in time polynomial in the size of P and S , and actually calculate the transport plan (that is, a specification of how to move the mass), rather than just the cost. To our knowledge, these are the first combinatorial algorithms with a provable approximation ratio for the Earth Mover's Distance when the objects are continuous rather than discrete points.


On Kernels for d Path Vertex Cover. In this paper we study the kernelization of d Path Vertex Cover ( d PVC) problem. Given a graph G , the problem requires finding whether there exists a set of at most k vertices whose removal from G results in a graph that does not contain a path (not necessarily induced) with d vertices. It is known that d PVC is NP complete for d geq 2 . Since the problem generalizes to d Hitting Set, it is known to admit a kernel with O(dk d) edges. We improve on this by giving better kernels. Specifically, we give kernels with O(k 2) vertices and edges for the cases when d 4 and d 5 . Further, we give a kernel with O(k 4) vertices and edges for general d .


DravidianMultiModality A Dataset for Multi modal Sentiment Analysis in Tamil and Malayalam. Human communication is inherently multimodal and asynchronous. Analyzing human emotions and sentiment is an emerging field of artificial intelligence. We are witnessing an increasing amount of multimodal content in local languages on social media about products and other topics. However, there are not many multimodal resources available for under resourced Dravidian languages. Our study aims to create a multimodal sentiment analysis dataset for the under resourced Tamil and Malayalam languages. First, we downloaded product or movies review videos from YouTube for Tamil and Malayalam. Next, we created captions for the videos with the help of annotators. Then we labelled the videos for sentiment, and verified the inter annotator agreement using Fleiss's Kappa. This is the first multimodal sentiment analysis dataset for Tamil and Malayalam by volunteer annotators.


Correlation Based Device Energy Efficient Dynamic Multi Task Offloading for Mobile Edge Computing. Task offloading to mobile edge computing (MEC) has emerged as a key technology to alleviate the computation workloads of mobile devices and decrease service latency for the computation intensive applications. Device battery consumption is one of the limiting factors needs to be considered during task offloading. In this paper, multi task offloading strategies have been investigated to improve device energy efficiency. Correlations among tasks in time domain as well as task domain are proposed to be employed to reduce the number of tasks to be transmitted to MEC. Furthermore, a binary decision tree based algorithm is investigated to jointly optimize the mobile device clock frequency, transmission power, structure and number of tasks to be transmitted. MATLAB based simulation is employed to demonstrate the performance of our proposed algorithm. It is observed that the proposed dynamic multi task offloading strategies can reduce the total energy consumption at device along various transmit power versus noise power point compared with the conventional one.


First Order Modal xi Calculus Application and Bisimulation. This paper proposes first order modal xi calculus as well as genealogical Kripke models. Inspired by modal mu calculus, first order modal xi calculus takes a quite similar form and extends its inductive expressivity onto a different dimension. We elaborate on several vivid examples that demonstrate this logic's profound utility, especially for depicting genealogy of concurrent computer processes. Bisimulation notion for the logic has also been thoroughly examined.


On Model Theory of Valued Vector Spaces. In analogy to valued fields, we study model theoretic properties of valued vector spaces with variable base field by proving transfer principles down to the skeleton and down to the value set and base field. For instance, we give a formula which computes its burden in terms of the burden of its base field and its value set. To do this, we study these transfer principles in the context of lexicographic products of structures.


High Accuracy Model Based Reinforcement Learning, a Survey. Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model free methods. Unfortunately, the sample complexity of model free methods is often high. To reduce the number of environment samples, model based reinforcement learning creates an explicit model of the environment dynamics. Achieving high model accuracy is a challenge in high dimensional problems. In recent years, a diverse landscape of model based methods has been introduced to improve model accuracy, using methods such as uncertainty modeling, model predictive control, latent models, and end to end learning and planning. Some of these methods succeed in achieving high accuracy at low sample complexity, most do so either in a robotics or in a games context. In this paper, we survey these methods we explain in detail how they work and what their strengths and weaknesses are. We conclude with a research agenda for future work to make the methods more robust and more widely applicable to other applications.


ETICA Efficient Two Level I O Caching Architecture for Virtualized Platforms. In this paper, we propose an Efficient Two Level I O Caching Architecture (ETICA) for virtualized platforms that can significantly improve I O latency, endurance, and cost (in terms of cache size) while preserving the reliability of write pending data blocks. As opposed to previous one level I O caching schemes in virtualized platforms, our proposed architecture 1) provides two levels of cache by employing both Dynamic Random Access Memory (DRAM) and SSD in the I O caching layer of virtualized platforms and 2) effectively partitions the cache space between running VMs to achieve maximum performance and minimum cache size. To manage the two level cache, unlike the previous reuse distance calculation schemes such as Useful Reuse Distance (URD), which only consider the request type and neglect the impact of cache write policy, we propose a new metric, Policy Optimized reuse Distance (POD). The key idea of POD is to effectively calculate the reuse distance and estimate the amount of two level DRAM SSD cache space to allocate by considering both 1) the request type and 2) the cache write policy. Doing so results in enhanced performance and reduced cache size due to the allocation of cache blocks only for the requests that would be served by the I O cache. ETICA maintains the reliability of write pending data blocks and improves performance by 1) assigning an effective and fixed write policy at each level of the I O cache hierarchy and 2) employing effective promotion and eviction methods between cache levels. Our extensive experiments conducted with a real implementation of the proposed two level storage caching architecture show that ETICA provides 45 higher performance, compared to the state of the art caching schemes in virtualized platforms, while improving both cache size and SSD endurance by 51.7 and 33.8 , respectively.


FIXP membership via Convex Optimization Games, Cakes, and Markets. We introduce a new technique for proving membership of problems in FIXP the class capturing the complexity of computing a fixed point of an algebraic circuit. Our technique constructs a "pseudogate" which can be used as a black box when building FIXP circuits. This pseudogate, which we term the "OPT gate", can solve most convex optimization problems. Using the OPT gate, we prove new FIXP membership results, and we generalize and simplify several known results from the literature on fair division, game theory and competitive markets. In particular, we prove complexity results for two classic problems computing a market equilibrium in the Arrow Debreu model with general concave utilities is in FIXP, and computing an envy free division of a cake with general valuations is FIXP complete. We further showcase the wide applicability of our technique, by using it to obtain simplified proofs and extensions of known FIXP membership results for equilibrium computation for various types of strategic games, as well as the pseudomarket mechanism of Hylland and Zeckhauser.


Sub Character Tokenization for Chinese Pretrained Language Models. Tokenization is fundamental to pretrained language models (PLMs). Existing tokenization methods for Chinese PLMs typically treat each character as an indivisible token. However, they ignore the unique feature of the Chinese writing system where additional linguistic information exists below the character level, i.e., at the sub character level. To utilize such information, we propose sub character (SubChar for short) tokenization. Specifically, we first encode the input text by converting each Chinese character into a short sequence based on its glyph or pronunciation, and then construct the vocabulary based on the encoded text with sub word tokenization. Experimental results show that SubChar tokenizers have two main advantages over existing tokenizers 1) They can tokenize inputs into much shorter sequences, thus improving the computational efficiency. 2) Pronunciation based SubChar tokenizers can encode Chinese homophones into the same transliteration sequences and produce the same tokenization output, hence being robust to all homophone typos. At the same time, models trained with SubChar tokenizers perform competitively on downstream tasks. We release our code at https github.com thunlp SubCharTokenization to facilitate future work.


Recurrent Brain Graph Mapper for Predicting Time Dependent Brain Graph Evaluation Trajectory. Several brain disorders can be detected by observing alterations in the brain's structural and functional connectivities. Neurological findings suggest that early diagnosis of brain disorders, such as mild cognitive impairment (MCI), can prevent and even reverse its development into Alzheimer's disease (AD). In this context, recent studies aimed to predict the evolution of brain connectivities over time by proposing machine learning models that work on brain images. However, such an approach is costly and time consuming. Here, we propose to use brain connectivities as a more efficient alternative for time dependent brain disorder diagnosis by regarding the brain as instead a large interconnected graph characterizing the interconnectivity scheme between several brain regions. We term our proposed method Recurrent Brain Graph Mapper (RBGM), a novel efficient edge based recurrent graph neural network that predicts the time dependent evaluation trajectory of a brain graph from a single baseline. Our RBGM contains a set of recurrent neural network inspired mappers for each time point, where each mapper aims to project the ground truth brain graph onto its next time point. We leverage the teacher forcing method to boost training and improve the evolved brain graph quality. To maintain the topological consistency between the predicted brain graphs and their corresponding ground truth brain graphs at each time point, we further integrate a topological loss. We also use l1 loss to capture time dependency and minimize the distance between the brain graph at consecutive time points for regularization. Benchmarks against several variants of RBGM and state of the art methods prove that we can achieve the same accuracy in predicting brain graph evolution more efficiently, paving the way for novel graph neural network architecture and a highly efficient training scheme.


The Scourge of Online Solutions and an Academic Hertzsprung Russell Diagram. We report on preliminary results of a statistical study of student performance in more than a decade of calculus based introductory physics courses. Treating average homework and test grades as proxies for student effort and comprehension respectively, we plot comprehension versus effort in an academic version of the astronomical Hertzsprung Russell diagram (which plots stellar luminosity versus temperature). We study the evolution of this diagram with time, finding that the "academic main sequence" has begun to break down in recent years as student achievement on tests has become decoupled from homework grades. We present evidence that this breakdown is likely related to the emergence of easily accessible online solutions to most textbook problems, and discuss possible responses and strategies for maintaining and enhancing student learning in the online era.


An Efficient Pessimistic Optimistic Algorithm for Stochastic Linear Bandits with General Constraints. This paper considers stochastic linear bandits with general nonlinear constraints. The objective is to maximize the expected cumulative reward over horizon T subject to a set of constraints in each round tau leq T . We propose a pessimistic optimistic algorithm for this problem, which is efficient in two aspects. First, the algorithm yields tilde cal O left( left( frac K 0.75 delta d right) sqrt tau right) (pseudo) regret in round tau leq T, where K is the number of constraints, d is the dimension of the reward feature space, and delta is a Slater's constant and zero constraint violation in any round tau tau', where tau' is independent of horizon T. Second, the algorithm is computationally efficient. Our algorithm is based on the primal dual approach in optimization and includes two components. The primal component is similar to unconstrained stochastic linear bandits (our algorithm uses the linear upper confidence bound algorithm (LinUCB)). The computational complexity of the dual component depends on the number of constraints, but is independent of the sizes of the contextual space, the action space, and the feature space. Thus, the overall computational complexity of our algorithm is similar to that of the linear UCB for unconstrained stochastic linear bandits.


Variations of the bridge quiver for domestic string algebras. In the computation of some representation theoretic numerical invariants of domestic string algebras, a finite combinatorial gadget introduced by Schr " o er the emph bridge quiver whose vertices are (representatives of cyclic permutations of) bands and whose arrows are certain band free strings has been used extensively. There is a natural but ill behaved partial binary operation, circ , on the larger set of emph weak bridges such that bridges are precisely the circ irreducibles. With the goal of computing hammocks up to isomorphism in a later work we equip an even larger set of emph weak arch bridges with another partial binary operation, circ H , to obtain a finite category. Each weak arch bridge admits a unique circ H factorization into emph arch bridges , i.e., the circ H irreducibles.


Stabilization results for delayed fifth order KdV type equation in a bounded domain. Studied here is the Kawahara equation, a fifth order Korteweg de Vries type equation, with time delayed internal feedback. Under suitable assumptions on the time delay coefficients we prove that solutions of this system are exponentially stable. First, considering a damping and delayed system, with some restriction of the spatial length of the domain, we prove that the Kawahara system is exponentially stable for T T min . After that, introducing a more general delayed system, and by introducing suitable energies, we show using Lyapunov approach, that the energy of the Kawahara equation goes to zero exponentially, considering the initial data small and a restriction in the spatial length of the domain. To remove these hypotheses, we use the compactness uniqueness argument which reduces our problem to prove an observability inequality, showing a semi global stabilization result.


Higher order generalizations of stability and arithmetic regularity. We define a natural notion of higher order stability and show that subsets of mathbb F p n that are tame in this sense can be approximately described by a union of low complexity quadratic subvarieties up to linear error. This generalizes the arithmetic regularity lemma for stable subsets of mathbb F p n proved by the authors, as well as subsequent refinements and generalizations by the authors, and Conant, Terry, and Pillay, to the realm of higher order Fourier analysis.


Automated Primary Hyperparathyroidism Screening with Neural Networks. Primary Hyperparathyroidism(PHPT) is a relatively common disease, affecting about one in every 1,000 adults. However, screening for PHPT can be difficult, meaning it often goes undiagnosed for long periods of time. While looking at specific blood test results independently can help indicate whether a patient has PHPT, often these blood result levels can all be within their respective normal ranges despite the patient having PHPT. Based on the clinic data from the real world, in this work, we propose a novel approach to screening PHPT with neural network (NN) architecture, achieving over 97 accuracy with common blood values as inputs. Further, we propose a second model achieving over 99 accuracy with additional lab test values as inputs. Moreover, compared to traditional PHPT screening methods, our NN models can reduce the false negatives of traditional screening methods by 99 .


Medipix3 proton and carbon ion measurements across full energy ranges and at clinical flux rates in MedAustron IR1. The Medipix3, a hybrid pixel detector with a silicon sensor, has been evaluated as a beam instrumentation device with proton and carbon ion measurements in the non clinical research room (IR1) of MedAustron Ion Therapy Center. Protons energies are varied from 62.4 to 800 MeV with 10 4 to 10 8 protons per second impinging on the detector surface. For carbon ions, energies are varied from 120 to 400 MeV amu with 10 7 to 10 8 carbon ions per second. Measurements include simultaneous high resolution, beam profile and beam intensity with various beam parameters at up to 1000 FPS (frames per second), count rate linearity and an assessment of radiation damage after the measurement day using an x ray tube to provide a homogeneous radiation measurement. The count rate linearity is found to be linear within the uncertainties (dominated by accelerator related sources due to special setup) for the measurements without degraders. Various frequency components are identified within the beam intensity over time firstly including 49.98 Hz with standard deviation, sigma 0.29 , secondly 30.55 Hz sigma 0.55 and thirdly 252.51 Hz sigma 0.83 . A direct correlation between the number of zero counting and noisy pixels is observed in the measurements with the highest flux. No conclusive evidence of long term radiation damage was found as a result of these measurements over one day.


Automata for dynamic answer set solving Preliminary report. We explore different ways of implementing temporal constraints expressed in an extension of Answer Set Programming (ASP) with language constructs from dynamic logic. Foremost, we investigate how automata can be used for enforcing such constraints. The idea is to transform a dynamic constraint into an automaton expressed in terms of a logic program that enforces the satisfaction of the original constraint. What makes this approach attractive is its independence of time stamps and the potential to detect unsatisfiability. On the one hand, we elaborate upon a transformation of dynamic formulas into alternating automata that relies on meta programming in ASP. This is the first application of reification applied to theory expressions in gringo. On the other hand, we propose two transformations of dynamic formulas into monadic second order formulas. These can then be used by off the shelf tools to construct the corresponding automata. We contrast both approaches empirically with the one of the temporal ASP solver telingo that directly maps dynamic constraints to logic programs. Since this preliminary study is restricted to dynamic formulas in integrity constraints, its implementations and (empirical) results readily apply to conventional linear dynamic logic, too.


Delocalization and quantum diffusion of random band matrices in high dimensions II T expansion. We consider Green's functions G(z) (H z) 1 of Hermitian random band matrices H on the d dimensional lattice ( mathbb Z L mathbb Z) d . The entries h xy overline h yx of H are independent centered complex Gaussian random variables with variances s xy mathbb E h xy 2 . The variances satisfy a banded profile so that s xy is negligible if x y exceeds the band width W . For any n in mathbb N , we construct an expansion of the T variable, T xy m 2 sum alpha s x alpha G alpha y 2 , with an error O(W nd 2 ) , and use it to prove a local law on the Green's function. This T expansion was the main tool to prove the delocalization and quantum diffusion of random band matrices for dimensions d ge 8 in part I of this series.


Class of meromorphic functions partially shared values with their differences or shifts. Two meromorphic functions f and g are said to share a value s in mathbb C cup infty CM (IM) provided that f(z) s and g(z) s have the same set of zeros counting multiplicities (ignoring multiplicities). We say that a meromorphic function f share s in mathbb C partially CM with a meromorphic function g if E(s,f) subseteq E(s,g) . It is easy to see that the condition partially shared values CM " is more general than the condition shared value CM ". With the idea of partially shared values, in this paper, we prove some uniqueness results between non constant meromorphic functions and their shifts or generalized differences. We exhibit some examples to show that the result of Charak emph et al. cite Cha Kor Kum 2016 is not true for k 2 or k 3 . We find some gaps in proof of the result of Lin emph et al. cite Lin Lin Wu , and we not only correct them but also generalize their result in a more convenient way. A number of examples have been exhibited to validate a certain claim of the main results of this paper and also to show that some of the conditions are sharp. In the end, we have posed some open questions for further investigation of the main result of the paper.


Contingent Penalty and Contingent Renewal Supply Contracts in High Tech Industry. Unlike consumer goods industry, a high tech manufacturer (OEM) often amortizes new product development costs over multiple generations, where demand for each generation is based on advance orders and additional uncertain demand. Also, due to economic reasons and regulations, high tech OEMs usually source from a single supplier. Relative to the high retail price, the wholesale price for a supplier to produce high tech components is low. Consequently, incentives are misaligned the OEM faces relatively high under stock costs and the supplier faces high over stock costs. In this paper, we examine supply contracts that are intended to align the incentives between a high tech OEM and a supplier so that the supplier will invest adequate and yet non verifiable capacity to meet the OEM's uncertain demand. When focusing on a single generation, the manufacturer can coordinate a decentralized supply chain and extract all surplus by augmenting a traditional wholesale price contract with a "contingent penalty" should the supplier fail to fulfill the OEM's demand. When the resulting penalty is too high to be enforceable, we consider a new class of "contingent renewal" wholesale price contracts with a stipulation the OEM will renew the contract with the incumbent supplier for the next generation only when the supplier can fulfill the demand for the current generation. By using non renewal as an implicit penalty, we show that the contingent renewal contract can coordinate the supply chain. While the OEM can capture the bulk of the supply chain profit, this innovative contract cannot enable the OEM to extract the entire surplus.


Tradeoffs in Streaming Binary Classification under Limited Inspection Resources. Institutions are increasingly relying on machine learning models to identify and alert on abnormal events, such as fraud, cyber attacks and system failures. These alerts often need to be manually investigated by specialists. Given the operational cost of manual inspections, the suspicious events are selected by alerting systems with carefully designed thresholds. In this paper, we consider an imbalanced binary classification problem, where events arrive sequentially and only a limited number of suspicious events can be inspected. We model the event arrivals as a non homogeneous Poisson process, and compare various suspicious event selection methods including those based on static and adaptive thresholds. For each method, we analytically characterize the tradeoff between the minority class detection rate and the inspection capacity as a function of the data class imbalance and the classifier confidence score densities. We implement the selection methods on a real public fraud detection dataset and compare the empirical results with analytical bounds. Finally, we investigate how class imbalance and the choice of classifier impact the tradeoff.


A variational approach to first order kinetic mean field games with local couplings. First order kinetic mean field games formally describe the Nash equilibria of deterministic differential games where agents control their acceleration, asymptotically in the limit as the number of agents tends to infinity. The known results for the well posedness theory of mean field games with control on the acceleration assume either that the running and final costs are regularising functionals of the density variable, or the presence of noise, i.e. a second order system. In this manuscript we construct global in time weak solutions to a first order mean field games system involving kinetic transport operators, where the costs are local (hence non regularising) functions of the density variable with polynomial growth. We show the uniqueness of these solutions on the support of the agent density. This is achieved by characterising solutions through two convex optimisation problems in duality. As part of our approach, we develop tools for the analysis of mean field games on a non compact domain by variational methods. We introduce a notion of reachable set', built from the initial measure, that allows us to work with initial measures with or without compact support. In this way we are able to obtain crucial estimates on minimising sequences for merely bounded and continuous initial measures with finite first velocity moment. These are then carefully combined with L 1 type averaging lemmas from kinetic theory to obtain pre compactness for the minimising sequence. Finally, under stronger convexity and monotonicity assumptions on the data, we prove higher order Sobolev estimates of the solutions.


A study of Type B uncertainties associated with the photoelectric effect in low energy Monte Carlo simulations. The goal of this manuscript is to estimate Type B uncertainties in absorbed dose calculations arising from the different implementations in current state of the art Monte Carlo codes of low energy photon cross sections ( 200 keV). Monte Carlo simulations are carried out using three codes widely used in the low energy domain PENELOPE 2018, EGSnrc, and MCNP. Mass energy absorption coefficients for water, air, graphite, and their respective ratios absorbed dose and photon fluence spectra are considered. Benchmark simulations using similar cross sections have been performed. The differences observed between these quantities when different cross sections are considered are taken to be a good estimator for the corresponding Type B uncertainties. A conservative Type B uncertainty for the absorbed dose (k 2) of 1.2 1.7 ( 50 keV), 0.6 1.2 (50 100 keV), and 0.3 (100 200 keV) is estimated. The photon fluence spectrum does not present clinically relevant differences that merit considering additional Type B uncertainties except for energies below 25 keV, where a Type B uncertainty of 0.5 is obtained. Below 30 keV, mass energy absorption coefficients show Type B uncertainties (k 2) of about 1.5 (water and air), and 2 (graphite), reaching values about 1 (40 50 keV) and 0.5 (50 75 keV). Type B uncertainties for the water to graphite ratios are observed for energies below 30 keV, about 0.7 (k 2). In contrast with the intermediate (about 500 keV) or high (about 1 MeV) energy domains, Type B uncertainties due to the different cross sections implementation cannot be considered subdominant with respect to Type A uncertainties or even to other sources of Type B uncertainties. Therefore, the values reported here should be accommodated within the uncertainty budget in low energy photon dosimetry studies.


Approaching meV level for transition energies in the radium monofluoride molecule RaF and radium cation Ra by including quantum electrodynamics effects. Highly accurate theoretical predictions of transition energies in the radium monofluoride molecule, 226 RaF and radium cation, 226 Ra , are reported. The considered transition X 2 Sigma 1 2 to A 2 Pi 1 2 in RaF is one of the main features of this molecule and can be used to laser cool RaF for subsequent measurement of the electron electric dipole moment. For molecular and atomic predictions we go beyond the Dirac Coulomb Hamiltonian and treat high order electron correlation effects within the coupled cluster theory with the inclusion of quadruple and ever higher amplitudes. Effects of quantum electrodynamics (QED) are included non perturbatively using the model QED operator that is implemented now for molecules. It is shown that the inclusion of QED effects in molecular and atomic calculations is a key ingredient in resolving the discrepancy between the theoretical values obtained within the Dirac Coulomb Breit Hamiltonian and the experiment. The remaining deviation from the experimental values is within a few meV. This is more than an order of magnitude better than the "chemical accuracy", 1 kcal mol 43 meV, that is usually considered as a guiding thread in theoretical molecular physics.


Memoir on the vibratory movement of an elliptical membrane. Translation of 'Emile Mathieu's "M 'emoire sur le mouvement vibratoire d'une membrane de forme elliptique", Journal de math 'ematiques pures et appliqu 'ees 2e s 'erie, tome 13 (1868), p. 137 203.


Inside ASCENT Exploring a Deep Commonsense Knowledge Base and its Usage in Question Answering. ASCENT is a fully automated methodology for extracting and consolidating commonsense assertions from web contents (Nguyen et al., WWW 2021). It advances traditional triple based commonsense knowledge representation by capturing semantic facets like locations and purposes, and composite concepts, i.e., subgroups and related aspects of subjects. In this demo, we present a web portal that allows users to understand its construction process, explore its content, and observe its impact in the use case of question answering. The demo website and an introductory video are both available online.


Methods for accurate calculations of multi center integrals of squared Coulomb potentials for lower bounds to energy levels of molecular systems. In this paper methods for calculations of multi center integrals of squared Coulomb potentials and Slater type orbitals (STO) are derived. These integrals are necessary for accurate lower bounds to energy levels of molecular systems. All multi center integrals are reduced to fundamental integrals using the Gaunt coefficients and translation of STO. When the potential is the usual Coulomb potential, using the Laplace expansion or the Neumann expansion of the potential the integrals can be calculated. However, for the squared Coulomb potentials such expansions are not known. For the fundamental one center and two center integrals with squared Coulomb potentials, by methods free from such expansions exact analytic expressions and expressions by one dimensional integrals of analytic functions are derived. The methods mainly rely on the integration in ellipsoidal coordinates, the Fourier transform, Hobson's theorem and expansion of differential operators by simple ones suitable for the calculation. Numerical results by these expressions are given and compared.


Skeleton aware multi scale heatmap regression for 2D hand pose estimation. Existing RGB based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning based framework that consists of two main modules. The former presents a segmentation based approach to detect the hand skeleton and localize the hand bounding box. The second module regresses the 2D joint locations through a multi scale heatmap regression approach that exploits the predicted hand skeleton as a constraint to guide the model. Furthermore, we construct a new dataset that is suitable for both hand detection and pose estimation. We qualitatively and quantitatively validate our method on two datasets. Results demonstrate that the proposed method outperforms state of the art and can recover the pose even in cluttered images and complex poses.


Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation. Despite recent progress, state of the art question answering models remain vulnerable to a variety of adversarial attacks. While dynamic adversarial data collection, in which a human annotator tries to write examples that fool a model in the loop, can improve model robustness, this process is expensive which limits the scale of the collected data. In this work, we are the first to use synthetic adversarial data generation to make question answering models more robust to human adversaries. We develop a data generation pipeline that selects source passages, identifies candidate answers, generates questions, then finally filters or re labels them to improve quality. Using this approach, we amplify a smaller human written adversarial dataset to a much larger set of synthetic question answer pairs. By incorporating our synthetic data, we improve the state of the art on the AdversarialQA dataset by 3.7F1 and improve model generalisation on nine of the twelve MRQA datasets. We further conduct a novel human in the loop evaluation to show that our models are considerably more robust to new human written adversarial examples crowdworkers can fool our model only 8.8 of the time on average, compared to 17.6 for a model trained without synthetic data.


On a theorem of Nosal. Let G be a graph with m edges and spectral radius lambda 1 . Let bk left( G right) stand for the maximal number of triangles with a common edge in G . In 1970 Nosal proved that if lambda 1 2 m, then G contains a triangle. In this paper we show that the same premise implies that bk left( G right) frac 1 12 sqrt 4 m . This result settles a conjecture of Zhai, Lin, and Shu. Write lambda 2 for the second largest eigenvalue of G . Recently, Lin, Ning, and Wu showed that if G is a triangle free graph of order at least three, then lambda 1 2 lambda 2 2 leq m, thereby settling the simplest case of a conjecture of Bollob ' a s and the author. We give a simpler proof of their result.


On the number of k gons in finite projective planes. Let Pi be a projective plane of order n and Gamma Pi be its Levi graph (the point line incidence graph). For fixed k geq 3 , let c 2k ( Gamma Pi ) denote the number of 2k cycles in Gamma Pi . In this paper we show that c 2k ( Gamma Pi ) frac 1 2k n 2k O(n 2k 2 ), hspace 0.5cm n rightarrow infty. We also state a conjecture regarding the third and fourth largest terms in the asymptotic of the number of 2k cycles in Gamma Pi . This result was also obtained independently by Voropaev in 2012. Let text ex (v, C 2k , mathcal C text odd cup C 4 ) denote the greatest number of 2k cycles amongst all bipartite graphs of order v and girth at least 6. As a corollary of the result above, we obtain text ex (v, C 2k , mathcal C text odd cup C 4 ) left( frac 1 2 k 1 k o(1) right)v k, hspace 0.5cm v rightarrow infty.


What Makes for Hierarchical Vision Transformer?. Recent studies indicate that hierarchical Vision Transformer with a macro architecture of interleaved non overlapped window based self attention shifted window operation is able to achieve state of the art performance in various visual recognition tasks, and challenges the ubiquitous convolutional neural networks (CNNs) using densely slid kernels. Most follow up works attempt to replace the shifted window operation with other kinds of cross window communication paradigms, while treating self attention as the de facto standard for window based information aggregation. In this manuscript, we question whether self attention is the only choice for hierarchical Vision Transformer to attain strong performance, and the effects of different kinds of cross window communication. To this end, we replace self attention layers with embarrassingly simple linear mapping layers, and the resulting proof of concept architecture termed as LinMapper can achieve very strong performance in ImageNet 1k image recognition. Moreover, we find that LinMapper is able to better leverage the pre trained representations from image recognition and demonstrates excellent transfer learning properties on downstream dense prediction tasks such as object detection and instance segmentation. We also experiment with other alternatives to self attention for content aggregation inside each non overlapped window under different cross window communication approaches, which all give similar competitive results. Our study reveals that the textbf macro architecture of Swin model families, other than specific aggregation layers or specific means of cross window communication, may be more responsible for its strong performance and is the real challenger to the ubiquitous CNN's dense sliding window paradigm. Code and models will be publicly available to facilitate future research.


Variation of Stratifications From Toric GIT. When a reductive group acts on an algebraic variety, a linearized ample line bundle induces a stratification on the variety where the strata are ordered by the degrees of instability. In this paper, we study variation of stratifications coming from the group actions in the GIT quotient construction for projective toric varieties. Cox showed that each projective toric variety is a GIT quotient of an affine space by a diagonalizable group with respect to linearizations that come from ample divisors on the toric variety. We provide a sufficient conditions for two ample divisors to induce the same stratification and formulate two types of walls in the ample cone that completely capture two kinds of variations. We also prove that the variation is intrinsic to the primitive collections and the relations among ray generators of the fans.


A Smart Sensor for the Heat Flow of an Extruder. Two mathematical models are derived to describe the thermal dynamics of a plastics production machine. The Smart Sensor design is based on the finite volume model. The accuracy of the derived finite volume model is validated by a finite element model. Those models are validated by measurements. A Smart Sensor for the heat flow between the extruder cylinder and screw conveyor is designed. Such a configuration has the advantage to decouple the thermal control problem from the specific granulate.


Interpolating commodity futures prices with Kriging. The shape of the futures term structure is essential to commodity hedgers and speculators as futures prices serve as a forecast of future spot prices. Commodity markets quotes futures prices on a selection of maturities and delivery periods. In this note, we investigate a Bayesian technique known as Kriging to build a term structure of futures prices by embedding trends and seasonalities and by taking into account bid ask spreads of market quotations on different delivery periods.


Spatial Domain Feature Extraction Methods for Unconstrained Handwritten Malayalam Character Recognition. Handwritten character recognition is an active research challenge,especially for Indian scripts. This paper deals with handwritten Malayalam, with a complete set of basic characters, vowel and consonant signs and compound characters that may be present in the script. Spatial domain features suitable for recognition are chosen in this work. For classification, k NN, SVM and ELM are employed


Optimizing the Numbers of Queries and Replies in Federated Learning with Differential Privacy. Federated learning (FL) empowers distributed clients to collaboratively train a shared machine learning model through exchanging parameter information. Despite the fact that FL can protect clients' raw data, malicious users can still crack original data with disclosed parameters. To amend this flaw, differential privacy (DP) is incorporated into FL clients to disturb original parameters, which however can significantly impair the accuracy of the trained model. In this work, we study a crucial question which has been vastly overlooked by existing works what are the optimal numbers of queries and replies in FL with DP so that the final model accuracy is maximized. In FL, the parameter server (PS) needs to query participating clients for multiple global iterations to complete training. Each client responds a query from the PS by conducting a local iteration. Our work investigates how many times the PS should query clients and how many times each client should reply the PS. We investigate two most extensively used DP mechanisms (i.e., the Laplace mechanism and Gaussian mechanisms). Through conducting convergence rate analysis, we can determine the optimal numbers of queries and replies in FL with DP so that the final model accuracy can be maximized. Finally, extensive experiments are conducted with publicly available datasets MNIST and FEMNIST, to verify our analysis and the results demonstrate that properly setting the numbers of queries and replies can significantly improve the final model accuracy in FL with DP.


Temporal Shuffling for Defending Deep Action Recognition Models against Adversarial Attacks. Recently, video based action recognition methods using convolutional neural networks (CNNs) achieve remarkable recognition performance. However, there is still lack of understanding about the generalization mechanism of action recognition models. In this paper, we suggest that action recognition models rely on the motion information less than expected, and thus they are robust to randomization of frame orders. Based on this observation, we develop a novel defense method using temporal shuffling of input videos against adversarial attacks for action recognition models. Another observation enabling our defense method is that adversarial perturbations on videos are sensitive to temporal destruction. To the best of our knowledge, this is the first attempt to design a defense method specific to video based action recognition models.


physics.ao-ph math.DS physics.data-an physics.flu-dyn

Exploring stratospheric rare events with transition path theory and short simulations. Extreme weather events are simultaneously the least likely and the most impactful features of the climate system, increasingly so as climate change proceeds. Extreme events are multi faceted, highly variable processes which can be characterized in many ways return time, worst case severity, and predictability are all sought after quantities for various kinds of rare events. A unifying framework is needed to define and calculate the most important quantities of interest for the purposes of near term forecasting, long term risk assessment, and benchmarking of reduced order models. Here we use Transition Path Theory (TPT) for a comprehensive analysis of sudden stratospheric warming (SSW) events in a highly idealized wave mean flow interaction system with stochastic forcing. TPT links together probabilities, dynamical behavior, and other risk metrics associated with rare events that represents their full statistical variability. At face value, fulfilling this promise demands extensive direct simulation to generate the rare event many times. Instead, we implement a highly parallel computational method that launches a large ensemble of short simulations, estimating long timescale rare event statistics from short term tendencies. We specifically investigate properties of SSW events including passage time distributions and large anomalies in vortex strength and heat flux. We visualize high dimensional probability densities and currents, obtaining a nuanced picture of critical altitude dependent interactions between waves and the mean flow that fuel SSW events. We find that TPT more faithfully captures the statistical variability between events as compared to the more conventional minimum action method.


Multi Agent Cooperative Bidding Games for Multi Objective Optimization in e Commercial Sponsored Search. Bid optimization for online advertising from single advertiser's perspective has been thoroughly investigated in both academic research and industrial practice. However, existing work typically assume competitors do not change their bids, i.e., the wining price is fixed, leading to poor performance of the derived solution. Although a few studies use multi agent reinforcement learning to set up a cooperative game, they still suffer the following drawbacks (1) They fail to avoid collusion solutions where all the advertisers involved in an auction collude to bid an extremely low price on purpose. (2) Previous works cannot well handle the underlying complex bidding environment, leading to poor model convergence. This problem could be amplified when handling multiple objectives of advertisers which are practical demands but not considered by previous work. In this paper, we propose a novel multi objective cooperative bid optimization formulation called Multi Agent Cooperative bidding Games (MACG). MACG sets up a carefully designed multi objective optimization framework where different objectives of advertisers are incorporated. A global objective to maximize the overall profit of all advertisements is added in order to encourage better cooperation and also to protect self bidding advertisers. To avoid collusion, we also introduce an extra platform revenue constraint. We analyze the optimal functional form of the bidding formula theoretically and design a policy network accordingly to generate auction level bids. Then we design an efficient multi agent evolutionary strategy for model optimization. Offline experiments and online A B tests conducted on the Taobao platform indicate both single advertiser's objective and global profit have been significantly improved compared to state of art methods.


Unfolding Taylor's Approximations for Image Restoration. Deep learning provides a new avenue for image restoration, which demands a delicate balance between fine grained details and high level contextualized information during recovering the latent clear image. In practice, however, existing methods empirically construct encapsulated end to end mapping networks without deepening into the rationality, and neglect the intrinsic prior knowledge of restoration task. To solve the above problems, inspired by Taylor's Approximations, we unfold Taylor's Formula to construct a novel framework for image restoration. We find the main part and the derivative part of Taylor's Approximations take the same effect as the two competing goals of high level contextualized information and spatial details of image restoration respectively. Specifically, our framework consists of two steps, correspondingly responsible for the mapping and derivative functions. The former first learns the high level contextualized information and the later combines it with the degraded input to progressively recover local high order spatial details. Our proposed framework is orthogonal to existing methods and thus can be easily integrated with them for further improvement, and extensive experiments demonstrate the effectiveness and scalability of our proposed framework.


Translation invariant operators in reproducing kernel Hilbert spaces. Let G be a locally compact abelian group with a Haar measure, and Y be a measure space. Suppose that H is a reproducing kernel Hilbert space of functions on G times Y , such that H is naturally embedded into L 2(G times Y) and is invariant under the translations associated with the elements of G . Under some additional technical assumptions, we study the W algebra mathcal V of translation invariant bounded linear operators acting on H . First, we decompose mathcal V into the direct integral of the W algebras of bounded operators acting on the reproducing kernel Hilbert spaces widehat H xi , xi in widehat G , generated by the Fourier transform of the reproducing kernel. Second, we give a constructive criterion for the commutativity of mathcal V . Third, in the commutative case, we construct a unitary operator that simultaneously diagonalizes all operators belonging to mathcal V , i.e., converts them into some multiplication operators. Our scheme generalizes many examples previously studied by Nikolai Vasilevski and other authors.


Selected Columns of the Density Matrix in an Atomic Orbital Basis I An Intrinsic and Non Iterative Orbital Localization Scheme for the Occupied Space. We extend the selected columns of the density matrix (SCDM) methodology J. Chem. Theory Comput. 2015, 11, 1463 1469 a non iterative procedure for generating localized occupied orbitals for condensed phase systems to the construction of local molecular orbitals (LMOs) in systems described using non orthogonal atomic orbital (AO) basis sets. In particular, we introduce three different variants of SCDM (referred to as SCDM M, SCDM L, and SCDM G) that can be used in conjunction with the standard AO basis sets. The SCDM M and SCDM L variants are based on the Mulliken and L "o wdin representations of the density matrix, and are tantamount to selecting a well conditioned set of projected atomic orbitals (PAOs) and projected (symmetrically ) orthogonalized atomic orbitals (POAOs), respectively, as proto LMOs. The SCDM G variant leverages a real space (grid) representation of the wavefunction to select a set of well conditioned proto LMOs. A detailed comparative analysis reveals that the LMOs generated by these three SCDM variants are robust, comparable in orbital locality to those produced with the iterative Boys or Pipek Mezey (PM) localization schemes, and are agnostic towards any single orbital locality metric. Although all three SCDM variants are based on the density matrix, we find that the character of the generated LMOs can differ significantly between SCDM M, SCDM L, and SCDM G. In this regard, only the grid based SCDM G procedure (like PM) generates LMOs that qualitatively preserve sigma text pi symmetry and are well aligned with chemical intuition. While the direct and standalone use of SCDM generated LMOs should suffice for most applications, our findings also suggest that the use of these orbitals as an unbiased and cost effective (initial) guess also has the potential to improve the convergence of iterative orbital localization schemes.


A Deep Generative Artificial Intelligence system to decipher species coexistence patterns. 1. Deciphering coexistence patterns is a current challenge to understanding diversity maintenance, especially in rich communities where the complexity of these patterns is magnified through indirect interactions that prevent their approximation with classical experimental approaches. 2. We explore cutting edge Machine Learning techniques called Generative Artificial Intelligence (GenAI) to decipher species coexistence patterns in vegetation patches, training generative adversarial networks (GAN) and variational AutoEncoders (VAE) that are then used to unravel some of the mechanisms behind community assemblage. 3. The GAN accurately reproduces the species composition of real patches as well as the affinity of plant species to different soil types, and the VAE also reaches a high level of accuracy, above 99 . Using the artificially generated patches, we found that high order interactions tend to suppress the positive effects of low order interactions. Finally, by reconstructing successional trajectories we could identify the pioneer species with larger potential to generate a high diversity of distinct patches in terms of species composition. 4. Understanding the complexity of species coexistence patterns in diverse ecological communities requires new approaches beyond heuristic rules. Generative Artificial Intelligence can be a powerful tool to this end as it allows to overcome the inherent dimensionality of this challenge.


RIFLE Robust Inference from Low Order Marginals. The ubiquity of missing values in real world datasets poses a challenge for statistical inference and can prevent similar datasets from being analyzed in the same study, precluding many existing datasets from being used for new analyses. While an extensive collection of packages and algorithms have been developed for data imputation, the overwhelming majority perform poorly if there are many missing values and low sample size, which are unfortunately common characteristics in empirical data. Such low accuracy estimations adversely affect the performance of downstream statistical models. We develop a statistical inference framework for predicting the target variable without imputing missing values. Our framework, RIFLE (Robust InFerence via Low order moment Estimations), estimates low order moments with corresponding confidence intervals to learn a distributionally robust model. We specialize our framework to linear regression and normal discriminant analysis, and we provide convergence and performance guarantees. This framework can also be adapted to impute missing data. In numerical experiments, we compare RIFLE with state of the art approaches (including MICE, Amelia, MissForest, KNN imputer, MIDA, and Mean Imputer). Our experiments demonstrate that RIFLE outperforms other benchmark algorithms when the percentage of missing values is high and or when the number of data points is relatively small. RIFLE is publicly available.


From Hand Perspective Visual Information to Grasp Type Probabilities Deep Learning via Ranking Labels. Limb deficiency severely affects the daily lives of amputees and drives efforts to provide functional robotic prosthetic hands to compensate this deprivation. Convolutional neural network based computer vision control of the prosthetic hand has received increased attention as a method to replace or complement physiological signals due to its reliability by training visual information to predict the hand gesture. Mounting a camera into the palm of a prosthetic hand is proved to be a promising approach to collect visual data. However, the grasp type labelled from the eye and hand perspective may differ as object shapes are not always symmetric. Thus, to represent this difference in a realistic way, we employed a dataset containing synchronous images from eye and hand view, where the hand perspective images are used for training while the eye view images are only for manual labelling. Electromyogram (EMG) activity and movement kinematics data from the upper arm are also collected for multi modal information fusion in future work. Moreover, in order to include human in the loop control and combine the computer vision with physiological signal inputs, instead of making absolute positive or negative predictions, we build a novel probabilistic classifier according to the Plackett Luce model. To predict the probability distribution over grasps, we exploit the statistical model over label rankings to solve the permutation domain problems via a maximum likelihood estimation, utilizing the manually ranked lists of grasps as a new form of label. We indicate that the proposed model is applicable to the most popular and productive convolutional neural network frameworks.


Gromov Hausdorff Distance Between Segment and Circle. We calculate the Gromov Hausdorff distance between a line segment and a circle in the Euclidean plane. To do that, we introduced a few new notions like round spaces and nonlinearity degree of a metric space.


Improving Patent Mining and Relevance Classification using Transformers. Patent analysis and mining are time consuming and costly processes for companies, but nevertheless essential if they are willing to remain competitive. To face the overload induced by numerous patents, the idea is to automatically filter them, bringing only few to read to experts. This paper reports a successful application of fine tuning and retraining on pre trained deep Natural Language Processing models on patent classification. The solution that we propose combines several state of the art treatments to achieve our goal decrease the workload while preserving recall and precision metrics.


Torsion groups of Mordell curves over number fields of higher degree. Mordell curves over a number field K are elliptic curves of the form y 2 x 3 c , where c in K setminus 0 . Let p geq 5 be a prime number, K a number field such that K mathbb Q in 2p, 3p and let E be a Mordell curve defined over K . We classify all the possible torsion subgroups E(K) text tors for all Mordell curves E defined over mathbb Q when K mathbb Q in 2p, 3p .


Type Based Analysis of Logarithmic Amortised Complexity. We introduce a novel amortised resource analysis couched in a type and effect system. Our analysis is formulated in terms of the physicist's method of amortised analysis, and is potential based. The type system makes use of logarithmic potential functions and is the first such system to exhibit logarithmic amortised complexity . With our approach we target the automated analysis of self adjusting data structures, like splay trees, which so far have only manually been analysed in the literature. In particular, we have implemented a semi automated prototype, which successfully analyses the zig zig case of splaying , once the type annotations are fixed.


PySTACHIO Python Single molecule TrAcking stoiCHiometry Intensity and simulatiOn, a flexible, extensible, beginner friendly and optimized program for analysis of single molecule microscopy. As camera pixel arrays have grown larger and faster, and optical microscopy techniques ever more refined, there has been an explosion in the quantity of data acquired during routine light microcopy. At the single molecule level, analysis involves multiple steps and can rapidly become computationally expensive, in some cases intractable on office workstations. Complex bespoke software can present high activation barriers to entry for new users. Here, we redevelop our quantitative single molecule analysis routines into an optimized and extensible Python program, with GUI and command line implementations to facilitate use on local machines and remote clusters, by beginners and advanced users alike. We demonstrate that its performance is on par with previous MATLAB implementations but runs an order of magnitude faster. We tested it against challenge data and demonstrate its performance is comparable to state of the art analysis platforms. We show the code can extract fluorescence intensity values for single reporter dye molecules and, using these, estimate molecular stoichiometries and cellular copy numbers of fluorescently labeled biomolecules. It can evaluate 2D diffusion coefficients for the characteristically short single particle tracking data. To facilitate benchmarking we include data simulation routines to compare different analysis programs. Finally, we show that it works with 2 color data and enables colocalization analysis based on overlap integration, to infer interactions between differently labelled biomolecules. By making this freely available we aim to make complex light microscopy single molecule analysis more democratized.


q-bio.CB physics.bio-ph q-bio.QM q-bio.TO

Spontaneous mechanical and energetic state transitions during Caenorhabditis elegans gastrulation. Gastrulation, namely cell internalization, is a significant milestone during the development of metazoans from worm to human, which generates multiple embryonic layers with distinct cell fates and spatial organizations. Although many molecular activities are known to facilitate this process, in this paper, we focus on gastrulation of the nematode Caenorhabditis elegans and theoretically demonstrate that even a group of cells with only isotropic repulsive and attractive interactions can experience such internalization behavior when dividing within a confined space. As the cell number increases and cell size decreases, the cells contacted to the eggshell become closer to each other along with harder lateral compression, and a cell that internalizes could effectively increase the cell neighbor distance and lower the potential energy of the system. The multicellular structure transits from single to double layer spontaneously with bistable states existing from 15 to 44 cell stages, near the gastrulation timing in vivo. Specifically, the cells with a larger size or placed near a smaller curvature boundary are easier to internalize. Actively regulating a few cells' internalizations can make the morphogenesis noise resistant. Our work successfully recaptures the key characteristics in C. elegans gastrulation and provides a rational interpretation of how this phenomenon emerges and is optimally programmed.


Stochastic block model entropy and broadcasting on trees with survey. The limit of the entropy in the stochastic block model (SBM) has been characterized in the sparse regime for the special case of disassortative communities COKPZ17 and for the classical case of assortative communities but in the dense regime DAM16 . The problem has not been closed in the classical sparse and assortative case. This paper establishes the result in this case for any SNR besides for the interval (1, 3.513). It further gives an approximation to the limit in this window. The result is obtained by expressing the global SBM entropy as an integral of local tree entropies in a broadcasting on tree model with erasure side information. The main technical advancement then relies on showing the irrelevance of the boundary in such a model, also studied with variants in KMS16 , MNS16 and MX15 . In particular, we establish the uniqueness of the BP fixed point in the survey model for any SNR above 3.513 or below 1. This only leaves a narrow region in the plane between SNR and survey strength where the uniqueness of BP conjectured in these papers remains unproved.


On the design of particle filters inspired by animal noses. Passive filtering is a common strategy used to reduce airborne disease transmission and particulate contaminants in buildings and individual covers. The engineering of high performance filters with relatively low flow resistance but high virus or particle blocking efficiency is a nontrivial problem of paramount relevance, as evidenced in the variety of industrial filtration systems and the worldwide use of face masks. In this case, standard N95 level covers have high virus blocking efficiency, but they can cause breathing discomfort. Next generation industrial filters and masks should retain sufficiently small droplets and aerosols while having low resistance. We introduce a novel 3D printable particle filter inspired by animals' complex nasal anatomy. Unlike standard random media based filters, the proposed concept relies on equally spaced channels with tortuous airflow paths. These two strategies induce distinct effects a reduced resistance and a high likelihood of particle trapping by altering their trajectories with tortuous paths and induced local flow instability. The structures are tested for pressure drop and particle filtering efficiency over a wide range of airflow rates. We have also cross validated the observed efficiency through numerical simulations. The designed filters exhibit a lower pressure drop than the commercial mask and air filters (N95, surgical, and high efficiency particulate air (HEPA)). The concept provides a new approach to developing scalable, flexible, high efficiency air filters for various engineering applications.


On the stability of conservative discontinuous Galerkin Hermite spectral methods for the Vlasov Poisson system. We study a class of spatial discretizations for the Vlasov Poisson system written as an hyperbolic system using Hermite polynomials. In particular, we focus on spectral methods and discontinuous Galerkin approximations. To obtain L 2 stability properties, we introduce a new L 2 weighted space, with a time dependent weight. For the Hermite spectral form of the Vlasov Poisson system, we prove conservation of mass, momentum and total energy, as well as global stability for the weighted L 2 norm. These properties are then discussed for several spatial discretizations. Finally, numerical simulations are performed with the proposed DG Hermite spectral method to highlight its stability and conservation features.


Robust White Matter Hyperintensity Segmentation on Unseen Domain. Typical machine learning frameworks heavily rely on an underlying assumption that training and test data follow the same distribution. In medical imaging which increasingly begun acquiring datasets from multiple sites or scanners, this identical distribution assumption often fails to hold due to systematic variability induced by site or scanner dependent factors. Therefore, we cannot simply expect a model trained on a given dataset to consistently work well, or generalize, on a dataset from another distribution. In this work, we address this problem, investigating the application of machine learning models to unseen medical imaging data. Specifically, we consider the challenging case of Domain Generalization (DG) where we train a model without any knowledge about the testing distribution. That is, we train on samples from a set of distributions (sources) and test on samples from a new, unseen distribution (target). We focus on the task of white matter hyperintensity (WMH) prediction using the multi site WMH Segmentation Challenge dataset and our local in house dataset. We identify how two mechanically distinct DG approaches, namely domain adversarial learning and mix up, have theoretical synergy. Then, we show drastic improvements of WMH prediction on an unseen target domain.


Auto robust relative radiometric normalization via latent change noise modelling. Relative radiometric normalization(RRN) of different satellite images of the same terrain is necessary for change detection, object classification segmentation, and map making tasks. However, traditional RRN models are not robust, disturbing by object change, and RRN models precisely considering object change can not robustly obtain the no change set. This paper proposes auto robust relative radiometric normalization methods via latent change noise modeling. They utilize the prior knowledge that no change points possess small scale noise under relative radiometric normalization and that change points possess large scale radiometric noise after radiometric normalization, combining the stochastic expectation maximization method to quickly and robustly extract the no change set to learn the relative radiometric normalization mapping functions. This makes our model theoretically grounded regarding the probabilistic theory and mathematics deduction. Specifically, when we select histogram matching as the relative radiometric normalization learning scheme integrating with the mixture of Gaussian noise(HM RRN MoG), the HM RRN MoG model achieves the best performance. Our model possesses the ability to robustly against clouds fogs changes. Our method naturally generates a robust evaluation indicator for RRN that is the no change set root mean square error. We apply the HM RRN MoG model to the latter vegetation water change detection task, which reduces the radiometric contrast and NDVI NDWI differences on the no change set, generates consistent and comparable results. We utilize the no change set into the building change detection task, efficiently reducing the pseudo change and boosting the precision.


Reinforcement Learning with Evolutionary Trajectory Generator A General Approach for Quadrupedal Locomotion. Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill specific controllers. However, due to the complex nonlinear dynamics in quadrupedal robots and reward sparsity, it is still difficult for RL to learn effective gaits from scratch, especially in challenging tasks such as walking over the balance beam. To alleviate such difficulty, we propose a novel RL based approach that contains an evolutionary foot trajectory generator. Unlike prior methods that use a fixed trajectory generator, the generator continually optimizes the shape of the output trajectory for the given task, providing diversified motion priors to guide the policy learning. The policy is trained with reinforcement learning to output residual control signals that fit different gaits. We then optimize the trajectory generator and policy network alternatively to stabilize the training and share the exploratory data to improve sample efficiency. As a result, our approach can solve a range of challenging tasks in simulation by learning from scratch, including walking on a balance beam and crawling through the cave. To further verify the effectiveness of our approach, we deploy the controller learned in the simulation on a 12 DoF quadrupedal robot, and it can successfully traverse challenging scenarios with efficient gaits.


Impact of Explanation on Trust of a Novel Mobile Robot. One challenge with introducing robots into novel environments is misalignment between supervisor expectations and reality, which can greatly affect a user's trust and continued use of the robot. We performed an experiment to test whether the presence of an explanation of expected robot behavior affected a supervisor's trust in an autonomous robot. We measured trust both subjectively through surveys and objectively through a dual task experiment design to capture supervisors' neglect tolerance (i.e., their willingness to perform their own task while the robot is acting autonomously). Our objective results show that explanations can help counteract the novelty effect of seeing a new robot perform in an unknown environment. Participants who received an explanation of the robot's behavior were more likely to focus on their own task at the risk of neglecting their robot supervision task during the first trials of the robot's behavior compared to those who did not receive an explanation. However, this effect diminished after seeing multiple trials, and participants who received explanations were equally trusting of the robot's behavior as those who did not receive explanations. Interestingly, participants were not able to identify their own changes in trust through their survey responses, demonstrating that the dual task design measured subtler changes in a supervisor's trust.


Rooted tree graphs and the Butcher group Combinatorics of elementary perturbation theory. The perturbation expansion of the solution of a fixed point equation or of an ordinary differential equation may be expressed as a power series in the perturbation parameter. The terms in this series are indexed by rooted trees and depend on a parameter in the equation in a way determined by the structure of the tree. Power series of this form may be considered more generally there are two interesting and useful group structures on these series, corresponding to operations of composition and substitution. The composition operation defines the Butcher group, an infinite dimensional group that was first introduced in the context of numerical analysis. This survey discusses various ways of realizing these rooted trees as labeled rooted trees, or increasing labeled rooted trees, or unlabeled rooted trees. It is argued that the simplest framework is to use labeled rooted trees.


Features that Predict the Acceptability of Java and JavaScript Answers on Stack Overflow. Context It is not uncommon for a new team member to join an existing Agile software development team, even after development has started. This new team member faces a number of challenges before they are integrated into the team and can contribute productively to team progress. Ideally, each newcomer should be supported in this transition through an effective team onboarding program, although prior evidence suggests that this is challenging for many organisations. Objective We seek to understand how Agile teams address the challenge of team onboarding in order to inform future onboarding design. Method We conducted an interview survey of eleven participants from eight organisations to investigate what onboarding activities are common across Agile software development teams. We also identify common goals of onboarding from a synthesis of literature. A repertory grid instrument is used to map the contributions of onboarding techniques to onboarding goals. Results Our study reveals that a broad range of team onboarding techniques, both formal and informal, are used in practice. It also shows that particular techniques that have high contributions to a given goal or set of goals. Conclusions In presenting a set of onboarding goals to consider and an evidence based mechanism for selecting techniques to achieve the desired goals it is expected that this study will contribute to better informed onboarding design and planning. An increase in practitioner awareness of the options for supporting new team members is also an expected outcome.


Expected Cost Analysis for Probabilistic Programs and Semantics Level Adaption of Optional Stopping Theorems. In this article, we present a semantics level adaption of the Optional Stopping Theorem, sketch an expected cost analysis as its application, and survey different variants of the Optional Stopping Theorem that have been used in static analysis of probabilistic programs.


ReLACE Reinforcement Learning Agent for Counterfactual Explanations of Arbitrary Predictive Models. The demand for explainable machine learning (ML) models has been growing rapidly in recent years. Amongst the methods proposed to associate ML model predictions with human understandable rationale, counterfactual explanations are one of the most popular. They consist of post hoc rules derived from counterfactual examples (CFs), i.e., modified versions of input samples that result in alternative output responses from the predictive model to be explained. However, existing CF generation strategies either exploit the internals of specific models (e.g., random forests or neural networks), or depend on each sample's neighborhood, which makes them hard to be generalized for more complex models and inefficient for larger datasets. In this work, we aim to overcome these limitations and introduce a model agnostic algorithm to generate optimal counterfactual explanations. Specifically, we formulate the problem of crafting CFs as a sequential decision making task and then find the optimal CFs via deep reinforcement learning (DRL) with discrete continuous hybrid action space. Differently from other techniques, our method is easily applied to any black box model, as this resembles the environment that the DRL agent interacts with. In addition, we develop an algorithm to extract explainable decision rules from the DRL agent's policy, so as to make the process of generating CFs itself transparent. Extensive experiments conducted on several datasets have shown that our method outperforms existing CF generation baselines.


Representability of cohomology of finite flat abelian group schemes. We prove various finiteness and representability results for flat cohomology of finite flat abelian group schemes. In particular, we show that if f X rightarrow mathrm Spec (k) is a projective scheme over a field k and G is a finite flat abelian group scheme over X then R if G is an algebraic space for all i . More generally, we study the derived pushforwards R if G for f X rightarrow S a projective morphism and G a finite flat abelian group scheme over X . We also develop a theory of compactly supported cohomology for finite flat abelian group schemes, describe cohomology in terms of the cotangent complex for group schemes of height 1 , and relate the Dieudonn 'e modules of the group schemes R if mu p to cohomology generalizing work of Illusie. A higher categorical version of our main representability results is also presented.


Semi Supervised Variational User Identity Linkage via Noise Aware Self Learning. User identity linkage, which aims to link identities of a natural person across different social platforms, has attracted increasing research interest recently. Existing approaches usually first embed the identities as deterministic vectors in a shared latent space, and then learn a classifier based on the available annotations. However, the formation and characteristics of real world social platforms are full of uncertainties, which makes these deterministic embedding based methods sub optimal. In addition, it is intractable to collect sufficient linkage annotations due to the tremendous gaps between different platforms. Semi supervised models utilize the unlabeled data to help capture the intrinsic data distribution, which are more promising in practical usage. However, the existing semi supervised linkage methods heavily rely on the heuristically defined similarity measurements to incorporate the innate closeness between labeled and unlabeled samples. Such manually designed assumptions may not be consistent with the actual linkage signals and further introduce the noises. To address the mentioned limitations, in this paper we propose a novel Noise aware Semi supervised Variational User Identity Linkage (NSVUIL) model. Specifically, we first propose a novel supervised linkage module to incorporate the available annotations. Each social identity is represented by a Gaussian distribution in the Wasserstein space to simultaneously preserve the fine grained social profiles and model the uncertainty of identities. Then, a noise aware self learning module is designed to faithfully augment the few available annotations, which is capable of filtering noises from the pseudo labels generated by the supervised module.


Relevant Region Sampling Strategy with Adaptive Heuristic Estimation for Asymptotically Optimal Motion Planning. The sampling based motion planning algorithms can solve the motion planning problem in high dimensional state space efficiently. This article presents a novel approach to sample in the promising region and reduce planning time remarkably. The RRT defines the Relevant Region according to the cost to come provided by the optimal forward searching tree however, it takes the cumulative cost of a direct connection between the current state and the goal state as the cost to go. We propose a batch sampling method that samples in the refined Relevant Region, which is defined according to the optimal cost to come and the adaptive cost to go. In our method, the cost to come and the cost to go of a specific vertex are estimated by the valid optimal forward searching tree and the lazy reverse searching tree, respectively. New samples are generated with a direct sampling method, which can take advantage of the heuristic estimation result. We carry on several simulations in both SE(2) and SE(3) state spaces to validate the effectiveness of our method. Simulation results demonstrate that the proposed algorithm can find a better initial solution and consumes less planning time than related work.


The derived sequence of a pre Jaffard family. We introduce the concept of emph pre Jaffard family , a generalization of Jaffard families obtained by substituting the locally finite hypothesis with a much weaker compactness hypothesis. From any such family, we construct a sequence of overrings of the starting domain that allows to decompose stable semistar operations and singular length functions in more cases than what is allowed by Jaffard families. We also apply the concept to one dimensional domains, unifying the treatment of sharp and dull degree of a Pr "ufer domain.


Graded algebras, projective spectra and blow ups in derived algebraic geometry. We define graded, quasi coherent mathcal O S algebras over a given base derived scheme S , and show that these are equivalent to derived mathbb G m,S schemes which are affine over S . We then use this mathbb G m,S action to define the projective spectrum mathrm Proj ( mathcal B ) of a graded algebra mathcal B as a quotient stack, show that mathrm Proj ( mathcal B ) is representable by a derived scheme over S , and describe the functor of points of mathrm Proj ( mathcal B ) in terms of line bundles. The theory of graded algebras and projective spectra is then used to define the blow up of a closed immersion of derived schemes. Our construction will coincide with the existing one for the quasi smooth case. The construction is done by generalizing the extended Rees algebra to the derived setting, using Weil restrictions. We close by also generalizing the deformation to the normal cone to the derived setting.


Controlling crop pest with a farming awareness based integrated approach and optimal control. We investigate a mathematical model in crop pest controlling, considering plant biomass, pest, and the effect of farming awareness. The pest population is divided into two compartments susceptible pests and infected pests. We assume that the growth rate of self aware people is proportional to the density of susceptible pests existing in the crop arena. Impacts of awareness are modeled through the usual mass action term and a saturated term. It is further assumed that self aware people will adopt chemical and biological control methods, namely integrated pest management. Bio pesticides are costly and require a long term process, expensive to impose. However, if chemical pesticides are introduced in the farming system along with bio pesticides, the process will be faster as well as cost effective. Also, farming knowledge is equally important. In this article, a mathematical model is derived for controlling crop pests through an awareness based integrated approach. In order to reduce the negative effects of pesticides, we apply optimal control theory.


Correction and addendum to The Fourier expansion of Hecke operators for vector valued modular forms. We correct a mistake in cite St leading to erroneous formulas in Theorems 5.2 and 5.4. As an immediate corollary of a formula in cite BCJ we give a formula, which relates the Hecke operators T(p 2) circ T(p 2l 2 ) , T(p 2l ) and T(p 2l 4 ) and comment on it.