Learning Fine grained Fact Article Correspondence in Legal Cases. Automatically recommending relevant law articles to a given legal case has attracted much attention as it can greatly release human labor from searching over the large database of laws. However, current researches only support coarse grained recommendation where all relevant articles are predicted as a whole without explaining which specific fact each article is relevant with. Since one case can be formed of many supporting facts, traversing over them to verify the correctness of recommendation results can be time consuming. We believe that learning fine grained correspondence between each single fact and law articles is crucial for an accurate and trustworthy AI system. With this motivation, we perform a pioneering study and create a corpus with manually annotated fact article correspondences. We treat the learning as a text matching task and propose a multi level matching network to address it. To help the model better digest the content of law articles, we parse articles in form of premise conclusion pairs with random forest. Experiments show that the parsed form yielded better performance and the resulting model surpassed other popular text matching baselines. Furthermore, we compare with previous researches and find that establishing the fine grained fact article correspondences can improve the recommendation accuracy by a large margin. Our best system reaches an F1 score of 96.3 , making it of great potential for practical use. It can also significantly boost the downstream task of legal decision prediction, increasing the F1 score by up to 12.7 .


Learning Interactive Driving Policies via Data driven Simulation. Data driven simulators promise high data efficiency for driving policy learning. When used for modelling interactions, this data efficiency becomes a bottleneck Small underlying datasets often lack interesting and challenging edge cases for learning interactive driving. We address this challenge by proposing a simulation method that uses in painted ado vehicles for learning robust driving policies. Thus, our approach can be used to learn policies that involve multi agent interactions and allows for training via state of the art policy learning methods. We evaluate the approach for learning standard interaction scenarios in driving. In extensive experiments, our work demonstrates that the resulting policies can be directly transferred to a full scale autonomous vehicle without making use of any traditional sim to real transfer techniques such as domain randomization.


My encounter with Seshadri and with the Narasimhan Seshadri theorem. C.S. Seshadri passed away in July 2020. The first part of this article contains some reminiscences from the early 1980s, when as a graduate student in the Tata Institute of Fundamental Research (TIFR), Mumbai, I had the good fortune to learn from him. The second part is on the Narasimhan Seshadri theorem and my encounter with it.


Blockchain Phishing Scam Detection via Multi channel Graph Classification. With the popularity of blockchain technology, the financial security issues of blockchain transaction networks have become increasingly serious. Phishing scam detection methods will protect possible victims and build a healthier blockchain ecosystem. Usually, the existing works define phishing scam detection as a node classification task by learning the potential features of users through graph embedding methods such as random walk or graph neural network (GNN). However, these detection methods are suffered from high complexity due to the large scale of the blockchain transaction network, ignoring temporal information of the transaction. Addressing this problem, we defined the transaction pattern graphs for users and transformed the phishing scam detection into a graph classification task. To extract richer information from the input graph, we proposed a multi channel graph classification model (MCGC) with multiple feature extraction channels for GNN. The transaction pattern graphs and MCGC are more able to detect potential phishing scammers by extracting the transaction pattern features of the target users. Extensive experiments on seven benchmark and Ethereum datasets demonstrate that the proposed MCGC can not only achieve state of the art performance in the graph classification task but also achieve effective phishing scam detection based on the target users' transaction pattern graphs.


Undecidability in Finite Transducers, Defense Systems and Finite Substitutions. In this manuscript we present a detailed proof for undecidability of the equivalence of finite substitutions on regular language b 0,1 c . The proof is based on the works of Leonid P. Lisovik.


A mod n version of the Kronecker Weyl equidistribution theorem. We establish various analogs of the Kronecker Weyl equidistribution theorem that can be considered higher dimensional versions of results established in our earlier investigation of the discrete 2 circle problem studied in 1969 by Veech. Whereas the Veech problem can be viewed as one of geodesic flow on a 2 dimensional flat surface, here we study geodesic flow in higher dimensional flat manifolds. This is more challenging, as the overwhelming majority of the available proof techniques for non integrable flat systems are based on arguments in dimension 2. For higher dimensions, we need a new approach.


A Reverse Augmented Constraint preconditioner for Lagrange multiplier methods in contact mechanics. Frictional contact is one of the most challenging problems in computational mechanics. Typically, it is a tough nonlinear problem often requiring several Newton iterations to converge and causing troubles also in the solution to the related linear systems. When contact is modeled with the aid of Lagrange multipliers, the impenetrability condition is enforced exactly, but the associated Jacobian matrix is indefinite and needs a special treatment for a fast numerical solution. In this work, a constraint preconditioner is proposed where the primal Schur complement is computed after augmenting the zero block. The name Reverse is used in contrast to the traditional approach where only the structural block undergoes an augmentation. Besides being able to address problems characterized by singular structural blocks, often arising in contact mechanics, it is shown that the proposed approach is significantly cheaper than traditional constraint preconditioning for this class of problems and it is suitable for an efficient HPC implementation through the Chronos parallel package. Our conclusions are supported by several numerical experiments on mid and large size problems from various applications. The source files implementing the proposed algorithm are freely available on GitHub.


KnowMAN Weakly Supervised Multinomial Adversarial Networks. The absence of labeled data for training neural models is often addressed by leveraging knowledge about the specific task, resulting in heuristic but noisy labels. The knowledge is captured in labeling functions, which detect certain regularities or patterns in the training samples and annotate corresponding labels for training. This process of weakly supervised training may result in an over reliance on the signals captured by the labeling functions and hinder models to exploit other signals or to generalize well. We propose KnowMAN, an adversarial scheme that enables to control influence of signals associated with specific labeling functions. KnowMAN forces the network to learn representations that are invariant to those signals and to pick up other signals that are more generally associated with an output label. KnowMAN strongly improves results compared to direct weakly supervised learning with a pre trained transformer language model and a feature based baseline.


Extending SOUP to ML Models When DesigningCertified Medical Systems. Software of Unknown Provenance, SOUP, refers to a software component that is already developed and widely available from a 3rd party, and that has not been developed, to be integrated into a medical device. From regulatory perspective, SOUP software requires special considerations, as the developers' obligations related to design and implementation are not applied to it. In this paper, we consider the implications of extending the concept of SOUP to machine learning (ML) models. As the contribution, we propose practical means to manage the added complexity of 3rd party ML models in regulated development.


Inverse Design of Multi input Multi output 2D Metastructured Devices. In this work, an optimization based inverse design method is provided for multi input multi output (MIMO) metastructured devices. Typically, optimization based methods use a full wave solver in conjunction with an optimization routine to design devices. Due to the computational cost this approach is not practical for designing electrically large aperiodic metastructured devices. To address this issue, a 2 D circuit network solver using reduced order models of the metastructure's unit cells is introduced. The circuit network solver is used in conjunction with a gradient based optimization routine that uses the adjoint variable method to solve large scale optimization problems like those posed by metastructured devices. To validate the inverse design method, a planar beamformer and an analog signal processor for aperture field reconstruction are designed and validated with full wave simulations.


Trading via Selective Classification. A binary classifier that tries to predict if the price of an asset will increase or decrease naturally gives rise to a trading strategy that follows the prediction and thus always has a position in the market. Selective classification extends a binary or many class classifier to allow it to abstain from making a prediction for certain inputs, thereby allowing a trade off between the accuracy of the resulting selective classifier against coverage of the input feature space. Selective classifiers give rise to trading strategies that do not take a trading position when the classifier abstains. We investigate the application of binary and ternary selective classification to trading strategy design. For ternary classification, in addition to classes for the price going up or down, we include a third class that corresponds to relatively small price moves in either direction, and gives the classifier another way to avoid making a directional prediction. We use a walk forward train validate test approach to evaluate and compare binary and ternary, selective and non selective classifiers across several different feature sets based on four classification approaches logistic regression, random forests, feed forward, and recurrent neural networks. We then turn these classifiers into trading strategies for which we perform backtests on commodity futures markets. Our empirical results demonstrate the potential of selective classification for trading.


Global planar dynamics with star nodes beyond Hilbert's 16 th problem. This is a complete study of the dynamics of polynomial planar vector fields whose linear part is a multiple of the identity and whose nonlinear part is a homogeneous polynomial. It extends previous work by other authors that was mainly concerned with the existence and number of limit cycles. The general results are also applied to two classes of examples where the nonlinearities have degrees 2 and 3, for which we provide a complete set of phase portraits.


TRAIL Near Optimal Imitation Learning with Suboptimal Data. The aim in imitation learning is to learn effective policies by utilizing near optimal expert demonstrations. However, high quality demonstrations from human experts can be expensive to obtain in large numbers. On the other hand, it is often much easier to obtain large quantities of suboptimal or task agnostic trajectories, which are not useful for direct imitation, but can nevertheless provide insight into the dynamical structure of the environment, showing what could be done in the environment even if not what should be done. We ask the question, is it possible to utilize such suboptimal offline datasets to facilitate provably improved downstream imitation learning? In this work, we answer this question affirmatively and present training objectives that use offline datasets to learn a factored transition model whose structure enables the extraction of a latent action space. Our theoretical analysis shows that the learned latent action space can boost the sample efficiency of downstream imitation learning, effectively reducing the need for large near optimal expert datasets through the use of auxiliary non expert data. To learn the latent action space in practice, we propose TRAIL (Transition Reparametrized Actions for Imitation Learning), an algorithm that learns an energy based transition model contrastively, and uses the transition model to reparametrize the action space for sample efficient imitation learning. We evaluate the practicality of our objective through experiments on a set of navigation and locomotion tasks. Our results verify the benefits suggested by our theory and show that TRAIL is able to improve baseline imitation learning by up to 4x in performance.


A Multiplication Formula and Its Application. This article presents a vertical multiplication formula for calculating the multiplication of any two multi digit integers, which may be not only used to design the multiplier but also to the mental multiplication. Our algorithm is a generalization of that of Karatsuba and Offman, but it is superior to the latter because the latter is not suitable for oral calculation of multiplication of large integers. These two algorithms are both the vertical multiplication method, but in our algorithm the horizontal subtraction in stead of the horizontal addition used in the Kartsuba algorithm makes the involved numbers are much smaller and their algebraic sum are much smaller too because the positive and negative numbers probably cancel each other out. Because of the above advantages, our vertical multiplication formula allows more practical and efficient multipliers to be designed.


Are locally finite MV algebras a variety?. We answer Mundici's problem number 3 (D. Mundici. Advanced L ukasiewicz calculus. Trends in Logic Vol. 35. Springer 2011, p. 235) Is the category of locally finite MV algebras equivalent to an equational class? We prove (i) The category of locally finite MV algebras is not equivalent to any finitary variety. (ii) More is true the category of locally finite MV algebras is not equivalent to any finitely sorted finitary quasi variety. (iii) The category of locally finite MV algebras is equivalent to an infinitary variety with operations of at most countable arity. (iv) The category of locally finite MV algebras is equivalent to a countably sorted finitary variety. Our proofs rest upon the duality between locally finite MV algebras and the category of multisets by R. Cignoli, E. J. Dubuc and D. Mundici, and categorical characterisations of varieties and quasi varieties proved by J. Duskin, J. R. Isbell, F. W. Lawvere and others. In fact no knowledge on MV algebras is needed, apart from the aforementioned duality.


SwinBERT End to End Transformers with Sparse Attention for Video Captioning. The canonical approach to video captioning dictates a caption generation model to learn from offline extracted dense video features. These feature extractors usually operate on video frames sampled at a fixed frame rate and are often trained on image video understanding tasks, without adaption to video captioning data. In this work, we present SwinBERT, an end to end transformer based model for video captioning, which takes video frame patches directly as inputs, and outputs a natural language description. Instead of leveraging multiple 2D 3D feature extractors, our method adopts a video transformer to encode spatial temporal representations that can adapt to variable lengths of video input without dedicated design for different frame rates. Based on this model architecture, we show that video captioning can benefit significantly from more densely sampled video frames as opposed to previous successes with sparsely sampled video frames for video and language understanding tasks (e.g., video question answering). Moreover, to avoid the inherent redundancy in consecutive video frames, we propose adaptively learning a sparse attention mask and optimizing it for task specific performance improvement through better long range video sequence modeling. Through extensive experiments on 5 video captioning datasets, we show that SwinBERT achieves across the board performance improvements over previous methods, often by a large margin. The learned sparse attention masks in addition push the limit to new state of the arts, and can be transferred between different video lengths and between different datasets. Code is available at https github.com microsoft SwinBERT


Unsupervised Feature Learning for Manipulation with Contrastive Domain Randomization. Robotic tasks such as manipulation with visual inputs require image features that capture the physical properties of the scene, e.g., the position and configuration of objects. Recently, it has been suggested to learn such features in an unsupervised manner from simulated, self supervised, robot interaction the idea being that high level physical properties are well captured by modern physical simulators, and their representation from visual inputs may transfer well to the real world. In particular, learning methods based on noise contrastive estimation have shown promising results. To robustify the simulation to real transfer, domain randomization (DR) was suggested for learning features that are invariant to irrelevant visual properties such as textures or lighting. In this work, however, we show that a naive application of DR to unsupervised learning based on contrastive estimation does not promote invariance, as the loss function maximizes mutual information between the features and both the relevant and irrelevant visual properties. We propose a simple modification of the contrastive loss to fix this, exploiting the fact that we can control the simulated randomization of visual properties. Our approach learns physical features that are significantly more robust to visual domain variation, as we demonstrate using both rigid and non rigid objects.


Proving Regulatory Compliance A Computational Complexity Analysis of Elementary Variants. Organisations model their processes using so called business process models, to allow for verification of their correctness with respect to regulatory requirements and business rules. Automated methods for checking compliance, however, have to deal with the high complexity of the requirements as well as the significant size and quantity of process models in an organisation, which may prevent process models from being checked efficiently and timely. This paper provides a computational complexity analysis of the problem of proving regulatory compliance of process models. We investigate the computational complexity of each variant of the problem resulting from a combination of three binary properties associated to the regulatory framework, determining the regulatory requirements that a process model needs to follow to be compliant. These binary properties are whether the framework contains one or multiple obligations, whether the obligations are global or conditional, and whether only literals or formulae can be used to describe the obligations. For each variant of the problem we study the computational complexity of proving full compliance, partial compliance, and non compliance. This analysis allows to understand the specific features of the problem leading to intractability issues, thus potentially guiding future research towards developing feasible solutions for the problem in practical settings.


BrFAST a Tool to Select Browser Fingerprinting Attributes for Web Authentication According to a Usability Security Trade off. In this demonstration, we put ourselves in the place of a website manager who seeks to use browser fingerprinting for web authentication. The first step is to choose the attributes to implement among the hundreds that are available. To do so, we developed BrFAST, an attribute selection platform that includes FPSelect, an algorithm that rigorously selects the attributes according to a trade off between security and usability. BrFAST is configured with a set of parameters for which we provide values for BrFAST to be usable as is. We notably include the resources to use two publicly available browser fingerprint datasets. BrFAST can be extended to use other parameters other attribute selection methods, other measures of security and usability, or other fingerprint datasets. BrFAST helps visualize the exploration of the possibilities during the search of the best attributes to use, compare the properties of attribute sets, and compare several attribute selection methods. During the demonstration, we compare the attributes selected by FPSelect with these selected by the usual methods according to the properties of the resulting browser fingerprints (e.g., their usability, their unicity).


Heritable Nongenetic Information in the Form of the DNA Autonomous Tissue Spatial Code that Governs Organismal Development, Tissue Regeneration, and Tumor Architecture. Numerous studies of the tumor microenvironment, interspecies xenografting, and limb regeneration suggest the existence of a tissue spatial code TSC that controls tissue structure in a quasi "epigenetic" fashion. Epigenetic is an inadequate label, because this information does not act directly upon DNA molecules like methylation. A broader term is needed to capture the diversity of three dimensional spatial codes in biology. One such term is Heritable Nongenetic Information HNI , which encompasses the TSC. The term heritable is appropriate because this information is passed onto offspring, otherwise it would have disappeared during evolution. Another reason for the heritability of HNI is that the spatial information observed in tissues is not reducible to the laws of physics, meaning structures like epithelial tubes or neural circuits do not spontaneously form in an aqueous solution. Pre existing physiological information in the microenvironment is necessary.


Recent Advances in Heterogeneous Relation Learning for Recommendation. Recommender systems have played a critical role in many web applications to meet user's personalized interests and alleviate the information overload. In this survey, we review the development of recommendation frameworks with the focus on heterogeneous relational learning, which consists of different types of dependencies among users and items. The objective of this task is to map heterogeneous relational data into latent representation space, such that the structural and relational properties from both user and item domain can be well preserved. To address this problem, recent research developments can fall into three major lines social recommendation, knowledge graph enhanced recommender system, and multi behavior recommendation. We discuss the learning approaches in each category, such as matrix factorization, attention mechanism and graph neural networks, for effectively distilling heterogeneous contextual information. Finally, we present an exploratory outlook to highlight several promising directions and opportunities in heterogeneous relational learning frameworks for recommendation.


Representations for the Bloch type semi norm of Frechet differentiable mappings. In this paper we give some results concerning Frechet differentiable mappings between domains in normed spaces with controlled growth. The results are mainly motivated by Pavlovic's equality for the Bloch semi norm of continuously differentiable mappings in the Bloch class on the unit ball of the Euclidean space as well as the very recent Jocic's generalization of this result.


Direct Prediction of Steady State Flow Fields in Meshed Domain with Graph Networks. We propose a model to directly predict the steady state flow field for a given geometry setup. The setup is an Eulerian representation of the fluid flow as a meshed domain. We introduce a graph network architecture to process the mesh space simulation as a graph. The benefit of our model is a strong understanding of the global physical system, while being able to explore the local structure. This is essential to perform direct prediction and is thus superior to other existing methods.


Membership Inference Attacks on Lottery Ticket Networks. The vulnerability of the Lottery Ticket Hypothesis has not been studied from the purview of Membership Inference Attacks. Through this work, we are the first to empirically show that the lottery ticket networks are equally vulnerable to membership inference attacks. A Membership Inference Attack (MIA) is the process of determining whether a data sample belongs to a training set of a trained model or not. Membership Inference Attacks could leak critical information about the training data that can be used for targeted attacks. Recent deep learning models often have very large memory footprints and a high computational cost associated with training and drawing inferences. Lottery Ticket Hypothesis is used to prune the networks to find smaller sub networks that at least match the performance of the original model in terms of test accuracy in a similar number of iterations. We used CIFAR 10, CIFAR 100, and ImageNet datasets to perform image classification tasks and observe that the attack accuracies are similar. We also see that the attack accuracy varies directly according to the number of classes in the dataset and the sparsity of the network. We demonstrate that these attacks are transferable across models with high accuracy.


Onset of fracture in random heterogeneous particle chains. In mechanical systems it is of interest to know the onset of fracture in dependence of the boundary conditions. Here we study a one dimensional model which allows for an underlying heterogeneous structure in the discrete setting. Such models have recently been studied in the passage to the continuum by means of variational convergence ( Gamma convergence). The Gamma limit results determine thresholds of the boundary condition, which mark a transition from purely elastic behaviour to the occurrence of a crack. In this article we provide a notion of fracture in the discrete setting and show that its continuum limit yields the same threshold as that obtained from the Gamma limit. Since the calculation of the fracture threshold is much easier with the new method, we see a good chance that this new approach will turn out useful in applications.


A web basis of invariant polynomials from noncrossing partitions. The irreducible representations of symmetric groups can be realized as certain graded pieces of invariant rings, equivalently as global sections of line bundles on partial flag varieties. There are various ways to choose useful bases of such Specht modules S lambda . Particularly powerful are web bases, which make important connections with cluster algebras and quantum link invariants. Unfortunately, web bases are only known in very special cases essentially, only the cases lambda (d,d) and lambda (d,d,d) . Building on work of B. Rhoades (2017), we construct an apparent web basis of invariant polynomials for the 2 parameter family of Specht modules with lambda of the form (d,d,1 ell) . The planar diagrams that appear are noncrossing set partitions, and we thereby obtain geometric interpretations of earlier enumerative results in combinatorial dynamics.


Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation. Multimodal target aspect sentiment classification combines multimodal sentiment analysis and aspect target sentiment classification. The goal of the task is to combine vision and language to understand the sentiment towards a target entity in a sentence. Twitter is an ideal setting for the task because it is inherently multimodal, highly emotional, and affects real world events. However, multimodal tweets are short and accompanied by complex, possibly irrelevant images. We introduce a two stream model that translates images in input space using an object aware transformer followed by a single pass non autoregressive text generation approach. We then leverage the translation to construct an auxiliary sentence that provides multimodal information to a language model. Our approach increases the amount of text available to the language model and distills the object level information in complex images. We achieve state of the art performance on two multimodal Twitter datasets without modifying the internals of the language model to accept multimodal data, demonstrating the effectiveness of our translation. In addition, we explain a failure mode of a popular approach for aspect sentiment analysis when applied to tweets. Our code is available at textcolor blue url https github.com codezakh exploiting BERT thru translation .


Assessment of machine learning methods for state to state approaches. It is well known that numerical simulations of high speed reacting flows, in the framework of state to state formulations, are the most detailed but also often prohibitively computationally expensive. In this work, we start to investigate the possibilities offered by the use of machine learning methods for state to state approaches to alleviate such burden. In this regard, several tasks have been identified. Firstly, we assessed the potential of state of the art data driven regression models based on machine learning to predict the relaxation source terms which appear in the right hand side of the state to state Euler system of equations for a one dimensional reacting flow of a N 2 N binary mixture behind a plane shock wave. It is found that, by appropriately choosing the regressor and opportunely tuning its hyperparameters, it is possible to achieve accurate predictions compared to the full scale state to state simulation in significantly shorter times. Secondly, we investigated different strategies to speed up our in house state to state solver by coupling it with the best performing pre trained machine learning algorithm. The embedding of machine learning methods into ordinary differential equations solvers may offer a speed up of several orders of magnitude but some care should be paid for how and where such coupling is realized. Performances are found to be strongly dependent on the mutual nature of the interfaced codes. Finally, we aimed at inferring the full solution of the state to state Euler system of equations by means of a deep neural network completely by passing the use of the state to state solver while relying only on data. Promising results suggest that deep neural networks appear to be a viable technology also for these tasks.


Data Free Evaluation of User Contributions in Federated Learning. Federated learning (FL) trains a machine learning model on mobile devices in a distributed manner using each device's private data and computing resources. A critical issues is to evaluate individual users' contributions so that (1) users' effort in model training can be compensated with proper incentives and (2) malicious and low quality users can be detected and removed. The state of the art solutions require a representative test dataset for the evaluation purpose, but such a dataset is often unavailable and hard to synthesize. In this paper, we propose a method called Pairwise Correlated Agreement (PCA) based on the idea of peer prediction to evaluate user contribution in FL without a test dataset. PCA achieves this using the statistical correlation of the model parameters uploaded by users. We then apply PCA to designing (1) a new federated learning algorithm called Fed PCA, and (2) a new incentive mechanism that guarantees truthfulness. We evaluate the performance of PCA and Fed PCA using the MNIST dataset and a large industrial product recommendation dataset. The results demonstrate that our Fed PCA outperforms the canonical FedAvg algorithm and other baseline methods in accuracy, and at the same time, PCA effectively incentivizes users to behave truthfully.


Calibrate Before Use Improving Few Shot Performance of Language Models. GPT 3 can perform numerous tasks when provided a natural language prompt that contains a few training examples. We show that this type of few shot learning can be unstable the choice of prompt format, training examples, and even the order of the training examples can cause accuracy to vary from near chance to near state of the art. We demonstrate that this instability arises from the bias of language models towards predicting certain answers, e.g., those that are placed near the end of the prompt or are common in the pre training data. To mitigate this, we first estimate the model's bias towards each answer by asking for its prediction when given the training prompt and a content free test input such as "N A". We then fit calibration parameters that cause the prediction for this input to be uniform across answers. On a diverse set of tasks, this contextual calibration procedure substantially improves GPT 3 and GPT 2's average accuracy (up to 30.0 absolute) and reduces variance across different choices of the prompt.


REFORM Fast and Adaptive Solution for Subteam Replacement. In this paper, we propose the novel problem of Subteam Replacement given a team of people embedded in a social network to complete a certain task, and a subset of members subteam in this team which have become unavailable, find another set of people who can perform the subteam's role in the larger team. The ability to simultaneously replace multiple team members is highly appreciated in settings such as corporate management where team structure is highly volatile and large scale changes are commonplace. We conjecture that a good candidate subteam should have high skill and structural similarity with the replaced subteam while sharing a similar connection with the larger team as a whole. Based on this conjecture, we propose a novel graph kernel which evaluates the goodness of candidate subteams in this holistic way freely adjustable to the need of the situation. To tackle the significant computational difficulties, we combine our kernel with a fast approximate algorithm which (a) employs effective pruning strategies, (b) exploits the similarity between candidate team structures to reduce kernel computations, and (c) features a solid theoretical bound obtained from mathematical properties of the problem. We extensively test our solution on both synthetic and real datasets to demonstrate its consistency and efficiency. Our proposed graph kernel results in more suitable replacements being proposed compared to graph kernels used in previous work, and our algorithm consistently outperforms alternative choices by finding near optimal solutions while scaling linearly with the size of the replaced subteam.


NEREL A Russian Dataset with Nested Named Entities, Relations and Events. In this paper, we present NEREL, a Russian dataset for named entity recognition and relation extraction. NEREL is significantly larger than existing Russian datasets to date it contains 56K annotated named entities and 39K annotated relations. Its important difference from previous datasets is annotation of nested named entities, as well as relations within nested entities and at the discourse level. NEREL can facilitate development of novel models that can extract relations between nested named entities, as well as relations on both sentence and document levels. NEREL also contains the annotation of events involving named entities and their roles in the events. The NEREL collection is available via https github.com nerel ds NEREL.


Microbunching Instability Based Synchrotron Radiation Sources. Although microbunching instability (MBI) based synchrotron radiation facilities do not exist yet, the prominent presence of this space charge driven instability in the high brightness accelerator facilities promotes the ongoing worldwide effort to mastering it. Thereby not only the possible countermeasures but also the applications of MBI are in focus of the research. So far, the observed microbunching wavelengths are in IR or optical regime. Shifting the microbunching towards shorter wavelengths seems to require either very high bunch peak currents or extremely small emittances. These extreme characteristics are difficult to generate and hard to preserve. This letter proposes a novel magnetic device which allows to amplify the initial shot noise at wavelengths in EUX and XUV range with moderate peak current and emittance. It consists of permanent magnets. The specific combination of focusing channels, dispersive chicanes and single focusing elements in this device allows for optimal amplification of microbunching by the longitudinal space charge impedance. Extensive simulation studies for different beam energies show the performance of the proposed device, which fed for example with an energy recovery linac can provide ultra short coherent high power radiation pulses with a high repetition rate.


MBDF Net Multi Branch Deep Fusion Network for 3D Object Detection. Point clouds and images could provide complementary information when representing 3D objects. Fusing the two kinds of data usually helps to improve the detection results. However, it is challenging to fuse the two data modalities, due to their different characteristics and the interference from the non interest areas. To solve this problem, we propose a Multi Branch Deep Fusion Network (MBDF Net) for 3D object detection. The proposed detector has two stages. In the first stage, our multi branch feature extraction network utilizes Adaptive Attention Fusion (AAF) modules to produce cross modal fusion features from single modal semantic features. In the second stage, we use a region of interest (RoI) pooled fusion module to generate enhanced local features for refinement. A novel attention based hybrid sampling strategy is also proposed for selecting key points in the downsampling process. We evaluate our approach on two widely used benchmark datasets including KITTI and SUN RGBD. The experimental results demonstrate the advantages of our method over state of the art approaches.


Machine Translation of Low Resource Indo European Languages. In this work, we investigate methods for the challenging task of translating between low resource language pairs that exhibit some level of similarity. In particular, we consider the utility of transfer learning for translating between several Indo European low resource languages from the Germanic and Romance language families. In particular, we build two main classes of transfer based systems to study how relatedness can benefit the translation performance. The primary system fine tunes a model pre trained on a related language pair and the contrastive system fine tunes one pre trained on an unrelated language pair. Our experiments show that although relatedness is not necessary for transfer learning to work, it does benefit model performance.


The Asymptotic Infinitesimal Distribution of a Real Wishart Random Matrix. Let X N be a N times N real Wishart random matrix with aspect ratio M N . The limit eigenvalue distribution of X N is the Marchenko Pastur law with parameter c lim N M N . The limit moments m n n are given by m n sum pi c ( pi) where the sum runs over NC(n) . Let m n' be the limit of N( mathrm E ( mathrm tr (X N n)) m n) . These are the asymptotic infinitesimal moments of a real Wishart matrix. We show that m' n can be written as a sum over planar diagrams with two terms, sum pi c'( ( pi) 1) c ( pi) 1 , and sum pi in S NC delta(n, n) c ( pi) 2 , where S NC delta(n, n) is a set of non crossing annular permutations satisfying a symmetry condition. Moreover we present a recursion formula for the second term which is related to one for higher order freeness.


Asymptotic expansions for the Laplace Mellin and Riemann Liouville transforms of Lerch zeta functions. For a complex variable s and real parameters a and lambda with a 0 , let phi(s,a, lambda) denote the Lerch zeta function with a complex variable, phi ast (s,a, lambda) a slight modification of phi(s,a, lambda) defined by extracting the (possible) singularity of phi(s,a, lambda) at s 1 , and ( phi ast ) (m) (s,a, lambda) for any m in mathbb Z the m th derivative with respect to s if m geq0 , while if m leq0 the m th primitive defined with its initial point at s infty . The present paper aims to study asymptotic aspects of ( phi ast ) (m) (s,a, lambda) , transformed through the Laplace Mellin and Riemann Liouville operators (say, mathcal LM z tau alpha and mathcal RL z tau alpha, beta , respectively) in terms of the variable s . We shall show that complete asymptotic expansions exist if a 1 for mathcal LM z tau alpha ( phi ast ) (m) (s tau,a, lambda) and mathcal RL z tau alpha, beta ( phi ast ) (m) (s tau,a, lambda) (Theorems 1 4), as well as for their iterated variants (Theorems 5 10), when the pivotal' parameter z (of the transforms) tends to both 0 and infty through appropriate sectors. Most of our results include any vertical ray in their region of validity this allows us to deduce complete asymptotic expansions along vertical lines (s,z) ( sigma,it) as t to pm infty (Corollaries 2.1, 4.1, 6.1 and 8.1).


Machine learning on knowledge graphs for context aware security monitoring. Machine learning techniques are gaining attention in the context of intrusion detection due to the increasing amounts of data generated by monitoring tools, as well as the sophistication displayed by attackers in hiding their activity. However, existing methods often exhibit important limitations in terms of the quantity and relevance of the generated alerts. Recently, knowledge graphs are finding application in the cybersecurity domain, showing the potential to alleviate some of these drawbacks thanks to their ability to seamlessly integrate data from multiple domains using human understandable vocabularies. We discuss the application of machine learning on knowledge graphs for intrusion detection and experimentally evaluate a link prediction method for scoring anomalous activity in industrial systems. After initial unsupervised training, the proposed method is shown to produce intuitively well calibrated and interpretable alerts in a diverse range of scenarios, hinting at the potential benefits of relational machine learning on knowledge graphs for intrusion detection purposes.


Combinatorial Resultants in the Algebraic Rigidity Matroid. Motivated by a rigidity theoretic perspective on the Localization Problem in 2D, we develop an algorithm for computing circuit polynomials in the algebraic rigidity matroid associated to the Cayley Menger ideal for n points in 2D. We introduce combinatorial resultants, a new operation on graphs that captures properties of the Sylvester resultant of two polynomials in the algebraic rigidity matroid. We show that every rigidity circuit has a construction tree from K 4 graphs based on this operation. Our algorithm performs an algebraic elimination guided by the construction tree, and uses classical resultants, factorization and ideal membership. To demonstrate its effectiveness, we implemented our algorithm in Mathematica it took less than 15 seconds on an example where a Groebner Basis calculation took 5 days and 6 hrs.


Hessian informed mirror descent. Inspired by the recent paper (L. Ying, Mirror descent algorithms for minimizing interacting free energy, Journal of Scientific Computing, 84 (2020), pp. 1 14),we explore the relationship between the mirror descent and the variable metric method. When the metric in the mirror decent is induced by a convex function, whose Hessian is close to the Hessian of the objective function, this method enjoys both robustness from the mirror descent and superlinear convergence for Newton type methods. When applied to a linearly constrained minimization problem, we prove the global and local convergence, both in the continuous and discrete settings. As applications, we compute the Wasserstein gradient flows and Cahn Hillard equation with degenerate mobility. When formulating these problems using a minimizing movement scheme with respect to a variable metric, our mirror descent algorithm offers a fast convergent speed for the underlining optimization problem while maintaining the total mass and bounds of the solution.


Connections of Class Numbers to the Group Structure of Generalized Pythagorean Triples. Two well studied Diophantine equations are those of Pythagorean triples and elliptic curves for the first, we have a parametrization through rational points on the unit circle, and for the second we have a structure theorem for the group of rational solutions. Recently Yekutieli discussed a connection between these two problems and described the group structure of Pythagorean triples and the number of triples for a given hypotenuse. We generalize these methods and results to Pell's equation. We find a similar group structure and count on the number of solutions for a given z to x 2 Dy 2 z 2 when D is 1 or 2 modulo 4 and the class group of mathbb Q sqrt D is a free mathbb Z 2 module, which always happens if the class number is at most 2. We give examples of when the results hold for a class number greater than 2, as well as an example with different behavior when the class group does not have this structure.


STARdom an architecture for trusted and secure human centered manufacturing systems. There is a lack of a single architecture specification that addresses the needs of trusted and secure Artificial Intelligence systems with humans in the loop, such as human centered manufacturing systems at the core of the evolution towards Industry 5.0. To realize this, we propose an architecture that integrates forecasts, Explainable Artificial Intelligence, supports collecting users' feedback, and uses Active Learning and Simulated Reality to enhance forecasts and provide decision making recommendations. The architecture security is addressed as a general concern. We align the proposed architecture with the Big Data Value Association Reference Architecture Model. We tailor it for the domain of demand forecasting and validate it on a real world case study.


Near Optimal Cayley Expanders for Abelian Groups. We give an efficient deterministic algorithm that outputs an expanding generating set for any finite abelian group. The size of the generating set is close to the randomized construction of Alon and Roichman (1994), improving upon various deterministic constructions in both the dependence on the dimension and the spectral gap. By obtaining optimal dependence on the dimension we resolve a conjecture of Azar, Motwani, and Naor (1998) in the affirmative. Our technique is an extension of the bias amplification technique of Ta Shma (2017), who used random walks on expanders to obtain expanding generating sets over the additive group of n bit strings. As a consequence, we obtain (i) randomness efficient constructions of almost k wise independent variables, (ii) a faster deterministic algorithm for the Remote Point Problem, (iii) randomness efficient low degree tests, and (iv) randomness efficient verification of matrix multiplication.


Deep Learning based Biological Anatomical Landmark Detection in Colonoscopy Videos. Colonoscopy is a standard imaging tool for visualizing the entire gastrointestinal (GI) tract of patients to capture lesion areas. However, it takes the clinicians excessive time to review a large number of images extracted from colonoscopy videos. Thus, automatic detection of biological anatomical landmarks within the colon is highly demanded, which can help reduce the burden of clinicians by providing guidance information for the locations of lesion areas. In this article, we propose a novel deep learning based approach to detect biological anatomical landmarks in colonoscopy videos. First, raw colonoscopy video sequences are pre processed to reject interference frames. Second, a ResNet 101 based network is used to detect three biological anatomical landmarks separately to obtain the intermediate detection results. Third, to achieve more reliable localization of the landmark periods within the whole video period, we propose to post process the intermediate detection results by identifying the incorrectly predicted frames based on their temporal distribution and reassigning them back to the correct class. Finally, the average detection accuracy reaches 99.75 . Meanwhile, the average IoU of 0.91 shows a high degree of similarity between our predicted landmark periods and ground truth. The experimental results demonstrate that our proposed model is capable of accurately detecting and localizing biological anatomical landmarks from colonoscopy videos.


EnsembleNTLDetect An Intelligent Framework for Electricity Theft Detection in Smart Grid. Artificial intelligence based techniques applied to the electricity consumption data generated from the smart grid prove to be an effective solution in reducing Non Technical Loses (NTLs), thereby ensures safety, reliability, and security of the smart energy systems. However, imbalanced data, consecutive missing values, large training times, and complex architectures hinder the real time application of electricity theft detection models. In this paper, we present EnsembleNTLDetect, a robust and scalable electricity theft detection framework that employs a set of efficient data pre processing techniques and machine learning models to accurately detect electricity theft by analysing consumers' electricity consumption patterns. This framework utilises an enhanced Dynamic Time Warping Based Imputation (eDTWBI) algorithm to impute missing values in the time series data and leverages the Near miss undersampling technique to generate balanced data. Further, stacked autoencoder is introduced for dimensionality reduction and to improve training efficiency. A Conditional Generative Adversarial Network (CTGAN) is used to augment the dataset to ensure robust training and a soft voting ensemble classifier is designed to detect the consumers with aberrant consumption patterns. Furthermore, experiments were conducted on the real time electricity consumption data provided by the State Grid Corporation of China (SGCC) to validate the reliability and efficiency of EnsembleNTLDetect over the state of the art electricity theft detection models in terms of various quality metrics.


On the Cauchy problems associated to a ZK KP type family equations with a transversal fractional dispersion. In this paper we examine the well posedness and ill posedeness of the Cauchy problems associated to a family equations of ZK KP type begin cases u t u xxx mathscr H D x alpha u yy uu x , cr u(0) psi in Z end cases in anisotropic Sobolev spaces, where 1 le alpha le 1 , mathscr H is the Hilbert transform and D x alpha is the fractional derivative, both with respect to x .


Hallucination Improves Few Shot Object Detection. Learning to detect novel objects from few annotated examples is of great practical importance. A particularly challenging yet common regime occurs when there are extremely limited examples (less than three). One critical factor in improving few shot detection is to address the lack of variation in training data. We propose to build a better model of variation for novel classes by transferring the shared within class variation from base classes. To this end, we introduce a hallucinator network that learns to generate additional, useful training examples in the region of interest (RoI) feature space, and incorporate it into a modern object detection model. Our approach yields significant performance improvements on two state of the art few shot detectors with different proposal generation procedures. In particular, we achieve new state of the art in the extremely few shot regime on the challenging COCO benchmark.


MALib A Parallel Framework for Population based Multi agent Reinforcement Learning. Population based multi agent reinforcement learning (PB MARL) refers to the series of methods nested with reinforcement learning (RL) algorithms, which produces a self generated sequence of tasks arising from the coupled population dynamics. By leveraging auto curricula to induce a population of distinct emergent strategies, PB MARL has achieved impressive success in tackling multi agent tasks. Despite remarkable prior arts of distributed RL frameworks, PB MARL poses new challenges for parallelizing the training frameworks due to the additional complexity of multiple nested workloads between sampling, training and evaluation involved with heterogeneous policy interactions. To solve these problems, we present MALib, a scalable and efficient computing framework for PB MARL. Our framework is comprised of three key components (1) a centralized task dispatching model, which supports the self generated tasks and scalable training with heterogeneous policy combinations (2) a programming architecture named Actor Evaluator Learner, which achieves high parallelism for both training and sampling, and meets the evaluation requirement of auto curriculum learning (3) a higher level abstraction of MARL training paradigms, which enables efficient code reuse and flexible deployments on different distributed computing paradigms. Experiments on a series of complex tasks such as multi agent Atari Games show that MALib achieves throughput higher than 40K FPS on a single machine with 32 CPU cores 5x speedup than RLlib and at least 3x speedup than OpenSpiel in multi agent training tasks. MALib is publicly available at https github.com sjtu marl malib.


Do Language Models Learn Commonsense Knowledge?. Language models (LMs) trained on large amounts of data have shown impressive performance on many NLP tasks under the zero shot and few shot setup. Here we aim to better understand the extent to which such models learn commonsense knowledge a critical component of many NLP applications. To that end, we conduct a systematic and rigorous zero shot and few shot commonsense evaluation of pre trained LMs, where we (i) carefully control for the LM's ability to exploit potential surface cues and annotation artefacts, and (ii) account for variations in model performance that arise from non commonsense related factors. Our findings highlight the limitations of pre trained LMs in acquiring commonsense knowledge without task specific supervision furthermore, using larger models or augmenting the LMs with commonsense knowledge bases at test time did not substantially improve their performance. More broadly, our findings offer valuable lessons and best practices for conducting more rigorous multiple choice evaluations of pre trained LMs.


Impact of Variable Speed on Collective Movement of Animal Groups. A variety of agent based models has been proposed to account for the emergence of coordinated collective behavior of animal groups from simple interaction rules. A common, simplifying assumption of such collective movement models, is the consideration of individual agents moving with a constant speed. In this work we critically re asses this assumption underlying a vast majority of collective movement models. First, we show the omnipresent speed variability observed in different species of live fish and artificial agents (RoboFish). Based on theoretical considerations accounting for inertia and rotational friction, we derive a functional dependence of the turning response of individuals on their instantaneous speed (confirmed by experimental data). We investigate how the interplay of variable speed and speed dependent turning affects self organized collective behavior by implementing an agent based model which accounts for both effects. We show, that besides average speed, the individual speed variability may have a dramatic impact on the emergent collective dynamics, as two groups differing only in their speed variability, and being otherwise identical in all other behavioral parameters, can be in two fundamentally different stationary states. We find that the local coupling between group polarization and individual speed is strongest at the order disorder transition. Furthermore, we demonstrate a decrease in polarization with group size for groups of individuals with variable speed, and a sudden decrease in mean individual speed at a critical group size (N 4 for Voronoi interactions) linked to a topological transition from an all to all to a distributed spatial interaction network. Overall, our work highlights the importance to account for fundamental kinematic constraints in general, and variable speed in particular, when modeling self organized collective dynamics.


Coxeter combinatorics for sum formulas in the representation theory of algebraic groups. Let G be a simple algebraic group over an algebraically closed field mathbb F of characteristic p geq h , the Coxeter number of G . We observe an easy recursion formula' for computing the Jantzen sum formula of a Weyl module with p regular highest weight. We also discuss a duality formula' that relates the Jantzen sum formula to Andersen's sum formula for tilting filtrations and we give two different representation theoretic explanations of the recursion formula. As a corollary, we also obtain an upper bound on the length of the Jantzen filtration of a Weyl module with p regular highest weight in terms of the length of the Jantzen filtration of a Weyl module with highest weight in an adjacent alcove.


Defining and Detecting Toxicity on Social Media Context and Knowledge are Key. Online platforms have become an increasingly prominent means of communication. Despite the obvious benefits to the expanded distribution of content, the last decade has resulted in disturbing toxic communication, such as cyberbullying and harassment. Nevertheless, detecting online toxicity is challenging due to its multi dimensional, context sensitive nature. As exposure to online toxicity can have serious social consequences, reliable models and algorithms are required for detecting and analyzing such communication across the vast and growing space of social media. In this paper, we draw on psychological and social theory to define toxicity. Then, we provide an approach that identifies multiple dimensions of toxicity and incorporates explicit knowledge in a statistical learning algorithm to resolve ambiguity across such dimensions.


Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation. Open domain neural dialogue models have achieved high performance in response ranking and evaluation tasks. These tasks are formulated as a binary classification of responses given in a dialogue context, and models generally learn to make predictions based on context response content similarity. However, over reliance on content similarity makes the models less sensitive to the presence of inconsistencies, incorrect time expressions and other factors important for response appropriateness and coherence. We propose approaches for automatically creating adversarial negative training data to help ranking and evaluation models learn features beyond content similarity. We propose mask and fill and keyword guided approaches that generate negative examples for training more robust dialogue systems. These generated adversarial responses have high content similarity with the contexts but are either incoherent, inappropriate or not fluent. Our approaches are fully data driven and can be easily incorporated in existing models and datasets. Experiments on classification, ranking and evaluation tasks across multiple datasets demonstrate that our approaches outperform strong baselines in providing informative negative examples for training dialogue systems.


TranSmart A Practical Interactive Machine Translation System. Automatic machine translation is super efficient to produce translations yet their quality is not guaranteed. This technique report introduces TranSmart, a practical human machine interactive translation system that is able to trade off translation quality and efficiency. Compared to existing publicly available interactive translation systems, TranSmart supports three key features, word level autocompletion, sentence level autocompletion and translation memory. By word level and sentence level autocompletion, TranSmart allows users to interactively translate words in their own manners rather than the strict manner from left to right. In addition, TranSmart has the potential to avoid similar translation mistakes by using translated sentences in history as its memory. This report presents major functions of TranSmart, algorithms for achieving these functions, how to use the TranSmart APIs, and evaluation results of some key functions. TranSmart is publicly available at its homepage (https transmart.qq.com).


A Semi supervised Multi task Learning Approach to Classify Customer Contact Intents. In the area of customer support, understanding customers' intents is a crucial step. Machine learning plays a vital role in this type of intent classification. In reality, it is typical to collect confirmation from customer support representatives (CSRs) regarding the intent prediction, though it can unnecessarily incur prohibitive cost to ask CSRs to assign existing or new intents to the mis classified cases. Apart from the confirmed cases with and without intent labels, there can be a number of cases with no human curation. This data composition (Positives Unlabeled multiclass Negatives) creates unique challenges for model development. In response to that, we propose a semi supervised multi task learning paradigm. In this manuscript, we share our experience in building text based intent classification models for a customer support service on an E commerce website. We improve the performance significantly by evolving the model from multiclass classification to semi supervised multi task learning by leveraging the negative cases, domain and task adaptively pretrained ALBERT on customer contact texts, and a number of un curated data with no labels. In the evaluation, the final model boosts the average AUC ROC by almost 20 points compared to the baseline finetuned multiclass classification ALBERT model.


ROOAD RELLIS Off road Odometry Analysis Dataset. The development and implementation of visual inertial odometry (VIO) has focused on structured environments, but interest in localization in off road environments is growing. In this paper, we present the RELLIS Off road Odometry Analysis Dataset (ROOAD) which provides high quality, time synchronized off road monocular visual inertial data sequences to further the development of related research. We evaluated the dataset on two state of the art VIO algorithms, (1) Open VINS and (2) VINS Fusion. Our findings indicate that both algorithms perform 2 to 30 times worse on the ROOAD dataset compared to their performance in structured environments. Furthermore, OpenVINS has better tracking stability and real time performance than VINS Fusion in the off road environment, while VINS Fusion outperformed OpenVINS in tracking accuracy in several data sequences. Since the camera IMU calibration tool from Kalibr toolkit is used extensively in this work, we have included several calibration data sequences. Our hand measurements show Kalibr's tool achieved 1 degree for orientation error and 1 mm at best (x and y axis) and 10 mm (z axis) at worse for position error in the camera frame between the camera and IMU. This novel dataset provides a new set of scenarios for researchers to design and test their localization algorithms on, as well as critical insights in the current performance of VIO in off road environments. ROOAD Dataset github.com unmannedlab ROOAD


Model Bias in NLP Application to Hate Speech Classification using transfer learning techniques. In this paper, a BERT based neural network model is applied to the JIGSAW data set in order to create a model identifying hateful and toxic comments (strictly seperated from offensive language) in online social platforms (English language), in this case Twitter. Three other neural network architectures and a GPT 2 model are also applied on the provided data set in order to compare these different models. The trained BERT model is then applied on two different data sets to evaluate its generalisation power, namely on another Twitter data set and the data set HASOC 2019 which includes Twitter and also Facebook comments we focus on the English HASOC 2019 data. In addition, it can be shown that by fine tuning the trained BERT model on these two data sets by applying different transfer learning scenarios via retraining partial or all layers the predictive scores improve compared to simply applying the model pre trained on the JIGSAW data set. With our results, we get precisions from 64 to around 90 while still achieving acceptable recall values of at least lower 60s , proving that BERT is suitable for real use cases in social platforms.


Vertical Bicycle Model of Vehicle with Dry Friction. The motion of a vertically positioned bicycle is considered when a horizontal control force, which maybe both internal and external in relation to the bicycle, is applied to its pedal. Tangential forces of dryfriction obeying the Euler Coulomb law act at points of contact of the wheels with the horizontal supportplane. The constraint at the points of contact of the wheels with the support is assumed to be unilateral.The problem of determining the acceleration of the centre of mass of the bicycle and the realized motionsof its wheels (with or without slip, and with or without detachment) with dierent values of the design parameters and control force is solved. This approach is usefull for control of vehicle and optimization of its dynamical parameters. Cases of non uniqueness of motion the Painleve paradox are found.


DRAG Director Generator Language Modelling Framework for Non Parallel Author Stylized Rewriting. Author stylized rewriting is the task of rewriting an input text in a particular author's style. Recent works in this area have leveraged Transformer based language models in a denoising autoencoder setup to generate author stylized text without relying on a parallel corpus of data. However, these approaches are limited by the lack of explicit control of target attributes and being entirely data driven. In this paper, we propose a Director Generator framework to rewrite content in the target author's style, specifically focusing on certain target attributes. We show that our proposed framework works well even with a limited sized target author corpus. Our experiments on corpora consisting of relatively small sized text authored by three distinct authors show significant improvements upon existing works to rewrite input texts in target author's style. Our quantitative and qualitative analyses further show that our model has better meaning retention and results in more fluent generations.


Be Causal De biasing Social Network Confounding in Recommendation. In recommendation systems, the existence of the missing not at random (MNAR) problem results in the selection bias issue, degrading the recommendation performance ultimately. A common practice to address MNAR is to treat missing entries from the so called "exposure" perspective, i.e., modeling how an item is exposed (provided) to a user. Most of the existing approaches use heuristic models or re weighting strategy on observed ratings to mimic the missing at random setting. However, little research has been done to reveal how the ratings are missing from a causal perspective. To bridge the gap, we propose an unbiased and robust method called DENC (De bias Network Confounding in Recommendation) inspired by confounder analysis in causal inference. In general, DENC provides a causal analysis on MNAR from both the inherent factors (e.g., latent user or item factors) and auxiliary network's perspective. Particularly, the proposed exposure model in DENC can control the social network confounder meanwhile preserves the observed exposure information. We also develop a deconfounding model through the balanced representation learning to retain the primary user and item features, which enables DENC generalize well on the rating prediction. Extensive experiments on three datasets validate that our proposed model outperforms the state of the art baselines.


On the Role of Images for Analyzing Claims in Social Media. Fake news is a severe problem in social media. In this paper, we present an empirical study on visual, textual, and multimodal models for the tasks of claim, claim check worthiness, and conspiracy detection, all of which are related to fake news detection. Recent work suggests that images are more influential than text and often appear alongside fake text. To this end, several multimodal models have been proposed in recent years that use images along with text to detect fake news on social media sites like Twitter. However, the role of images is not well understood for claim detection, specifically using transformer based textual and multimodal models. We investigate state of the art models for images, text (Transformer based), and multimodal information for four different datasets across two languages to understand the role of images in the task of claim and conspiracy detection.


Noncommutative Symmetric Functions and Lagrange Inversion II Noncrossing partitions and the Farahat Higman algebra. We introduce a new pair of mutually dual bases of noncommutative symmetric functions and quasi symmetric functions, and use it to derive generalizations of several results on the reduced incidence algebra of the lattice of noncrossing partitions. As a consequence, we obtain a quasi symmetric version of the Farahat Higman algebra.


Doc2Dict Information Extraction as Text Generation. Typically, information extraction (IE) requires a pipeline approach first, a sequence labeling model is trained on manually annotated documents to extract relevant spans then, when a new document arrives, a model predicts spans which are then post processed and standardized to convert the information into a database entry. We replace this labor intensive workflow with a transformer language model trained on existing database records to directly generate structured JSON. Our solution removes the workload associated with producing token level annotations and takes advantage of a data source which is generally quite plentiful (e.g. database records). As long documents are common in information extraction tasks, we use gradient checkpointing and chunked encoding to apply our method to sequences of up to 32,000 tokens on a single GPU. Our Doc2Dict approach is competitive with more complex, hand engineered pipelines and offers a simple but effective baseline for document level information extraction. We release our Doc2Dict model and code to reproduce our experiments and facilitate future work.


The Coq Proof Script Visualiser (coq psv). In this work, we present a visualisation tool that is able to process Coq proof scripts and generate a table representation of the contained proofs as LaTeX or PDF files. This tool has the aim to support both education and review processes as all proof steps can be visualised. Thus, there is no need to use Coq in order to review proofs or use them as examples in teaching. In contrast to the usual approach of visualising proofs as hypertext or markdown documents, the generated files can be easily printed.


A note on relative homological epimorphisms of topological algebras. We give several characterizations of relative homological epimorphisms in the setting of locally convex topological algebras, thereby correcting a gap in our earlier paper Trans. Moscow Math. Soc. 2008, 27 104 .


Extensive networks would eliminate the demand for pricing formulas. In this study, we generate a large number of implied volatilities for the Stochastic Alpha Beta Rho (SABR) model using a graphics processing unit (GPU) based simulation and enable an extensive neural network to learn them. This model does not have any exact pricing formulas for vanilla options, and neural networks have an outstanding ability to approximate various functions. Surprisingly, the network reduces the simulation noises by itself, thereby achieving as much accuracy as the Monte Carlo simulation. Extremely high accuracy cannot be attained via existing approximate formulas. Moreover, the network is as efficient as the approaches based on the formulas. When evaluating based on high accuracy and efficiency, extensive networks can eliminate the necessity of the pricing formulas for the SABR model. Another significant contribution is that a novel method is proposed to examine the errors based on nonlinear regression. This approach is easily extendable to other pricing models for which it is hard to induce analytic formulas.


Tilting objects in singularity categories of toric Gorenstein varieties. We study certain toric Gorenstein varieties with isolated singularities which are the quotient spaces of generic unimodular representations by the one dimensional torus, or by the product of the one dimensional torus with a finite abelian group. Based on the works of v S penko and Van den Bergh Invent. Math. 210 (2017), no. 1, 3 67 and Mori and Ueyama Adv. Math. 297 (2016), 54 92 , we show that the singularity categories of these varieties admit tilting objects, and hence are triangle equivalent to the perfect categories of some finite dimensional algebras.


Genus two curves with full sqrt 3 level structure and Tate Shafarevich groups. We give an explicit rational parameterization of the surface mathcal H 3 over mathbb Q whose points parameterize genus 2 curves C with full 3 level structure on their Jacobians J . We use this model to construct abelian surfaces A such that the Tate Shafarevich group of A d has non trivial 3 torsion, for a positive proportion of quadratic twists A d . In fact, for 100 of x in mathcal H 3( mathbb Q ) , this holds for the surface A mathrm Jac (C x) langle P rangle , where P is the marked point of order 3. Our methods also give an explicit bound on the average rank of J d( mathbb Q ) , as well as statistical results on the size of C d( mathbb Q ) , as d varies through squarefree integers.


Conversational Multi Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules. One of the challenges faced by conversational agents is their inability to identify unstated presumptions of their users' commands, a task trivial for humans due to their common sense. In this paper, we propose a zero shot commonsense reasoning system for conversational agents in an attempt to achieve this. Our reasoner uncovers unstated presumptions from user commands satisfying a general template of if (state), then (action), because (goal). Our reasoner uses a state of the art transformer based generative commonsense knowledge base (KB) as its source of background knowledge for reasoning. We propose a novel and iterative knowledge query mechanism to extract multi hop reasoning chains from the neural KB which uses symbolic logic rules to significantly reduce the search space. Similar to any KBs gathered to date, our commonsense KB is prone to missing knowledge. Therefore, we propose to conversationally elicit the missing knowledge from human users with our novel dynamic question generation strategy, which generates and presents contextualized queries to human users. We evaluate the model with a user study with human users that achieves a 35 higher success rate compared to SOTA.


Vaccine skepticism detection by network embedding. We demonstrate the applicability of network embedding to vaccine skepticism, a controversial topic of long past history. With the Covid 19 pandemic outbreak at the end of 2019, the topic is more important than ever. Only a year after the first international cases were registered, multiple vaccines were developed and passed clinical testing. Besides the challenges of development, testing, and logistics, another factor that might play a significant role in the fight against the pandemic are people who are hesitant to get vaccinated, or even state that they will refuse any vaccine offered to them. Two groups of people commonly referred to as a) pro vaxxer, those who support vaccinating people b) vax skeptic, those who question vaccine efficacy or the need for general vaccination against Covid 19. It is very difficult to tell exactly how many people share each of these views. It is even more difficult to understand all the reasoning why vax skeptic opinions are getting more popular. In this work, our intention was to develop techniques that are able to efficiently differentiate between pro vaxxer and vax skeptic content. After multiple data preprocessing steps, we analyzed the tweet text as well as the structure of user interactions on Twitter. We deployed several node embedding and community detection models that scale well for graphs with millions of edges.


P rho Log a system for rule based programming. In this paper, we give a brief overview of the rule based programming system, called P rho Log and illustrate its capabilities.


The Geometry of the Painlev 'e paradox. Painlev 'e showed that there can be inconsistency and indeterminacy in solutions to the equations of motion of a 2D rigid body moving on a sufficiently rough surface. The study of Painlev 'e paradoxes in 3D has received far less attention. In this paper, we highlight the pivotal role in the dynamics of the azimuthal angular velocity Psi by proving the existence of three critical values of Psi, one of which occurs independently of any paradox. We show that the 2D problem is highly singular and uncover a rich geometry in the 3D problem which we use to explain recent numerical results.


Stability of overshoots of Markov additive processes. We prove precise stability results for overshoots of Markov additive processes (MAPs) with finite modulating space. Our approach is based on the Markovian nature of overshoots of MAPs whose mixing and ergodic properties are investigated in terms of the characteristics of the MAP. On our way we extend fluctuation theory of MAPs, contributing among others to the understanding of the Wiener Hopf factorization for MAPs by generalizing Vigon's 'equations amicales invers 'es known for L 'evy processes. Using the Lamperti transformation the results can be applied to self similar Markov processes. Among many possible applications, we study the mixing behavior of stable processes sampled at first hitting times as a concrete example.


Rapid computation of special values of Dirichlet L functions. We consider computing the Riemann zeta function zeta(s) and Dirichlet L functions L(s, chi) to p bit accuracy for large p . Using the approximate functional equation together with asymptotically fast computation of the incomplete gamma function, we observe that p 3 2 o(1) bit complexity can be achieved if s is an algebraic number of fixed degree and with algebraic height bounded by O(p) . This is an improvement over the p 2 o(1) complexity of previously published algorithms and yields, among other things, p 3 2 o(1) complexity algorithms for Stieltjes constants and n 3 2 o(1) complexity algorithms for computing the n th Bernoulli number or the n th Euler number exactly.


Crowd Sensing and Living Lab Outdoor Experimentation Made Easy. Living lab outdoor experimentation using pervasive computing provides new opportunities higher realism, external validity and socio spatio temporal observations in large scale. However, experimentation in the wild' is complex and costly. Noise, biases, privacy concerns, compliance with standards of ethical review boards, remote moderation, control of experimental conditions and equipment perplex the collection of high quality data for causal inference. This article introduces Smart Agora, a novel open source software platform for rigorous systematic outdoor experimentation. Without writing a single line of code, highly complex experimental scenarios are visually designed and automatically deployed to smart phones. Novel geolocated survey and sensor data are collected subject of participants verifying desired experimental conditions, for instance, their localization at certain urban spots. This new approach drastically improves the quality and purposefulness of crowd sensing, tailored to conditions that confirm reject hypotheses. The features that support this innovative functionality and the broad spectrum of its applicability are demonstrated.


Augmented Tensor Decomposition with Stochastic Optimization. Tensor decompositions are powerful tools for dimensionality reduction and feature interpretation of multidimensional data such as signals. Existing tensor decomposition objectives (e.g., Frobenius norm) are designed for fitting raw data under statistical assumptions, which may not align with downstream classification tasks. Also, real world tensor data are usually high ordered and have large dimensions with millions or billions of entries. Thus, it is expensive to decompose the whole tensor with traditional algorithms. In practice, raw tensor data also contains redundant information while data augmentation techniques may be used to smooth out noise in samples. This paper addresses the above challenges by proposing augmented tensor decomposition (ATD), which effectively incorporates data augmentations to boost downstream classification. To reduce the memory footprint of the decomposition, we propose a stochastic algorithm that updates the factor matrices in a batch fashion. We evaluate ATD on multiple signal datasets. It shows comparable or better performance (e.g., up to 15 in accuracy) over self supervised and autoencoder baselines with less than 5 of model parameters, achieves 0.6 1.3 accuracy gain over other tensor based baselines, and reduces the memory footprint by 9X when compared to standard tensor decomposition algorithms.


Smart Village An IoT Based Digital Transformation. Almost 46 of the world's population resides in a rural landscape. Smart villages, alongside smart cities, are in need of time for future economic growth, improved agriculture, better health, and education. The smart village is a concept that improves the traditional rural aspects with the help of digital transformation. The smart village is built up using heterogeneous digital technologies pillared around the Internet of Thing (IoT). There exist many opportunities in research to design a low cost, secure, and efficient technical ecosystem. This article identifies the key application areas, where the IoT can be applied in the smart village. The article also presents a comparative study of communication technology options.


Optimizing the ecological connectivity of landscapes with generalized flow models and preprocessing. In this paper we consider the problem of optimizing the ecological connectivity of a landscape under a budget constraint by improving habitat areas and ecological corridors between them. We consider a formulation of this problem in terms of graphs in which vertices represent the habitat areas and arcs represent a probability of connection between two areas that depend on the quality of the respective corridor. We propose a new generalized flow model that improves existing models for this problem and an efficient preprocessing algorithm that reduces the size of the graphs on which generalized flows is computed. Reported numerical experiments highlight the benefice of these two contributions on computation times and show that larger problems can be solved using them. Our experiments also show that several variants of greedy algorithms perform relatively well on practical instances while they return arbitrary bad solutions in the worst case.


Design, fabrication and low power RF measurement of an X band dielectric loaded accelerating structure. Dielectric loaded accelerating (DLA) structures are being studied as an alternative to conventional disk loaded copper structures to produce the high accelerating gradient. This paper presents the design, fabrication and low power RF measurement of an externally powered X band DLA structure with a dielectric constant epsilon r 16.66 and a loss tangent tan delta 0.0000343. A dielectric matching section for coupling the RF power from a circular waveguide to an X band DLA structure consists of a very compact dielectric disk with a width of 2.035 mm and a tilt angle of 60 degree, resulting in a broadband coupling at a low RF field which has the potential to survive in the high power environment. Based on simulation studies, a prototype of the DLA structure was fabricated. Results from bench measurements and their comparison with design values are presented. The detailed analysis on the fabrication error which may cause the discrepancy between the RF measurements and simulations is also discussed.


Graphonomy Universal Image Parsing via Graph Reasoning and Transfer. Prior highly tuned image parsing models are usually studied in a certain domain with a specific set of semantic labels and can hardly be adapted into other scenarios (e.g., sharing discrepant label granularity) without extensive re training. Learning a single universal parsing model by unifying label annotations from different domains or at various levels of granularity is a crucial but rarely addressed topic. This poses many fundamental learning challenges, e.g., discovering underlying semantic structures among different label granularity or mining label correlation across relevant tasks. To address these challenges, we propose a graph reasoning and transfer learning framework, named "Graphonomy", which incorporates human knowledge and label taxonomy into the intermediate graph representation learning beyond local convolutions. In particular, Graphonomy learns the global and structured semantic coherency in multiple domains via semantic aware graph reasoning and transfer, enforcing the mutual benefits of the parsing across domains (e.g., different datasets or co related tasks). The Graphonomy includes two iterated modules Intra Graph Reasoning and Inter Graph Transfer modules. The former extracts the semantic graph in each domain to improve the feature representation learning by propagating information with the graph the latter exploits the dependencies among the graphs from different domains for bidirectional knowledge transfer. We apply Graphonomy to two relevant but different image understanding research topics human parsing and panoptic segmentation, and show Graphonomy can handle both of them well via a standard pipeline against current state of the art approaches. Moreover, some extra benefit of our framework is demonstrated, e.g., generating the human parsing at various levels of granularity by unifying annotations across different datasets.


Capturing Corruption with Hybrid Auctions Social Welfare Loss in Multi Unit Auctions. Corruption in auctions is a phenomenon that is theoretically still poorly understood, despite the fact that it occurs rather frequently in practice. In this paper, we initiate the study of the social welfare loss caused by a corrupt auctioneer, both in the single item and the multi unit auction setting. In our model, the auctioneer may collude with the winners of the auction by letting them lower their bids in exchange for a fixed fraction gamma of the surplus. As it turns out, this setting is equivalent to a gamma hybrid auction in which the payments are a convex combination (parameterized by gamma ) of the first price and the second price payments. Our goal is thus to obtain a precise understanding of the (robust) price of anarchy of gamma hybrid auctions. If no further restrictions are imposed on the bids, we prove a bound on the robust POA which is tight (over the entire range of gamma ) for the single item and the multi unit auction setting. On the other hand, if the bids satisfy the no overbidding assumption a more fine grained landscape of the price of anarchy emerges, depending on the auction setting and the equilibrium notion. We derive tight bounds for single item auctions up to the correlated price of anarchy and for the pure price of anarchy in multi unit auctions. These results are complemented by nearly tight bounds on the coarse correlated price of anarchy in both settings.


Derivation of a one dimensional von K ' a rm ' a n theory for viscoelastic ribbons. We consider a two dimensional model of viscoelastic von K 'arm 'an plates in the Kelvin's Voigt's rheology derived from a three dimensional model at a finite strain setting. As the width of the plate goes to zero, we perform a dimension reduction from 2D to 1D and identify an effective one dimensional model for a viscoelastic ribbon comprising stretching, bending, and twisting both in the elastic and the viscous stress. Our arguments rely on the abstract theory of gradient flows in metric spaces by Sandier and Serfaty and complement the Gamma convergence analysis of elastic von K ' a rm ' a n ribbons in Freddi et al., 2018 . Besides convergence of the gradient flows, we also show convergence of associated time discrete approximations, and we provide a corresponding commutativity result.


A Vorono "i Oppenheim summation formula for number fields. In this note, we establish a Vorono "i Oppenheim summation formula for divisor functions over an arbitrary number field.


On principal component analysis of the convex combination of two data matrices and its application to acoustic metamaterial filters. In this short paper, a matrix perturbation bound on the eigenvalues found by principal component analysis is investigated, for the case in which the data matrix on which principal component analysis is performed is a convex combination of two data matrices. The application of the theoretical analysis to multi objective optimization problems (e.g., those arising in the design of acoustic metamaterial filters) is briefly discussed, together with possible extensions.


The full approximation storage multigrid scheme A 1D finite element example. This note describes the full approximation storage (FAS) multigrid scheme for an easy one dimensional nonlinear boundary value problem. The problem is discretized by a simple finite element (FE) scheme. We apply both FAS V cycles and F cycles, with a nonlinear Gauss Seidel smoother, to solve the resulting finite dimensional problem. The mathematics of the FAS restriction and prolongation operators, in the FE case, are explained. A self contained Python program implements the scheme. Optimal performance, i.e. work proportional to the number of unknowns, is demonstrated for both kinds of cycles, including convergence nearly to discretization error in a single F cycle.


Sharp bounds on p norms for sums of independent uniform random variables, 0 p 1 . We provide a sharp lower bound on the p norm of a sum of independent uniform random variables in terms of its variance when 0 p 1 . We address an analogous question for p R 'enyi entropy for p in the same range.


Improving state of the art in Detecting Student Engagement with Resnet and TCN Hybrid Network. Automatic detection of students' engagement in online learning settings is a key element to improve the quality of learning and to deliver personalized learning materials to them. Varying levels of engagement exhibited by students in an online classroom is an affective behavior that takes place over space and time. Therefore, we formulate detecting levels of students' engagement from videos as a spatio temporal classification problem. In this paper, we present a novel end to end Residual Network (ResNet) and Temporal Convolutional Network (TCN) hybrid neural network architecture for students' engagement level detection in videos. The 2D ResNet extracts spatial features from consecutive video frames, and the TCN analyzes the temporal changes in video frames to detect the level of engagement. The spatial and temporal arms of the hybrid network are jointly trained on raw video frames of a large publicly available students' engagement detection dataset, DAiSEE. We compared our method with several competing students' engagement detection methods on this dataset. The ResNet TCN architecture outperforms all other studied methods, improves the state of the art engagement level detection accuracy, and sets a new baseline for future research.


Saddle Point Optimization with Approximate Minimization Oracle. A major approach to saddle point optimization min x max y f(x, y) is a gradient based approach as is popularized by generative adversarial networks (GANs). In contrast, we analyze an alternative approach relying only on an oracle that solves a minimization problem approximately. Our approach locates approximate solutions x' and y' to min x' f(x', y) and max y' f(x, y') at a given point (x, y) and updates (x, y) toward these approximate solutions (x', y') with a learning rate eta . On locally strong convex concave smooth functions, we derive conditions on eta to exhibit linear convergence to a local saddle point, which reveals a possible shortcoming of recently developed robust adversarial reinforcement learning algorithms. We develop a heuristic approach to adapt eta derivative free and implement zero order and first order minimization algorithms. Numerical experiments are conducted to show the tightness of the theoretical results as well as the usefulness of the eta adaptation mechanism.


Generation of microbial colonies dataset with deep learning style transfer. We introduce an effective strategy to generate an annotated synthetic dataset of microbiological images of Petri dishes that can be used to train deep learning models in a fully supervised fashion. The developed generator employs traditional computer vision algorithms together with a neural style transfer method for data augmentation. We show that the method is able to synthesize a dataset of realistic looking images that can be used to train a neural network model capable of localising, segmenting, and classifying five different microbial species. Our method requires significantly fewer resources to obtain a useful dataset than collecting and labeling a whole large set of real images with annotations. We show that starting with only 100 real images, we can generate data to train a detector that achieves comparable results (detection mAP 0.416, and counting MAE 4.49) to the same detector but trained on a real, several dozen times bigger dataset (mAP 0.520, MAE 4.31), containing over 7k images. We prove the usefulness of the method in microbe detection and segmentation, but we expect that it is general and flexible and can also be applicable in other domains of science and industry to detect various objects.


Aligning Correlation Information for Domain Adaptation in Action Recognition. Domain adaptation (DA) approaches address domain shift and enable networks to be applied to different scenarios. Although various image DA approaches have been proposed in recent years, there is limited research towards video DA. This is partly due to the complexity in adapting the different modalities of features in videos, which includes the correlation features extracted as long term dependencies of pixels across spatiotemporal dimensions. The correlation features are highly associated with action classes and proven their effectiveness in accurate video feature extraction through the supervised action recognition task. Yet correlation features of the same action would differ across domains due to domain shift. Therefore we propose a novel Adversarial Correlation Adaptation Network (ACAN) to align action videos by aligning pixel correlations. ACAN aims to minimize the distribution of correlation information, termed as Pixel Correlation Discrepancy (PCD). Additionally, video DA research is also limited by the lack of cross domain video datasets with larger domain shifts. We, therefore, introduce a novel HMDB ARID dataset with a larger domain shift caused by a larger statistical difference between domains. This dataset is built in an effort to leverage current datasets for dark video classification. Empirical results demonstrate the state of the art performance of our proposed ACAN for both existing and the new video DA datasets.


Analysis of pedestrian stress level using GSR sensor in virtual immersive reality. Level of emotional arousal of one's body changes in response to external stimuli in an environment. Given the risks involved while crossing streets, particularly at unsignalized mid block crosswalks, one can expect a change in the stress level of pedestrians. In this study, we investigate the levels and changes in pedestrian stress, under different road crossing scenarios in immersive virtual reality. To measure the stress level of pedestrians, we used Galvanic Skin Response (GSR) sensors. To collect the required data for the model, Virtual Immersive Reality Environment (VIRE) tool is used, which enables us to measure participants' stress levels in a controlled environment. The results suggested that the density of vehicles has a positive effect, meaning as the density of vehicles increases, so does the stress level for pedestrians. It was noted that younger pedestrians have a lower amount of stress when crossing as compared to older pedestrians which have higher amounts of stress. Geometric variables have an impact on the stress level of pedestrians. The greater the number of lanes the greater the observed stress, which is due to the crossing distance increasing, while the walking speed remains the same.


Durable Queues The Second Amendment. We consider durable data structures for non volatile main memory, such as the new Intel Optane memory architecture. Substantial recent work has concentrated on making concurrent data structures durable with low overhead, by adding a minimal number of blocking persist operations (i.e., flushes and fences). In this work we show that focusing on minimizing the number of persist instructions is important, but not enough. We show that access to flushed content is of high cost due to cache invalidation in current architectures. Given this finding, we present a design of the queue data structure that properly takes care of minimizing blocking persist operations as well as minimizing access to flushed content. The proposed design outperforms state of the art durable queues. We start by providing a durable version of the Michael Scott queue (MSQ). We amend MSQ by adding a minimal number of persist instructions, fewer than in available durable queues, and meeting the theoretical lower bound on the number of blocking persist operations. We then proceed with a second amendment to this design, that eliminates accesses to flushed data. Evaluation shows that the second amendment yields substantial performance improvement, outperforming the state of the art and demonstrating the importance of reduced accesses to flushed content. The presented queues are durably linearizable and lock free. Finally, we discuss the theoretical optimal number of accesses to flushed content.