Evaluating Multiple Guesses by an Adversary via a Tunable Loss Function. We consider a problem of guessing, wherein an adversary is interested in knowing the value of the realization of a discrete random variable X on observing another correlated random variable Y . The adversary can make multiple (say, k ) guesses. The adversary's guessing strategy is assumed to minimize alpha loss, a class of tunable loss functions parameterized by alpha . It has been shown before that this loss function captures well known loss functions including the exponential loss ( alpha 1 2 ), the log loss ( alpha 1 ) and the 0 1 loss ( alpha infty ). We completely characterize the optimal adversarial strategy and the resulting expected alpha loss, thereby recovering known results for alpha infty . We define an information leakage measure from the k guesses setup and derive a condition under which the leakage is unchanged from a single guess.


Sound Probabilistic Inference via Guide Types. Probabilistic programming languages aim to describe and automate Bayesian modeling and inference. Modern languages support programmable inference, which allows users to customize inference algorithms by incorporating guide programs to improve inference performance. For Bayesian inference to be sound, guide programs must be compatible with model programs. One pervasive but challenging condition for model guide compatibility is absolute continuity, which requires that the model and guide programs define probability distributions with the same support. This paper presents a new probabilistic programming language that guarantees absolute continuity, and features general programming constructs, such as branching and recursion. Model and guide programs are implemented as coroutines that communicate with each other to synchronize the set of random variables they sample during their execution. Novel guide types describe and enforce communication protocols between coroutines. If the model and guide are well typed using the same protocol, then they are guaranteed to enjoy absolute continuity. An efficient algorithm infers guide types from code so that users do not have to specify the types. The new programming language is evaluated with an implementation that includes the type inference algorithm and a prototype compiler that targets Pyro. Experiments show that our language is capable of expressing a variety of probabilistic models with nontrivial control flow and recursion, and that the coroutine based computation does not introduce significant overhead in actual Bayesian inference.


Using growth transform dynamical systems for spatio temporal data sonification. Sonification, or encoding information in meaningful audio signatures, has several advantages in augmenting or replacing traditional visualization methods for human in the loop decision making. Standard sonification methods reported in the literature involve either (i) using only a subset of the variables, or (ii) first solving a learning task on the data and then mapping the output to an audio waveform, which is utilized by the end user to make a decision. This paper presents a novel framework for sonifying high dimensional data using a complex growth transform dynamical system model where both the learning (or, more generally, optimization) and the sonification processes are integrated together. Our algorithm takes as input the data and optimization parameters underlying the learning or prediction task and combines it with the psychoacoustic parameters defined by the user. As a result, the proposed framework outputs binaural audio signatures that not only encode some statistical properties of the high dimensional data but also reveal the underlying complexity of the optimization learning process. Along with extensive experiments using synthetic datasets, we demonstrate the framework on sonifying Electro encephalogram (EEG) data with the potential for detecting epileptic seizures in pediatric patients.


A Granular Sieving Algorithm for Deterministic Global Optimization. A gradient free deterministic method is developed to solve global optimization problems for Lipschitz continuous functions defined in arbitrary path wise connected compact sets in Euclidean spaces. The method can be regarded as granular sieving with synchronous analysis in both the domain and range of the objective function. With straightforward mathematical formulation applicable to both univariate and multivariate objective functions, the global minimum value and all the global minimizers are located through two decreasing sequences of compact sets in, respectively, the domain and range spaces. The algorithm is easy to implement with moderate computational cost. The method is tested against extensive benchmark functions in the literature. The experimental results show remarkable effectiveness and applicability of the algorithm.


Adaptive t Momentum based Optimization for Unknown Ratio of Outliers in Amateur Data in Imitation Learning. Behavioral cloning (BC) bears a high potential for safe and direct transfer of human skills to robots. However, demonstrations performed by human operators often contain noise or imperfect behaviors that can affect the efficiency of the imitator if left unchecked. In order to allow the imitators to effectively learn from imperfect demonstrations, we propose to employ the robust t momentum optimization algorithm. This algorithm builds on the Student's t distribution in order to deal with heavy tailed data and reduce the effect of outlying observations. We extend the t momentum algorithm to allow for an adaptive and automatic robustness and show empirically how the algorithm can be used to produce robust BC imitators against datasets with unknown heaviness. Indeed, the imitators trained with the t momentum based Adam optimizers displayed robustness to imperfect demonstrations on two different manipulation tasks with different robots and revealed the capability to take advantage of the additional data while reducing the adverse effect of non optimal behaviors.


p adic Hodge theory for Artin stacks. This work is devoted to the study of integral p adic Hodge theory in the context of Artin stacks. For a Hodge proper stack, using the formalism of prismatic cohomology, we establish a version of p adic Hodge theory with the 'etale cohomology of the Raynaud generic fiber as an input. In particular, we show that the corresponding Galois representation is crystalline and that the associated Breuil Kisin module is given by the prismatic cohomology. An interesting new feature of the stacky setting is that the natural map between 'etale cohomology of the algebraic and the Raynaud generic fibers is often an equivalence even outside of the proper case. In particular, we show that this holds for global quotients X G where X is a smooth proper scheme and G is a reductive group. As applications we deduce Totaro's conjectural inequality and also set up a theory of A mathrm inf characteristic classes.


Relating homomorphism spaces between Specht modules of different degrees. Let K be an infinite field of characteristic p 0 and let lambda, mu be partitions of n , where lambda ( lambda 1,..., lambda n) and mu ( mu 1,.., mu n) . By S lambda we denote the Specht module corresponding to lambda for the group algebra K mathfrak S n of the symmetric group mathfrak S n . D. Hemmer has raised the question of relating the homomorphism spaces Hom mathfrak S n (S mu , S lambda ) and Hom mathfrak S n' (S mu , S lambda ) , where n' n kp d , lambda lambda (kp d ) , mu mu (kp d ) , and d, k are positive integers. We show that these are isomorphic if p is odd, p d min lambda 2, mu 1 lambda 1 and mu 2 le lambda 1 .


A Note on Hardy Spaces on Quadratic CR Manifolds. Given a quadratic CR manifold mathcal M embedded in a complex space, and a holomorphic function f on a tubular neighbourhood of mathcal M , we show that the L p norms of the restriction of f to the translates of mathcal M is decreasing for the ordering induced by the closed convex envelope of the image of the Levi form of mathcal M .


UnSplit Data Oblivious Model Inversion, Model Stealing, and Label Inference Attacks Against Split Learning. Training deep neural networks requires large scale data, which often forces users to work in a distributed or outsourced setting, accompanied with privacy concerns. Split learning framework aims to address this concern by splitting up the model among the client and the server. The idea is that since the server does not have access to client's part of the model, the scheme supposedly provides privacy. We show that this is not true via two novel attacks. (1) We show that an honest but curious split learning server, equipped only with the knowledge of the client neural network architecture, can recover the input samples and also obtain a functionally similar model to the client model, without the client being able to detect the attack. (2) Furthermore, we show that if split learning is used naively to protect the training labels, the honest but curious server can infer the labels with perfect accuracy. We test our attacks using three benchmark datasets and investigate various properties of the overall system that affect the attacks' effectiveness. Our results show that plaintext split learning paradigm can pose serious security risks and provide no more than a false sense of security.


Circularly polarized states and propagating bound states in the continuum in a periodic array of cylinders. Bound states in the continuum (BICs) in a periodic structure sandwiched between two homogeneous media have interesting properties and useful applications in photonics. The topological nature of BICs was previously revealed based on a topological charge related to the far field polarization vector of the surrounding resonant states. Recently, it was established that when a symmetry protected BIC (with a nonzero topological charge) is destroyed by a generic symmetry breaking perturbation, a pair of circularly polarized resonant states (CPSs) emerge and the net topological charge is conserved. A periodic structure can also support propagating BICs with a nonzero wavevector. These BICs are not protected by symmetry in the sense of symmetry mismatch, but they need symmetry for their robust existence. Based on a highly accurate computational method for a periodic array of slightly noncircular cylinders, we show that a propagating BIC is typically destroyed by a structural perturbation that breaks only the in plane inversion symmetry, and when this happens, a pair of CPSs of opposite handedness emerge so that the net topological charge is conserved. We also study the generation and annihilation of CPSs when a structural parameter is varied. It is shown that two CPSs with opposite topological charge and same handedness, connected to two BICs or in a continuous branch from one BIC, may collapse and become a CPS with a zero charge. Our study clarifies the important connection between symmetry and topological charge conservation.


Structure Aware Multi Hop Graph Convolution for Graph Neural Networks. In this paper, we propose a spatial graph convolution (GC) to classify signals on a graph. Existing GC methods are limited to using the structural information in the feature space. Additionally, the single step of GCs only uses features on the one hop neighboring nodes from the target node. In this paper, we propose two methods to improve the performance of GCs 1) Utilizing structural information in the feature space, and 2) exploiting the multi hop information in one GC step. In the first method, we define three structural features in the feature space feature angle, feature distance, and relational embedding. The second method aggregates the node wise features of multi hop neighbors in a GC. Both methods can be simultaneously used. We also propose graph neural networks (GNNs) integrating the proposed GC for classifying nodes in 3D point clouds and citation networks. In experiments, the proposed GNNs exhibited a higher classification accuracy than existing methods.


Character degrees in blocks and defect groups. A recent question of Gabriel Navarro asks whether it is true that the derived length of a defect group is less than or equal to the number of degrees of irreducible characters in a block. In this article, we bring new evidence towards the validity of this statement.


Separating Data via Block Invalidation Time Inference for Write Amplification Reduction in Log Structured Storage. Log structured storage has been widely deployed in various domains of storage systems, yet its garbage collection incurs write amplification (WA) due to the rewrites of live data. We show that there exists an optimal data placement scheme that minimizes WA using the future knowledge of block invalidation time (BIT) of each written block, yet it is infeasible to realize in practice. We propose a novel data placement algorithm for reducing WA, SepBIT, that aims to infer the BITs of written blocks from storage workloads and separately place the blocks into groups with similar estimated BITs. We show via both mathematical and production trace analyses that SepBIT effectively infers the BITs by leveraging the write skewness property in practical storage workloads. Trace analysis and prototype experiments show that SepBIT reduces WA and improves I O throughput, respectively, compared with state of the art data placement schemes. SepBIT is currently deployed to support the log structured block storage management at Alibaba Cloud.


Custom Tailored Clone Detection for IEC 61131 3 Programming Languages. Automated production systems (aPS) are highly customized systems that consist of hardware and software. Such aPS are controlled by a programmable logic controller (PLC), often in accordance with the IEC 61131 3 standard that divides system implementation into so called program organization units (POUs) as the smallest software unit and is comprised of multiple textual and graphical programming languages that can be arbitrarily nested. A common practice during the development of such systems is reusing implementation artifacts by copying, pasting, and then modifying code. This approach is referred to as code cloning. It is used on a fine granular level where a POU is cloned within a system variant. It is also applied on the coarse granular system level, where the entire system is cloned and adapted to create a system variant, for example for another customer. This ad hoc practice for the development of variants is commonly referred to as clone and own. It allows the fast development of variants to meet varying customer requirements or altered regulatory guidelines. However, clone and own is a non sustainable approach and does not scale with an increasing number of variants. It has a detrimental effect on the overall quality of a software system, such as the propagation of bugs to other variants, which harms maintenance. In order to support the effective development and maintenance of such systems, a detailed code clone analysis is required. On the one hand, an analysis of code clones within a variant (i.e., clone detection in the classical sense) supports experts in refactoring respective code into library components. On the other hand, an analysis of commonalities and differences between cloned variants (i.e., variability analysis) supports the maintenance and further reuse and facilitates the migration of variants into a software product line (SPL).


LAFITE Towards Language Free Training for Text to Image Generation. One of the major challenges in training text to image generation models is the need of a large number of high quality image text pairs. While image samples are often easily accessible, the associated text descriptions typically require careful human captioning, which is particularly time and cost consuming. In this paper, we propose the first work to train text to image generation models without any text data. Our method leverages the well aligned multi modal semantic space of the powerful pre trained CLIP model the requirement of text conditioning is seamlessly alleviated via generating text features from image features. Extensive experiments are conducted to illustrate the effectiveness of the proposed method. We obtain state of the art results in the standard text to image generation tasks. Importantly, the proposed language free model outperforms most existing models trained with full image text pairs. Furthermore, our method can be applied in fine tuning pre trained models, which saves both training time and cost in training text to image generation models. Our pre trained model obtains competitive results in zero shot text to image generation on the MS COCO dataset, yet with around only 1 of the model size and training data size relative to the recently proposed large DALL E model.


Sharp L p decay estimates for degenerate and singular oscillatory integral operators Homogeneous polynomial phases. In this paper, we consider the degenerate and singular oscillatory integral operator with a singular kernel which is not a Calder ' o n Zygmund kernel and satisfies suitable size and derivative conditions related to a real parameter mu . For any given homogeneous polynomial phases, except monomial phases, of degreee n , we give the range of p for which the sharp decay rate frac 1 mu n on L 2 spaces can be preserved on L p spaces.


Product systems and their representations an approach using Fock spaces and Fell bundles. In this exposition we highlight product systems as the semigroup analogue of Fell bundles. Motivated by Fock creation operators we extend the definition of Fowler's product systems over unital discrete left cancellative semigroups, via both a concrete and an abstract characterization. We next underline the importance of Fock spaces and Fell bundle methods for obtaining covariant representation results. First, the strongly covariant representations of Sehnem, for product systems over group embeddable semigroups, find their analogue here. Secondly, we give two solutions for the existence of the co universal C algebra with respect to equivariant injective Fock covariant representations in this context. The first one uses an intertwining isometry technique to realize it as the C envelope of the normal cosystem on the Fock tensor algebra. The second uses a Fell bundle quotient technique to realize it as the reduced C algebra of Sehnem's strong covariance relations. This C algebra is boundary for a larger class of equivariant injective representations.


Multi Proxy Anchor Loss and Effectiveness of Deep Metric Learning Performance Metrics. Deep metric learning (DML) learns the mapping, which maps into embedding space in which similar data is near and dissimilar data is far. However, conventional proxy based losses for DML have two problems gradient problems and applying the real world dataset with multiple local centers. Besides, DML performance metrics also have some issues have stability and flexibility. This paper proposes multi proxies anchor (MPA) loss and normalized discounted cumulative gain (nDCG k) metric. This study contributes three following (1) MPA loss is able to learn the real world dataset with multi local centers. (2) MPA loss improves the training capacity of a neural network owing to solving the gradient issues. (3) nDCG k metric encourages complete evaluation for various datasets. Finally, we demonstrate MPA loss's effectiveness, and MPA loss achieves higher accuracy on two datasets for fine grained images.


Cardinality constrained optimization problems in general position and beyond. We study cardinality constrained optimization problems (CCOP) in general position, i. e. those optimization related properties that are fulfilled for a dense and open subset of their defining functions. We show that the well known cardinality constrained linear independence constraint qualification (CC LICQ) is generic in this sense. For M stationary points we define nondegeneracy and show that it is a generic property too. In particular, the sparsity constraint turns out to be active at all minimizers of a generic CCOP. Moreover, we describe the global structure of CCOP in the sense of Morse theory, emphasizing the strength of the generic approach. Here, we prove that multiple cells need to be attached, each of dimension coinciding with the proposed M index of nondegenerate M stationary points. Beyond this generic viewpoint, we study singularities of CCOP. For that, the relation between nondegeneracy and strong stability in the sense of Kojima (1980) is examined. We show that nondegeneracy implies the latter, while the reverse implication is in general not true. To fill the gap, we fully characterize the strong stability of M stationary points under CC LICQ by first and second order information of CCOP defining functions. Finally, we compare nondegeneracy and strong stability of M stationary points with second order sufficient conditions recently introduced in the literature.


Lecture Notes on Stationary Gamma Processes. For each lambda 0 and every square integrable infinitely divisible (ID) distribution there exists at least one stationary stochastic process t mapsto X t with the specified distribution for X 1 and with first order autoregressive (AR(1)) structure in the sense that the autocorrelation of X s and X t is exp( lambda s t ) for all indices s,t . For the special case of the standard Normal distribution, the process X t is unique namely, the first order autoregressive Ornstein Uhlenbeck velocity process. The process X t is also uniquely determined if X 1 is accorded the unit rate Poisson distribution. For the Gamma distribution, however, X t is emph not determined uniquely. In these lecture notes we describe six distinct processes with the same univariate marginal distributions and AR(1) autocorrelation function. We explore a few of their properties and describe methods of simulating their sample paths.


Why are there Seven Sisters?. There are two puzzles surrounding the Pleiades, or Seven Sisters. First, why are the mythological stories surrounding them, typically involving seven young girls being chased by a man associated with the constellation Orion, so similar in vastly separated cultures, such as the Australian Aboriginal cultures and Greek mythology? Second, why do most cultures call them "Seven Sisters" even though most people with good eyesight see only six stars? Here we show that both these puzzles may be explained by a combination of the great antiquity of the stories combined with the proper motion of the stars, and that these stories may predate the departure of most modern humans out of Africa around 100,000 BC.


Outlining and Filling Hierarchical Query Graph Generation for Answering Complex Questions over Knowledge Graph. Query graph building aims to build correct executable SPARQL over the knowledge graph for answering natural language questions. Although recent approaches perform well by NN based query graph ranking, more complex questions bring three new challenges complicated SPARQL syntax, huge search space for ranking, and noisy query graphs with local ambiguity. This paper handles these challenges. Initially, we regard common complicated SPARQL syntax as the sub graphs comprising of vertices and edges and propose a new unified query graph grammar to adapt them. Subsequently, we propose a new two stage approach to build query graphs. In the first stage, the top k related instances (entities, relations, etc.) are collected by simple strategies, as the candidate instances. In the second stage, a graph generation model performs hierarchical generation. It first outlines a graph structure whose vertices and edges are empty slots, and then fills the appropriate instances into the slots, thereby completing the query graph. Our approach decomposes the unbearable search space of entire query graphs into affordable sub spaces of operations, meanwhile, leverages the global structural information to eliminate local ambiguity. The experimental results demonstrate that our approach greatly improves state of the art on the hardest KGQA benchmarks and has an excellent performance on complex questions.


Human AI Interactions Through A Gricean Lens. Grice's Cooperative Principle (1975) describes the implicit maxims that guide conversation between humans. As humans begin to interact with non human dialogue systems more frequently and in a broader scope, an important question emerges what principles govern those interactions? The present study addresses this question by evaluating human AI interactions using Grice's four maxims we demonstrate that humans do, indeed, apply these maxims to interactions with AI, even making explicit references to the AI's performance through a Gricean lens. Twenty three participants interacted with an American English speaking Alexa and rated and discussed their experience with an in lab researcher. Researchers then reviewed each exchange, identifying those that might relate to Grice's maxims Quantity, Quality, Manner, and Relevance. Many instances of explicit user frustration stemmed from violations of Grice's maxims. Quantity violations were noted for too little but not too much information, while Quality violations were rare, indicating trust in Alexa's responses. Manner violations focused on speed and humanness. Relevance violations were the most frequent, and they appear to be the most frustrating. While the maxims help describe many of the issues participants encountered, other issues do not fit neatly into Grice's framework. Participants were particularly averse to Alexa initiating exchanges or making unsolicited suggestions. To address this gap, we propose the addition of human Priority to describe human AI interaction. Humans and AIs are not conversational equals, and human initiative takes priority. We suggest that the application of Grice's Cooperative Principles to human AI interactions is beneficial both from an AI development perspective and as a tool for describing an emerging form of interaction.


Spatial spectral Hyperspectral Image Classification via Multiple Random Anchor Graphs Ensemble Learning. Graph based semi supervised learning methods, which deal well with the situation of limited labeled data, have shown dominant performance in practical applications. However, the high dimensionality of hyperspectral images (HSI) makes it hard to construct the pairwise adjacent graph. Besides, the fine spatial features that help improve the discriminability of the model are often overlooked. To handle the problems, this paper proposes a novel spatial spectral HSI classification method via multiple random anchor graphs ensemble learning (RAGE). Firstly, the local binary pattern is adopted to extract the more descriptive features on each selected band, which preserves local structures and subtle changes of a region. Secondly, the adaptive neighbors assignment is introduced in the construction of anchor graph, to reduce the computational complexity. Finally, an ensemble model is built by utilizing multiple anchor graphs, such that the diversity of HSI is learned. Extensive experiments show that RAGE is competitive against the state of the art approaches.


StyleLess layer Improving robustness for real world driving. Deep Neural Networks (DNNs) are a critical component for self driving vehicles. They achieve impressive performance by reaping information from high amounts of labeled data. Yet, the full complexity of the real world cannot be encapsulated in the training data, no matter how big the dataset, and DNNs can hardly generalize to unseen conditions. Robustness to various image corruptions, caused by changing weather conditions or sensor degradation and aging, is crucial for safety when such vehicles are deployed in the real world. We address this problem through a novel type of layer, dubbed StyleLess, which enables DNNs to learn robust and informative features that can cope with varying external conditions. We propose multiple variations of this layer that can be integrated in most of the architectures and trained jointly with the main task. We validate our contribution on typical autonomous driving tasks (detection, semantic segmentation), showing that in most cases, this approach improves predictive performance on unseen conditions (fog, rain), while preserving performance on seen conditions and objects.


Cops and Robber on Cartesian products and some classes of hypergraphs. The game of Cops and Robber is a pursuit evasion game which is usually played on a connected graph. In the game, a set of cops and a robber move around the vertices of a graph along edges, where the cops aim to capture the robber, while the robber aims to avoid capture. Much research about this game have been done since the early 1980s. The game has a natural generalisation to being played on connected hypergraphs, where the cops and the robber may now move along hyperedges. In this paper, we shall provide a characterisation of all hypergraphs where one cop is sufficient to capture the robber. The cop number of a connected hypergraph is the minimum number of cops required in order to capture the robber. We shall prove some results about the cop number of certain hypergraphs, including hypertrees and Cartesian products of hypergraphs.


Unified gas kinetic wave particle methods VI Disperse dilute gas particle multiphase flow. In this paper, a unified gas kinetic wave particle scheme (UGKWP) for the disperse dilute gas particle multiphase flow is proposed. The gas phase is always in the hydrodynamic regime. However, the particle phase covers different flow regimes from particle trajectory crossing to the hydrodynamic wave interaction with the variation of local particle phase Knudsen number. The UGKWP is an appropriate method for the capturing of the multiscale transport mechanism in the particle phase through its coupled wave particle formulation. In the regime with intensive particle collision, the evolution of solid particle will be followed by the analytic wave with quasi equilibrium distribution while in the rarefied regime the non equilibrium particle phase will be captured through particle tracking and collision, which plays a decisive role in recovering particle trajectory crossing behavior. The gas kinetic scheme (GKS) is employed for the simulation of gas flow. In the highly collision regime for the particles, no particles will be sampled in UGKWP and the wave formulation for solid particle with the hydrodynamic gas phase will reduce the system to the two fluid Eulerian model. On the other hand, in the collisionless regime for the solid particle, the free transport of solid particle will be followed in UGKWP, and coupled system will return to the Eulerian Lagrangian formulation for the gas and particle. The scheme will be tested for in all flow regimes, which include the non equilibrium particle trajectory crossing, the particle concentration under different Knudsen number, and the dispersion of particle flow with the variation of Stokes number. A experiment of shock induced particle bed fluidization is simulated and the results are compared with experimental measurements. These numerical solutions validate suitability of the proposed scheme for the simulation of gas particle multiphase flow.


Training Multi Layer Over Parametrized Neural Network in Subquadratic Time. We consider the problem of training a multi layer over parametrized neural networks to minimize the empirical risk induced by a loss function. In the typical setting of over parametrization, the network width m is much larger than the data dimension d and number of training samples n ( m mathrm poly (n,d) ), which induces a prohibitive large weight matrix W in mathbb R m times m per layer. Naively, one has to pay O(m 2) time to read the weight matrix and evaluate the neural network function in both forward and backward computation. In this work, we show how to reduce the training cost per iteration, specifically, we propose a framework that uses m 2 cost only in the initialization phase and achieves a truly subquadratic cost per iteration in terms of m , i.e., m 2 Omega(1) per iteration. To obtain this result, we make use of various techniques, including a shifted ReLU based sparsifier, a lazy low rank maintenance data structure, fast rectangular matrix multiplication, tensor based sketching techniques and preconditioning.


Stupid, Evil, or Both? Understanding the Smittestopp conflict. Like many governments, the Norwegian government provided a contact tracing application to help in combating the COVID 19 pandemic at its outset. However, the application was widely criticized for enabling an unacceptable intrusion into its subjects' lives, leading to its discontinuation only four months into the pandemic. In this essay, we will take a closer look at what went wrong, attempt to gain a deeper understanding of the passionate nature of the conflict, and how both sides came to view the other as being either stupid, or evil, or both.


Sum rate Maximization in Uplink CRAN with a Massive MIMO Fronthaul. The limited fronthaul capacity is known to be one of the main problems in cloud radio access networks (CRANs), especially in the wireless fronthaul links. In this paper, we consider the uplink of a CRAN system, where massive multiple input multiple output (MIMO) is utilized in the fronthaul link. Considering multi antenna user equipment (UEs) and multi antenna remote radio heads (RRHs), we maximize the system sum rate by jointly optimizing the precoders at the UEs and the quantization noise covariance matrices and transmit powers at the RRHs. To solve the resulting nonconvex problem, an iterative algorithm based on the majorization minimization (MM) method is proposed. Two schemes at the central unit are considered, namely maximum ratio (MR) and zero forcing (ZF) combining. Numerical results show that the sum rate has an asymptotic behaviour with respect to the maximum available power at RRHs and that the MR scheme goes to its asymptote faster than the ZF scheme.


Data Augmentation for Speech Recognition in Maltese A Low Resource Perspective. Developing speech technologies is a challenge for low resource languages for which both annotated and raw speech data is sparse. Maltese is one such language. Recent years have seen an increased interest in the computational processing of Maltese, including speech technologies, but resources for the latter remain sparse. In this paper, we consider data augmentation techniques for improving speech recognition for such languages, focusing on Maltese as a test case. We consider three different types of data augmentation unsupervised training, multilingual training and the use of synthesized speech as training data. The goal is to determine which of these techniques, or combination of them, is the most effective to improve speech recognition for languages where the starting point is a small corpus of approximately 7 hours of transcribed speech. Our results show that combining the three data augmentation techniques studied here lead us to an absolute WER improvement of 15 without the use of a language model.


Some thin film models based on Shikhmurzaev's approach. We derive several lubrication approximation models, using Shikhmurzaev's approach to the contact line problem, obtained in cite GNV . The first two lubrication models describe thin film flow of incompressible fluids on solid substrates, based on different orders of magnitude of the slip length parameter. The third lubrication model describes a meniscus formation where a wedge shaped solid immerses in a thin film of fluid.


Small Strong Blocking Sets by Concatenation. Strong blocking sets and their counterparts, minimal codes, attracted lots of attention in the last years. Combining the concatenating construction of codes with a geometric insight into the minimality condition, we explicitly provide infinite families of small strong blocking sets, whose size is linear in the dimension of the ambient projective spaces. As a byproduct, small saturating sets are obtained.


High Precision Medicine Bottles Vision Online Inspection System and Classification Based on Multi Features and Ensemble Learning via Independence Test. To address the problem of online automatic inspection of drug liquid bottles in production line, an implantable visual inspection system is designed and the ensemble learning algorithm for detection is proposed based on multi features fusion. A tunnel structure is designed for visual inspection system, which allows bottles inspection to be automated without changing original


Global Regularity of 2D Navier Stokes Free Boundary with Small Viscosity Contrast. This paper studies the dynamics of two incompressible immiscible fluids in 2D modeled by the inhomogeneous Navier Stokes equations. We prove that if initially the viscosity contrast is small then there is global in time regularity. This result has been proved recently in 32 for H 5 2 Sobolev regularity of the interface. Here we provide a new approach which allows to obtain preservation of the natural C 1 gamma H "older regularity of the interface for all 0 gamma 1 . Our proof is direct and allows for low Sobolev regularity of the initial velocity without any extra technicality. It uses new quantitative harmonic analysis bounds for C gamma norms of even singular integral operators on characteristic functions of C 1 gamma domains 21 .


A novel Three step Network based Ecosystem Modelling Framework. NEMF is a novel network based ecosystem modelling framework. It is a flexible and easy to use tool for modelling ecosystems with low to intermediate complexity. It is designed around the idea of visualizing an ecosystem through a network that implicitly defines a set of differential equations. These equations are then solved numerically and can also be inverse modelled. The framework offers the functionality to handle non equilibrium, non linear interactions.


Generalized Hilbert series operators. In this note we study the generalized Hilbert series operator H mu , induced by a positive Bore measure mu on 0, 1) , between weighted sequence spaces. We characterize the measures mu for which H mu is bounded between different sequence spaces. Finally, for certain special measures, we obtain the sharp norm estimates of the operators and establish some new generalized Hilbert series inequalities with the best constant factors.


Deep Model Compression based on the Training History. Deep Convolutional Neural Networks (DCNNs) have shown promising results in several visual recognition problems which motivated the researchers to propose popular architectures such as LeNet, AlexNet, VGGNet, ResNet, and many more. These architectures come at a cost of high computational complexity and parameter storage. To get rid of storage and computational complexity, deep model compression methods have been evolved. We propose a novel History Based Filter Pruning (HBFP) method that utilizes network training history for filter pruning. Specifically, we prune the redundant filters by observing similar patterns in the L1 norms of filters (absolute sum of weights) over the training epochs. We iteratively prune the redundant filters of a CNN in three steps. First, we train the model and select the filter pairs with redundant filters in each pair. Next, we optimize the network to increase the similarity between the filters in a pair. It facilitates us to prune one filter from each pair based on its importance without much information loss. Finally, we retrain the network to regain the performance, which is dropped due to filter pruning. We test our approach on popular architectures such as LeNet 5 on MNIST dataset and VGG 16, ResNet 56, and ResNet 110 on CIFAR 10 dataset. The proposed pruning method outperforms the state of the art in terms of FLOPs reduction (floating point operations) by 97.98 , 83.42 , 78.43 , and 74.95 for LeNet 5, VGG 16, ResNet 56, and ResNet 110 models, respectively, while maintaining the less error rate.


Mixer based lidar lane detection network and dataset for urban roads. Accurate lane detection under various road conditions is a critical function for autonomous driving. Generally, when detected lane lines from a front camera image are projected into a birds eye view (BEV) for motion planning, the resulting lane lines are often distorted. And convolutional neural network (CNN) based feature extractors often lose resolution when increasing the receptive field to detect global features such as lane lines. However, Lidar point cloud has little image distortion in the BEV projection. Since lane lines are thin and stretch over entire BEV image while occupying only a small portion, lane lines should be detected as a global feature with high resolution. In this paper, we propose Lane Mixer Network (LMN) that extracts local features from Lidar point cloud, recognizes global features, and detects lane lines using a BEV encoder, a Mixer based global feature extractor, and a detection head, respectively. In addition, we provide a world first large urban lane dataset for Lidar, K Lane, which has maximum 6 lanes under various urban road conditions. We demonstrate that the proposed LMN achieves the state of the art performance, an F1 score of 91.67 , with K Lane. The K Lane, LMN training code, pre trained models, and total dataset development platform are available at github.


Transformers predicting the future. Applying attention in next frame and time series forecasting. Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention mechanisms without any RNN can improve on the results in various sequence processing tasks (e.g. NLP). Multiple studies since then have shown that similar approaches can be applied for images, point clouds, video, audio or time series forecasting. Furthermore, solutions such as the Perceiver or the Informer have been introduced to expand on the applicability of the Transformer. Our main objective is testing and evaluating the effectiveness of applying Transformer like models on time series data, tackling susceptibility to anomalies, context awareness and space complexity by fine tuning the hyperparameters, preprocessing the data, applying dimensionality reduction or convolutional encodings, etc. We are also looking at the problem of next frame prediction and exploring ways to modify existing solutions in order to achieve higher performance and learn generalized knowledge.


Pricing Ordered Items. We study the revenue guarantees and approximability of item pricing. Recent work shows that with n heterogeneous items, item pricing guarantees an O( log n) approximation to the optimal revenue achievable by any (buy many) mechanism, even when buyers have arbitrarily combinatorial valuations. However, finding good item prices is challenging it is known that even under unit demand valuations, it is NP hard to find item prices that approximate the revenue of the optimal item pricing better than O( sqrt n ) . Our work provides a more fine grained analysis of the revenue guarantees and computational complexity in terms of the number of item categories'' which may be significantly fewer than n . We assume the items are partitioned in k categories so that items within a category are totally ordered and a buyer's value for a bundle depends only on the best item contained from every category. We show that item pricing guarantees an O( log k) approximation to the optimal (buy many) revenue and provide a PTAS for computing the optimal item pricing when k is constant. We also provide a matching lower bound showing that the problem is (strongly) NP hard even when k 1 . Our results naturally extend to the case where items are only partially ordered, in which case the revenue guarantees and computational complexity depend on the width of the partial ordering, i.e. the largest set for which no two items are comparable.


Unidirectional guided resonances in anisotropic waveguides. We show that anisotropic planar anti guiding waveguide structures with two radiation channels towards the surrounding cladding materials can support unidirectional guided resonances (UGRs), where radiation is cancelled in one of the radiation channels and redirected into the other. Their formation is subtle as it requires breaking the so called polar anisotropy symmetry of the structures. Then, UGRs appear at specific wavelengths and light propagation directions, are robust, and are characterised by phase singularities in the channel in which radiation is cancelled. The mechanism we describe allows for ready selection of the radiation direction, as well as tuning of the wavelength and the propagation angle at which UGRs occur.


One Million Scenes for Autonomous Driving ONCE Dataset. Current perception models in autonomous driving have become notorious for greatly relying on a mass of annotated data to cover unseen cases and address the long tail problem. On the other hand, learning from unlabeled large scale collected data and incrementally self training powerful recognition models have received increasing attention and may become the solutions of next generation industry level powerful and robust perception models in autonomous driving. However, the research community generally suffered from data inadequacy of those essential real world scene data, which hampers the future exploration of fully semi self supervised methods for 3D perception. In this paper, we introduce the ONCE (One millioN sCenEs) dataset for 3D object detection in the autonomous driving scenario. The ONCE dataset consists of 1 million LiDAR scenes and 7 million corresponding camera images. The data is selected from 144 driving hours, which is 20x longer than the largest 3D autonomous driving dataset available (e.g. nuScenes and Waymo), and it is collected across a range of different areas, periods and weather conditions. To facilitate future research on exploiting unlabeled data for 3D detection, we additionally provide a benchmark in which we reproduce and evaluate a variety of self supervised and semi supervised methods on the ONCE dataset. We conduct extensive analyses on those methods and provide valuable observations on their performance related to the scale of used data. Data, code, and more information are available at https once for auto driving.github.io index.html.


VESPo Verified Evaluation of Secret Polynomials. We consider the problem of efficiently evaluating a secret polynomial at a given public point, when the polynomial is stored on an untrusted server. The server performs the evaluation and returns a certificate, and the client can efficiently check that the evaluation is correct using some pre computed keys. Our protocols support two important features the polynomial itself can be encrypted on the server, and it can be dynamically updated by changing individual coefficients cheaply without redoing the entire setup. As an important application, we show how these new techniques can be used to instantiate a Dynamic Proof of Retrievability (DPoR) for arbitrary outsourced data storage that achieves low server storage size and audit complexity. Our methods rely only on linearly homomorphic encryption and pairings, and preliminary timing results indicate reasonable performance for polynomials with millions of coefficients, and efficient DPoR with for instance 1TB size databases.


Detecting Abusive Albanian. The ever growing usage of social media in the recent years has had a direct impact on the increased presence of hate speech and offensive speech in online platforms. Research on effective detection of such content has mainly focused on English and a few other widespread languages, while the leftover majority fail to have the same work put into them and thus cannot benefit from the steady advancements made in the field. In this paper we present textsc Shaj , an annotated Albanian dataset for hate speech and offensive speech that has been constructed from user generated content on various social media platforms. Its annotation follows the hierarchical schema introduced in OffensEval. The dataset is tested using three different classification models, the best of which achieves an F1 score of 0.77 for the identification of offensive language, 0.64 F1 score for the automatic categorization of offensive types and lastly, 0.52 F1 score for the offensive language target identification.


Automatic Amortized Resource Analysis with the Quantum Physicist's Method. We present a novel method for working with the physicist's method of amortized resource analysis, which we call the quantum physicist's method. These principles allow for more precise analyses of resources that are not monotonically consumed, like stack. This method takes its name from its two major features, worldviews and resource tunneling, which behave analogously to quantum superposition and quantum tunneling. We use the quantum physicist's method to extend the Automatic Amortized Resource Analysis (AARA) type system, enabling the derivation of resource bounds based on tree depth. In doing so, we also introduce remainder contexts, which aid bookkeeping in linear type systems. We then evaluate this new type system's performance by bounding stack use of functions in the Set module of OCaml's standard library. Compared to state of the art implementations of AARA, our new system derives tighter bounds with only moderate overhead.


Short Term Load Forecasting Using Time Pooling Deep Recurrent Neural Network. Integration of renewable energy sources and emerging loads like electric vehicles to smart grids brings more uncertainty to the distribution system management. Demand Side Management (DSM) is one of the approaches to reduce the uncertainty. Some applications like Nonintrusive Load Monitoring (NILM) can support DSM, however they require accurate forecasting on high resolution data. This is challenging when it comes to single loads like one residential household due to its high volatility. In this paper, we review some of the existing Deep Learning based methods and present our solution using Time Pooling Deep Recurrent Neural Network. The proposed method augments data using time pooling strategy and can overcome overfitting problems and model uncertainties of data more efficiently. Simulation and implementation results show that our method outperforms the existing algorithms in terms of RMSE and MAE metrics.


An Interactive Dashboard for Real Time Analytics and Monitoring of COVID 19 Outbreak in India A proof of Concept. Data analysis and visualization are essential for exploring and communicating findings in medical research, especially in epidemiological surveillance. Data on COVID 19 diagnosed cases and mortality, from crowdsourced website COVID 19 India Tracker, Census 2011, and Google Mobility reports have been used to develop a real time analytics and monitoring system for the COVID 19 outbreak in India. We have developed a dashboard application for data visualization and analysis of several indicators to follow the SARS CoV 2 epidemic using data science techniques. A district level tool for basic epidemiological surveillance, in an interactive and user friendly manner which includes time trends, epidemic curves, key epidemiological parameters such as growth rate, doubling time, and effective reproduction number have been estimated. This demonstrates the application of data science methods and epidemiological techniques in public health decision making while addressing the gap of timely and reliable decision aiding tools.


Meta learning for skin cancer detection using Deep Learning Techniques. This study focuses on automatic skin cancer detection using a Meta learning approach for dermoscopic images. The aim of this study is to explore the benefits of the generalization of the knowledge extracted from non medical data in the classification performance of medical data and the impact of the distribution shift problem within limited data by using a simple class and distribution balancer algorithm. In this study, a small sample of a combined dataset from 3 different sources was used to fine tune a ResNet model pre trained on non medical data. The results show an increase in performance on detecting melanoma, malignant (skin cancer), and benign moles with the prior knowledge obtained from images of everyday objects from the ImageNet dataset by 20 points. These findings suggest that features from non medical images can be used towards the classification of skin moles and that the distribution of the data affects the performance of the model.


EdgeFlow Achieving Practical Interactive Segmentation with Edge Guided Flow. High quality training data play a key role in image segmentation tasks. Usually, pixel level annotations are expensive, laborious and time consuming for the large volume of training data. To reduce labelling cost and improve segmentation quality, interactive segmentation methods have been proposed, which provide the result with just a few clicks. However, their performance does not meet the requirements of practical segmentation tasks in terms of speed and accuracy. In this work, we propose EdgeFlow, a novel architecture that fully utilizes interactive information of user clicks with edge guided flow. Our method achieves state of the art performance without any post processing or iterative optimization scheme. Comprehensive experiments on benchmarks also demonstrate the superiority of our method. In addition, with the proposed method, we develop an efficient interactive segmentation tool for practical data annotation tasks. The source code and tool is avaliable at https github.com PaddlePaddle PaddleSeg.


Local Citation Recommendation with Hierarchical Attention Text Encoder and SciBERT based Reranking. The goal of local citation recommendation is to recommend a missing reference from the local citation context and optionally also from the global context. To balance the tradeoff between speed and accuracy of citation recommendation in the context of a large scale paper database, a viable approach is to first prefetch a limited number of relevant documents using efficient ranking methods and then to perform a fine grained reranking using more sophisticated models. In that vein, BM25 has been found to be a tough to beat approach to prefetching, which is why recent work has focused mainly on the reranking step. Even so, we explore prefetching with nearest neighbor search among text embeddings constructed by a hierarchical attention network. When coupled with a SciBERT reranker fine tuned on local citation recommendation tasks, our hierarchical Attention encoder (HAtten) achieves high prefetch recall for a given number of candidates to be reranked. Consequently, our reranker requires fewer prefetch candidates to rerank, yet still achieves state of the art performance on various local citation recommendation datasets such as ACL 200, FullTextPeerRead, RefSeer, and arXiv.


Design of a user friendly control system for planetary rovers with CPS feature. In this paper, we present a user friendly planetary rover's control system for low latency surface telerobotic. Thanks to the proposed system, an operator can comfortably give commands through the control base station to a rover using commercially available off the shelf (COTS) joysticks or by command sequencing with interactive monitoring on the sensed map of the environment. During operations, high situational awareness is made possible thanks to 3D map visualization. The map of the environment is built on the on board computer by processing the rover's camera images with a visual Simultaneous Localization and Mapping (SLAM) algorithm. It is transmitted via Wi Fi and displayed on the control base station screen in near real time. The navigation stack takes as input the visual SLAM data to build a cost map to find the minimum cost path. By interacting with the virtual map, the rover exhibits properties of a Cyber Physical System (CPS) for its self awareness capabilities. The software architecture is based on the Robot Operative System (ROS) middleware. The system design and the preliminary field test results are shown in the paper.


Exact meromorphic solutions of Schwarzian differential equations. This paper studies exact meromorphic solutions of the autonomous Schwarzian differential equations. All transcendental meromorphic solutions of five canonical types (among six) of the autonomous Schwarzian differential equations are constructed explicitly. In particular, the solutions of four types are shown to be elliptic functions. Also, all transcendental meromorphic solutions that are locally injective or possess a Picard exceptional value are characterized for the remaining canonical type.


3D Instance Segmentation of MVS Buildings. We present a novel framework for instance segmentation of 3D buildings from Multi view Stereo (MVS) urban scenes. Unlike existing works focusing on semantic segmentation of an urban scene, the emphasis of this work lies in detecting and segmenting 3D building instances even if they are attached and embedded in a large and imprecise 3D surface model. Multi view RGB images are first enhanced to RGBH images by adding a heightmap and are segmented to obtain all roof instances using a fine tuned 2D instance segmentation neural network. Roof instance masks from different multi view images are then clustered into global masks. Our mask clustering accounts for spatial occlusion and overlapping, which can eliminate segmentation ambiguities among multi view images. Based on these global masks, 3D roof instances are segmented out by mask back projections and extended to the entire building instances through a Markov random field (MRF) optimization. Quantitative evaluations and ablation studies have shown the effectiveness of all major steps of the method. A dataset for the evaluation of instance segmentation of 3D building models is provided as well. To the best of our knowledge, it is the first dataset for 3D urban buildings on the instance segmentation level.


On reachability and null controllability of nonstrict convex processes. This paper studies reachability and null controllability for difference inclusions involving convex processes. Such difference inclusions arise, for instance, in the study of linear discrete time systems whose inputs and or states are constrained to lie within a convex cone. After developing a geometric framework for convex processes relying on invariance properties, we provide necessary and sufficient conditions for both reachability and null controllability in terms of the spectrum of dual processes.


Schmidt rank of quartics over perfect fields. Let k be a perfect field of characteristic neq 2 . We prove that the Schmidt rank (also known as strength) of a quartic polynomial f over k is bounded above in terms of only the Schmidt rank of f over overline k , an algebraic closure of k .


Switching Contexts Transportability Measures for NLP. This paper explores the topic of transportability, as a sub area of generalisability. By proposing the utilisation of metrics based on well established statistics, we are able to estimate the change in performance of NLP models in new contexts. Defining a new measure for transportability may allow for better estimation of NLP system performance in new domains, and is crucial when assessing the performance of NLP systems in new tasks and domains. Through several instances of increasing complexity, we demonstrate how lightweight domain similarity measures can be used as estimators for the transportability in NLP applications. The proposed transportability measures are evaluated in the context of Named Entity Recognition and Natural Language Inference tasks.


A Neumann type problem on an unbounded domain in the Heisenberg group. We discuss the wellposedness of the Neumann problem on a half space for the Kohn Laplacian in the Heisenberg group. We then construct the Neumann function and explicitly represent the solution of the associated inhomogeneous problem.


Constructing equivalence bimodules between noncommutative solenoids a two pronged approach. We revisit and generalize the application of a method introduced by Latr 'emoli ere and Packer for constructing finitely generated projective modules over the noncommutative solenoid C algebras. By realizing them as direct limits of rotation algebras, the method constructs directed systems of equivalence bimodules between rotation algebras that satisfy the necessary compatibility conditions to build Morita equivalence bimodules between the direct limit C algebras. In the irrational case, we use a fixed projection in a matrix algebra over the rotation algebra satisfying a key condition to build an equivalence bimodule at each stage following a construction of Rieffel. From this, our main result shows that two irrational noncommutative solenoids are Morita equivalent if and only if such a projection exists. We also make additional observations about the Heisenberg bimodules construction studied by the aforementioned two authors and connect the two constructions.


Learning to Ground Multi Agent Communication with Autoencoders. Communication requires having a common language, a lingua franca, between agents. This language could emerge via a consensus process, but it may require many generations of trial and error. Alternatively, the lingua franca can be given by the environment, where agents ground their language in representations of the observed world. We demonstrate a simple way to ground language in learned representations, which facilitates decentralized multi agent communication and coordination. We find that a standard representation learning algorithm autoencoding is sufficient for arriving at a grounded common language. When agents broadcast these representations, they learn to understand and respond to each other's utterances and achieve surprisingly strong task performance across a variety of multi agent communication environments.


Path dependent Hamilton Jacobi Bellman equation Uniqueness of Crandall Lions viscosity solutions. We prove existence and uniqueness of Crandall Lions viscosity solutions of Hamilton Jacobi Bellman equations in the space of continuous paths, associated to the optimal control of path dependent SDEs. This seems the first uniqueness result in such a context. More precisely, similarly to the seminal paper of P.L. Lions, the proof of our core result, that is the comparison theorem, is based on the fact that the value function is bigger than any viscosity subsolution and smaller than any viscosity supersolution. Such a result, coupled with the proof that the value function is a viscosity solution (based on the dynamic programming principle, which we prove), implies that the value function is the unique viscosity solution to the Hamilton Jacobi Bellman equation. The proof of the comparison theorem in P.L. Lions' paper, relies on regularity results which are missing in the present infinite dimensional context, as well as on the local compactness of the finite dimensional underlying space. We overcome such non trivial technical difficulties introducing a suitable approximating procedure and a smooth gauge type function, which allows to generate maxima and minima through an appropriate version of the Borwein Preiss generalization of Ekeland's variational principle on the space of continuous paths.


Human irrationality both bad and good for reward inference. Assuming humans are (approximately) rational enables robots to infer reward functions by observing human behavior. But people exhibit a wide array of irrationalities, and our goal with this work is to better understand the effect they can have on reward inference. The challenge with studying this effect is that there are many types of irrationality, with varying degrees of mathematical formalization. We thus operationalize irrationality in the language of MDPs, by altering the Bellman optimality equation, and use this framework to study how these alterations would affect inference. We find that wrongly modeling a systematically irrational human as noisy rational performs a lot worse than correctly capturing these biases so much so that it can be better to skip inference altogether and stick to the prior! More importantly, we show that an irrational human, when correctly modelled, can communicate more information about the reward than a perfectly rational human can. That is, if a robot has the correct model of a human's irrationality, it can make an even stronger inference than it ever could if the human were rational. Irrationality fundamentally helps rather than hinder reward inference, but it needs to be correctly accounted for.


Single frequency integrated laser on erbium doped lithium niobate on insulator. The erbium doped Lithium niobate on insulator (Er LNOI) platform has great promise in the application of telecommunication, microwave photonics, and quantum photonics due to its excellent electro optic, piezo electric, nonlinear nature as well as the gain characteristics in the telecommunication C band. Here, we report a single frequency Er LNOI integrated laser based on dual cavity structure. Facilitated by the Vernier effect and gain competition, the single frequency laser can operate stably at 1531 nm wavelength with a 1484 nm pump laser. The output laser has a power of 0.31 uW, a linewidth of 1.2 MHz, and a side mode suppression ratio (SMSR) of 31 dB. Our work allows the direct integration of this laser source with existing LNOI components and paves the way for a fully integrated LNOI system.


Probing Product Description Generation via Posterior Distillation. In product description generation (PDG), the user cared aspect is critical for the recommendation system, which can not only improve user's experiences but also obtain more clicks. High quality customer reviews can be considered as an ideal source to mine user cared aspects. However, in reality, a large number of new products (known as long tailed commodities) cannot gather sufficient amount of customer reviews, which brings a big challenge in the product description generation task. Existing works tend to generate the product description solely based on item information, i.e., product attributes or title words, which leads to tedious contents and cannot attract customers effectively. To tackle this problem, we propose an adaptive posterior network based on Transformer architecture that can utilize user cared information from customer reviews. Specifically, we first extend the self attentive Transformer encoder to encode product titles and attributes. Then, we apply an adaptive posterior distillation module to utilize useful review information, which integrates user cared aspects to the generation process. Finally, we apply a Transformer based decoding phase with copy mechanism to automatically generate the product description. Besides, we also collect a large scare Chinese product description dataset to support our work and further research in this field. Experimental results show that our model is superior to traditional generative models in both automatic indicators and human evaluation.


Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detection. The datasets most widely used for abusive language detection contain lists of messages, usually tweets, that have been manually judged as abusive or not by one or more annotators, with the annotation performed at message level. In this paper, we investigate what happens when the hateful content of a message is judged also based on the context, given that messages are often ambiguous and need to be interpreted in the context of occurrence. We first re annotate part of a widely used dataset for abusive language detection in English in two conditions, i.e. with and without context. Then, we compare the performance of three classification algorithms obtained on these two types of dataset, arguing that a context aware classification is more challenging but also more similar to a real application scenario.


SVP CF Selection via Proxy for Collaborative Filtering Data. We study the practical consequences of dataset sampling strategies on the performance of recommendation algorithms. Recommender systems are generally trained and evaluated on samples of larger datasets. Samples are often taken in a naive or ad hoc fashion e.g. by sampling a dataset randomly or by selecting users or items with many interactions. As we demonstrate, commonly used data sampling schemes can have significant consequences on algorithm performance masking performance deficiencies in algorithms or altering the relative performance of algorithms, as compared to models trained on the complete dataset. Following this observation, this paper makes the following main contributions (1) characterizing the effect of sampling on algorithm performance, in terms of algorithm and dataset characteristics (e.g. sparsity characteristics, sequential dynamics, etc.) and (2) designing SVP CF, which is a data specific sampling strategy, that aims to preserve the relative performance of models after sampling, and is especially suited to long tail interaction data. Detailed experiments show that SVP CF is more accurate than commonly used sampling schemes in retaining the relative ranking of different recommendation algorithms.


Weakly supervised deep learning based intracranial hemorrhage localization. Intracranial hemorrhage is a life threatening disease, which requires fast medical intervention. Owing to the duration of data annotation, head CT images are usually available only with slice level labeling. This paper presents a weakly supervised method of precise hemorrhage localization in axial slices using only position free labels, which is based on multiple instance learning. An algorithm is introduced that generates hemorrhage likelihood maps and finds the coordinates of bleeding. The Dice coefficient of 58.08 is achieved on data from a publicly available dataset.


Bug or not bug? That is the question. Nowadays, development teams often rely on tools such as Jira or Bugzilla to manage backlogs of issues to be solved to develop or maintain software. Although they relate to many different concerns (e.g., bug fixing, new feature development, architecture refactoring), few means are proposed to identify and classify these different kinds of issues, except for non mandatory labels that can be manually associated to them. This may lead to a lack of issue classification or to issue misclassification that may impact automatic issue management (planning, assignment) or issue derived metrics. Automatic issue classification thus is a relevant topic for assisting backlog management. This paper proposes a binary classification solution for discriminating bug from non bug issues. This solution combines natural language processing (TF IDF) and classification (multi layer perceptron) techniques, selected after comparing commonly used solutions to classify issues. Moreover, hyper parameters of the neural network are optimized using a genetic algorithm. The obtained results, as compared to existing works on a commonly used benchmark, show significant improvements on the F1 measure for all datasets.


Exact Algorithms for No Rainbow Coloring and Phylogenetic Decisiveness. The input to the no rainbow hypergraph coloring problem is a hypergraph H where every hyperedge has r nodes. The question is whether there exists an r coloring of the nodes of H such that all r colors are used and there is no rainbow hyperedge i.e., no hyperedge uses all r colors. The no rainbow hypergraph r coloring problem is known to be NP complete for r geq 3 . The special case of r 4 is the complement of the phylogenetic decisiveness problem. Here we present a deterministic algorithm that solves the no rainbow r coloring problem in O ((r 1) (r 1)n r ) time and a randomized algorithm that solves the problem in O (( frac r 2 ) n) time.


Extending structures for infinitesimal BiHom bialgebras. We introduce the concept of braided infinitesimal BiHom bialgebras and give the unified product constructions for infinitesimal BiHom bialgebras. We find that the extending problem for infinitesimal BiHom bialgebras can be classified by some non abelian cohomology theory.


Breaking the Coupled Cluster Barrier for Machine Learned Potentials of Large Molecules The Case of 15 atom Acetylacetone. Machine learned potential energy surfaces (PESs) for molecules with more than 10 atoms are typically forced to use lower level electronic structure methods such as density functional theory and second order Moller Plesset perturbation theory (MP2). While these are efficient and realistic, they fall short of the accuracy of the gold standard'' coupled cluster method, especially with respect to reaction and isomerization barriers. We report a major step forward in applying a Delta machine learning method to the challenging case of acetylacetone, whose MP2 barrier height for H atom transfer is low by roughly 1.5 kcal mol relative to the benchmark CCSD(T) barrier of 3.2 kcal mol. From a database of 2151 local CCSD(T) energies, and training with as few as 430 energies, we obtain a new PES with a barrier of 3.49 kcal mol in agreement with the LCCSD(T) one of 3.54 kcal mol and close to the benchmark value. Tunneling splittings due to H atom transfer are calculated using this new PES, providing improved estimates over previous ones obtained using an MP2 based PES.


EVOQUER Enhancing Temporal Grounding with Video Pivoted BackQuery Generation. Temporal grounding aims to predict a time interval of a video clip corresponding to a natural language query input. In this work, we present EVOQUER, a temporal grounding framework incorporating an existing text to video grounding model and a video assisted query generation network. Given a query and an untrimmed video, the temporal grounding model predicts the target interval, and the predicted video clip is fed into a video translation task by generating a simplified version of the input query. EVOQUER forms closed loop learning by incorporating loss functions from both temporal grounding and query generation serving as feedback. Our experiments on two widely used datasets, Charades STA and ActivityNet, show that EVOQUER achieves promising improvements by 1.05 and 1.31 at R 0.7. We also discuss how the query generation task could facilitate error analysis by explaining temporal grounding model behavior.


LR to HR Face Hallucination with an Adversarial Progressive Attribute Induced Network. Face super resolution is a challenging and highly ill posed problem since a low resolution (LR) face image may correspond to multiple high resolution (HR) ones during the hallucination process and cause a dramatic identity change for the final super resolved results. Thus, to address this problem, we propose an end to end progressive learning framework incorporating facial attributes and enforcing additional supervision from multi scale discriminators. By incorporating facial attributes into the learning process and progressively resolving the facial image, the mapping between LR and HR images is constrained more, and this significantly helps to reduce the ambiguity and uncertainty in one to many mapping. In addition, we conduct thorough evaluations on the CelebA dataset following the settings of previous works (i.e. super resolving by a factor of 8x from tiny 16x16 face images.), and the results demonstrate that the proposed approach can yield satisfactory face hallucination images outperforming other state of the art approaches.


Measuring Information Leakage in Non stochastic Brute Force Guessing. This paper proposes an operational measure of non stochastic information leakage to formalize privacy against a brute force guessing adversary. The information is measured by non probabilistic uncertainty of uncertain variables, the non stochastic counterparts of random variables. For X that is related to released data Y , the non stochastic brute force leakage is measured by the complexity of exhaustively checking all the possibilities of the private attribute U of X by an adversary. The complexity refers to the number of trials to successfully guess U . Maximizing this leakage over all possible private attributes U gives rise to the maximal (i.e., worst case) non stochastic brute force guessing leakage. This is proved to be fully determined by the minimal non stochastic uncertainty of X given Y , which also determines the worst case attribute U indicating the highest privacy risk if Y is disclosed. The maximal non stochastic brute force guessing leakage is shown to be proportional to the non stochastic identifiability of X given Y and upper bounds the existing maximin information. The latter quantifies the information leakage when an adversary must perfectly guess U in one shot via Y . Experiments are used to demonstrate the tradeoff between the maximal non stochastic brute force guessing leakage and the data utility (measured by the maximum quantization error) and to illustrate the relationship between maximin information and stochastic one shot maximal leakage.


Deep Context and Relation Aware Learning for Aspect based Sentiment Analysis. Existing works for aspect based sentiment analysis (ABSA) have adopted a unified approach, which allows the interactive relations among subtasks. However, we observe that these methods tend to predict polarities based on the literal meaning of aspect and opinion terms and mainly consider relations implicitly among subtasks at the word level. In addition, identifying multiple aspect opinion pairs with their polarities is much more challenging. Therefore, a comprehensive understanding of contextual information w.r.t. the aspect and opinion are further required in ABSA. In this paper, we propose Deep Contextualized Relation Aware Network (DCRAN), which allows interactive relations among subtasks with deep contextual information based on two modules (i.e., Aspect and Opinion Propagation and Explicit Self Supervised Strategies). Especially, we design novel self supervised strategies for ABSA, which have strengths in dealing with multiple aspects. Experimental results show that DCRAN significantly outperforms previous state of the art methods by large margins on three widely used benchmarks.


Procedural Generalization by Planning with Self Supervised World Models. One of the key promises of model based reinforcement learning is the ability to generalize using an internal model of the world to make predictions in novel environments and tasks. However, the generalization ability of model based agents is not well understood because existing work has focused on model free agents when benchmarking generalization. Here, we explicitly measure the generalization ability of model based agents in comparison to their model free counterparts. We focus our analysis on MuZero (Schrittwieser et al., 2020), a powerful model based agent, and evaluate its performance on both procedural and task generalization. We identify three factors of procedural generalization planning, self supervised representation learning, and procedural data diversity and show that by combining these techniques, we achieve state of the art generalization performance and data efficiency on Procgen (Cobbe et al., 2019). However, we find that these factors do not always provide the same benefits for the task generalization benchmarks in Meta World (Yu et al., 2019), indicating that transfer remains a challenge and may require different approaches than procedural generalization. Overall, we suggest that building generalizable agents requires moving beyond the single task, model free paradigm and towards self supervised model based agents that are trained in rich, procedural, multi task environments.


MSCFNet A Lightweight Network With Multi Scale Context Fusion for Real Time Semantic Segmentation. In recent years, how to strike a good trade off between accuracy and inference speed has become the core issue for real time semantic segmentation applications, which plays a vital role in real world scenarios such as autonomous driving systems and drones. In this study, we devise a novel lightweight network using a multi scale context fusion (MSCFNet) scheme, which explores an asymmetric encoder decoder architecture to dispose this problem. More specifically, the encoder adopts some developed efficient asymmetric residual (EAR) modules, which are composed of factorization depth wise convolution and dilation convolution. Meanwhile, instead of complicated computation, simple deconvolution is applied in the decoder to further reduce the amount of parameters while still maintaining high segmentation accuracy. Also, MSCFNet has branches with efficient attention modules from different stages of the network to well capture multi scale contextual information. Then we combine them before the final classification to enhance the expression of the features and improve the segmentation efficiency. Comprehensive experiments on challenging datasets have demonstrated that the proposed MSCFNet, which contains only 1.15M parameters, achieves 71.9 Mean IoU on the Cityscapes testing dataset and can run at over 50 FPS on a single Titan XP GPU configuration.


First Order Problem Solving through Neural MCTS based Reinforcement Learning. The formal semantics of an interpreted first order logic (FOL) statement can be given in Tarskian Semantics or a basically equivalent Game Semantics. The latter maps the statement and the interpretation into a two player semantic game. Many combinatorial problems can be described using interpreted FOL statements and can be mapped into a semantic game. Therefore, learning to play a semantic game perfectly leads to the solution of a specific instance of a combinatorial problem. We adapt the AlphaZero algorithm so that it becomes better at learning to play semantic games that have different characteristics than Go and Chess. We propose a general framework, Persephone, to map the FOL description of a combinatorial problem to a semantic game so that it can be solved through a neural MCTS based reinforcement learning algorithm. Our goal for Persephone is to make it tabula rasa, mapping a problem stated in interpreted FOL to a solution without human intervention.


Turbulent energy cascade through equivalence of Euler and Lagrange motion descriptions and bifurcation rates. This work analyses the homogeneous isotropic turbulence by means of the equivalence between Euler and Lagrange representations of motion, adopting the bifurcation rates associated with Navier Stokes and kinematic equations, and an appropriate hypothesis of fully developed chaos. The equivalence of these motion descriptions allows to show that kinetic and thermal energy cascade arise both from the convective term of Liouville equation. Accordingly, these phenomena, of nondiffusive nature, correspond to a transport in physical space linked to the trajectories divergence. Both the bifurcation rates are properly defined, where the kinematic bifurcation rate is shown to be much greater than Navier Stokes bifurcation rate. This justifies the proposed hypothesis of fully developed chaos where velocity field and particles trajectories fluctuations are statistically uncorrelated. Thereafter, a specific ergodic property is presented, which relates the statistics of fluid displacement to that of velocity and temperature fields. A detailed analysis of separation rate is proposed which studies the statistics of radial velocity component along the material separation vector. Based on previous elements, the closure formulas of von K 'arm 'an Howarth and Corrsin equations are finally achieved. These closures, of nondiffusive kind, represent a propagation phenomenon, and coincide with those just presented by the author in previous works, corroborating the results of these latter.


Decentralized Deep Learning for Multi Access Edge Computing A Survey on Communication Efficiency and Trustworthiness. Wider coverage and a better solution to a latency reduction in 5G necessitate its combination with multi access edge computing (MEC) technology. Decentralized deep learning (DDL) such as federated learning and swarm learning as a promising solution to privacy preserving data processing for millions of smart edge devices, leverages distributed computing of multi layer neural networks within the networking of local clients, whereas, without disclosing the original local training data. Notably, in industries such as finance and healthcare where sensitive data of transactions and personal medical records is cautiously maintained, DDL can facilitate the collaboration among these institutes to improve the performance of trained models while protecting the data privacy of participating clients. In this survey paper, we demonstrate the technical fundamentals of DDL that benefit many walks of society through decentralized learning. Furthermore, we offer a comprehensive overview of the current state of the art in the field by outlining the challenges of DDL and the most relevant solutions from novel perspectives of communication efficiency and trustworthiness.


Poisson double structures. We introduce Poisson double algebroids, and the equivalent concept of double Lie bialgebroid, which arise as second order infinitesimal counterparts of Poisson double groupoids. We develop their underlying Lie theory, showing how these objects are related by differentiation and integration. We use these results to revisit Lie 2 bialgebras by means of Poisson double structures.


Equivariant maps to subshifts whose points have small stabilizers. Let Gamma be a countably infinite group. Given k in mathbb N , we use mathrm Free (k Gamma) to denote the free part of the Bernoulli shift action of Gamma on k Gamma . Seward and Tucker Drob showed that there exists a free subshift mathcal S subseteq mathrm Free (2 Gamma) such that every free Borel action of Gamma on a Polish space admits a Borel Gamma equivariant map to mathcal S . Here we generalize this result as follows. Let mathcal S be a subshift of finite type (for example, mathcal S could be the set of all proper colorings of the Cayley graph of Gamma with some finite number of colors). Suppose that pi colon mathrm Free (k Gamma) to mathcal S is a continuous Gamma equivariant map and let mathrm Stab ( pi) be the set of all group elements that fix every point in the image of pi . Unless pi is constant, mathrm Stab ( pi) is a finite normal subgroup of Gamma . We prove that there exists a subshift mathcal S ' subseteq mathcal S such that the stabilizer of every point in mathcal S ' is mathrm Stab ( pi) and every free Borel action of Gamma on a Polish space admits a Borel Gamma equivariant map to mathcal S ' . As an application, we deduce that if F is a nonempty finite symmetric subset of Gamma of size F d not containing the identity and mathrm Col (F, d 1) subseteq (d 1) Gamma is the set of all proper (d 1) colorings of the Cayley graph of Gamma corresponding to F , then there is a free subshift mathcal S subseteq mathrm Col (F, d 1) such that every free Borel action of Gamma on a Polish space admits a Borel Gamma equivariant map to mathcal S .


An Evaluation of Machine Learning and Deep Learning Models for Drought Prediction using Weather Data. Drought is a serious natural disaster that has a long duration and a wide range of influence. To decrease the drought caused losses, drought prediction is the basis of making the corresponding drought prevention and disaster reduction measures. While this problem has been studied in the literature, it remains unknown whether drought can be precisely predicted or not with machine learning models using weather data. To answer this question, a real world public dataset is leveraged in this study and different drought levels are predicted using the last 90 days of 18 meteorological indicators as the predictors. In a comprehensive approach, 16 machine learning models and 16 deep learning models are evaluated and compared. The results show no single model can achieve the best performance for all evaluation metrics simultaneously, which indicates the drought prediction problem is still challenging. As benchmarks for further studies, the code and results are publicly available in a Github repository.


Underwater inspection and intervention dataset. This paper presents a novel dataset for the development of visual navigation and simultaneous localisation and mapping (SLAM) algorithms as well as for underwater intervention tasks. It differs from existing datasets as it contains ground truth for the vehicle's position captured by an underwater motion tracking system. The dataset contains distortion free and rectified stereo images along with the calibration parameters of the stereo camera setup. Furthermore, the experiments were performed and recorded in a controlled environment, where current and waves could be generated allowing the dataset to cover a wide range of conditions from calm water to waves and currents of significant strength.


On snapshot based model reduction under compatibility conditions for a nonlinear flow problem on networks. This paper is on the construction of structure preserving, online efficient reduced models for the barotropic Euler equations with a friction term on networks. The nonlinear flow problem finds broad application in the context of gas distribution networks. We propose a snapshot based reduction approach that consists of a mixed variational Galerkin approximation combined with quadrature type complexity reduction. Its main feature is that certain compatibility conditions are assured during the training phase, which make our approach structure preserving. The resulting reduced models are locally mass conservative and inherit an energy bound and port Hamiltonian structure. We also derive a well posedness result for them. In the training phase, the compatibility conditions pose challenges, we face constrained data approximation problems as opposed to the unconstrained training problems in the conventional reduction methods. The training of our model order reduction consists of a principal component analysis under a compatibility constraint and, notably, yields reduced models that fulfill an optimality condition for the snapshot data. The training of our quadrature type complexity reduction involves a semi definite program with combinatorial aspects, which we approach by a greedy procedure.


Accelerating Sparse Deep Neural Networks. As neural network model sizes have dramatically increased, so has the interest in various techniques to reduce their parameter counts and accelerate their execution. An active area of research in this field is sparsity encouraging zero values in parameters that can then be discarded from storage or computations. While most research focuses on high levels of sparsity, there are challenges in universally maintaining model accuracy as well as achieving significant speedups over modern matrix math hardware. To make sparsity adoption practical, the NVIDIA Ampere GPU architecture introduces sparsity support in its matrix math units, Tensor Cores. We present the design and behavior of Sparse Tensor Cores, which exploit a 2 4 (50 ) sparsity pattern that leads to twice the math throughput of dense matrix units. We also describe a simple workflow for training networks that both satisfy 2 4 sparsity pattern requirements and maintain accuracy, verifying it on a wide range of common tasks and model architectures. This workflow makes it easy to prepare accurate models for efficient deployment on Sparse Tensor Cores.


On local regularity estimates for fractional powers of parabolic operators with time dependent measurable coefficients. We consider fractional operators of the form mathcal H s ( partial t mathrm div x ( A(x,t) nabla x )) s, (x,t) in mathbb R n times mathbb R, where s in (0,1) and A A(x,t) A i,j (x,t) i,j 1 n is an accretive, bounded, complex, measurable, n times n dimensional matrix valued function. We study the fractional operators mathcal H s and their relation to the initial value problem ( lambda 1 2s mathrm u ')'( lambda) lambda 1 2s mathcal H mathrm u ( lambda), quad lambda in (0, infty), mathrm u (0) u, in mathbb R times mathbb R n times mathbb R . Exploring this type of relation, and making the additional assumption that A A(x,t) A i,j (x,t) i,j 1 n is real, we derive some local properties of solutions to the non local Dirichlet problem mathcal H su ( partial t mathrm div x ( A(x,t) nabla x )) s u 0 mbox for (x,t) in Omega times J , u f mbox for (x,t) in mathbb R n 1 setminus ( Omega times J) . Our contribution is that we allow for non symmetric and time dependent coefficients.


An Intrinsic Harnack inequality for some non homogeneous parabolic equations in non divergence form. In this paper, we establish a scale invariant Harnack inequality for some inhomogeneous parabolic equations in a suitable intrinsic geometry dictated by the nonlinearity. The class of equations that we consider correspond to the parabolic counterpart of the equations studied by Julin in 10 where a generalized Harnack inequality was obtained which quantifies the strong maximum principle. Our version of parabolic Harnack (see Theorem 1.2) when restricted to the elliptic case is however quite different from that in 10 . The key new feature of this work is an appropriate modification of the stack of cubes covering argument which is tailored for the nonlinearity that we consider.


Synthetic fibered ( infty,1) category theory. We study cocartesian fibrations in the setting of the synthetic ( infty,1) category theory developed in the simplicial type theory introduced by Riehl and Shulman. Our development culminates in a Yoneda Lemma for cocartesian fibrations.


Maintenance scheduling of manufacturing systems based on optimal price of the network. Goods can exhibit positive externalities impacting decisions of customers in socials networks. Suppliers can integrate these externalities in their pricing strategies to increase their revenue. Besides optimizing the prize, suppliers also have to consider their production and maintenance costs. Predictive maintenance has the potential to reduce the maintenance costs and improve the system availability. To address the joint optimization of pricing with network externalities and predictive maintenance scheduling based on the condition of the system, we propose a bi level optimization solution based on game theory. In the first level, the manufacturing company decides about the predictive maintenance scheduling of the units and the price of the goods. In the second level, the customers decide about their consumption using an optimization approach in which the objective function depends on their consumption, the consumption levels of other customers who are connected through the graph, and the price of the network which is determined by the supplier. To solve the problem, we propose the leader multiple followers game where the supplier as a leader predicts the strategies of the followers. Then, customers as the followers obtain their strategies based on the leader's and other followers' strategies. We demonstrate the effectiveness of our proposed method on a simulated case study. The results demonstrate that knowledge of the social network graph results in an increased revenue compared to the case when the underlying social network graph is not known. Moreover, the results demonstrate that obtaining the predictive maintenance scheduling based on the proposed optimization approach leads to an increased profit compared to the baseline decision making (perform maintenance at the degradation limit).


Mesh Graphormer. We present a graph convolution reinforced transformer, named Mesh Graphormer, for 3D human pose and mesh reconstruction from a single image. Recently both transformers and graph convolutional neural networks (GCNNs) have shown promising progress in human mesh reconstruction. Transformer based approaches are effective in modeling non local interactions among 3D mesh vertices and body joints, whereas GCNNs are good at exploiting neighborhood vertex interactions based on a pre specified mesh topology. In this paper, we study how to combine graph convolutions and self attentions in a transformer to model both local and global interactions. Experimental results show that our proposed method, Mesh Graphormer, significantly outperforms the previous state of the art methods on multiple benchmarks, including Human3.6M, 3DPW, and FreiHAND datasets. Code and pre trained models are available at https github.com microsoft MeshGraphormer


Rack Aware Cooperative Regenerating Codes. In distributed storage systems, cooperative regenerating codes tradeoff storage for repair bandwidth in the case of multiple node failures. In rack aware distributed storage systems, there is no cost associated with transferring symbols within a rack. Hence, the repair bandwidth will only take into account cross rack transfer. Rack aware regenerating codes for the case of single node failures have been studied and their repair bandwidth tradeoff characterized. In this paper, we consider the framework of rack aware cooperative regenerating codes for the case of multiple node failures where the node failures are uniformly distributed among a certain number of racks. We characterize the storage repair bandwidth tradeoff as well as derive the minimum storage and minimum repair bandwidth points of the tradeoff. We also provide constructions of minimum bandwidth rack aware cooperative regenerating codes for all parameters.


Understanding Human Reading Comprehension with Brain Signals. Reading comprehension is a complex cognitive process involving many human brain activities. Plenty of works have studied the reading patterns and attention allocation mechanisms in the reading process. However, little is known about what happens in human brain during reading comprehension and how we can utilize this information as implicit feedback to facilitate information acquisition performance. With the advances in brain imaging techniques such as EEG, it is possible to collect high precision brain signals in almost real time. With neuroimaging techniques, we carefully design a lab based user study to investigate brain activities during reading comprehension. Our findings show that neural responses vary with different types of contents, i.e., contents that can satisfy users' information needs and contents that cannot. We suggest that various cognitive activities, e.g., cognitive loading, semantic thematic understanding, and inferential processing, at the micro time scale during reading comprehension underpin these neural responses. Inspired by these detectable differences in cognitive activities, we construct supervised learning models based on EEG features for two reading comprehension tasks answer sentence classification and answer extraction. Results show that it is feasible to improve their performance with brain signals. These findings imply that brain signals are valuable feedback for enhancing human computer interactions during reading comprehension.