Central limit theorems for associated possibly moving partial sums and application to the non stationary invariance principle. General Central limit theorem deals with weak limits (in type) of sums of row elements of array random variables. In some situations as in the invariance principle problem, the sums may include only parts of the row elements. For strictly stationary arrays (stationary for each row), there is no change to the asymptotic results. But for non stationary data, especially for dependent data, asymptotic laws of partial sums moving in rows may require extra conditions to exist. This paper deals with central limit theorems with Gaussian limits for non stationary data. Our main focus is on dependent data, particularly on associated data. But the non stationary independent data is also studied as a learning process. The results are applied to finite distributional invariance principles for the types of data described above. In Moreover, results for associated sequences are interesting and innovative. Beyond their own interest, the results are expected to be applied for random sums of random variables and next in statistical modeling in many disciplines, in Actuarial sciences for example


Safe Real Time Optimization using Multi Fidelity Gaussian Processes. This paper proposes a new class of real time optimization schemes to overcome system model mismatch of uncertain processes. This work's novelty lies in integrating derivative free optimization schemes and multi fidelity Gaussian processes within a Bayesian optimization framework. The proposed scheme uses two Gaussian processes for the stochastic system, one emulates the (known) process model, and another, the true system through measurements. In this way, low fidelity samples can be obtained via a model, while high fidelity samples are obtained through measurements of the system. This framework captures the system's behavior in a non parametric fashion while driving exploration through acquisition functions. The benefit of using a Gaussian process to represent the system is the ability to perform uncertainty quantification in real time and allow for chance constraints to be satisfied with high confidence. This results in a practical approach that is illustrated in numerical case studies, including a semi batch photobioreactor optimization problem.


Closed Loop Nash Competition for Liquidity. We study a multi player stochastic differential game, where agents interact through their joint price impact on an asset that they trade to exploit a common trading signal. In this context, we prove that a closed loop Nash equilibrium exists if the price impact parameter is small enough. Compared to the corresponding open loop Nash equilibrium, both the agents' optimal trading rates and their performance move towards the central planner solution, in that excessive trading due to lack of coordination is reduced. However, the size of this effect is modest for plausible parameter values.


Text similarity analysis for evaluation of descriptive answers. Keeping in mind the necessity of intelligent system in educational sector, this paper proposes a text analysis based automated approach for automatic evaluation of the descriptive answers in an examination. In particular, the research focuses on the use of intelligent concepts of Natural Language Processing and Data Mining for computer aided examination evaluation system. The paper present an architecture for fair evaluation of answer sheet. In this architecture, the examiner creates a sample answer sheet for given sets of question. By using the concept of text summarization, text semantics and keywords summarization, the final score for each answer is calculated. The text similarity model is based on Siamese Manhattan LSTM (MaLSTM). The results of this research were compared to manually graded assignments and other existing system. This approach was found to be very efficient in order to be implemented in an institution or in an university.


Drop, Swap, and Generate A Self Supervised Approach for Generating Neural Activity. Meaningful and simplified representations of neural activity can yield insights into how and what information is being processed within a neural circuit. However, without labels, finding representations that reveal the link between the brain and behavior can be challenging. Here, we introduce a novel unsupervised approach for learning disentangled representations of neural activity called Swap VAE. Our approach combines a generative modeling framework with an instance specific alignment loss that tries to maximize the representational similarity between transformed views of the input (brain state). These transformed (or augmented) views are created by dropping out neurons and jittering samples in time, which intuitively should lead the network to a representation that maintains both temporal consistency and invariance to the specific neurons used to represent the neural state. Through evaluations on both synthetic data and neural recordings from hundreds of neurons in different primate brains, we show that it is possible to build representations that disentangle neural datasets along relevant latent dimensions linked to behavior.


Towards Clinical Encounter Summarization Learning to Compose Discharge Summaries from Prior Notes. The records of a clinical encounter can be extensive and complex, thus placing a premium on tools that can extract and summarize relevant information. This paper introduces the task of generating discharge summaries for a clinical encounter. Summaries in this setting need to be faithful, traceable, and scale to multiple long documents, motivating the use of extract then abstract summarization cascades. We introduce two new measures, faithfulness and hallucination rate for evaluation in this task, which complement existing measures for fluency and informativeness. Results across seven medical sections and five models show that a summarization architecture that supports traceability yields promising results, and that a sentence rewriting approach performs consistently on the measure used for faithfulness (faithfulness adjusted F 3 ) over a diverse range of generated sections.


Explainability and the Fourth AI Revolution. This chapter discusses AI from the prism of an automated process for the organization of data, and exemplifies the role that explainability has to play in moving from the current generation of AI systems to the next one, where the role of humans is lifted from that of data annotators working for the AI systems to that of collaborators working with the AI systems.


On sum of Hecke eigenvalue squares over primes in very short intervals. Let eta 0 be a fixed positive number, let N be a sufficiently large number. In this paper, we study the second moment of the sum of Hecke eigenvalues over primes in short intervals (whose length is eta log N ) on average (with some weights) over the family of weight k holomorphic Hecke cusp forms. We also generalize the above result to Hecke Maass cusp forms for SL(2, mathbb Z ) and SL(3, mathbb Z ). By applying the Hardy Littlewood prime 2 tuples conjecture, we calculate the exact values of the mean values.


Fractional integration of summable functions Maz'ya's Phi inequalities. We study the inequalities of the type int mathbb R d Phi(K f) lesssim f L 1( mathbb R d) p , where the kernel K is homogeneous of order alpha d and possibly vector valued, the function Phi is positively p homogeneous, and p d (d alpha) . Under mild regularity assumptions on K and Phi , we find necessary and sufficient conditions on these functions under which the inequality holds true with a uniform constant for all sufficiently regular functions f .


Graph Condensation for Graph Neural Networks. Given the prevalence of large scale graphs in real world applications, the storage and time for training neural models have raised increasing concerns. To alleviate the concerns, we propose and study the problem of graph condensation for graph neural networks (GNNs). Specifically, we aim to condense the large, original graph into a small, synthetic and highly informative graph, such that GNNs trained on the small graph and large graph have comparable performance. We approach the condensation problem by imitating the GNN training trajectory on the original graph through the optimization of a gradient matching loss and design a strategy to condense node futures and structural information simultaneously. Extensive experiments have demonstrated the effectiveness of the proposed framework in condensing different graph datasets into informative smaller graphs. In particular, we are able to approximate the original test accuracy by 95.3 on Reddit, 99.8 on Flickr and 99.0 on Citeseer, while reducing their graph size by more than 99.9 , and the condensed graphs can be used to train various GNN architectures.Code is released at https github.com ChandlerBang GCond.


Visual Relationship Detection Using Part and Sum Transformers with Composite Queries. Computer vision applications such as visual relationship detection and human object interaction can be formulated as a composite (structured) set detection problem in which both the parts (subject, object, and predicate) and the sum (triplet as a whole) are to be detected in a hierarchical fashion. In this paper, we present a new approach, denoted Part and Sum detection Transformer (PST), to perform end to end visual composite set detection. Different from existing Transformers in which queries are at a single level, we simultaneously model the joint part and sum hypotheses interactions with composite queries and attention modules. We explicitly incorporate sum queries to enable better modeling of the part and sum relations that are absent in the standard Transformers. Our approach also uses novel tensor based part queries and vector based sum queries, and models their joint interaction. We report experiments on two vision tasks, visual relationship detection and human object interaction and demonstrate that PST achieves state of the art results among single stage models, while nearly matching the results of custom designed two stage models.


Aleatoric Description Logic for Probailistic Reasoning (Long Version). Description logics are a powerful tool for describing ontological knowledge bases. That is, they give a factual account of the world in terms of individuals, concepts and relations. In the presence of uncertainty, such factual accounts are not feasible, and a subjective or epistemic approach is required. Aleatoric description logic models uncertainty in the world as aleatoric events, by the roll of the dice, where an agent has subjective beliefs about the bias of these dice. This provides a subjective Bayesian description logic, where propositions and relations are assigned probabilities according to what a rational agent would bet, given a configuration of possible individuals and dice. Aleatoric description logic is shown to generalise the description logic ALC, and can be seen to describe a probability space of interpretations of a restriction of ALC where all roles are functions. Several computational problems are considered and model checking and consistency checking algorithms are presented. Finally, aleatoric description logic is shown to be able to model learning, where agents are able to condition their beliefs on the bias of dice according to observations.


An Automated Portfolio Trading System with Feature Preprocessing and Recurrent Reinforcement Learning. We propose a novel portfolio trading system, which contains a feature preprocessing module and a trading module. The feature preprocessing module consists of various data processing operations, while in the trading part, we integrate the portfolio weight rebalance function with the trading algorithm and make the trading system fully automated and suitable for individual investors, holding a handful of stocks. The data preprocessing procedures are applied to remove the white noise in the raw data set and uncover the general pattern underlying the data set before the processed feature set is inputted into the trading algorithm. Our empirical results reveal that the proposed portfolio trading system can efficiently earn high profit and maintain a relatively low drawdown, which clearly outperforms other portfolio trading strategies.


Cascaded Diffusion Models for High Fidelity Image Generation. We show that cascaded diffusion models are capable of generating high fidelity images on the class conditional ImageNet generation benchmark, without any assistance from auxiliary image classifiers to boost sample quality. A cascaded diffusion model comprises a pipeline of multiple diffusion models that generate images of increasing resolution, beginning with a standard diffusion model at the lowest resolution, followed by one or more super resolution diffusion models that successively upsample the image and add higher resolution details. We find that the sample quality of a cascading pipeline relies crucially on conditioning augmentation, our proposed method of data augmentation of the lower resolution conditioning inputs to the super resolution models. Our experiments show that conditioning augmentation prevents compounding error during sampling in a cascaded model, helping us to train cascading pipelines achieving FID scores of 1.48 at 64x64, 3.52 at 128x128 and 4.88 at 256x256 resolutions, outperforming BigGAN deep, and classification accuracy scores of 63.02 (top 1) and 84.06 (top 5) at 256x256, outperforming VQ VAE 2.


Uncertainty Aware Multiple Instance Learning from Large Scale Long Time Series Data. We propose a novel framework to classify large scale time series data with long duration. Long time seriesclassification (L TSC) is a challenging problem because the dataoften contains a large amount of irrelevant information to theclassification target. The irrelevant period degrades the classifica tion performance while the relevance is unknown to the system.This paper proposes an uncertainty aware multiple instancelearning (MIL) framework to identify the most relevant periodautomatically. The predictive uncertainty enables designing anattention mechanism that forces the MIL model to learn from thepossibly discriminant period. Moreover, the predicted uncertaintyyields a principled estimator to identify whether a prediction istrustworthy or not. We further incorporate another modality toaccommodate unreliable predictions by training a separate modelbased on its availability and conduct uncertainty aware fusion toproduce the final prediction. Systematic evaluation is conductedon the Automatic Identification System (AIS) data, which is col lected to identify and track real world vessels. Empirical resultsdemonstrate that the proposed method can effectively detect thetypes of vessels based on the trajectory and the uncertainty awarefusion with other available data modality (Synthetic ApertureRadar or SAR imagery is used in our experiments) can furtherimprove the detection accuracy.


Morphosyntactic Tagging with Pre trained Language Models for Arabic and its Dialects. We present state of the art results on morphosyntactic tagging across different varieties of Arabic using fine tuned pre trained transformer language models. Our models consistently outperform existing systems in Modern Standard Arabic and all the Arabic dialects we study, achieving 2.6 absolute improvement over the previous state of the art in Modern Standard Arabic, 2.8 in Gulf, 1.6 in Egyptian, and 8.3 in Levantine. We explore different training setups for fine tuning pre trained transformer language models, including training data size, the use of external linguistic resources, and the use of annotated data from other dialects in a low resource scenario. Our results show that strategic fine tuning using datasets from other high resource dialects is beneficial for a low resource dialect. Additionally, we show that high quality morphological analyzers as external linguistic resources are beneficial especially in low resource settings.


Tactile RL for Insertion Generalization to Objects of Unknown Geometry. Object insertion is a classic contact rich manipulation task. The task remains challenging, especially when considering general objects of unknown geometry, which significantly limits the ability to understand the contact configuration between the object and the environment. We study the problem of aligning the object and environment with a tactile based feedback insertion policy. The insertion process is modeled as an episodic policy that iterates between insertion attempts followed by pose corrections. We explore different mechanisms to learn such a policy based on Reinforcement Learning. The key contribution of this paper is to demonstrate that it is possible to learn a tactile insertion policy that generalizes across different object geometries, and an ablation study of the key design choices for the learning agent 1) the type of learning scheme supervised vs. reinforcement learning 2) the type of learning schedule unguided vs. curriculum learning 3) the type of sensing modality force torque (F T) vs. tactile and 4) the type of tactile representation tactile RGB vs. tactile flow. We show that the optimal configuration of the learning agent (RL curriculum tactile flow) exposed to 4 training objects yields an insertion policy that inserts 4 novel objects with over 85.0 success rate and within 3 4 attempts. Comparisons between F T and tactile sensing, shows that while an F T based policy learns more efficiently, a tactile based policy provides better generalization.


Generic properties of free boundary problems in plasma physics. We are concerned with the global bifurcation analysis of positive solutions to free boundary problems arising in plasma physics. We show that in general, in the sense of domain variations, the following alternative holds either the shape of the branch of solutions resembles the monotone one of the model case of the two dimensional disk, or it is a continuous simple curve without bifurcation points which ends up at a point where the boundary density vanishes. On the other hand, we deduce a general criterion ensuring the existence of a free boundary in the interior of the domain. Application to a classic nonlinear eigenvalue problem is also discussed.


Domain State Tracking for a Simplified Dialogue System. Task oriented dialogue systems aim to help users achieve their goals in specific domains. Recent neural dialogue systems use the entire dialogue history for abundant contextual information accumulated over multiple conversational turns. However, the dialogue history becomes increasingly longer as the number of turns increases, thereby increasing memory usage and computational costs. In this paper, we present DoTS (Domain State Tracking for a Simplified Dialogue System), a task oriented dialogue system that uses a simplified input context instead of the entire dialogue history. However, neglecting the dialogue history can result in a loss of contextual information from previous conversational turns. To address this issue, DoTS tracks the domain state in addition to the belief state and uses it for the input context. Using this simplified input, DoTS improves the inform rate and success rate by 1.09 points and 1.24 points, respectively, compared to the previous state of the art model on MultiWOZ, which is a well known benchmark.


Optimal solutions and ranks in the max cut SDP. The max cut problem is a classical graph theory problem which is NP complete. The best polynomial time approximation scheme relies on emph semidefinite programming (SDP). We study the conditions under which graphs of certain classes have rank 1 solutions to the max cut SDP. We apply these findings to look at how solutions to the max cut SDP behave under simple combinatorial constructions. Our results determine when solutions to the max cut SDP for cycle graphs are rank 1. We find the solutions to the max cut SDP of the vertex sum of two graphs. We then characterize the SDP solutions upon joining two triangle graphs by an edge sum.


Stressed hyperplanes and Kazhdan Lusztig gamma positivity for matroids. In this article we make several contributions of independent interest. First, we introduce the notion of stressed hyperplane of a matroid, essentially a type of cyclic flat that permits to transition from a given matroid into another with more bases. Second, we prove that the framework provided by the stressed hyperplanes allows to write very concise closed formulas for the Kazhdan Lusztig, inverse Kazhdan Lusztig and Z polynomials of all paving matroids, a class which is conjectured to predominate among matroids. Third, noticing the palindromicity of the Z polynomial, we address its gamma positivity, a fact that is a midpoint between unimodality and real rootedness to this end, we introduce the gamma polynomial associated to it, we study some of its basic properties, and we find closed expressions for it in the case of paving matroids also, we prove that it has positive coefficients in many interesting cases, particularly the also large family of sparse paving matroids, and other smaller classes such as projective geometries, thagomizer matroids and other particular graphs. Our last contribution consists of providing explicit combinatorial interpretations for the coefficients of many of the polynomials addressed in this article by enumerating fillings in certain Young tableaux and skew Young tableaux.


Real time Autonomous Robot for Object Tracking using Vision System. Researchers and robotic development groups have recently started paying special attention to autonomous mobile robot navigation in indoor environments using vision sensors. The required data is provided for robot navigation and object detection using a camera as a sensor. The aim of the project is to construct a mobile robot that has integrated vision system capability used by a webcam to locate, track and follow a moving object. To achieve this task, multiple image processing algorithms are implemented and processed in real time. A mini laptop was used for collecting the necessary data to be sent to a PIC microcontroller that turns the processes of data obtained to provide the robot's proper orientation. A vision system can be utilized in object recognition for robot control applications. The results demonstrate that the proposed mobile robot can be successfully operated through a webcam that detects the object and distinguishes a tennis ball based on its color and shape.


LOME Large Ontology Multilingual Extraction. We present LOME, a system for performing multilingual information extraction. Given a text document as input, our core system identifies spans of textual entity and event mentions with a FrameNet (Baker et al., 1998) parser. It subsequently performs coreference resolution, fine grained entity typing, and temporal relation prediction between events. By doing so, the system constructs an event and entity focused knowledge graph. We can further apply third party modules for other types of annotation, like relation extraction. Our (multilingual) first party modules either outperform or are competitive with the (monolingual) state of the art. We achieve this through the use of multilingual encoders like XLM R (Conneau et al., 2020) and leveraging multilingual training data. LOME is available as a Docker container on Docker Hub. In addition, a lightweight version of the system is accessible as a web demo.


Constrained Feedforward Neural Network Training via Reachability Analysis. Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural network to obey safety constraints. Most existing safety related methods only seek to verify that already trained networks obey constraints, requiring alternating training and verification. Instead, this work proposes a constrained method to simultaneously train and verify a feedforward neural network with rectified linear unit (ReLU) nonlinearities. Constraints are enforced by computing the network's output space reachable set and ensuring that it does not intersect with unsafe sets training is achieved by formulating a novel collision check loss function between the reachable set and unsafe portions of the output space. The reachable and unsafe sets are represented by constrained zonotopes, a convex polytope representation that enables differentiable collision checking. The proposed method is demonstrated successfully on a network with one nonlinearity layer and approximately 50 parameters.


A quasi conservative DG ALE method for multi component flows using the non oscillatory kinetic flux. A high order quasi conservative discontinuous Galerkin (DG) method is proposed for the numerical simulation of compressible multi component flows. A distinct feature of the method is a predictor corrector strategy to define the grid velocity. A Lagrangian mesh is first computed based on the flow velocity and then used as an initial mesh in a moving mesh method (the moving mesh partial differential equation or MMPDE method ) to improve its quality. The fluid dynamic equations are discretized in the direct arbitrary Lagrangian Eulerian framework using DG elements and the non oscillatory kinetic flux while the species equation is discretized using a quasi conservative DG scheme to avoid numerical oscillations near material interfaces. A selection of one and two dimensional examples are presented to verify the convergence order and the constant pressure velocity preservation property of the method. They also demonstrate that the incorporation of the Lagrangian meshing with the MMPDE moving mesh method works well to concentrate mesh points in regions of shocks and material interfaces.


Skeletons and Minimum Energy Scheduling. Consider the problem where n jobs, each with a release time, a deadline and a required processing time are to be feasibly scheduled in a single or multi processor setting so as to minimize the total energy consumption of the schedule. A processor has two available states a emph sleep state where no energy is consumed but also no processing can take place, and an emph active state which consumes energy at a rate of one, and in which jobs can be processed. Transitioning from the active to the sleep does not incur any further energy cost, but transitioning from the sleep to the active state requires q energy units. Jobs may be preempted and (in the multi processor case) migrated. The single processor case of the problem is known to be solvable in polynomial time via an involved dynamic program, whereas the only known approximation algorithm for the multi processor case attains an approximation factor of 3 and is based on rounding the solution to a linear programming relaxation of the problem. In this work, we present efficient and combinatorial approximation algorithms for both the single and the multi processor setting. Before, only an algorithm based on linear programming was known for the multi processor case. Our algorithms build upon the concept of a emph skeleton , a basic (and not necessarily feasible) schedule that captures the fact that some processor(s) must be active at some time point during an interval. Finally, we further demonstrate the power of skeletons by providing an 2 approximation algorithm for the multiprocessor case, thus improving upon the recent breakthrough 3 approximation result. Our algorithm is based on a novel rounding scheme of a linear programming relaxation of the problem which incorporates skeletons.


On Data Driven Prescriptive Analytics with Side Information A Regularized Nadaraya Watson Approach. We consider generic stochastic optimization problems in the presence of side information which enables a more insightful decision. The side information constitutes observable exogenous covariates that alter the conditional probability distribution of the random problem parameters. A decision maker who adapts her decisions according to the observed side information solves an optimization problem where the objective function is specified by the conditional expectation of the random cost. If the joint probability distribution is unknown, then the conditional expectation can be approximated in a data driven manner using the Nadaraya Watson (NW) kernel regression. While the emerging approximation scheme has found successful applications in diverse decision problems under uncertainty, it is largely unknown whether the scheme can provide any reasonable out of sample performance guarantees. In this paper, we establish guarantees for the generic problems by leveraging techniques from moderate deviations theory. Our analysis motivates the use of a variance based regularization scheme which, in general, leads to a non convex optimization problem. We adopt ideas from distributionally robust optimization to obtain tractable formulations. We present numerical experiments for newsvendor and wind energy commitment problems to highlight the effectiveness of our regularization scheme.


RikoNet A Novel Anime Recommendation Engine. Anime is quite well received today, especially among the younger generations. With many genres of available shows, more and more people are increasingly getting attracted to this niche section of the entertainment industry. As anime has recently garnered mainstream attention, we have insufficient information regarding users' penchant and watching habits. Therefore, it is an uphill task to build a recommendation engine for this relatively obscure entertainment medium. In this attempt, we have built a novel hybrid recommendation system that could act both as a recommendation system and as a means of exploring new anime genres and titles. We have analyzed the general trends in this field and the users' watching habits for coming up with our efficacious solution. Our solution employs deep autoencoders for the tasks of predicting ratings and generating embeddings. Following this, we formed clusters using the embeddings of the anime titles. These clusters form the search space for anime with similarities and are used to find anime similar to the ones liked and disliked by the user. This method, combined with the predicted ratings, forms the novel hybrid filter. In this article, we have demonstrated this idea and compared the performance of our implemented model with the existing state of the art techniques.


Learning under Distribution Mismatch and Model Misspecification. We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified. Moreover, we provide a connection between the generalization error and the rate distortion theory, which allows one to utilize bounds from the rate distortion theory to derive new bounds on the generalization error and vice versa. In particular, the rate distortion based bound strictly improves over the earlier bound by Xu and Raginsky even when there is no mismatch. We also discuss how "auxiliary loss functions" can be utilized to obtain upper bounds on the generalization error.


Towards Biologically Plausible Convolutional Networks. Convolutional networks are ubiquitous in deep learning. They are particularly useful for images, as they reduce the number of parameters, reduce training time, and increase accuracy. However, as a model of the brain they are seriously problematic, since they require weight sharing something real neurons simply cannot do. Consequently, while neurons in the brain can be locally connected (one of the features of convolutional networks), they cannot be convolutional. Locally connected but non convolutional networks, however, significantly underperform convolutional ones. This is troublesome for studies that use convolutional networks to explain activity in the visual system. Here we study plausible alternatives to weight sharing that aim at the same regularization principle, which is to make each neuron within a pool react similarly to identical inputs. The most natural way to do that is by showing the network multiple translations of the same image, akin to saccades in animal vision. However, this approach requires many translations, and doesn't remove the performance gap. We propose instead to add lateral connectivity to a locally connected network, and allow learning via Hebbian plasticity. This requires the network to pause occasionally for a sleep like phase of "weight sharing". This method enables locally connected networks to achieve nearly convolutional performance on ImageNet and improves their fit to the ventral stream data, thus supporting convolutional networks as a model of the visual stream.


Deep Compression of Neural Networks for Fault Detection on Tennessee Eastman Chemical Processes. Artificial neural network has achieved the state of art performance in fault detection on the Tennessee Eastman process, but it often requires enormous memory to fund its massive parameters. In order to implement online real time fault detection, three deep compression techniques (pruning, clustering, and quantization) are applied to reduce the computational burden. We have extensively studied 7 different combinations of compression techniques, all methods achieve high model compression rates over 64 while maintain high fault detection accuracy. The best result is applying all three techniques, which reduces the model sizes by 91.5 and remains a high accuracy over 94 . This result leads to a smaller storage requirement in production environments, and makes the deployment smoother in real world.


Causal aware Safe Policy Improvement for Task oriented dialogue. The recent success of reinforcement learning's (RL) in solving complex tasks is most often attributed to its capacity to explore and exploit an environment where it has been trained. Sample efficiency is usually not an issue since cheap simulators are available to sample data on policy. On the other hand, task oriented dialogues are usually learnt from offline data collected using human demonstrations. Collecting diverse demonstrations and annotating them is expensive. Unfortunately, use of RL methods trained on off policy data are prone to issues of bias and generalization, which are further exacerbated by stochasticity in human response and non markovian belief state of a dialogue management system. To this end, we propose a batch RL framework for task oriented dialogue policy learning causal aware safe policy improvement (CASPI). This method gives guarantees on dialogue policy's performance and also learns to shape rewards according to intentions behind human responses, rather than just mimicking demonstration data this couple with batch RL helps overall with sample efficiency of the framework. We demonstrate the effectiveness of this framework on a dialogue context to text Generation and end to end dialogue task of the Multiwoz2.0 dataset. The proposed method outperforms the current state of the art on these metrics, in both case. In the end to end case, our method trained only on 10 of the data was able to out perform current state in three out of four evaluation metrics.


On Two XAI Cultures A Case Study of Non technical Explanations in Deployed AI System. Explainable AI (XAI) research has been booming, but the question " textbf To whom are we making AI explainable?" is yet to gain sufficient attention. Not much of XAI is comprehensible to non AI experts, who nonetheless, are the primary audience and major stakeholders of deployed AI systems in practice. The gap is glaring what is considered "explained" to AI experts versus non experts are very different in practical scenarios. Hence, this gap produced two distinct cultures of expectations, goals, and forms of XAI in real life AI deployments. We advocate that it is critical to develop XAI methods for non technical audiences. We then present a real life case study, where AI experts provided non technical explanations of AI decisions to non technical stakeholders, and completed a successful deployment in a highly regulated industry. We then synthesize lessons learned from the case, and share a list of suggestions for AI experts to consider when explaining AI decisions to non technical stakeholders.


Tensor feature hallucination for few shot learning. Few shot learning addresses the challenge of learning how to address novel tasks given not just limited supervision but limited data as well. An attractive solution is synthetic data generation. However, most such methods are overly sophisticated, focusing on high quality, realistic data in the input space. It is unclear whether adapting them to the few shot regime and using them for the downstream task of classification is the right approach. Previous works on synthetic data generation for few shot classification focus on exploiting complex models, e.g. a Wasserstein GAN with multiple regularizers or a network that transfers latent diversities from known to novel classes. We follow a different approach and investigate how a simple and straightforward synthetic data generation method can be used effectively. We make two contributions, namely we show that (1) using a simple loss function is more than enough for training a feature generator in the few shot setting and (2) learning to generate tensor features instead of vector features is superior. Extensive experiments on miniImagenet, CUB and CIFAR FS datasets show that our method sets a new state of the art, outperforming more sophisticated few shot data augmentation methods. The source code can be found at https github.com MichalisLazarou TFH fewshot.


A posteriori goal oriented bounds for the Poisson problem using potential and equilibrated flux reconstructions application to the hybridizable discontinuous Galerkin method. We present a general framework to compute upper and lower bounds for linear functional outputs of the exact solutions of the Poisson equation based on reconstructions of the field variable and flux for both the primal and adjoint problems. The method is devised from a generalization of the complementary energy principle and the duality theory. Using duality theory, the computation of bounds is reduced to finding independent potential and equilibrated flux reconstructions. A generalization of this result is also introduced, allowing to derive alternative guaranteed bounds from nearly arbitrary H(div Omega ) flux reconstructions (only zero order equilibration is required). This approach is applicable to any numerical method used to compute the solution. In this work, the proposed approach is applied to derive bounds for the hybridizable discontinuous Galerkin (HDG) method. An attractive feature of the proposed approach is that superconvergence on the bound gap is achieved, yielding accurate bounds even for very coarse meshes. Numerical experiments are presented to illustrate the performance and convergence of the bounds for the HDG method in both uniform and adaptive mesh refinements.


Prognostics Informed Battery Reconfiguration in a Multi Battery Small UAS Energy System. Batteries have been identified as one most likely small UAS (sUAS) components to fail in flight. sUAS safety will therefore be improved with redundant or backup batteries. This paper presents a prognostics informed Markov Decision Process (MDP) model for managing multi battery reconfiguration for sUAS missions. Typical lithium polymer (Lipo) battery properties are experimentally characterized and used in Monte Carlo simulations to establish battery dynamics in sUAS flights of varying duration. Case studies illustrate the trade off between multi battery system increased complexity weight and resilience to non ideal battery performance.


Indecomposability of the bounded derived categories of Brill Noether varieties. We prove that the bounded derived category of coherent sheaves of the Brill Noether variety G r d (C) that parametrizing linear series of degree d and dimension r on a general smooth projective curve C is indecomposable when d leq g(C) 1 .


Optimal H " o lder regularity for the bar partial problem on product domains in mathbb C 2 . The note concerns the bar partial problem on product domains in mathbb C 2 . We show that there exists a bounded solution operator from C k, alpha into itself, k in mathbb Z cup 0 , 0 alpha 1 . The regularity result is optimal in view of an example of Stein Kerzman.


Resource aware Online Parameter Adaptation for Computationally constrained Visual Inertial Navigation Systems. In this paper, a computational resources aware parameter adaptation method for visual inertial navigation systems is proposed with the goal of enabling the improved deployment of such algorithms on computationally constrained systems. Such a capacity can prove critical when employed on ultra lightweight systems or alongside mission critical computationally expensive processes. To achieve this objective, the algorithm proposes selected changes in the vision front end and optimization back end of visual inertial odometry algorithms, both prior to execution and in real time based on an online profiling of available resources. The method also utilizes information from the motion dynamics experienced by the system to manipulate parameters online. The general policy is demonstrated on three established algorithms, namely S MSCKF, VINS Mono and OKVIS and has been verified experimentally on the EuRoC dataset. The proposed approach achieved comparable performance at a fraction of the original computational cost.


Making opportunistic networks in IoT environments CCN ready A performance evaluation of the MobCCN protocol. In future IoT environments it is expected that the role of personal devices of mobile users in the physical area where IoT devices are deployed will become more and more important. In particular, due to the push towards decentralisation of services towards the edge, it is likely that a significant share of data generated by IoT devices will be needed by other (mobile) nodes nearby, while global Internet access will be limited only to a small fraction of data. In this context, opportunistic networking schemes can be adopted to build efficient content centric protocols, through which data generated by IoT devices (or by mobile nodes themselves) can be accessed by the other nodes nearby. In this paper, we propose MobCCN, which is an ICN compliant protocol for this heterogeneous environment. MobCCN is designed to implement the routing and forwarding mechanisms of the main ICN realisations, such as CCN. The original aspect of MobCCN is to implement an efficient opportunistic networking routing scheme to populate the Forwarding Interest Base (FIB) tables of the nodes, in order to guide the propagation of Interest packets towards nodes that store the required data. Specifically, MobCCN defines the utility of each node as a forwarder of Interest packets for a certain type of content, such that Interest packets can be propagated along a positive utility gradient, until reaching some node storing the data. We evaluate MobCCN against protocols representing two possible endpoints of the spectrum, respectively in terms of minimising the data delivery delay and the resource consumption. Performance results show that MobCCN is very effective and efficient, as it guarantees very high delivery rates and low delays, while keeping the total generated traffic at a reasonable level and also saving local resources.


A Comparison of Deep Learning Models for the Prediction of Hand Hygiene Videos. This paper presents a comparison of various deep learning models such as Exception, Resnet 50, and Inception V3 for the classification and prediction of hand hygiene gestures, which were recorded in accordance with the World Health Organization (WHO) guidelines. The dataset consists of six hand hygiene movements in a video format, gathered for 30 participants. The network consists of pre trained models with image net weights and a modified head of the model. An accuracy of 37 (Xception model), 33 (Inception V3), and 72 (ResNet 50) is achieved in the classification report after the training of the models for 25 epochs. ResNet 50 model clearly outperforms with correct class predictions. The major speed limitation can be overcome with the use of fast processing GPU for future work. A complete hand hygiene dataset along with other generic gestures such as one hand movements (linear hand motion circular hand rotation) will be tested with ResNet 50 architecture and the variants for health care workers.


Variations of Renormalized Volume for Minimal Submanifolds of Hyperbolic Space. We investigate the asymptotic expansion and the renormalized volume of minimal submanifolds of arbitrary codimension in mathbb H n 1 . In particular, we derive formulae for the first and second variations of renormalized volume for Y m subseteq mathbb H n 1 when m n 1 . We apply our formulae to codimension 1 case, gaining simpler expressions for the first and second variations. Furthermore, we prove the existence of an asymptotic graphical description of our minimal submanifold, Y , over the boundary cylinder partial Y times mathbb R , and we further derive an L 2 inner product relationship between u 2 and u m 1 .


Change Matters Medication Change Prediction with Recurrent Residual Networks. Deep learning is revolutionizing predictive healthcare, including recommending medications to patients with complex health conditions. Existing approaches focus on predicting all medications for the current visit, which often overlaps with medications from previous visits. A more clinically relevant task is to identify medication changes. In this paper, we propose a new recurrent residual network, named MICRON, for medication change prediction. MICRON takes the changes in patient health records as input and learns to update a hidden medication vector and the medication set recurrently with a reconstruction design. The medication vector is like the memory cell that encodes longitudinal information of medications. Unlike traditional methods that require the entire patient history for prediction, MICRON has a residual based inference that allows for sequential updating based only on new patient features (e.g., new diagnoses in the recent visit) more efficiently. We evaluated MICRON on real inpatient and outpatient datasets. MICRON achieves 3.5 and 7.8 relative improvements over the best baseline in F1 score, respectively. MICRON also requires fewer parameters, which significantly reduces the training time to 38.3s per epoch with 1.5x speed up.


A theory of reflective X ray multilayer structures with graded period and its applications. In this paper a theory of reflective X ray multilayer structures with a graded (slowly varying) period based on the coupled waves method and quasi classical asymptotic expansions is reported. A number of exact solutions of the coupled wave equations is obtained and analyzed demonstrating suitability of this method for the description of the reflective properties of the graded multilayers. The developed theory is then used as a basis for the solution of the inverse problem, i.e. designing multilayer structures with a pre specified reflectivity dependence on the wavelength or grazing angle. A number numerical experiments is conducted to demonstrate the capabilities of the proposed method in designing reflective multilayer coatings with an arbitrary shape of the reflectivity curve. The problem of maximization of the integral reflectivity is considered and a second order differential equation, which solutions correspond to multilayer structures with the maximal reflectivity, is derived. Finally, an upper limit on the integral reflectivity achievable with a graded multilayer is estimated.


Isbell adjunctions and Kan adjunctions via quantale enriched two variable adjunctions. It is shown that every two variable adjunction in categories enriched in a commutative quantale serves as a base for constructing Isbell adjunctions between functor categories, and Kan adjunctions are precisely Isbell adjunctions constructed from suitable associated two variable adjunctions. Representation theorems are established for fixed points of these adjunctions.


Rainfall runoff prediction using a Gustafson Kessel clustering based Takagi Sugeno Fuzzy model. A rainfall runoff model predicts surface runoff either using a physically based approach or using a systems based approach. Takagi Sugeno (TS) Fuzzy models are systems based approaches and a popular modeling choice for hydrologists in recent decades due to several advantages and improved accuracy in prediction over other existing models. In this paper, we propose a new rainfall runoff model developed using Gustafson Kessel (GK) clustering based TS Fuzzy model. We present comparative performance measures of GK algorithms with two other clustering algorithms (i) Fuzzy C Means (FCM), and (ii)Subtractive Clustering (SC). Our proposed TS Fuzzy model predicts surface runoff using (i) observed rainfall in a drainage basin and (ii) previously observed precipitation flow in the basin outlet. The proposed model is validated using the rainfall runoff data collected from the sensors installed on the campus of the Indian Institute of Technology, Kharagpur. The optimal number of rules of the proposed model is obtained by different validation indices. A comparative study of four performance criteria RootMean Square Error (RMSE), Coefficient of Efficiency (CE), Volumetric Error (VE), and Correlation Coefficient of Determination(R) have been quantitatively demonstrated for each clustering algorithm.


qRRT Quality Biased Incremental RRT for Optimal Motion Planning in Non Holonomic Systems. This paper presents a sampling based method for optimal motion planning in non holonomic systems in the absence of known cost functions. It uses the principle of learning through experience to deduce the cost to go of regions within the workspace. This cost information is used to bias an incremental graph based search algorithm that produces solution trajectories. Iterative improvement of cost information and search biasing produces solutions that are proven to be asymptotically optimal. The proposed framework builds on incremental Rapidly exploring Random Trees (RRT) for random sampling based search and Reinforcement Learning (RL) to learn workspace costs. A series of experiments were performed to evaluate and demonstrate the performance of the proposed method.


Embedding in MDS codes and Latin cubes. An embedding of a code is a mapping that preserves distances between codewords. We prove that any code with code distance rho and length d can be embedded into an MDS code with the same code distance and length but under a larger alphabet. As a corollary we obtain embeddings of systems of partial mutually orthogonal Latin cubes and n ary quasigroups.


Scalable Graph Embedding LearningOn A Single GPU. Graph embedding techniques have attracted growing interest since they convert the graph data into continuous and low dimensional space. Effective graph analytic provides users a deeper understanding of what is behind the data and thus can benefit a variety of machine learning tasks. With the current scale of real world applications, most graph analytic methods suffer high computation and space costs. These methods and systems can process a network with thousands to a few million nodes. However, scaling to large scale networks remains a challenge. The complexity of training graph embedding system requires the use of existing accelerators such as GPU. In this paper, we introduce a hybrid CPU GPU framework that addresses the challenges of learning embedding of large scale graphs. The performance of our method is compared qualitatively and quantitatively with the existing embedding systems on common benchmarks. We also show that our system can scale training to datasets with an order of magnitude greater than a single machine's total memory capacity. The effectiveness of the learned embedding is evaluated within multiple downstream applications. The experimental results indicate the effectiveness of the learned embedding in terms of performance and accuracy.


Statistical position reconstruction for RPC based thermal neutron detectors. Multilayer position sensitive 10B RPC thermal neutron detectors offer an attractive combination of sub millimeter spatial resolution and high ( 50 ) detection efficiency. Here we describe a new position reconstruction method based on a statistical approach. Using experimental data, we compare the performance of this method with that of the centroid reconstruction. Both methods result in a similar image linearity uniformity and spatial resolution. However, the statistical method allows to improve the image quality at the detector periphery, offers more flexible event filtering and allows to develop automatic quality monitoring procedures for early detection of situations when a change in the detector operation conditions starts to affect reconstruction quality.


Almost complex manifolds with small Nijenhuis tensor. We give several explicit examples of compact manifolds with a 1 parameter family of almost complex structures having arbitrarily small Nijenhuis tensor in the C 0 norm. The 4 dimensional examples possess no complex structure, whereas the 6 dimensional example does not possesses a left invariant complex structure, and whether it possesses a complex structure appears to be unknown.


ARC A Vision based Automatic Retail Checkout System. Retail checkout systems employed at supermarkets primarily rely on barcode scanners, with some utilizing QR codes, to identify the items being purchased. These methods are time consuming in practice, require a certain level of human supervision, and involve waiting in long queues. In this regard, we propose a system, that we call ARC, which aims at making the process of check out at retail store counters faster, autonomous, and more convenient, while reducing dependency on a human operator. The approach makes use of a computer vision based system, with a Convolutional Neural Network at its core, which scans objects placed beneath a webcam for identification. To evaluate the proposed system, we curated an image dataset of one hundred local retail items of various categories. Within the given assumptions and considerations, the system achieves a reasonable test time accuracy, pointing towards an ambitious future for the proposed setup. The project code and the dataset are made publicly available.


CLINS Continuous Time Trajectory Estimation for LiDAR Inertial System. In this paper, we propose a highly accurate continuous time trajectory estimation framework dedicated to SLAM (Simultaneous Localization and Mapping) applications, which enables fuse high frequency and asynchronous sensor data effectively. We apply the proposed framework in a 3D LiDAR inertial system for evaluations. The proposed method adopts a non rigid registration method for continuous time trajectory estimation and simultaneously removing the motion distortion in LiDAR scans. Additionally, we propose a two state continuous time trajectory correction method to efficiently and efficiently tackle the computationally intractable global optimization problem when loop closure happens. We examine the accuracy of the proposed approach on several publicly available datasets and the data we collected. The experimental results indicate that the proposed method outperforms the discrete time methods regarding accuracy especially when aggressive motion occurs. Furthermore, we open source our code at url https github.com APRIL ZJU clins to benefit research community.


Congruences modulo powers of 5 for the rank parity function. It is well known that Ramanujan conjectured congruences modulo powers of 5, 7 and and 11 for the partition function. These were subsequently proved by Watson (1938) and Atkin (1967). In 2009 Choi, Kang, and Lovejoy proved congruences modulo powers of 5 for the crank parity function. The generating function for rank parity function is f(q), which is the first example of a mock theta function that Ramanujan mentioned in his last letter to Hardy. We prove congruences modulo powers of 5 for the rank parity function.


Compressed sensing in the presence of speckle noise. The problem of recovering a structured signal from its linear measurements in the presence of speckle noise is studied. This problem appears in many imaging systems such as synthetic aperture radar and optical coherence tomography. The current acquisition technology oversamples signals and converts the problem into a denoising problem with multiplicative noise. However, this paper explores the possibility of reducing the number of measurements below the ambient dimension of the signal. The sophistications that appear in the study of multiplicative noises have so far impeded theoretical analysis of such problems. This paper aims to present the first theoretical result regarding the recovery of signals from their undersampled measurements under the speckle noise. It is shown that if the signal class is structured, in the sense that the signals can be compressed efficiently, then one can obtain accurate estimates of the signal from fewer measurements than the ambient dimension. We demonstrate the effectiveness of the methods we propose through simulation results.


Characterization of Nonhomogeneous Wavelet Bi frames for Reducing Subspaces of Sobolev Spaces over Local Fields of Prime Characteristics. In this paper, we provide the characterization of nonhomogeneous wavelet bi frames. First of all we introduce the reducing subspaces of Sobolev spaces over local fields of prime characteristics and then characterize the nonhomogeneous wavelet bi frames over such fields.


Machine and People Protection. This contribution acts as an introduction to the requirements of the machine protection system. As the first step, the basics interactions of fast charged particles, neutrons and gamma rays with matter are summarized. The architecture of a machine protection system based on beam loss detection is described. Personal safety issues and personal dosimetry are discussed, including the concept of radiation shielding.


Sixth Order Compact Finite Difference Method for 2D Helmholtz Equations with Singular Sources and Reduced Pollution Effect. Due to its highly oscillating solution, the Helmholtz equation is numerically challenging to solve. To obtain a reasonable solution, a mesh size that is much smaller than the reciprocal of the wavenumber is typically required (known as the pollution effect). High order schemes are desirable, because they are better in mitigating the pollution effect. In this paper, we present a sixth order compact finite difference method for 2D Helmholtz equations with singular sources, which can also handle any possible combinations of boundary conditions (Dirichlet, Neumann, and impedance) on a rectangular domain. To reduce the pollution effect, we propose a new pollution minimization strategy that is based on the average truncation error of plane waves. Our numerical experiments demonstrate the superiority of our proposed finite difference scheme with reduced pollution effect to several state of the art finite difference schemes in the literature, particularly in the critical pre asymptotic region where textsf k h is near 1 with textsf k being the wavenumber and h the mesh size.


Protecting Intellectual Property of Generative Adversarial Networks from Ambiguity Attack. Ever since Machine Learning as a Service (MLaaS) emerges as a viable business that utilizes deep learning models to generate lucrative revenue, Intellectual Property Right (IPR) has become a major concern because these deep learning models can easily be replicated, shared, and re distributed by any unauthorized third parties. To the best of our knowledge, one of the prominent deep learning models Generative Adversarial Networks (GANs) which has been widely used to create photorealistic image are totally unprotected despite the existence of pioneering IPR protection methodology for Convolutional Neural Networks (CNNs). This paper therefore presents a complete protection framework in both black box and white box settings to enforce IPR protection on GANs. Empirically, we show that the proposed method does not compromise the original GANs performance (i.e. image generation, image super resolution, style transfer), and at the same time, it is able to withstand both removal and ambiguity attacks against embedded watermarks.


SaccadeCam Adaptive Visual Attention for Monocular Depth Sensing. Most monocular depth sensing methods use conventionally captured images that are created without considering scene content. In contrast, animal eyes have fast mechanical motions, called saccades, that control how the scene is imaged by the fovea, where resolution is highest. In this paper, we present the SaccadeCam framework for adaptively distributing resolution onto regions of interest in the scene. Our algorithm for adaptive resolution is a self supervised network and we demonstrate results for end to end learning for monocular depth estimation. We also show preliminary results with a real SaccadeCam hardware prototype.


Learning to Predict with Supporting Evidence Applications to Clinical Risk Prediction. The impact of machine learning models on healthcare will depend on the degree of trust that healthcare professionals place in the predictions made by these models. In this paper, we present a method to provide people with clinical expertise with domain relevant evidence about why a prediction should be trusted. We first design a probabilistic model that relates meaningful latent concepts to prediction targets and observed data. Inference of latent variables in this model corresponds to both making a prediction and providing supporting evidence for that prediction. We present a two step process to efficiently approximate inference (i) estimating model parameters using variational learning, and (ii) approximating maximum a posteriori estimation of latent variables in the model using a neural network, trained with an objective derived from the probabilistic model. We demonstrate the method on the task of predicting mortality risk for patients with cardiovascular disease. Specifically, using electrocardiogram and tabular data as input, we show that our approach provides appropriate domain relevant supporting evidence for accurate predictions.


Fano Shimura varieties with mostly branched cusps. We show the Satake Baily Borel compactification of certain Shimura varieties are Fano varieties or with ample canonical divisor by means of special modular forms and give various concrete examples. Their unbranched open subsets are always quasi affine and in Fano unitary Shimura varieties case for instance, all but one cusps are necessarily covered by the closure of branch divisors. Our examples include the moduli of (log) Enriques surfaces, those corresponding to II 2,26 , and those associated to various Hermitian lattices. On the way, we also show that for some imaginary quadratic fields and any unimodular Hermitian lattices, the associated unitary Shimura varieties are unbranched in codimension 1 .


Semi Local Convolutions for LiDAR Scan Processing. A number of applications, such as mobile robots or automated vehicles, use LiDAR sensors to obtain detailed information about their three dimensional surroundings. Many methods use image like projections to efficiently process these LiDAR measurements and use deep convolutional neural networks to predict semantic classes for each point in the scan. The spatial stationary assumption enables the usage of convolutions. However, LiDAR scans exhibit large differences in appearance over the vertical axis. Therefore, we propose semi local convolution (SLC), a convolution layer with reduced amount of weight sharing along the vertical dimension. We are first to investigate the usage of such a layer independent of any other model changes. Our experiments did not show any improvement over traditional convolution layers in terms of segmentation IoU or accuracy.


Czech News Dataset for Semantic Textual Similarity. This paper describes a novel dataset consisting of sentences with semantic similarity annotations. The data originate from the journalistic domain in the Czech language. We describe the process of collecting and annotating the data in detail. The dataset contains 138,556 human annotations divided into train and test sets. In total, 485 journalism students participated in the creation process. To increase the reliability of the test set, we compute the annotation as an average of 9 individual annotations. We evaluate the quality of the dataset by measuring inter and intra annotation annotators' agreements. Beside agreement numbers, we provide detailed statistics of the collected dataset. We conclude our paper with a baseline experiment of building a system for predicting the semantic similarity of sentences. Due to the massive number of training annotations (116 956), the model can perform significantly better than an average annotator (0,92 versus 0,86 of Person's correlation coefficients).


Finding a Largest Area Triangle in a Terrain in Near Linear Time. A terrain is an x monotone polygon whose lower boundary is a single line segment. We present an algorithm to find in a terrain a triangle of largest area in O(n log n) time, where n is the number of vertices defining the terrain. The best previous algorithm for this problem has a running time of O(n 2) .


A note on the low dimensional Minkowski reduction. In this research expository paper we recall the basic results of reduction theory of positive definite quadratic forms. Using the result of Ryskov on admissible centerings and the result of Tammela about the determination of a Minkowski reduced form, we prove that the absolute values of coordinates of a minimum vector in a six dimensional Minkowski reduced basis are less or equal to three. To get this little sharpening of the result which can be deduced automatically from Tammela's works we combine some elementary geometric reasonings with the mentioned theoretical results.


Multi color continuous variable quantum entanglement in dissipative Kerr solitons. In a traveling wave microresonator, the cascaded four wave mixing between optical modes allows the generation of frequency combs, including the intriguing dissipative Kerr solitons (DKS). Here, we theoretically investigate the quantum fluctuations of the comb and reveal the quantum feature of the soliton. It is demonstrated that the fluctuations of Kerr frequency comb lines are correlated, leading to multi color continuous variable entanglement. In particular, in the DKS state, the coherent comb lines stimulate photon pair generation and also coherent photon conversion between all optical modes, and exhibit all to all connection of quantum entanglement. The broadband multi color entanglement is not only universal, but also is robust against practical imperfections, such as extra optical loss or extraordinary frequency shift of a few modes. Our work reveals the prominent quantum nature of DKSs, which is of fundamental interest in quantum optics and also holds potential for quantum network and distributed quantum sensing applications.


Irreducibility and monicity for representations of k graph C algebras. The representations of a k graph C algebra C ( Lambda) which arise from Lambda semibranching function systems are closely linked to the dynamics of the k graph Lambda . In this paper, we undertake a systematic analysis of the question of irreducibility for these representations. We provide a variety of necessary and sufficient conditions for irreducibility, as well as a number of examples indicating the optimality of our results. We also explore the relationship between irreducible Lambda semibranching representations and purely atomic representations of C ( Lambda) . Throughout the paper, we work in the setting of row finite source free k graphs this paper constitutes the first analysis of Lambda semibranching representations at this level of generality.


A National Discovery Cloud Preparing the US for Global Competitiveness in the New Era of 21st Century Digital Transformation. The nature of computation and its role in our lives have been transformed in the past two decades by three remarkable developments the emergence of public cloud utilities as a new computing platform the ability to extract information from enormous quantities of data via machine learning and the emergence of computational simulation as a research method on par with experimental science. Each development has major implications for how societies function and compete together, they represent a change in technological foundations of society as profound as the telegraph or electrification. Societies that embrace these changes will lead in the 21st Century those that do not, will decline in prosperity and influence. Nowhere is this stark choice more evident than in research and education, the two sectors that produce the innovations that power the future and prepare a workforce able to exploit those innovations, respectively. In this article, we introduce these developments and suggest steps that the US government might take to prepare the research and education system for its implications.


Shunted Self Attention via Multi Scale Token Aggregation. Recent Vision Transformer (ViT) models have demonstrated encouraging results across various computer vision tasks, thanks to their competence in modeling long range dependencies of image patches or tokens via self attention. These models, however, usually designate the similar receptive fields of each token feature within each layer. Such a constraint inevitably limits the ability of each self attention layer in capturing multi scale features, thereby leading to performance degradation in handling images with multiple objects of different scales. To address this issue, we propose a novel and generic strategy, termed shunted self attention (SSA), that allows ViTs to model the attentions at hybrid scales per attention layer. The key idea of SSA is to inject heterogeneous receptive field sizes into tokens before computing the self attention matrix, it selectively merges tokens to represent larger object features while keeping certain tokens to preserve fine grained features. This novel merging scheme enables the self attention to learn relationships between objects with different sizes and simultaneously reduces the token numbers and the computational cost. Extensive experiments across various tasks demonstrate the superiority of SSA. Specifically, the SSA based transformer achieves 84.0 Top 1 accuracy and outperforms the state of the art Focal Transformer on ImageNet with only half of the model size and computation cost, and surpasses Focal Transformer by 1.3 mAP on COCO and 2.9 mIOU on ADE20K under similar parameter and computation cost. Code has been released at https github.com OliverRensu Shunted Transformer.


Power series summability methods in de Branges Rovnyak spaces. We show that there exists a de Branges Rovnyak space mathcal H (b) on the unit disk containing a function f with the following property even though f can be approximated by polynomials in mathcal H (b) , neither the Taylor partial sums of f nor their Ces aro, Abel, Borel or logarithmic means converge to f in mathcal H (b) . A key tool is a new abstract result showing that, if one regular summability method includes another for scalar sequences, then it automatically does so for certain Banach space valued sequences too.


RGB D Local Implicit Function for Depth Completion of Transparent Objects. Majority of the perception methods in robotics require depth information provided by RGB D cameras. However, standard 3D sensors fail to capture depth of transparent objects due to refraction and absorption of light. In this paper, we introduce a new approach for depth completion of transparent objects from a single RGB D image. Key to our approach is a local implicit neural representation built on ray voxel pairs that allows our method to generalize to unseen objects and achieve fast inference speed. Based on this representation, we present a novel framework that can complete missing depth given noisy RGB D input. We further improve the depth estimation iteratively using a self correcting refinement model. To train the whole pipeline, we build a large scale synthetic dataset with transparent objects. Experiments demonstrate that our method performs significantly better than the current state of the art methods on both synthetic and real world data. In addition, our approach improves the inference speed by a factor of 20 compared to the previous best method, ClearGrasp. Code and dataset will be released at https research.nvidia.com publication 2021 03 RGB D Local Implicit.


The e positivity and Schur positivity of the chromatic symmetric functions of some trees. We investigate the e positivity and Schur positivity of the chromatic symmetric functions of some spider graphs with three legs. We obtain the positivity classification of all broom graphs and that of most double broom graphs. The methods involve extracting particular e coefficients of the chromatic symmetric function of these graphs with the aid of Orellana and Scott's triple deletion property, and using the combinatorial formula of Schur coefficients by examining certain special rim hook tabloids. We also propose some conjectures on the e positivity and Schur positivity of trees.


Geometric L packets of Howe unramified toral supercuspidal representations. We show that L packets of toral supercuspidal representations arising from unramified maximal tori of p adic groups are realized by Deligne Lusztig varieties for parahoric subgroups. We prove this by exhibiting a direct comparison between the cohomology of these varieties and algebraic constructions of supercuspidal representations. Our approach is to establish that toral irreducible representations are uniquely determined by the values of their characters on a domain of sufficiently regular elements. This is an analogue of Harish Chandra's characterization of real discrete series representations by their character on regular elements of compact maximal tori, a characterization which Langlands relied on in his construction of L packets of these representations. In parallel to the real case, we characterize the members of Kaletha's toral L packets by their character on sufficiently regular elements of elliptic maximal tori.


FinRL Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance. Deep reinforcement learning (DRL) has been envisioned to have a competitive edge in quantitative finance. However, there is a steep development curve for quantitative traders to obtain an agent that automatically positions to win in the market, namely textit to decide where to trade, at what price and textit what quantity , due to the error prone programming and arduous debugging. In this paper, we present the first open source framework textit FinRL as a full pipeline to help quantitative traders overcome the steep learning curve. FinRL is featured with simplicity, applicability and extensibility under the key principles, textit full stack framework, customization, reproducibility and textit hands on tutoring . Embodied as a three layer architecture with modular structures, FinRL implements fine tuned state of the art DRL algorithms and common reward functions, while alleviating the debugging workloads. Thus, we help users pipeline the strategy design at a high turnover rate. At multiple levels of time granularity, FinRL simulates various markets as training environments using historical data and live trading APIs. Being highly extensible, FinRL reserves a set of user import interfaces and incorporates trading constraints such as market friction, market liquidity and investor's risk aversion. Moreover, serving as practitioners' stepping stones, typical trading tasks are provided as step by step tutorials, e.g., stock trading, portfolio allocation, cryptocurrency trading, etc.


Fusion Moves for Graph Matching. We contribute to approximate algorithms for the quadratic assignment problem also known as graph matching. Inspired by the success of the fusion moves technique developed for multilabel discrete Markov random fields, we investigate its applicability to graph matching. In particular, we show how fusion moves can be efficiently combined with the dedicated state of the art dual methods that have recently shown superior results in computer vision and bio imaging applications. As our empirical evaluation on a wide variety of graph matching datasets suggests, fusion moves significantly improve performance of these methods in terms of speed and quality of the obtained solutions. Our method sets a new state of the art with a notable margin with respect to its competitors.


Unifying AI Algorithms with Probabilistic Programming using Implicitly Defined Representations. We introduce Scruff, a new framework for developing AI systems using probabilistic programming. Scruff enables a variety of representations to be included, such as code with stochastic choices, neural networks, differential equations, and constraint systems. These representations are defined implicitly using a set of standardized operations that can be performed on them. General purpose algorithms are then implemented using these operations, enabling generalization across different representations. Zero, one, or more operation implementations can be provided for any given representation, giving algorithms the flexibility to use the most appropriate available implementations for their purposes and enabling representations to be used in ways that suit their capabilities. In this paper, we explain the general approach of implicitly defined representations and provide a variety of examples of representations at varying degrees of abstraction. We also show how a relatively small set of operations can serve to unify a variety of AI algorithms. Finally, we discuss how algorithms can use policies to choose which operation implementations to use during execution.


Neural Embeddings of Urban Big Data Reveal Emergent Structures in Cities. In this study, we propose using a neural embedding model graph neural network (GNN) that leverages the heterogeneous features of urban areas and their interactions captured by human mobility network to obtain vector representations of these areas. Using large scale high resolution mobility data sets from millions of aggregated and anonymized mobile phone users in 16 metropolitan counties in the United States, we demonstrate that our embeddings encode complex relationships among features related to urban components (such as distribution of facilities) and population attributes and activities. The spatial gradient in each direction from city center to suburbs is measured using clustered representations and the shared characteristics among urban areas in the same cluster. Furthermore, we show that embeddings generated by a model trained on a different county can capture 50 to 60 of the emergent spatial structure in another county, allowing us to make cross county comparisons in a quantitative way. Our GNN based framework overcomes the limitations of previous methods used for examining spatial structures and is highly scalable. The findings reveal non linear relationships among urban components and anisotropic spatial gradients in cities. Since the identified spatial structures and gradients capture the combined effects of various mechanisms, such as segregation, disparate facility distribution, and human mobility, the findings could help identify the limitations of the current city structure to inform planning decisions and policies. Also, the model and findings set the stage for a variety of research in urban planning, engineering and social science through integrated understanding of how the complex interactions between urban components and population activities and attributes shape the spatial structures in cities.


Conformer specific Chemistry Imaged in Real Space and Time. Conformational isomers or conformers of molecules play a decisive role in chemistry and biology. However, experimental methods to investigate chemical reaction dynamics are typically not conformer sensitive. Here, we report on a gas phase megaelectronvolt ultrafast electron diffraction investigation of alpha phellandrene undergoing an electrocyclic ring opening reaction. We directly image the evolution of a specific set of alpha phellandrene conformers into the product isomer predicted by the Woodward Hoffmann rules in real space and time. Our experimental results are in quantitative agreement with nonadiabatic quantum molecular dynamics simulations, which provide unprecedented detail of how conformation influences time scale and quantum efficiency of photoinduced ring opening reactions. Due to the prevalence of large numbers of conformers in organic chemistry, our findings impact our general understanding of reaction dynamics in chemistry and biology.


Blow up for the inhomogeneous nonlinear Schrodinger equation. In this work, we consider the following inhomogeneous nonlinear Schr "odinger equation begin align i partial t u Delta u x b u p 1 u 0, quad (x, t) in mathbb R N times mathbb R end align with 0 b mbox min 2, N and 1 frac 4 2b N p 2 ast . We assume that u 0 in H 1 ( mathbb R N) and satisfies begin align E(u 0) s c M(u 0) 1 s c E(Q) s c M(Q) 1 s c , end align and begin align nabla u 0 L 2 s c u 0 L 2 1 s c nabla Q L 2 s c Q L 2 1 s c , end align where Q is the ground state solution of the corresponding elliptic equation. We prove that when 1 frac 4 2b N p leq1 frac 4 N , then the corresponding solution blows up in finite time. Besides, when 1 frac 4 N p 2 ast , we prove the finite or infinite time blow up and obtain a precise lower bound of blow up rate.


Grammatical Profiling for Semantic Change Detection. Semantics, morphology and syntax are strongly interdependent. However, the majority of computational methods for semantic change detection use distributional word representations which encode mostly semantics. We investigate an alternative method, grammatical profiling, based entirely on changes in the morphosyntactic behaviour of words. We demonstrate that it can be used for semantic change detection and even outperforms some distributional semantic methods. We present an in depth qualitative and quantitative analysis of the predictions made by our grammatical profiling system, showing that they are plausible and interpretable.


Approximation of nilpotent orbits for simple Lie groups. We propose a systematic and topological study of limits lim nu to 0 G mathbb R cdot( nu x) of continuous families of adjoint orbits for non compact simple Lie groups. This limit is always a finite union of nilpotent orbits. We describe explicitly these nilpotent orbits in terms of Richardson orbits in the case of hyperbolic semisimple elements. We also show that one can approximate minimal nilpotent orbits or even nilpotent orbits by elliptic semisimple orbits. The special cases of mathrm SL n( mathbb R ) and mathrm SU (p,q) are computed in detail.


Global existence of solutions of a loglog energy supercritical Klein Gordon equation. We prove global existence of solutions of a loglog energy supercritical Klein Gordon equation for n 3,4,5. Assuming that blow up occurs at a time of maximal existence, we perform an analysis close to this time in order to find a finite bound of a Strichartz type norm, which eventually leads to a contraction with the blow up assumption.


Regularity of powers of (parity) binomial edge ideals. In this paper, we provide exact formulas for the Castelnuovo Mumford regularity of powers of an almost complete intersection ideal I which is generated by a homogeneous d sequence. As applications, when I is an almost complete intersection, taking the form of the (parity) binomial edge ideal of a connected graph, we can describe explicitly formulas for reg(I t) for t ge 2 . The only exception is when I is the parity binomial edge ideal of a graph which is obtained by adding an edge between two disjoint odd cycles.


Defending against Reconstruction Attack in Vertical Federated Learning. Recently researchers have studied input leakage problems in Federated Learning (FL) where a malicious party can reconstruct sensitive training inputs provided by users from shared gradient. It raises concerns about FL since input leakage contradicts the privacy preserving intention of using FL. Despite a relatively rich literature on attacks and defenses of input reconstruction in Horizontal FL, input leakage and protection in vertical FL starts to draw researcher's attention recently. In this paper, we study how to defend against input leakage attacks in Vertical FL. We design an adversarial training based framework that contains three modules adversarial reconstruction, noise regularization, and distance correlation minimization. Those modules can not only be employed individually but also applied together since they are independent to each other. Through extensive experiments on a large scale industrial online advertising dataset, we show our framework is effective in protecting input privacy while retaining the model utility.


Filtration and canonical completeness for continuous modal mu calculi. The continuous modal mu calculus is a fragment of the modal mu calculus, where the application of fixpoint operators is restricted to formulas whose functional interpretation is Scott continuous, rather than merely monotone. By game theoretic means, we show that this relatively expressive fragment still allows two important techniques of basic modal logic, which notoriously fail for the full modal mu calculus filtration and canonical models. In particular, we show that the Filtration Theorem holds for formulas in the language of the continuous modal mu calculus. As a consequence we obtain the finite model property over a wide range of model classes. Moreover, we show that if a basic modal logic L is canonical and the class of L frames admits filtration, then the logic obtained by adding continuous fixpoint operators to L is sound and complete with respect to the class of L frames. This generalises recent results on a strictly weaker fragment of the modal mu calculus, viz. PDL.


Generalized Out of Distribution Detection A Survey. Out of distribution (OOD) detection is critical to ensuring the reliability and safety of machine learning systems. For instance, in autonomous driving, we would like the driving system to issue an alert and hand over the control to humans when it detects unusual scenes or objects that it has never seen before and cannot make a safe decision. This problem first emerged in 2017 and since then has received increasing attention from the research community, leading to a plethora of methods developed, ranging from classification based to density based to distance based ones. Meanwhile, several other problems are closely related to OOD detection in terms of motivation and methodology. These include anomaly detection (AD), novelty detection (ND), open set recognition (OSR), and outlier detection (OD). Despite having different definitions and problem settings, these problems often confuse readers and practitioners, and as a result, some existing studies misuse terms. In this survey, we first present a generic framework called generalized OOD detection, which encompasses the five aforementioned problems, i.e., AD, ND, OSR, OOD detection, and OD. Under our framework, these five problems can be seen as special cases or sub tasks, and are easier to distinguish. Then, we conduct a thorough review of each of the five areas by summarizing their recent technical developments. We conclude this survey with open challenges and potential research directions.


Analytic lattice cohomology of surface singularities. We construct the analytic lattice cohomology associated with the analytic type of any complex normal surface singularity. It is the categorification of the geometric genus of the germ, whenever the link is a rational homology sphere. It is the analytic analogue of the topological lattice cohomology, associated with the link of the germ whenever it is a rational homology sphere. This topological lattice cohomology is the categorification of the Seiberg Witten invariant, and conjecturally it is isomorphic with the Heegaard Floer cohomology. We compare the two lattice cohomologies in some simple cases they coincide, but in general, the analytic cohomology is sensitive to the analytic structure. We expect a deep connection with deformation theory. We provide several basic properties and key examples, and we formulate several conjectures and problems. This is the initial article of a series, in which we develop the analytic lattice cohomology of singularities.


Fusion categories containing a fusion subcategory with maximal rank. In this paper, we study fusion categories which contain a proper fusion subcategory with maximal rank. They can be viewed as generalizations of near group fusion categories. We first prove that they admit spherical structure. We then classify those which are non degenerate or symmetric. Finally, we classify such fusion categories of rank 4.


Edge augmented Graph Transformers Global Self attention is Enough for Graphs. Transformer neural networks have achieved state of the art results for unstructured data such as text and images but their adoption for graph structured data has been limited. This is partly due to the difficulty of incorporating complex structural information in the basic transformer framework. We propose a simple yet powerful extension to the transformer residual edge channels. The resultant framework, which we call Edge augmented Graph Transformer (EGT), can directly accept, process and output structural information as well as node information. It allows us to use global self attention, the key element of transformers, directly for graphs and comes with the benefit of long range interaction among nodes. Moreover, the edge channels allow the structural information to evolve from layer to layer, and prediction tasks on edges links can be performed directly from the output embeddings of these channels. In addition, we introduce a generalized positional encoding scheme for graphs based on Singular Value Decomposition which can improve the performance of EGT. Our framework, which relies on global node feature aggregation, achieves better performance compared to Convolutional Message Passing Graph Neural Networks, which rely on local feature aggregation within a neighborhood. We verify the performance of EGT in a supervised learning setting on a wide range of experiments on benchmark datasets. Our findings indicate that convolutional aggregation is not an essential inductive bias for graphs and global self attention can serve as a flexible and adaptive alternative.


Fast and flexible Human program induction in abstract reasoning tasks. The Abstraction and Reasoning Corpus (ARC) is a challenging program induction dataset that was recently proposed by Chollet (2019). Here, we report the first set of results collected from a behavioral study of humans solving a subset of tasks from ARC (40 out of 1000). Although this subset of tasks contains considerable variation, our results showed that humans were able to infer the underlying program and generate the correct test output for a novel test input example, with an average of 80 of tasks solved per participant, and with 65 of tasks being solved by more than 80 of participants. Additionally, we find interesting patterns of behavioral consistency and variability within the action sequences during the generation process, the natural language descriptions to describe the transformations for each task, and the errors people made. Our findings suggest that people can quickly and reliably determine the relevant features and properties of a task to compose a correct solution. Future modeling work could incorporate these findings, potentially by connecting the natural language descriptions we collected here to the underlying semantics of ARC.


Ramification structures for quotients of multi EGS groups. Groups associated to surfaces isogenous to a higher product of curves can be characterised by a purely group theoretic condition, which is the existence of a so called ramification structure. G " u l and Uria Albizuri showed that quotients of the periodic Grigorchuk Gupta Sidki groups, GGS groups for short, admit ramification structures. We extend their result by showing that quotients of generalisations of the GGS groups, namely multi EGS groups, also admit ramification structures.


Embedding theory of lattices and its application for 2 integrable lattices. For a positive integer s , a lattice L is said to be s integrable if sqrt s cdot L is isometric to a sublattice of mathbb Z n for some integer n . Conway and Sloane found two minimal non 2 integrable lattices of rank 12 and determinant 7 in 1989. We find two more ones of rank 12 and determinant 15 . Then we introduce a method of embedding a given lattice into a unimodular lattice, which plays a key role in proving minimality of non 2 integrable lattices and finding candidates for non 2 integrable lattices.


An Information Filtering approach to stress testing an application to FTSE markets. We present a novel methodology to quantify the "impact" of and "response" to market shocks. We apply shocks to a group of stocks in a part of the market, and we quantify the effects in terms of average losses on another part of the market using a sparse probabilistic elliptical model for the multivariate return distribution of the whole market. Sparsity is introduced with an L 0 norm regularization, which forces to zero some elements of the inverse covariance according to a dependency structure inferred from an information filtering network. Our study concerns the FTSE 100 and 250 markets and analyzes impact and response to shocks both applied to and received from individual stocks and group of stocks. We observe that the shock pattern is related to the structure of the network associated with the sparse structure of the inverse covariance of stock returns. Central sectors appear more likely to be affected by shocks, and stocks with a large level of underlying diversification have a larger impact on the rest of the market when experiencing shocks. By analyzing the system during times of crisis and comparative market calmness, we observe changes in the shock patterns with a convergent behavior in times of crisis.


Integral Einstein hypersurfaces in spheres. Combining the intrinsic and extrinsic geometry, we generalize Einstein manifolds to Integral Einstein (IE) submanifolds. A Takahashi type theorem is established to characterize minimal hypersurfaces with constant scalar curvature (CSC) in unit spheres, which is the main object of the Chern conjecture such hypersurfaces are isoparametric. For these hypersurfaces, we obtain some integral inequalities with the bounds characterizing exactly the totally geodesic hypersphere, the non IE minimal Clifford torus S 1 ( sqrt frac 1 n ) times S n 1 ( sqrt frac n 1 n ) and the IE minimal CSC hypersurfaces. Moreover, if further the third mean curvature is constant, then it is an IE hypersurface or an isoparametric hypersurface with g leq2 principal curvatures. In particular, all the minimal isoparametric hypersurfaces with g geq3 principal curvatures are IE hypersurfaces. As applications, we also obtain some spherical Bernstein theorems.


Kryptonite An Adversarial Attack Using Regional Focus. With the Rise of Adversarial Machine Learning and increasingly robust adversarial attacks, the security of applications utilizing the power of Machine Learning has been questioned. Over the past few years, applications of Deep Learning using Deep Neural Networks(DNN) in several fields including Medical Diagnosis, Security Systems, Virtual Assistants, etc. have become extremely commonplace, and hence become more exposed and susceptible to attack. In this paper, we present a novel study analyzing the weaknesses in the security of deep learning systems. We propose 'Kryptonite', an adversarial attack on images. We explicitly extract the Region of Interest (RoI) for the images and use it to add imperceptible adversarial perturbations to images to fool the DNN. We test our attack on several DNN's and compare our results with state of the art adversarial attacks like Fast Gradient Sign Method (FGSM), DeepFool (DF), Momentum Iterative Fast Gradient Sign Method (MIFGSM), and Projected Gradient Descent (PGD). The results obtained by us cause a maximum drop in network accuracy while yielding minimum possible perturbation and in considerably less amount of time per sample. We thoroughly evaluate our attack against three adversarial defence techniques and the promising results showcase the efficacy of our attack.


Glasner property for unipotently generated group actions on tori. A theorem of Glasner from 1979 shows that if A subset mathbb T mathbb R mathbb Z is infinite then for each epsilon 0 there exists an integer n such that nA is epsilon dense and Berend Peres later showed that in fact one can take n to be of the form f(m) for any non constant f(x) in mathbb Z x . Alon and Peres provided a general framework for this problem that has been used by Kelly L e and Dong to show that the same property holds for various linear actions on mathbb T d . We complement the result of Kelly L e on the epsilon dense images of integer polynomial matrices in some subtorus of mathbb T d by classifying those integer polynomial matrices that have the Glasner property in the full torus mathbb T d . We also extend a recent result of Dong by showing that if Gamma leq operatorname SL d( mathbb Z ) is generated by finitely many unipotents and acts irreducibly on mathbb R d then the action Gamma curvearrowright mathbb T d has a uniform Glasner property.


On a class of generalized Fermat equations of signature (2,2n,3) . We consider the Diophantine equation 7x 2 y 2n 4z 3 . We determine all solutions to this equation for n 2, 3, 4 and 5 . We formulate a Kraus type criterion for showing that the Diophantine equation 7x 2 y 2p 4z 3 has no non trivial proper integer solutions for specific primes p 7 . We computationally verify the criterion for all primes 7 p 10 9 , p neq 13 . We use the symplectic method and quadratic reciprocity to show that the Diophantine equation 7x 2 y 2p 4z 3 has no non trivial proper solutions for a positive proportion of primes p . In the paper cite ChDS we consider the Diophantine equation x 2 7y 2n 4z 3 , determining all families of solutions for n 2 and 3 , as well as giving a (mostly) conjectural description of the solutions for n 4 and primes n geq 5 .