EXplainable Neural Symbolic Learning (X NeSyL) methodology to fuse deep learning representations with expert knowledge graphs the MonuMAI cultural heritage use case. The latest Deep Learning (DL) models for detection and classification have achieved an unprecedented performance over classical machine learning algorithms. However, DL models are black box methods hard to debug, interpret, and certify. DL alone cannot provide explanations that can be validated by a non technical audience. In contrast, symbolic AI systems that convert concepts into rules or symbols such as knowledge graphs are easier to explain. However, they present lower generalisation and scaling capabilities. A very important challenge is to fuse DL representations with expert knowledge. One way to address this challenge, as well as the performance explainability trade off is by leveraging the best of both streams without obviating domain expert knowledge. We tackle such problem by considering the symbolic knowledge is expressed in form of a domain expert knowledge graph. We present the eXplainable Neural symbolic learning (X NeSyL) methodology, designed to learn both symbolic and deep representations, together with an explainability metric to assess the level of alignment of machine and human expert explanations. The ultimate objective is to fuse DL representations with expert domain knowledge during the learning process to serve as a sound basis for explainability. X NeSyL methodology involves the concrete use of two notions of explanation at inference and training time respectively 1) EXPLANet Expert aligned eXplainable Part based cLAssifier NETwork Architecture, a compositional CNN that makes use of symbolic representations, and 2) SHAP Backprop, an explainable AI informed training procedure that guides the DL process to align with such symbolic representations in form of knowledge graphs. We showcase X NeSyL methodology using MonuMAI dataset for monument facade image classification, and demonstrate that our approach improves explainability and performance.


On the fluctuations of Internal DLA on the Sierpinski gasket graph. Internal diffusion limited aggregation (IDLA) is a random aggregation model on a graph G , whose clusters are formed by random walks started in the origin (some fixed vertex) and stopped upon visiting a previously unvisited site. On the Sierpinski gasket graph the asymptotic shape is known to be a ball in the usual graph metric. In this paper we establish bounds for the fluctuations of the cluster from its asymptotic shape.


Graph Aided Online Multi Kernel Learning. Multi kernel learning (MKL) has been widely used in function approximation tasks. The key problem of MKL is to combine kernels in a prescribed dictionary. Inclusion of irrelevant kernels in the dictionary can deteriorate accuracy of MKL, and increase the computational complexity. To improve the accuracy of function approximation and reduce the computational complexity, the present paper studies data driven selection of kernels from the dictionary that provide satisfactory function approximations. Specifically, based on the similarities among kernels, the novel framework constructs and refines a graph to assist choosing a subset of kernels. In addition, random feature approximation is utilized to enable online implementation for sequentially obtained data. Theoretical analysis shows that our proposed algorithms enjoy tighter sub linear regret bound compared with state of art graph based online MKL alternatives. Experiments on a number of real datasets also showcase the advantages of our novel graph aided framework.


On the local constancy of certain mod p Galois representations. In this article we study local constancy of the mod p reduction of certain 2 dimensional crystalline representations of mathrm Gal left( bar mathbb Q p mathbb Q p right) using the mod p local Langlands correspondence. We prove local constancy in the weight space by giving an explicit lower bound on the local constancy radius centered around weights going up to (p 1) 2 3 and the slope fixed in (0, p 1) satisfying certain constraints. We establish the lower bound by determining explicitly the mod p reductions at nearby weights and applying a local constancy result of Berger.


Focus Attention Promoting Faithfulness and Diversity in Summarization. Professional summaries are written with document level information, such as the theme of the document, in mind. This is in contrast with most seq2seq decoders which simultaneously learn to focus on salient content, while deciding what to generate, at each decoding step. With the motivation to narrow this gap, we introduce Focus Attention Mechanism, a simple yet effective method to encourage decoders to proactively generate tokens that are similar or topical to the input document. Further, we propose a Focus Sampling method to enable generation of diverse summaries, an area currently understudied in summarization. When evaluated on the BBC extreme summarization task, two state of the art models augmented with Focus Attention generate summaries that are closer to the target and more faithful to their input documents, outperforming their vanilla counterparts on rouge and multiple faithfulness measures. We also empirically demonstrate that Focus Sampling is more effective in generating diverse and faithful summaries than top k or nucleus sampling based decoding methods.


On the Unreasonable Effectiveness of Feature propagation in Learning on Graphs with Missing Node Features. While Graph Neural Networks (GNNs) have recently become the de facto standard for modeling relational data, they impose a strong assumption on the availability of the node or edge features of the graph. In many real world applications, however, features are only partially available for example, in social networks, age and gender are available only for a small subset of users. We present a general approach for handling missing features in graph machine learning applications that is based on minimization of the Dirichlet energy and leads to a diffusion type differential equation on the graph. The discretization of this equation produces a simple, fast and scalable algorithm which we call Feature Propagation. We experimentally show that the proposed approach outperforms previous methods on seven common node classification benchmarks and can withstand surprisingly high rates of missing features on average we observe only around 4 relative accuracy drop when 99 of the features are missing. Moreover, it takes only 10 seconds to run on a graph with sim 2.5M nodes and sim 123M edges on a single GPU.


SAU Smooth activation function using convolution with approximate identities. Well known activation functions like ReLU or Leaky ReLU are non differentiable at the origin. Over the years, many smooth approximations of ReLU have been proposed using various smoothing techniques. We propose new smooth approximations of a non differentiable activation function by convolving it with approximate identities. In particular, we present smooth approximations of Leaky ReLU and show that they outperform several well known activation functions in various datasets and models. We call this function Smooth Activation Unit (SAU). Replacing ReLU by SAU, we get 5.12 improvement with ShuffleNet V2 (2.0x) model on CIFAR100 dataset.


IceClave A Trusted Execution Environment for In Storage Computing. In storage computing with modern solid state drives (SSDs) enables developers to offload programs from the host to the SSD. It has been proven to be an effective approach to alleviate the I O bottleneck. To facilitate in storage computing, many frameworks have been proposed. However, few of them treat the in storage security as the first citizen. Specifically, since modern SSD controllers do not have a trusted execution environment, an offloaded (malicious) program could steal, modify, and even destroy the data stored in the SSD. In this paper, we first investigate the attacks that could be conducted by offloaded in storage programs. To defend against these attacks, we build a lightweight trusted execution environment, named IceClave for in storage computing. IceClave enables security isolation between in storage programs and flash management functions that include flash address translation, data access control, and garbage collection, with TrustZone extensions. IceClave also achieves security isolation between in storage programs by enforcing memory integrity verification of in storage DRAM with low overhead. To protect data loaded from flash chips, IceClave develops a lightweight data encryption decryption mechanism in flash controllers. We develop IceClave with a full system simulator. We evaluate IceClave with a variety of data intensive applications such as databases. Compared to state of the art in storage computing approaches, IceClave introduces only 7.6 performance overhead, while enforcing security isolation in the SSD controller with minimal hardware cost. IceClave still keeps the performance benefit of in storage computing by delivering up to 2.31 times better performance than the conventional host based trusted computing approach.


Planes in mathbb Z 4 and Eisenstein series. We study the number of two dimensional sublattices of mathbb Z 4 of a fixed covolume and construct the associated Dirichlet series. The latter is shown to be related to Eisenstein series on both GL 4 and its metaplectic double cover.


Discovering Representation Sprachbund For Multilingual Pre Training. Multilingual pre trained models have demonstrated their effectiveness in many multilingual NLP tasks and enabled zero shot or few shot transfer from high resource languages to low resource ones. However, due to significant typological differences and contradictions between some languages, such models usually perform poorly on many languages and cross lingual settings, which shows the difficulty of learning a single model to handle massive diverse languages well at the same time. To alleviate this issue, we present a new multilingual pre training pipeline. We propose to generate language representation from multilingual pre trained models and conduct linguistic analysis to show that language representation similarity reflect linguistic similarity from multiple perspectives, including language family, geographical sprachbund, lexicostatistics and syntax. Then we cluster all the target languages into multiple groups and name each group as a representation sprachbund. Thus, languages in the same representation sprachbund are supposed to boost each other in both pre training and fine tuning as they share rich linguistic similarity. We pre train one multilingual model for each representation sprachbund. Experiments are conducted on cross lingual benchmarks and significant improvements are achieved compared to strong baselines.


HiddenCut Simple Data Augmentation for Natural Language Understanding with Better Generalization. Fine tuning large pre trained models with task specific data has achieved great success in NLP. However, it has been demonstrated that the majority of information within the self attention networks is redundant and not utilized effectively during the fine tuning stage. This leads to inferior results when generalizing the obtained models to out of domain distributions. To this end, we propose a simple yet effective data augmentation technique, HiddenCut, to better regularize the model and encourage it to learn more generalizable features. Specifically, contiguous spans within the hidden space are dynamically and strategically dropped during training. Experiments show that our HiddenCut method outperforms the state of the art augmentation methods on the GLUE benchmark, and consistently exhibits superior generalization performances on out of distribution and challenging counterexamples. We have publicly released our code at https github.com GT SALT HiddenCut.


Wave function for GL(n, mathbb R ) hyperbolic Sutherland model II. Dual Hamiltonians. Recently we found Mellin Barnes integrals, representing the wave function for GL(n, mathbb R ) hyperbolic Sutherland model. In present paper, we establish bispectral properties of this wave function with respect to dual Ruijesenaars Macdonald operators.


XLM T A Multilingual Language Model Toolkit for Twitter. Language models are ubiquitous in current NLP, and their multilingual capacity has recently attracted considerable attention. However, current analyses have almost exclusively focused on (multilingual variants of) standard benchmarks, and have relied on clean pre training and task specific corpora as multilingual signals. In this paper, we introduce XLM T, a framework for using and evaluating multilingual language models in Twitter. This framework features two main assets (1) a strong multilingual baseline consisting of an XLM R (Conneau et al. 2020) model pre trained on millions of tweets in over thirty languages, alongside starter code to subsequently fine tune on a target task and (2) a set of unified sentiment analysis Twitter datasets in eight different languages. This is a modular framework that can easily be extended to additional tasks, as well as integrated with recent efforts also aimed at the homogenization of Twitter specific datasets (Barbieri et al. 2020).


Fourier modal method for Moir 'e lattices. In recent years twisted bi layers of 2D materials became very popular in the field due to the possibility to totally change their electronic properties by simple rotation. At the same time, in the wide field of photonic crystals, this idea still remains almost untouched, and only some particular problems were considered. One of the reasons is the computational difficulty of the accurate consideration of Moir 'e superlattices that appear due to the superimposition of misaligned lattices. Indeed, the unit cell of the complex lattice is typically much larger than the original crystals and requires much more computational resources for the computations. Here, we propose a careful adaptation of the Fourier modal method in the form of the scattering matrices for the description of twisted 1D gratings' stacks. Our approach allows us to consider sublattices in close vicinity to each other and account for their interaction via the near field. In the developed numerical scheme, we utilize the fact that each sublattice is only 1D periodic and therefore simpler than the resulting 2D superlattice, as well as the fact that even a small gap between the lattices filters out high Fourier harmonics due to their evanescent origin. This accelerates the computations from 1 up to 3 and more orders of magnitude for typical structures depending on the number of harmonics. This paves the way for rigorous study of almost any photonic crystals of the proposed geometry and demonstration of specific Moir 'e associated effects.


Reversed Strichartz estimates for wave on non trapping asymptotically hyperbolic manifolds and applications. We provide reversed Strichartz estimates for the shifted wave equations on non trapping asymptotically hyperbolic manifolds using cluster estimates for spectral projectors proved previously in such generality. As a consequence, we solve a problem left open in cite SSWZ about the endpoint case for global well posedness of nonlinear wave equations. We also provide estimates in this context for the maximal wave operator.


Smooth Symbolic Regression Transformation of Symbolic Regression into a Real valued Optimization Problem. The typical methods for symbolic regression produce rather abrupt changes in solution candidates. In this work, we have tried to transform symbolic regression from an optimization problem, with a landscape that is so rugged that typical analysis methods do not produce meaningful results, to one that can be compared to typical and very smooth real valued problems. While the ruggedness might not interfere with the performance of optimization, it restricts the possibilities of analysis. Here, we have explored different aspects of a transformation and propose a simple procedure to create real valued optimization problems from symbolic regression problems.


Real time, low cost multi person 3D pose estimation. The process of tracking human anatomy in computer vision is referred to pose estimation, and it is used in fields ranging from gaming to surveillance. Three dimensional pose estimation traditionally requires advanced equipment, such as multiple linked intensity cameras or high resolution time of flight cameras to produce depth images. However, there are applications, e.g. consumer electronics, where significant constraints are placed on the size, power consumption, weight and cost of the usable technology. Here, we demonstrate that computational imaging methods can achieve accurate pose estimation and overcome the apparent limitations of time of flight sensors designed for much simpler tasks. The sensor we use is already widely integrated in consumer grade mobile devices, and despite its low spatial resolution, only 4 times 4 pixels, our proposed Pixels2Pose system transforms its data into accurate depth maps and 3D pose data of multiple people up to a distance of 3 m from the sensor. We are able to generate depth maps at a resolution of 32 times 32 and 3D localization of a body parts with an error of only approx 10 cm at a frame rate of 7 fps. This work opens up promising real life applications in scenarios that were previously restricted by the advanced hardware requirements and cost of time of flight technology.


Conormal homology of manifolds with corners. Given a manifold with corners X , we associates to it the corner structure simplicial complex Sigma X . Its reduced K homology is isomorphic to the K theory of the C algebra mathcal K b(X) of b compact operators on X . Moreover, the homology of Sigma X is isomorphic to the conormal homology of X . In this note, we constract for an arbitrary abstract finite simplicial complex Sigma a manifold with corners X such that Sigma X cong Sigma . As a consequence, the homology and K homology which occur for finite simplicial complexes also occur as conormal homology of manifolds with corners and as K theory of their b compact operators. In particular, these groups can contain torsion.


Molecular spectra calculations using an optimized quasi regular Gaussian basis and the collocation method. We revisit the collocation method of Manzhos and Carrington (J. Chem. Phys. 145, 224110, 2016) in which a distributed localized (e.g., Gaussian) basis is used to set up a generalized eigenvalue problem to compute the eigenenergies and eigenfunctions of a molecular vibrational Hamiltonian. Although the resulting linear algebra problem involves full matrices, the method provides a number of important advantages. Namely (i) it is very simple both conceptually and numerically, (ii) it can be formulated using any set of internal molecular coordinates, (iii) it is flexible with respect to the choice of the basis, and (iv) it has the potential to significantly reduce the basis size through optimizing the placement and the shapes of the basis functions. In the present paper we explore the latter aspect of the method using the recently introduced, and here further improved, quasi regular grids (QRGs). By computing the eigenenergies of the four atom molecule of formaldehyde, we demonstrate that a QRG based distributed Gaussian basis is superior to the previously used choices.


Transformed CNNs recasting pre trained convolutional layers with self attention. Vision Transformers (ViT) have recently emerged as a powerful alternative to convolutional networks (CNNs). Although hybrid models attempt to bridge the gap between these two architectures, the self attention layers they rely on induce a strong computational bottleneck, especially at large spatial resolutions. In this work, we explore the idea of reducing the time spent training these layers by initializing them as convolutional layers. This enables us to transition smoothly from any pre trained CNN to its functionally identical hybrid model, called Transformed CNN (T CNN). With only 50 epochs of fine tuning, the resulting T CNNs demonstrate significant performance gains over the CNN ( 2.2 top 1 on ImageNet 1k for a ResNet50 RS) as well as substantially improved robustness ( 11 top 1 on ImageNet C). We analyze the representations learnt by the T CNN, providing deeper insights into the fruitful interplay between convolutions and self attention. Finally, we experiment initializing the T CNN from a partially trained CNN, and find that it reaches better performance than the corresponding hybrid model trained from scratch, while reducing training time.


Arboreal Categories An Axiomatic Theory of Resources. We introduce arboreal categories, which have an intrinsic process structure, allowing dynamic notions such as bisimulation and back and forth games, and resource notions such as number of rounds of a game, to be defined. These are related to extensional or "static" structures via arboreal covers, which are resource indexed comonadic adjunctions. These ideas are developed in a very general, axiomatic setting, and applied to relational structures, where the recently introduced comonadic constructions for pebbling, Ehrenfeucht Fra "iss 'e and modal bisimulation games are recovered, showing that many of the fundamental notions of finite model theory and descriptive complexity arise from instances of arboreal covers.


An Epimorphism between Fine and Ferguson's Matrices for Angell's AC. Angell's logic of analytic containment AC has been shown to be characterized by a 9 valued matrix NC by Ferguson, and by a 16 valued matrix by Fine. We show that the former is the image of a surjective homomorphism from the latter, i.e., an epimorphic image. The epimorphism was found with the help of MUltlog, which also provides a tableau calculus for NC extended by quantifiers that generalize conjunction and disjunction.


Motif Prediction with Graph Neural Networks. Link prediction is one of the central problems in graph mining. However, recent studies highlight the importance of higher order network analysis, where complex structures called motifs are the first class citizens. We first show that existing link prediction schemes fail to effectively predict motifs. To alleviate this, we establish a general motif prediction problem and we propose several heuristics that assess the chances for a specified motif to appear. To make the scores realistic, our heuristics consider among others correlations between links, i.e., the potential impact of some arriving links on the appearance of other links in a given motif. Finally, for highest accuracy, we develop a graph neural network (GNN) architecture for motif prediction. Our architecture offers vertex features and sampling schemes that capture the rich structural properties of motifs. While our heuristics are fast and do not need any training, GNNs ensure highest accuracy of predicting motifs, both for dense (e.g., k cliques) and for sparse ones (e.g., k stars). We consistently outperform the best available competitor by more than 10 on average and up to 32 in area under the curve. Importantly, the advantages of our approach over schemes based on uncorrelated link prediction increase with the increasing motif size and complexity. We also successfully apply our architecture for predicting more arbitrary clusters and communities, illustrating its potential for graph mining beyond motif analysis.


Convolutional neural network based on transfer learning for breast cancer screening. Breast cancer is the most common cancer in the world and the most prevalent cause of death among women worldwide. Nevertheless, it is also one of the most treatable malignancies if detected early. In this paper, a deep convolutional neural network based algorithm is proposed to aid in accurately identifying breast cancer from ultrasonic images. In this algorithm, several neural networks are fused in a parallel architecture to perform the classification process and the voting criteria are applied in the final classification decision between the candidate object classes where the output of each neural network is representing a single vote. Several experiments were conducted on the breast ultrasound dataset consisting of 537 Benign, 360 malignant, and 133 normal images. These experiments show an optimistic result and a capability of the proposed model to outperform many state of the art algorithms on several measures. Using k fold cross validation and a bagging classifier ensemble, we achieved an accuracy of 99.5 and a sensitivity of 99.6 .


In the light of feature distributions moment matching for Neural Style Transfer. Style transfer aims to render the content of a given image in the graphical artistic style of another image. The fundamental concept underlying NeuralStyle Transfer (NST) is to interpret style as a distribution in the feature space of a Convolutional Neural Network, such that a desired style can be achieved by matching its feature distribution. We show that most current implementations of that concept have important theoretical and practical limitations, as they only partially align the feature distributions. We propose a novel approach that matches the distributions more precisely, thus reproducing the desired style more faithfully, while still being computationally efficient. Specifically, we adapt the dual form of Central Moment Discrepancy (CMD), as recently proposed for domain adaptation, to minimize the difference between the target style and the feature distribution of the output image. The dual interpretation of this metric explicitly matches all higher order centralized moments and is therefore a natural extension of existing NST methods that only take into account the first and second moments. Our experiments confirm that the strong theoretical properties also translate to visually better style transfer, and better disentangle style from semantic image content.


On 7 division fields of CM elliptic curves. Let mathcal E be a CM elliptic curve defined over a number field K , with Weiestrass form y 3 x 3 bx or y 2 x 3 c . For every positive integer m , we denote by mathcal E m the m torsion subgroup of mathcal E and by K m K( mathcal E m ) the m th division field, i.e. the extension of K generated by the coordinates of the points in mathcal E m . We classify all fields K 7 . In particular we give explicit generators for K 7 K and produce all Galois groups textrm Gal (K 7 K) . We also show some applications to the Local Global Divisibility Problem and to modular curves.


MixSeq Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data. Time series forecasting is widely used in business intelligence, e.g., forecast stock market price, sales, and help the analysis of data trend. Most time series of interest are macroscopic time series that are aggregated from microscopic data. However, instead of directly modeling the macroscopic time series, rare literature studied the forecasting of macroscopic time series by leveraging data on the microscopic level. In this paper, we assume that the microscopic time series follow some unknown mixture probabilistic distributions. We theoretically show that as we identify the ground truth latent mixture components, the estimation of time series from each component could be improved because of lower variance, thus benefitting the estimation of macroscopic time series as well. Inspired by the power of Seq2seq and its variants on the modeling of time series data, we propose Mixture of Seq2seq (MixSeq), an end2end mixture model to cluster microscopic time series, where all the components come from a family of Seq2seq models parameterized by different parameters. Extensive experiments on both synthetic and real world data show the superiority of our approach.


Safe Multi Agent Reinforcement Learning through Decentralized Multiple Control Barrier Functions. Multi Agent Reinforcement Learning (MARL) algorithms show amazing performance in simulation in recent years, but placing MARL in real world applications may suffer safety problems. MARL with centralized shields was proposed and verified in safety games recently. However, centralized shielding approaches can be infeasible in several real world multi agent applications that involve non cooperative agents or communication delay. Thus, we propose to combine MARL with decentralized Control Barrier Function (CBF) shields based on available local information. We establish a safe MARL framework with decentralized multiple CBFs and develop Multi Agent Deep Deterministic Policy Gradient (MADDPG) to Multi Agent Deep Deterministic Policy Gradient with decentralized multiple Control Barrier Functions (MADDPG CBF). Based on a collision avoidance problem that includes not only cooperative agents but obstacles, we demonstrate the construction of multiple CBFs with safety guarantees in theory. Experiments are conducted and experiment results verify that the proposed safe MARL framework can guarantee the safety of agents included in MARL.


Deformations of varieties of general type. We prove that small deformations of a projective variety of general type are also projective varieties of general type, with the same plurigenera. Version 2 small changes in first half. Improved version of the second half is now a separate preprint (Seshadri's criterion and openness of projectivity). Version 3 Footnote corrects citation on p.4.


Equation of the Aftershocks and its Phase Portrait. Recently, simple differential models of aftershocks have attracted increased attention of researchers at the Institute of Physics of the Earth, Russian Academy of Sciences for their remarkable properties. The shortened Bernoulli equation allows us to introduce the concept of the source deactivation factor and phenomenologically describe the nonstationarity of the geological environment in the earthquake source, "cooling down" after the main shock. The Verhulst logistic equation makes it possible to take into account the transition of the aftershock flow to the background seismicity mode. The Kolmogorov Petrovsky Piskunov nonlinear diffusion equation is convenient for modeling the spatio temporal evolution of aftershocks. This paper focuses on the phase portrait of a dynamical system that simulates the evolution of aftershocks. The phase portrait allows us to understand why the Omori hyperbolic law is most clearly manifested after strong earthquakes. It is noted that the Omori epoch, during which the deactivation coefficient is constant, does not immediately end with a transition to the background mode. In the experience after the end of the Omori epoch, the deactivation coefficient changes over time in a rather complex way, and can even becomes negative. The theory predicts that if negative values of the coefficient are held long enough, then a geotectonic explosion occurs, vaguely resembling the main shock of earthquake. The paper discusses possible directions for the further development of the theory. Keywords earthquake, aftershock, deactivation factor, Omori epoch, logistic equation, explosive instability, Bath law.


Spectral singularities and threshold gain of a slab laser under illumination of a focused Gaussian beam. We study spectral singularities of an infinite planar slab of homogeneous optically active material in focus of a thin lens under illumination of a Gaussian beam. We describe the field distribution of the Gaussian beam under this configuration as a plane wave propagated near the optical axis which its phase and amplitude vary with distance from center of the beam. Based on this approximation, we carry out the transfer matrix for the slab. We explore the consequences of this configuration on determining the threshold gain of the active medium and tuning the resonance frequencies related to spectral singularities. We show that the spectral singularities and the threshold gain besides that vary with distance from center of the Gaussian beam, also they change with relative aperture of the focusing lens. As a result, using a thin lens with higher relative aperture, the spectral singularities corresponding resonances shift to the higher frequencies (lower wavelengths). Numerical results confirm the theoretical findings


The Exact Rate Memory Tradeoff for Large Caches with Coded Placement. The idea of coded caching for content distribution networks was introduced by Maddah Ali and Niesen, who considered the canonical (N, K) cache network in which a server with N files satisfy the demands of K users (equipped with independent caches of size M each). Among other results, their work provided a characterization of the exact rate memory tradeoff for the problem when M geq frac N K (K 1) . In this paper, we improve this result for large caches with M geq frac N K (K 2) . For the case big lceil frac K 1 2 big rceil leq N leq K , we propose a new coded caching scheme, and derive a matching lower bound to show that the proposed scheme is optimal. This extends the characterization of the exact rate memory tradeoff to the case M geq frac N K Big(K 2 frac (K 2 1 N) (K 1) Big) . For the case 1 leq N leq big lceil frac K 1 2 big rceil , we derive a new lower bound, which demonstrates that the scheme proposed by Yu et al. is optimal and thus extend the characterization of the exact rate memory tradeoff to the case M geq frac N K (K 2) .


Revelation Gap for Pricing from Samples. This paper considers prior independent mechanism design, in which a single mechanism is designed to achieve approximately optimal performance on every prior distribution from a given class. Most results in this literature focus on mechanisms with truthtelling equilibria, a.k.a., truthful mechanisms. Feng and Hartline (2018) introduce the revelation gap to quantify the loss of the restriction to truthful mechanisms. We solve a main open question left in Feng and Hartline (2018) namely, we identify a non trivial revelation gap for revenue maximization. Our analysis focuses on the canonical problem of selling a single item to a single agent with only access to a single sample from the agent's valuation distribution. We identify the sample bid mechanism (a simple non truthful mechanism) and upper bound its prior independent approximation ratio by 1.835 (resp. 1.296) for regular (resp. MHR) distributions. We further prove that no truthful mechanism can achieve prior independent approximation ratio better than 1.957 (resp. 1.543) for regular (resp. MHR) distributions. Thus, a non trivial revelation gap is shown as the sample bid mechanism outperforms the optimal prior independent truthful mechanism. On the hardness side, we prove that no (possibly non truthful) mechanism can achieve prior independent approximation ratio better than 1.073 even for uniform distributions.


Robust Online Algorithms for Dynamic Choosing Problems. Semi online algorithms that are allowed to perform a bounded amount of repacking achieve guaranteed good worst case behaviour in a more realistic setting. Most of the previous works focused on minimization problems that aim to minimize some costs. In this work, we study maximization problems that aim to maximize their profit. We mostly focus on a class of problems that we call choosing problems, where a maximum profit subset of a set objects has to be maintained. Many known problems, such as Knapsack, MaximumIndependentSet and variations of these, are part of this class. We present a framework for choosing problems that allows us to transfer offline alpha approximation algorithms into ( alpha epsilon) competitive semi online algorithms with amortized migration O(1 epsilon) . Moreover we complement these positive results with lower bounds that show that our results are tight in the sense that no amortized migration of o(1 epsilon) is possible.


Bayesian Agency Linear versus Tractable Contracts. We study principal agent problems in which a principal commits to an outcome dependent payment scheme (a.k.a. contract) so as to induce an agent to take a costly, unobservable action. We relax the assumption that the principal perfectly knows the agent by considering a Bayesian setting where the agent's type is unknown and randomly selected according to a given probability distribution, which is known to the principal. Each agent's type is characterized by her own action costs and action outcome distributions. In the literature on non Bayesian principal agent problems, considerable attention has been devoted to linear contracts, which are simple, pure commission payment schemes that still provide nice approximation guarantees with respect to principal optimal (possibly non linear) contracts. While in non Bayesian settings an optimal contract can be computed efficiently, this is no longer the case for our Bayesian principal agent problems. This further motivates our focus on linear contracts, which can be optimized efficiently given their single parameter nature. Our goal is to analyze the properties of linear contracts in Bayesian settings, in terms of approximation guarantees with respect to optimal contracts and general tractable contracts (i.e., efficiently computable ones). First, we study the approximation guarantees of linear contracts with respect to optimal ones, showing that the former suffer from a multiplicative loss linear in the number of agent's types. Nevertheless, we prove that linear contracts can still provide a constant multiplicative approximation rho of the optimal principal's expected utility, though at the expense of an exponentially small additive loss 2 Omega( rho) . Then, we switch to tractable contracts, showing that, surprisingly, linear contracts perform well among them.


Zero shot Learning with Class Description Regularization. The purpose of generative Zero shot learning (ZSL) is to learning from seen classes, transfer the learned knowledge, and create samples of unseen classes from the description of these unseen categories. To achieve better ZSL accuracies, models need to better understand the descriptions of unseen classes. We introduce a novel form of regularization that encourages generative ZSL models to pay more attention to the description of each category. Our empirical results demonstrate improvements over the performance of multiple state of the art models on the task of generalized zero shot recognition and classification when trained on textual description based datasets like CUB and NABirds and attribute based datasets like AWA2, aPY and SUN.


A Cayley Bacharach theorem and plane configurations. In this paper, we examine linear conditions on finite sets of points in projective space implied by the Cayley Bacharach condition. In particular, by bounding the number of points satisfying the Cayley Bacharach condition, we force them to lie on unions of low dimensional linear spaces. These results are motivated by investigations into degrees of irrationality of complete intersections, which are controlled by minimum degree rational maps to projective space. As an application of our main theorem, we describe the fibers of such maps for certain complete intersections of codimension two.


Potential theory with multivariate kernels. In the present paper we develop the theory of minimization for energies with multivariate kernels, i.e. energies, in which pairwise interactions are replaced by interactions between triples or, more generally, n tuples of particles. Such objects, which arise naturally in various fields, present subtle differences and complications when compared to the classical two input case. We introduce appropriate analogues of conditionally positive definite kernels, establish a series of relevant results in potential theory, explore rotationally invariant energies on the sphere, and present a variety of interesting examples, in particular, some optimization problems in probabilistic geometry which are related to multivariate versions of the Riesz energies.


Dynamic Katz and Related Network Measures. We study walk based centrality measures for time ordered network sequences. For the case of standard dynamic walk counting, we show how to derive and compute centrality measures induced by analytic functions. We also prove that dynamic Katz centrality, based on the resolvent function, has the unique advantage of allowing computations to be performed entirely at the node level. We then consider two distinct types of backtracking and develop a framework for capturing dynamic walk combinatorics when either or both is disallowed.


DyNetKAT An Algebra of Dynamic Networks. We introduce a formal language for specifying dynamic updates for Software Defined Networks. Our language builds upon Network Kleene Algebra with Tests (NetKAT) and adds constructs for synchronisations and multi packet behaviour to capture the interaction between the control and data plane in dynamic updates. We provide a sound and ground complete axiomatisation of our language. We exploit the equational theory to provide an efficient reasoning method about safety properties for dynamic networks. We implement our equational theory in DyNetiKAT a tool prototype, based on the Maude Rewriting Logic and the NetKAT tool, and apply it to a case study. We show that we can analyse the case study for networks with hundreds of switches using our initial tool prototype.


Orbit equivalence rigidity of irreducible actions of right angled Artin groups. Let G Gamma curvearrowright X and G Lambda curvearrowright Y be two free measure preserving actions of one ended centerless right angled Artin groups on standard probability spaces. Assume they are irreducible, i.e. every element from a standard generating set acts ergodically. We prove that if the two actions are stably orbit equivalent (or merely stably W equivalent), then they are automatically conjugate through a group isomorphism between G Gamma and G Lambda . Through work of Monod and Shalom, we derive a superrigidity statement if the action G Gamma curvearrowright X is stably orbit equivalent (or merely stably W equivalent) to a free, measure preserving, mildly mixing action of a countable group, then the two actions are virtually conjugate. In an appendix written jointly with Adrian Ioana, we use works of Popa and Ioana Popa Vaes to establish the W superrigidity of Bernoulli actions of all ICC groups having a finite generating set made of infinite order elements where two consecutive elements commute, and one has a nonamenable centralizer these include one ended non abelian right angled Artin groups, but also many other Artin groups and most mapping class groups of finite type surfaces.


Asymptotic analysis of a biphase tumor fluid flow. The weak coupling case. The aim of this paper is to investigate the asymptotic behavior of a biphase tumor fluid flow derived by 2 scale homogenisation techniques in recent works. This biphase fluid flow model accounts for the capillary wall permeability, and the interstitial avascular phase, both being mixed in the limit homogenised problem. When the vessel walls become more permeable, we show that the biphase fluid flow exhibits a boundary layer that makes the computation of the full problem costly and unstable. In the limit, both capillary and interstitial pressures coincide except in the vicinity of the boundary where different boundary conditions are applied. Thanks to a rigorous asymptotic analysis, we prove that the solution to the full problem can be approached at any order of approximation by a monophasic model with appropriate boundary conditions on the tumor boundary and appropriate correcting terms near the boundary are given. Numerical simulations in spherical geometry illustrate the theoretical results.


A Query Driven System for Discovering Interesting Subgraphs in Social Media. Social media data are often modeled as heterogeneous graphs with multiple types of nodes and edges. We present a discovery algorithm that first chooses a "background" graph based on a user's analytical interest and then automatically discovers subgraphs that are structurally and content wise distinctly different from the background graph. The technique combines the notion of a texttt group by operation on a graph and the notion of subjective interestingness, resulting in an automated discovery of interesting subgraphs. Our experiments on a socio political database show the effectiveness of our technique.


Interplay between risk perception, behaviour, and COVID 19 spread. Pharmaceutical and non pharmaceutical interventions (NPIs) have been crucial for controlling COVID 19. They are complemented by voluntary health protective behaviour, building a complex interplay between risk perception, behaviour, and disease spread. We studied how voluntary health protective behaviour and vaccination willingness impact the long term dynamics. We analysed how different levels of mandatory NPIs determine how individuals use their leeway for voluntary actions. If mandatory NPIs are too weak, COVID 19 incidence will surge, implying high morbidity and mortality before individuals react if they are too strong, one expects a rebound wave once restrictions are lifted, challenging the transition to endemicity. Conversely, moderate mandatory NPIs give individuals time and room to adapt their level of caution, mitigating disease spread effectively. When complemented with high vaccination rates, this also offers a robust way to limit the impacts of the Omicron variant of concern. Altogether, our work highlights the importance of appropriate mandatory NPIs to maximise the impact of individual voluntary actions in pandemic control.


Liouville's theorems to quasilinear differential inequalities involving gradient nonlinearity term on manifolds. We investigate the nonexistence and existence of nontrivial positive solutions to Delta m u u p nabla u q leq0 on noncompact geodesically complete Riemannian manifolds, where m 1 , and (p,q) in mathbb R 2 . According to classification of (p, q) , we establish different volume growth conditions to obtain Liouville's theorems for the above quasilinear differential inequalities, and we also show these volume growth conditions are sharp in most cases. Moreover, the results are completely new for (p, q) of negative pair, even in the Euclidean space.


Categorifications of rational Hilbert series and characters of FS op modules. We introduce a method for associating a chain complex to a module over a combinatorial category, such that if the complex is exact then the module has a rational Hilbert series. We prove homology vanishing theorems for these complexes for several combinatorial categories including the category of finite sets and injections, the opposite of the category of finite sets and surjections, and the category of finite dimensional vector spaces over a finite field and injections. Our main applications are to modules over the opposite of the category of finite sets and surjections, known as FS op modules. We obtain many constraints on the sequence of symmetric group representations underlying a finitely generated FS op module. In particular, we describe its character in terms of functions that we call character exponentials. Our results have new consequences for the character of the homology of the moduli space of stable marked curves, and for the equivariant Kazhdan Luzstig polynomial of the braid matroid.


Synthetic properties of locally compact groups preservation and transference. Using techniques from TRO equivalence of masa bimodules we prove various transference results We show that when alpha is a group homomorphism which pushes forward the Haar measure of G to a measure absolutely continuous with respect to the Haar measure on H , then ( alpha times alpha) 1 preserves sets of compact operator synthesis, and conversely when alpha is onto. We also prove similar preservation results for operator Ditkin sets and operator M sets, obtaining preservation results for M sets as corollaries. Some of these results extend or complement existing results of Ludwig, Shulman, Todorov and Turowska.


Learning Skill Equivalencies Across Platform Taxonomies. Assessment and reporting of skills is a central feature of many digital learning platforms. With students often using multiple platforms, cross platform assessment has emerged as a new challenge. While technologies such as Learning Tools Interoperability (LTI) have enabled communication between platforms, reconciling the different skill taxonomies they employ has not been solved at scale. In this paper, we introduce and evaluate a methodology for finding and linking equivalent skills between platforms by utilizing problem content as well as the platform's clickstream data. We propose six models to represent skills as continuous real valued vectors and leverage machine translation to map between skill spaces. The methods are tested on three digital learning platforms ASSISTments, Khan Academy, and Cognitive Tutor. Our results demonstrate reasonable accuracy in skill equivalency prediction from a fine grained taxonomy to a coarse grained one, achieving an average recall 5 of 0.8 between the three platforms. Our skill translation approach has implications for aiding in the tedious, manual process of taxonomy to taxonomy mapping work, also called crosswalks, within the tutoring as well as standardized testing worlds.


Active Learning with Pseudo Labels for Multi View 3D Pose Estimation. Pose estimation of the human body hand is a fundamental problem in computer vision, and learning based solutions require a large amount of annotated data. Given limited annotation budgets, a common approach to increasing label efficiency is Active Learning (AL), which selects examples with the highest value to annotate, but choosing the selection strategy is often nontrivial. In this work, we improve Active Learning for the problem of 3D pose estimation in a multi view setting, which is of increasing importance in many application scenarios. We develop a framework that allows us to efficiently extend existing single view AL strategies, and then propose two novel AL strategies that make full use of multi view geometry. Moreover, we demonstrate additional performance gains by incorporating predicted pseudo labels, which is a form of self training. Our system significantly outperforms baselines in 3D body and hand pose estimation on two large scale benchmarks CMU Panoptic Studio and InterHand2.6M. Notably, on CMU Panoptic Studio, we are able to match the performance of a fully supervised model using only 20 of labeled training data.


Finding Experts in Social Media Data using a Hybrid Approach. Several approaches to the problem of expert finding have emerged in computer science research. In this work, three of these approaches content analysis, social graph analysis and the use of Semantic Web technologies are examined. An integrated set of system requirements is then developed that uses all three approaches in one hybrid approach. To show the practicality of this hybrid approach, a usable prototype expert finding system called ExpertQuest is developed using a modern functional programming language (Clojure) to query social media data and Linked Data. This system is evaluated and discussed. Finally, a discussion and conclusions are presented which describe the benefits and shortcomings of the hybrid approach and the technologies used in this work.


Decentralizing Information Technology The Advent of Resource Based Systems. The growth of the Bitcoin network during the first decade of its operation to a global scale system is a singular event in the deployment of Information Technology systems. Can this approach serve as a wider paradigm for Information Technology services beyond the use case of digital currencies? We investigate this question by introducing the concept of resource based systems and their four fundamental characteristics (i) resource based operation, (ii) tokenomics, (iii) decentralized service provision, and (iv) rewards sharing. We explore these characteristics, identify design goals and challenges and investigate some crucial game theoretic aspects of reward sharing that can be decisive for their effective operation.


Non delay limit in the energy space from the nonlinear damped wave equation to the nonlinear heat equation. We consider a singular limit problem from the damped wave equation with a power type nonlinearity to the corresponding heat equation. We call our singular limit problem non delay limit. Our proofs are based on the argument for non relativistic limit from the nonlinear Klein Gordon equation to the nonlinear Schr " o dinger equation by the second author, Nakanishi, and Ozawa (2002), Nakanishi (2002), and Masmoudi and Nakanishi (2002). We can obtain better results for the non delay limit problem than that for the non relativistic limit problem due to the dissipation property. More precisely, we get the better convergence rate of the L 2 norm and we also obtain the global in time uniform convergence of the non delay limit in the L 2 supercritical case.


Graph Transformer Networks Learning Meta path Graphs to Improve GNNs. Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed and homogeneous graphs. The limitations especially become problematic when learning representations on a misspecified graph or a heterogeneous graph that consists of various types of nodes and edges. To address this limitations, we propose Graph Transformer Networks (GTNs) that are capable of generating new graph structures, which preclude noisy connections and include useful connections (e.g., meta paths) for tasks, while learning effective node representations on the new graphs in an end to end fashion. We further propose enhanced version of GTNs, Fast Graph Transformer Networks (FastGTNs), that improve scalability of graph transformations. Compared to GTNs, FastGTNs are 230x faster and use 100x less memory while allowing the identical graph transformations as GTNs. In addition, we extend graph transformations to the semantic proximity of nodes allowing non local operations beyond meta paths. Extensive experiments on both homogeneous graphs and heterogeneous graphs show that GTNs and FastGTNs with non local operations achieve the state of the art performance for node classification tasks. The code is available https github.com seongjunyun Graph Transformer Networks


Motion Based Handwriting Recognition and Word Reconstruction. In this project, we leverage a trained single letter classifier to predict the written word from a continuously written word sequence, by designing a word reconstruction pipeline consisting of a dynamic programming algorithm and an auto correction model. We conduct experiments to optimize models in this pipeline, then employ domain adaptation to explore using this pipeline on unseen data distributions.


On the topology of the transversal slice of a quasi homogeneous map germ. We consider a corank 1 , finitely determined, quasi homogeneous map germ f from ( mathbb C 2,0) to ( mathbb C 3,0) . We describe the embedded topological type of a generic hyperplane section of f( mathbb C 2) , denoted by gamma f , in terms of the weights and degrees of f . As a consequence, a necessary condition for a corank 1 finitely determined map germ g ( mathbb C 2,0) rightarrow ( mathbb C 3,0) to be quasi homogeneous is that the plane curve gamma g has either two or three characteristic exponents. As an application of our main result, we also show that any one parameter unfolding F (f t,t) of f which adds only terms of the same degrees as the degrees of f is Whitney equisingular.


MGN Net a multi view graph normalizer for integrating heterogeneous biological network populations. With the recent technological advances, biological datasets, often represented by networks (i.e., graphs) of interacting entities, proliferate with unprecedented complexity and heterogeneity. Although modern network science opens new frontiers of analyzing connectivity patterns in such datasets, we still lack data driven methods for extracting an integral connectional fingerprint of a multi view graph population, let alone disentangling the typical from the atypical variations across the population samples. We present the multi view graph normalizer network (MGN Net https github.com basiralab MGN Net), a graph neural network based method to normalize and integrate a set of multi view biological networks into a single connectional template that is centered, representative, and topologically sound. We demonstrate the use of MGN Net by discovering the connectional fingerprints of healthy and neurologically disordered brain network populations including Alzheimer's disease and Autism spectrum disorder patients. Additionally, by comparing the learned templates of healthy and disordered populations, we show that MGN Net significantly outperforms conventional network integration methods across extensive experiments in terms of producing the most centered templates, recapitulating unique traits of populations, and preserving the complex topology of biological networks. Our evaluations showed that MGN Net is powerfully generic and easily adaptable in design to different graph based problems such as identification of relevant connections, normalization and integration.


Aware Adoption of Artificial Intelligence and Big Data a Value Framework for Reusable Knowledge. Artificial Intelligence (AI) is changing the way decision makers reason about complex systems more information (re)sources, e.g. Big Data (BD), are now available, but decisions are not always based on reusable and explainable knowledge resulting from the direct interaction with data. Therefore, it is necessary to define new models to describe and manage this type of uncertainty. This contribution introduces a conceptual framework to deal with the notion of Value in AI BD contexts, embracing both the multiplicity of Value dimensions and the uncertainty in their visibility as the foundations for a dynamic, relational representation of Value. The purpose is to provide ad hoc models to support Business Intelligence in assessing the impact of AI BD projects. The framework design is based on abstract and highly scalable definitions to represent Value, even considering the interaction of different agents through comparison, combination, and update of states of knowledge. The focus on reusable knowledge is exploited in the relation between Human and Artificial intelligences, which is characterised by a non classical form of uncertainty regarding data observability. The impact of the dynamic behaviour of Value dimensions on decision making and potential application domains are discussed, with the aim to enhance the sustainability of AI BD initiatives over time.


Dynamic Aware Autonomous Exploration in Populated Environments. Autonomous exploration allows mobile robots to navigate in initially unknown territories in order to build complete representations of the environments. In many real life applications, environments often contain dynamic obstacles which can compromise the exploration process by temporarily blocking passages, narrow paths, exits or entrances to other areas yet to be explored. In this work, we formulate a novel exploration strategy capable of explicitly handling dynamic obstacles, thus leading to complete and reliable exploration outcomes in populated environments. We introduce the concept of dynamic frontiers to represent unknown regions at the boundaries with dynamic obstacles together with a cost function which allows the robot to make informed decisions about when to revisit such frontiers. We evaluate the proposed strategy in challenging simulated environments and show that it outperforms a state of the art baseline in these populated scenarios.


Optimal Vaccination and Treatment Strategies in Reduction of COVID 19 Burden. In this study, we formulate a mathematical model incorporating age specific transmission dynamics of COVID 19 to evaluate the role of vaccination and treatment strategies in reducing the size of COVID 19 burden. Initially, we establish the positivity and boundedness of the solutions of the model and calculate the basic reproduction number. We then formulate an optimal control problem with vaccination and treatment as control variables. Optimal vaccination and treatment policies are analysed for different values of the weight constant associated with the cost of vaccination and different transmissibility levels. Findings from these suggested that the combined strategies(vaccination and treatment) worked best in minimizing the infection and disease induced mortality. In order to reduce COVID 19 infection and COVID 19 induced deaths to maximum, it was observed that optimal control strategy should be prioritized to population with age greater than 40 years. Not much difference was found between individual strategies and combined strategies in case of mild epidemic ( R 0 in (0, 2) ). For higher values of R 0 (R 0 in (2, 10)) the combined strategies was found to be best in terms of minimizing the overall infection. The infection curves varying the efficacies of the vaccines were also analysed and it was found that higher efficacy of the vaccine resulted in lesser number of infection and COVID induced death.


Mismatched Binary Hypothesis Testing Error Exponent Sensitivity. We study the problem of mismatched binary hypothesis testing between i.i.d. distributions. We analyze the tradeoff between the pairwise error probability exponents when the actual distributions generating the observation are different from the distributions used in the likelihood ratio test, sequential probability ratio test, and Hoeffding's generalized likelihood ratio test in the composite setting. When the real distributions are within a small divergence ball of the test distributions, we find the deviation of the worst case error exponent of each test with respect to the matched error exponent. In addition, we consider the case where an adversary tampers with the observation, again within a divergence ball of the observation type. We show that the tests are more sensitive to distribution mismatch than to adversarial observation tampering.


Self supervised Monocular Depth Estimation for All Day Images using Domain Separation. Remarkable results have been achieved by DCNN based self supervised depth estimation approaches. However, most of these approaches can only handle either day time or night time images, while their performance degrades for all day images due to large domain shift and the variation of illumination between day and night images. To relieve these limitations, we propose a domain separated network for self supervised depth estimation of all day images. Specifically, to relieve the negative influence of disturbing terms (illumination, etc.), we partition the information of day and night image pairs into two complementary sub spaces private and invariant domains, where the former contains the unique information (illumination, etc.) of day and night images and the latter contains essential shared information (texture, etc.). Meanwhile, to guarantee that the day and night images contain the same information, the domain separated network takes the day time images and corresponding night time images (generated by GAN) as input, and the private and invariant feature extractors are learned by orthogonality and similarity loss, where the domain gap can be alleviated, thus better depth maps can be expected. Meanwhile, the reconstruction and photometric losses are utilized to estimate complementary information and depth maps effectively. Experimental results demonstrate that our approach achieves state of the art depth estimation results for all day images on the challenging Oxford RobotCar dataset, proving the superiority of our proposed approach.


Updatable Materialization of Approximate Constraints. Modern big data applications integrate data from various sources. As a result, these datasets may not satisfy perfect constraints, leading to sparse schema information and non optimal query performance. The existing approach of PatchIndexes enable the definition of approximate constraints and improve query performance by exploiting the materialized constraint information. As real world data warehouse workloads are often not limited to read only queries, we enhance the PatchIndex structure towards an update conscious design in this paper. Therefore, we present a sharded bitmap as the underlying data structure which offers efficient update operations, and describe approaches to maintain approximate constraints under updates, avoiding index recomputations and full table scans. In our evaluation, we prove that PatchIndexes significantly impact query performance while achieving lightweight update support.


TMR Evaluating NER Recall on Tough Mentions. We propose the Tough Mentions Recall (TMR) metrics to supplement traditional named entity recognition (NER) evaluation by examining recall on specific subsets of "tough" mentions unseen mentions, those whose tokens or token type combination were not observed in training, and type confusable mentions, token sequences with multiple entity types in the test data. We demonstrate the usefulness of these metrics by evaluating corpora of English, Spanish, and Dutch using five recent neural architectures. We identify subtle differences between the performance of BERT and Flair on two English NER corpora and identify a weak spot in the performance of current models in Spanish. We conclude that the TMR metrics enable differentiation between otherwise similar scoring systems and identification of patterns in performance that would go unnoticed from overall precision, recall, and F1.


A characterization of 4 chi S vertex critical graphs for S succeq (1,3,3,3, ldots) . If S (s 1,s 2, ldots) is a non decreasing sequence of positive integers, then the S packing k coloring of a graph G is a mapping c V(G) rightarrow k such that if c(u) c(v) i for u neq v in V(G) , then d G(u,v) s i . The S packing chromatic number of G is the smallest integer k such that G admits an S packing k coloring. A graph G is chi S critical if chi S(G u) chi S(G) for each u in V(G) . If G is chi S critical and chi S(G) k , then G is k chi S vertex critical. In this paper, 4 chi S vertex critical graphs are characterized for sequences S (1,s 2, s 3, ldots) with s 2 ge 3 . There are 28 sporadic examples and two infinite families of such graphs.


Numerical integration of ODEs while preserving all polynomial first integrals. We present a novel method for solving ordinary differential equations (ODEs) while preserving all polynomial first integrals. The method is essentially a symplectic Runge Kutta method applied to a reformulated version of the ODE under study and is illustrated through a number of examples including Hamiltonian ODEs, a Nambu system and the Toda Lattice. When applied to certain Hamiltonian ODEs, the proposed method yields the averaged vector field method as a special case.


Embedding based Recommender System for Job to Candidate Matching on Scale. The online recruitment matching system has been the core technology and service platform in CareerBuilder. One of the major challenges in an online recruitment scenario is to provide good matches between job posts and candidates using a recommender system on the scale. In this paper, we discussed the techniques for applying an embedding based recommender system for the large scale of job to candidates matching. To learn the comprehensive and effective embedding for job posts and candidates, we have constructed a fused embedding via different levels of representation learning from raw text, semantic entities and location information. The clusters of fused embedding of job and candidates are then used to build and train the Faiss index that supports runtime approximate nearest neighbor search for candidate retrieval. After the first stage of candidate retrieval, a second stage reranking model that utilizes other contextual information was used to generate the final matching result. Both offline and online evaluation results indicate a significant improvement of our proposed two staged embedding based system in terms of click through rate (CTR), quality and normalized discounted accumulated gain (nDCG), compared to those obtained from our baseline system. We further described the deployment of the system that supports the million scale job and candidate matching process at CareerBuilder. The overall improvement of our job to candidate matching system has demonstrated its feasibility and scalability at a major online recruitment site.


Two Guarded Recursive Powerdomains for Applicative Simulation. Clocked Cubical Type Theory is a new type theory combining the power of guarded recursion with univalence and higher inductive types (HITs). This type theory can be used as a metalanguage for synthetic guarded domain theory in which one can solve guarded recursive type equations, also with negative variable occurrences, and use these to construct models for reasoning about programming languages. Combining this with HITs allows for the use of type constructors familiar from set theory based approaches to semantics, such as quotients and finite powersets in these models. In this paper we show how to reason about the combination of finite non determinism and recursion in this type theory. Unlike traditional domain theory which takes an ordering of programs as primitive, synthetic guarded domain theory takes the notion of computation step as primitive in the form of a modal operator. We use this extra intensional information to define two guarded recursive (finite) powerdomain constructions differing in the way non determinism interacts with the computation steps. As an example application of these we show how to prove applicative similarity a congruence in the cases of may and must convergence for the untyped lambda calculus with finite non determinism. Such results are usually proved using operational reasoning and Howe's method. Here we use an adaptation of a denotational method developed by Pitts in the context of domain theory.


Diversified Patch based Style Transfer with Shifted Style Normalization. Gram based and patch based approaches are two important research lines of image style transfer. Recent diversified Gram based methods have been able to produce multiple and diverse reasonable solutions for the same content and style inputs. However, as another popular research interest, the diversity of patch based methods remains challenging due to the stereotyped style swapping process based on nearest patch matching. To resolve this dilemma, in this paper, we dive into the core style swapping process of patch based style transfer and explore possible ways to diversify it. What stands out is an operation called shifted style normalization (SSN), the most effective and efficient way to empower existing patch based methods to generate diverse results for arbitrary styles. The key insight is to use an important intuition that neural patches with higher activation values could contribute more to diversity. Theoretical analyses and extensive experiments are conducted to demonstrate the effectiveness of our method, and compared with other possible options and state of the art algorithms, it shows remarkable superiority in both diversity and efficiency.


Linear stability estimates for Serrin's problem via a modified implicit function theorem. We examine Serrin's classical overdetermined problem under a perturbation of the Neumann boundary condition. The solution of the problem for a constant Neumann boundary condition exists provided that the underlying domain is a ball. The question arises whether for a perturbation of the constant there still are domains admitting solutions to the problem. Furthermore, one may ask whether a domain that admits a solution for the perturbed problem is unique up to translation and whether it is close to the ball. We develop a new implicit function theorem for a pair of Banach triplets that is applicable to nonlinear problems with loss of derivatives except at the point under consideration. Combined with a detailed analysis of the linearized operator, we prove the existence and local uniqueness of a domain admitting a solution to the perturbed overdetermined problem. Moreover, an optimal linear stability estimate for the shape of a domain is established.


Controlling an Inverted Pendulum with Policy Gradient Methods A Tutorial. This paper provides the details of implementing two important policy gradient methods to solve the inverted pendulum problem. These are namely the Deep Deterministic Policy Gradient (DDPG) and the Proximal Policy Optimization (PPO) algorithm. The problem is solved by using an actor critic model where an actor network is used to learn the policy function and a critic network is to evaluate the actor network by learning to estimate the Q function. Apart from briefly explaining the mathematics behind these two algorithms, the details of python implementation are provided which helps in demystifying the underlying complexity of the algorithm. In the process, the readers will be introduced to OpenAI Gym, Tensorflow 2.x and Keras utilities used for implementing the above concepts.


Interpreting Deep Knowledge Tracing Model on EdNet Dataset. With more deep learning techniques being introduced into the knowledge tracing domain, the interpretability issue of the knowledge tracing models has aroused researchers' attention. Our previous study(Lu et al. 2020) on building and interpreting the KT model mainly adopts the ASSISTment dataset(Feng, Heffernan, and Koedinger 2009),, whose size is relatively small. In this work, we perform the similar tasks but on a large and newly available dataset, called EdNet(Choi et al. 2020). The preliminary experiment results show the effectiveness of the interpreting techniques, while more questions and tasks are worthy to be further explored and accomplished.


Conic optimization with spectral functions on Euclidean Jordan algebras. Spectral functions on Euclidean Jordan algebras arise frequently in convex models. Despite the success of primal dual conic interior point solvers, there has been little work on enabling direct support for spectral cones, i.e. proper nonsymmetric cones defined from epigraphs and perspectives of spectral functions. We propose simple logarithmically homogeneous barriers for spectral cones and we derive efficient, numerically stable procedures for evaluating barrier oracles such as inverse Hessian operators. For two useful classes of spectral cones the root determinant cones and the matrix monotone derivative cones we show that the barriers are self concordant, with nearly optimal parameters. We implement these cones and oracles in our open source solver Hypatia, and we write simple, natural formulations for four applied problems. Our computational benchmarks demonstrate that Hypatia often solves the natural formulations more efficiently than advanced solvers such as MOSEK 9 solve equivalent extended formulations written using only the cones these solvers support.


Jigsaw Clustering for Unsupervised Visual Representation Learning. Unsupervised representation learning with contrastive learning achieved great success. This line of methods duplicate each training batch to construct contrastive pairs, making each training batch and its augmented version forwarded simultaneously and leading to additional computation. We propose a new jigsaw clustering pretext task in this paper, which only needs to forward each training batch itself, and reduces the training cost. Our method makes use of information from both intra and inter images, and outperforms previous single batch based ones by a large margin. It is even comparable to the contrastive learning methods when only half of training batches are used. Our method indicates that multiple batches during training are not necessary, and opens the door for future research of single batch unsupervised methods. Our models trained on ImageNet datasets achieve state of the art results with linear classification, outperforming previous single batch methods by 2.6 . Models transferred to COCO datasets outperform MoCo v2 by 0.4 with only half of the training batches. Our pretrained models outperform supervised ImageNet pretrained models on CIFAR 10 and CIFAR 100 datasets by 0.9 and 4.1 respectively. Code is available at https github.com Jia Research Lab JigsawClustering


An Online Data Driven Emergency Response Method for Autonomous Agents in Unforeseen Situations. Reinforcement learning agents perform well when presented with inputs within the distribution of those encountered during training. However, they are unable to respond effectively when faced with novel, out of distribution events, until they have undergone additional training. This paper presents an online, data driven, emergency response method that aims to provide autonomous agents the ability to react to unexpected situations that are very different from those it has been trained or designed to address. In such situations, learned policies cannot be expected to perform appropriately since the observations obtained in these novel situations would fall outside the distribution of inputs that the agent has been optimized to handle. The proposed approach devises a customized response to the unforeseen situation sequentially, by selecting actions that minimize the rate of increase of the reconstruction error from a variational auto encoder. This optimization is achieved online in a data efficient manner (on the order of 30 data points) using a modified Bayesian optimization procedure. We demonstrate the potential of this approach in a simulated 3D car driving scenario, in which the agent devises a response in under 2 seconds to avoid collisions with objects it has not seen during training.


Number fluctuations induce persistent congestion. The capacity of a street segment quantifies the maximal density of vehicles before congestion arises. Here we show in a simple mathematical model that fluctuations in the instantaneous number of vehicles entering a street segment are sufficient to induce persistent congestion. Congestion emerges even if the average flow is below the segment's capacity where congestion is absent without fluctuations. We explain how this fluctuation induced congestion emerges due to a self amplifying reduction of the average vehicle velocities.


Sparser Kernel Herding with Pairwise Conditional Gradients without Swap Steps. The Pairwise Conditional Gradients (PCG) algorithm is a powerful extension of the Frank Wolfe algorithm leading to particularly sparse solutions, which makes PCG very appealing for problems such as sparse signal recovery, sparse regression, and kernel herding. Unfortunately, PCG exhibits so called swap steps that might not provide sufficient primal progress. The number of these bad steps is bounded by a function in the dimension and as such known guarantees do not generalize to the infinite dimensional case, which would be needed for kernel herding. We propose a new variant of PCG, the so called Blended Pairwise Conditional Gradients (BPCG). This new algorithm does not exhibit any swap steps, is very easy to implement, and does not require any internal gradient alignment procedures. The convergence rate of BPCG is basically that of PCG if no drop steps would occur and as such is no worse than PCG but improves and provides new rates in many cases. Moreover, we observe in the numerical experiments that BPCG's solutions are much sparser than those of PCG. We apply BPCG to the kernel herding setting, where we derive nice quadrature rules and provide numerical results demonstrating the performance of our method.


Ymir A Supervised Ensemble Framework for Multivariate Time Series Anomaly Detection. We proposed a multivariate time series anomaly detection frame work Ymir, which leverages ensemble learning and supervisedlearning technology to efficiently learn and adapt to anomaliesin real world system applications. Ymir integrates several currentlywidely used unsupervised anomaly detection models through anensemble learning method, and thus can provide robust frontalanomaly detection results in unsupervised scenarios. In a super vised setting, domain experts and system users discuss and providelabels (anomalous or not) for the training data, which reflects theiranomaly detection criteria for the specific system. Ymir leveragesthe aforementioned unsupervised methods to extract rich and usefulfeature representations from the raw multivariate time series data,then combines the features and labels with a supervised classifier todo anomaly detection. We evaluated Ymir on internal multivariatetime series datasets from large monitoring systems and achievedgood anomaly detection performance.


Calibrate your listeners! Robust communication based training for pragmatic speakers. To be good conversational partners, natural language processing (NLP) systems should be trained to produce contextually useful utterances. Prior work has investigated training NLP systems with communication based objectives, where a neural listener stands in as a communication partner. However, these systems commonly suffer from semantic drift where the learned language diverges radically from natural language. We propose a method that uses a population of neural listeners to regularize speaker training. We first show that language drift originates from the poor uncertainty calibration of a neural listener, which makes high certainty predictions on novel sentences. We explore ensemble and dropout based populations of listeners and find that the former results in better uncertainty quantification. We evaluate both population based objectives on reference games, and show that the ensemble method with better calibration enables the speaker to generate pragmatic utterances while scaling to a large vocabulary and generalizing to new games and listeners.


Continuity of critical exponent of quasiconvex cocompact groups under Gromov Hausdorff convergence. We show continuity under equivariant Gromov Hausdorff convergence of the critical exponent of discrete, non elementary, torsion free, quasiconvex cocompact groups with uniformly bounded codiameter acting on uniformly Gromov hyperbolic metric spaces.


Predicting the Last Zero before an exponential time of a Spectrally Negative L 'evy Process. Given a spectrally negative L 'evy process, we predict, in a L 1 sense, the last passage time of the process below zero before an independent exponential time. This optimal prediction problem generalises Baurdoux and Pedraza (2020) where the infinite horizon problem is solved. Using a similar argument as that in Urusov (2005), we show that this optimal prediction problem is equivalent to solving an optimal prediction problem in a finite horizon setting. Surprisingly (unlike the infinite horizon problem) an optimal stopping time is based on a curve that is killed at the moment the mean of the exponential time is reached. That is, an optimal stopping time is the first time the process crosses above a non negative, continuous and non increasing curve depending on time. This curve and the value function are characterised as a solution of a system of non linear integral equations which can be understood as a generalisation of the free boundary equations (see e.g. Peskir and Shiryaev (2006) Chapter IV.14.1) in the presence of jumps. As an example, we calculate numerically such curve in the Brownian motion case and a compound Poisson process with exponential sized jumps perturbed by a Brownian motion.


Numerical analysis of a new formulation for the Oseen equations in terms of vorticity and Bernoulli pressure. A variational formulation is introduced for the Oseen equations written in terms of vor ti city and Bernoulli pressure. The velocity is fully decoupled using the momentum balance equation, and it is later recovered by a post process. A finite element method is also proposed, consisting in equal order N 'ed 'elec finite elements and piecewise continuous polynomials for the vorticity and the Bernoulli pressure, respectively. The it a priori error analysis is carried out in the mathrm L 2 norm for vorticity, pressure, and velocity under a smallness assumption either on the convecting velocity, or on the mesh parameter. Furthermore, an it a posteriori error estimator is designed and its robustness and efficiency are studied using weighted norms. Finally, a set of numerical examples in 2D and 3D is given, where the error indicator serves to guide adaptive mesh refinement. These tests illustrate the behaviour of the new formulation in typical flow conditions, and they also confirm the theoretical findings.


A Novel Adaptive Minority Oversampling Technique for Improved Classification in Data Imbalanced Scenarios. Imbalance in the proportion of training samples belonging to different classes often poses performance degradation of conventional classifiers. This is primarily due to the tendency of the classifier to be biased towards the majority classes in the imbalanced dataset. In this paper, we propose a novel three step technique to address imbalanced data. As a first step we significantly oversample the minority class distribution by employing the traditional Synthetic Minority OverSampling Technique (SMOTE) algorithm using the neighborhood of the minority class samples and in the next step we partition the generated samples using a Gaussian Mixture Model based clustering algorithm. In the final step synthetic data samples are chosen based on the weight associated with the cluster, the weight itself being determined by the distribution of the majority class samples. Extensive experiments on several standard datasets from diverse domains shows the usefulness of the proposed technique in comparison with the original SMOTE and its state of the art variants algorithms.


Boosting Binary Masks for Multi Domain Learning through Affine Transformations. In this work, we present a new, algorithm for multi domain learning. Given a pretrained architecture and a set of visual domains received sequentially, the goal of multi domain learning is to produce a single model performing a task in all the domains together. Recent works showed how we can address this problem by masking the internal weights of a given original conv net through learned binary variables. In this work, we provide a general formulation of binary mask based models for multi domain learning by affine transformations of the original network parameters. Our formulation obtains significantly higher levels of adaptation to new domains, achieving performances comparable to domain specific models while requiring slightly more than 1 bit per network parameter per additional domain. Experiments on two popular benchmarks showcase the power of our approach, achieving performances close to state of the art methods on the Visual Decathlon Challenge.


Prism Private Verifiable Set Computation over Multi Owner Outsourced Databases. This paper proposes Prism, a secret sharing based approach to compute private set operations (i.e., intersection and union), as well as aggregates over outsourced databases belonging to multiple owners. Prism enables data owners to pre load the data onto non colluding servers and exploits the additive and multiplicative properties of secret shares to compute the above listed operations in (at most) two rounds of communication between the servers (storing the secret shares) and the querier, resulting in a very efficient implementation. Also, Prism does not require communication among the servers and supports result verification techniques for each operation to detect malicious adversaries. Experimental results show that Prism scales both in terms of the number of data owners and database sizes, to which prior approaches do not scale.


Improved Singleton bound on insertion deletion codes and optimal constructions. Insertion deletion codes (insdel codes for short) play an important role in synchronization error correction. The higher the minimum insdel distance, the more insdel errors the code can correct. Haeupler and Shahrasbi established the Singleton bound for insdel codes the minimum insdel distance of any n,k linear code over mathbb F q satisfies d leq2n 2k 2. There have been some constructions of insdel codes through Reed Solomon codes with high capabilities, but none has come close to this bound. Recently, Do Duc it et al. showed that the minimum insdel distance of any n,k Reed Solomon code is no more than 2n 2k if q is large enough compared to the code length n optimal codes that meet the new bound were also constructed explicitly. The contribution of this paper is twofold. We first show that the minimum insdel distance of any n,k linear code over mathbb F q satisfies d leq2n 2k if n k 1 . This result improves and generalizes the previously known results in the literature. We then give a sufficient condition under which the minimum insdel distance of a two dimensional Reed Solomon code of length n over mathbb F q is exactly equal to 2n 4 . As a consequence, we show that the sufficient condition is not hard to achieve we explicitly construct an infinite family of optimal two dimensional Reed Somolom codes meeting the bound.


Local Hyper Flow Diffusion. Recently, hypergraphs have attracted a lot of attention due to their ability to capture complex relations among entities. The insurgence of hypergraphs has resulted in data of increasing size and complexity that exhibit interesting small scale and local structure, e.g., small scale communities and localized node ranking around a given set of seed nodes. Popular and principled ways to capture the local structure are the local hypergraph clustering problem and related seed set expansion problem. In this work, we propose the first local diffusion method that achieves edge size independent Cheeger type guarantee for the problem of local hypergraph clustering while applying to a rich class of higher order relations that covers many previously studied special cases. Our method is based on a primal dual optimization formulation where the primal problem has a natural network flow interpretation, and the dual problem has a cut based interpretation using the ell 2 norm penalty on associated cut costs. We demonstrate the new technique is significantly better than state of the art methods on both synthetic and real world data.


APEX Net Automatic Plot Extractor Network. Automatic extraction of raw data from 2D line plot images is a problem of great importance having many real world applications. Several algorithms have been proposed for solving this problem. However, these algorithms involve a significant amount of human intervention. To minimize this intervention, we propose APEX Net, a deep learning based framework with novel loss functions for solving the plot extraction problem. We introduce APEX 1M, a new large scale dataset which contains both the plot images and the raw data. We demonstrate the performance of APEX Net on the APEX 1M test set and show that it obtains impressive accuracy. We also show visual results of our network on unseen plot images and demonstrate that it extracts the shape of the plots to a great extent. Finally, we develop a GUI based software for plot extraction that can benefit the community at large. For dataset and more information visit https sites.google.com view apexnetpaper .


The world is not a theorem. The evolution of the biosphere unfolds as a luxuriant generative process of new living forms and functions. Organisms adapt to their environment, exploit novel opportunities that are created in this continuous blooming dynamics. Affordances play a fundamental role in the evolution of the biosphere, for organisms can exploit them for new morphological and behavioral adaptations achieved by heritable variations and selection. This way, the opportunities offered by affordances are then actualized as ever novel adaptations. In this paper we maintain that affordances elude a formalization that relies on set theory we argue that it is not possible to apply set theory to affordances, therefore we cannot devise a set based mathematical theory of the diachronic evolution of the biosphere.


Automorphism and outer automorphism groups of Right angled Artin groups are not relatively hyperbolic. We show that the automorphism groups of right angled Artin groups whose defining graphs have at least 3 vertices are not relatively hyperbolic. We then show that the outer automorphism groups are also not relatively hyperbolic, except for a few exceptional cases. In these cases, they are virtually isomorphic to one of the following a finite group, an infinite cyclic group, or mathrm GL 2( mathbb Z ) .


Boundary homogenization of a class of obstacle problems. We study homogenization of a boundary obstacle problem on C 1, alpha domain D for some elliptic equations with uniformly elliptic coefficient matrices gamma . For any epsilon in mathbb R , partial D Gamma cup Sigma , Gamma cap Sigma emptyset and S epsilon subset Sigma with suitable assumptions, we prove that as epsilon tends to zero, the energy minimizer u epsilon of int D gamma nabla u 2 dx , subject to u geq varphi on S varepsilon , up to a subsequence, converges weakly in H 1 (D) to widetilde u which minimizes the energy functional int D gamma nabla u 2 int Sigma (u varphi) 2 mu(x) dS x , where mu(x) depends on the structure of S epsilon and varphi is any given function in C infty ( overline D ) .


Neural Models for Offensive Language Detection. Offensive language detection is an ever growing natural language processing (NLP) application. This growth is mainly because of the widespread usage of social networks, which becomes a mainstream channel for people to communicate, work, and enjoy entertainment content. Many incidents of sharing aggressive and offensive content negatively impacted society to a great extend. We believe contributing to improving and comparing different machine learning models to fight such harmful contents is an important and challenging goal for this thesis. We targeted the problem of offensive language detection for building efficient automated models for offensive language detection. With the recent advancements of NLP models, specifically, the Transformer model, which tackled many shortcomings of the standard seq to seq techniques. The BERT model has shown state of the art results on many NLP tasks. Although the literature still exploring the reasons for the BERT achievements in the NLP field. Other efficient variants have been developed to improve upon the standard BERT, such as RoBERTa and ALBERT. Moreover, due to the multilingual nature of text on social media that could affect the model decision on a given tween, it is becoming essential to examine multilingual models such as XLM RoBERTa trained on 100 languages and how did it compare to unilingual models. The RoBERTa based model proved to be the most capable model and achieved the highest F1 score for the tasks. Another critical aspect of a well rounded offensive language detection system is the speed at which a model can be trained and make inferences. In that respect, we have considered the model run time and fine tuned the very efficient implementation of FastText called BlazingText that achieved good results, which is much faster than BERT based models.


Tracking and managing deemed abilities. Information about the powers and abilities of acting entities is used to coordinate their actions in societies, either physical or digital. Yet, the commonsensical meaning of an acting entity being deemed able to do something is still missing from the existing specification languages for the web or for multi agent systems. We advance a general purpose abstract logical account of evidence based ability. A basic model can be thought of as the ongoing trace of a multi agent system. Every state records systemic confirmations and disconfirmations of whether an acting entity is able to bring about something. Qualitative inductive reasoning is then used in order to infer what acting entities are deemed able to bring about in the multi agent system. A temporalised modal language is used to talk about deemed ability, actual agency, and confirmation and disconfirmation of deemed ability. What constitutes a confirmation and a disconfirmation is left to the modeller as in general it depends on the application at hand. So to illustrate the methodology we propose two extended examples, one in practical philosophy, the other in system engineering. We first use a logic of agency and ability to obtain a version of Mele's general practical abilities. Then, we look at the management of abilities in a supervised system.


Square root problem and Subnormal Aluthge transforms. For a non negative measure mu with p atoms, we study the relation between the Square Root Problem of mu and the problem of subnormality of tilde W mu the Aluthge transform of the associated unilateral weighted shift. We use an approach based on uniquely represented elements in the support of mu mu . We first show that if tilde W mu is subnormal, then 2p 1 le card(supp( mu mu)) le frac (p 1) 2 6 2 . We rewrite several results known for finitely atomic measure having at most five atoms and give a complete solution for measures six atoms.