A Probabilistic Hard Attention Model For Sequentially Observed Scenes. A visual hard attention model actively selects and observes a sequence of subregions in an image to make a prediction. The majority of hard attention models determine the attention worthy regions by first analyzing a complete image. However, it may be the case that the entire image is not available initially but instead sensed gradually through a series of partial observations. In this paper, we design an efficient hard attention model for classifying such sequentially observed scenes. The presented model never observes an image completely. To select informative regions under partial observability, the model uses Bayesian Optimal Experiment Design. First, it synthesizes the features of the unobserved regions based on the already observed regions. Then, it uses the predicted features to estimate the expected information gain (EIG) attained, should various regions be attended. Finally, the model attends to the actual content on the location where the EIG mentioned above is maximum. The model uses a) a recurrent feature aggregator to maintain a recurrent state, b) a linear classifier to predict the class label, c) a Partial variational autoencoder to predict the features of unobserved regions. We use normalizing flows in Partial VAE to handle multi modality in the feature synthesis problem. We train our model using a differentiable objective and test it on five datasets. Our model gains 2 10 higher accuracy than the baseline models when both have seen only a couple of glimpses.


A dual primal balanced augmented Lagrangian method for linearly constrained convex programming. Most recently, He and Yuan arXiv 2108.08554, 2021 have proposed a balanced augmented Lagrangian method (ALM) for the canonical convex programming problem with linear constraints, which advances the original ALM by balancing its subproblems and improving its implementation. In this short note, we propose a dual primal version of the balanced ALM, which updates the new iterate via a conversely dual primal iterative order formally. The proposed method inherits all advantages of the prototype balanced ALM, and its convergence analysis can be well conducted in the context of variational inequalities. In addition, its numerical efficiency is demonstrated by the basis pursuit problem.


Convergence results of a nested decentralized gradient method for non strongly convex problems. We are concerned with the convergence of NEAR DGD (Nested Exact Alternating Recursion Distributed Graident Descent) method introduced to solve the distributed optimization problems. Under the assumption of strong convexity and Lipschitz continuous gradient, the linear convergence is established in cite BBKW Near DGD . In this paper, we investigate the convergence property of NEAR DGD in the absence of strong convexity. More precisely, we establish the convergence result in the case where only the convexity or the quasi strong convexity is assumed on the objective function in place of the strong convexity. Numerical results are provided to support the convergence results.


Leakage Resilient Secret Sharing with Constant Share Size. We consider the leakage resilience of AG code based ramp secret sharing schemes extending the leakage resilience of linear threshold secret sharing schemes over prime fields done by Benhamouda et al. Since there is not any explicit efficient construction of AG codes over prime fields, we consider constructions over prime fields with the help of concatenation method and those over field extensions. Extending the Fourier analysis done by Benhamouda et al., concatenated algebraic geometric codes over prime fields do produce some nice leakage resilient secret sharing schemes. One natural and curious question is whether AG codes over extension fields produce better leakage resilient secret sharing schemes than the construction based on concatenated AG codes. Such construction provides several advantages compared to the construction over prime fields using concatenation method. First, AG codes over extension fields give secret sharing schemes with smaller reconstruction for a fixed privacy parameter t. Second, concatenated AG codes do not enjoy strong multiplicity and hence they are not applicable to secure MPC schemes. It is also confirmed that indeed AG codes over extension fields have stronger leakage resilience under some reasonable assumptions. These three advantages strongly motivate the study of secret sharing schemes from AG codes over extension fields. The current paper has two main contributions 1, we obtain leakage resilient secret sharing schemes with constant share sizes and unbounded numbers of players. Like Shamir secret scheme, our schemes enjoy multiplicity and hence can be applied to MPC. 2, via a sophisticated Fourier Analysis, we analyze the leakage resilience of secret sharing schemes from codes over extension fields. This is of its own theoretical interest independent of its application to secret sharing schemes from algebraic geometric codes over extension fields.


The cutoff phenomenon in Wasserstein distance for nonlinear stable Langevin systems with small L 'evy noise. This article establishes the cutoff phenomenon in the Wasserstein distance for systems of nonlinear ordinary differential equations with a unique coercive stable fixed point subject to general additive Markovian noise in the limit of small noise intensity. This result generalizes the results shown in Barrera, H "ogele, Pardo (EJP2021) in a more restrictive setting of Blumenthal Getoor index alpha 3 2 to the formulation in Wasserstein distance, which allows to cover the case of general L 'evy processes with some given moment. The main proof techniques are based on the close control of the errors in a version of the Hartman Grobman theorem and the adaptation of the linear theory established in Barrera, H "ogele, Pardo (JSP2021). In particular, they rely on the precise asymptotics of the nonlinear flow and the nonstandard shift linearity property of the Wasserstein distance, which is established by the authors in (JSP2021). Main examples are the Fermi Pasta Ulam Tsingou gradient flow and coercive nonlinear oscillators subject to small (and possibly degenerate) Brownian or arbitrary alpha stable noise.


A note on weakly proregular sequences and local cohomology. In this note, we give an elementary proof of the result given by Schenzel that there are functorial isomorphisms between local cohomology groups and v C ech cohomology groups, by using weakly proregular sequences. In Sch03 , he used notions of derived category theory in his proof, but we do not use them in this paper.


Strong valid inequalities for a class of concave submodular minimization problems under cardinality constraints. We study the polyhedral convex hull structure of a mixed integer set which arises in a class of cardinality constrained concave submodular minimization problems. This class of problems has an objective function in the form of f(a top x) , where f is a univariate concave function, a is a non negative vector, and x is a binary vector of appropriate dimension. Such minimization problems frequently appear in applications that involve risk aversion or economies of scale. We propose three classes of strong valid linear inequalities for this convex hull and specify their facet conditions when a has two distinct values. We show how to use these inequalities to obtain valid inequalities for general a that contains multiple values. We further provide a complete linear convex hull description for this mixed integer set when a contains two distinct values and the cardinality constraint upper bound is two. Our computational experiments on the mean risk optimization problem demonstrate the effectiveness of the proposed inequalities in a branch and cut framework.


Symplectic topology and ideal valued measures. We adapt Gromov's notion of ideal valued measures to symplectic topology, and use it for proving new results on symplectic rigidity and symplectic intersections. Furthermore, it enables us to discuss three "big fiber theorems", the Centerpoint Theorem in combinatorial geometry, the Maximal Fiber Inequality in topology, and the Non displaceable Fiber Theorem in symplectic topology, from a unified viewpoint. Our main technical tool is an enhancement of the symplectic cohomology theory recently developed by Varolgunes.


A comparison between the Bismut Lott torsion and the Igusa Klein torsion. We consider a fibration with compact fiber together with a unitarily flat complex vector bundle over the total space. Under the assumption that the fiberwise cohomology admits a filtration with unitary factors, we construct Bismut Lott analytic torsion classes. The analytic torsion classes obtained satisfy Igusa's and Ohrt's axiomatization of higher torsion invariants. As a consequence, we obtain a higher version of the Cheeger M "uller Bismut Zhang theorem for trivial flat line bundles, the Bismut Lott analytic torsion classes coincide with the Igusa Klein higher topological torsions up to a normalization.


The Effective Permittivity and Permeability Generated by a Cluster of Moderately Contrasting Nanoparticles. In a 3D bounded and C 1, alpha smooth domain Omega , alpha in (0, 1) , we distribute a cluster of nanoparticles enjoying moderately contrasting relative permittivity and permeability which can be anisotropic. We show that the effective permittivity and permeability generated by such cluster is explicitly characterized by the corresponding electric and magnetic polarization tensors of the fixed shape. The error of the approximation of the scattered fields corresponding to the cluster and the effective medium is inversely proportional to the dilution parameter c r frac delta a where a is the maximum diameter of the nanoparticles and delta the minimum distance between them. The constant of the proportionality is given in terms of a priori bounds on the cluster of nanoparticles (i.e. upper and lower bounds on their permittivity and permeability parameters, upper bound on the dilution parameter c r , the used incident frequency and the domain Omega ). A key point of the analysis is to show that the Foldy Lax field appearing in the meso scale approximation, derived in cite AM , is a discrete form of a (continuous) system of Lippmann Schwinger equations with a related effective permittivity and permeability contrasts. To derive this, we prove that the Lippmann Schwinger operator, for the Maxwell system, is invertible in the H " o lder spaces. As a by product, this shows a H " o lder regularity property of the electromagnetic fields up to the boundary of the inhomogeneity.


Exploring Text to Text Transformers for English to Hinglish Machine Translation with Synthetic Code Mixing. We describe models focused at the understudied problem of translating between monolingual and code mixed language pairs. More specifically, we offer a wide range of models that convert monolingual English text into Hinglish (code mixed Hindi and English). Given the recent success of pretrained language models, we also test the utility of two recent Transformer based encoder decoder models (i.e., mT5 and mBART) on the task finding both to work well. Given the paucity of training data for code mixing, we also propose a dependency free method for generating code mixed texts from bilingual distributed representations that we exploit for improving language model performance. In particular, armed with this additional data, we adopt a curriculum learning approach where we first finetune the language models on synthetic data then on gold code mixed data. We find that, although simple, our synthetic code mixing method is competitive with (and in some cases is even superior to) several standard methods (backtranslation, method based on equivalence constraint theory) under a diverse set of conditions. Our work shows that the mT5 model, finetuned following the curriculum learning procedure, achieves best translation performance (12.67 BLEU). Our models place first in the overall ranking of the English Hinglish official shared task.


Convex Joint Graph Matching and Clustering via Semidefinite Relaxations. This paper proposes a new algorithm for simultaneous graph matching and clustering. For the first time in the literature, these two problems are solved jointly and synergetically without relying on any training data, which brings advantages for identifying similar arbitrary objects in compound 3D scenes and matching them. For joint reasoning, we first rephrase graph matching as a rigid point set registration problem operating on spectral graph embeddings. Consequently, we utilise efficient convex semidefinite program relaxations for aligning points in Hilbert spaces and add coupling constraints to model the mutual dependency and exploit synergies between both tasks. We outperform state of the art in challenging cases with non perfectly matching and noisy graphs, and we show successful applications on real compound scenes with multiple 3D elements. Our source code and data are publicly available.


Metaverse for Social Good A University Campus Prototype. In recent years, the metaverse has attracted enormous attention from around the world with the development of related technologies. The expected metaverse should be a realistic society with more direct and physical interactions, while the concepts of race, gender, and even physical disability would be weakened, which would be highly beneficial for society. However, the development of metaverse is still in its infancy, with great potential for improvement. Regarding metaverse's huge potential, industry has already come forward with advance preparation, accompanied by feverish investment, but there are few discussions about metaverse in academia to scientifically guide its development. In this paper, we highlight the representative applications for social good. Then we propose a three layer metaverse architecture from a macro perspective, containing infrastructure, interaction, and ecosystem. Moreover, we journey toward both a historical and novel metaverse with a detailed timeline and table of specific attributes. Lastly, we illustrate our implemented blockchain driven metaverse prototype of a university campus and discuss the prototype design and insights.


EBIC.JL an Efficient Implementation of Evolutionary Biclustering Algorithm in Julia. Biclustering is a data mining technique which searches for local patterns in numeric tabular data with main application in bioinformatics. This technique has shown promise in multiple areas, including development of biomarkers for cancer, disease subtype identification, or gene drug interactions among others. In this paper we introduce EBIC.JL an implementation of one of the most accurate biclustering algorithms in Julia, a modern highly parallelizable programming language for data science. We show that the new version maintains comparable accuracy to its predecessor EBIC while converging faster for the majority of the problems. We hope that this open source software in a high level programming language will foster research in this promising field of bioinformatics and expedite development of new biclustering methods for big data.


GroupLink An End to end Multitask Method for Word Grouping and Relation Extraction in Form Understanding. Forms are a common type of document in real life and carry rich information through textual contents and the organizational structure. To realize automatic processing of forms, word grouping and relation extraction are two fundamental and crucial steps after preliminary processing of optical character reader (OCR). Word grouping is to aggregate words that belong to the same semantic entity, and relation extraction is to predict the links between semantic entities. Existing works treat them as two individual tasks, but these two tasks are correlated and can reinforce each other. The grouping process will refine the integrated representation of the corresponding entity, and the linking process will give feedback to the grouping performance. For this purpose, we acquire multimodal features from both textual data and layout information and build an end to end model through multitask training to combine word grouping and relation extraction to enhance performance on each task. We validate our proposed method on a real world, fully annotated, noisy scanned benchmark, FUNSD, and extensive experiments demonstrate the effectiveness of our method.


Terahertz Wireless Communications Co sharing for Terrestrial and Satellite Systems above 100 GHz. This paper demonstrates how spectrum up to 1 THz will support mobile communications beyond 5G in the coming decades. Results of rooftop surrogate satellite tower base station measurements at 140 GHz show the natural isolation between terrestrial networks and surrogate satellite systems, as well as between terrestrial mobile users and co channel fixed backhaul links. These first of their kind measurements and accompanying analysis show that by keeping the energy radiated by terrestrial emitters on the horizon (e.g., elevation angles leq 15 textdegree), there will not likely be interference in the same or adjacent bands between passive satellite sensors and terrestrial terminals, or between mobile links and terrestrial backhaul links at frequencies above 100 GHz.


Predicting Take over Time for Autonomous Driving with Real World Data Robust Data Augmentation, Models, and Evaluation. Understanding occupant vehicle interactions by modeling control transitions is important to ensure safe approaches to passenger vehicle automation. Models which contain contextual, semantically meaningful representations of driver states can be used to determine the appropriate timing and conditions for transfer of control between driver and vehicle. However, such models rely on real world control take over data from drivers engaged in distracting activities, which is costly to collect. Here, we introduce a scheme for data augmentation for such a dataset. Using the augmented dataset, we develop and train take over time (TOT) models that operate sequentially on mid and high level features produced by computer vision algorithms operating on different driver facing camera views, showing models trained on the augmented dataset to outperform the initial dataset. The demonstrated model features encode different aspects of the driver state, pertaining to the face, hands, foot and upper body of the driver. We perform ablative experiments on feature combinations as well as model architectures, showing that a TOT model supported by augmented data can be used to produce continuous estimates of take over times without delay, suitable for complex real world scenarios.


Characterization of Decomposition of Matrix Multiplication Tensors. In this paper, the canonical polyadic (CP) decomposition of tensors that corresponds to matrix multiplications is studied. Finding the rank of these tensors and computing the decompositions is a fundamental problem of algebraic complexity theory. In this paper, we characterize existing decompositions (found by any algorithm) by certain vectors called signature, and transform them in another decomposition which can be more suitable in practical algorithms. In particular, we present a novel decomposition of the tensor multiplication of matrices of the size 3x3 with 3x6 with rank 40.


Exponential mixing, KAM and smooth local rigidity. Consider actions of Z r by ergodic automorphisms on a compact nilmanifolds for r geq 2 . We show that small C k perturbations of such higher rank partially hyperbolic actions are smoothly conjugate to the original action, using a KAM scheme. The driving force for convergence of this iteration is the exponential mixing of the original action.


Self supervised Contrastive Attributed Graph Clustering. Attributed graph clustering, which learns node representation from node attribute and topological graph for clustering, is a fundamental but challenging task for graph analysis. Recently, methods based on graph contrastive learning (GCL) have obtained impressive clustering performance on this task. Yet, we observe that existing GCL based methods 1) fail to benefit from imprecise clustering labels 2) require a post processing operation to get clustering labels 3) cannot solve out of sample (OOS) problem. To address these issues, we propose a novel attributed graph clustering network, namely Self supervised Contrastive Attributed Graph Clustering (SCAGC). In SCAGC, by leveraging inaccurate clustering labels, a self supervised contrastive loss, which aims to maximize the similarities of intra cluster nodes while minimizing the similarities of inter cluster nodes, are designed for node representation learning. Meanwhile, a clustering module is built to directly output clustering labels by contrasting the representation of different clusters. Thus, for the OOS nodes, SCAGC can directly calculate their clustering labels. Extensive experimental results on four benchmark datasets have shown that SCAGC consistently outperforms 11 competitive clustering methods.


Towards an Abolitionist AI the role of Historically Black Colleges and Universities. Abolition is the process of destroying and then rebuilding the structures that impede liberation. This paper addresses the particular case of Black folk in the United States, but is relevant to the global decolonization movement. Using notions of abolition and infrastructures of feeling developed by Ruth Wilson Gilmore, I view Historically Black Colleges and Universities ( HBCUs ) as a particular kind of abolitionist project, created for the explicit purpose of nurturing and sustaining Black excellence particularly within the sciences. I then examine how artificial intelligence (AI) in particular and computing in general have contributed to racial oppression and the further confinement and diminishing of Black existence. I conclude by examining how the space held by HBCUs in computing might contribute to a re imagining of AI as a technology that enhances the possibility and actualization of Black life.


Illumination and Temperature Aware Multispectral Networks for Edge Computing Enabled Pedestrian Detection. Accurate and efficient pedestrian detection is crucial for the intelligent transportation system regarding pedestrian safety and mobility, e.g., Advanced Driver Assistance Systems, and smart pedestrian crosswalk systems. Among all pedestrian detection methods, vision based detection method is demonstrated to be the most effective in previous studies. However, the existing vision based pedestrian detection algorithms still have two limitations that restrict their implementations, those being real time performance as well as the resistance to the impacts of environmental factors, e.g., low illumination conditions. To address these issues, this study proposes a lightweight Illumination and Temperature aware Multispectral Network (IT MN) for accurate and efficient pedestrian detection. The proposed IT MN is an efficient one stage detector. For accommodating the impacts of environmental factors and enhancing the sensing accuracy, thermal image data is fused by the proposed IT MN with visual images to enrich useful information when visual image quality is limited. In addition, an innovative and effective late fusion strategy is also developed to optimize the image fusion performance. To make the proposed model implementable for edge computing, the model quantization is applied to reduce the model size by 75 while shortening the inference time significantly. The proposed algorithm is evaluated by comparing with the selected state of the art algorithms using a public dataset collected by in vehicle cameras. The results show that the proposed algorithm achieves a low miss rate and inference time at 14.19 and 0.03 seconds per image pair on GPU. Besides, the quantized IT MN achieves an inference time of 0.21 seconds per image pair on the edge device, which also demonstrates the potentiality of deploying the proposed model on edge devices as a highly efficient pedestrian detection algorithm.


Recolouring planar graphs of girth at least five. For a positive integer k , the k recolouring graph of a graph G has as vertex set all proper k colourings of G with two k colourings being adjacent if they differ by the colour of exactly one vertex. A result of Dyer et al. regarding graphs of bounded degeneracy implies that the 7 recolouring graphs of planar graphs, the 5 recolouring graphs of triangle free planar graphs and the 4 recolouring graphs planar graphs of girth at least six are connected. On the other hand, there are planar graphs whose 6 recolouring graph is disconnected, triangle free planar graphs whose 4 recolouring graph is disconnected and planar graphs of any given girth whose 3 recolouring graph is disconnected. The main result of this paper consists in showing, via a novel application of the discharging method, that the 4 recolouring graph of every planar graph of girth five is connected. This completes the classification of the connectedness of the recolouring graph for planar graphs of given girth. We also prove some theorems regarding the diameter of the recolouring graph of planar graphs.


A Multiplicity Formula of K types. In this paper, by proving a simple local trace formula for real reductive groups, we prove a multiplicity formula of K types for all irreducible representations of real reductive groups. This multiplicity formula expresses the K characters in terms of the Harish Chandra characters.


Adversarial Robustness in Multi Task Learning Promises and Illusions. Vulnerability to adversarial attacks is a well known weakness of Deep Neural networks. While most of the studies focus on single task neural networks with computer vision datasets, very little research has considered complex multi task models that are common in real applications. In this paper, we evaluate the design choices that impact the robustness of multi task deep learning networks. We provide evidence that blindly adding auxiliary tasks, or weighing the tasks provides a false sense of robustness. Thereby, we tone down the claim made by previous research and study the different factors which may affect robustness. In particular, we show that the choice of the task to incorporate in the loss function are important factors that can be leveraged to yield more robust models.


Best approximations, distance formulas and orthogonality in C algebras. For a unital C algebra mathcal A and a subspace mathcal B of mathcal A , a characterization for a best approximation to an element of mathcal A in mathcal B is obtained. As an application, a formula for the distance of an element of mathcal A from mathcal B has been obtained, when a best approximation of that element to mathcal B exists. Further, a characterization for Birkhoff James orthogonality of an element of a Hilbert C module to a subspace is obtained.


Multi VAE Learning Disentangled View common and View peculiar Visual Representations for Multi view Clustering. Multi view clustering, a long standing and important research problem, focuses on mining complementary information from diverse views. However, existing works often fuse multiple views' representations or handle clustering in a common feature space, which may result in their entanglement especially for visual representations. To address this issue, we present a novel VAE based multi view clustering framework (Multi VAE) by learning disentangled visual representations. Concretely, we define a view common variable and multiple view peculiar variables in the generative model. The prior of view common variable obeys approximately discrete Gumbel Softmax distribution, which is introduced to extract the common cluster factor of multiple views. Meanwhile, the prior of view peculiar variable follows continuous Gaussian distribution, which is used to represent each view's peculiar visual factors. By controlling the mutual information capacity to disentangle the view common and view peculiar representations, continuous visual information of multiple views can be separated so that their common discrete cluster information can be effectively mined. Experimental results demonstrate that Multi VAE enjoys the disentangled and explainable visual representations, while obtaining superior clustering performance compared with state of the art methods.


Enhancing Utility in the Watchdog Privacy Mechanism. This paper is concerned with enhancing data utility in the privacy watchdog method for attaining information theoretic privacy. For a specific privacy constraint, the watchdog method filters out the high risk data symbols through applying a uniform data regulation scheme, e.g., merging all high risk symbols together. While this method entirely trades the symbols resolution off for privacy, we show that the data utility can be greatly improved by partitioning the high risk symbols set and individually privatizing each subset. We further propose an agglomerative merging algorithm that finds a suitable partition of high risk symbols it starts with a singleton high risk symbol, which is iteratively fused with others until the resulting subsets are private. Numerical simulations demonstrate the efficacy of this algorithm in privately achieving higher utilities in the watchdog scheme.


The BNS invariants of the generalized solvable Baumslag Solitar groups and of their finite index subgroups. We compute the Bieri Neumann Strebel invariants Sigma 1 for the generalized solvable Baumslag Solitar groups Gamma n and their finite index subgroups. Using Sigma 1 , we show that certain finite index subgroups of Gamma n cannot be isomorphic to Gamma tilde n for any tilde n . In addition, we use the BNS invariants to give a new proof of property R infty for the groups Gamma n and their finite index subgroups.


Uppsala NLP at SemEval 2021 Task 2 Multilingual Language Models for Fine tuning and Feature Extraction in Word in Context Disambiguation. We describe the Uppsala NLP submission to SemEval 2021 Task 2 on multilingual and cross lingual word in context disambiguation. We explore the usefulness of three pre trained multilingual language models, XLM RoBERTa (XLMR), Multilingual BERT (mBERT) and multilingual distilled BERT (mDistilBERT). We compare these three models in two setups, fine tuning and as feature extractors. In the second case we also experiment with using dependency based information. We find that fine tuning is better than feature extraction. XLMR performs better than mBERT in the cross lingual setting both with fine tuning and feature extraction, whereas these two models give a similar performance in the multilingual setting. mDistilBERT performs poorly with fine tuning but gives similar results to the other models when used as a feature extractor. We submitted our two best systems, fine tuned with XLMR and mBERT.


Spectral solutions of PDEs on networks. To solve linear PDEs on metric graphs with standard coupling conditions (continuity and Kirchhoff's law), we develop and compare a spectral, a second order finite difference, and a discontinuous Galerkin method. The spectral method yields eigenvalues and eigenvectors of arbitary order with machine precision and converges exponentially. These eigenvectors provide a Fourier like basis on which to expand the solution however, more complex coupling conditions require additional research. The discontinuous Galerkin method provides approximations of arbitrary polynomial order however computing high order eigenvalues accurately requires the respective eigenvector to be well resolved. The method allows arbitrary non Kirchhoff flux conditions and requires special penalty terms at the vertices to enforce continuity of the solutions. For the finite difference method, the standard one sided second order finite difference stencil reduces the accuracy of the vertex solution to O(h 3 2 ) . To preserve overall second order accuracy, we used ghost cells for each edge. For all three methods we provide the implementation details, their validation, and examples illustrating their performance for the eigenproblem, Poisson equation, and the wave equation.


Using Meta learning to Recommend Process Discovery Methods. Process discovery methods have obtained remarkable achievements in Process Mining, delivering comprehensible process models to enhance management capabilities. However, selecting the suitable method for a specific event log highly relies on human expertise, hindering its broad application. Solutions based on Meta learning (MtL) have been promising for creating systems with reduced human assistance. This paper presents a MtL solution for recommending process discovery methods that maximize model quality according to complementary dimensions. Thanks to our MtL pipeline, it was possible to recommend a discovery method with 92 of accuracy using light weight features that describe the event log. Our experimental analysis also provided significant insights on the importance of log features in generating recommendations, paving the way to a deeper understanding of the discovery algorithms.


ROMAX Certifiably Robust Deep Multiagent Reinforcement Learning via Convex Relaxation. In a multirobot system, a number of cyber physical attacks (e.g., communication hijack, observation perturbations) can challenge the robustness of agents. This robustness issue worsens in multiagent reinforcement learning because there exists the non stationarity of the environment caused by simultaneously learning agents whose changing policies affect the transition and reward functions. In this paper, we propose a minimax MARL approach to infer the worst case policy update of other agents. As the minimax formulation is computationally intractable to solve, we apply the convex relaxation of neural networks to solve the inner minimization problem. Such convex relaxation enables robustness in interacting with peer agents that may have significantly different behaviors and also achieves a certified bound of the original optimization problem. We evaluate our approach on multiple mixed cooperative competitive tasks and show that our method outperforms the previous state of the art approaches on this topic.


Technology Report Robotic Localization and Navigation System for Visible Light Positioning and SLAM. Visible light positioning (VLP) technology is a promising technique as it can provide high accuracy positioning based on the existing lighting infrastructure. However, existing approaches often require dense lighting distributions. Additionally, due to complicated indoor environments, it is still challenging to develop a robust VLP. In this work, we proposed loosely coupled multi sensor fusion method based on VLP and Simultaneous Localization and Mapping (SLAM), with light detection and ranging (LiDAR), odometry, and rolling shutter camera. Our method can provide accurate and robust robotics localization and navigation in LED shortage or even outage situations. The efficacy of the proposed scheme is verified by extensive real time experiment. The results show that our proposed scheme can provide an average accuracy of 2 cm and the average computational time in low cost embedded platforms is around 50 ms.


Adversarial Sample Enhanced Domain Adaptation A Case Study on Predictive Modeling with Electronic Health Records. With the successful adoption of machine learning on electronic health records (EHRs), numerous computational models have been deployed to address a variety of clinical problems. However, due to the heterogeneity of EHRs, models trained on different patient groups suffer from poor generalizability. How to mitigate domain shifts between the source patient group where the model is built upon and the target one where the model will be deployed becomes a critical issue. In this paper, we propose a data augmentation method to facilitate domain adaptation, which leverages knowledge from the source patient group when training model on the target one. Specifically, adversarially generated samples are used during domain adaptation to fill the generalization gap between the two patient groups. The proposed method is evaluated by a case study on different predictive modeling tasks on MIMIC III EHR dataset. Results confirm the effectiveness of our method and the generality on different tasks.


Nonterminal complexity of some families of infinite regular languages. Nonterminal complexity of a context free language is the smallest possible number of nonterminals in its generating grammar. While in general case nonterminal complexity computation problem is unsolvable, it can be computed for different families of regular languages. In this paper we study nonterminal complexity of some families of infinite regular languages.


On Generalizations of Pairwise Compatibility Graphs. A graph G is a PCG if there exists an edge weighted tree such that each leaf of the tree is a vertex of the graph, and there is an edge x, y in G if and only if the weight of the path in the tree connecting x and y lies within a given interval. PCGs have different applications in phylogenetics and have been lately generalized to multi interval PCGs. In this paper we define two new generalizations of the PCG class, namely k OR PCGs and k AND PCGs, that are the classes of graphs that can be expressed as union and intersection, respectively, of k PCGs. The problems we consider can be also described in terms of the emph covering number and the emph intersection dimension of a graph with respect to the PCG class. In this paper we investigate how the classes of PCG, multi interval PCG, OR PCG and AND PCG are related to each other and to other graph classes known in the literature. In particular, we provide upper bounds on the minimum k for which an arbitrary graph G belongs to k interval PCG, k OR PCG and k AND PCG classes. Furthermore, for particular graph classes, we improve these general bounds. Moreover, we show that, for every integer k , there exists a bipartite graph that is not in the k interval PCG class, proving that there is no finite k for which the k interval PCG class contains all the graphs. Finally, we use a Ramsey theory argument to show that for any k , there exist graphs that are not in k AND PCG, and graphs that are not in k OR PCG.


Mapping class groups with the Rokhlin property. We classify the connected orientable 2 manifolds whose mapping class groups have a dense conjugacy class. We also show that the mapping class group of a connected orientable 2 manifold has a comeager conjugacy class if and only if the mapping class group is trivial.


Functional Extensionality for Refinement Types. Refinement type checkers are a powerful way to reason about functional programs. For example, one can prove properties of a slow, specification implementation, porting the proofs to an optimized implementation that behaves the same. Without functional extensionality, proofs must relate functions that are fully applied. When data itself has a higher order representation, fully applied proofs face serious impediments! When working with first order data, fully applied proofs lead to noisome duplication when using higher order functions. While dependent type theories are typically consistent with functional extensionality axioms, refinement type systems with semantic subtyping treat naive phrasings of functional extensionality inconsistently, leading to unsoundness. We demonstrate this unsoundness and develop a new approach to equality in Liquid Haskell we define a propositional equality in a library we call PEq. Using PEq avoids the unsoundness while still proving useful equalities at higher types we demonstrate its use in several case studies. We validate PEq by building a small model and developing its metatheory. Additionally, we prove metaproperties of PEq inside Liquid Haskell itself using an unnamed folklore technique, which we dub classy induction'.


25 open questions about vector bundles and their moduli. We present 25 open questions about moduli spaces of vector bundles and related topics and discuss some longstanding conjectures. We hope to inspire young researchers to engage in this area of research.


Characterization of the stability and dynamics of a laser produced plasma expanding across strong magnetic field. Magnetized laser produced plasmas are central to many new studies in laboratory astrophysics, inertial confinement fusion, and industrial applications. Here we present the results of large scale, three dimensional magneto hydrodynamic simulations of the dynamics of a laser produced plasma expanding into a transverse magnetic field with a strength of tens of Tesla. The simulations show the plasma is confined by the strong magnetic field into a slender slab structured by the magnetized Rayleigh Taylor instability that develops at the plasma vacuum interface. We find that by perturbing the initial velocity of the plume the slab can develop kink like motion which disrupts its propagation.


Asymptotic Log Det Rank Minimization via (Alternating) Iteratively Reweighted Least Squares. The affine rank minimization (ARM) problem is well known for both its applications and the fact that it is NP hard. One of the most successful approaches, yet arguably underrepresented, is iteratively reweighted least squares (IRLS), more specifically mathrm IRLS 0 . Despite comprehensive empirical evidence that it overall outperforms nuclear norm minimization and related methods, it is still not understood to a satisfying degree. In particular, the significance of a slow decrease of the therein appearing regularization parameter denoted gamma poses interesting questions. While commonly equated to matrix recovery, we here consider the ARM independently. We investigate the particular structure and global convergence property behind the asymptotic minimization of the log det objective function on which mathrm IRLS 0 is based. We expand on local convergence theorems, now with an emphasis on the decline of gamma , and provide representative examples as well as counterexamples such as a diverging mathrm IRLS 0 sequence that clarify theoretical limits. We present a data sparse, alternating realization mathrm AIRLS p (related to prior work under the name mathrm SALSA ) that, along with the rest of this work, serves as basis and introduction to the more general tensor setting. In conclusion, numerical sensitivity experiments are carried out that reconfirm the success of mathrm IRLS 0 and demonstrate that in surprisingly many cases, a slower decay of gamma will yet lead to a solution of the ARM problem, up to the point that the exact theoretical phase transition for generic recoverability can be observed. Likewise, this suggests that non convexity is less substantial and problematic for the log det approach than it might initially appear.


A quantum shuffle approach to quantum determinants. Let bigwedge sigma V bigoplus k geq 0 bigwedge sigma kV be the quantum exterior algebra associated to a finite dimensional braided vector space (V, sigma) . For an algebra mathfrak A , we consider the convolution product on the graded space bigoplus k geq 0 mathrm Hom big( bigwedge sigma kV, bigwedge sigma kV otimes mathfrak A big) . Using this product, we define a notion of quantum minor determinant of a map from V to V otimes mathfrak A , which coincides with the classical one in the case that mathfrak A is the FRT algebra corresponding to U q( mathfrak sl N) . We establish quantum Laplace expansion formulas and multiplicative formulas for these determinants.


DISC A Dynamic Shape Compiler for Machine Learning Workloads. Many recent machine learning models show dynamic shape characteristics. However, existing AI compiler optimization systems suffer a lot from problems brought by dynamic shape models, including compilation overhead, memory usage, optimization pipeline and deployment complexity. This paper provides a compiler system to natively support optimization for dynamic shape workloads, named DISC. DISC enriches a set of IR to form a fully dynamic shape representation. It generates the runtime flow at compile time to support processing dynamic shape based logic, which avoids the interpretation overhead at runtime and enlarges the opportunity of host device co optimization. It addresses the kernel fusion problem of dynamic shapes with shape propagation and constraints collecting methods. This is the first work to demonstrate how to build an end to end dynamic shape compiler based on MLIR infrastructure. Experiments show that DISC achieves up to 3.3x speedup than TensorFlow PyTorch, and 1.8x than Nimble.


Derived isogenies and isogenies for abelian surfaces. In this paper, we study the twisted Fourier Mukai partners of abelian surfaces. Following the work of Huybrechts doi 10.4171 CMH 465 , we introduce the twisted derived equivalence between abelian surfaces. We show that there is a twisted derived Torelli theorem for abelian surfaces over algebraically closed fields with characteristic neq 2,3 . Over complex numbers, the derived isogenies correspond to rational Hodge isometries between the second cohomology groups, which is in analogy to the work of Huybrechts and Fu Vial on K3 surfaces. Their proof relies on the global Torelli theorem over mathbb C , which is missing in positive characteristics. To overcome this issue, we firstly extend a trick given by Shioda on integral Hodge structures, to rational Hodge structures, ell adic Tate modules and F crystals. Then we make use of Tate's isogeny theorem to give a characterization of the twisted derived equivalences between abelian surfaces via isogenies. As a consequence, we show the two abelian surfaces are principally isogenous if and only if they are derived isogenous.


Liouville theorems for parabolic systems with homogeneous nonlinearities and gradient structure. Liouville theorems for scaling invariant nonlinear parabolic equations and systems (saying that the equation or system does not possess nontrivial entire solutions) guarantee optimal universal estimates of solutions of related initial and initial boundary value problems. Assume that p 1 is subcritical in the Sobolev sense. In the case of nonnegative solutions and the system U t Delta U F(U) quad hbox in quad mathbb R n times mathbb R , where U (u 1, dots,u N) , F nabla G is p homogeneous and satisfies the positivity assumptions G(U) 0 for U neq0 and xi cdot F(U) 0 for some xi in mathbb R N and all U geq0 , U ne 0 , it has recently been shown in P. Quittner, Duke Math. J. 170 (2021), 1113 1136 that the parabolic Liouville theorem is true whenever the corresponding elliptic Liouville theorem for the system Delta U F(U) is true. By modifying the arguments in that proof we show that the same result remains true without the positivity assumptions on G and F , and that the class of solutions can also be enlarged to contain (some or all) sign changing solutions. In particular, in the scalar case N 1 and F(u) u p 1 u , our results cover the main result in T. Bartsch, P. Polacik and P. Quittner, J. European Math. Soc. 13 (2011), 219 247 . We also prove a parabolic Liouville theorem for solutions in mathbb R n times mathbb R satisfying homogeneous Dirichlet boundary conditions on partial mathbb R n times mathbb R since such theorem is also needed if one wants to prove universal estimates of solutions of related systems in Omega times(0,T) , where Omega subset mathbb R n is a smooth domain. Finally, we use our Liouville theorems to prove universal estimates for particular parabolic systems.


Multi index ensemble Kalman filtering. In this work we marry multi index Monte Carlo with ensemble Kalman filtering (EnKF) to produce the multi index EnKF method (MIEnKF). The MIEnKF method is based on independent samples of four coupled EnKF estimators on a multi index hierarchy of resolution levels, and it may be viewed as an extension of the multilevel EnKF (MLEnKF) method developed by the same authors in 2020. Multi index here refers to a two index method, consisting of a hierarchy of EnKF estimators that are coupled in two degrees of freedom time discretization and ensemble size. Under certain assumptions, the MIEnKF method is proven to be more tractable than EnKF and MLEnKF, and this is also verified in numerical examples.


Super resolved Second Harmonic Generation Imaging by Coherent Image Scanning Microscopy. We extend image scanning microscopy to second harmonic generation (SHG) by extracting the complex field amplitude of the second harmonic beam. While the theory behind coherent image scanning microscopy (ISM) is known, an experimental demonstration wasn't yet established. The main reason is that the naive intensity reassignment procedure cannot be used for coherent scattering as the point spread function is now defined for the field amplitude rather than for the intensity. We use an inline interferometer to demonstrate super resolved phase sensitive SHG microscopy by applying the ISM reassignment machinery on the resolved field. This scheme can be easily extended to third harmonic generation and stimulated Raman microscopy schemes.


Convex minorants and the fluctuation theory of L 'evy processes. We establish a novel characterisation of the law of the convex minorant of any L 'evy process. Our self contained elementary proof is based on the analysis of piecewise linear convex functions and requires only very basic properties of L 'evy processes. Our main result provides a new simple and self contained approach to the fluctuation theory of L 'evy processes, circumventing local time and excursion theory. Easy corollaries include classical theorems, such as Rogozin's regularity criterion, Spitzer's identities and the Wiener Hopf factorisation, as well as a novel factorisation identity.


Turning the Tables The View from Offshore During 60 Days in JST. A report and examination of a Remote Work experience during the Covid 19 pandemic encompassing a 14 hour time difference from the primary work location. Advantages and disadvantages of a globally distributed work experience as compared to an aligned time zone are explored. Logistical aspects of the arrangement are provided as well as the management support, peer reaction, and relative productivity. Recommendations are also provided on how to improve future geographically diverse team arrangements. Keywords Global Software Development, Offshore Development, Software Engineering, IT Management, Remote Work, Remote Office Design, Distributed Communications, Collaboration Technology, Team Management, Research, Development, Productivity


Saved by the rook a case of matchings and Hamiltonian cycles. The rook graph is a graph whose edges represent all the possible legal moves of the rook chess piece on a chessboard. The problem we consider is the following. Given any set M containing pairs of cells such that each cell of the m 1 times m 2 chessboard is in exactly one pair, we determine the values of the positive integers m 1 and m 2 for which it is possible to construct a closed tour of all the cells of the chessboard which uses all the pairs of cells in M and some edges of the rook graph. This is an alternative formulation of a graph theoretical problem presented in Electron. J. Combin. 28(1) (2021), P1.7 involving the Cartesian product G of two complete graphs K m 1 and K m 2 , which is, in fact, isomorphic to the m 1 times m 2 rook graph. The problem revolves around determining the values of the parameters m 1 and m 2 that would allow any perfect matching of the complete graph on the same vertex set of G to be extended to a Hamiltonian cycle by using only edges in G .


Striking a new balance in accuracy and simplicity with the Probabilistic Inductive Miner. Numerous process discovery techniques exist for generating process models that describe recorded executions of business processes. The models are meant to generalize executions into human understandable modeling patterns, notably parallelism, and enable rigorous analysis of process deviations. However, well defined models with parallelism returned by existing techniques are often too complex or generalize the recorded behavior too strongly to be trusted in a practical business context. We bridge this gap by introducing the Probabilistic Inductive Miner (PIM) based on the Inductive Miner framework. PIM compares in each step the most probable operators and structures based on frequency information in the data, which results in block structured models with significantly higher accuracy. All design choices in PIM are based on business context requirements obtained through a user study with industrial process mining experts. PIM is evaluated quantitatively and in an novel kind of empirical study comparing users' trust in discovered model structures. The evaluations show that PIM strikes a unique trade off between model accuracy and model complexity, that is conclusively preferred by users over all state of the art process discovery methods.


On the Uncertain Single View Depths in Endoscopies. Estimating depth from endoscopic images is a pre requisite for a wide set of AI assisted technologies, namely accurate localization, measurement of tumors, or identification of non inspected areas. As the domain specificity of colonoscopies a deformable low texture environment with fluids, poor lighting conditions and abrupt sensor motions pose challenges to multi view approaches, single view depth learning stands out as a promising line of research. In this paper, we explore for the first time Bayesian deep networks for single view depth estimation in colonoscopies. Their uncertainty quantification offers great potential for such a critical application area. Our specific contribution is two fold 1) an exhaustive analysis of Bayesian deep networks for depth estimation in three different datasets, highlighting challenges and conclusions regarding synthetic to real domain changes and supervised vs. self supervised methods and 2) a novel teacher student approach to deep depth learning that takes into account the teacher uncertainty.


Layering and vertical transport in sheared double diffusive convection in the diffusive regime. A sequence of two and three dimensional simulations is conducted for the double diffusive convection (DDC) flows in the diffusive regime subjected to an imposed shear. The flow is confined between two horizontal plates which are maintained at different constant temperature, salinity, and different velocity, thus setting up a shear across the flow. The lower plate is fixed at higher temperature and salinity, while the overall (unperturbed) density gradient is statically stable. For a wide range of control parameters, and for sufficiently strong perturbation of the conductive initial state, we find that staircase like structures spontaneously develop, with relatively well mixed layers separated by sharp interfaces of enhanced scalar gradient. Such staircases appear to be robust even in the presence of strong shear over very long times, although we typically observe early time coarsening of the number of observed layers. For the same set of control parameters, different asymptotic layered states, with markedly different vertical scalar fluxes, can arise for different initial perturbation structures. The imposed shear does significantly spatio temporally modify the vertical transport of the various scalars. The flux ratio (i.e., the ratio between the density fluxes due to the total (convective and diffusive) salt flux and the total heat flux) is found, at steady state, to be essentially equal to the square root of the ratio of the salt diffusivity to the thermal diffusivity, consistently with the physical model originally proposed by Linden and Shirtcliffe (1978) and the variational arguments presented by Stern (1982) for unsheared double diffusive convection.


NL CNN A Resources Constrained Deep Learning Model based on Nonlinear Convolution. A novel convolution neural network model, abbreviated NL CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution nonlinearity layers. The code for its implementation and some trained models are made publicly available. Performance evaluation for several widely known datasets is provided, showing several relevant features i) for small medium input image sizes the proposed network gives very good testing accuracy, given a low implementation complexity and model size ii) compares favorably with other widely known resources constrained models, for instance in comparison to MobileNetv2 provides better accuracy with several times less training times and up to ten times less parameters (memory occupied by the model) iii) has a relevant set of hyper parameters which can be easily and rapidly tuned due to the fast training specific to it. All these features make NL CNN suitable for IoT, smart sensing, bio medical portable instrumentation and other applications where artificial intelligence must be deployed in energy constrained environments.


Denoised Internal Models a Brain Inspired Autoencoder against Adversarial Attacks. Despite its great success, deep learning severely suffers from robustness that is, deep neural networks are very vulnerable to adversarial attacks, even the simplest ones. Inspired by recent advances in brain science, we propose the Denoised Internal Models (DIM), a novel generative autoencoder based model to tackle this challenge. Simulating the pipeline in the human brain for visual signal processing, DIM adopts a two stage approach. In the first stage, DIM uses a denoiser to reduce the noise and the dimensions of inputs, reflecting the information pre processing in the thalamus. Inspired from the sparse coding of memory related traces in the primary visual cortex, the second stage produces a set of internal models, one for each category. We evaluate DIM over 42 adversarial attacks, showing that DIM effectively defenses against all the attacks and outperforms the SOTA on the overall robustness.


Introduction to Set Shaping Theory. In this article, we define the Set Shaping Theory whose goal is the study of the bijection functions that transform a set of strings into a set of equal size made up of strings of greater length. The functions that meet this condition are many but since the goal of this theory is the transmission of data, we have analyzed the function that minimizes the average information content. The results obtained show how this type of function can be useful in data compression.


Generalized Framework for Group Testing Queries, Feedbacks and Adversaries. In the Group Testing problem, the objective is to learn a subset K of some much larger domain N, using the shortest possible sequence of queries Q. A feedback to a query provides some information about the intersection between the query and subset K. Several specific feedbacks have been studied in the literature, often proving different formulas for the estimate of the query complexity of the problem, defined as the shortest length of queries' sequence solving Group Testing problem with specific feedback. In this paper we study what are the properties of the feedback that influence the query complexity of Group Testing and what is their measurable impact. We propose a generic framework that covers a vast majority of relevant settings considered in the literature, which depends on two fundamental parameters of the feedback input capacity alpha and output expressiveness beta . They upper bound the logarithm of the size of the feedback function domain and image, respectively. To justify the value of the framework, we prove upper bounds on query complexity of non adaptive, deterministic Group Testing under some "efficient" feedbacks, for minimum, maximum and general expressiveness, and complement them with a lower bound on all feedbacks with given parameters alpha, beta . Our upper bounds also hold if the feedback function could get an input twisted by a malicious adversary, in case the intersection of a query and the hidden set is bigger than the feedback capacity alpha . We also show that slight change in the feedback function may result in substantial worsening of the query complexity. Additionally, we analyze explicitly constructed randomized counterparts of the deterministic results. Our results provide some insights to what are the most useful bits of information an output restricted feedback could provide, and open a number of challenging research directions.


Interactions of Ions and Ultracold Neutral Atom Ensembles in Composite Optical Dipole Traps Developments and Perspectives. Ion atom interactions are a comparatively recent field of research that has drawn considerable attention due to its applications in areas including quantum chemistry and quantum simulations. In first experiments, atomic ions and neutral atoms have been successfully overlapped by devising hybrid apparatuses combining established trapping methods, Paul traps for ions and optical or magneto optical traps for neutral atoms, respectively. Since then, the field has seen considerable progress, but the inherent presence of radiofrequency (rf) fields in such hybrid traps was found to have a limiting impact on the achievable collision energies. Recently, it was shown that suitable combinations of optical dipole traps (ODTs) can be used for trapping both atoms and atomic ions alike, allowing to carry out experiments in absence of any rf fields. Here, we show that the expected cooling in such bichromatic traps is highly sensitive to relative position fluctuations between the two optical trapping beams, suggesting that this is the dominant mechanism limiting the currently observed cooling performance. We discuss strategies for mitigating these effects by using optimized setups featuring adapted ODT configurations. This includes proposed schemes that may mitigate three body losses expected at very low temperatures, allowing to access the quantum dominated regime of interaction.


The Oblique Boundary Value Problem for Monge Amp ere Equations. We study the good shape property of boundary sections of convex viscosity solutions to the oblique boundary value problem for Monge Amp ere equations. In the two dimensional case, we prove the global Schauder estimate, W 2,1 epsilon estimate and W 2,p estimate for the solutions. When the space dimension n geq 3 , we show that these estimates still hold if the solution is bounded from above by a quadratic function in the tangent direction. We also obtain an existence result for the viscous convex solutions of Monge Amp ere equations with Robin oblique boundary conditions.


Defender Policy Evaluation and Resource Allocation Using MITRE ATT CK Evaluations Data. Protecting against multi step attacks of uncertain duration and timing forces defenders into an indefinite, always ongoing, resource intensive response. To effectively allocate resources, a defender must be able to analyze multi step attacks under assumption of constantly allocating resources against an uncertain stream of potentially undetected attacks. To achieve this goal, we present a novel methodology that applies a game theoretic approach to the attack, attacker, and defender data derived from MITRE's ATT CK Framework. Time to complete attack steps is drawn from a probability distribution determined by attacker and defender strategies and capabilities. This constraints attack success parameters and enables comparing different defender resource allocation strategies. By approximating attacker defender games as Markov processes, we represent the attacker defender interaction, estimate the attack success parameters, determine the effects of attacker and defender strategies, and maximize opportunities for defender strategy improvements against an uncertain stream of attacks. This novel representation and analysis of multi step attacks enables defender policy optimization and resource allocation, which we illustrate using the data from MITRE's APT3 ATT CK Evaluations.


NASI Label and Data agnostic Neural Architecture Search at Initialization. Recent years have witnessed a surging interest in Neural Architecture Search (NAS). Various algorithms have been proposed to improve the search efficiency and effectiveness of NAS, i.e., to reduce the search cost and improve the generalization performance of the selected architectures, respectively. However, the search efficiency of these algorithms is severely limited by the need for model training during the search process. To overcome this limitation, we propose a novel NAS algorithm called NAS at Initialization (NASI) that exploits the capability of a Neural Tangent Kernel in being able to characterize the converged performance of candidate architectures at initialization, hence allowing model training to be completely avoided to boost the search efficiency. Besides the improved search efficiency, NASI also achieves competitive search effectiveness on various datasets like CIFAR 10 100 and ImageNet. Further, NASI is shown to be label and data agnostic under mild conditions, which guarantees the transferability of architectures selected by our NASI over different datasets.


Localization with Directional Coordinates. A coordinate system is proposed that replaces the usual three dimensional Cartesian x,y,z position coordinates, for use in robotic localization applications. Range, azimuth, and elevation measurement models become greatly simplified, and, unlike spherical coordinates, the proposed coordinates do not suffer from the same kinematic singularities and angle wrap around. When compared to Cartesian coordinates, the proposed coordinate system results in a significantly enhanced ability to represent the true distribution of robot positions, ultimately leading to large improvements in state estimation consistency.


The closures of wreath products in product action. Let m be a positive integer and let Omega be a finite set. The m closure of G le Sym ( Omega) is the largest permutation group on Omega having the same orbits as G in its induced action on the Cartesian product Omega m . The exact formula for the m closure of the wreath product in product action is given. As a corollary, a sufficient condition is obtained for this m closure to be included in the wreath product of the m closures of the factors.


A triangular field of rational numbers related to Stirling numbers and Hyperbolic functions. A triangular field of rational numbers is characterized, with relations to Stirling numbers 2nd, Hyperbolic functions, and centered Binomial distribution. A Generating function is given.


Neural Network Guided Evolutionary Fuzzing for Finding Traffic Violations of Autonomous Vehicles. Self driving cars and trucks, autonomous vehicles (AVs), should not be accepted by regulatory bodies and the public until they have much higher confidence in their safety and reliability which can most practically and convincingly be achieved by testing. But existing testing methods are inadequate for checking the end to end behaviors of AV controllers against complex, real world corner cases involving interactions with multiple independent agents such as pedestrians and human driven vehicles. While test driving AVs on streets and highways fails to capture many rare events, existing simulation based testing methods mainly focus on simple scenarios and do not scale well for complex driving situations that require sophisticated awareness of the surroundings. To address these limitations, we propose a new fuzz testing technique, called AutoFuzz, which can leverage widely used AV simulators' API grammars. To generate semantically and temporally valid complex driving scenarios (sequences of scenes). AutoFuzz is guided by a constrained Neural Network (NN) evolutionary search over the API grammar to generate scenarios seeking to find unique traffic violations. Evaluation of our prototype on one state of the art learning based controller, two rule based controllers, and one industrial grade controller shows that AutoFuzz efficiently finds hundreds of traffic violations in high fidelity simulation environments. Further, fine tuning the learning based controller with the traffic violations found by AutoFuzz successfully reduced the traffic violations found in the new version of the AV controller software.


IPS300 a Challenging Multimodal Dataset for Intersection Perception System. Due to the high complexity and occlusion, insufficient perception in the crowded urban intersection can be a serious safety risk for both human drivers and autonomous algorithms, whereas CVIS (Cooperative Vehicle Infrastructure System) is a proposed solution for full participants perception in this scenario. However, the research on roadside multimodal perception is still in its infancy, and there is no open source dataset for such scenario. Accordingly, this paper fills the gap. Through an IPS (Intersection Perception System) installed at the diagonal of the intersection, this paper proposes a high quality multimodal dataset for the intersection perception task. The center of the experimental intersection covers an area of 3000m2, and the extended distance reaches 300m, which is typical for CVIS. The first batch of open source data includes 14198 frames, and each frame has an average of 319.84 labels, which is 9.6 times larger than the most crowded dataset (H3D dataset in 2019) by now. In order to facilitate further study, this dataset tries to keep the label documents consistent with the KITTI dataset, and a standardized benchmark is created for algorithm evaluation. Our dataset is available at http www.openmpd.com column other datasets.


Nirikshak An Autonomous Testing Framework. Quality Assurance (QA) is an important part of any product. But even with automated methods of software testing, QA is mostly a set of repetitive tasks. A lot of time, energy, and resources are spent in writing tests than in realizing the bugs themselves and the traditional process does not scale well to changes in the software. With advances in data science, it is theoretically possible to have an autonomous testing framework. Such a framework would need minimal user input and will be able to perform the complete testing process by itself. This project is an effort to make such a framework.


A distillation based approach for the diagnosis of diseases. Presently, Covid 19 is a serious threat to the world at large. Efforts are being made to reduce disease screening times and in the development of a vaccine to resist this disease, even as thousands succumb to it everyday. We propose a novel method of automated screening of diseases like Covid 19 and pneumonia from Chest X Ray images with the help of Computer Vision. Unlike computer vision classification algorithms which come with heavy computational costs, we propose a knowledge distillation based approach which allows us to bring down the model depth, while preserving the accuracy. We make use of an augmentation of the standard distillation module with an auxiliary intermediate assistant network that aids in the continuity of the flow of information. Following this approach, we are able to build an extremely light student network, consisting of just 3 convolutional blocks without any compromise on accuracy. We thus propose a method of classification of diseases which can not only lead to faster screening, but can also operate seamlessly on low end devices.


GKS Graph based Knowledge Selector for Task oriented Dialog System. In previous research, knowledge selection tasks mostly rely on language model based methods or knowledge ranking. However, while approaches that rely on the language models take all knowledge as sequential input, knowledge does not contain sequential information in most circumstances. On the other hand, the knowledge ranking methods leverage dialog history and each given knowledge snippet separately, but they do not consider information between knowledge snippets. In the Tenth Dialog System Technology Challenges (DSTC10), we participated in the second Knowledge grounded Task oriented Dialogue Modeling on Spoken Conversations. To deal with the problems mentioned above, we modified training methods based on state of the art (SOTA) models for the first and third sub tasks. As for the second sub task of knowledge selection, we proposed Graph Knowledge Selector (GKS), utilizing a graph attention base model incorporated with the language model. GKS makes knowledge selection decisions in the dialog by simultaneously considering each knowledge embedding generated from the language model without sequential features. Moreover, GKS leverages considerable knowledge in decision making and takes relations across knowledge as part of the selection process. As a result, GKS outperforms several SOTA models proposed in the data set on knowledge selection from the Ninth Dialog System Technology Challenges (DSTC9).


Vulnerability and Transaction behavior based detection of Malicious Smart Contracts. Smart Contracts (SCs) in Ethereum can automate tasks and provide different functionalities to a user. Such automation is enabled by the Turing complete' nature of the programming language (Solidity) in which SCs are written. This also opens up different vulnerabilities and bugs in SCs that malicious actors exploit to carry out malicious or illegal activities on the cryptocurrency platform. In this work, we study the correlation between malicious activities and the vulnerabilities present in SCs and find that some malicious activities are correlated with certain types of vulnerabilities. We then develop and study the feasibility of a scoring mechanism that corresponds to the severity of the vulnerabilities present in SCs to determine if it is a relevant feature to identify suspicious SCs. We analyze the utility of severity score towards detection of suspicious SCs using unsupervised machine learning (ML) algorithms across different temporal granularities and identify behavioral changes. In our experiments with on chain SCs, we were able to find a total of 1094 benign SCs across different granularities which behave similar to malicious SCs, with the inclusion of the smart contract vulnerability scores in the feature set.


Iterative and greedy algorithms for the sparsity in levels model in compressed sensing. Motivated by the question of optimal functional approximation via compressed sensing, we propose generalizations of the Iterative Hard Thresholding and the Compressive Sampling Matching Pursuit algorithms able to promote sparse in levels signals. We show, by means of numerical experiments, that the proposed algorithms are successfully able to outperform their unstructured variants when the signal exhibits the sparsity structure of interest. Moreover, in the context of piecewise smooth function approximation, we numerically demonstrate that the structure promoting decoders outperform their unstructured variants and the basis pursuit program when the encoder is structure agnostic.


Data Analytics for Smart cities Challenges and Promises. The explosion of advancements in artificial intelligence, sensor technologies, and wireless communication activates ubiquitous sensing through distributed sensors. These sensors are various domains of networks that lead us to smart systems in healthcare, transportation, environment, and other relevant branches networks. Having collaborative interaction among the smart systems connects end user devices to each other which enables achieving a new integrated entity called Smart Cities. The goal of this study is to provide a comprehensive survey of data analytics in smart cities. In this paper, we aim to focus on one of the smart cities important branches, namely Smart Mobility, and its positive ample impact on the smart cities decision making process. Intelligent decision making systems in smart mobility offer many advantages such as saving energy, relaying city traffic, and more importantly, reducing air pollution by offering real time useful information and imperative knowledge. Making a decision in smart cities in time is challenging due to various and high dimensional factors and parameters, which are not frequently collected. In this paper, we first address current challenges in smart cities and provide an overview of potential solutions to these challenges. Then, we offer a framework of these solutions, called universal smart cities decision making, with three main sections of data capturing, data analysis, and decision making to optimize the smart mobility within smart cities. With this framework, we elaborate on fundamental concepts of big data, machine learning, and deep leaning algorithms that have been applied to smart cities and discuss the role of these algorithms in decision making for smart mobility in smart cities.


Category theoretical Semantics of the Description Logic ALC (extended version). Category theory can be used to state formulas in First Order Logic without using set membership. Several notable results in logic such as proof of the continuum hypothesis can be elegantly rewritten in category theory. We propose in this paper a reformulation of the usual set theoretical semantics of the description logic mathcal ALC by using categorical language. In this setting, ALC concepts are represented as objects, concept subsumptions as arrows, and memberships as logical quantifiers over objects and arrows of categories. Such a category theoretical semantics provides a more modular representation of the semantics of mathcal ALC and a new way to design algorithms for reasoning.


Sensor invariant Fingerprint ROI Segmentation Using Recurrent Adversarial Learning. A fingerprint region of interest (roi) segmentation algorithm is designed to separate the foreground fingerprint from the background noise. All the learning based state of the art fingerprint roi segmentation algorithms proposed in the literature are benchmarked on scenarios when both training and testing databases consist of fingerprint images acquired from the same sensors. However, when testing is conducted on a different sensor, the segmentation performance obtained is often unsatisfactory. As a result, every time a new fingerprint sensor is used for testing, the fingerprint roi segmentation model needs to be re trained with the fingerprint image acquired from the new sensor and its corresponding manually marked ROI. Manually marking fingerprint ROI is expensive because firstly, it is time consuming and more importantly, requires domain expertise. In order to save the human effort in generating annotations required by state of the art, we propose a fingerprint roi segmentation model which aligns the features of fingerprint images derived from the unseen sensor such that they are similar to the ones obtained from the fingerprints whose ground truth roi masks are available for training. Specifically, we propose a recurrent adversarial learning based feature alignment network that helps the fingerprint roi segmentation model to learn sensor invariant features. Consequently, sensor invariant features learnt by the proposed roi segmentation model help it to achieve improved segmentation performance on fingerprints acquired from the new sensor. Experiments on publicly available FVC databases demonstrate the efficacy of the proposed work.


A Self adaptive Weighted Differential Evolution Approach for Large scale Feature Selection. Recently, many evolutionary computation methods have been developed to solve the feature selection problem. However, the studies focused mainly on small scale issues, resulting in stagnation issues in local optima and numerical instability when dealing with large scale feature selection dilemmas. To address these challenges, this paper proposes a novel weighted differential evolution algorithm based on self adaptive mechanism, named SaWDE, to solve large scale feature selection. First, a multi population mechanism is adopted to enhance the diversity of the population. Then, we propose a new self adaptive mechanism that selects several strategies from a strategy pool to capture the diverse characteristics of the datasets from the historical information. Finally, a weighted model is designed to identify the important features, which enables our model to generate the most suitable feature selection solution. We demonstrate the effectiveness of our algorithm on twelve large scale datasets. The performance of SaWDE is superior compared to six non EC algorithms and six other EC algorithms, on both training and test datasets and on subset size, indicating that our algorithm is a favorable tool to solve the large scale feature selection problem. Moreover, we have experimented SaWDE with six EC algorithms on twelve higher dimensional data, which demonstrates that SaWDE is more robust and efficient compared to those state of the art methods. SaWDE source code is available on Github at https github.com wangxb96 SaWDE.


Large Scale Analysis of Multitasking Behavior During Remote Meetings. Virtual meetings are critical for remote work because of the need for synchronous collaboration in the absence of in person interactions. In meeting multitasking is closely linked to people's productivity and wellbeing. However, we currently have limited understanding of multitasking in remote meetings and its potential impact. In this paper, we present what we believe is the most comprehensive study of remote meeting multitasking behavior through an analysis of a large scale telemetry dataset collected from February to May 2020 of U.S. Microsoft employees and a 715 person diary study. Our results demonstrate that intrinsic meeting characteristics such as size, length, time, and type, significantly correlate with the extent to which people multitask, and multitasking can lead to both positive and negative outcomes. Our findings suggest important best practice guidelines for remote meetings (e.g., avoid important meetings in the morning) and design implications for productivity tools (e.g., support positive remote multitasking).


On the well posedness problem for the derivative nonlinear Schr "odinger equation. We consider the derivative nonlinear Schr "odinger equation in one space dimension, posed both on the line and on the circle. This model is known to be completely integrable and L 2 critical with respect to scaling. The first question we discuss is whether ensembles of orbits with L 2 equicontinuous initial data remain equicontinuous under evolution. We prove that this is true under the restriction M(q) int q 2 4 pi . We conjecture that this restriction is unnecessary. Further, we prove that the problem is globally well posed for initial data in H 1 6 under the same restriction on M . Moreover, we show that this restriction would be removed by a successful resolution of our equicontinuity conjecture.


Sharp thresholds limit the benefit of defector avoidance in cooperation on networks. Consider a cooperation game on a spatial network of habitat patches, where players can relocate between habitats if they judge the local conditions to be unfavorable. In time, the relocation events may lead to a homogeneous state where all patches harbor the same densities of cooperators and defectors or they may lead to self organized patterns, where some patches become safe havens that maintain a high cooperator density. Here we analyze the transition between these states mathematically. We show that safe havens form once a certain threshold in connectivity is crossed. This threshold can be analytically linked to the structure of the patch network and specifically to certain network motifs. Surprisingly, a forgiving defector avoidance strategy may be most favorable for cooperators. Our results demonstrate that the analysis of cooperation games in ecologically inspired metacommunity models is mathematically tractable and has the potential to link diverse topics such as macroecological patterns, behavioral evolution, and network topology.


R 'enyi Divergence in General Hidden Markov Models. In this paper, we examine the existence of the R 'enyi divergence between two time invariant general hidden Markov models with arbitrary positive initial distributions. By making use of a Markov chain representation of the probability distribution for the general hidden Markov model and eigenvalue for the associated Markovian operator, we obtain, under some regularity conditions, convergence of the R 'enyi divergence. By using this device, we also characterize the R 'enyi divergence, and obtain the Kullback Leibler divergence as alpha rightarrow 1 of the R 'enyi divergence. Several examples, including the classical finite state hidden Markov models, Markov switching models, and recurrent neural networks, are given for illustration. Moreover, we develop a non Monte Carlo method that computes the R 'enyi divergence of two state Markov switching models via the underlying invariant probability measure, which is characterized by the Fredholm integral equation.


PIETOOLS 2020a User Manual. PIETOOLS 2020a manual is a document that describes all the features of the first release of MATLAB toolbox for analysis and control of Partial Integral Equations (PIEs). The manual is aimed to guide, with examples, the first time users to three basic features of PIETOOLS converting coupled ODE PDEs, DDEs, DDFs, etc., to PIE representation analysis of stability and input output properties of PIEs design of optimal observers and controllers for PIEs. The use of PIETOOLS is not limited to the features described above, however, the manual focuses of these features to provide an holistic understanding of the workflow of PIETOOLS which will serve as a foundation to develop more complicated programs, for example design of boundary feedback controllers, robust observers, robust controllers, etc.


A SOM based Gradient Free Deep Learning Method with Convergence Analysis. As gradient descent method in deep learning causes a series of questions, this paper proposes a novel gradient free deep learning structure. By adding a new module into traditional Self Organizing Map and introducing residual into the map, a Deep Valued Self Organizing Map network is constructed. And analysis about the convergence performance of such a deep Valued Self Organizing Map network is proved in this paper, which gives an inequality about the designed parameters with the dimension of inputs and the loss of prediction.


Grouping Search Results with Product Graphs in E commerce Platforms. Showing relevant search results to the user is the primary challenge for any search system. Walmart e commerce provides an omnichannel search platform to its customers to search from millions of products. This search platform takes a textual query as input and shows relevant items from the catalog. One of the primary challenges is that this queries are complex to understand as it contains multiple intent in many cases. This paper proposes a framework to group search results into multiple ranked lists intending to provide better user intent. The framework is to create a product graph having relations between product entities and utilize it to group search results into a series of stacks where each stack provides a group of items based on a precise intent. As an example, for a query "milk," the results can be grouped into multiple stacks of "white milk", "low fat milk", "almond milk", "flavored milk". We measure the impact of our algorithm by evaluating how it improves the user experience both in terms of search quality relevance and user behavioral signals like Add To Cart.


Residues and obstructions for log symplectic manifolds. We consider compact K "ahlerian manifolds X of even dimension 4 or more, endowed with a log symplectic structure Phi , a generically nondegenerate closed 2 form with simple poles on a divisor D with local normal crossings. A simple linear inequality involving the iterated Poincar 'e residues of Phi at components of the double locus of D ensures that the pair (X, Phi) has unobstructed deformations and that D deforms locally trivially.


The indecomposable objects in the center of Deligne's category Rep(S t) . We classify the indecomposable objects in the monoidal center of Deligne's interpolation category Rep(S t) by viewing Rep(S t) as a model theoretic limit in rank and characteristic. We further prove that the center of Rep(S t) is semisimple if and only if t is not a non negative integer. In addition, we identify the associated graded Grothendieck ring of this monoidal center with that of the graded sum of the centers of representation categories of finite symmetric groups with an induction product.


An Experiment Study on Federated LearningTestbed. While the Internet of Things (IoT) can benefit from machine learning by outsourcing model training on the cloud, user data exposure to an untrusted cloud service provider can pose threat to user privacy. Recently, federated learning is proposed as an approach for privacy preserving machine learning (PPML) for the IoT, while its practicability remains unclear. This work presents the evaluation on the efficiency and privacy performance of a readily available federated learning framework based on PySyft, a Python library for distributed deep learning. It is observed that the training speed of the framework is significantly slower than of the centralized approach due to communication overhead. Meanwhile, the framework bears some vulnerability to potential man in the middle attacks at the network level. The report serves as a starting point for PPML performance analysis and suggests the future direction for PPML framework development.


Counting 3 dimensional algebraic tori over mathbb Q . In this paper we count the number N 3 text tor (X) of 3 dimensional algebraic tori over mathbb Q whose Artin conductor is bounded by X . We prove that N 3 text tor (X) ll varepsilon X 1 frac log 2 varepsilon log log X , and this upper bound can be improved to N 3 text tor (X) ll X ( log X) 4 log log X under the Cohen Lenstra heuristics for p 3 . We also prove that for 67 out of 72 conjugacy classes of finite nontrivial subgroups of operatorname GL 3( mathbb Z ) , Malle's conjecture for tori over mathbb Q holds up to a bounded power of log X under the Cohen Lenstra heuristics for p 3 and Malle's conjecture for quartic A 4 fields.


Relative Cubulation of Small Cancellation Free Products. We expand the class of groups with relatively geometric actions on CAT(0) cube complexes by proving that it is closed under C'( frac16) small cancellation free products. We build upon a result of Martin and Steenbock who prove an analogous result in the more specialized setting of groups acting properly and cocompactly on Gromov hyperbolic CAT(0) cube complexes. Our methods make use of the same blown up complex of groups to construct a candidate collection of walls. However, rather than arguing geometrically, we show relative cubulation by appealing to a boundary separation criterion of Einstein and Groves and proving that wall stabilizers form a sufficiently rich family of full relatively quasi convex codimension one subgroups. The additional flexibility of relatively geometric actions has surprising new applications. For example, we prove that C'( frac16) small cancellation free products of residually finite groups are residually finite.


Can multi label classification networks know what they don't know?. Estimating out of distribution (OOD) uncertainty is a central challenge for safely deploying machine learning models in the open world environment. Improved methods for OOD detection in multi class classification have emerged, while OOD detection methods for multi label classification remain underexplored and use rudimentary techniques. We propose JointEnergy, a simple and effective method, which estimates the OOD indicator scores by aggregating energy scores from multiple labels. We show that JointEnergy can be mathematically interpreted from a joint likelihood perspective. Our results show consistent improvement over previous methods that are based on the maximum valued scores, which fail to capture joint information from multiple labels. We demonstrate the effectiveness of our method on three common multi label classification benchmarks, including MS COCO, PASCAL VOC, and NUS WIDE. We show that JointEnergy can reduce the FPR95 by up to 10.05 compared to the previous best baseline, establishing state of the art performance.


VIRAL SLAM Tightly Coupled Camera IMU UWB Lidar SLAM. In this paper, we propose a tightly coupled, multi modal simultaneous localization and mapping (SLAM) framework, integrating an extensive set of sensors IMU, cameras, multiple lidars, and Ultra wideband (UWB) range measurements, hence referred to as VIRAL (visual inertial ranging lidar) SLAM. To achieve such a comprehensive sensor fusion system, one has to tackle several challenges such as data synchronization, multi threading programming, bundle adjustment (BA), and conflicting coordinate frames between UWB and the onboard sensors, so as to ensure real time localization and smooth updates in the state estimates. To this end, we propose a two stage approach. In the first stage, lidar, camera, and IMU data on a local sliding window are processed in a core odometry thread. From this local graph, new key frames are evaluated for admission to a global map. Visual feature based loop closure is also performed to supplement the global factor graph with loop constraints. When the global factor graph satisfies a condition on spatial diversity, the BA process will be triggered to update the coordinate transform between UWB and onboard SLAM systems. The system then seamlessly transitions to the second stage where all sensors are tightly integrated in the odometry thread. The capability of our system is demonstrated via several experiments on high fidelity graphical physical simulation and public datasets.


Effect of Strain Rate on Single Tau, Dimerized Tau and Tau Microtubule Interface a Molecular Dynamics Simulation Study. In this study, the mechanical behavior of single tau, dimerized tau, and tau microtubule interface subjected to high strain rate is investigated by molecular dynamics simulation.


Defective Ramsey Numbers and Defective Cocolorings in Some Subclasses of Perfect Graphs. In this paper, we investigate a variant of Ramsey numbers called defective Ramsey numbers where cliques and independent sets are generalized to k dense and k sparse sets, both commonly called k defective sets. We focus on the computation of defective Ramsey numbers restricted to some subclasses of perfect graphs. Since direct proof techniques are often insufficient for obtaining new values of defective Ramsey numbers, we provide a generic algorithm to compute defective Ramsey numbers in a given target graph class. We combine direct proof techniques with our efficient graph generation algorithm to compute several new defective Ramsey numbers in perfect graphs, bipartite graphs and chordal graphs. We also initiate the study of a related parameter, denoted by c mathcal G k(m) , which is the maximum order n such that the vertex set of any graph of order at n in a class mathcal G can be partitioned into at most m subsets each of which is k defective. We obtain several values for c mathcal G k(m) in perfect graphs and cographs.


VisuoSpatial Foresight for Physical Sequential Fabric Manipulation. Robotic fabric manipulation has applications in home robotics, textiles, senior care and surgery. Existing fabric manipulation techniques, however, are designed for specific tasks, making it difficult to generalize across different but related tasks. We build upon the Visual Foresight framework to learn fabric dynamics that can be efficiently reused to accomplish different sequential fabric manipulation tasks with a single goal conditioned policy. We extend our earlier work on VisuoSpatial Foresight (VSF), which learns visual dynamics on domain randomized RGB images and depth maps simultaneously and completely in simulation. In this earlier work, we evaluated VSF on multi step fabric smoothing and folding tasks against 5 baseline methods in simulation and on the da Vinci Research Kit (dVRK) surgical robot without any demonstrations at train or test time. A key finding was that depth sensing significantly improves performance RGBD data yields an 80 improvement in fabric folding success rate in simulation over pure RGB data. In this work, we vary 4 components of VSF, including data generation, visual dynamics model, cost function, and optimization procedure. Results suggest that training visual dynamics models using longer, corner based actions can improve the efficiency of fabric folding by 76 and enable a physical sequential fabric folding task that VSF could not previously perform with 90 reliability. Code, data, videos, and supplementary material are available at https sites.google.com view fabric vsf .


Proceedings Seventh Workshop on Proof eXchange for Theorem Proving. This volume of EPTCS contains the proceedings of the Seventh Workshop on Proof Exchange for Theorem Proving (PxTP 2021), held on 11 July 2021 as part of the CADE 28 online conference in Pittsburgh, USA. The PxTP workshop series brings together researchers working on various aspects of communication, integration, and cooperation between reasoning systems and formalisms, with a special focus on proofs. The progress in computer aided reasoning, both automated and interactive, during the past decades, made it possible to build deduction tools that are increasingly more applicable to a wider range of problems and are able to tackle larger problems progressively faster. In recent years, cooperation between such tools in larger systems has demonstrated the potential to reduce the amount of manual intervention. Cooperation between reasoning systems relies on availability of theoretical formalisms and practical tools to exchange problems, proofs, and models. The PxTP workshop series strives to encourage such cooperation by inviting contributions on all aspects of cooperation between reasoning tools, whether automatic or interactive.


Rationalization through Concepts. Automated predictions require explanations to be interpretable by humans. One type of explanation is a rationale, i.e., a selection of input features such as relevant text snippets from which the model computes the outcome. However, a single overall selection does not provide a complete explanation, e.g., weighing several aspects for decisions. To this end, we present a novel self interpretable model called ConRAT. Inspired by how human explanations for high level decisions are often based on key concepts, ConRAT extracts a set of text snippets as concepts and infers which ones are described in the document. Then, it explains the outcome with a linear aggregation of concepts. Two regularizers drive ConRAT to build interpretable concepts. In addition, we propose two techniques to boost the rationale and predictive performance further. Experiments on both single and multi aspect sentiment classification tasks show that ConRAT is the first to generate concepts that align with human rationalization while using only the overall label. Further, it outperforms state of the art methods trained on each aspect label independently.