Extractive Research Slide Generation Using Windowed Labeling Ranking. Presentation slides describing the content of scientific and technical papers are an efficient and effective way to present that work. However, manually generating presentation slides is labor intensive. We propose a method to automatically generate slides for scientific papers based on a corpus of 5000 paper slide pairs compiled from conference proceedings websites. The sentence labeling module of our method is based on SummaRuNNer, a neural sequence model for extractive summarization. Instead of ranking sentences based on semantic similarities in the whole document, our algorithm measures importance and novelty of sentences by combining semantic and lexical features within a sentence window. Our method outperforms several baseline methods including SummaRuNNer by a significant margin in terms of ROUGE score.


Exponential convergence to a steady state for a population genetics model with sexual reproduction and selection. We are interested in the dynamics of a population structured by a phenotypic trait. Individuals reproduce sexually, which is represented by a non linear integral operator. This operator is combined to a multiplicative operator representing selection. When the strength of selection is small, we show that the dynamics of the population is governed by a simple macroscopic differential equation, and that solutions converge exponentially to steady states that are locally unique. The analysis is based on Wasserstein distance inequalities using a uniform lower bound on distributions. These inequalities are coupled to tail estimates to show the stability of the steady states.


Discrete spectrum of zero order pseudodifferential operators. For a class of zero order pseudodifferential operators we find the asymptotics of eigenvalues converging to a non isolated tip of the essential spectrum.


ASK Adversarial Soft k Nearest Neighbor Attack and Defense. K Nearest Neighbor (kNN) based deep learning methods have been applied to many applications due to their simplicity and geometric interpretability. However, the robustness of kNN based classification models has not been thoroughly explored and kNN attack strategies are underdeveloped. In this paper, we propose an Adversarial Soft kNN (ASK) loss to both design more effective kNN attack strategies and to develop better defenses against them. Our ASK loss approach has two advantages. First, ASK loss can better approximate the kNN's probability of classification error than objectives proposed in previous works. Second, the ASK loss is interpretable it preserves the mutual information between the perturbed input and the in class reference data. We use the ASK loss to generate a novel attack method called the ASK Attack (ASK Atk), which shows superior attack efficiency and accuracy degradation relative to previous kNN attacks. Based on the ASK Atk, we then derive an ASK underline Def ense (ASK Def) method that optimizes the worst case training loss induced by ASK Atk. Experiments on CIFAR 10 (ImageNet) show that (i) ASK Atk achieves geq 13 ( geq 13 ) improvement in attack success rate over previous kNN attacks, and (ii) ASK Def outperforms the conventional adversarial training method by geq 6.9 ( geq 3.5 ) in terms of robustness improvement.


High performance computing on Android devices a case study. High performance computing for low power devices can be useful to speed up calculations on processors that use a lower clock rate than computers for which energy efficiency is not an issue. In this trial, different high performance techniques for Android devices have been compared, with a special focus on the use of the GPU. Although not officially supported, the OpenCL framework can be used on Android tablets. For the comparison of the different parallel programming paradigms, a benchmark was chosen that could be implemented easily with all frameworks. The Mandelbrot algorithm is computationally intensive and has very few input and output operations. The algorithm has been implemented in Java, C, C with assembler, C with SIMD assembler, C with OpenCL and scalar instructions and C with OpenCL and vector instructions. The implementations have been tested for all architectures currently supported by Android. High speedups can be achieved using SIMD and OpenCL, although the implementation is not straightforward for either one. Apps that use the GPU must account for the fact that they can be suspended by the user at any moment. In using the OpenCL framework on the GPU of Android devices, a computational power comparable to those of modern high speed CPUs can be made available to the software developer.


A posteriori error analysis for a space time parallel discretization of parabolic partial differential equations. We construct a space time parallel method for solving parabolic partial differential equations by coupling the Parareal algorithm in time with overlapping domain decomposition in space. The goal is to obtain a discretization consisting of "local" problems that can be solved on parallel computers efficiently. However, this introduces significant sources of error that must be evaluated. Reformulating the original Parareal algorithm as a variational method and implementing a finite element discretization in space enables an adjoint based a posteriori error analysis to be performed. Through an appropriate choice of adjoint problems and residuals the error analysis distinguishes between errors arising due to the temporal and spatial discretizations, as well as between the errors arising due to incomplete Parareal iterations and incomplete iterations of the domain decomposition solver. We first develop an error analysis for the Parareal method applied to parabolic partial differential equations, and then refine this analysis to the case where the associated spatial problems are solved using overlapping domain decomposition. These constitute our Time Parallel Algorithm (TPA) and Space Time Parallel Algorithm (STPA) respectively. Numerical experiments demonstrate the accuracy of the estimator for both algorithms and the iterations between distinct components of the error.


CoSQA 20,000 Web Queries for Code Search and Question Answering. Finding codes given natural language query isb eneficial to the productivity of software developers. Future progress towards better semantic matching between query and code requires richer supervised training resources. To remedy this, we introduce the CoSQA dataset.It includes 20,604 labels for pairs of natural language queries and codes, each annotated by at least 3 human annotators. We further introduce a contrastive learning method dubbed CoCLR to enhance query code matching, which works as a data augmenter to bring more artificially generated training instances. We show that evaluated on CodeXGLUE with the same CodeBERT model, training on CoSQA improves the accuracy of code question answering by 5.1 , and incorporating CoCLR brings a further improvement of 10.5 .


Validation Conceptual versus Activity Diagram Approaches. A conceptual model is used to support development and design within the area of systems and software modeling. The notion of validation refers to representing a domain in a model accurately and generating results using an executable model. In UML specifications, validation verifies the correctness of UML diagrams against any constraints and rules defined within the model. Currently, significant research has been conducted on generating test sets to validate that UML diagrams conform to requirements. UML activity diagrams are a specific focus of such efforts. An activity diagram is a flexible instrument for describing a system s behaviors and the internal logic of complex operations. This paper focuses on the notion of validation using activity diagrams and contrasts that process with a proposed method that involves an informal validation procedure. Accordingly, this informal validation involves comparing requirements to specifications expressed by a diagram of a modeling language called thinging machine (TM) modeling. The informal validation is a type of model checking that requires the model to be small enough for the verification to be done in a limited space or time period. In the proposed method, the model diagram is divided into subdiagrams to achieve this purpose. We claim the TM behavioral model comes with a particular dispositional structure that allows a designer to carve a model into smaller components for informal validation, which is shown through two case studies.


Action angle coordinates for surface group representations in genus zero. We study a family of compact components of totally elliptic representations of the fundamental group of a punctured sphere into PSL (2, mathbb R) discovered by Deroin Tholozan. We develop a polygonal model for the space of representations in terms of chains of triangles in the hyperbolic plane. This model makes explicit the symplectic toric nature of the space of representations described by Deroin Tholozan. We introduce action angle coordinates as geometric quantities associated to the chains of triangles. The coordinates give rise to an explicit isomorphism between the space of representations and the complex projective space. We prove that they are almost global Darboux coordinates for the Goldman symplectic form.


Digital History and History Teaching in the Digital Age. Digital technologies, such as the Internet and Artificial Intelligence, are part of our daily lives, influencing broader aspects of our way of life, as well as the way we interact with the past. Having dramatically changed the ways in which knowledge is produced and consumed, the algorithmic age has also radically changed the relationship that the general public has with History. Fields of History such as Public and Oral History have particularly benefitted from the rise of digital culture. How does our digital culture affect the way we think, study, research and teach the past, as historical evidence spreads rapidly in the public sphere? How do digital technologies promote the study, writing and teaching of History? What should historians, students of history and pre service history teachers be critically aware of, when swarmed with digitized or born digital content, constantly growing on the Internet? And while these changes are now visible globally, how is the discipline of History situated within the digital transformation rapidly advancing in Greece? Finally, what are the consequences of these changes for History as a subject taught at Greek secondary schools? These are some of the issues raised in the text that follows, which is part of the course materials of the undergraduate course offered during winter semester 2020 2021 at the School University of Athens, School of Philosophy, Pedagogy, Psychology. Course Title 'Pedagogics of History Theory and Practice', Academic Institution School of Philosophy Pedagogy Psychology, University of Athens.


Low Rank Subspaces in GANs. The latent space of a Generative Adversarial Network (GAN) has been shown to encode rich semantics within some subspaces. To identify these subspaces, researchers typically analyze the statistical information from a collection of synthesized data, and the identified subspaces tend to control image attributes globally (i.e., manipulating an attribute causes the change of an entire image). By contrast, this work introduces low rank subspaces that enable more precise control of GAN generation. Concretely, given an arbitrary image and a region of interest (e.g., eyes of face images), we manage to relate the latent space to the image region with the Jacobian matrix and then use low rank factorization to discover steerable latent subspaces. There are three distinguishable strengths of our approach that can be aptly called LowRankGAN. First, compared to analytic algorithms in prior work, our low rank factorization of Jacobians is able to find the low dimensional representation of attribute manifold, making image editing more precise and controllable. Second, low rank factorization naturally yields a null space of attributes such that moving the latent code within it only affects the outer region of interest. Therefore, local image editing can be simply achieved by projecting an attribute vector into the null space without relying on a spatial mask as existing methods do. Third, our method can robustly work with a local region from one image for analysis yet well generalize to other images, making it much easy to use in practice. Extensive experiments on state of the art GAN models (including StyleGAN2 and BigGAN) trained on various datasets demonstrate the effectiveness of our LowRankGAN.


Wind tree model for billiard motion from a signal processing viewpoint. In the Ehrenfest wind tree model, a point particle moves on the plane and collides with randomly placed fixed square obstacles under the usual law of geometric optics. The particle represents the wind and the squares are the trees. We examine the periodic version of the model. Previous authors analyze the dynamical properties of the model using techniques from algebraic topology or ergodic theory. In contrast to these works, we adopt a signal processing viewpoint. We describe the phenomenon of the long term trajectories by using a 3 state hidden Markov model.


Pointwise bounds for Eisenstein series on Gamma 0(q) setminus SL 2( mathbb R ) . We construct pointwise bounds in the weight aspect for Eisenstein series on X 0(q) Gamma 0(q) setminus SL 2( mathbb R ) , with squarefree level q , using a Sobolev technique. More specifically, we show that for an Eisenstein series E on X 0(q) of weight parameter n and type t , one has for all x in X 0(q) E(x,1 2 it) ll epsilon q epsilon (1 n 1 2 epsilon t 1 2 epsilon ) sqrt y(x) y(x) 1 , where y(x) is the Iwasawa y coordinate of the point x .


Urysohn and Tietze extensions of Lipschitz functions. Let (X,d) be a metric space and alpha 0 . In this paper, we study extensions of some complex valued Lipschitz functions, from some special subset X 0 to X. These extensions are with no increasing Lipschitz number or the smallest Lipschitz number. Moreover, we show that under some conditions, Tietze extension theorem can be generalized for Lipschitz functions and call it Tietze Lipschitz extension. Furthermore, we generalize Urysohn lemma for Lipschitz functions. In fact we present a necessary and sufficient condition for that Lipschitz functions separate subsets of X.


An Isotropy Analysis in the Multilingual BERT Embedding Space. Several studies have explored various advantages of multilingual pre trained models (such as multilingual BERT) in capturing shared linguistic knowledge. However, less attention has been paid to their limitations. In this paper, we investigate the multilingual BERT for two known issues of the monolingual models anisotropic embedding space and outlier dimensions. We show that, unlike its monolingual counterpart, the multilingual BERT model exhibits no outlier dimension in its representations while it has a highly anisotropic space. There are a few dimensions in the monolingual BERT with high contributions to the anisotropic distribution. However, we observe no such dimensions in the multilingual BERT. Furthermore, our experimental results demonstrate that increasing the isotropy of multilingual space can significantly improve its representation power and performance, similarly to what had been observed for monolingual CWRs on semantic similarity tasks. Our analysis indicates that, despite having different degenerated directions, the embedding spaces in various languages tend to be partially similar with respect to their structures.


The Persistent Homology of Dual Digital Image Constructions. To compute the persistent homology of a grayscale digital image one needs to build a simplicial or cubical complex from it. For cubical complexes, the two commonly used constructions (corresponding to direct and indirect digital adjacencies) can give different results for the same image. The two constructions are almost dual to each other, and we use this relationship to extend and modify the cubical complexes to become dual filtered cell complexes. We derive a general relationship between the persistent homology of two dual filtered cell complexes, and also establish how various modifications to a filtered complex change the persistence diagram. Applying these results to images, we derive a method to transform the persistence diagram computed using one type of cubical complex into a persistence diagram for the other construction. This means software for computing persistent homology from images can now be easily adapted to produce results for either of the two cubical complex constructions without additional low level code implementation.


The stability for multivalued McKean Vlasov SDEs with non Lipschitz coefficients. The work concerns the stability for a type of multivalued McKean Vlasov SDEs with non Lipschitz coefficients. First, we prove the existence and uniqueness of strong solutions for multivalued McKean Vlasov stochastic differential equations with non Lipschitz coefficients. Then, we extend the classical It o 's formula from SDEs to multivalued McKean Vlasov SDEs. Next, the exponential stability of second moments, the exponentially 2 ultimate boundedness and the almost surely asymptotic stability for their solutions in terms of a Lyapunov function are shown.


Bid Optimization using Maximum Entropy Reinforcement Learning. Real time bidding (RTB) has become a critical way of online advertising. In RTB, an advertiser can participate in bidding ad impressions to display its advertisements. The advertiser determines every impression's bidding price according to its bidding strategy. Therefore, a good bidding strategy can help advertisers improve cost efficiency. This paper focuses on optimizing a single advertiser's bidding strategy using reinforcement learning (RL) in RTB. Unfortunately, it is challenging to optimize the bidding strategy through RL at the granularity of impression due to the highly dynamic nature of the RTB environment. In this paper, we first utilize a widely accepted linear bidding function to compute every impression's base price and optimize it by a mutable adjustment factor derived from the RTB auction environment, to avoid optimizing every impression's bidding price directly. Specifically, we use the maximum entropy RL algorithm (Soft Actor Critic) to optimize the adjustment factor generation policy at the impression grained level. Finally, the empirical study on a public dataset demonstrates that the proposed bidding strategy has superior performance compared with the baselines.


A Cartesian FMM accelerated Galerkin boundary integral Poisson Boltzmann solver. The Poisson Boltzmann model is an effective and popular approach for modeling solvated biomolecules in continuum solvent with dissolved electrolytes. In this paper, we report our recent work in developing a Galerkin boundary integral method for solving the Poisson Boltzmann (PB) equation. The solver has combined advantages in accuracy, efficiency, and memory usage as it applies a well posed boundary integral formulation to circumvent many numerical difficulties associated with the PB equation and uses an O(N) Cartesian Fast Multipole Method (FMM) to accelerate the GMRES iteration. In addition, special numerical treatments such as adaptive FMM order, block diagonal preconditioners, Galerkin discretization, and Duffy's transformation are combined to improve the performance of the solver, which is validated on benchmark Kirkwood's sphere and a series of testing proteins.


Multidimensional Kyle Back model with a risk averse informed trader. We study the continuous time Kyle Back model with a risk averse informed trader.We show that in a market with multiple assets and non Gaussian prices an equilibrium exists. The equilibrium is constructed by considering a Fokker Planck equation and a system of partial differential equations that are coupled with an optimal transport type constraint at maturity.


Constructing Pseudo involutions in the Riordan Group. Riordan arrays, denoted by pairs of generating functions (g(z), f(z)), are infinite lower triangular matrices that are used as combinatorial tools. In this paper, we present Riordan and stochastic Riordan arrays that have connections to the Fibonacci and modified Lucas numbers. Then, we present some pseudo involutions in the Riordan group that are based on constructions starting with a certain generating function g(z). We also present a theorem that shows how to construct pseudo involutions in the Riordan group starting with a certain generating function f(z) whose additive inverse has compositional order 2. The theorem is then used to construct more pseudo involutions in the Riordan group where some arrays have connections to the Fibonacci and modified Lucas numbers. A MATLAB algorithm for constructing the pseudo involutions is also given.


Envy free division of multi layered cakes. We study the problem of dividing a multi layered cake among heterogeneous agents under non overlapping constraints. This problem, recently proposed by Hosseini et al. (2020), captures several natural scenarios such as the allocation of multiple facilities over time where each agent can utilize at most one facility simultaneously, and the allocation of tasks over time where each agent can perform at most one task simultaneously. We establish the existence of an envy free multi division that is both non overlapping and contiguous within each layered cake when the number n of agents is a prime power and the number m of layers is at most n , thus providing a positive partial answer to a recent open question. To achieve this, we employ a new approach based on a general fixed point theorem, originally proven by Volovikov (1996), and recently applied by Joji ' c , Panina, and v Z ivaljevi ' c (2020) to the envy free division problem of a cake. We further show that for a two layered cake division among three agents with monotone preferences, an varepsilon approximate envy free solution that is both non overlapping and contiguous can be computed in logarithmic time of 1 varepsilon .


A Resilient ICT4D Approach to ECO Countries' Education Response during COVID 19 Pandemic. According to the United Nations, schools' closures have impacted up to 99 per cent of the student population in low and lower middle income countries. This research in progress report introduces a project on Emergency Remote Teaching (ERT) measures in the ten member states of the Economic Cooperation Organization (ECO) with a focus on the application of Information and Communication Technologies (ICTs) in primary and secondary education levels. The project takes a comparative approach within a resilient ICT for Development (ICT4D) framework, where the coping, endurance, and return to pre crisis functionalities in education systems are studied. The preliminary research demonstrates the impacts of the country's general COVID 19 strategy, the education system in place, and digital infrastructure's level of development on instigating distance learning platforms. The paper further shows that in addition to access to stable internet connections and digital devices, other infrastructural factors such as access to food, electricity and health services play a significant role in education response planning and implementation. Human factors in the education system, such as teacher training for the usage of ICTs, digital literacy of students and parents, and already existing vulnerabilities in the education system pose challenges to crisis management in the education sector. Other socio political factors such as attitudes towards girls' education, level of corruption, institutional capacity, and international sanctions or available funds also make the education system less resilient.


On long arithmetic progressions in binary Morse like words. We present results on the existence of long arithmetic progressions in the Thue Morse word and in a class of generalised Thue Morse words. Our arguments are inspired by van der Waerden's proof for the existence of arbitrary long monochromatic arithmetic progressions in any finite colouring of the (positive) integers.


Reward Reinforced Reinforcement Learning for Multi agent Systems. Reinforcement learning algorithms in multi agent systems deliver highly resilient and adaptable solutions for common problems in telecommunications,aerospace, and industrial robotics. However, achieving an optimal global goal remains a persistent obstacle for collaborative multi agent systems, where learning affects the behaviour of more than one agent. A number of nonlinear function approximation methods have been proposed for solving the Bellman equation, which describe a recursive format of an optimal policy. However, how to leverage the value distribution based on reinforcement learning, and how to improve the efficiency and efficacy of such systems remain a challenge. In this work, we developed a reward reinforced generative adversarial network to represent the distribution of the value function, replacing the approximation of Bellman updates. We demonstrated our method is resilient and outperforms other conventional reinforcement learning methods. This method is also applied to a practical case study maximising the number of user connections to autonomous airborne base stations in a mobile communication network. Our method maximises the data likelihood using a cost function under which agents have optimal learned behaviours. This reward reinforced generative adversarial network can be used as ageneric framework for multi agent learning at the system level


Inter Extreme Points Geodesics for End to End Weakly Supervised Image Segmentation. We introduce textit InExtremIS , a weakly supervised 3D approach to train a deep image segmentation network using particularly weak train time annotations only 6 extreme clicks at the boundary of the objects of interest. Our fully automatic method is trained end to end and does not require any test time annotations. From the extreme points, 3D bounding boxes are extracted around objects of interest. Then, deep geodesics connecting extreme points are generated to increase the amount of "annotated" voxels within the bounding boxes. Finally, a weakly supervised regularised loss derived from a Conditional Random Field formulation is used to encourage prediction consistency over homogeneous regions. Extensive experiments are performed on a large open dataset for Vestibular Schwannoma segmentation. textit InExtremIS obtained competitive performance, approaching full supervision and outperforming significantly other weakly supervised techniques based on bounding boxes. Moreover, given a fixed annotation time budget, textit InExtremIS outperforms full supervision. Our code and data are available online.


TROLLMAGNIFIER Detecting State Sponsored Troll Accounts on Reddit. Growing evidence points to recurring influence campaigns on social media, often sponsored by state actors aiming to manipulate public opinion on sensitive political topics. Typically, campaigns are performed through instrumented accounts, known as troll accounts despite their prominence, however, little work has been done to detect these accounts in the wild. In this paper, we present TROLLMAGNIFIER, a detection system for troll accounts. Our key observation, based on analysis of known Russian sponsored troll accounts identified by Reddit, is that they show loose coordination, often interacting with each other to further specific narratives. Therefore, troll accounts controlled by the same actor often show similarities that can be leveraged for detection. TROLLMAGNIFIER learns the typical behavior of known troll accounts and identifies more that behave similarly. We train TROLLMAGNIFIER on a set of 335 known troll accounts and run it on a large dataset of Reddit accounts. Our system identifies 1,248 potential troll accounts we then provide a multi faceted analysis to corroborate the correctness of our classification. In particular, 66 of the detected accounts show signs of being instrumented by malicious actors (e.g., they were created on the same exact day as a known troll, they have since been suspended by Reddit, etc.). They also discuss similar topics as the known troll accounts and exhibit temporal synchronization in their activity. Overall, we show that using TROLLMAGNIFIER, one can grow the initial knowledge of potential trolls provided by Reddit by over 300 .


On Adaptive Fairness in Software Systems. Software systems are increasingly making decisions on behalf of humans, raising concerns about the fairness of such decisions. Such concerns are usually attributed to flaws in algorithmic design or biased data, but we argue that they are often the result of a lack of explicit specification of fairness requirements. However, such requirements are challenging to elicit, a problem exacerbated by increasingly dynamic environments in which software systems operate, as well as stakeholders' changing needs. Therefore, capturing all fairness requirements during the production of software is challenging, and is insufficient for addressing software changes post deployment. In this paper, we propose adaptive fairness as a means for maintaining the satisfaction of changing fairness requirements. We demonstrate how to combine requirements driven and resource driven adaptation in order to address variabilities in both fairness requirements and their associated resources. Using models for fairness requirements, resources, and their relations, we show how the approach can be used to provide systems owners and end users with capabilities that reflect adaptive fairness behaviours at runtime. We demonstrate our approach using an example drawn from shopping experiences of citizens. We conclude with a discussion of open research challenges in the engineering of adaptive fairness in human facing software systems.


Relational World Knowledge Representation in Contextual Language Models A Review. Relational knowledge bases (KBs) are commonly used to represent world knowledge in machines. However, while advantageous for their high degree of precision and interpretability, KBs are usually organized according to manually defined schemas, which limit their expressiveness and require significant human efforts to engineer and maintain. In this review, we take a natural language processing perspective to these limitations, examining how they may be addressed in part by training deep contextual language models (LMs) to internalize and express relational knowledge in more flexible forms. We propose to organize knowledge representation strategies in LMs by the level of KB supervision provided, from no KB supervision at all to entity and relation level supervision. Our contributions are threefold (1) We provide a high level, extensible taxonomy for knowledge representation in LMs (2) Within our taxonomy, we highlight notable models, evaluation tasks, and findings, in order to provide an up to date review of current knowledge representation capabilities in LMs and (3) We suggest future research directions that build upon the complementary aspects of LMs and KBs as knowledge representations.


FINNger Applying artificial intelligence to ease math learning for children. Kids have an amazing capacity to use modern electronic devices such as tablets, smartphones, etc. This has been incredibly boosted by the ease of access of these devices given the expansion of such devices through the world, reaching even third world countries. Also, it is well known that children tend to have difficulty learning some subjects at pre school. We as a society focus extensively on alphabetization, but in the end, children end up having differences in another essential area Mathematics. With this work, we create the basis for an intuitive application that could join the fact that children have a lot of ease when using such technological applications, trying to shrink the gap between a fun and enjoyable activity with something that will improve the children knowledge and ability to understand concepts when in a low age, by using a novel convolutional neural network to achieve so, named FINNger.


Computation Rate Maximum for Mobile Terminals in UAV assisted Wireless Powered MEC Networks with Fairness Constraint. This paper investigates an unmanned aerial vehicle (UAV) assisted wireless powered mobile edge computing (MEC) system, where the UAV powers the mobile terminals by wireless power transfer (WPT) and provides computation service for them. We aim to maximize the computation rate of terminals while ensuring fairness among them. Considering the random trajectories of mobile terminals, we propose a soft actor critic (SAC) based UAV trajectory planning and resource allocation (SAC TR) algorithm, which combines off policy and maximum entropy reinforcement learning to promote the convergence of the algorithm. We design the reward as a heterogeneous function of computation rate, fairness, and reaching of destination. Simulation results show that SAC TR can quickly adapt to varying network environments and outperform representative benchmarks in a variety of situations.


Photothermal effects in small gold nanorod aggregates for therapeutic applications. Proximity of the metal nanoparticles enhance the plasmonic coupling and shifts the resonance. This article presents a numerical study of the photothermal effect in aggregates of small gold nanorods considering the ordered as well as random aggregates. In the ordered aggregates, there is lateral coupling which causes blueshifts in the plasmonic resonance, while in the random aggregates there are redshifts in the plasmonic resonance. The plasmon response of latter could be tailored up to the second infrared biological therapeutic window. It has been observed that the aggregates show higher absorption power and therefore, higher temperature rise compared to the single gold nanorod or monodispersive nanorods. The absorption resonance peak position of the random aggregate depends on the incident and polarization angles of the incident light. The aggregation of the nanoparticles often inherently occurs in the biological medium which affects the photothermal process. This study helps to understand the photothermal heating of nanoparticle aggregates and the use of the optimal light source concerning the absorption peak of the aggregates suspension for therapeutic uses.


Integer colorings with no rainbow 3 term arithmetic progression. In this paper, we study the rainbow Erd H o s Rothschild problem with respect to 3 term arithmetic progressions. We obtain the asymptotic number of r colorings of n without rainbow 3 term arithmetic progressions, and we show that the typical colorings with this property are 2 colorings. We also prove that n attains the maximum number of rainbow 3 term arithmetic progression free r colorings among all subsets of n . Moreover, the exact number of rainbow 3 term arithmetic progression free r colorings of mathbb Z p is obtained, where p is any prime and mathbb Z p is the cyclic group of order p .


Chromatic index of dense quasirandom graphs. Let G be a simple graph with maximum degree Delta(G) . A subgraph H of G is overfull if E(H) Delta(G) lfloor V(H) 2 rfloor . Chetwynd and Hilton in 1985 conjectured that a graph G on n vertices with Delta(G) n 3 has chromatic index Delta(G) if and only if G contains no overfull subgraph. Glock, K " u hn and Osthus in 2016 showed that the conjecture is true for dense quasirandom graphs with even order, and they conjectured that the same should hold for such graphs with odd order. In this paper, we show that the conjecture of Glock, K " u hn and Osthus is affirmative.


Visualization Techniques with Data Cubes Utilizing Concurrency for Complex Data. With web and mobile platforms becoming more prominent devices utilized in data analysis, there are currently few systems which are not without flaw. In order to increase the performance of these systems and decrease errors of data oversimplification, we seek to understand how other programming languages can be used across these platforms which provide data and type safety, as well as utilizing concurrency to perform complex data manipulation tasks.


An automated approach to mitigate transcription errors in braille texts for the Portuguese language. The quota system in Brazil made it possible to include blind students in higher education. Teachers' lack of knowledge about the braille system can represent a barrier between them and students who use it for writing and reading. Computer vision based transcription solutions represent mechanisms for reducing understanding restrictions on this system. However, such tools face nuisances inherent to image processing systems, e.g., illumination, noise, and scale, harming the result. This paper presents an automated approach to mitigate transcription errors in braille texts for the Portuguese language. We propose a selection function, combined with dictionaries, that provides the best correspondence of words based on their braille representation. We validated our proposal on a dataset of synthetic images by submitting them to different noise levels and testing the proposal's robustness. Experimental results confirm the effectiveness of the solution compared to a standard approach. As a contribution of this paper, we expect to provide a method to support robust and adaptable solutions to real use conditions.


Error bounds for Lanczos based matrix function approximation. We analyze the Lanczos method for matrix function approximation (Lanczos FA), an iterative algorithm for computing f( mathbf A ) mathbf b when mathbf A is a Hermitian matrix and mathbf b is a given mathbftor. Assuming that f mathbb C rightarrow mathbb C is piecewise analytic, we give a framework, based on the Cauchy integral formula, which can be used to derive em a priori and emph a posteriori error bounds for Lanczos FA in terms of the error of Lanczos used to solve linear systems. Unlike many error bounds for Lanczos FA, these bounds account for fine grained properties of the spectrum of mathbf A , such as clustered or isolated eigenvalues. Our results are derived assuming exact arithmetic, but we show that they are easily extended to finite precision computations using existing theory about the Lanczos algorithm in finite precision. We also provide generalized bounds for the Lanczos method used to approximate quadratic forms mathbf b textsf H f( mathbf A ) mathbf b , and demonstrate the effectiveness of our bounds with numerical experiments.


Scene Transformer A unified architecture for predicting multiple agent trajectories. Predicting the motion of multiple agents is necessary for planning in dynamic environments. This task is challenging for autonomous driving since agents (e.g. vehicles and pedestrians) and their associated behaviors may be diverse and influence one another. Most prior work have focused on predicting independent futures for each agent based on all past motion, and planning against these independent predictions. However, planning against independent predictions can make it challenging to represent the future interaction possibilities between different agents, leading to sub optimal planning. In this work, we formulate a model for predicting the behavior of all agents jointly, producing consistent futures that account for interactions between agents. Inspired by recent language modeling approaches, we use a masking strategy as the query to our model, enabling one to invoke a single model to predict agent behavior in many ways, such as potentially conditioned on the goal or full future trajectory of the autonomous vehicle or the behavior of other agents in the environment. Our model architecture employs attention to combine features across road elements, agent interactions, and time steps. We evaluate our approach on autonomous driving datasets for both marginal and joint motion prediction, and achieve state of the art performance across two popular datasets. Through combining a scene centric approach, agent permutation equivariant model, and a sequence masking strategy, we show that our model can unify a variety of motion prediction tasks from joint motion predictions to conditioned prediction.


Query Driven Graph Neural Networks for Community Search From Non Attributed, Attributed, to Interactive Attributed. Given one or more query vertices, Community Search (CS) aims to find densely intra connected and loosely inter connected structures containing query vertices. Attributed Community Search (ACS), a related problem, is more challenging since it finds communities with both cohesive structures and homogeneous vertex attributes. However, most methods for the CS task rely on inflexible pre defined structures and studies for ACS treat each attribute independently. Moreover, the most popular ACS strategies decompose ACS into two separate sub problems, i.e., the CS task and subsequent attribute filtering task. However, in real world graphs, the community structure and the vertex attributes are closely correlated to each other. This correlation is vital for the ACS problem. In this paper, we propose Graph Neural Network models for both CS and ACS problems, i.e., Query Driven GNN and Attributed Query Driven GNN. In QD GNN, we combine the local query dependent structure and global graph embedding. In order to extend QD GNN to handle attributes, we model vertex attributes as a bipartite graph and capture the relation between attributes by constructing GNNs on this bipartite graph. With a Feature Fusion operator, AQD GNN processes the structure and attribute simultaneously and predicts communities according to each attributed query. Experiments on real world graphs with ground truth communities demonstrate that the proposed models outperform existing CS and ACS algorithms in terms of both efficiency and effectiveness. More recently, an interactive setting for CS is proposed that allows users to adjust the predicted communities. We further verify our approaches under the interactive setting and extend to the attributed context. Our method achieves 2.37 and 6.29 improvements in F1 score than the state of the art model without attributes and with attributes respectively.


In Congestion Games, Taxes Achieve Optimal Approximation. We consider the problem of minimizing social cost in atomic congestion games and show, perhaps surprisingly, that efficiently computed taxation mechanisms yield the same performance achievable by the best polynomial time algorithm, even when the latter has full control over the players' actions. It follows that no other tractable approach geared at incentivizing desirable system behavior can improve upon this result, regardless of whether it is based on taxations, coordination mechanisms, information provision, or any other principle. In short Judiciously chosen taxes achieve optimal approximation. Three technical contributions underpin this conclusion. First, we show that computing the minimum social cost is NP hard to approximate within a given factor depending solely on the admissible resource costs. Second, we design a tractable taxation mechanism whose efficiency (price of anarchy) matches this hardness factor, and thus is optimal. As these results extend to coarse correlated equilibria, any no regret algorithm inherits the same performances, allowing us to devise polynomial time algorithms with optimal approximation.


Analysing GSM Insecurity. In the 1990s, GSM emerged as a cutting edge technology that promised improved services, mobility, security, and increase in the revenues of companies through improved, secure communication for business transactions. The practical experience, however, has shown global subscribers and companies that mere technological excellence of GSM has not resulted in its success. This paper has been carried out to analyse the existing GSM subscriber activities in both personal and business worlds by implementing a customized GSM baseband protocol stack on a phone. The paper encompasses the tasks of analysing the prevailing GSM insecurity, establishing a conceptual design towards the findings revealed in the practical personal and business environments and knowledge gathered from the literature.


From partners to populations A hierarchical Bayesian account of coordination and convention. Languages are powerful solutions to coordination problems they provide stable, shared expectations about how the words we say correspond to the beliefs and intentions in our heads. Yet language use in a variable and non stationary social environment requires linguistic representations to be flexible old words acquire new ad hoc or partner specific meanings on the fly. In this paper, we introduce CHAI (Continual Hierarchical Adaptation through Inference), a hierarchical Bayesian theory of coordination and convention formation that aims to reconcile the long standing tension between these two basic observations. We argue that the central computational problem of communication is not simply transmission, as in classical formulations, but continual learning and adaptation over multiple timescales. Partner specific common ground quickly emerges from social inferences within dyadic interactions, while community wide social conventions are stable priors that have been abstracted away from interactions with multiple partners. We present new empirical data alongside simulations showing how our model provides a computational foundation for several phenomena that have posed a challenge for previous accounts (1) the convergence to more efficient referring expressions across repeated interaction with the same partner, (2) the gradual transfer of partner specific common ground to strangers, and (3) the influence of communicative context on which conventions eventually form.


Submodular functions and perfect graphs. We give a combinatorial polynomial time algorithm to find a maximum weight independent set in perfect graphs of bounded degree that do not contain a prism or a hole of length four as an induced subgraph. An even pair in a graph is a pair of vertices all induced paths between which are even. An even set is a set of vertices every two of which are an even pair. We show that every perfect graph that does not contain a prism or a hole of length four as an induced subgraph has a balanced separator which is the union of a bounded number of even sets, where the bound depends only on the maximum degree of the graph. This allows us to solve the maximum weight independent set problem using the well known submodular function minimization algorithm.


A simulation study of a windowless gas stripping room in an E B neutral particle analyzer. Neutral Particle Analyzer (NPA) is one of the crucial diagnostic devices on Tokamak facilities. Stripping unit is one of the main parts of the NPA. A windowless gas stripping room with two differential pipes is adopted in a parallel direction of electric and magnetic fields (E B) NPA. The pressure distributions in the stripping chamber are simulated by Ansys Fluent together with MolFlow . Based on the pressure distributions extracted from the simulation, the stripping efficiency of the E B NPA is studied with GEANT4. The hadron reaction physics is modified to track the charge state of each particle in a cross section base method in GEANT4. The transmission rates ( R ) and the stripping efficiencies f 1 are examined for the particle energy ranging from 20 to 200 keV at the input pressure ( P 0 ) ranging from 20 to 400 Pa. According to the combined global efficiency, R times f 1 , P 0 240 Pa is obtained as the optimum pressure for the maximum global efficiency in the incident energy range investigated.


Asymptotic Behaviour of the Error of Polynomial Approximation of Functions Like vert x vert alpha i beta . New asymptotic relations between the L p errors of best approximation of univariate functions by algebraic polynomials and entire functions of exponential type are obtained for p in (0, iy . General asymptotic relations are applied to functions vert x vert al i be , , vert x vert al cos( be log vert x vert) , and vert x vert al sin( be log vert x vert) .


Meta Modeling of Assembly Contingencies and Planning for Repair. The World Robotics Challenge (2018 2020) was designed to challenge teams to design systems that are easy to adapt to new tasks and to ensure robust operation in a semi structured environment. We present a layered strategy to transform missions into tasks and actions and provide a set of strategies to address simple and complex failures. We propose a model for characterizing failures using this model and discuss repairs. Simple failures are by far the most common in our WRC system and we also present how we repaired them.


On the distribution of traces of Frobenius for families of elliptic curves and the Lang Trotter conjecture on average. We obtain distribution results for traces of Frobenius for various families of elliptic curves with respect to the Lang Trotter conjecture, extremal primes, and the central limit theorem. This includes some generalisations and bounds related to the work of Sha Shparlinski on the average Lang Trotter conjecture for single parametric families of elliptic curves and the work of various authors on the trace of Frobenius for primes in congruence classes. Some results are also obtained for modular forms.


Differential Galois Theory and Integration. In this paper, we present methods to simplify reducible linear differential systems before solving. Classical integrals appear naturally as solutions of such systems. We will illustrate the methods developed in a previous paper on several examples to reduce the differential system. This will give information on potential algebraic relations between integrals.


Ergodic Average Of Typical Orbits And Typical Functions. In this article we mainly aim to know what kind of asymptotic behavior of typical orbits can display. For example, we show in any transitive system, the emprical measures of a typical orbit can cover all emprical measures of dense orbits and can intersect some physical like measures. In particular, if the union set of emprical measures of all dense orbits is not singleton, then the typical orbit will display historic behavior simultaneously for typical continuous functions and the limit set of ergodic average along every continuous function equals to a closed interval composed by the union of limit sets of ergodic average on all dense orbits. Moreover, if the union set of emprical measures of all dense orbits contains all ergodic measures, the above interval equals to the rotation set. These results are not only suitable for systems with specification like properties or minimal systems, but also suitable for many other systems including all general (not assumed uniformly hyperbolic) nontrivial homoclinic classes and Bowen eyes. Moreover, we introduce a new property called m g product property weaker than classical specification property and minimal property and nontrivial examples are constructed.


A Variant of the VC dimension with Applications to Depth 3 Circuits. We introduce the following variant of the VC dimension. Given S subseteq 0, 1 n and a positive integer d , we define mathbb U d(S) to be the size of the largest subset I subseteq n such that the projection of S on every subset of I of size d is the d dimensional cube. We show that determining the largest cardinality of a set with a given mathbb U d dimension is equivalent to a Tur 'an type problem related to the total number of cliques in a d uniform hypergraph. This allows us to beat the Sauer Shelah lemma for this notion of dimension. We use this to obtain several results on Sigma 3 k circuits, i.e., depth 3 circuits with top gate OR and bottom fan in at most k Tight relationship between the number of satisfying assignments of a 2 CNF and the dimension of the largest projection accepted by it, thus improving Paturi, Saks, and Zane (Comput. Complex. '00). Improved Sigma 3 3 circuit lower bounds for affine dispersers for sublinear dimension. Moreover, we pose a purely hypergraph theoretic conjecture under which we get further improvement. We make progress towards settling the Sigma 3 2 complexity of the inner product function and all degree 2 polynomials over mathbb F 2 in general. The question of determining the Sigma 3 3 complexity of IP was recently posed by Golovnev, Kulikov, and Williams (ITCS'21).


Symbiotic System of Systems Design for Safe and Resilient Autonomous Robotics in Offshore Wind Farms. To reduce Operation and Maintenance (O M) costs on offshore wind farms, wherein 80 of the O M cost relates to deploying personnel, the offshore wind sector looks to Robotics and Artificial Intelligence (RAI) for solutions. Barriers to Beyond Visual Line of Sight (BVLOS) robotics include operational safety compliance and resilience, inhibiting the commercialization of autonomous services offshore. To address safety and resilience challenges we propose a Symbiotic System Of Systems Approach (SSOSA), reflecting the lifecycle learning and co evolution with knowledge sharing for mutual gain of robotic platforms and remote human operators. Our novel methodology enables the run time verification of safety, reliability and resilience during autonomous missions. To achieve this, a Symbiotic Digital Architecture (SDA) was developed to synchronize digital models of the robot, environment, infrastructure, and integrate front end analytics and bidirectional communication for autonomous adaptive mission planning and situation reporting to a remote operator. A reliability ontology for the deployed robot, based on our holistic hierarchical relational model, supports computationally efficient platform data analysis. We demonstrate an asset inspection mission within a confined space through Cooperative, Collaborative and Corroborative (C3) governance (internal and external symbiosis) via decision making processes and the associated structures. We create a hyper enabled human interaction capability to analyze the mission status, diagnostics of critical sub systems within the robot to provide automatic updates to our AI driven run time reliability ontology. This enables faults to be translated into failure modes for decision making during the mission.


Towards Quantifiable Dialogue Coherence Evaluation. Automatic dialogue coherence evaluation has attracted increasing attention and is crucial for developing promising dialogue systems. However, existing metrics have two major limitations (a) they are mostly trained in a simplified two level setting (coherent vs. incoherent), while humans give Likert type multi level coherence scores, dubbed as "quantifiable" (b) their predicted coherence scores cannot align with the actual human rating standards due to the absence of human guidance during training. To address these limitations, we propose Quantifiable Dialogue Coherence Evaluation (QuantiDCE), a novel framework aiming to train a quantifiable dialogue coherence metric that can reflect the actual human rating standards. Specifically, QuantiDCE includes two training stages, Multi Level Ranking (MLR) pre training and Knowledge Distillation (KD) fine tuning. During MLR pre training, a new MLR loss is proposed for enabling the model to learn the coarse judgement of coherence degrees. Then, during KD fine tuning, the pretrained model is further finetuned to learn the actual human rating standards with only very few human annotated data. To advocate the generalizability even with limited fine tuning data, a novel KD regularization is introduced to retain the knowledge learned at the pre training stage. Experimental results show that the model trained by QuantiDCE presents stronger correlations with human judgements than the other state of the art metrics.


A Framework for Intuitionistic Grammar Logics. We generalize intuitionistic tense logics to the multi modal case by placing grammar logics on an intuitionistic footing. We provide axiomatizations for a class of base intuitionistic grammar logics as well as provide axiomatizations for extensions with combinations of seriality axioms and what we call "intuitionistic path axioms". We show that each axiomatization is sound and complete with completeness being shown via a typical canonical model construction.


A coherent categorification of the based ring of the lowest two sided cell. We give a coherent categorification of J 0 , the based ring of the lowest two sided cell of an affine Weyl group, equipped with a monoidal functor from the category of coherent sheaves on the derived Steinberg variety. We show that our categorification acts on natural coherent categorifications of the Iwahori invariants of the Schwartz space of the basic affine space. In low rank cases, we construct complexes that lift the basis elements t w of J 0 and their structure constants.


Elsa Energy based learning for semi supervised anomaly detection. Anomaly detection aims at identifying deviant instances from the normal data distribution. Many advances have been made in the field, including the innovative use of unsupervised contrastive learning. However, existing methods generally assume clean training data and are limited when the data contain unknown anomalies. This paper presents Elsa, a novel semi supervised anomaly detection approach that unifies the concept of energy based models with unsupervised contrastive learning. Elsa instills robustness against any data contamination by a carefully designed fine tuning step based on the new energy function that forces the normal data to be divided into classes of prototypes. Experiments on multiple contamination scenarios show the proposed model achieves SOTA performance. Extensive analyses also verify the contribution of each component in the proposed model. Beyond the experiments, we also offer a theoretical interpretation of why contrastive learning alone cannot detect anomalies under data contamination.


Size and Shape Space Gaussian Mixture Models for Structural Clustering of Molecular Dynamics Trajectories. Determining the optimal number and identity of structural clusters from an ensemble of molecular configurations continues to be a challenge. Recent structural clustering methods have focused on the use of internal coordinates due to the innate rotational and translational invariance of these features. The vast number of possible internal coordinates necessitates a feature space supervision step to make clustering tractable, but yields a protocol that can be system type specific. Particle positions offer an appealing alternative to internal coordinates, but suffer from a lack of rotational and translational invariance, as well as a perceived insensitivity to regions of structural dissimilarity. Here, we present a method, denoted shape GMM, that overcomes the shortcomings of particle positions using a weighted maximum likelihood (ML) alignment procedure. This alignment strategy is then built into an expectation maximization Gaussian mixture model (GMM) procedure to capture metastable states in the free energy landscape. The resulting algorithm distinguishes between a variety of different structures, including those indistinguishable by RMSD and pair wise distances, as demonstrated on several model systems. Shape GMM results on an extensive simulation of the the fast folding HP35 Nle Nle mutant protein support a 4 state folding unfolding mechanism which is consistent with previous experimental results and provides kinetic detail comparable to previous state of the art clustering approaches, as measured by the VAMP 2 score. Currently, training of shape GMMs is recommended for systems (or subsystems) that can be represented by lesssim 200 particles and lesssim 100K configurations to estimate high dimensional covariance matrices and balance computational expense. Once a shape GMM is trained, it can be used to predict the cluster identities of millions of configurations.


A Review of Biomedical Datasets Relating to Drug Discovery A Knowledge Graph Perspective. Drug discovery and development is a complex and costly process. Machine learning approaches are being investigated to help improve the effectiveness and speed of multiple stages of the drug discovery pipeline. Of these, those that use Knowledge Graphs (KG) have promise in many tasks, including drug repurposing, drug toxicity prediction and target gene disease prioritisation. In a drug discovery KG, crucial elements including genes, diseases and drugs are represented as entities, whilst relationships between them indicate an interaction. However, to construct high quality KGs, suitable data is required. In this review, we detail publicly available sources suitable for use in constructing drug discovery focused KGs. We aim to help guide machine learning and KG practitioners who are interested in applying new techniques to the drug discovery field, but who may be unfamiliar with the relevant data sources. The datasets are selected via strict criteria, categorised according to the primary type of information contained within and are considered based upon what information could be extracted to build a KG. We then present a comparative analysis of existing public drug discovery KGs and a evaluation of selected motivating case studies from the literature. Additionally, we raise numerous and unique challenges and issues associated with the domain and its datasets, whilst also highlighting key future research directions. We hope this review will motivate KGs use in solving key and emerging questions in the drug discovery domain.


Sample canonical correlation coefficients of high dimensional random vectors with finite rank correlations. Consider two random vectors widetilde mathbf x in mathbb R p and widetilde mathbf y in mathbb R q of the forms widetilde mathbf x A mathbf z mathbf C 1 1 2 mathbf x and widetilde mathbf y B mathbf z mathbf C 2 1 2 mathbf y , where mathbf x in mathbb R p , mathbf y in mathbb R q and mathbf z in mathbb R r are independent vectors with i.i.d. entries of mean 0 and variance 1, mathbf C 1 and mathbf C 2 are p times p and q times q deterministic covariance matrices, and A and B are p times r and q times r deterministic matrices. With n independent observations of ( widetilde mathbf x , widetilde mathbf y ) , we study the sample canonical correlations between widetilde mathbf x and widetilde mathbf y . We consider the high dimensional setting with finite rank correlations. Let t 1 ge t 2 ge cdots ge t r be the squares of the nontrivial population canonical correlation coefficients, and let widetilde lambda 1 ge widetilde lambda 2 ge cdots ge widetilde lambda p wedge q be the squares of the sample canonical correlation coefficients. If the entries of mathbf x , mathbf y and mathbf z are i.i.d. Gaussian, then the following dichotomy has been shown in 7 for a fixed threshold t c in(0, 1) for 1 le i le r , if t i t c , then widetilde lambda i converges to the right edge lambda of the limiting eigenvalue spectrum of the sample canonical correlation matrix if t i t c , then widetilde lambda i converges to a deterministic limit theta i in ( lambda ,1) determined by t i . In this paper, we prove that these results hold universally under the sharp fourth moment conditions on the entries of mathbf x and mathbf y . Moreover, we prove the results in full generality, in the sense that they also hold for near degenerate t i 's and for t i 's that are close to the threshold t c .


Learning to Regress Bodies from Images using Differentiable Semantic Rendering. Learning to regress 3D human body shape and pose (e.g. SMPL parameters) from monocular images typically exploits losses on 2D keypoints, silhouettes, and or part segmentation when 3D training data is not available. Such losses, however, are limited because 2D keypoints do not supervise body shape and segmentations of people in clothing do not match projected minimally clothed SMPL shapes. To exploit richer image information about clothed people, we introduce higher level semantic information about clothing to penalize clothed and non clothed regions of the image differently. To do so, we train a body regressor using a novel Differentiable Semantic Rendering DSR loss. For Minimally Clothed regions, we define the DSR MC loss, which encourages a tight match between a rendered SMPL body and the minimally clothed regions of the image. For clothed regions, we define the DSR C loss to encourage the rendered SMPL body to be inside the clothing mask. To ensure end to end differentiable training, we learn a semantic clothing prior for SMPL vertices from thousands of clothed human scans. We perform extensive qualitative and quantitative experiments to evaluate the role of clothing semantics on the accuracy of 3D human pose and shape estimation. We outperform all previous state of the art methods on 3DPW and Human3.6M and obtain on par results on MPI INF 3DHP. Code and trained models are available for research at https dsr.is.tue.mpg.de .


Adaptive Learning Rate and Momentum for Training Deep Neural Networks. Recent progress on deep learning relies heavily on the quality and efficiency of training algorithms. In this paper, we develop a fast training method motivated by the nonlinear Conjugate Gradient (CG) framework. We propose the Conjugate Gradient with Quadratic line search (CGQ) method. On the one hand, a quadratic line search determines the step size according to current loss landscape. On the other hand, the momentum factor is dynamically updated in computing the conjugate gradient parameter (like Polak Ribiere). Theoretical results to ensure the convergence of our method in strong convex settings is developed. And experiments in image classification datasets show that our method yields faster convergence than other local solvers and has better generalization capability (test set accuracy). One major advantage of the paper method is that tedious hand tuning of hyperparameters like the learning rate and momentum is avoided.


Moments and tails of hitting times of Bessel processes and convolutions of elementary mixtures of exponential distributions. We present explicit estimates of right and left tails and exact (up to universal, multiplicative constants) estimates of tails and moments of hitting times of Bessel processes. The latter estimates are obtained from more general estimates of moments and tails established for convolutions of elementary mixtures of exponential distributions.


Machine learning based discovery of missing physical processes in radiation belt modeling. Real time prediction of the dynamics of energetic electrons in Earth's radiation belts incorporating incomplete observation data is important to protect valuable artificial satellites and to understand their physical processes. Traditionally, reduced models have employed a diffusion equation based on the quasilinear approximation. Using a Physics Informed Neural Network (PINN) framework, we train and test a model based on Van Allen Probe data. We present a recipe for gleaning physical insight from solving the ill posed inverse problem of inferring model coefficients from data using PINNs. With this, it is discovered that the dynamics of "killer electrons" is described more accurately instead by a drift diffusion equation. A parameterization for the diffusion and drift coefficients, which is both simpler and more accurate than existing models, is presented.


Formal Methods in Railways a Systematic Mapping Study. Formal methods are mathematically based techniques for the rigorous development of software intensive systems. The railway signaling domain is a field in which formal methods have traditionally been applied, with several success stories. This article reports on a mapping study that surveys the landscape of research on applications of formal methods to the development of railway systems. Our main results are as follows (i) we identify a total of 328 primary studies relevant to our scope published between 1989 and 2020, of which 44 published during the last 5 years and 24 involving industry (ii) the majority of studies are evaluated through Examples (41 ) and Experience Reports (38 ), while full fledged Case Studies are limited (1.5 ) (iii) Model checking is the most commonly adopted technique (47 ), followed by simulation (27 ) and theorem proving (19.5 ) (iv) the dominant languages are UML (18 ) and B (15 ), while frequently used tools are ProB (9 ), NuSMV (8 ) and UPPAAL (7 ) however, a diverse landscape of languages and tools is employed (v) the majority of systems are interlocking products (40 ), followed by models of high level control logic (27 ) (vi) most of the studies focus on the Architecture (66 ) and Detailed Design (45 ) development phases. Based on these findings, we highlight current research gaps and expected actions. In particular, the need to focus on more empirically sound research methods, such as Case Studies and Controlled Experiments, and to lower the degree of abstraction, by applying formal methods and tools to development phases that are closer to software development. Our study contributes with an empirically based perspective on the future of research and practice in formal methods applications for railways.


L functions of certain exponential sums over finite fields II. In this paper, we compute the q adic slopes of the L functions of an important class of exponential sums arising from analytic number theory. Our main tools include Adolphson Sperber's work on toric exponential sums and Wan's decomposition theorems.


Helicity, linking and the distribution of null homologous periodic orbits for Anosov flows. This paper concerns connections between dynamical systems, knots and helicity of vector fields. For a divergence free vector field on a closed 3 manifold that generates an Anosov flow, we show that the helicity of the vector field may be recovered as the limit of appropriately weighted averages of linking numbers of periodic orbits, regarded as knots. This complements a classical result of Arnold and Vogel that, when the manifold is a real homology 3 sphere, the helicity may be obtained as the limit of the normalised linking numbers of typical pairs of long trajectories. We also obtain results on the asymptotic distribution of weighted averages of null homologous periodic orbits.


Online search of unknown terrains using a dynamical system based path planning approach. Surveillance and exploration of large environments is a tedious task. In spaces with limited environmental cues, random like search appears to be an effective approach as it allows the robot to perform online coverage of environments using a simple design. One way to generate random like scanning is to use nonlinear dynamical systems to impart chaos into the robot's controller. This will result in generation of unpredictable but at the same time deterministic trajectories, allowing the designer to control the system and achieve a high scanning coverage. However, the unpredictability comes at the cost of increased coverage time and lack of scalability, both of which have been ignored by the state of the art chaotic path planners. This study introduces a new scalable technique that helps a robot to steer away from the obstacles and cover the entire space in a short period of time. The technique involves coupling and manipulating two chaotic systems to minimize the coverage time and enable scanning of unknown environments with different properties online. Using this technique resulted in 49 boost, on average, in the robot's performance compared to the state of the art planners. While ensuring unpredictability in the paths, the overall performance of the chaotic planner remained comparable to optimal systems.


Arjun An Efficient Independent Support Computation Technique and its Applications to Counting and Sampling. Given a Boolean formula varphi over the set of variables X and a projection set mathcal P subseteq X , a subset of variables mathcal I is independent support of mathcal P if two solutions agree on mathcal I , then they also agree on mathcal P . The notion of independent support is related to the classical notion of definability dating back to 1901, and have been studied over the decades. Recently, the computational problem of determining independent support for a given formula has attained importance owing to the crucial importance of independent support for hashing based counting and sampling techniques. In this paper, we design an efficient and scalable independent support computation technique that can handle formulas arising from real world benchmarks. Our algorithmic framework, called Arjun, employs implicit and explicit definability notions, and is based on a tight integration of gate identification techniques and assumption based framework. We demonstrate that augmenting the state of the art model counter ApproxMC4 and sampler UniGen3 with Arjun leads to significant performance improvements. In particular, ApproxMC4 augmented with Arjun counts 387 more benchmarks out of 1896 while UniGen3 augmented with Arjun samples 319 more benchmarks within the same time limit.


Common Privacy Weaknesses and Vulnerabilities in Software Applications. In this digital era, our privacy is under constant threat as our personal data and traceable online offline activities are frequently collected, processed and transferred by many software applications. Privacy attacks are often formed by exploiting vulnerabilities found in those software applications. The Common Weakness Enumeration (CWE) and Common Vulnerabilities and Exposures (CVE) systems are currently the main sources that software engineers rely on for understanding and preventing publicly disclosed software vulnerabilities. However, our study on all 922 weaknesses in the CWE and 156,537 vulnerabilities registered in the CVE to date has found a very small coverage of privacy related vulnerabilities in both systems, only 4.45 in CWE and 0.1 in CVE. These also cover only a small number of areas of privacy threats that have been raised in existing privacy software engineering research, privacy regulations and frameworks, and industry sources. The actionable insights generated from our study led to the introduction of 11 new common privacy weaknesses to supplement the CWE system, making it become a source for both security and privacy vulnerabilities.


Automorphisms of the fine curve graph. Building on work of Farb and the second author, we prove that the group of automorphisms of the fine curve graph for a surface is isomorphic to the group of homeomorphisms of the surface. This theorem is analogous to the seminal result of Ivanov that the group of automorphisms of the (classical) curve graph is isomorphic to the extended mapping class group of the corresponding surface.


Quadratic non stochastic operators Examples of splitted chaos. There is one to one correspondence between quadratic operators (mapping mathbb R m to itself) and cubic matrices. It is known that any quadratic operator corresponding to a stochastic (in a fixed sense) cubic matrix preserves the standard simplex. In this paper we find conditions on the (non stochastic) cubic matrix ensuring that corresponding quadratic operator preserves simplex. Moreover, we construct several quadratic non stochastic operators which generate chaotic dynamical systems on the simplex. These chaotic behaviors are emph splitted meaning that the simplex is partitioned into uncountably many invariant (with respect to quadratic operator) subsets and the restriction of the dynamical system on each invariant set is chaos in the sense of Devaney.


Toward Certifiable Motion Planning for Medical Steerable Needles. Medical steerable needles can move along 3D curvilinear trajectories to avoid anatomical obstacles and reach clinically significant targets inside the human body. Automating steerable needle procedures can enable physicians and patients to harness the full potential of steerable needles by maximally leveraging their steerability to safely and accurately reach targets for medical procedures such as biopsies and localized therapy delivery for cancer. For the automation of medical procedures to be clinically accepted, it is critical from a patient care, safety, and regulatory perspective to certify the correctness and effectiveness of the motion planning algorithms involved in procedure automation. In this paper, we take an important step toward creating a certifiable motion planner for steerable needles. We introduce the first motion planner for steerable needles that offers a guarantee, under clinically appropriate assumptions, that it will, in finite time, compute an exact, obstacle avoiding motion plan to a specified target, or notify the user that no such plan exists. We present an efficient, resolution complete motion planner for steerable needles based on a novel adaptation of multi resolution planning. Compared to state of the art steerable needle motion planners (none of which provide any completeness guarantees), we demonstrate that our new resolution complete motion planner computes plans faster and with a higher success rate.


A deep neural network for multi species fish detection using multiple acoustic cameras. Underwater acoustic cameras are high potential devices for many applications in ecology, notably for fisheries management and monitoring. However how to extract such data into high value information without a time consuming entire dataset reading by an operator is still a challenge. Moreover the analysis of acoustic imaging, due to its low signal to noise ratio, is a perfect training ground for experimenting with new approaches, especially concerning Deep Learning techniques. We present hereby a novel approach that takes advantage of both CNN (Convolutional Neural Network) and classical CV (Computer Vision) techniques, able to detect a generic class ''fish'' in acoustic video streams. The pipeline pre treats the acoustic images to extract 2 features, in order to localise the signals and improve the detection performances. To ensure the performances from an ecological point of view, we propose also a two step validation, one to validate the results of the trainings and one to test the method on a real world scenario. The YOLOv3 based model was trained with data of fish from multiple species recorded by the two common acoustic cameras, DIDSON and ARIS, including species of high ecological interest, as Atlantic salmon or European eels. The model we developed provides satisfying results detecting almost 80 of fish and minimizing the false positive rate, however the model is much less efficient for eel detections on ARIS videos. The first CNN pipeline for fish monitoring exploiting video data from two models of acoustic cameras satisfies most of the required features. Many challenges are still present, such as the automation of fish species identification through a multiclass model. 1 However the results point a new solution for dealing with complex data, such as sonar data, which can also be reapplied in other cases where the signal to noise ratio is a challenge.


Gradient Estimates And Liouville Theorems For A Class of Nonlinear Elliptic Equations. In this paper, first we study carefully the positive solutions to Delta u lambda 1 u ln u lambda 2 u b 1 0 defined on a complete noncompact Riemannian manifold (M, g) with Ric(g) geq Kg , which can be regarded as Lichnerowicz type equations, and obtain the gradient estimates of positive solutions to these equations which do not depend on the bounds of the solutions and the Laplacian of the distance function on (M, g) . Then, we extend our techniques to a class of more general semilinear elliptic equations Delta u(x) uh( ln u) 0 and obtain some similar results under some suitable analysis conditions on these equations. Moreover, we also obtain some Liouville type theorems for these equations when Ric(g) geq 0 and establish some Harnack inequalities as consequences.


De biasing Distantly Supervised Named Entity Recognition via Causal Intervention. Distant supervision tackles the data bottleneck in NER by automatically generating training instances via dictionary matching. Unfortunately, the learning of DS NER is severely dictionary biased, which suffers from spurious correlations and therefore undermines the effectiveness and the robustness of the learned models. In this paper, we fundamentally explain the dictionary bias via a Structural Causal Model (SCM), categorize the bias into intra dictionary and inter dictionary biases, and identify their causes. Based on the SCM, we learn de biased DS NER via causal interventions. For intra dictionary bias, we conduct backdoor adjustment to remove the spurious correlations introduced by the dictionary confounder. For inter dictionary bias, we propose a causal invariance regularizer which will make DS NER models more robust to the perturbation of dictionaries. Experiments on four datasets and three DS NER models show that our method can significantly improve the performance of DS NER.


Independence and almost automorphy of high order. In this paper, it is shown that for a minimal system (X,T) and d,k in mathbb N , if (x,x i) is regionally proximal of order d for 1 leq i leq k , then (x,x 1, ldots,x k) is (k 1) regionally proximal of order d . Meanwhile, we introduce the notion of mathrm IN d pair for a dynamical system (X,T) and d in mathbb N , a pair (x 0,x 1) in X times X is called an mathrm IN d pair if for any k in mathbb N and any neighborhoods U 0 ,U 1 of x 0 and x 1 respectively, there exist integers p j (i) ,1 leq i leq k, 1 leq j leq d such that bigcup i 1 k p 1 (i) epsilon(1) ldots p d (i) epsilon(d) epsilon(j) in 0,1 ,1 leq j leq d backslash 0 subset mathrm Ind (U 0,U 1), where mathrm Ind (U 0,U 1) denotes the collection of all independence sets for (U 0,U 1) . It turns out that for a minimal system, if it dose not contain any nontrivial mathrm IN d pair, then it is an almost one to one extension of its maximal factor of order d .


An AI powered Smart Routing Solution for Payment Systems. In the current era of digitization, online payment systems are attracting considerable interest. Improving the efficiency of a payment system is important since it has a substantial impact on revenues for businesses. A gateway is an integral component of a payment system through which every transaction is routed. In an online payment system, payment processors integrate with these gateways by means of various configurations such as pricing, methods, risk checks, etc. These configurations are called terminals. Each gateway can have multiple terminals associated with it. Routing a payment transaction through the best terminal is crucial to increase the probability of a payment transaction being successful. Machine learning (ML) and artificial intelligence (AI) techniques can be used to accurately predict the best terminals based on their previous performance and various payment related attributes. We have devised a pipeline consisting of static and dynamic modules. The static module does the initial filtering of the terminals using static rules and a logistic regression model that predicts gateway downtimes. Subsequently, the dynamic module computes a lot of novel features based on success rate, payment attributes, time lag, etc. to model the terminal behaviour accurately. These features are updated using an adaptive time decay rate algorithm in real time using a feedback loop and passed to a random forest classifier to predict the success probabilities for every terminal. This pipeline is currently in production at Razorpay routing millions of transactions through it in real time and has given a 4 6 improvement in success rate across all payment methods (credit card, debit card, UPI, net banking). This has made our payment system more resilient to performance drops, which has improved the user experience, instilled more trust in the merchants, and boosted the revenue of the business.


Markov Rewards Processes with Impulse Rewards and Absorbing States. We study the expected accumulated reward for a discrete time Markov reward model with absorbing states. The rewards are impulse rewards, where a reward rho ij is accumulated when transitioning from state i to state j . We derive an explicit, single letter expression for the expected accumulated reward as a function of the number of time steps n and include in our analysis the limit in which n to infty .


MSE Loss with Outlying Label for Imbalanced Classification. In this paper, we propose mean squared error (MSE) loss with outlying label for class imbalanced classification. Cross entropy (CE) loss, which is widely used for image recognition, is learned so that the probability value of true class is closer to one by back propagation. However, for imbalanced datasets, the learning is insufficient for the classes with a small number of samples. Therefore, we propose a novel classification method using the MSE loss that can be learned the relationships of all classes no matter which image is input. Unlike CE loss, MSE loss is possible to equalize the number of back propagation for all classes and to learn the feature space considering the relationships between classes as metric learning. Furthermore, instead of the usual one hot teacher label, we use a novel teacher label that takes the number of class samples into account. This induces the outlying label which depends on the number of samples in each class, and the class with a small number of samples has outlying margin in a feature space. It is possible to create the feature space for separating high difficulty classes and low difficulty classes. By the experiments on imbalanced classification and semantic segmentation, we confirmed that the proposed method was much improved in comparison with standard CE loss and conventional methods, even though only the loss and teacher labels were changed.


Matched transient and steady state approximation of first passage time distributions of coloured noise driven leaky neurons. The first passage time distribution of a leaky integrate and fire neuron driven by a characteristically coloured noise is approximated by matching a transient and a steady state solution of the membrane voltage distribution. These approximations follow from a simple manipulation, made possible by the specific eigen' colouring of the noise, which allows to express the membrane potential as a Gaussian diffusion process on top of a deterministic exponential movement. Following, the presented method is extended to the case of an arbitrarily coloured noise driving by factoring out the eigen' noise and replacing the residue with an equivalent Gaussian process. It is shown that the obtained expressions agree well with numerical simulations for different values of the neuron parameters and noise colouring.


Synergistic epidemic spreading in correlated networks. We investigate the effect of degree correlation on a susceptible infected susceptible (SIS) model with a nonlinear cooperative effect (synergy) in infectious transmissions. In a mean field treatment of the synergistic SIS model on a bimodal network with tunable degree correlation, we identify a discontinuous transition that is independent of the degree correlation strength unless the synergy is absent or extremely weak. Regardless of synergy (absent or present), a positive and negative degree correlation in the model reduces and raises the epidemic threshold, respectively. For networks with a strongly positive degree correlation, the mean field treatment predicts the emergence of two discontinuous jumps in the steady state infected density. To test the mean field treatment, we provide approximate master equations of the present model, which accurately describe the synergistic SIS dynamics. We quantitatively confirm all qualitative predictions of the mean field treatment in numerical evaluations of the approximate master equations.


Single photon imaging and sensing of obscured objects around the corner. Non line of sight (NLOS) optical imaging and sensing of objects imply new capabilities valuable to autonomous technology, machine vision, and other applications. Existing NLOS imaging methods rely heavily on the prowess of computational algorithms to reconstruct the images from weak triply scattered signals. Here, we introduce a new approach to NLOS imaging and sensing using the picosecond gated single photon detection generated by quantum frequency conversion. With exceptional signal isolation, this approach can reliably sense obscured objects around the corner and substantially simplify the data processing needed for position retrieval and surface profiling. For each pixel, only 4 times 10 3 photons are needed to be detected per pulse to position and profile occluded objects with high resolution. Furthermore, the vibration frequencies of different objects can be resolved by analyzing the photon number fluctuation received within in a ten picosecond window, allowing NLOS acoustic sensing. Our results highlight the prospect of photon efficient NLOS imaging and sensing for real world applications.


cgSpan Pattern Mining in Conceptual Graphs. Conceptual Graphs (CGs) are a graph based knowledge representation formalism. In this paper we propose cgSpan a CG frequent pattern mining algorithm. It extends the DMGM GSM algorithm that takes taxonomy based labeled graphs as input it includes three more kinds of knowledge of the CG formalism (a) the fixed arity of relation nodes, handling graphs of neighborhoods centered on relations rather than graphs of nodes, (b) the signatures, avoiding patterns with concept types more general than the maximal types specified in signatures and (c) the inference rules, applying them during the pattern mining process. The experimental study highlights that cgSpan is a functional CG Frequent Pattern Mining algorithm and that including CGs specificities results in a faster algorithm with more expressive results and less redundancy with vocabulary.


Identification of RF MW microcalorimeter weak points by means of uncertainty analysis. Microcalorimeters are used by National Metrology Institutes (NMI) for the realization of the Radiofrequency and Microwaves (RF MW) primary power standard. Since they are not available on the market, NMIs have to design their own systems. It involves the design of complex mechanical structures and of low noise data acquisition systems. Resulting setups allow precision measurements of RF MW power by applying difficult and time consuming measurement techniques. Weaknesses to be addressed in order to improve the performance, whether in the mechanical structure or in the data acquisition electronics, are not easy to identify. Anyway, they can be found by analyzing the microcalorimeter measurement uncertainty. In recent years, several improvements have been made on the INRIM (Istituto Nazionale di Ricerca Metrologica, Italy) coaxial microcalorimeter with the aim of making its operation more stable and to reduce the measurement uncertainty. Its weak points are here analyzed by means of a comprehensive uncertainty budget. Details are also given on how uncertainty contributions have been determined. The method here applied is general and can be conveniently used in many other fields or applications provided that the analytical model is known. It is useful while designing an experiment and or a posteriori, to identify the parts of the apparatus and of the measurement set up that need to be optimized.


AFDetV2 Rethinking the Necessity of the Second Stage for Object Detection from Point Clouds. There have been two streams in the 3D detection from point clouds single stage methods and two stage methods. While the former is more computationally efficient, the latter usually provides better detection accuracy. By carefully examining the two stage approaches, we have found that if appropriately designed, the first stage can produce accurate box regression. In this scenario, the second stage mainly rescores the boxes such that the boxes with better localization get selected. From this observation, we have devised a single stage anchor free network that can fulfill these requirements. This network, named AFDetV2, extends the previous work by incorporating a self calibrated convolution block in the backbone, a keypoint auxiliary supervision, and an IoU prediction branch in the multi task head. As a result, the detection accuracy is drastically boosted in the single stage. To evaluate our approach, we have conducted extensive experiments on the Waymo Open Dataset and the nuScenes Dataset. We have observed that our AFDetV2 achieves the state of the art results on these two datasets, superior to all the prior arts, including both the single stage and the two stage se3D detectors. AFDetV2 won the 1st place in the Real Time 3D Detection of the Waymo Open Dataset Challenge 2021. In addition, a variant of our model AFDetV2 Base was entitled the "Most Efficient Model" by the Challenge Sponsor, showing a superior computational efficiency. To demonstrate the generality of this single stage method, we have also applied it to the first stage of the two stage networks. Without exception, the results show that with the strengthened backbone and the rescoring approach, the second stage refinement is no longer needed.


Hand tracking for immersive virtual reality opportunities and challenges. Hand tracking has become an integral feature of recent generations of immersive virtual reality head mounted displays. With the widespread adoption of this feature, hardware engineers and software developers are faced with an exciting array of opportunities and a number of challenges, mostly in relation to the human user. In this article, I outline what I see as the main possibilities for hand tracking to add value to immersive virtual reality as well as some of the potential challenges in the context of the psychology and neuroscience of the human user. It is hoped that this paper serves as a roadmap for the development of best practices in the field for the development of subsequent generations of hand tracking and virtual reality technologies.


Kinetic Derivation of the Hessian Geometric Structure in Chemical Reaction Systems. The theory of chemical kinetics form the basis to describe the dynamics of chemical systems. Owing to physical and thermodynamic constraints, chemical reaction systems possess various structures, which can be utilized to characterize important physical properties of the systems. In this work, we reveal the Hessian geometry which underlies chemical reaction systems and demonstrate how it originates from the interplay of stoichiometric and thermodynamic constraints. Our derivation is based on kinetics, we assume the law of mass action and characterize the equilibrium states by the detailed balance condition. The obtained geometric structure is then related to thermodynamics via the Hessian geometry appearing in a pure thermodynamic derivation. We demonstrate, based on the fact that both equilibrium and complex balanced states form toric varieties, how the Hessian geometric framework can be extended to nonequilibrium complex balanced steady states. We conclude that Hessian geometry provides a natural framework to capture the thermodynamic aspects of chemical reaction kinetics.


Measuring and Improving Consistency in Pretrained Language Models. Consistency of a model that is, the invariance of its behavior under meaning preserving alternations in its input is a highly desirable property in natural language processing. In this paper we study the question Are Pretrained Language Models (PLMs) consistent with respect to factual knowledge? To this end, we create ParaRel, a high quality resource of cloze style query English paraphrases. It contains a total of 328 paraphrases for 38 relations. Using ParaRel, we show that the consistency of all PLMs we experiment with is poor though with high variance between relations. Our analysis of the representational spaces of PLMs suggests that they have a poor structure and are currently not suitable for representing knowledge robustly. Finally, we propose a method for improving model consistency and experimentally demonstrate its effectiveness.


On Poisson transforms for differential forms on real hyperbolic spaces. We study the Poisson transform for differential forms on the real hyperbolic space mathbb H n . For 1 r infty , we prove that the Poisson transform is an isomorphism from the space of L r q differential forms on the boundary partial mathbb H n onto a Hardy type subspace of p eigenforms of the de Rham Hodge Laplacian, for 0 leq p frac n 1 2 and q p 1, p .


Reasoning about the garden of forking paths. Lazy evaluation is a powerful tool for functional programmers. It enables the concise expression of on demand computation and a form of compositionality not available under other evaluation strategies. However, the stateful nature of lazy evaluation makes it hard to analyze a program's computational cost, either informally or formally. In this work, we present a novel and simple framework for formally reasoning about lazy computation costs based on a recent model of lazy evaluation clairvoyant call by value. The key feature of our framework is its simplicity, as expressed by our definition of the clairvoyance monad. This monad is both simple to define (around 20 lines of Coq) and simple to reason about. We show that this monad can be effectively used to mechanically reason about the computational cost of lazy functional programs written in Coq.


UDIS Unsupervised Discovery of Bias in Deep Visual Recognition Models. Deep learning models have been shown to learn spurious correlations from data that sometimes lead to systematic failures for certain subpopulations. Prior work has typically diagnosed this by crowdsourcing annotations for various protected attributes and measuring performance, which is both expensive to acquire and difficult to scale. In this work, we propose UDIS, an unsupervised algorithm for surfacing and analyzing such failure modes. UDIS identifies subpopulations via hierarchical clustering of dataset embeddings and surfaces systematic failure modes by visualizing low performing clusters along with their gradient weighted class activation maps. We show the effectiveness of UDIS in identifying failure modes in models trained for image classification on the CelebA and MSCOCO datasets.