Factorization and pseudofactorization of weighted graphs. For unweighted graphs, finding isometric embeddings is closely related to decompositions of G into Cartesian products of smaller graphs. When G is isomorphic to a Cartesian graph product, we call the factors of this product a factorization of G . When G is isomorphic to an isometric subgraph of a Cartesian graph product, we call those factors a pseudofactorization of G . Prior work has shown that an unweighted graph's pseudofactorization can be used to generate a canonical isometric embedding into a product of the smallest possible pseudofactors. However, for arbitrary weighted graphs, which represent a richer variety of metric spaces, methods for finding isometric embeddings or determining their existence remain elusive, and indeed pseudofactorization and factorization have not previously been extended to this context. In this work, we address the problem of finding the factorization and pseudofactorization of a weighted graph G , where G satisfies the property that every edge constitutes a shortest path between its endpoints. We term such graphs minimal graphs, noting that every graph can be made minimal by removing edges not affecting its path metric. We generalize pseudofactorization and factorization to minimal graphs and develop new proof techniques that extend the previously proposed algorithms due to Graham and Winkler Graham and Winkler, '85 and Feder Feder, '92 for pseudofactorization and factorization of unweighted graphs. We show that any m edge, n vertex graph with positive integer edge weights can be factored in O(m 2) time, plus the time to find all pairs shortest paths (APSP) distances in a weighted graph, resulting in an overall running time of O(m 2 n 2 log log n) time. We also show that a pseudofactorization for such a graph can be computed in O(mn) time, plus the time to solve APSP, resulting in an O(mn n 2 log log n) running time.


Private Rank Aggregation in Central and Local Models. In social choice theory, (Kemeny) rank aggregation is a well studied problem where the goal is to combine rankings from multiple voters into a single ranking on the same set of items. Since rankings can reveal preferences of voters (which a voter might like to keep private), it is important to aggregate preferences in such a way to preserve privacy. In this work, we present differentially private algorithms for rank aggregation in the pure and approximate settings along with distribution independent utility upper and lower bounds. In addition to bounds in the central model, we also present utility bounds for the local model of differential privacy.


Scatterbrained A flexible and expandable pattern for decentralized machine learning. Federated machine learning is a technique for training a model across multiple devices without exchanging data between them. Because data remains local to each compute node, federated learning is well suited for use cases in fields where data is carefully controlled, such as medicine, or in domains with bandwidth constraints. One weakness of this approach is that most federated learning tools rely upon a central server to perform workload delegation and to produce a single shared model. Here, we suggest a flexible framework for decentralizing the federated learning pattern, and provide an open source, reference implementation compatible with PyTorch.


Adaptive Group Lasso Neural Network Models for Functions of Few Variables and Time Dependent Data. In this paper, we propose an adaptive group Lasso deep neural network for high dimensional function approximation where input data are generated from a dynamical system and the target function depends on few active variables or few linear combinations of variables. We approximate the target function by a deep neural network and enforce an adaptive group Lasso constraint to the weights of a suitable hidden layer in order to represent the constraint on the target function. We utilize the proximal algorithm to optimize the penalized loss function. Using the non negative property of the Bregman distance, we prove that the proposed optimization procedure achieves loss decay. Our empirical studies show that the proposed method outperforms recent state of the art methods including the sparse dictionary matrix method, neural networks with or without group Lasso penalty.


DeepLoc A Ubiquitous Accurate and Low Overhead Outdoor Cellular Localization System. Recent years have witnessed fast growth in outdoor location based services. While GPS is considered a ubiquitous localization system, it is not supported by low end phones, requires direct line of sight to the satellites, and can drain the phone battery quickly. In this paper, we propose DeepLoc a deep learning based outdoor localization system that obtains GPS like localization accuracy without its limitations. In particular, DeepLoc leverages the ubiquitous cellular signals received from the different cell towers heard by the mobile device as hints to localize it. To do that, crowd sensed geo tagged received signal strength information coming from different cell towers is used to train a deep model that is used to infer the user's position. As part of DeepLoc design, we introduce modules to address a number of practical challenges including scaling the data collection to large areas, handling the inherent noise in the cellular signal and geo tagged data, as well as providing enough data that is required for deep learning models with low overhead. We implemented DeepLoc on different Android devices. Evaluation results in realistic urban and rural environments show that DeepLoc can achieve a median localization accuracy within 18.8m in urban areas and within 15.7m in rural areas. This accuracy outperforms the state of the art cellular based systems by more than 470 and comes with 330 savings in power compared to the GPS. This highlights the promise of DeepLoc as a ubiquitous accurate and low overhead localization system.


AutoDrop Training Deep Learning Models with Automatic Learning Rate Drop. Modern deep learning (DL) architectures are trained using variants of the SGD algorithm that is run with a textit manually defined learning rate schedule, i.e., the learning rate is dropped at the pre defined epochs, typically when the training loss is expected to saturate. In this paper we develop an algorithm that realizes the learning rate drop textit automatically . The proposed method, that we refer to as AutoDrop, is motivated by the observation that the angular velocity of the model parameters, i.e., the velocity of the changes of the convergence direction, for a fixed learning rate initially increases rapidly and then progresses towards soft saturation. At saturation the optimizer slows down thus the angular velocity saturation is a good indicator for dropping the learning rate. After the drop, the angular velocity "resets" and follows the previously described pattern it increases again until saturation. We show that our method improves over SOTA training approaches it accelerates the training of DL models and leads to a better generalization. We also show that our method does not require any extra hyperparameter tuning. AutoDrop is furthermore extremely simple to implement and computationally cheap. Finally, we develop a theoretical framework for analyzing our algorithm and provide convergence guarantees.


Ex DoF Expansion of Action Degree of Freedom with Virtual Camera Rotation for Omnidirectional Image. Inter robot transfer of training data is a little explored topic in learning and vision based robot control. Here we propose a transfer method from a robot with a lower Degree of Freedom (DoF) to one with a higher DoF utilizing the omnidirectional camera image. The virtual rotation of the robot camera enables data augmentation in this transfer learning process. As an experimental demonstration, a vision based control policy for a 6 DoF robot is trained using a dataset collected by a wheeled ground robot with only three DoFs. Towards the application of robotic manipulations, we also demonstrate a control system of a 6 DoF arm robot using multiple policies with different fields of view to enable object reaching tasks.


On Optimal w gons in Convex Polygons. Let P be a set of n points in mathbb R 2 . For a given positive integer w n , our objective is to find a set C subset P of points, such that CH(P setminus C) has the smallest number of vertices and C has at most n w points. We discuss the O(wn 3) time dynamic programming algorithm for monotone decomposable functions (MDF) introduced for finding a class of optimal convex w gons, with vertices chosen from P , and improve it to O(n 3 log w) time, which gives an improvement to the existing algorithm for MDFs if their input is a convex polygon.


The Eulerian transformation. Eulerian polynomials are fundamental in combinatorics and algebra. In this paper we study the linear transformation mathcal A mathbb R t to mathbb R t defined by mathcal A (t n) A n(t) , where A n(t) denotes the n th Eulerian polynomial. We give combinatorial, topological and Ehrhart theoretic interpretations of the operator mathcal A , and investigate questions of unimodality and real rootedness. In particular, we disprove a conjecture by Brenti (1989) concerning the preservation of real zeros, and generalize and strengthen recent results of Haglund and Zhang (2019) on binomial Eulerian polynomials.


RAW C Relatedness of Ambiguous Words in Context (A New Lexical Resource for English). Most words are ambiguous i.e., they convey distinct meanings in different contexts and even the meanings of unambiguous words are context dependent. Both phenomena present a challenge for NLP. Recently, the advent of contextualized word embeddings has led to success on tasks involving lexical ambiguity, such as Word Sense Disambiguation. However, there are few tasks that directly evaluate how well these contextualized embeddings accommodate the more continuous, dynamic nature of word meaning particularly in a way that matches human intuitions. We introduce RAW C, a dataset of graded, human relatedness judgments for 112 ambiguous words in context (with 672 sentence pairs total), as well as human estimates of sense dominance. The average inter annotator agreement (assessed using a leave one annotator out method) was 0.79. We then show that a measure of cosine distance, computed using contextualized embeddings from BERT and ELMo, correlates with human judgments, but that cosine distance also systematically underestimates how similar humans find uses of the same sense of a word to be, and systematically overestimates how similar humans find uses of different sense homonyms. Finally, we propose a synthesis between psycholinguistic theories of the mental lexicon and computational models of lexical semantics.


Combining Context Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification. Since their inception, transformer based language models have led to impressive performance gains across multiple natural language processing tasks. For Arabic, the current state of the art results on most datasets are achieved by the AraBERT language model. Notwithstanding these recent advancements, sarcasm and sentiment detection persist to be challenging tasks in Arabic, given the language's rich morphology, linguistic disparity and dialectal variations. This paper proffers team SPPU AASM's submission for the WANLP ArSarcasm shared task 2021, which centers around the sarcasm and sentiment polarity detection of Arabic tweets. The study proposes a hybrid model, combining sentence representations from AraBERT with static word vectors trained on Arabic social media corpora. The proposed system achieves a F1 sarcastic score of 0.62 and a F PN score of 0.715 for the sarcasm and sentiment detection tasks, respectively. Simulation results show that the proposed system outperforms multiple existing approaches for both the tasks, suggesting that the amalgamation of context free and context dependent text representations can help capture complementary facets of word meaning in Arabic. The system ranked second and tenth in the respective sub tasks of sarcasm detection and sentiment identification.


A Preconditioned Alternating Minimization Framework for Nonconvex and Half Quadratic Optimization. For some typical and widely used non convex half quadratic regularization models and the Ambrosio Tortorelli approximate Mumford Shah model, based on the Kurdyka L ojasiewicz analysis and the recent nonconvex proximal algorithms, we developed an efficient preconditioned framework aiming at the linear subproblems that appeared in the nonlinear alternating minimization procedure. Solving large scale linear subproblems is always important and challenging for lots of alternating minimization algorithms. By cooperating the efficient and classical preconditioned iterations into the nonlinear and nonconvex optimization, we prove that only one or any finite times preconditioned iterations are needed for the linear subproblems without controlling the error as the usual inexact solvers. The proposed preconditioned framework can provide great flexibility and efficiency for dealing with linear subproblems and guarantee the global convergence of the nonlinear alternating minimization method simultaneously.


Augmented Legendrian cobordism in J 1S 1 . We consider Legendrian links and tangles in J 1S 1 and J 1 0,1 equipped with Morse complex families over a field mathbb F and classify them up to Legendrian cobordism. When the coefficient field is mathbb F 2 this provides a cobordism classification for Legendrians equipped with augmentations of the Legendrian contact homology DG algebras. A complete set of invariants, for which arbitrary values may be obtained, is provided by the fiber cohomology, a graded monodromy matrix, and a mod 2 spin number. We apply the classification to construct augmented Legendrian surfaces in J 1M with dim M 2 realizing any prescribed monodromy representation, Phi pi 1(M,x 0) rightarrow mathit GL ( mathbf n , mathbb F ) .


Roadmap on multimode light shaping. Our ability to generate new distributions of light has been remarkably enhanced in recent years. At the most fundamental level, these light patterns are obtained by ingeniously combining different electromagnetic modes. Interestingly, the modal superposition occurs in the spatial, temporal as well as spatio temporal domain. This generalized concept of structured light is being applied across the entire spectrum of optics generating classical and quantum states of light, harnessing linear and nonlinear light matter interactions, and advancing applications in microscopy, spectroscopy, holography, communication, and synchronization. This Roadmap highlights the common roots of these different techniques and thus establishes links between research areas that complement each other seamlessly. We provide an overview of all these areas, their backgrounds, current research, and future developments. We highlight the power of multimodal light manipulation and want to inspire new eclectic approaches in this vibrant research community.


CoCoNets Continuous Contrastive 3D Scene Representations. This paper explores self supervised learning of amodal 3D feature representations from RGB and RGB D posed images and videos, agnostic to object and scene semantic content, and evaluates the resulting scene representations in the downstream tasks of visual correspondence, object tracking, and object detection. The model infers a latent3D representation of the scene in the form of 3D feature points, where each continuous world 3D point is mapped to its corresponding feature vector. The model is trained for contrastive view prediction by rendering 3D feature clouds in queried viewpoints and matching against the 3D feature point cloud predicted from the query view. Notably, the representation can be queried for any 3D location, even if it is not visible from the input view. Our model brings together three powerful ideas of recent exciting research work 3D feature grids as a neural bottleneck for view prediction, implicit functions for handling resolution limitations of 3D grids, and contrastive learning for unsupervised training of feature representations. We show the resulting 3D visual feature representations effectively scale across objects and scenes, imagine information occluded or missing from the input viewpoints, track objects over time, align semantically related objects in 3D, and improve 3D object detection. We outperform many existing state of the art methods for 3D feature learning and view prediction, which are either limited by 3D grid spatial resolution, do not attempt to build amodal 3D representations, or do not handle combinatorial scene variability due to their non convolutional bottlenecks.


DNA Supercoiling Drives a Transition between Collective Modes of Gene Synthesis. Recent experiments showed that multiple copies of the molecular machine RNA polymerase (RNAP) can efficiently synthesize mRNA collectively in the active state of the promoter. However, environmentally induced promoter repression results in long distance antagonistic interactions that drastically reduce the speed of RNAPs and cause a quick arrest of mRNA synthesis. The mechanism underlying this transition between cooperative and antagonistic dynamics remains poorly understood. In this Letter, we introduce a continuum deterministic model for the translocation of RNAPs, where the speed of an RNAP is coupled to the local DNA supercoiling as well as the density of RNAPs on the gene. We assume that torsional stress experienced by individual RNAPs is exacerbated by high RNAP density on the gene and that transcription factors act as physical barriers to the diffusion of DNA supercoils. We show that this minimal model exhibits two transcription modes mediated by the torsional stress a fluid mode when the promoter is active and a torsionally stressed mode when the promoter is repressed, in quantitative agreement with experimentally observed dynamics of co transcribing RNAPs. Our work provides an important step towards understanding the collective dynamics of molecular machines involved in gene expression.


Joint model for intent and entity recognition. The semantic understanding of natural dialogues composes of several parts. Some of them, like intent classification and entity detection, have a crucial role in deciding the next steps in handling user input. Handling each task as an individual problem can be wasting of training resources, and also each problem can benefit from each other. This paper tackles these problems as one. Our new model, which combine intent and entity recognition into one system, is achieving better metrics in both tasks with lower training requirements than solving each task separately. We also optimize the model based on the inputs.


Double tails of multiple zeta values. In this paper we introduce and study double tails of multiple zeta values. We show, in particular, that they satisfy certain recurrence relations and deduce from this a generalization of Euler's classical formula zeta(2) 3 sum m 1 infty m 2 left( 2m atop m right) 1 to all multiple zeta values, as well as a new and very efficient algorithm for computing these values.


A 3D Magnetohydrodynamic simulation for the propagation of plasma plume transverse to applied magnetic field. We have carried out a 3D ideal MHD (Magnetohydrodynamic) simulation to study the evolution of laser generated plasma plume in a moderate external magnetic field (0.13 T) oriented perpendicular to the flow direction of the plasma plume. The simulation shows that the plasma plume pushes the external magnetic field lines outward in the direction of the expansion. This leads to compression and bending of the magnetic field lines.The force resulting from the change in shape and the density of magnetic field lines opposes the expansion of the plume. An elliptic layer of shocked plasma is formed at the plasma external field interface leaving a cavity in the plume core due to the outward expansion and the inertia of the plume. As the plasma pressure drops due to expansion, the imbalance between the magnetic energy and the internal energy results in the collapse of the cavity. These observations have striking similarities with the observations of the experiments Phys. Plasmas 24, 033511 (2017) performed recently to study the plasma plume expansion in the presence of an external transverse magnetic field. This similarity indicates that the physical mechanisms dominantly governing the plasma plume expansion in the moderate magnetic field are aptly described in the ideal MHD regime. The studies thus show that the laser generated plasma plume can be utilized to carry out interesting experiments on MHD phenomena in a simple laboratory set up.


Asymptotics for multifactor Volterra type stochastic volatility models. We study multidimensional stochastic volatility models in which the volatility process is a positive continuous function of a continuous multidimensional Volterra process. The main results obtained in this paper are a generalization of the results due, in the one dimensional case, to Cellupica and Pacchiarotti in cite Cel Pac . We state some large deviation principles for the scaled log price


A Ramsey Theorem for Graded Lattices. We develop a Van der Waerden type theorem in an axiomatic setting of graded lattices and show that this axiomatic formulation can be applied to various lattices, for instance the set partition and the Boolean lattices. We derive the Hales Jewett theorem as a corollary.


Alternative Pathways for Multiple Exciton Generation Solar Cells by Tandem Configurations. Multiple exciton generation solar cells (MEGSCs) undergo low efficiency due to material imperfections such as nonradiative recombination This paper introduces alternative approaches for realizing photovoltaic (PV) devices similar to MEGSCs. Furthermore, we reorganize the detailed balance equation of MEGSCs such that it is similar to that of independent connection tandem solar cells. This is possible because of the spectral dependence of the ideal QY. Finally, we compare these two similar equations and propose alternative approaches for realizing MEGSC like tandem solar cells. We explain the difficulty in fabricating MEGSCs, which arises from the high rate of non idealities. In this regard, the deconstruction of the detailed balance equation of MEGSCs can reveal alternative paths for replacing MEGSCs with tandem solar cell configurations.


NTopo Mesh free Topology Optimization using Implicit Neural Representations. Recent advances in implicit neural representations show great promise when it comes to generating numerical solutions to partial differential equations. Compared to conventional alternatives, such representations employ parameterized neural networks to define, in a mesh free manner, signals that are highly detailed, continuous, and fully differentiable. In this work, we present a novel machine learning approach for topology optimization an important class of inverse problems with high dimensional parameter spaces and highly nonlinear objective landscapes. To effectively leverage neural representations in the context of mesh free topology optimization, we use multilayer perceptrons to parameterize both density and displacement fields. Our experiments indicate that our method is highly competitive for minimizing structural compliance objectives, and it enables self supervised learning of continuous solution spaces for topology optimization problems.


A Gambler that Bets Forever and the Strong Law of Large Numbers. In this expository note, we give a simple proof that a gambler repeating a game with positive expected value never goes broke with a positive probability. This does not immediately follow from the strong law of large numbers or other basic facts on random walks. Using this result, we provide an elementary proof of the strong law of large numbers. The ideas of the proofs come from the maximal ergodic theorem and Birkhoff's ergodic theorem.


Emergence of synchronization in Kuramoto model with frustration under general network topology. In this paper, we will study the emergent behavior of Kuramoto model with frustration on a general digraph containing a spanning tree. We provide a sufficient condition for the emergence of asymptotical synchronization if the initial data is confined in half circle. As lack of uniform coercivity in general digraph, we apply the node decomposition criteria in cite H L Z20 to capture a clear hierarchical structure, which successfully yields the dissipation mechanism of phase diameter and a small invariant set after finite time. Then the dissipation of frequency diameter will be clear, which eventually leads to the synchronization.


Totally disconnected locally compact groups with just infinite locally normal subgroups. We obtain a characterization of totally disconnected, locally compact groups G with the following property given a locally normal subgroup K of G , then there is an open subgroup of K that is a direct factor of an open subgroup of G . This property is motivated by J. Wilson's structure theory of just infinite groups, and indeed, when G has trivial quasi centre, the condition turns out to be equivalent to the condition that G is locally isomorphic to a finite direct product of just infinite profinite groups. In the latter situation we obtain some global structural features of G , building on an earlier result of Barnea Ershov Weigel and also using tools developed by P. E. Caprace, G. Willis and the author for studying local structure in totally disconnected locally compact groups.


One generated nilpotent assosymmetric algebras. We give the classification of 5 and 6 dimensional complex one generated nilpotent assosymmetric algebras.


The Bregman proximal average. We provide a proximal average with repect to a 1 coercive Legendre function. In the sense of Bregman distance, the Bregman envelope of the proximal average is a convex combination of Bregman envelopes of individual functions. The Bregman proximal mapping of the average is a convex combination of convexified proximal mappings of individual functions. Techniques from variational analysis provide the keys for the Bregman proximal average.


Autonomous Navigation and Configuration of Integrated Access Backhauling for UAV Base Station Using Reinforcement Learning. Fast and reliable connectivity is essential to enhancing situational awareness and operational efficiency for public safety mission critical (MC) users. In emergency or disaster circumstances, where existing cellular network coverage and capacity may not be available to meet MC communication demands, deployable network based solutions such as cells on wheels wings can be utilized swiftly to ensure reliable connection for MC users. In this paper, we consider a scenario where a macro base station (BS) is destroyed due to a natural disaster and an unmanned aerial vehicle carrying BS (UAV BS) is set up to provide temporary coverage for users in the disaster area. The UAV BS is integrated into the mobile network using the 5G integrated access and backhaul (IAB) technology. We propose a framework and signalling procedure for applying machine learning to this use case. A deep reinforcement learning algorithm is designed to jointly optimize the access and backhaul antenna tilt as well as the three dimensional location of the UAV BS in order to best serve the on ground MC users while maintaining a good backhaul connection. Our result shows that the proposed algorithm can autonomously navigate and configure the UAV BS to improve the throughput and reduce the drop rate of MC users.


Projective Normality and Ehrhart Unimodality for Weighted Projective Space Simplices. Within the intersection of Ehrhart theory, commutative algebra, and algebraic geometry lie lattice polytopes. Ehrhart theory is concerned with lattice point enumeration in dilates of polytopes lattice polytopes provide a sandbox in which to test many conjectures in commutative algebra and many properties of projectively normal toric varieties in algebraic geometry are encoded through corresponding lattice polytopes. In this article we focus on reflexive simplices and work to identify when these have the integer decomposition property (IDP), or equivalently, when certain weighted projective spaces are projectively normal. We characterize the reflexive, IDP simplices whose associated weighted projective spaces have one projective coordinate with weight fixed to unity and for which the remaining coordinates can assume one of three distinct weights. We show that several subfamilies of such reflexive simplices have unimodal h ast polynomials, thereby making progress towards conjectures and questions of Stanley, Hibi Ohsugi, and others regarding the unimodality of their h ast polynomials. We also provide computational results and introduce the notion of reflexive stabilizations to explore the (non )ubiquity of reflexive simplices that are simultaneously IDP and h ast unimodal.


Tele EvalNet A Low cost, Teleconsultation System for Home based Rehabilitation of Stroke Survivors using Multiscale CNN LSTM Architecture. Technology has an important role to play in the field of Rehabilitation, improving patient outcomes and reducing healthcare costs. However, existing approaches lack clinical validation, robustness and ease of use. We propose Tele EvalNet, a novel system consisting of two components a live feedback model and an overall performance evaluation model. The live feedback model demonstrates feedback on exercise correctness with easy to understand instructions highlighted using color markers. The overall performance evaluation model learns a mapping of joint data to scores, given to the performance by clinicians. The model does this by extracting clinically approved features from joint data. Further, these features are encoded to a lower dimensional space with an autoencoder. A novel multi scale CNN LSTM network is proposed to learn a mapping of performance data to the scores by leveraging features extracted at multiple scales. The proposed system shows a high degree of improvement in score predictions and outperforms the state of the art rehabilitation models.


Vertex and Mixed k Diameter Component Connectivity. n the k diameter component connectivity model a network is consider operational if there is a component with diameter at least k . Therefore, a network is in a failure state if every component has diameter less than k . In this paper we find the vertex variant of the k diameter component connectivity parameter, which is the minimum number of vertex deletions in order to put a network into a failure state, for particular classes of graphs. We also show the mixed variant by allowing vertex and edge failures within the network. We show results for paths, cycles, complete, and complete bipartite graphs for both variants as well as perfect r ary trees for the vertex variant.


Adding the Relation Meets to the Temporal Logic of Prefixes and Infixes makes it EXPSPACE Complete. The choice of the right trade off between expressiveness and complexity is the main issue in interval temporal logic. In their seminal paper, Halpern and Shoham showed that the satisfiability problem for HS (the temporal logic of Allen's relations) is highly undecidable over any reasonable class of linear orders. In order to recover decidability, one can restrict the set of temporal modalities and or the class of models. In the following, we focus on the satisfiability problem for HS fragments under the homogeneity assumption, according to which any proposition letter holds over an interval if only if it holds at all its points. The problem for full HS with homogeneity has been shown to be non elementarily decidable, but its only known lower bound is EXPSPACE (in fact, EXPSPACE hardness has been shown for the logic of prefixes and suffixes BE, which is a very small fragment of it. The logic of prefixes and infixes BD has been recently shown to be PSPACE complete. In this paper, we prove that the addition of the Allen relation Meets to BD makes it EXPSPACE complete.


Region level Active Detector Learning. Active learning for object detection is conventionally achieved by applying techniques developed for classification in a way that aggregates individual detections into image level selection criteria. This is typically coupled with the costly assumption that every image selected for labelling must be exhaustively annotated. This yields incremental improvements on well curated vision datasets and struggles in the presence of data imbalance and visual clutter that occurs in real world imagery. Alternatives to the image level approach are surprisingly under explored in the literature. In this work, we introduce a new strategy that subsumes previous Image level and Object level approaches into a generalized, Region level approach that promotes spatial diversity by avoiding nearby redundant queries from the same image and minimizes context switching for the labeler. We show that this approach significantly decreases labeling effort and improves rare object search on realistic data with inherent class imbalance and cluttered scenes.


A triangulated hull and a Nakayama closure of the stable module category inside the homotopy category. The stable module category has been realized as a subcategory of the unbounded homotopy category of projective modules by Kato. We construct the triangulated hull of this subcategory inside the homotopy category. This can also be used to characterize self injective algebras. Moreover, we extend this construction to a subcategory closed under an induced Nakayama functor. Both of these categories are shown to be preserved by stable equivalences of Morita type. As an application, we study the Grothendieck group of this triangulated hull and compare it with the stable Grothendieck group.


Thermal and Vibrationally Activated Decomposition of the syn CH 3 CHOO Criegee Intermediate. The full reaction pathway between the syn CH 3 CHOO Criegee Intermediate via vinyl hydroxyperoxide to OH CH 2 COH is followed for vibrationally excited and thermally prepared reactants. The rates from vibrational excitation are consistent with those found from experiments and tunneling is not required for reactivity at all initial conditions probed. For vibrationally excited reactant, VHP accumulates and becomes a bottleneck for the reaction. The two preparations relevant for laboratory studies and conditions in the atmosphere lead to a difference of close to one order of magnitude in OH production ( 5 vs. 35 ) on the 1 ns time scale which is an important determinant for the chemical evolution of the atmosphere.


Nonlinear dimensionality reduction for parametric problems a kernel Proper Orthogonal Decomposition (kPOD). Reduced order models are essential tools to deal with parametric problems in the context of optimization, uncertainty quantification, or control and inverse problems. The set of parametric solutions lies in a low dimensional manifold (with dimension equal to the number of independent parameters) embedded in a large dimensional space (dimension equal to the number of degrees of freedom of the full order discrete model). A posteriori model reduction is based on constructing a basis from a family of snapshots (solutions of the full order model computed offline), and then use this new basis to solve the subsequent instances online. Proper Orthogonal Decomposition (POD) reduces the problem into a linear subspace of lower dimension, eliminating redundancies in the family of snapshots. The strategy proposed here is to use a nonlinear dimensionality reduction technique, namely the kernel Principal Component Analysis (kPCA), in order to find a nonlinear manifold, with an expected much lower dimension, and to solve the problem in this low dimensional manifold. Guided by this paradigm, the methodology devised here introduces different novel ideas, namely 1) characterizing the nonlinear manifold using local tangent spaces, where the reduced order problem is linear and based on the neighbouring snapshots, 2) the approximation space is enriched with the cross products of the snapshots, introducing a quadratic description, 3) the kernel for kPCA is defined ad hoc, based on physical considerations, and 4) the iterations in the reduced dimensional space are performed using an algorithm based on a Delaunay tessellation of the cloud of snapshots in the reduced space. The resulting computational strategy is performing outstandingly in the numerical tests, alleviating many of the problems associated with POD and improving the numerical accuracy.


Formalizing Higher Order Termination in Coq. We describe a formalization of higher order rewriting theory and formally prove that an AFS is strongly normalizing if it can be interpreted in a well founded domain. To do so, we use Coq, which is a proof assistant based on dependent type theory. Using this formalization, one can implement several termination techniques, like the interpretation method or dependency pairs, and prove their correctness. Those implementations can then be extracted to OCaml, which results in a verified termination checker.


Vertex Face Zeta correspondence. We present the characteristic polynomial for the transition matrix of a vertex face walk on a graph, and obtain its spectra. Furthermore, we express the characteristic polynomial for the transition matrix of a vertex face walk on the 2 dimensional torus by using its adjacency matrix, and obtain its spectra. As an application, we define a new walk type zeta function with respect to the transition matrix of a vertex face walk on the 2 dimensional torus, and present its explicit formula.


A Concept Knowledge Driven Keywords Retrieval Framework for Sponsored Search. In sponsored search, retrieving synonymous keywords for exact match type is important for accurately targeted advertising. Data driven deep learning based method has been proposed to tackle this problem. An apparent disadvantage of this method is its poor generalization performance on entity level long tail instances, even though they might share similar concept level patterns with frequent instances. With the help of a large knowledge base, we find that most commercial synonymous query keyword pairs can be abstracted into meaningful conceptual patterns through concept tagging. Based on this fact, we propose a novel knowledge driven conceptual retrieval framework to mitigate this problem, which consists of three parts data conceptualization, matching via conceptual patterns and concept augmented discrimination. Both offline and online experiments show that our method is very effective. This framework has been successfully applied to Baidu's sponsored search system, which yields a significant improvement in revenue.


Modeling Context in Answer Sentence Selection Systems on a Latency Budget. Answer Sentence Selection (AS2) is an efficient approach for the design of open domain Question Answering (QA) systems. In order to achieve low latency, traditional AS2 models score question answer pairs individually, ignoring any information from the document each potential answer was extracted from. In contrast, more computationally expensive models designed for machine reading comprehension tasks typically receive one or more passages as input, which often results in better accuracy. In this work, we present an approach to efficiently incorporate contextual information in AS2 models. For each answer candidate, we first use unsupervised similarity techniques to extract relevant sentences from its source document, which we then feed into an efficient transformer architecture fine tuned for AS2. Our best approach, which leverages a multi way attention architecture to efficiently encode context, improves 6 to 11 over noncontextual state of the art in AS2 with minimal impact on system latency. All experiments in this work were conducted in English.


Reconstructing the degree sequence of a sparse graph from a partial deck. The deck of a graph G is the multiset of cards G v v in V(G) . Myrvold (1992) showed that the degree sequence of a graph on n geq7 vertices can be reconstructed from any deck missing one card. We prove that the degree sequence of a graph with average degree d can reconstructed from any deck missing O(n d 3) cards. In particular, in the case of graphs that can be embedded on a fixed surface (e.g. planar graphs), the degree sequence can be reconstructed even when a linear number of the cards are missing.


High performance symbolic numerics via multiple dispatch. As mathematical computing becomes more democratized in high level languages, high performance symbolic numeric systems are necessary for domain scientists and engineers to get the best performance out of their machine without deep knowledge of code optimization. Naturally, users need different term types either to have different algebraic properties for them, or to use efficient data structures. To this end, we developed Symbolics.jl, an extendable symbolic system which uses dynamic multiple dispatch to change behavior depending on the domain needs. In this work we detail an underlying abstract term interface which allows for speed without sacrificing generality. We show that by formalizing a generic API on actions independent of implementation, we can retroactively add optimized data structures to our system without changing the pre existing term rewriters. We showcase how this can be used to optimize term construction and give a 113x acceleration on general symbolic transformations. Further, we show that such a generic API allows for complementary term rewriting implementations. We demonstrate the ability to swap between classical term rewriting simplifiers and e graph based term rewriting simplifiers. We showcase an e graph ruleset which minimizes the number of CPU cycles during expression evaluation, and demonstrate how it simplifies a real world reaction network simulation to halve the runtime. Additionally, we show a reaction diffusion partial differential equation solver which is able to be automatically converted into symbolic expressions via multiple dispatch tracing, which is subsequently accelerated and parallelized to give a 157x simulation speedup. Together, this presents Symbolics.jl as a next generation symbolic numeric computing environment geared towards modeling and simulation.


When is BERT Multilingual? Isolating Crucial Ingredients for Cross lingual Transfer. While recent work on multilingual language models has demonstrated their capacity for cross lingual zero shot transfer on downstream tasks, there is a lack of consensus in the community as to what shared properties between languages enable such transfer. Analyses involving pairs of natural languages are often inconclusive and contradictory since languages simultaneously differ in many linguistic aspects. In this paper, we perform a large scale empirical study to isolate the effects of various linguistic properties by measuring zero shot transfer between four diverse natural languages and their counterparts constructed by modifying aspects such as the script, word order, and syntax. Among other things, our experiments show that the absence of sub word overlap significantly affects zero shot transfer when languages differ in their word order, and there is a strong correlation between transfer performance and word embedding alignment between languages (e.g., R 0.94 on the task of NLI). Our results call for focus in multilingual models on explicitly improving word embedding alignment between languages rather than relying on its implicit emergence.


On a continuous S 'ark "ozy type problem. We prove that there exists a constant varepsilon 0 with the following property if K subset mathbb R 2 is a compact set which contains no pair of the form x, x (z, z 2 ) for z neq 0 , then mathrm dim mathrm H K leq 2 varepsilon .


ShapeEditer a StyleGAN Encoder for Face Swapping. In this paper, we propose a novel encoder, called ShapeEditor, for high resolution, realistic and high fidelity face exchange. First of all, in order to ensure sufficient clarity and authenticity, our key idea is to use an advanced pretrained high quality random face image generator, i.e. StyleGAN, as backbone. Secondly, we design ShapeEditor, a two step encoder, to make the swapped face integrate the identity and attribute of the input faces. In the first step, we extract the identity vector of the source image and the attribute vector of the target image respectively in the second step, we map the concatenation of identity vector and attribute vector into the mathcal W potential space. In addition, for learning to map into the latent space of StyleGAN, we propose a set of self supervised loss functions with which the training data do not need to be labeled manually. Extensive experiments on the test dataset show that the results of our method not only have a great advantage in clarity and authenticity than other state of the art methods, but also reflect the sufficient integration of identity and attribute.


Ramsey numbers of sparse digraphs. Burr and Erd H o s in 1975 conjectured, and Chv 'atal, R "odl, Szemer 'edi and Trotter later proved, that the Ramsey number of any bounded degree graph is linear in the number of vertices. In this paper, we disprove the natural directed analogue of the Burr Erd H o s conjecture, answering a question of Buci 'c, Letzter, and Sudakov. If H is an acyclic digraph, the oriented Ramsey number of H , denoted overrightarrow r 1 (H) , is the least N such that every tournament on N vertices contains a copy of H . We show that for any Delta geq 2 and any sufficiently large n , there exists an acyclic digraph H with n vertices and maximum degree Delta such that overrightarrow r 1 (H) ge n Omega( Delta 2 3 log 5 3 Delta) . This proves that overrightarrow r 1 (H) is not always linear in the number of vertices for bounded degree H . On the other hand, we show that overrightarrow r 1 (H) is nearly linear in the number of vertices for typical bounded degree acyclic digraphs H , and obtain linear or nearly linear bounds for several natural families of bounded degree acyclic digraphs. For multiple colors, we prove a quasi polynomial upper bound overrightarrow r k (H) 2 ( log n) O k (1) for all bounded degree acyclic digraphs H on n vertices, where overrightarrow r k (H) is the least N such that every k edge colored tournament on N vertices contains a monochromatic copy of H . For k geq 2 and n geq 4 , we exhibit an acyclic digraph H with n vertices and maximum degree 3 such that overrightarrow r k (H) ge n Omega( log n log log n) , showing that these Ramsey numbers can grow faster than any polynomial in the number of vertices.


Predictive Representation Learning for Language Modeling. To effectively perform the task of next word prediction, long short term memory networks (LSTMs) must keep track of many types of information. Some information is directly related to the next word's identity, but some is more secondary (e.g. discourse level features or features of downstream words). Correlates of secondary information appear in LSTM representations even though they are not part of an emph explicitly supervised prediction task. In contrast, in reinforcement learning (RL), techniques that explicitly supervise representations to predict secondary information have been shown to be beneficial. Inspired by that success, we propose Predictive Representation Learning (PRL), which explicitly constrains LSTMs to encode specific predictions, like those that might need to be learned implicitly. We show that PRL 1) significantly improves two strong language modeling methods, 2) converges more quickly, and 3) performs better when data is limited. Our work shows that explicitly encoding a simple predictive task facilitates the search for a more effective language model.


Efficient Communication Leader Wingman Flight Formation Control. This paper considers autonomous flight formation of fixed wing air vehicles. Due to several issues such as limitations on communication bandwidth and low observability requirements, an asynchronous control and communication approach is designed in order to reduce the number of updates between the vehicles. With the implementation of an event triggered controller, it is possible to obtain a more efficient communication scheme while also achieving the convergence properties of the desired formation.


Abolitionist Networks Modeling Language Change in Nineteenth Century Activist Newspapers. The abolitionist movement of the nineteenth century United States remains among the most significant social and political movements in US history. Abolitionist newspapers played a crucial role in spreading information and shaping public opinion around a range of issues relating to the abolition of slavery. These newspapers also serve as a primary source of information about the movement for scholars today, resulting in powerful new accounts of the movement and its leaders. This paper supplements recent qualitative work on the role of women in abolition's vanguard, as well as the role of the Black press, with a quantitative text modeling approach. Using diachronic word embeddings, we identify which newspapers tended to lead lexical semantic innovations the introduction of new usages of specific words and which newspapers tended to follow. We then aggregate the evidence across hundreds of changes into a weighted network with the newspapers as nodes directed edge weights represent the frequency with which each newspaper led the other in the adoption of a lexical semantic change. Analysis of this network reveals pathways of lexical semantic influence, distinguishing leaders from followers, as well as others who stood apart from the semantic changes that swept through this period. More specifically, we find that two newspapers edited by women THE PROVINCIAL FREEMAN and THE LILY led a large number of semantic changes in our corpus, lending additional credence to the argument that a multiracial coalition of women led the abolitionist movement in terms of both thought and action. It also contributes additional complexity to the scholarship that has sought to tease apart the relation of the abolitionist movement to the women's suffrage movement, and the vexed racial politics that characterized their relation.


Development of a high light yield liquid argon detector using tetraphenyl butadiene and silicon photomultiplier array. To increase the light yield of a liquid Ar (LAr) detector, we optimized the evaporation technique of tetraphenyl butadiene (TPB) on the detector surface and tested the operability of a silicon photomultiplier (SiPM), namely, the multi pixel photon counter with through silicon via (TSV MPPC, Hamamatsu Photonics K.K.) at LAr temperature. TPB converts the LAr scintillations (vacuum ultraviolet light) to visible light, which can be detected by high sensitivity photosensors. Because the light yield depends on the deposition mass of TPB on the inner surface of the detector, we constructed a well controlled TPB evaporator to ensure reproducibility and measured the TPB deposition mass using a quartz crystal microbalance sensor. After optimizing the deposition mass of TPB (30 mu g cm 2 on the photosensor window and 40 mu g cm 2 on the detector wall), the light yield was 12.8 pm 0.3 p.e. keVee using PMTs with a quantum efficiency of approximately 30 for TPB converted light. We also tested the low temperature tolerance of TSV MPPC, which has a high photon detection efficiency, in the LAr environment. The TSV MPPC detected the LAr scintillations converted by TPB with a photon detection efficiency exceeding 50 .


On special elements for mathbb G m . We construct, unconditionally and in a very general setting, a canonical family of elements in the reduced exterior power lattices of unit groups of global fields. We show these elements generalise cyclotomic elements and we determine their detailed arithmetic properties. We are thereby led to the formulation of refined versions of Stark's conjectures on the values at zero of Artin L series and, in several important cases, we provide concrete evidence in support of these refinements.


Enumerating Minimal Separators in Ranked Order. Let G be an n vertex graph, and s,t vertices of G . We present an efficient algorithm which enumerates the set of minimal st separators of G in ascending order of cardinality, with a delay of O(n 3.5 ) per separator. In particular, we present an algorithm that lists, in ascending order of cardinality, all minimal separators with at most k vertices. In that case, we show that the delay of the enumeration algorithm is O(kn 2.5 ) per separator. Our process is based on a new method that can decide, in polynomial time, whether the set of minimal separators under certain inclusion, exclusion, and cardinality constraints is empty.


Multiscale modelling of oxygenic photogranules. This work presents a mathematical model which describes both the genesis and growth of oxygenic photogranules (OPGs) and the related treatment process. The photogranule has been modelled as a free boundary domain with radial symmetry, which evolves over time as a result of microbial growth, attachment and detachment processes. A system of hyperbolic and parabolic PDEs has been considered to model the advective transport and growth of sessile biomass and the diffusive transport and conversion of soluble substrates. The reactor has been modelled as a sequencing batch reactor (SBR) through a system of first order IDEs. Phototrophic biomass has been considered for the first time in granular biofilms, and cyanobacteria and microalgae are taken into account separately to model their differences in growth rate and light harvesting and utilization. To describe the key role of cyanobacteria in the photogranules formation process, the attachment velocity of all suspended microbial species has been modelled as a function of the cyanobacteria concentration in suspended form. The model takes into account the main biological aspects and processes involved in OPGs based systems heterotrophic and photoautotrophic activities of cyanobacteria and microalgae, metabolic activity of heterotrophic and nitrifying bacteria, microbial decay, EPS secrection, diffusion and conversion of soluble substrates (inorganic and organic carbon, ammonia, nitrate and oxygen), symbiotic and competitive interactions between the different microbial species, day night cycle, light diffusion and attenuation across the granular biofilm and photoinhibion phenomena. The model has been integrated numerically, investigating the evolution and microbial composition of photogranules and the treatment efficiency of the OPGs based system. The results show the consistency of the model and confirm the effectiveness of the OPGs technology.


Global solutions of a doubly tactic resource consumption model with logistic source. We study a doubly tactic resource consumption model bess left begin array lll u t tr u nabla cd(u nabla w), 1mm v t tr v nabla cd(v nabla u) v(1 v beta 1 ), 1mm w t tr w (u v)w w r end array right. eess in a smooth bounded domain oo in R 2 with homogeneous Neumann boundary conditions, where r in C 1( bar Omega times 0, infty)) cap L infty( Omega times(0, infty)) is a given nonnegative function fulfilling bess int t t 1 ii nn sqrt r 2 yy for all t 0. eess It is shown that, firstly, if beta 2 , then the corresponding Neumann initial boundary problem admits a global bounded classical solution. Secondly, when beta 2 , the Neumann initial boundary problem admits a global generalized solution.


Electrotactile feedback applications for hand and arm interactions A systematic review, meta analysis, and future directions. Haptic feedback is critical in a broad range of human machine computer interaction applications. However, the high cost and low portability wearability of haptic devices remain unresolved issues, severely limiting the adoption of this otherwise promising technology. Electrotactile interfaces have the advantage of being more portable and wearable due to their reduced actuators' size, as well as their lower power consumption and manufacturing cost. The applications of electrotactile feedback have been explored in human computer interaction and human machine interaction for facilitating hand based interactions in applications such as prosthetics, virtual reality, robotic teleoperation, surface haptics, portable devices, and rehabilitation. This paper presents a technological overview of electrotactile feedback, as well a systematic review and meta analysis of its applications for hand based interactions. We discuss the different electrotactile systems according to the type of application. We also discuss over a quantitative congregation of the findings, to offer a high level overview into the state of art and suggest future directions. Electrotactile feedback systems showed increased portability wearability, and they were successful in rendering and or augmenting most tactile sensations, eliciting perceptual processes, and improving performance in many scenarios. However, knowledge gaps (e.g., embodiment), technical (e.g., recurrent calibration, electrodes' durability) and methodological (e.g., sample size) drawbacks were detected, which should be addressed in future studies.


Topological rigidity of tori and finite group actions on hypertoral manifolds. Let X be a closed, connected and oriented topological n dimensional manifold. Suppose that (1) X supports an effective action of ( mathbf Z r) n for arbitrarily large values of r , (2) the fundamental group pi 1(X) is virtually solvable, and (3) there exists a map X to T n of nonzero degree. We then prove that X is homeomorphic to T n . Without using the assumption on pi 1(X) we prove that the cohomology ring H (X mathbf Z ) is isomorphic to H (T n mathbf Z ) . We also prove that any closed connected and oriented n dimensional manifold X admitting a map to T n of nonzero degree has Jordan homeomorphism group, and we study for such manifolds the maximal number k such that X admits effective actions of ( mathbf Z r) k for arbitrarily large r . Finally, we prove that if X is a compact and connected Kaehler manifold of real dimension n and X supports effective holomorphic actions of ( mathbf Z r) m for arbitrarily large r , then m leq n , and if m n then X is biholomorphic to a complex torus.


How Fair is Fairness aware Representative Ranking and Methods for Fair Ranking. Rankings of people and items has been highly used in selection making, match making, and recommendation algorithms that have been deployed on ranging of platforms from employment websites to searching tools. The ranking position of a candidate affects the amount of opportunities received by the ranked candidate. It has been observed in several works that the ranking of candidates based on their score can be biased for candidates belonging to the minority community. In recent works, the fairness aware representative ranking was proposed for computing fairness aware re ranking of results. The proposed algorithm achieves the desired distribution of top ranked results with respect to one or more protected attributes. In this work, we highlight the bias in fairness aware representative ranking for an individual as well as for a group if the group is sub active on the platform. We define individual unfairness and group unfairness and propose methods to generate ideal individual and group fair representative ranking if the universal representation ratio is known or unknown. The simulation results show the quantified analysis of fairness in the proposed solutions. The paper is concluded with open challenges and further directions.


Key Information Extraction From Documents Evaluation And Generator. Extracting information from documents usually relies on natural language processing methods working on one dimensional sequences of text. In some cases, for example, for the extraction of key information from semi structured documents, such as invoice documents, spatial and formatting information of text are crucial to understand the contextual meaning. Convolutional neural networks are already common in computer vision models to process and extract relationships in multidimensional data. Therefore, natural language processing models have already been combined with computer vision models in the past, to benefit from e.g. positional information and to improve performance of these key information extraction models. Existing models were either trained on unpublished data sets or on an annotated collection of receipts, which did not focus on PDF like documents. Hence, in this research project a template based document generator was created to compare state of the art models for information extraction. An existing information extraction model "Chargrid" (Katti et al., 2019) was reconstructed and the impact of a bounding box regression decoder, as well as the impact of an NLP pre processing step was evaluated for information extraction from documents. The results have shown that NLP based pre processing is beneficial for model performance. However, the use of a bounding box regression decoder increases the model performance only for fields that do not follow a rectangular shape.


Explaining Off Policy Actor Critic From A Bias Variance Perspective. Off policy Actor Critic algorithms have demonstrated phenomenal experimental performance but still require better explanations. To this end, we show its policy evaluation error on the distribution of transitions decomposes into a Bellman error, a bias from policy mismatch, and a variance term from sampling. By comparing the magnitude of bias and variance, we explain the success of the Emphasizing Recent Experience sampling and 1 age weighted sampling. Both sampling strategies yield smaller bias and variance and are hence preferable to uniform sampling.


A dimension free estimate on L 2 for the maximal Riesz transform in terms of the Riesz transform. W prove a dimension free estimate for the L 2( mathbb R d) norm of the maximal truncated Riesz transform in terms of the L 2( mathbb R d) norm of the Riesz transform. Consequently, the vector of maximal truncated Riesz transforms has a dimension free estimate on L 2( mathbb R d) . We also show that the maximal function of the vector of truncated Riesz transforms has a dimension free estimate on all L p( mathbb R d) spaces, 1 p infty.


Predicting 3D shapes, masks, and properties of materials, liquids, and objects inside transparent containers, using the TransProteus CGI dataset. We present TransProteus, a dataset, and methods for predicting the 3D structure, masks, and properties of materials, liquids, and objects inside transparent vessels from a single image without prior knowledge of the image source and camera parameters. Manipulating materials in transparent containers is essential in many fields and depends heavily on vision. This work supplies a new procedurally generated dataset consisting of 50k images of liquids and solid objects inside transparent containers. The image annotations include 3D models, material properties (color transparency roughness...), and segmentation masks for the vessel and its content. The synthetic (CGI) part of the dataset was procedurally generated using 13k different objects, 500 different environments (HDRI), and 1450 material textures (PBR) combined with simulated liquids and procedurally generated vessels. In addition, we supply 104 real world images of objects inside transparent vessels with depth maps of both the vessel and its content. We propose a camera agnostic method that predicts 3D models from an image as an XYZ map. This allows the trained net to predict the 3D model as a map with XYZ coordinates per pixel without prior knowledge of the image source. To calculate the training loss, we use the distance between pairs of points inside the 3D model instead of the absolute XYZ coordinates. This makes the loss function translation invariant. We use this to predict 3D models of vessels and their content from a single image. Finally, we demonstrate a net that uses a single image to predict the material properties of the vessel content and surface.


Weakly supervised Generative Adversarial Networks for medical image classification. Weakly supervised learning has become a popular technology in recent years. In this paper, we propose a novel medical image classification algorithm, called Weakly Supervised Generative Adversarial Networks (WSGAN), which only uses a small number of real images without labels to generate fake images or mask images to enlarge the sample size of the training set. First, we combine with MixMatch to generate pseudo labels for the fake images and unlabeled images to do the classification. Second, contrastive learning and self attention mechanism are introduced into the proposed problem to enhance the classification accuracy. Third, the problem of mode collapse is well addressed by cyclic consistency loss. Finally, we design global and local classifiers to complement each other with the key information needed for classification. The experimental results on four medical image datasets show that WSGAN can obtain relatively high learning performance by using few labeled and unlabeled data. For example, the classification accuracy of WSGAN is 11 higher than that of the second ranked MIXMATCH with 100 labeled images and 1000 unlabeled images on the OCT dataset. In addition, we also conduct ablation experiments to verify the effectiveness of our algorithm.


Tag, Copy or Predict A Unified Weakly Supervised Learning Framework for Visual Information Extraction using Sequences. Visual information extraction (VIE) has attracted increasing attention in recent years. The existing methods usually first organized optical character recognition (OCR) results into plain texts and then utilized token level entity annotations as supervision to train a sequence tagging model. However, it expends great annotation costs and may be exposed to label confusion, and the OCR errors will also significantly affect the final performance. In this paper, we propose a unified weakly supervised learning framework called TCPN (Tag, Copy or Predict Network), which introduces 1) an efficient encoder to simultaneously model the semantic and layout information in 2D OCR results 2) a weakly supervised training strategy that utilizes only key information sequences as supervision and 3) a flexible and switchable decoder which contains two inference modes one (Copy or Predict Mode) is to output key information sequences of different categories by copying a token from the input or predicting one in each time step, and the other (Tag Mode) is to directly tag the input sequence in a single forward pass. Our method shows new state of the art performance on several public benchmarks, which fully proves its effectiveness.


Shallow Minors, Graph Products and Beyond Planar Graphs. The planar graph product structure theorem of Dujmovi ' c , Joret, Micek, Morin, Ueckerdt, and Wood J. ACM 2020 states that every planar graph is a subgraph of the strong product of a graph with bounded treewidth and a path. This result has been the key tool to resolve important open problems regarding queue layouts, nonrepetitive colourings, centered colourings, and adjacency labelling schemes. In this paper, we extend this line of research by utilizing shallow minors to prove analogous product structure theorems for several beyond planar graph classes. The key observation that drives our work is that many beyond planar graphs can be described as a shallow minor of the strong product of a planar graph with a small complete graph. In particular, we show that power of planar graphs, k planar, (k,p) cluster planar, k semi fan planar graphs and k fan bundle planar graphs can be described in this manner. Using a combination of old and new results, we deduce that these classes have bounded queue number, bounded nonrepetitive chromatic number, polynomial p centred chromatic numbers, linear strong colouring numbers, and cubic weak colouring numbers. In addition, we show that k gap planar graphs have super linear local treewidth and, as a consequence, cannot be described as a subgraph of the strong product of a graph with bounded treewidth and a path.


Learning to Synthesize Programs as Interpretable and Generalizable Policies. Recently, deep reinforcement learning (DRL) methods have achieved impressive performance on tasks in a variety of domains. However, neural network policies produced with DRL methods are not human interpretable and often have difficulty generalizing to novel scenarios. To address these issues, prior works explore learning programmatic policies that are more interpretable and structured for generalization. Yet, these works either employ limited policy representations (e.g. decision trees, state machines, or predefined program templates) or require stronger supervision (e.g. input output state pairs or expert demonstrations). We present a framework that instead learns to synthesize a program, which details the procedure to solve a task in a flexible and expressive manner, solely from reward signals. To alleviate the difficulty of learning to compose programs to induce the desired agent behavior from scratch, we propose to first learn a program embedding space that continuously parameterizes diverse behaviors in an unsupervised manner and then search over the learned program embedding space to yield a program that maximizes the return for a given task. Experimental results demonstrate that the proposed framework not only learns to reliably synthesize task solving programs but also outperforms DRL and program synthesis baselines while producing interpretable and more generalizable policies. We also justify the necessity of the proposed two stage learning scheme as well as analyze various methods for learning the program embedding.


Inverse properties of a class of seven diagonal (near) Toeplitz matrices. This paper discusses the explicit inverse of a class of seven diagonal (near) Toeplitz matrices, which arises in the numerical solutions of nonlinear fourth order differential equation with a finite difference method. A non recurrence explicit inverse formula is derived using the Sherman Morrison formula. Related to the fixed point iteration used to solve the differential equation, we show the positivity of the inverse matrix and construct an upper bound for the norms of the inverse matrix, which can be used to predict the convergence of the method.


Automated computation of nerve fibre inclinations from 3D polarised light imaging measurements of brain tissue. The method 3D polarised light imaging (3D PLI) measures the birefringence of histological brain sections to determine the spatial course of nerve fibres (myelinated axons). While the in plane fibre directions can be determined with high accuracy, the computation of the out of plane fibre inclinations is more challenging because they are derived from the strength of the birefringence signals (retardation), which depends e.g. on the amount of nerve fibres. One possibility to improve the accuracy is to consider the average transmitted light intensity (transmittance weighting). The current procedure requires effortful manual adjustment of parameters and anatomical knowledge. Here, we introduce an automated, optimised computation of the fibre inclinations, allowing for a much faster, reproducible determination of fibre orientations in 3D PLI. Depending on the degree of myelination, the algorithm uses different models (transmittance weighted, unweighted, or a linear combination), allowing to go beyond traditional definitions of white and grey matter and account for regionally specific behaviour. As the algorithm is parallelised and GPU optimised, and uses images from standard 3D PLI (retardation and transmittance), it can be applied to large data sets, also from previous measurements. The functionality is demonstrated on unstained coronal and sagittal histological sections of vervet monkey and rat brains.


On upper and lower fast Knintchine spectra of continued fractions. Let psi mathbb N to mathbb R be a function satisfying phi(n) n to infty as n to infty . We investigate from a multifractal analysis point of view the growth rate of the sums sum n k 1 log a k(x) relative to psi(n) , where a 1(x),a 2(x), a 3(x) cdots denotes the continued fraction expansion of x in (0,1) . The upper (resp. lower) fast Khintchine spectrum is defined by the Hausdorff dimension of the set of all points x for which the upper (resp. lower) limit of frac 1 psi(n) sum n k 1 log a k(x) is 1 . The precise formulas of these two spectra are completely determined, which strengthens a result of Liao and Rams (2016).


Lidar with Velocity Motion Distortion Correction of Point Clouds from Oscillating Scanning Lidars. Lidar point cloud distortion from moving object is an important problem in autonomous driving, and recently becomes even more demanding with the emerging of newer lidars, which feature back and forth scanning patterns. Accurately estimating moving object velocity would not only provide a tracking capability but also correct the point cloud distortion with more accurate description of the moving object. Since lidar measures the time of flight distance but with a sparse angular resolution, the measurement is precise in the radial measurement but lacks angularly. Camera on the other hand provides a dense angular resolution. In this paper, Gaussian based lidar and camera fusion is proposed to estimate the full velocity and correct the lidar distortion. A probabilistic Kalman filter framework is provided to track the moving objects, estimate their velocities and simultaneously correct the point clouds distortions. The framework is evaluated on real road data and the fusion method outperforms the traditional ICP based and point cloud only method. The complete working framework is open sourced (https github.com ISEE Technology lidar with velocity) to accelerate the adoption of the emerging lidars.


Sign Language Production A Review. Sign Language is the dominant yet non primary form of communication language used in the deaf and hearing impaired community. To make an easy and mutual communication between the hearing impaired and the hearing communities, building a robust system capable of translating the spoken language into sign language and vice versa is fundamental. To this end, sign language recognition and production are two necessary parts for making such a two way system. Sign language recognition and production need to cope with some critical challenges. In this survey, we review recent advances in Sign Language Production (SLP) and related areas using deep learning. This survey aims to briefly summarize recent achievements in SLP, discussing their advantages, limitations, and future directions of research.


Self similar solutions for the Muskat equation. We show the existence of self similar solutions for the Muskat equation. These solutions are parameterized by 0 s ll 1 they are exact corners of slope s at t 0 and become smooth in x for t 0 .


Accelerating XOR based Erasure Coding using Program Optimization Techniques. Erasure coding (EC) affords data redundancy for large scale systems. XOR based EC is an easy to implement method for optimizing EC. This paper addresses a significant performance gap between the state of the art XOR based EC approach (with 4.9 GB s coding throughput) and Intel's high performance EC library based on another approach (with 6.7 GB s). We propose a novel approach based on our observation that XOR based EC virtually generates programs of a Domain Specific Language for XORing byte arrays. We formalize such programs as straight line programs (SLPs) of compiler construction and optimize SLPs using various optimization techniques. Our optimization flow is three fold 1) reducing operations using grammar compression algorithms 2) reducing memory accesses using deforestation, a functional program optimization method and 3) reducing cache misses using the (red blue) pebble game of program analysis. We provide an experimental library, which outperforms Intel's library with 8.92 GB s throughput.


Unexpected Suppression of Leidenfrost Phenomenon on Superhydrophobic Surfaces. The Leidenfrost phenomenon entails the levitation of a liquid droplet over a superheated surface, cushioned by its vapor layer. For water, superhydrophobic surfaces are believed to suppress the Leidenfrost point ( it T rm L ) the temperature at which this phenomenon occurs. The vapor film obstructs boiling heat transfer in heat exchangers, thereby compromising energy efficiency and safety. Thus, it is desirable to realize superhydrophobicity without suppressing it T rm L . Here we demonstrate that the it T rm L of water on microtextured superhydrophobic surfaces comprising doubly reentrant pillars (DRPs) can exceed those on hydrophilic and even superhydrophilic surfaces. We disentangle the contributions of microtexture, heat transfer, and surface chemistry on it T rm L and reveal how superhydrophobicity can be realized without suppressing it T rm L . For instance, silica surfaces with DRPs facilitate 300 greater heat transfer to water droplets at 200 circ C in comparison with silica surfaces coated with perfluorinated nanoparticles. Thus, superhydrophobic surfaces could be harnessed for energy efficient thermal machinery.


Patch Tracking based Online Tensor Ring Completion for Streaming Visual Data. Tensor completion is the problem of estimating the missing entries of a partially observed tensor by exploiting its low rank structure. In streaming applications where the frames arrive sequentially such as video completion, the missing entries of the tensor need to be dynamically recovered in an online fashion. Traditional online completion algorithms treat the entire visual data as a tensor, which may not work satisfactorily when there is a big change in the tensor subspace along the temporal dimension, such as due to strong motion across the video frames. In this paper, we develop a novel patch tracking based online tensor completion framework for streaming data. Each incoming tensor is extracted into small patches, and similar patches are tracked along the temporal domain. We propose a new patch tracking strategy that can accurately and efficiently track the patches with missing data. Further, a new online tensor ring completion method is proposed which can efficiently and accurately update the latent core tensors and complete the missing entries of the tracked patches. Extensive experimental results demonstrate the superior performance of the proposed algorithms compared with both online and offline state of the art tensor completion methods.


Axes of Jordan type in non commutative algebras. The Peirce decomposition of a Jordan algebra with respect to an idempotent is well known. This decomposition was taken one step further and generalized recently by Hall, Rehren and Shpectorov, withtheir introduction of it axial algebras , and in particular it primitive axial algebras of Jordan type (PJs for short). It turns out that these notions are closely related to 3 transposition groups and vertex operator algebras. De Medts, Peacock, Shpectorov, and M. Van Couwenberghe generalized axial algebrasto it decomposition algebras which, in particular, are not necessarily commutative. This paper deals with decomposition algebras which are non commutative versions of PJs.


Optimistic and Adaptive Lagrangian Hedging. In online learning an algorithm plays against an environment with losses possibly picked by an adversary at each round. The generality of this framework includes problems that are not adversarial, for example offline optimization, or saddle point problems (i.e. min max optimization). However, online algorithms are typically not designed to leverage additional structure present in non adversarial problems. Recently, slight modifications to well known online algorithms such as optimism and adaptive step sizes have been used in several domains to accelerate online learning recovering optimal rates in offline smooth optimization, and accelerating convergence to saddle points or social welfare in smooth games. In this work we introduce optimism and adaptive stepsizes to Lagrangian hedging, a class of online algorithms that includes regret matching, and hedge (i.e. multiplicative weights). Our results include a general general regret bound a path length regret bound for a fixed smooth loss, applicable to an optimistic variant of regret matching and regret matching optimistic regret bounds for Phi regret, a framework that includes external, internal, and swap regret and optimistic bounds for a family of algorithms that includes regret matching as a special case.


An integrability criterion for a projective limit of Banach distributions. We give an integrability criterion for a projective limit of Banach distributions on a Fr 'echet manifold which is a projective limit of Banach manifolds. This leads to a result of integrability of projective limit of involutive bundles on a projective sequence of Banach manifolds. This can be seen as a version of Frobenius Theorem in Fr 'echet setting. As consequence, we obtain a version of the third Lie theorem for a Fr 'echet Lie group which is a submersive projective limit of Banach Lie groups. We also give an application to a sequence of prolongations of a Banach Lie algebroid.


Designing a Dashboard for Student Teamwork Analysis. Classroom dashboards are designed to help instructors effectively orchestrate classrooms by providing summary statistics, activity tracking, and other information. Existing dashboards are generally specific to an LMS or platform and they generally summarize individual work, not group behaviors. However, CS courses typically involve constellations of tools and mix on and offline collaboration. Thus, cross platform monitoring of individuals and teams is important to develop a full picture of the class. In this work, we describe our work on Concert, a data integration platform that collects data about student activities from several sources such as Piazza, My Digital Hand, and GitHub and uses it to support classroom monitoring through analysis and visualizations. We discuss team visualizations that we have developed to support effective group management and to help instructors identify teams in need of intervention.


Computational catalyst discovery Active classification through myopic multiscale sampling. The recent boom in computational chemistry has enabled several projects aimed at discovering useful materials or catalysts. We acknowledge and address two recurring issues in the field of computational catalyst discovery. First, calculating macro scale catalyst properties is not straight forward when using ensembles of atomic scale calculations (e.g., density functional theory). We attempt to address this issue by creating a multiscale model that estimates bulk catalyst activity using adsorption energy predictions from both density functional theory and machine learning models. The second issue is that many catalyst discovery efforts seek to optimize catalyst properties, but optimization is an inherently exploitative objective that is in tension with the explorative nature of early stage discovery projects. In other words why invest so much time finding a "best" catalyst when it is likely to fail for some other, unforeseen problem? We address this issue by relaxing the catalyst discovery goal into a classification problem "What is the set of catalysts that is worth testing experimentally?" Here we present a catalyst discovery method called myopic multiscale sampling, which combines multiscale modeling with automated selection of density functional theory calculations. It is an active classification strategy that seeks to classify catalysts as "worth investigating" or "not worth investigating" experimentally. Our results show a 7 16 times speedup in catalyst classification relative to random sampling. These results were based on offline simulations of our algorithm on two different datasets a larger, synthesized dataset and a smaller, real dataset.


Model Reduction of Parametric Differential Algebraic Systems by Balanced Truncation. In this article, we deduce a procedure to apply balanced truncation to parameter dependent differential algebraic systems. For that we solve multiple projected Lyapunov equations for different parameter values to compute the Gramians that are required for the truncation procedure. As this process would lead to high computational costs if we perform it for a large number of parameters. Hence, we combine this approach with the reduced basis method that determines a reduced representation of the Lyapunov equation solutions for the parameters of interest. Residual based error estimators are then used to evaluate the quality of the approximations. After introducing the procedure for a general class of differential algebraic systems we turn our focus to systems with a certain structure, for which the method can be applied particularly efficiently. We illustrate the effectiveness of our approach on several models from fluid dynamics and mechanics. We further consider an application of the method in the context of damping optimization.


Towards Intrinsic Interactive Reinforcement Learning. Reinforcement learning (RL) and brain computer interfaces (BCI) are two fields that have been growing over the past decade. Until recently, these fields have operated independently of one another. With the rising interest in human in the loop (HITL) applications, RL algorithms have been adapted to account for human guidance giving rise to the sub field of interactive reinforcement learning (IRL). Adjacently, BCI applications have been long interested in extracting intrinsic feedback from neural activity during human computer interactions. These two ideas have set RL and BCI on a collision course for one another through the integration of BCI into the IRL framework where intrinsic feedback can be utilized to help train an agent. This intersection has created a new and emerging paradigm denoted as intrinsic IRL. To further help facilitate deeper ingratiation of BCI and IRL, we provide a tutorial and review of intrinsic IRL so far with an emphasis on its parent field of feedback driven IRL along with discussions concerning validity, challenges, and open problems.


A Systematic Review on the Detection of Fake News Articles. It has been argued that fake news and the spread of false information pose a threat to societies throughout the world, from influencing the results of elections to hindering the efforts to manage the COVID 19 pandemic. To combat this threat, a number of Natural Language Processing (NLP) approaches have been developed. These leverage a number of datasets, feature extraction selection techniques and machine learning (ML) algorithms to detect fake news before it spreads. While these methods are well documented, there is less evidence regarding their efficacy in this domain. By systematically reviewing the literature, this paper aims to delineate the approaches for fake news detection that are most performant, identify limitations with existing approaches, and suggest ways these can be mitigated. The analysis of the results indicates that Ensemble Methods using a combination of news content and socially based features are currently the most effective. Finally, it is proposed that future research should focus on developing approaches that address generalisability issues (which, in part, arise from limitations with current datasets), explainability and bias.


Measurements of the Most Significant Software Security Weaknesses. In this work, we provide a metric to calculate the most significant software security weaknesses as defined by an aggregate metric of the frequency, exploitability, and impact of related vulnerabilities. The Common Weakness Enumeration (CWE) is a well known and used list of software security weaknesses. The CWE community publishes such an aggregate metric to calculate the Most Dangerous Software Errors'. However, we find that the published equation highly biases frequency and almost ignores exploitability and impact in generating top lists of varying sizes. This is due to the differences in the distributions of the component metric values. To mitigate this, we linearize the frequency distribution using a double log function. We then propose a variety of other improvements, provide top lists of the most significant CWEs for 2019, provide an analysis of the identified software security weaknesses, and compare them against previously published top lists.


Scale aware direct monocular odometry. We present a framework for direct monocular odometry based on depth prediction from a deep neural network. In contrast with existing methods where depth information is only partially exploited, we formulate a novel depth prediction residual which allows us to incorporate multi view depth information. In addition, we propose to use a truncated robust cost function which prevents considering inconsistent depth estimations. The photometric and depth prediction measurements are integrated in a tightly coupled optimization leading to a scale aware monocular system which does not accumulate scale drift. We demonstrate the validity of our proposal evaluating it on the KITTI odometry dataset and comparing it with state of the art monocular and stereo SLAM systems. Experiments show that our proposal largely outperforms classic monocular SLAM, being 5 to 9 times more precise, with an accuracy which is closer to that of stereo systems.


Efficient Byzantine Resilient Stochastic Gradient Desce. Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the workers in a distributed learning system, compute stochastic gradients at each iteration. These methods, albeit workable under Byzantine failures, have the shortcomings of either a sub optimal convergence rate or high computation cost. To this end, we propose a new Byzantine resilient stochastic gradient descent algorithm (BrSGD for short) which is provably robust against Byzantine failures. BrSGD obtains the optimal statistical performance and efficient computation simultaneously. In particular, BrSGD can achieve an order optimal statistical error rate for strongly convex loss functions. The computation complexity of BrSGD is O(md), where d is the model dimension and m is the number of machines. Experimental results show that BrSGD can obtain competitive results compared with non Byzantine machines in terms of effectiveness and convergence.


Algorithmic Concept based Explainable Reasoning. Recent research on graph neural network (GNN) models successfully applied GNNs to classical graph algorithms and combinatorial optimisation problems. This has numerous benefits, such as allowing applications of algorithms when preconditions are not satisfied, or reusing learned models when sufficient training data is not available or can't be generated. Unfortunately, a key hindrance of these approaches is their lack of explainability, since GNNs are black box models that cannot be interpreted directly. In this work, we address this limitation by applying existing work on concept based explanations to GNN models. We introduce concept bottleneck GNNs, which rely on a modification to the GNN readout mechanism. Using three case studies we demonstrate that (i) our proposed model is capable of accurately learning concepts and extracting propositional formulas based on the learned concepts for each target class (ii) our concept based GNN models achieve comparative performance with state of the art models (iii) we can derive global graph concepts, without explicitly providing any supervision on graph level concepts.


Optimizing Space Utilization for More Effective Multi Robot Path Planning. We perform a systematic exploration of the principle of Space Utilization Optimization (SUO) as a heuristic for planning better individual paths in a decoupled multi robot path planner, with applications to both one shot and life long multi robot path planning problems. We show that the decentralized heuristic set, SU I, preserves single path optimality and significantly reduces congestion that naturally happens when many paths are planned without coordination. Integration of SU I into complete planners brings dramatic reductions in computation time due to the significantly reduced number of conflicts and leads to sizable solution optimality gains in diverse evaluation scenarios with medium and large maps, for both one shot and life long problem settings.


On Kaprekar's Junction Numbers. A base b junction number u has the property that there are at least two ways to write it as u v s(v), where s(v) is the sum of the digits in the expansion of the number v in base b. For the base 10 case, Kaprekar in the 1950's and 1960's studied the problem of finding K(n), the smallest u such that the equation u v s(v) has exactly n solutions. He gave the values K(2) 101, K(3) 10 13 1, and conjectured that K(4) 10 24 102. In 1966 Narasinga Rao gave the upper bound 10 1111111111124 102 for K(5), as well as upper bounds for K(6), K(7), K(8), and K(16). In the present work, we derive a set of recurrences which determine K(n) for any base b and in particular imply that these conjectured values of K(n) are correct. The key to our approach is an apparently new recurrence for F(u), the number of solutions to u v s(v). We illustrate our method by computing the values of K(n) for n 16 and bases b 10, and show that for each base K(n) grows as a tower of height proportional to log 2(n). Rather surprisingly, the values of K(n) for the base 5 problem are determined by the classical Thue Morse sequence, which leads us to define generalized Thue Morse sequences for other bases.


Limit Cycles Bifurcating from a Periodic Annulus in Discontinuous Planar Piecewise Linear Hamiltonian differential System with Three Zones. In this paper, we study the number of limit cycles that can bifurcating from a periodic annulus in discontinuous planar piecewise linear Hamiltonian differential system with three zones separated by two parallel straight lines. We prove that if the central subsystem, i.e. the system defined between the two parallel lines, has a real center and the others subsystems have centers or saddles, then we have at least three limit cycles that appear after perturbations of periodic annulus. For this, we study the number of zeros of a Melnikov function for piecewise Hamiltonian system and present a normal form for this system in order to simplify the computations.


Qian Jian and His Contribution to Small Scale Turbulence Studies. Qian Jian, a Chinese theoretical physicist and fluid dynamicist, devoted the second part of his scientific life to the physical understanding of small scale turbulence to the exclusion of all else. Qian developed his own statistical theory of small scale turbulence, based on the Liouville (1853) equation and a perturbation variational approach to non equilibrium statistical mechanics, which is compatible with the Kolmogorov Oboukhov energy spectrum. His statistical theory of small scale turbulence, which appears mathematically and physically valid, successfully led to his contributions to (i) the closure problem of turbulence (ii) one dimensional turbulence (iii) two dimensional turbulence (iv) the turbulent passive scalar field (v) the cascade model of turbulence (vi) the universal equilibrium range of turbulence (vii) a simple model of the bump phenomenon (viii) universal constants of turbulence (ix) the intermittency of turbulence and perhaps most importantly, (x) the effect of the Taylor microscale Reynolds number on both the width of the inertial range of finite Re turbulence and the scaling exponents of velocity structure functions. In particular, Qian found that the inertial range cannot exist when Re is smaller than 2000. In contrast to the prevailing intermittency models, he discovered that normal scaling is valid in the real Kolmogorov inertial range when Re approaches infinity while the anomalous scaling observed in experiments reflects the finite Re effect. He then made a correction to the famous Kolmogorov (1941c) equation and obtained the finite Re effect equation or the Kolmogorov Novikov Qian equation. He also independently derived the decay law of the finite Re effect. Qian steered us along the right path to an improved understanding of small scale turbulence and solutions to its problems.


Discover, Hallucinate, and Adapt Open Compound Domain Adaptation for Semantic Segmentation. Unsupervised domain adaptation (UDA) for semantic segmentation has been attracting attention recently, as it could be beneficial for various label scarce real world scenarios (e.g., robot control, autonomous driving, medical imaging, etc.). Despite the significant progress in this field, current works mainly focus on a single source single target setting, which cannot handle more practical settings of multiple targets or even unseen targets. In this paper, we investigate open compound domain adaptation (OCDA), which deals with mixed and novel situations at the same time, for semantic segmentation. We present a novel framework based on three main design principles discover, hallucinate, and adapt. The scheme first clusters compound target data based on style, discovering multiple latent domains (discover). Then, it hallucinates multiple latent target domains in source by using image translation (hallucinate). This step ensures the latent domains in the source and the target to be paired. Finally, target to source alignment is learned separately between domains (adapt). In high level, our solution replaces a hard OCDA problem with much easier multiple UDA problems. We evaluate our solution on standard benchmark GTA to C driving, and achieved new state of the art results.