A Graph based Approach for Mitigating Multi sided Exposure Bias in Recommender Systems. Fairness is a critical system level objective in recommender systems that has been the subject of extensive recent research. A specific form of fairness is supplier exposure fairness where the objective is to ensure equitable coverage of items across all suppliers in recommendations provided to users. This is especially important in multistakeholder recommendation scenarios where it may be important to optimize utilities not just for the end user, but also for other stakeholders such as item sellers or producers who desire a fair representation of their items. This type of supplier fairness is sometimes accomplished by attempting to increasing aggregate diversity in order to mitigate popularity bias and to improve the coverage of long tail items in recommendations. In this paper, we introduce FairMatch, a general graph based algorithm that works as a post processing approach after recommendation generation to improve exposure fairness for items and suppliers. The algorithm iteratively adds high quality items that have low visibility or items from suppliers with low exposure to the users' final recommendation lists. A comprehensive set of experiments on two datasets and comparison with state of the art baselines show that FairMatch, while significantly improves exposure fairness and aggregate diversity, maintains an acceptable level of relevance of the recommendations.


Flattening Multiparameter Hierarchical Clustering Functors. We bring together topological data analysis, applied category theory, and machine learning to study multiparameter hierarchical clustering. We begin by introducing a procedure for flattening multiparameter hierarchical clusterings. We demonstrate that this procedure is a functor from a category of multiparameter hierarchical partitions to a category of binary integer programs. We also include empirical results demonstrating its effectiveness. Next, we introduce a Bayesian update algorithm for learning clustering parameters from data. We demonstrate that the composition of this algorithm with our flattening procedure satisfies a consistency property.


The 1966 International Congress of Mathematicians A micro memoir. To an extent, the 1966 congress was a hole in the iron curtain. At least that how a young Soviet mathematician saw it.


Dynamic Schnyder Woods. A realizer, commonly known as Schnyder woods, of a triangulation is a partition of its interior edges into three oriented rooted trees. A flip in a realizer is a local operation that transforms one realizer into another. Two types of flips in a realizer have been introduced colored flips and cycle flips. A corresponding flip graph is defined for each of these two types of flips. The vertex sets are the realizers, and two realizers are adjacent if they can be transformed into each other by one flip. In this paper we study the relation between these two types of flips and their corresponding flip graphs. We show that a cycle flip can be obtained from linearly many colored flips. We also prove an upper bound of O(n 2) on the diameter of the flip graph of realizers defined by colored flips. In addition, a data structure is given to dynamically maintain a realizer over a sequence of colored flips which supports queries, including getting a node's barycentric coordinates, in O( log n) time per flip or query.


Disentangling Observed Causal Effects from Latent Confounders using Method of Moments. Discovering the complete set of causal relations among a group of variables is a challenging unsupervised learning problem. Often, this challenge is compounded by the fact that there are latent or hidden confounders. When only observational data is available, the problem is ill posed, i.e. the causal relationships are non identifiable unless strong modeling assumptions are made. When interventions are available, we provide guarantees on identifiability and learnability under mild assumptions. We assume a linear structural equation model (SEM) with independent latent factors and directed acyclic graph (DAG) relationships among the observables. Since the latent variable inference is based on independent component analysis (ICA), we call this model SEM ICA. We use the method of moments principle to establish model identifiability. We develop efficient algorithms based on coupled tensor decomposition with linear constraints to obtain scalable and guaranteed solutions. Thus, we provide a principled approach to tackling the joint problem of causal discovery and latent variable inference.


The complexity of root finding in orders. Given an order, a fundamental problem is deciding whether a univariate polynomial has a zero. It is a special case of deciding whether text Hom (A,B) is non empty for two orders A and B . For fixed separable orders, deciding whether a polynomial has a zero is in P . If we instead fix a separable polynomial, the problem is NP complete with probability 1 . We provide several theorems about NP completeness, culminating into a complete classification of the problem for quadratic and cubic polynomials. A main ingredient is a new type of algebraic NP complete group theoretic problems, as seen in Spe21 .


WeChat Neural Machine Translation Systems for WMT21. This paper introduces WeChat AI's participation in WMT 2021 shared news translation task on English Chinese, English Japanese, Japanese English and English German. Our systems are based on the Transformer (Vaswani et al., 2017) with several novel and effective variants. In our experiments, we employ data filtering, large scale synthetic data generation (i.e., back translation, knowledge distillation, forward translation, iterative in domain knowledge transfer), advanced finetuning approaches, and boosted Self BLEU based model ensemble. Our constrained systems achieve 36.9, 46.9, 27.8 and 31.3 case sensitive BLEU scores on English Chinese, English Japanese, Japanese English and English German, respectively. The BLEU scores of English Chinese, English Japanese and Japanese English are the highest among all submissions, and that of English German is the highest among all constrained submissions.


Efficient Sparse Matrix Kernels based on Adaptive Workload Balancing and Parallel Reduction. Sparse matrix vector and matrix matrix multiplication (SpMV and SpMM) are fundamental in both conventional (graph analytics, scientific computing) and emerging (sparse DNN, GNN) domains. Workload balancing and parallel reduction are widely used design principles for efficient SpMV. However, prior work fails to resolve how to implement and adaptively use the two principles for SpMV MM. To overcome this obstacle, we first complete the implementation space with optimizations by filling three missing pieces in prior work, including (1) We show that workload balancing and parallel reduction can be combined through a segment reduction algorithm implemented with SIMD shuffle primitives. (2) We show that parallel reduction can be implemented in SpMM through loading the dense matrix rows with vector memory operations. (3) We show that vectorized loading of sparse rows, being a part of the benefit of parallel reduction, can co exist with sequential reduction in SpMM through temporally caching sparse matrix elements in the shared memory. In terms of adaptive use, we analyze how the benefit of two principles change with two characteristics from the input data space the diverse sparsity pattern and dense matrix width. We find the benefit of the two principles fades along with the increased total workload, i.e. the increased dense matrix width. We also identify, for SpMV and SpMM, different sparse matrix features that impact workload balancing effectiveness. Our design consistently exceeds cuSPARSE by 1.07 1.57x on different GPUs and dense matrix width, and the kernel selection rules involve 5 12 performance loss compared with optimal choices. Our kernel is being integrated into popular graph learning frameworks to accelerate GNN training.


Time Optimal Paths for Simple Cars with Moving Obstacles in the Hamilton Jacobi Formulation. We consider the problem of time optimal path planning for simple nonholonomic vehicles. In previous similar work, the vehicle has been simplified to a point mass and the obstacles have been stationary. Our formulation accounts for a rectangular vehicle, and involves the dynamic programming principle and a time dependent Hamilton Jacobi Bellman (HJB) formulation which allows for moving obstacles. To our knowledge, this is the first HJB formulation of the problem which allows for moving obstacles. We design an upwind finite difference scheme to approximate the equation and demonstrate the efficacy of our model with a few synthetic examples.


Scene Retrieval for Contextual Visual Mapping. Visual navigation localizes a query place image against a reference database of place images, also known as a visual map'. Localization accuracy requirements for specific areas of the visual map, scene classes', vary according to the context of the environment and task. State of the art visual mapping is unable to reflect these requirements by explicitly targetting scene classes for inclusion in the map. Four different scene classes, including pedestrian crossings and stations, are identified in each of the Nordland and St. Lucia datasets. Instead of re training separate scene classifiers which struggle with these overlapping scene classes we make our first contribution defining the problem of scene retrieval'. Scene retrieval extends image retrieval to classification of scenes defined at test time by associating a single query image to reference images of scene classes. Our second contribution is a triplet trained convolutional neural network (CNN) to address this problem which increases scene classification accuracy by up to 7 against state of the art networks pre trained for scene recognition. The second contribution is an algorithm DMC' that combines our scene classification with distance and memorability for visual mapping. Our analysis shows that DMC includes 64 more images of our chosen scene classes in a visual map than just using distance interval mapping. State of the art visual place descriptors AMOS Net, Hybrid Net and NetVLAD are finally used to show that DMC improves scene class localization accuracy by a mean of 3 and localization accuracy of the remaining map images by a mean of 10 across both datasets.


The Role of the Gradient Term of the Bochner Kodaira Formula in Coherent Sheaf Extension. In applying the Bochner Kodaira formula with boundary term to solve the bar partial equation with L 2 estimates, the gradient term is usually not used. In this note we use the gradient term to construct holomorphic sections to prove the Thullen type extension across codimension 1 for holomorphic vector bundles with Hermitian metric whose curvature is L p for some p 1 .


Annotation and Classification of Evidence and Reasoning Revisions in Argumentative Writing. Automated writing evaluation systems can improve students' writing insofar as students attend to the feedback provided and revise their essay drafts in ways aligned with such feedback. Existing research on revision of argumentative writing in such systems, however, has focused on the types of revisions students make (e.g., surface vs. content) rather than the extent to which revisions actually respond to the feedback provided and improve the essay. We introduce an annotation scheme to capture the nature of sentence level revisions of evidence use and reasoning (the RER' scheme) and apply it to 5th and 6th grade students' argumentative essays. We show that reliable manual annotation can be achieved and that revision annotations correlate with a holistic assessment of essay improvement in line with the feedback provided. Furthermore, we explore the feasibility of automatically classifying revisions according to our scheme.


Reductions for the 3 Decomposition Conjecture. The 3 decomposition conjecture is wide open. It asserts that every finite connected cubic graph can be decomposed into a spanning tree, a disjoint union of cycles, and a matching. We show that every such decomposition is derived from a homeomorphically irreducible spanning tree (HIST). This allows us to propose a novel reformulation of the 3 decomposition conjecture the HIST extension conjecture. We also prove that the following graphs are reducible configurations with respect to the 3 decomposition conjecture the triangle, the K 2,3 , the Petersen graph with one vertex removed, the claw square, the twin house, and the domino. As an application, we show that all 3 connected graphs of tree width at most 3 or of path width at most 4 satisfy the 3 decomposition conjecture and that a 3 connected minimum counterexample to the conjecture is triangle free, all cycles of length at most 6 are induced, and every edge is in the centre of an induced P 6. Finally, we automate the naive part of the process of checking whether a configuration is reducible and we prove that all graphs of order at most 20 satisfy the 3 decomposition conjecture.


ZUPT Aided GNSS Factor Graph with Inertial Navigation Integration for Wheeled Robots. In this work, we demonstrate the importance of zero velocity information for global navigation satellite system (GNSS) based navigation. The effectiveness of using the zero velocity information with zero velocity update (ZUPT) for inertial navigation applications have been shown in the literature. Here we leverage this information and add it as a position constraint in a GNSS factor graph. We also compare its performance to a GNSS inertial navigation system (INS) coupled factor graph. We tested our ZUPT aided factor graph method on three datasets and compared it with the GNSS only factor graph.


Information theoretic characterization of the complete genotype phenotype map of a complex pre biotic world. How information is encoded in bio molecular sequences is difficult to quantify since such an analysis usually requires sampling an exponentially large genetic space. Here we show how information theory reveals both robust and compressed encodings in the largest complete genotype phenotype map (over 5 trillion sequences) obtained to date.


"I'm Not Mad" Commonsense Implications of Negation and Contradiction. Natural language inference requires reasoning about contradictions, negations, and their commonsense implications. Given a simple premise (e.g., "I'm mad at you"), humans can reason about the varying shades of contradictory statements ranging from straightforward negations ("I'm not mad at you") to commonsense contradictions ("I'm happy"). Moreover, these negated or contradictory statements shift the commonsense implications of the original premise in nontrivial ways. For example, while "I'm mad" implies "I'm unhappy about something," negating the premise (i.e., "I'm not mad") does not necessarily negate the corresponding commonsense implications. In this paper, we present the first comprehensive study focusing on commonsense implications of negated statements and contradictions. We introduce ANION1, a new commonsense knowledge graph with 624K if then rules focusing on negated and contradictory events. We then present joint generative and discriminative inference models for this new resource, providing novel empirical insights on how logical negations and commonsense contradictions reshape the commonsense implications of their original premises.


Porosity in the space of H "o lder functions. Let (X, d) be a bounded metric space with a base point 0 X , (Y, bullet ) be a Banach space and Lip alpha 0 (X, Y) be the space of all alpha H "o lderfunctions that vanish at 0 X , equipped with its natural norm (0 alpha le 1). Let 0 alpha beta le 1. We prove that Lip beta 0 (X, Y) is a sigma porous subset of Lip alpha 0 (X, Y), if (and only if) inf d(x, x ') x, x ' in X x x ' 0 (i.e. d is non uniformly discrete). A more general result will be given.


Revelio ML Generated Debugging Queries for Distributed Systems. A major difficulty in debugging distributed systems lies in manually determining which of the many available debugging tools to use and how to query its logs. Our own study of a production debugging workflow confirms the magnitude of this burden. This paper explores whether a machine learning model can assist developers in distributed systems debugging. We present Revelio, a debugging assistant which takes user reports and system logs as input, and outputs debugging queries that developers can use to find a bug's root cause. The key challenges lie in (1) combining inputs of different types (e.g., natural language reports and quantitative logs) and (2) generalizing to unseen faults. Revelio addresses these by employing deep neural networks to uniformly embed diverse input sources and potential queries into a high dimensional vector space. In addition, it exploits observations from production systems to factorize query generation into two computationally and statistically simpler learning tasks. To evaluate Revelio, we built a testbed with multiple distributed applications and debugging tools. By injecting faults and training on logs and reports from 800 Mechanical Turkers, we show that Revelio includes the most helpful query in its predicted list of top 3 relevant queries 96 of the time. Our developer study confirms the utility of Revelio.


Empathetic Response Generation through Graph based Multi hop Reasoning on Emotional Causality. Empathetic response generation aims to comprehend the user emotion and then respond to it appropriately. Most existing works merely focus on what the emotion is and ignore how the emotion is evoked, thus weakening the capacity of the model to understand the emotional experience of the user for generating empathetic responses. To tackle this problem, we consider the emotional causality, namely, what feelings the user expresses (i.e., emotion) and why the user has such feelings (i.e., cause). Then, we propose a novel graph based model with multi hop reasoning to model the emotional causality of the empathetic conversation. Finally, we demonstrate the effectiveness of our model on EMPATHETICDIALOGUES in comparison with several competitive models.


In vitro and Particle Image Velocimetry Studies of Dry Powder Inhalers. Inhalation drug delivery has seen a swift rise in the use of dry powder inhalers (DPIs) to treat chronic respiratory conditions. However, universal adoption of DPIs has been restrained due to their low efficiencies and significant drug losses in the mouth throat region. Aerosol efficiency of DPIs is closely related to the fluid dynamics characteristics of the inhalation flow generated from the devices, which in turn are influenced by the device design. In vitro and particle image velocimetry (PIV) have been used in this study to assess the aerosol performance of a model carrier formulation delivered by DPI devices and to investigate their flow characteristics. Four DPI device models, with modification to their tangential inlets and addition of a grid, have been explored. Similar aerosol performances were observed for all four device models, with FPF larger than 50 , indicating desirable lung deposition. A high swirling and recirculating jet flow emerging from the mouthpiece of the DPI models without the grid was observed, which contributed to particle deposition in the throat. DPI models where the grid was present showed a straightened outflow without undesired lateral spreading, that reduced particle deposition in the throat and mass retention in the device. These findings demonstrate that PIV measurements strengthen in vitro evaluation and can be jointly used to develop high performance DPIs.


Note on the Polyhedral Description of the Minkowski Sum of Two L convex Sets. L convex sets are one of the most fundamental concepts in discrete convex analysis. Furthermore, the Minkowski sum of two L convex sets, called L2 convex sets, is an intriguing object that is closely related to polymatroid intersection. This paper reveals the polyhedral description of an L2 convex set, together with the observation that the convex hull of an L2 convex set is a box TDI polyhedron. Two different proofs are given for the polyhedral description. The first is a structural short proof, relying on the conjugacy theorem in discrete convex analysis, and the second is a direct algebraic proof, based on Fourier Motzkin elimination. The obtained results admit natural graph representations. Implications of the obtained results in discrete convex analysis are also discussed.


A Systematic Evaluation of Domain Adaptation in Facial Expression Recognition. Facial Expression Recognition is a commercially important application, but one common limitation is that applications often require making predictions on out of sample distributions, where target images may have very different properties from the images that the model was trained on. How well, or badly, do these models do on unseen target domains? In this paper, we provide a systematic evaluation of domain adaptation in facial expression recognition. Using state of the art transfer learning techniques and six commonly used facial expression datasets (three collected in the lab and three "in the wild"), we conduct extensive round robin experiments to examine the classification accuracies for a state of the art CNN model. We also perform multi source experiments where we examine a model's ability to transfer from multiple source datasets, including (i) within setting (e.g., lab to lab), (ii) cross setting (e.g., in the wild to lab), (iii) mixed setting (e.g., lab and wild to lab) transfer learning experiments. We find sobering results that the accuracy of transfer learning is not high, and varies idiosyncratically with the target dataset, and to a lesser extent the source dataset. Generally, the best settings for transfer include fine tuning the weights of a pre trained model, and we find that training with more datasets, regardless of setting, improves transfer performance. We end with a discussion of the need for more and regular systematic investigations into the generalizability of FER models, especially for deployed applications.


The complexity of testing all properties of planar graphs, and the role of isomorphism. Consider property testing on bounded degree graphs and let varepsilon 0 denote the proximity parameter. A remarkable theorem of Newman Sohler (SICOMP 2013) asserts that all properties of planar graphs (more generally hyperfinite) are testable with query complexity only depending on varepsilon . Recent advances in testing minor freeness have proven that all additive and monotone properties of planar graphs can be tested in poly( varepsilon 1 ) queries. Some properties falling outside this class, such as Hamiltonicity, also have a similar complexity for planar graphs. Motivated by these results, we ask can all properties of planar graphs can be tested in poly( varepsilon 1 ) queries? Is there a uniform query complexity upper bound for all planar properties, and what is the "hardest" such property to test? We discover a surprisingly clean and optimal answer. Any property of bounded degree planar graphs can be tested in exp(O( varepsilon 2 )) queries. Moreover, there is a matching lower bound, up to constant factors in the exponent. The natural property of testing isomorphism to a fixed graph needs exp( Omega( varepsilon 2 )) queries, thereby showing that (up to polynomial dependencies) isomorphism to an explicit fixed graph is the hardest property of planar graphs. The upper bound is a straightforward adapation of the Newman Sohler analysis that tracks dependencies on varepsilon carefully. The main technical contribution is the lower bound construction, which is achieved by a special family of planar graphs that are all mutually far from each other. We can also apply our techniques to get analogous results for bounded treewidth graphs. We prove that all properties of bounded treewidth graphs can be tested in exp(O( varepsilon 1 log varepsilon 1 )) queries. Moreover, testing isomorphism to a fixed forest requires exp( Omega( varepsilon 1 )) queries.


Twist polynomials of delta matroids. Recently, Gross, Mansour and Tucker introduced the partial duality polynomial of a ribbon graph and posed a conjecture that there is no orientable ribbon graph whose partial duality polynomial has only one non constant term. We found an infinite family of counterexamples for the conjecture and showed that essentially these are the only counterexamples. This is also obtained independently by Chumutov and Vignes Tourneret and they posed a problem it would be interesting to know whether the partial duality polynomial and the related conjectures would make sence for general delta matroids. In this paper, we show that partial duality polynomials have delta matroid analogues. We introduce the twist polynomials of delta matroids and discuss its basic properties for delta matroids. We give a characterization of even normal binary delta matroids whose twist polynomials have only one term and then prove that the twist polynomial of a normal binary delta matroid contains non zero constant term if and only if its intersection graph is bipartite.


Resolving ultrahigh contrast ultrashort pulses with single shot cross correlator at the photon noise limit. In strong field physics experiments with intense lasers, it is of paramount importance to single shot diagnose the temporal contrast between laser pulse peak and its noise pedestal. This allows fast optimization of pulse contrast and meaningful comparison with theory for each pulse shot, and it can help new outcomes from clean laser plasma interactions. Thus far, high contrast ratios up to 10 10, required by present petawatt (PW) class lasers, have been accessible in both generation and single shot characterization. However, ultrahigh contrast 10 13, required by the planned 200 PW lasers, challenges intense laser technology and remains an open question. This paper reports on the first demonstration of such an ultrahigh contrast measurement by adapting single shot cross correlator (SSCC). We introduce an ultrafast method that enables to determine the SSCC detection limit. Our strategy mimics the test laser having known ultrahigh contrast in the measurement frame of time to space mapping. The ultimate contrast measurement limit of 10 13 is achieved, which corresponds to the highest pulse intensity set by SSCC damage threshold and the lowest noise pedestal set by single photon detection. As a consequence, photon noise in the detection is observed and increases as the noise pedestal reduces. The demonstrated measurement ability at the photon noise limit is applied to a high contrast laser system based on second harmonic generation and optical parametric chirped pulse amplification, suggesting accessible of ultrahigh contrast pulses.


TLBfind a Thermal Lattice Boltzmann code for concentrated emulsions with FINite size Droplets. In this paper, we present TLBfind, a GPU code for simulating the hydrodynamics of droplets along with a dynamic temperature field. TLBfind hinges on a two dimensional multi component lattice Boltzmann (LB) model simulating a concentrated emulsion with finite size droplets evolving in a thermal convective state, just above the transition from conduction to convection. The droplet concentration of the emulsion system is tenable, and at the core of the code lies the possibility to measure a large number of physical observables characterising the flow and droplets. Furthermore, TLBfind includes a parallel implementation on GPU of the Delaunay triangulation useful for the detection of droplets' plastic rearrangements, and several types of boundary conditions, supporting simulations of channels with structured rough walls.


How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN. Current language models can generate high quality text. Are they simply copying text they have seen before, or have they learned generalizable linguistic abstractions? To tease apart these possibilities, we introduce RAVEN, a suite of analyses for assessing the novelty of generated text, focusing on sequential structure (n grams) and syntactic structure. We apply these analyses to four neural language models (an LSTM, a Transformer, Transformer XL, and GPT 2). For local structure e.g., individual dependencies model generated text is substantially less novel than our baseline of human generated text from each model's test set. For larger scale structure e.g., overall sentence structure model generated text is as novel or even more novel than the human generated baseline, but models still sometimes copy substantially, in some cases duplicating passages over 1,000 words long from the training set. We also perform extensive manual analysis showing that GPT 2's novel text is usually well formed morphologically and syntactically but has reasonably frequent semantic issues (e.g., being self contradictory).


One conjecture on cut points of virtual links and the arrow polynomial of twisted links. Checkerboard framings are an extension of checkerboard colorings for virtual links. According to checkerboard framings, in 2017, Dye obtained an independent invariant of virtual links the cut point number. Checkerboard framings and cut points can be used as a tool to extend other classical invariants to virtual links. We prove that one of the conjectures in Dye's paper is correct. Moreover, we analyze the connection and difference between checkerboard framing obtained from virtual link diagram by adapting cut points and twisted link diagram obtained from virtual link diagram by introducing bars. By adjusting the normalized arrow polynomial of virtual links, we generalize it to twisted links. And we show that it is an invariant for twisted link. Finally, we figure out three characteristics of the normalized arrow polynomial of a checkerboard colorable twisted link, which is a tool of detecting checkerboard colorability of a twisted link. The latter two characteristics are the same as in the case of checkerboard colorable virtual link diagram.


On Deterministic Numerical Methods for the Quantum Boltzmann Nordheim Equation. I. Spectrally Accurate Approximations, Bose Einstein Condensation, Fermi Dirac Saturation. Spectral methods, thanks to their high accuracy and the possibility to use fast algorithms, represent an effective way to approximate the collisional kinetic equations of Boltzmann type, such as the Boltzmann Nordheim equation. This equation, modeled on the seminal Boltzmann equation, describes using a statistical physics formalism the time evolution of a gas composed of bosons or fermions. Using the spectral Galerkin algorithm introduced in F. Filbet, J. Hu, and S. Jin, ESAIM Math. Model. Numer. Anal., 2011 , together with some novel parallelization techniques, we investigate some of the conjectured properties of the large time behavior of the solutions to this equation. In particular, we are able to observe numerically both Bose Einstein condensation and Fermi Dirac relaxation.


On the small measure expansion phenomenon in connected noncompact nonabelian groups. Suppose G is a connected noncompact locally compact group, A,B are nonempty and compact subsets of G , mu is a left Haar measure on G . Assuming that G is unimodular, and mu(A 2) K mu(A) with K 1 a fixed constant, our first result shows that there is a continuous surjective group homomorphism chi G to L with compact kernel, where L is a Lie group with dim(L) leq lfloor log K rfloor( lfloor log K rfloor 1) 2. We also demonstrate that this dimension bound is sharp, establish the relationship between A and its image under the quotient map, and obtain a more general version of this result for the product set AB without assuming unimodularity. Our second result classifies G,A,B where A,B have nearly minimal expansions (when G is unimodular, this just means mu(AB) is close to mu(A) mu(B) ). This answers a question suggested by Griesmer and Tao, and completes the last open case of the inverse Kemperman problem. The proofs of both results involve a new analysis of locally compact group G with bounded n h , where n h is an invariant of G appearing in the recently developed nonabelian Brunn Minkowski inequality. We also generalize Ruzsa's distance and related results to possibly nonunimodular locally compact groups.


Graph Neural Networks for Traffic Forecasting. The significant increase in world population and urbanisation has brought several important challenges, in particular regarding the sustainability, maintenance and planning of urban mobility. At the same time, the exponential increase of computing capability and of available sensor and location data have offered the potential for innovative solutions to these challenges. In this work, we focus on the challenge of traffic forecasting and review the recent development and application of graph neural networks (GNN) to this problem. GNNs are a class of deep learning methods that directly process the input as graph data. This leverages more directly the spatial dependencies of traffic data and makes use of the advantages of deep learning producing state of the art results. We introduce and review the emerging topic of GNNs, including their most common variants, with a focus on its application to traffic forecasting. We address the different ways of modelling traffic forecasting as a (temporal) graph, the different approaches developed so far to combine the graph and temporal learning components, as well as current limitations and research opportunities.


CoreLM Coreference aware Language Model Fine Tuning. Language Models are the underpin of all modern Natural Language Processing (NLP) tasks. The introduction of the Transformers architecture has contributed significantly into making Language Modeling very effective across many NLP task, leading to significant advancements in the field. However, Transformers come with a big computational cost, which grows quadratically with respect to the input length. This presents a challenge as to understand long texts requires a lot of context. In this paper, we propose a Fine Tuning framework, named CoreLM, that extends the architecture of current Pretrained Language Models so that they incorporate explicit entity information. By introducing entity representations, we make available information outside the contextual space of the model, which results in a better Language Model for a fraction of the computational cost. We implement our approach using GPT2 and compare the fine tuned model to the original. Our proposed model achieves a lower Perplexity in GUMBY and LAMBDADA datasets when compared to GPT2 and a fine tuned version of GPT2 without any changes. We also compare the models' performance in terms of Accuracy in LAMBADA and Children's Book Test, with and without the use of model created coreference annotations.


On the spectrum of an operator associated with least squares finite elements for linear elasticity. In this paper we provide some more details on the numerical analysis and we present some enlightening numerical results related to the spectrum of a finite element least squares approximation of the linear elasticity formulation introduced recently. We show that, although the formulation is robust in the incompressible limit for the source problem, its spectrum is strongly dependent on the Lam 'e parameters and on the underlying mesh.


Feature Concepts for Data Federative Innovations. A feature concept, the essence of the data federative innovation process, is presented as a model of the concept to be acquired from data. A feature concept may be a simple feature, such as a single variable, but is more likely to be a conceptual illustration of the abstract information to be obtained from the data. For example, trees and clusters are feature concepts for decision tree learning and clustering, respectively. Useful feature concepts for satis fying the requirements of users of data have been elicited so far via creative communication among stakeholders in the market of data. In this short paper, such a creative communication is reviewed, showing a couple of appli cations, for example, change explanation in markets and earthquakes, and highlight the feature concepts elicited in these cases.


Declarative Machine Learning Systems. In the last years machine learning (ML) has moved from a academic endeavor to a pervasive technology adopted in almost every aspect of computing. ML powered products are now embedded in our digital lives from recommendations of what to watch, to divining our search intent, to powering virtual assistants in consumer and enterprise settings. Recent successes in applying ML in natural sciences revealed that ML can be used to tackle some of the hardest real world problems humanity faces today. For these reasons ML has become central in the strategy of tech companies and has gathered even more attention from academia than ever before. Despite these successes, what we have witnessed so far is just the beginning. Right now the people training and using ML models are expert developers working within large organizations, but we believe the next wave of ML systems will allow a larger amount of people, potentially without coding skills, to perform the same tasks. These new ML systems will not require users to fully understand all the details of how models are trained and utilized for obtaining predictions. Declarative interfaces are well suited for this goal, by hiding complexity and favouring separation of interests, and can lead to increased productivity. We worked on such abstract interfaces by developing two declarative ML systems, Overton and Ludwig, that require users to declare only their data schema (names and types of inputs) and tasks rather then writing low level ML code. In this article we will describe how ML systems are currently structured, highlight important factors for their success and adoption, what are the issues current ML systems are facing and how the systems we developed addressed them. Finally we will talk about learnings from the development of ML systems throughout the years and how we believe the next generation of ML systems will look like.


On almost p rational characters of p' degree. Let p be a prime and G a finite group. A complex character of G is called almost p rational if its values belong to a cyclotomic field mathbb Q (e 2 pi i n ) for some n in mathbb Z prime to p or precisely divisible by p . We prove that, in contrast to usual p rational characters, there are always "many" almost p rational irreducible characters in finite groups. We obtain both explicit and asymptotic bounds for the number of almost p rational irreducible characters of G in terms of p . In fact, motivated by the McKay Navarro conjecture, we obtain the same bound for the number of such characters of p' degree and prove that, in the minimal situation, the number of almost p rational irreducible p' characters of G coincides with that of N G(P) for P in mathrm Syl p(G) . Lastly, we propose a new way to detect the cyclicity of Sylow p subgroups of a finite group G from its character table, using almost p rational irreducible p' characters and the blockwise refinement of the McKay Navarro conjecture.


Bridging the gap between Human Action Recognition and Online Action Detection. Action recognition, early prediction, and online action detection are complementary disciplines that are often studied independently. Most online action detection networks use a pre trained feature extractor, which might not be optimal for its new task. We address the task specific feature extraction with a teacher student framework between the aforementioned disciplines, and a novel training strategy. Our network, Online Knowledge Distillation Action Detection network (OKDAD), embeds online early prediction and online temporal segment proposal subnetworks in parallel. Low interclass and high intraclass similarity are encouraged during teacher training. Knowledge distillation to the OKDAD network is ensured via layer reuse and cosine similarity between teacher student feature vectors. Layer reuse and similarity learning significantly improve our baseline which uses a generic feature extractor. We evaluate our framework on infrared videos from two popular datasets, NTU RGB D (action recognition, early prediction) and PKU MMD (action detection). Unlike previous attempts on those datasets, our student networks perform without any knowledge of the future. Even with this added difficulty, we achieve state of the art results on both datasets. Moreover, our networks use infrared from RGB D cameras, which we are the first to use for online action detection, to our knowledge.


TransRefer3D Entity and Relation Aware Transformer for Fine Grained 3D Visual Grounding. Recently proposed fine grained 3D visual grounding is an essential and challenging task, whose goal is to identify the 3D object referred by a natural language sentence from other distractive objects of the same category. Existing works usually adopt dynamic graph networks to indirectly model the intra inter modal interactions, making the model difficult to distinguish the referred object from distractors due to the monolithic representations of visual and linguistic contents. In this work, we exploit Transformer for its natural suitability on permutation invariant 3D point clouds data and propose a TransRefer3D network to extract entity and relation aware multimodal context among objects for more discriminative feature learning. Concretely, we devise an Entity aware Attention (EA) module and a Relation aware Attention (RA) module to conduct fine grained cross modal feature matching. Facilitated by co attention operation, our EA module matches visual entity features with linguistic entity features while RA module matches pair wise visual relation features with linguistic relation features, respectively. We further integrate EA and RA modules into an Entity and Relation aware Contextual Block (ERCB) and stack several ERCBs to form our TransRefer3D for hierarchical multimodal context modeling. Extensive experiments on both Nr3D and Sr3D datasets demonstrate that our proposed model significantly outperforms existing approaches by up to 10.6 and claims the new state of the art. To the best of our knowledge, this is the first work investigating Transformer architecture for fine grained 3D visual grounding task.


Incomplete Information VCG Contracts for Common Agency. We study contract design for welfare maximization in the well known "common agency" model of Bernheim and Whinston, 1986 . This model combines the challenges of coordinating multiple principals with the fundamental challenge of contract design that principals have incomplete information of the agent's choice of action. Motivated by the significant social inefficiency of standard contracts for such settings (which we formally quantify using a price of anarchy stability analysis), we investigate whether and how a recent toolbox developed for the first set of challenges under a complete information assumption, VCG contracts Lavi and Shamash, 2019 , can be extended to incomplete information. We define and characterize the class of "incomplete information VCG contracts (IIVCG)", and show it is the unique class guaranteeing truthfulness of the principals and welfare maximization by the agent. Our results reveal an inherent tradeoff between two important properties required to ensure participation in the contract individual rationality (for the principals) and limited liability (for the agent). We design a polynomial time algorithm for determining whether a setting has an IIVCG contract with both properties. As our main result we design a polynomial time "algorithmic IIVCG" contract given valuation reports from the principals it returns, if possible for the setting, a payment scheme for the agent that constitutes an IIVCG contract with all desired properties. We also give a sufficient graph theoretic condition on the population of principals that ensures the existence of such an IIVCG contract.


On the regularity of scalar type spectral C 0 semigroups. We show that, for the C 0 semigroups of scalar type spectral operators, a well known necessary condition for the generation of eventually norm continuous C 0 semigroups, formulated exclusively in terms of the location of the spectrum of the semigroup's generator in the complex plane, is also sufficient and, in fact, characterizes the generators of immediately norm continuous such semigroups. Combining characterizations of the immediate differentiability and the Gevrey ultradifferentiability of scalar type spectral C 0 semigroups with the generation theorem, found earlier by the author, we arrive at respective characterizations of the generation of such semigroups. We further establish characterizations of the generation of eventually differentiable and immediately compact scalar type spectral C 0 semigroups also in terms of the generator's spectrum and show that, for such semigroups, eventual compactness implies immediate. All the obtained results are instantly transferred to the C 0 semigroups of normal operators.


Markov Decision Processes with Incomplete Information and Semi Uniform Feller Transition Probabilities. This paper deals with control of partially observable discrete time stochastic systems. It introduces and studies Markov Decision Processes with Incomplete Information and with semi uniform Feller transition probabilities. The important feature of these models is that their classic reduction to Completely Observable Markov Decision Processes with belief states preserves semi uniform Feller continuity of transition probabilities. Under mild assumptions on cost functions, optimal policies exist, optimality equations hold, and value iterations converge to optimal values for these models. In particular, for Partially Observable Markov Decision Processes the results of this paper imply new and generalize several known sufficient conditions on transition and observation probabilities for weak continuity of transition probabilities for Markov Decision Processes with belief states, the existence of optimal policies, validity of optimality equations defining optimal policies, and convergence of value iterations to optimal values.


Shortest non separating st path on chordal graphs. Many NP Hard problems on general graphs, such as maximum independence set, maximal cliques and graph coloring can be solved efficiently on chordal graphs. In this paper, we explore the problem of non separating st paths defined on edges for a connected undirected graph and two vertices, a non separating path is a path between the two vertices such that if we remove all the edges on the path, the graph remains connected. We show that on general graphs, checking the existence of non separating st paths is NP Hard, but the same problem can be solved in linear time on chordal graphs. In the case that such path exists, we introduce an algorithm that finds the shortest non separating st path on a connected chordal graph of n vertices and m edges with positive edge lengths that runs in O(n log n m) time.


From 3 DoF to 6 DoF New Metrics to Analyse Users Behaviour in Immersive Applications. This work focuses on enabling user centric immersive systems, in which every aspect of the coding delivery rendering chain is tailored to the interactive users. Understanding the actual interactivity and behaviour of those users is still an open challenge and a key step to enable such a user centric system. Our main goal is to enable user behavioural analysis in the case of 6 degree of freedom (DoF) systems by extending the applicability of existing behavioural methodologies adopted for studying user behaviour in 3 DoF settings. Specifically, we deeply analyse 6 DoF navigation patterns with comparisons to the 3 DoF counterpart. Then, we define new metrics aimed at better modelling users similarities in a 6 DoF system. We validate and test our solutions on real navigation paths of users while displaying dynamic volumetric media in 6 DoF Virtual Reality conditions. To show the flexibility and generality of our proposed metrics, we also test their performance on navigation trajectories collected in a 6 DoF Augmented Reality settings. Our results show that metrics that consider both user position and viewing direction better perform in detecting user similarity while navigating in a 6 DoF system. Having easy to use but robust metrics that underpin multiple tools and answer the question "how do I detect if two users look at the same content?" open the gate to new solutions for a user centric system.


Inferring User Facial Affect in Work like Settings. Unlike the six basic emotions of happiness, sadness, fear, anger, disgust and surprise, modelling and predicting dimensional affect in terms of valence (positivity negativity) and arousal (intensity) has proven to be more flexible, applicable and useful for naturalistic and real world settings. In this paper, we aim to infer user facial affect when the user is engaged in multiple work like tasks under varying difficulty levels (baseline, easy, hard and stressful conditions), including (i) an office like setting where they undertake a task that is less physically demanding but requires greater mental strain (ii) an assembly line like setting that requires the usage of fine motor skills and (iii) an office like setting representing teleworking and teleconferencing. In line with this aim, we first design a study with different conditions and gather multimodal data from 12 subjects. We then perform several experiments with various machine learning models and find that (i) the display and prediction of facial affect vary from non working to working settings (ii) prediction capability can be boosted by using datasets captured in a work like context and (iii) segment level (spectral representation) information is crucial in improving the facial affect prediction.


VIN Voxel based Implicit Network for Joint 3D Object Detection and Segmentation for Lidars. A unified neural network structure is presented for joint 3D object detection and point cloud segmentation in this paper. We leverage rich supervision from both detection and segmentation labels rather than using just one of them. In addition, an extension based on single stage object detectors is proposed based on the implicit function widely used in 3D scene and object understanding. The extension branch takes the final feature map from the object detection module as input, and produces an implicit function that generates semantic distribution for each point for its corresponding voxel center. We demonstrated the performance of our structure on nuScenes lidarseg, a large scale outdoor dataset. Our solution achieves competitive results against state of the art methods in both 3D object detection and point cloud segmentation with little additional computation load compared with object detection solutions. The capability of efficient weakly supervision semantic segmentation of the proposed method is also validated by experiments.


cs.MM cs.AI cs.CL cs.CR cs.CY cs.LG cs.SI

A Survey on Multimodal Disinformation Detection. Recent years have witnessed the proliferation of fake news, propaganda, misinformation, and disinformation online. While initially this was mostly about textual content, over time images and videos gained popularity, as they are much easier to consume, attract much more attention, and spread further than simple text. As a result, researchers started targeting different modalities and combinations thereof. As different modalities are studied in different research communities, with insufficient interaction, here we offer a survey that explores the state of the art on multimodal disinformation detection covering various combinations of modalities text, images, audio, video, network structure, and temporal information. Moreover, while some studies focused on factuality, others investigated how harmful the content is. While these two components in the definition of disinformation (i) factuality and (ii) harmfulness, are equally important, they are typically studied in isolation. Thus, we argue for the need to tackle disinformation detection by taking into account multiple modalities as well as both factuality and harmfulness, in the same framework. Finally, we discuss current challenges and future research directions.


Towards Robust One shot Task Execution using Knowledge Graph Embeddings. Requiring multiple demonstrations of a task plan presents a burden to end users of robots. However, robustly executing tasks plans from a single end user demonstration is an ongoing challenge in robotics. We address the problem of one shot task execution, in which a robot must generalize a single demonstration or prototypical example of a task plan to a new execution environment. Our approach integrates task plans with domain knowledge to infer task plan constituents for new execution environments. Our experimental evaluations show that our knowledge representation makes more relevant generalizations that result in significantly higher success rates over tested baselines. We validated the approach on a physical platform, which resulted in the successful generalization of initial task plans to 38 of 50 execution environments with errors resulting from autonomous robot operation included.


Parallelware Tools An Experimental Evaluation on POWER Systems. Static code analysis tools are designed to aid software developers to build better quality software in less time, by detecting defects early in the software development life cycle. Even the most experienced developer regularly introduces coding defects. Identifying, mitigating and resolving defects is an essential part of the software development process, but frequently defects can go undetected. One defect can lead to a minor malfunction or cause serious security and safety issues. This is magnified in the development of the complex parallel software required to exploit modern heterogeneous multicore hardware. Thus, there is an urgent need for new static code analysis tools to help in building better concurrent and parallel software. The paper reports preliminary results about the use of Appentra's Parallelware technology to address this problem from the following three perspectives finding concurrency issues in the code, discovering new opportunities for parallelization in the code, and generating parallel equivalent codes that enable tasks to run faster. The paper also presents experimental results using well known scientific codes and POWER systems.


MITNet GAN Enhanced Magnetic Induction Tomography Based on Complex CNN. Magnetic induction tomography (MIT) is an efficient solution for long term brain disease monitoring, which focuses on reconstructing bio impedance distribution inside the human brain using non intrusive electromagnetic fields. However, high quality brain image reconstruction remains challenging since reconstructing images from the measured weak signals is a highly non linear and ill conditioned problem. In this work, we propose a generative adversarial network (GAN) enhanced MIT technique, named MITNet, based on a complex convolutional neural network (CNN). The experimental results on the real world dataset validate the performance of our technique, which outperforms the state of art method by 25.27 .


Phase space interpretation of spatial stationarity for coherence holography. We extend the wide sense spatial stationarity concept of coherence holography in the regime of phase space using the wigner distribution function. We focus mainly on the incoherent light source and the Fourier and Fresnel propagation kernels for the optical field transformation rule (inputoutput relation) and derive the same analogy in WDF. We further show that in phase space the WDF obtained from the ensemble averaged and space averaged coherence functions are the same. Finally, we interpret behaviour of these results through numerical simulations.


An Inexact Riemannian Proximal Gradient Method. This paper considers the problem of minimizing the summation of a differentiable function and a nonsmooth function on a Riemannian manifold. In recent years, proximal gradient method and its invariants have been generalized to the Riemannian setting for solving such problems. Different approaches to generalize the proximal mapping to the Riemannian setting lead versions of Riemannian proximal gradient methods. However, their convergence analyses all rely on solving their Riemannian proximal mapping exactly, which is either too expensive or impracticable. In this paper, we study the convergence of an inexact Riemannian proximal gradient method. It is proven that if the proximal mapping is solved sufficiently accurately, then the global convergence and local convergence rate based on the Riemannian Kurdyka L ojasiewicz property can be guaranteed. Moreover, practical conditions on the accuracy for solving the Riemannian proximal mapping are provided. As a byproduct, the proximal gradient method on the Stiefel manifold proposed in CMSZ2020 can be viewed as the inexact Riemannian proximal gradient method provided the proximal mapping is solved to certain accuracy. Finally, numerical experiments on sparse principal component analysis are conducted to test the proposed practical conditions.


Coupled FBSDEs with Measurable Coefficients and its Application to Parabolic PDEs. Using purely probabilistic methods, we prove the existence and the uniqueness of solutions fora system of coupled forward backward stochastic differential equations (FBSDEs) with measurable, possibly discontinuous coefficients. As a corollary, we obtain the well posedness of semilinear parabolic partial differential equations (PDEs) begin aligned mathcal L u(t,x) F(t,x,u, partial x u) 0 qquad u(T,x) h(x) mathcal L partial t frac 1 2 sum i,j 1 m( sigma sigma intercal) ij (t,x) partial 2 x ix j end aligned in the natural domain of the second order linear parabolic operator mathcal L . We allow F and h to be discontinuous with respect to x . Finally, we apply the result to optimal policy making for pandemics and pricing of carbon emission financial derivatives.


Hole operations on Hurwitz maps. For a given group G the orientably regular maps with orientation preserving automorphism group G are used as the vertices of a graph O(G) , with undirected and directed edges showing the effect of duality and hole operations on these maps. Some examples of these graphs are given, including several for small Hurwitz groups. For some G , such as the affine groups rm AGL 1(2 e) , the graph O(G) is connected, whereas for some other infinite families, such as the alternating and symmetric groups, the number of connected components is unbounded.


Associating Objects with Transformers for Video Object Segmentation. This paper investigates how to realize better and more efficient embedding learning to tackle the semi supervised video object segmentation under challenging multi object scenarios. The state of the art methods learn to decode features with a single positive object and thus have to match and segment each target separately under multi object scenarios, consuming multiple times computing resources. To solve the problem, we propose an Associating Objects with Transformers (AOT) approach to match and decode multiple objects uniformly. In detail, AOT employs an identification mechanism to associate multiple targets into the same high dimensional embedding space. Thus, we can simultaneously process multiple objects' matching and segmentation decoding as efficiently as processing a single object. For sufficiently modeling multi object association, a Long Short Term Transformer is designed for constructing hierarchical matching and propagation. We conduct extensive experiments on both multi object and single object benchmarks to examine AOT variant networks with different complexities. Particularly, our R50 AOT L outperforms all the state of the art competitors on three popular benchmarks, i.e., YouTube VOS (84.1 J F), DAVIS 2017 (84.9 ), and DAVIS 2016 (91.1 ), while keeping more than 3 times faster multi object run time. Meanwhile, our AOT T can maintain real time multi object speed on the above benchmarks. Based on AOT, we ranked 1st in the 3rd Large scale VOS Challenge.


Diffusion of gravity waves by random space inhomogeneities in pancake ice fields. Theory and validation with wave buoys and synthetic aperture radar. We study the diffusion of ocean waves by ice bodies much smaller than a wavelength, such as pancakes and small ice floes. We argue that inhomogeneities in the ice cover at scales comparable to that of the wavelength significantly increase diffusion, producing a contribution to wave attenuation comparable to what is observed in the field and usually explained by viscous effects. The resulting attenuation spectrum is characterized by a peak at the scale of the inhomogeneities in the ice cover, which could explain the rollover of the attenuation profile at small wavelengths observed in field experiments. The proposed attenuation mechanism leads to the same behaviors that would be produced by a viscous wave model with effective viscosity linearly dependent on the ice thickness. This may explain recent findings that viscous wave models require a thickness dependent viscosity to fit experimental attenuation data. Experimental validation is carried out using wave buoy attenuation data and synthetic aperture radar image analysis.


Re Three dimensional wake topology and propulsive performance of low aspect ratio pitching rolling plates. This article reports on a full replication study in computational fluid dynamics, using an immersed boundary method to obtain the flow around a pitching and rolling elliptical wing. As in the original study, the computational experiments investigate the wake topology and aerodynamic forces, looking at the effect of Reynolds number (100 400), Strouhal number (0.4 1.2), aspect ratio, and rolling pitching phase difference. We also include a grid independence study (from 5 to 72 million grid cells). The trends in aerodynamic performance and the characteristics of the wake topology were replicated, despite some differences in results. We declare the replication successful, and make fully available all the digital artifacts and workflow definitions, including software build recipes and container images, as well as secondary data and post processing code. Run times for each computational experiment were between 8.1 and 13.8 hours to complete 5 flapping cycles, using two compute nodes with dual 20 core 3.7GHz Intel Xeon Gold 6148 CPUs and two NVIDIA V100 GPU devices each.


DLL Direct LIDAR Localization. A map based localization approach for aerial robots. This paper presents DLL, a fast direct map based localization technique using 3D LIDAR for its application to aerial robots. DLL implements a point cloud to map registration based on non linear optimization of the distance of the points and the map, thus not requiring features, neither point correspondences. Given an initial pose, the method is able to track the pose of the robot by refining the predicted pose from odometry. Through benchmarks using real datasets and simulations, we show how the method performs much better than Monte Carlo localization methods and achieves comparable precision to other optimization based approaches but running one order of magnitude faster. The method is also robust under odometric errors. The approach has been implemented under the Robot Operating System (ROS), and it is publicly available.


Towards Optimized Distributed Multi Robot Printing An Algorithmic Approach. This paper presents a distributed multi robot printing method which utilizes an optimization approach to decompose and allocate a printing task to a group of mobile robots. The motivation for this problem is to minimize the printing time of the robots by using an appropriate task decomposition algorithm. We present one such algorithm which decomposes an image into rasterized geodesic cells before allocating them to the robots for printing. In addition to this, we also present the design of a numerically controlled holonomic robot capable of spraying ink on smooth surfaces. Further, we use this robot to experimentally verify the results of this paper.


Rapid Convex Optimization of Centroidal Dynamics using Block Coordinate Descent. In this paper we explore the use of block coordinate descent (BCD) to optimize the centroidal momentum dynamics for dynamically consistent multi contact behaviors. The centroidal dynamics have recently received a large amount of attention in order to create physically realizable motions for robots with hands and feet while being computationally more tractable than full rigid body dynamics models. Our contribution lies in exploiting the structure of the dynamics in order to simplify the original non convex problem into two convex subproblems. We iterate between these two subproblems for a set number of iterations or until a consensus is reached. We explore the properties of the proposed optimization method for the centroidal dynamics and verify in simulation that motions generated by our approach can be tracked by the quadruped Solo12. In addition, we compare our method to a recently proposed convexification using a sequence of convex relaxations as well as a more standard interior point method used in the off the shelf solver IPOPT to show that our approach finds similar, if not better, trajectories (in terms of cost), and is more than four times faster than both approaches. Finally, compared to previous approaches, we note its practicality due to the convex nature of each subproblem which allows our method to be used with any off the shelf quadratic programming solver.


Periodic Fast Multipole Method. A new scheme is presented for imposing periodic boundary conditions on unit cells with arbitrary source distributions. We restrict our attention here to the Poisson, modified Helmholtz, Stokes and modified Stokes equations. The approach extends to the oscillatory equations of mathematical physics, including the Helmholtz and Maxwell equations, but we will address these in a companion paper, since the nature of the problem is somewhat different and includes the consideration of quasiperiodic boundary conditions and resonances. Unlike lattice sum based methods, the scheme is insensitive to the unit cell's aspect ratio and is easily coupled to adaptive fast multipole methods (FMMs). Our analysis relies on classical "plane wave" representations of the fundamental solution, and yields an explicit low rank representation of the field due to all image sources beyond the first layer of neighboring unit cells. When the aspect ratio of the unit cell is large, our scheme can be coupled with the nonuniform fast Fourier transform (NUFFT) to accelerate the evaluation of the induced field. Its performance is illustrated with several numerial examples.


Short Text Clustering with Transformers. Recent techniques for the task of short text clustering often rely on word embeddings as a transfer learning component. This paper shows that sentence vector representations from Transformers in conjunction with different clustering methods can be successfully applied to address the task. Furthermore, we demonstrate that the algorithm of enhancement of clustering via iterative classification can further improve initial clustering performance with different classifiers, including those based on pre trained Transformer language models.


Optimal stability estimates and a new uniqueness result for advection diffusion equations. This paper contains two main contributions. First, it provides optimal stability estimates for advection diffusion equations in a setting in which the velocity field is Sobolev regular in the spatial variable. This estimate is formulated with the help of Kantorovich Rubinstein distances with logarithmic cost functions. Second, the stability estimates are extended to the advection diffusion equations with velocity fields whose gradients are singular integrals of L 1 functions entailing a new well posedness result.


Coordinate Descent Methods for DC Minimization. Difference of Convex (DC) minimization, referring to the problem of minimizing the difference of two convex functions, has been found rich applications in statistical learning and studied extensively for decades. However, existing methods are primarily based on multi stage convex relaxation, only leading to weak optimality of critical points. This paper proposes a coordinate descent method for minimizing DC functions based on sequential nonconvex approximation. Our approach iteratively solves a nonconvex one dimensional subproblem globally, and it is guaranteed to converge to a coordinate wise stationary point. We prove that this new optimality condition is always stronger than the critical point condition and the directional point condition when the objective function is weakly convex. For comparisons, we also include a naive variant of coordinate descent methods based on sequential convex approximation in our study. When the objective function satisfies an additional regularity condition called textit sharpness , coordinate descent methods with an appropriate initialization converge textit linearly to the optimal solution set. Also, for many applications of interest, we show that the nonconvex one dimensional subproblem can be computed exactly and efficiently using a breakpoint searching method. Finally, we have conducted extensive experiments on several statistical learning tasks to show the superiority of our approach. Keywords Coordinate Descent, DC Minimization, DC Programming, Difference of Convex Programs, Nonconvex Optimization, Sparse Optimization, Binary Optimization.


Data driven, structure preserving approximations to entropy based moment closures for kinetic equations. We present a data driven approach to construct entropy based closures for the moment system from kinetic equations. The proposed closure learns the entropy function by fitting the map between the moments and the entropy of the moment system, and thus does not depend on the space time discretization of the moment system and specific problem configurations such as initial and boundary conditions. With convex and C 2 approximations, this data driven closure inherits several structural properties from entropy based closures, such as entropy dissipation, hyperbolicity, and H Theorem. We construct convex approximations to the Maxwell Boltzmann entropy using convex splines and neural networks, test them on the plane source benchmark problem for linear transport in slab geometry, and compare the results to the standard, optimization based M N closures. Numerical results indicate that these data driven closures provide accurate solutions in much less computation time than the M N closures.


Fine tuning of Pre trained Transformers for Hate, Offensive, and Profane Content Detection in English and Marathi. This paper describes neural models developed for the Hate Speech and Offensive Content Identification in English and Indo Aryan Languages Shared Task 2021. Our team called neuro utmn thales participated in two tasks on binary and fine grained classification of English tweets that contain hate, offensive, and profane content (English Subtasks A B) and one task on identification of problematic content in Marathi (Marathi Subtask A). For English subtasks, we investigate the impact of additional corpora for hate speech detection to fine tune transformer models. We also apply a one vs rest approach based on Twitter RoBERTa to discrimination between hate, profane and offensive posts. Our models ranked third in English Subtask A with the F1 score of 81.99 and ranked second in English Subtask B with the F1 score of 65.77 . For the Marathi tasks, we propose a system based on the Language Agnostic BERT Sentence Embedding (LaBSE). This model achieved the second result in Marathi Subtask A obtaining an F1 of 88.08 .


Factual Probing Is MASK Learning vs. Learning to Recall. Petroni et al. (2019) demonstrated that it is possible to retrieve world facts from a pre trained language model by expressing them as cloze style prompts and interpret the model's prediction accuracy as a lower bound on the amount of factual information it encodes. Subsequent work has attempted to tighten the estimate by searching for better prompts, using a disjoint set of facts as training data. In this work, we make two complementary contributions to better understand these factual probing techniques. First, we propose OptiPrompt, a novel and efficient method which directly optimizes in continuous embedding space. We find this simple method is able to predict an additional 6.4 of facts in the LAMA benchmark. Second, we raise a more important question Can we really interpret these probing results as a lower bound? Is it possible that these prompt search methods learn from the training data too? We find, somewhat surprisingly, that the training data used by these methods contains certain regularities of the underlying fact distribution, and all the existing prompt methods, including ours, are able to exploit them for better fact prediction. We conduct a set of control experiments to disentangle "learning" from "learning to recall", providing a more detailed picture of what different prompts can reveal about pre trained language models.


Quadric bundles and hyperbolic equivalence. We introduce the notion of hyperbolic equivalence for quadric bundles and show that hyperbolic equivalent quadric bundles share many important properties they have the same Brauer data moreover, if they have the same dimension over the base, they are birational over the base and have equal classes in the Grothendieck ring of varieties. Furthermore, when the base is a projective space we show that two quadric bundles are hyperbolic equivalent if and only if their cokernel sheaves are isomorphic up to twist, their fibers over a fixed point of the base are Witt equivalent, and, in some cases, certain quadratic forms on intermediate cohomology groups of the underlying vector bundles are Witt equivalent. For this we show that any quadric bundle over mathbb P n is hyperbolic equivalent to a quadric bundle whose underlying vector bundle has many cohomology vanishings this class of bundles, called VLC bundles in the paper, is interesting by itself.


MCUa Multi level Context and Uncertainty aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classification. Breast histology image classification is a crucial step in the early diagnosis of breast cancer. In breast pathological diagnosis, Convolutional Neural Networks (CNNs) have demonstrated great success using digitized histology slides. However, tissue classification is still challenging due to the high visual variability of the large sized digitized samples and the lack of contextual information. In this paper, we propose a novel CNN, called Multi level Context and Uncertainty aware (MCUa) dynamic deep learning ensemble model.MCUamodel consists of several multi level context aware models to learn the spatial dependency between image patches in a layer wise fashion. It exploits the high sensitivity to the multi level contextual information using an uncertainty quantification component to accomplish a novel dynamic ensemble model.MCUamodelhas achieved a high accuracy of 98.11 on a breast cancer histology image dataset. Experimental results show the superior effectiveness of the proposed solution compared to the state of the art histology classification models.


Transforming the Preparation of Physics GTAs Curriculum Development. Graduate Teaching Assistants (GTAs) are key partners in the education of undergraduates. Given the potentially large impact GTAs can have on undergraduate student learning, it is important to provide them with appropriate preparation for teaching. But GTAs are students themselves, and not all of them desire to pursue an academic career. Fully integrating GTA preparation into the professional development of graduate students lowers the barrier to engagement so that all graduate students may benefit from the opportunity to explore teaching and its applications to many potential career paths. In this paper we describe the design and implementation of a GTA Preparation course for first year Ph.D. students at the Georgia Tech School of Physics. Through a yearly cycle of implementation and revision, guided by the 3P Framework we developed (Pedagogy, Physics, Professional Development), the course has evolved into a robust and comprehensive professional development program that is well received by physics graduate students.


Comparison of different convolutional neural network activation functions and methods for building ensembles. Recently, much attention has been devoted to finding highly efficient and powerful activation functions for CNN layers. Because activation functions inject different nonlinearities between layers that affect performance, varying them is one method for building robust ensembles of CNNs. The objective of this study is to examine the performance of CNN ensembles made with different activation functions, including six new ones presented here 2D Mexican ReLU, TanELU, MeLU GaLU, Symmetric MeLU, Symmetric GaLU, and Flexible MeLU. The highest performing ensemble was built with CNNs having different activation layers that randomly replaced the standard ReLU. A comprehensive evaluation of the proposed approach was conducted across fifteen biomedical data sets representing various classification tasks. The proposed method was tested on two basic CNN architectures Vgg16 and ResNet50. Results demonstrate the superiority in performance of this approach. The MATLAB source code for this study will be available at https github.com LorisNanni.


Learning Cross Scale Visual Representations for Real Time Image Geo Localization. Robot localization remains a challenging task in GPS denied environments. State estimation approaches based on local sensors, e.g. cameras or IMUs, are drifting prone for long range missions as error accumulates. In this study, we aim to address this problem by localizing image observations in a 2D multi modal geospatial map. We introduce the cross scale dataset and a methodology to produce additional data from cross modality sources. We propose a framework that learns cross scale visual representations without supervision. Experiments are conducted on data from two different domains, underwater and aerial. In contrast to existing studies in cross view image geo localization, our approach a) performs better on smaller scale multi modal maps b) is more computationally efficient for real time applications c) can serve directly in concert with state estimation pipelines.


Assessing Exception Handling Testing Practices in Open Source Libraries. Modern programming languages (e.g., Java and C ) provide features to separate error handling code from regular code, seeking to enhance software comprehensibility and maintainability. Nevertheless, the way exception handling (EH) code is structured in such languages may lead to multiple, different, and complex control flows, which may affect the software testability. Previous studies have reported that EH code is typically neglected, not well tested, and its misuse can lead to reliability degradation and catastrophic failures. However, little is known about the relationship between testing practices and EH testing effectiveness. In this exploratory study, we (i) measured the adequacy degree of EH testing concerning code coverage (instruction, branch, and method) criteria and (ii) evaluated the effectiveness of the EH testing by measuring its capability to detect artificially injected faults (i.e., mutants) using 7 EH mutation operators. Our study was performed using test suites of 27 long lived Java libraries from open source ecosystems. Our results show that instructions and branches within mathtt catch blocks and mathtt throw instructions are less covered, with statistical significance than the overall instructions and branches. Nevertheless, most of the studied libraries presented test suites capable of detecting more than 70 of the injected faults. From a total of 12,331 mutants created in this study, the test suites were able to detect 68 of them.


A New Algorithm for Hidden Markov Models Learning Problem. This research focuses on the algorithms and approaches for learning Hidden Markov Models (HMMs) and compares HMM learning methods and algorithms. HMM is a statistical Markov model in which the system being modeled is assumed to be a Markov process. One of the essential characteristics of HMMs is their learning capabilities. Learning algorithms are introduced to overcome this inconvenience. One of the main problems of the newly proposed algorithms is their validation. This research aims by using the theoretical and experimental analysis to 1) compare HMMs learning algorithms proposed in the literature, 2) provide a validation tool for new HMM learning algorithms, and 3) present a new algorithm called Asexual Reproduction Optimization (ARO) with one of its extensions Modified ARO (MARO) as a novel HMM learning algorithm to use the validation tool proposed. According to the literature findings, it seems that populationbased algorithms perform better among HMMs learning approaches than other algorithms. Also, the testing was done in nine benchmark datasets. The results show that MARO outperforms different algorithms in objective functions in terms of accuracy and robustness.


Linear Codes Associated to Symmetric Determinantal Varieties Even Rank Case. We consider linear codes over a finite field mathbb F q , for odd q , derived from determinantal varieties, obtained from symmetric matrices of bounded ranks. A formula for the weight of a codeword is derived. Using this formula, we have computed the minimum distance for the codes corresponding to matrices upperbounded by any fixed, even rank. A conjecture is proposed for the cases where the upper bound is odd. At the end of the article, tables for the weights of these codes, for spaces of symmetric matrices up to order 5 , are given.


Graph Neural Network to Dilute Outliers for Refactoring Monolith Application. Microservices are becoming the defacto design choice for software architecture. It involves partitioning the software components into finer modules such that the development can happen independently. It also provides natural benefits when deployed on the cloud since resources can be allocated dynamically to necessary components based on demand. Therefore, enterprises as part of their journey to cloud, are increasingly looking to refactor their monolith application into one or more candidate microservices wherein each service contains a group of software entities (e.g., classes) that are responsible for a common functionality. Graphs are a natural choice to represent a software system. Each software entity can be represented as nodes and its dependencies with other entities as links. Therefore, this problem of refactoring can be viewed as a graph based clustering task. In this work, we propose a novel method to adapt the recent advancements in graph neural networks in the context of code to better understand the software and apply them in the clustering task. In that process, we also identify the outliers in the graph which can be directly mapped to top refactor candidates in the software. Our solution is able to improve state of the art performance compared to works from both software engineering and existing graph representation based techniques.


Mode center Placement of Monolayer WS 2 in a Photonic Polymer Waveguide. Effective integration of 2D materials such as monolayer transition metal dichalcogenides (TMDs) into photonic waveguides and integrated circuits is being intensely pursued due to the materials' strong exciton based optical response. Here, we present a platform where a WS 2 hBN 2D heterostructure is directly integrated into the photonic mode center of a novel polymer ridge waveguide. FDTD simulations and collection of photoluminescence from the guided mode indicate that this system exhibits significantly improved waveguide emitter coupling over a previous elastomer platform. This is facilitated by the platform's enhanced refractive index contrast and a new method for mode center integration of the coupled TMD. The integration is based on a simple dry transfer process that is applicable to other 2D materials, and the platform's elastomeric nature is a natural fit to explore strain tunable hybrid photonic devices. The demonstrated ability of coupling photoluminescence to a polymer waveguide opens up new possibilities for hybrid photonic systems in a variety of contexts.


Partially isometric Toeplitz operators on the polydisc. A Toeplitz operator T varphi , varphi in L infty( mathbb T n) , is a partial isometry if and only if there exist inner functions varphi 1, varphi 2 in H infty( mathbb D n) such that varphi 1 and varphi 2 depends on different variables and varphi bar varphi 1 varphi 2 . In particular, for n 1 , along with new proof, this recovers a classical theorem of Brown and Douglas. noindent We also prove that a partially isometric Toeplitz operator is hyponormal if and only if the corresponding symbol is an inner function in H infty( mathbb D n) . Moreover, partially isometric Toeplitz operators are always power partial isometry (following Halmos and Wallen), and hence, up to unitary equivalence, a partially isometric Toeplitz operator with symbol in L infty( mathbb T n) , n 1 , is either a shift, or a co shift, or a direct sum of truncated shifts. Along the way, we prove that T varphi is a shift whenever varphi is inner in H infty( mathbb D n) .


Almost Tight Approximation Algorithms for Explainable Clustering. Recently, due to an increasing interest for transparency in artificial intelligence, several methods of explainable machine learning have been developed with the simultaneous goal of accuracy and interpretability by humans. In this paper, we study a recent framework of explainable clustering first suggested by Dasgupta et al. cite dasgupta2020explainable . Specifically, we focus on the k means and k medians problems and provide nearly tight upper and lower bounds. First, we provide an O( log k log log k) approximation algorithm for explainable k medians, improving on the best known algorithm of O(k) cite dasgupta2020explainable and nearly matching the known Omega( log k) lower bound cite dasgupta2020explainable . In addition, in low dimensional spaces d ll log k , we show that our algorithm also provides an O(d log 2 d) approximate solution for explainable k medians. This improves over the best known bound of O(d log k) for low dimensions cite laber2021explainable , and is a constant for constant dimensional spaces. To complement this, we show a nearly matching Omega(d) lower bound. Next, we study the k means problem in this context and provide an O(k log k) approximation algorithm for explainable k means, improving over the O(k 2) bound of Dasgupta et al. and the O(d k log k) bound of cite laber2021explainable . To complement this we provide an almost tight Omega(k) lower bound, improving over the Omega( log k) lower bound of Dasgupta et al. Given an approximate solution to the classic k means and k medians, our algorithm for k medians runs in time O(kd log 2 k ) and our algorithm for k means runs in time O(k 2 d) .


SPAN a Simple Predict Align Network for Handwritten Paragraph Recognition. Unconstrained handwriting recognition is an essential task in document analysis. It is usually carried out in two steps. First, the document is segmented into text lines. Second, an Optical Character Recognition model is applied on these line images. We propose the Simple Predict Align Network an end to end recurrence free Fully Convolutional Network performing OCR at paragraph level without any prior segmentation stage. The framework is as simple as the one used for the recognition of isolated lines and we achieve competitive results on three popular datasets RIMES, IAM and READ 2016. The proposed model does not require any dataset adaptation, it can be trained from scratch, without segmentation labels, and it does not require line breaks in the transcription labels. Our code and trained model weights are available at https github.com FactoDeepLearning SPAN.


Improved constructions for succinct affine automata. Affine finite automata (AfA) can be more succinct than probabilistic and quantum finite automata when recognizing some regular languages with bounded error. In this paper, we improve previously known constructions given for the succinctness of AfAs in three ways. First, we replace some of fixed error bounds with arbitrarily small error bounds. Second, we present new constructions by using less states than the previous constructions. Third, we show that any language recognized by a nondeterministic finite automaton (NFA) is also recognized by bounded error AfAs having one more state, and so, AfAs inherit all succinct results by NFAs. As a special case, we also show that any language recognized by a NFA is recognized by AfAs with zero error if the number of accepting path(s) for each member is exactly the same number.


A 1 O(1 N) approximation algorithm for TTP(2). The traveling tournament problem is a well known benchmark problem of the sports scheduling. We propose an approximation algorithm for the traveling tournament problem with the constraints such that both the number of consecutive home games and that of consecutive away games are at most two (called TTP(2)). The approximation ratio of the proposed algorithm is 1 24 n for n teams, which is the first 1 O(1 n) approximation algorithm for TTP(2).


On the complexity of Putinar Vasilescu's Positivstellensatz. We provide a new degree bound on the weighted sum of squares (SOS) polynomials for Putinar Vasilescu's Positivstellensatz. This leads to another Positivstellensatz saying that if f is a polynomial of degree at most 2 d f nonnegative on a semialgebraic set having nonempty interior defined by finitely many polynomial inequalities g j(x) ge 0 , j 1, dots,m with g 1 L x 2 2 for some L 0 , then there exist positive constants bar c and c depending on f,g j such that for any varepsilon 0 , for all k ge bar c varepsilon c , f has the decomposition begin equation begin array l (1 x 2 2) k(f varepsilon) sigma 0 sum j 1 m sigma jg j ,, end array end equation for some SOS polynomials sigma j being such that the degrees of sigma 0, sigma jg j are at most 2(d f k) . Here cdot 2 denotes the ell 2 vector norm. As a consequence, we obtain a converging hierarchy of semidefinite relaxations for lower bounds in polynomial optimization on basic compact semialgebraic sets. The complexity of this hierarchy is mathcal O ( varepsilon c ) for prescribed accuracy varepsilon 0 . In particular, if m L 1 then c 65 , yielding the complexity mathcal O ( varepsilon 65 ) for the minimization of a polynomial on the unit ball. Our result improves the complexity bound mathcal O ( exp( varepsilon c )) due to Nie and Schweighofer in Journal of Complexity 23.1 (2007) 135 150 .


Analogs of Bol operators for mathfrak pgl (a 1 vert b) subset mathfrak vect (a vert b) . Bol operators are differential operators invariant under the projective action of mathfrak pgl (2) simeq mathfrak sl (2) between spaces of weighted densities on the 1 dimensional manifold. In arXiv 2110.10504, we classified analogs of Bol operators on the 1 vert n dimensional superstrings with a contact structure invariant under the projective action of mathfrak osp (n vert 2) between spaces of weighted densities (i.e., tensor fields with rank 1 fiber) as well as under mathfrak pgl (m 2) subset mathfrak k (1 2m) , and mathfrak osp a(4 2) subset mathfrak k (1 4) for the even fiber, and mathfrak pe (2) subset mathfrak m (1) for the odd fiber. Here we consider other analogs of Bol operators mathfrak pgl (a 1 vert b) invariant differential operators between spaces of tensor fields on (a vert b) dimensional supermanifolds with irreducible, as mathfrak gl (a vert b) modules, fibers of arbitrary, even infinite, dimension for certain "key" values of a and b the ones for which the solution is describable. We discovered many new operators the case of 1 vert 1 dimensional general superstring looks a most natural superization of Bol's result, additional to the case of a superstring with a contact structure. For a and b generic and fibers of rank 1 , the solution is indescribable whereas there are no non scalar non zero differential operators between spaces with rank 1 fibers. This justifies the selection of cases in arXiv 2110.10504.


Growth estimates and diameter bounds for classical Chevalley groups. Babai's conjecture states that, for any finite simple non abelian group G , the diameter of G is bounded by ( log G ) C for some absolute constant C . We prove that, for any classical Chevalley group G of rank r defined over a field mathbb F q with q not too small with respect to r , begin equation mathrm diam (G( mathbb F q )) leq( log G( mathbb F q ) ) 1947r 4 log(2r) . end equation This bound improves on results by Breuillard, Green, and Tao 7 , Pyber and Szab 'o 31 , and, for q large enough, also on Halasi, Mar 'oti, Pyber, and Qiao 13 . Our bound is achieved by way of giving dimensional estimates for certain subvarieties of G , i.e. estimates of the form A cap V( mathbb F q ) ll A C dim(V) dim(G) valid for all generating sets A . We also provide an explicit dimensional estimate for general subvarieties of G .


The attenuated ray transforms on Gaussian thermostats with negative curvature. In the present paper we consider a Gaussian thermostat on a compact Riemannian surface with negative thermostat curvature. In the case of surfaces with boundary, we show that the thermostat ray transform with attenuation given by a general connection and Higgs field is injective, modulo the natural obstruction, for tensors. We also prove that the connection and Higgs field can be determined, up to a gauge transformation, from the knowledge of the parallel transport between boundary points along all possible thermostat geodesics. In the case of closed surfaces, we obtain similar results for the ray transform with some additional conditions on the connection. Under the same condition, we study connections and Higgs fields whose parallel transport along periodic thermostat geodesics coincides with the ones for the flat connection.


Data Driven Synthesis of Provably Sound Side Channel Analyses. We propose a data driven method for synthesizing a static analyzer to detect side channel information leaks in cryptographic software. Compared to the conventional way of manually crafting such a static analyzer, which can be labor intensive, error prone and suboptimal, our learning based technique is not only automated but also provably sound. Our analyzer consists of a set of type inference rules learned from the training data, i.e., example code snippets annotated with ground truth. Internally, we use syntax guided synthesis (SyGuS) to generate new features and decision tree learning (DTL) to generate type inference rules based on these features. We guarantee soundness by formally proving each learned rule via a technique called Datalog query containment checking. We have implemented our technique in the LLVM compiler and used it to detect power side channels in C programs. Our results show that, in addition to being automated and provably sound during synthesis, the learned analyzer also has the same empirical accuracy as two state of the art, manually crafted analyzers while being 300X and 900X faster, respectively.


MultiHead MultiModal Deep Interest Recommendation Network. With the development of information technology, human beings are constantly producing a large amount of information at all times. How to obtain the information that users are interested in from the large amount of information has become an issue of great concern to users and even business managers. In order to solve this problem, from traditional machine learning to deep learning recommendation systems, researchers continue to improve optimization models and explore solutions. Because researchers have optimized more on the recommendation model network structure, they have less research on enriching recommendation model features, and there is still room for in depth recommendation model optimization. Based on the DIN cite Authors01 model, this paper adds multi head and multi modal modules, which enriches the feature sets that the model can use, and at the same time strengthens the cross combination and fitting capabilities of the model. Experiments show that the multi head multi modal DIN improves the recommendation prediction effect, and outperforms current state of the art methods on various comprehensive indicators.


Bounding nonminimality and a conjecture of Borovik Cherlin. Motivated by the search for methods to establish strong minimality of certain low order algebraic differential equations, a measure of how far a finite rank stationary type is from being minimal is introduced and studied The em degree of nonminimality is the minimum number of realisations of the type required to witness a nonalgebraic forking extension. Conditional on the truth of a conjecture of Borovik and Cherlin on the generic multiple transitivity of homogeneous spaces definable in the stable theory being considered, it is shown that the nonminimality degree is bounded by the U rank plus 2 . The Borovik Cherlin conjecture itself is verified for algebraic and meromorphic group actions, and a bound of U rank plus 1 is then deduced unconditionally for differentially closed fields and compact complex manifolds. An application is given regarding transcendence of solutions to algebraic differential equations.