The effects of local homogeneity assumptions in metapopulation models of infectious disease. Computational models of infectious disease can be broadly categorized into two types individual based (Agent based), or compartmental models. While compartmental models can be structured to separate distinct sectors of a population, they are conceptually distinct from individual based models in which population structure emerges from micro scale interactions. While the conceptual distinction is straightforward, a fair comparison of the approaches is difficult to achieve. Here, we carry out such a comparison by building a set of compartmental metapopulation models from an agent based representation of a real population. By adjusting the compartmental model to approximately match the dynamics of the Agent based model, we identify two key qualitative properties of the individual based dynamics which are lost upon aggregation into metapopulations. These are (1) the local depletion of susceptibility to infection, and (2) decoupling of different regional groups due to correlation between commuting behaviors and contact rates. The first of these effects is a general consequence of aggregating small, closely connected groups (i.e., families) into larger homogeneous metapopulations. The second can be interpreted as a consequence of aggregating two distinct types of individuals school children, who travel short distances but have many potentially infectious contacts, and adults, who travel further but tend to have fewer contacts capable of transmitting infection. Our results could be generalised to other types of correlations between the characteristics of individuals and the behaviors that distinguish them.


Can Attention Enable MLPs To Catch Up With CNNs?. In the first week of May, 2021, researchers from four different institutions Google, Tsinghua University, Oxford University and Facebook, shared their latest work 16, 7, 12, 17 on arXiv.org almost at the same time, each proposing new learning architectures, consisting mainly of linear layers, claiming them to be comparable, or even superior to convolutional based models. This sparked immediate discussion and debate in both academic and industrial communities as to whether MLPs are sufficient, many thinking that learning architectures are returning to MLPs. Is this true? In this perspective, we give a brief history of learning architectures, including multilayer perceptrons (MLPs), convolutional neural networks (CNNs) and transformers. We then examine what the four newly proposed architectures have in common. Finally, we give our views on challenges and directions for new learning architectures, hoping to inspire future research.


Some matrix inequalities of log majorization type. The purpose of this paper is two fold we present some matrix inequalities of log majorization type for eigenvalues indexed by a sequence we then apply our main theorem to generalize and improve the Hua Marcus' inequalities. Our results are stronger and more general than the existing ones.


Visual Search Asymmetry Deep Nets and Humans Share Similar Inherent Biases. Visual search is a ubiquitous and often challenging daily task, exemplified by looking for the car keys at home or a friend in a crowd. An intriguing property of some classical search tasks is an asymmetry such that finding a target A among distractors B can be easier than finding B among A. To elucidate the mechanisms responsible for asymmetry in visual search, we propose a computational model that takes a target and a search image as inputs and produces a sequence of eye movements until the target is found. The model integrates eccentricity dependent visual recognition with target dependent top down cues. We compared the model against human behavior in six paradigmatic search tasks that show asymmetry in humans. Without prior exposure to the stimuli or task specific training, the model provides a plausible mechanism for search asymmetry. We hypothesized that the polarity of search asymmetry arises from experience with the natural environment. We tested this hypothesis by training the model on augmented versions of ImageNet where the biases of natural images were either removed or reversed. The polarity of search asymmetry disappeared or was altered depending on the training protocol. This study highlights how classical perceptual properties can emerge in neural network models, without the need for task specific training, but rather as a consequence of the statistical properties of the developmental diet fed to the model. All source code and data are publicly available at https github.com kreimanlab VisualSearchAsymmetry.


MSR Net Multi Scale Relighting Network for One to One Relighting. Deep image relighting allows photo enhancement by illumination specific retouching without human effort and so it is getting much interest lately. Most of the existing popular methods available for relighting are run time intensive and memory inefficient. Keeping these issues in mind, we propose the use of Stacked Deep Multi Scale Hierarchical Network, which aggregates features from each image at different scales. Our solution is differentiable and robust for translating image illumination setting from input image to target image. Additionally, we have also shown that using a multi step training approach to this problem with two different loss functions can significantly boost performance and can achieve a high quality reconstruction of a relighted image.


Resilience from Diversity Population based approach to harden models against adversarial attacks. Traditional deep learning networks (DNN) exhibit intriguing vulnerabilities that allow an attacker to force them to fail at their task. Notorious attacks such as the Fast Gradient Sign Method (FGSM) and the more powerful Projected Gradient Descent (PGD) generate adversarial samples by adding a magnitude of perturbation epsilon to the input's computed gradient, resulting in a deterioration of the effectiveness of the model's classification. This work introduces a model that is resilient to adversarial attacks. Our model leverages an established mechanism of defense which utilizes randomness and a population of DNNs. More precisely, our model consists of a population of n diverse submodels, each one of them trained to individually obtain a high accuracy for the task at hand, while forced to maintain meaningful differences in their weights. Each time our model receives a classification query, it selects a submodel from its population at random to answer the query. To counter the attack transferability, diversity is introduced and maintained in the population of submodels. Thus introducing the concept of counter linking weights. A Counter Linked Model (CLM) consists of a population of DNNs of the same architecture where a periodic random similarity examination is conducted during the simultaneous training to guarantee diversity while maintaining accuracy. Though the randomization technique proved to be resilient against adversarial attacks, we show that by retraining the DNNs ensemble or training them from the start with counter linking would enhance the robustness by around 20 when tested on the MNIST dataset and at least 15 when tested on the CIFAR 10 dataset. When CLM is coupled with adversarial training, this defense mechanism achieves state of the art robustness.


Heat transfer process with solid solid interface Analytical and numerical solutions. This work is aimed at the study and analysis of the heat transport on a metal bar of length L with a solid solid interface. The process is assumed to be developed along one direction, across two homogeneous and isotropic materials. Analytical and numerical solutions are obtained under continuity conditions at the interface, that is a perfect assembly. The lateral side is assumed to be isolated and a constant thermal source is located at the left boundary while the right end stays free allowing the heat to transfer to the surrounding fluid by a convective process. The differences between the analytic solution and temperature measurements at any point on the right would indicate the presence of discontinuities. The greater these differences, the greater the discontinuity in the interface due to thermal resistances, providing a measure of its propagation from the interface and they could be modeled as temperature perturbations. The problem of interest may be described by a parabolic equation with initial, interface and boundary conditions, where the thermal properties, the conductivity and diffusivity coefficients, are piecewise constant functions. The analytic solution is derived by using Fourier methods. Special attention is given to the Sturm Liouville problem that arises when deriving the solution, since a complicated eigenvalue equation must to be solved. Numerical simulations are conducted by using finite difference schemes where its convergence and stability properties are discussed along with physical interpretations of the results.


Goal Driven Autonomous Exploration Through Deep Reinforcement Learning. In this paper, we present an autonomous navigation system for goal driven exploration of unknown environments through deep reinforcement learning (DRL). Points of interest (POI) for possible navigation directions are obtained from the environment and an optimal waypoint is selected, based on the available data. Following the waypoints, the robot is guided towards the global goal and the local optimum problem of reactive navigation is mitigated. Then, a motion policy for local navigation is learned through a DRL framework in a simulation. We develop a navigation system where this learned policy is integrated into a motion planning stack as the local navigation layer to move the robot between waypoints towards a global goal. The fully autonomous navigation is performed without any prior knowledge while a map is recorded as the robot moves through the environment. Experiments show that the proposed method has an advantage over similar exploration methods, without reliance on a map or prior information in complex static as well as dynamic environments.


Hazy Re ID An Interference Suppression Model For Domain Adaptation Person Re identification Under Inclement Weather Condition. In a conventional domain adaptation person Re identification (Re ID) task, both the training and test images in target domain are collected under the sunny weather. However, in reality, the pedestrians to be retrieved may be obtained under severe weather conditions such as hazy, dusty and snowing, etc. This paper proposes a novel Interference Suppression Model (ISM) to deal with the interference caused by the hazy weather in domain adaptation person Re ID. A teacherstudent model is used in the ISM to distill the interference information at the feature level by reducing the discrepancy between the clear and the hazy intrinsic similarity matrix. Furthermore, in the distribution level, the extra discriminator is introduced to assist the student model make the interference feature distribution more clear. The experimental results show that the proposed method achieves the superior performance on two synthetic datasets than the stateof the art methods. The related code will be released online https github.com pangjian123 ISM ReID.


Two Stochastic Control Problems In Capital Structure and Portfolio Choice. This thesis mainly focuses on two problems in capital structure and individual's life cycle portfolio choice. In the first problem, we derive a stochastic control model to optimize banks' dividend and recapitalization policies and calibrate that to a sample of U.S. banks in the situation where we model banks' true accounting asset values as partially observed variables due to the opaqueness in banks' assets. By the calibrated model, the noise in reported accounting asset values hides about one third of the true asset return volatility and raises the banks' market equity value by 7.8 because the noise hides the banks' solvency risk from banking regulators. Particularly, those banks with a high level of loan loss provisions, nonperforming assets, and real estate loans, and with a low volatility of reported total assets have noisy accounting asset values. Because of the substantial shock on the true asset values, the banks' assets were more opaque during the recent financial crisis. In the second problem, we present an optimal portfolio selection model with voluntary retirement option in an economic situation, where an investor is facing borrowing and short sale constraints, as well as the cointegration between the stock and labor markets. Our model reinterprets the non participation puzzle in stock investment and early retirement in market booms. Investor's willingness to retire earlier becomes stronger as risk aversion increases or as wages decline in the long term. Consistent with the empirical evidence, we find that retirement flexibility makes the optimal portfolio invest less in the stock market. We also find that our model generated portfolio share rises in wealth.


Regularity of the coefficients of multilinear forms on sequence spaces. The investigation of regularity summability properties of the coefficients of bilinear forms in sequence spaces was initiated by Littlewood in 1930 . Nowadays, this topic has important connections with other fields of Pure and Applied Mathematics as Complex Analysis, Quantum Information Theory, Theoretical Computer Science and Combinatorial Games. In this paper we explore a regularity technique to obtain optimal parameters for several results in this framework, extending generalizing theorems of Osikiewicz and Tonge ( 2001 ), Albuquerque textit et al. ( 2016 ), Aron textit et al. ( 2017 ), Albuquerque and Rezende ( 2018 ), Paulino ( 2020 ), among others.


TATL Task Agnostic Transfer Learning for Skin Attributes Detection. Existing skin attributes detection methods usually initialize with a pre trained Imagenet network and then fine tune on a medical target task. However, we argue that such approaches are suboptimal because medical datasets are largely different from ImageNet and often contain limited training samples. In this work, we propose emph Task Agnostic Transfer Learning (TATL) , a novel framework motivated by dermatologists' behaviors in the skincare context. TATL learns an attribute agnostic segmenter that detects lesion skin regions and then transfers this knowledge to a set of attribute specific classifiers to detect each particular attribute. Since TATL's attribute agnostic segmenter only detects skin attribute regions, it enjoys ample data from all attributes, allows transferring knowledge among features, and compensates for the lack of training data from rare attributes. We conduct extensive experiments to evaluate the proposed TATL transfer learning mechanism with various neural network architectures on two popular skin attributes detection benchmarks. The empirical results show that TATL not only works well with multiple architectures but also can achieve state of the art performances while enjoying minimal model and computational complexities. We also provide theoretical insights and explanations for why our transfer learning framework performs well in practice.


Generalized Hukuhara Subgradient and its Application in Optimization Problem with Interval valued Functions. In this article, the concepts of gH subgradients and gH subdifferentials of interval valued functions are illustrated. Several important characteristics of the gH subdifferential of a convex interval valued function, e.g., closeness, boundedness, chain rule, etc. are studied. Alongside, we prove that gH subdifferential of a gH differentiable convex interval valued function only contains gH gradient of that interval valued function. It is observed that the gH directional derivative of a convex interval valued function in each direction is maximum of all the products of gH subgradients and the direction. Importantly, we show that a convex interval valued function is gH Lipschitz continuous if it has gH subgradients at each point in its domain. Furthermore, the relations between efficient solutions of an optimization problem with interval valued function and its gH subgradients are derived.


Let's Ask Students About Their Programs, Automatically. Students sometimes produce code that works but that its author does not comprehend. For example, a student may apply a poorly understood code template, stumble upon a working solution through trial and error, or plagiarize. Similarly, passing an automated functional assessment does not guarantee that the student understands their code. One way to tackle these issues is to probe students' comprehension by asking them questions about their own programs. We propose an approach to automatically generate questions about student written program code. We moreover propose a use case for such questions in the context of automatic assessment systems after a student's program passes unit tests, the system poses questions to the student about the code. We suggest that these questions can enhance assessment systems, deepen student learning by acting as self explanation prompts, and provide a window into students' program comprehension. This discussion paper sets an agenda for future technical development and empirical research on the topic.


Unsupervised Self Training for Sentiment Analysis of Code Switched Data. Sentiment analysis is an important task in understanding social media content like customer reviews, Twitter and Facebook feeds etc. In multilingual communities around the world, a large amount of social media text is characterized by the presence of Code Switching. Thus, it has become important to build models that can handle code switched data. However, annotated code switched data is scarce and there is a need for unsupervised models and algorithms. We propose a general framework called Unsupervised Self Training and show its applications for the specific use case of sentiment analysis of code switched data. We use the power of pre trained BERT models for initialization and fine tune them in an unsupervised manner, only using pseudo labels produced by zero shot transfer. We test our algorithm on multiple code switched languages and provide a detailed analysis of the learning dynamics of the algorithm with the aim of answering the question Does our unsupervised model understand the Code Switched languages or does it just learn its representations?'. Our unsupervised models compete well with their supervised counterparts, with their performance reaching within 1 7 (weighted F1 scores) when compared to supervised models trained for a two class problem.


The Neglected Sibling Isotropic Gaussian Posterior for VAE. Deep generative models have been widely used in several areas of NLP, and various techniques have been proposed to augment them or address their training challenges. In this paper, we propose a simple modification to Variational Autoencoders (VAEs) by using an Isotropic Gaussian Posterior (IGP) that allows for better utilisation of their latent representation space. This model avoids the sub optimal behavior of VAEs related to inactive dimensions in the representation space. We provide both theoretical analysis, and empirical evidence on various datasets and tasks that show IGP leads to consistent improvement on several quantitative and qualitative grounds, from downstream task performance and sample efficiency to robustness. Additionally, we give insights about the representational properties encouraged by IGP and also show that its gain generalises to image domain as well.


Non Stationary KPZ equation from ASEP with slow bonds. We make progress on the weak universality conjecture for the KPZ equation by proving the height functions associated to a class of non integrable and non stationary generalizations of ASEP converge to the solution of the appropriate KPZ stochastic PDE. The models considered herein are variations on ASEP with a mesoscopic family of slow bonds, thus our results partially extend those of Franco Goncalves Simon '16 to the non stationary regime and add to the almost empty set of non integrable and non stationary interacting particle systems for which weak KPZ universality has been established. Technically, in this current paper we develop further the dynamical strategy from Y '20 and Y '20b through spatial localization and combination with the two blocks scheme of Guo Papanicolaou Varadhan '88 and Dembo Tsai '16 with hopes towards weak KPZ universality in more generality.


First and second moments of the size distribution of bond percolation clusters on regular graphs. Motivated by network resilience and insurance premiums in the context of cyber security, we derive universal upper bounds for the first and second moments of the size of bond percolation clusters on finite regular graphs. Thinking of the clusters as dynamical objects coupled with branching processes gives a first set of bounds that are accurate when the probability of an edge being open is small. Estimating the number of isolated vertices, we also obtain a second set of bounds that are accurate when the probability of an edge being closed is small. As an illustration, we apply our results to the first three Platonic solids.


Solving the membership problem for certain subgroups of SL 2( mathbb Z ) . For positive integers u and v , let L u begin bmatrix 1 0 u 1 end bmatrix and R v begin bmatrix 1 v 0 1 end bmatrix . Let G u,v be the group generated by L u and R v . In a previous paper, the authors determined a characterization of matrices M begin bmatrix a b c d end bmatrix in G u,v when u,v geq 3 in terms of the short continued fraction representation of b d . We extend this result to the case where u,v geq 2 with uv neq 4 .


On the uniform stability of recovering sine type functions with asymptotically separated zeros. We obtain a uniform stability of recovering entire functions of a special form from their zeros. To this form, one can reduce the characteristic determinants of strongly regular differential operators and pencils of the first and the second orders, including differential systems with asymptotically separated eigenvalues whose characteristic numbers lie on a line containing the origin, and their non local perturbations. We establish that the dependence of such functions on the sequences of their zeros possesses the Lipschitz property with respect to natural metrics on each ball of a finite radius. Results of this type can be used for studying the uniform stability of inverse spectral problems. In addition, general theorems on the asymptotics of zeros of functions of this class and on their equivalent representation via an infinite product are obtained, which give the corresponding results for many specific operators.


Black Box Diagnosis and Calibration on GAN Intra Mode Collapse A Pilot Study. Generative adversarial networks (GANs) nowadays are capable of producing images of incredible realism. One concern raised is whether the state of the art GAN's learned distribution still suffers from mode collapse, and what to do if so. Existing diversity tests of samples from GANs are usually conducted qualitatively on a small scale, and or depends on the access to original training data as well as the trained model parameters. This paper explores to diagnose GAN intra mode collapse and calibrate that, in a novel black box setting no access to training data, nor the trained model parameters, is assumed. The new setting is practically demanded, yet rarely explored and significantly more challenging. As a first stab, we devise a set of statistical tools based on sampling, that can visualize, quantify, and rectify intra mode collapse. We demonstrate the effectiveness of our proposed diagnosis and calibration techniques, via extensive simulations and experiments, on unconditional GAN image generation (e.g., face and vehicle). Our study reveals that the intra mode collapse is still a prevailing problem in state of the art GANs and the mode collapse is diagnosable and calibratable in black box settings. Our codes are available at https github.com VITA Group BlackBoxGANCollapse.


Non intrusive Nonlinear Model Reduction via Machine Learning Approximations to Low dimensional Operators. Although projection based reduced order models (ROMs) for parameterized nonlinear dynamical systems have demonstrated exciting results across a range of applications, their broad adoption has been limited by their intrusivity implementing such a reduced order model typically requires significant modifications to the underlying simulation code. To address this, we propose a method that enables traditionally intrusive reduced order models to be accurately approximated in a non intrusive manner. Specifically, the approach approximates the low dimensional operators associated with projection based reduced order models (ROMs) using modern machine learning regression techniques. The only requirement of the simulation code is the ability to export the velocity given the state and parameters as this functionality is used to train the approximated low dimensional operators. In addition to enabling nonintrusivity, we demonstrate that the approach also leads to very low computational complexity, achieving up to 1000 times reduction in run time. We demonstrate the effectiveness of the proposed technique on two types of PDEs.


Early exit deep neural networks for distorted images providing an efficient edge offloading. Edge offloading for deep neural networks (DNNs) can be adaptive to the input's complexity by using early exit DNNs. These DNNs have side branches throughout their architecture, allowing the inference to end earlier in the edge. The branches estimate the accuracy for a given input. If this estimated accuracy reaches a threshold, the inference ends on the edge. Otherwise, the edge offloads the inference to the cloud to process the remaining DNN layers. However, DNNs for image classification deals with distorted images, which negatively impact the branches' estimated accuracy. Consequently, the edge offloads more inferences to the cloud. This work introduces expert side branches trained on a particular distortion type to improve robustness against image distortion. The edge detects the distortion type and selects appropriate expert branches to perform the inference. This approach increases the estimated accuracy on the edge, improving the offloading decisions. We validate our proposal in a realistic scenario, in which the edge offloads DNN inference to Amazon EC2 instances.


UMAD Universal Model Adaptation under Domain and Category Shift. Learning to reject unknown samples (not present in the source classes) in the target domain is fairly important for unsupervised domain adaptation (UDA). There exist two typical UDA scenarios, i.e., open set, and open partial set, and the latter assumes that not all source classes appear in the target domain. However, most prior methods are designed for one UDA scenario and always perform badly on the other UDA scenario. Moreover, they also require the labeled source data during adaptation, limiting their usability in data privacy sensitive applications. To address these issues, this paper proposes a Universal Model ADaptation (UMAD) framework which handles both UDA scenarios without access to the source data nor prior knowledge about the category shift between domains. Specifically, we aim to learn a source model with an elegantly designed two head classifier and provide it to the target domain. During adaptation, we develop an informative consistency score to help distinguish unknown samples from known samples. To achieve bilateral adaptation in the target domain, we further maximize localized mutual information to align known samples with the source classifier and employ an entropic loss to push unknown samples far away from the source classification boundary, respectively. Experiments on open set and open partial set UDA scenarios demonstrate that UMAD, as a unified approach without access to source data, exhibits comparable, if not superior, performance to state of the art data dependent methods.


Breaking the n k Barrier for Minimum k cut on Simple Graphs. In the minimum k cut problem, we want to find the minimum number of edges whose deletion breaks the input graph into at least k connected components. The classic algorithm of Karger and Stein runs in tilde O(n 2k 2 ) time, and recent, exciting developments have improved the running time to O(n k) . For general, weighted graphs, this is tight assuming popular hardness conjectures. In this work, we show that perhaps surprisingly, O(n k) is not the right answer for simple, unweighted graphs. We design an algorithm that runs in time O(n (1 epsilon)k ) where epsilon 0 is an absolute constant, breaking the natural n k barrier. This establishes a separation of the two problems in the unweighted and weighted cases.


Volume constraint local energy minimizing sets in a ball. In this paper, we prove a Poincar 'e inequality for any volume constraint local energy minimizing sets, provided its singular set is of Hausdorff dimension at most n 3 . With this inequality, we prove that the only volume constraint local energy minimizing sets in the Euclidean unit ball, whose singular set is closed and of Hausdorff dimension at most n 3 , are totally geodesic balls or spherical caps intersecting the unit sphere with constant contact angle for stable sets in a wedge shaped domain or in a half space, provided the same condition of the singular set, must be spherical. In particular, they are smooth.


A Large Scale Study of Machine Translation in the Turkic Languages. Recent advances in neural machine translation (NMT) have pushed the quality of machine translation systems to the point where they are becoming widely adopted to build competitive systems. However, there is still a large number of languages that are yet to reap the benefits of NMT. In this paper, we provide the first large scale case study of the practical application of MT in the Turkic language family in order to realize the gains of NMT for Turkic languages under high resource to extremely low resource scenarios. In addition to presenting an extensive analysis that identifies the bottlenecks towards building competitive systems to ameliorate data scarcity, our study has several key contributions, including, i) a large parallel corpus covering 22 Turkic languages consisting of common public datasets in combination with new datasets of approximately 2 million parallel sentences, ii) bilingual baselines for 26 language pairs, iii) novel high quality test sets in three different translation domains and iv) human evaluation scores. All models, scripts, and data will be released to the public.


The scattering matrix with respect to an Hermitian matrix of a graph. Recently, Gnutzmann and Smilansky presented a formula for the bond scattering matrix of a graph with respect to a Hermitian matrix. We present another proof for this Gnutzmann and Smilansky's formula by a technique used in the zeta function of a graph. Furthermore, we generalize Gnutzmann and Smilansky's formula to a regular covering of a graph. Finally, we define an L fuction of a graph, and present a determinant expression. As a corollary, we express the generalization of Gnutzmann and Smilansky's formula to a regular covering of a graph by using its L functions.


Schur functions in noncommuting variables. In 2004 Rosas and Sagan asked whether there was a way to define a basis in the algebra of symmetric functions in noncommuting variables, NCSym, having properties analogous to the classical Schur functions. We answer this question by defining Schur functions in noncommuting variables using a noncommutative analogue of the Jacobi Trudi determinant. Our Schur functions in NCSym map to classical Schur functions under commutation, and a subset of them indexed by set partitions forms a basis for NCSym. Among other properties, Schur functions in NCSym also satisfy a noncommutative analogue of the product rule for classical Schur functions in terms of skew Schur functions. We also show how Schur functions in NCSym are related to Specht modules, and naturally refine the Rosas Sagan Schur functions. Moreover, by generalizing Rosas Sagan Schur functions to skew Schur functions in the natural way, we prove noncommutative analogues of the Littlewood Richardson rule and coproduct rule for them. Finally, we relate our functions to noncommutative symmetric functions by proving a subset of our functions are natural extensions of noncommutative ribbon Schur functions, and immaculate functions indexed by integer partitions.


Revisiting Prioritized Experience Replay A Value Perspective. Experience replay enables off policy reinforcement learning (RL) agents to utilize past experiences to maximize the cumulative reward. Prioritized experience replay that weighs experiences by the magnitude of their temporal difference error ( text TD ) significantly improves the learning efficiency. But how text TD is related to the importance of experience is not well understood. We address this problem from an economic perspective, by linking text TD to value of experience, which is defined as the value added to the cumulative reward by accessing the experience. We theoretically show the value metrics of experience are upper bounded by text TD for Q learning. Furthermore, we successfully extend our theoretical framework to maximum entropy RL by deriving the lower and upper bounds of these value metrics for soft Q learning, which turn out to be the product of text TD and "on policyness" of the experiences. Our framework links two important quantities in RL text TD and value of experience. We empirically show that the bounds hold in practice, and experience replay using the upper bound as priority improves maximum entropy RL in Atari games.


On the representation of non holonomic univariate power series. Holonomic functions play an essential role in Computer Algebra since they allow the application of many symbolic algorithms. Among all algorithmic attempts to find formulas for power series, the holonomic property remains the most important requirement to be satisfied by the function under consideration. The targeted functions mainly summarize that of meromorphic functions. However, expressions like tan(z) , z ( exp(z) 1) , sec(z) , etc., particularly, reciprocals, quotients and compositions of holonomic functions, are generally not holonomic. Therefore their power series are inaccessible by the holonomic framework. From the mathematical dictionaries, one can observe that most of the known closed form formulas of non holonomic power series involve another sequence whose evaluation depends on some finite summations. In the case of tan(z) and sec(z) the corresponding sequences are the Bernoulli and Euler numbers, respectively. Thus providing a symbolic approach that yields complete representations when linear summations for power series coefficients of non holonomic functions appear, might be seen as a step forward towards the representation of non holonomic power series. By adapting the method of ansatz with undetermined coefficients, we build an algorithm that computes least order quadratic differential equations with polynomial coefficients for a large class of non holonomic functions. A differential equation resulting from this procedure is converted into a recurrence equation by applying the Cauchy product formula and rewriting powers into polynomials and derivatives into shifts. Finally, using enough initial values we are able to give normal form representations to characterize several non holonomic power series and prove non trivial identities. We discuss this algorithm and its implementation for Maple 2022.


Convergence of the height process of supercritical Galton Watson forests with an application to the configuration model in the critical window. We show joint convergence of the Lukasiewicz path and height process for slightly supercritical Galton Watson forests. This shows that the height processes for supercritical continuous state branching processes as constructed by Lambert (2002) are the limit under rescaling of their discrete counterparts. Unlike for (sub )critical Galton Watson forests, the height process does not encode the entire metric structure of a supercritical Galton Watson forest. We demonstrate that this result is nonetheless useful, by applying it to the configuration model with an i.i.d. power law degree sequence in the critical window, of which we obtain the metric space scaling limit in the product Gromov Hausdorff Prokhorov topology, which is of independent interest.


Monitoring Object Detection Abnormalities via Data Label and Post Algorithm Abstractions. While object detection modules are essential functionalities for any autonomous vehicle, the performance of such modules that are implemented using deep neural networks can be, in many cases, unreliable. In this paper, we develop abstraction based monitoring as a logical framework for filtering potentially erroneous detection results. Concretely, we consider two types of abstraction, namely data label abstraction and post algorithm abstraction. Operated on the training dataset, the construction of data label abstraction iterates each input, aggregates region wise information over its associated labels, and stores the vector under a finite history length. Post algorithm abstraction builds an abstract transformer for the tracking algorithm. Elements being associated together by the abstract transformer can be checked against consistency over their original values. We have implemented the overall framework to a research prototype and validated it using publicly available object detection datasets.


Parallel decomposition of persistence modules through interval bases. We introduce an algorithm to decompose any finite type persistence module with coefficients in a field into what we call an em interval basis . This construction yields both the standard persistence pairs of Topological Data Analysis (TDA), as well as a special set of generators inducing the interval decomposition of the Structure theorem. The computation of this basis can be distributed over the steps in the persistence module. This construction works for general persistence modules on a field mathbb F , not necessarily deriving from persistent homology. We subsequently provide a parallel algorithm to build a persistent homology module over mathbb R by leveraging the Hodge decomposition, thus providing new motivation to explore the interplay between TDA and the Hodge Laplacian.


Cameron's operator in terms of determinants, and hypergeometric numbers. By studying Cameron's operator in terms of determinants, two kinds of "integer" sequences of incomplete numbers were introduced. One was the sequence of restricted numbers, including s step Fibonacci sequences. Another was the sequence of associated numbers, including Lam 'e sequences of higher order. By the classical Trudi's formula and the inverse relation, more expressions were able to be obtained. These relations and identities can be extended to those of sequence of negative integers or rational numbers. As applications, we consider hypergeometric Bernoulli, Cauchy and Euler numbers with some modifications.


A compact and stable incidence plane rotating second harmonics detector. We describe a compact and stable setup for detecting the optical second harmonics, in which the incident plane rotates with respect to the sample. The setup is composed of rotating Fresnel rhomb optics and a femtosecond ytterbium doped fiber laser source operating at the repetition frequency of 10 MHz. The setup including the laser source occupies an area of 1 m2 and is stable so that the intensity fluctuation of the laser harmonics can be less than 0.2 for 4 h. We present the isotropic harmonic signal of a gold mirror of 0.5 pW and demonstrate the integrity and sensitivity of the setup. We also show the polarization dependent six fold pattern of the harmonics of a few layer WSe2, from which we infer the degree of local field effects. Finally, we describe the extendibility of the setup to investigate the samples in various conditions such as cryogenic, strained, ultrafast non equilibrium, and high magnetic fields.


Local X ray Transform on Asymptotically Hyperbolic Manifolds via Projective Compactification. We prove local injectivity near a boundary point for the geodesic X ray transform for an asymptotically hyperbolic metric even mod O( rho 5) in dimensions three and higher.


Exemplars can Reciprocate Principal Components. This paper presents a clustering algorithm that is an extension of the Category Trees algorithm. Category Trees is a clustering method that creates tree structures that branch on category type and not feature. The development in this paper is to consider a secondary order of clustering that is not the category to which the data row belongs, but the tree, representing a single classifier, that it is eventually clustered with. Each tree branches to store subsets of other categories, but the rows in those subsets may also be related. This paper is therefore concerned with looking at that second level of clustering between the other category subsets, to try to determine if there is any consistency over it. It is argued that Principal Components may be a related and reciprocal type of structure, and there is an even bigger question about the relation between exemplars and principal components, in general. The theory is demonstrated using the Portugal Forest Fires dataset as a case study. The Category Trees are then combined with other Self Organising algorithms from the author and it is suggested that they all belong to the same family type, which is an Entropy style of classifier.


Can crowdsourcing rescue the social marketplace of ideas?. Facebook and Twitter recently announced community based review platforms to address misinformation. We provide an overview of the potential affordances of such community based approaches to content moderation based on past research and preliminary analysis of Twitter's Birdwatch data. While our analysis generally supports a community based approach to content moderation, it also warns against potential pitfalls, particularly when the implementation of the new infrastructure focuses on crowd based "validation" rather than "collaboration." We call for multidisciplinary research utilizing methods from complex systems studies, behavioural sociology, and computational social science to advance the research on crowd based content moderation.


Learning from demonstrations with SACR2 Soft Actor Critic with Reward Relabeling. During recent years, deep reinforcement learning (DRL) has made successful incursions into complex decision making applications such as robotics, autonomous driving or video games. Off policy algorithms tend to be more sample efficient than their on policy counterparts, and can additionally benefit from any off policy data stored in the replay buffer. Expert demonstrations are a popular source for such data the agent is exposed to successful states and actions early on, which can accelerate the learning process and improve performance. In the past, multiple ideas have been proposed to make good use of the demonstrations in the buffer, such as pretraining on demonstrations only or minimizing additional cost functions. We carry on a study to evaluate several of these ideas in isolation, to see which of them have the most significant impact. We also present a new method for sparse reward tasks, based on a reward bonus given to demonstrations and successful episodes. First, we give a reward bonus to the transitions coming from demonstrations to encourage the agent to match the demonstrated behaviour. Then, upon collecting a successful episode, we relabel its transitions with the same bonus before adding them to the replay buffer, encouraging the agent to also match its previous successes. The base algorithm for our experiments is the popular Soft Actor Critic (SAC), a state of the art off policy algorithm for continuous action spaces. Our experiments focus on manipulation robotics, specifically on a 3D reaching task for a robotic arm in simulation. We show that our method SACR2 based on reward relabeling improves the performance on this task, even in the absence of demonstrations.


3D FFS Faster 3D object detection with Focused Frustum Search in sensor fusion based networks. In this work we propose 3D FFS, a novel approach to make sensor fusion based 3D object detection networks significantly faster using a class of computationally inexpensive heuristics. Existing sensor fusion based networks generate 3D region proposals by leveraging inferences from 2D object detectors. However, as images have no depth information, these networks rely on extracting semantic features of points from the entire scene to locate the object. By leveraging aggregated intrinsic properties (e.g. point density) of point cloud data, 3D FFS can substantially constrain the 3D search space and thereby significantly reduce training time, inference time and memory consumption without sacrificing accuracy. To demonstrate the efficacy of 3D FFS, we have integrated it with Frustum ConvNet (F ConvNet), a prominent sensor fusion based 3D object detection model. We assess the performance of 3D FFS on the KITTI dataset. Compared to F ConvNet, we achieve improvements in training and inference times by up to 62.80 and 58.96 , respectively, while reducing the memory usage by up to 58.53 . Additionally, we achieve 0.36 , 0.59 and 2.19 improvements in accuracy for the Car, Pedestrian and Cyclist classes, respectively. 3D FFS shows a lot of promise in domains with limited computing power, such as autonomous vehicles, drones and robotics where LiDAR Camera based sensor fusion perception systems are widely used.


Restricted tangent bundles for general free rational curves. Suppose that X is a smooth projective variety and that C is a general member of a family of free rational curves on X . We prove several statements showing that the Harder Narasimhan filtration of T X C is approximately the same as the restriction of the Harder Narasimhan filtration of T X with respect to the class of C . When X is a Fano variety, we prove that the set of all restricted tangent bundles for general free rational curves is controlled by a finite set of data. We then apply our work to analyze Peyre's "freeness" formulation of Manin's Conjecture in the setting of rational curves.


FPGA Based Near Memory Acceleration of Modern Data Intensive Applications. Modern data intensive applications demand high computation capabilities with strict power constraints. Unfortunately, such applications suffer from a significant waste of both execution cycles and energy in current computing systems due to the costly data movement between the computation units and the memory units. Genome analysis and weather prediction are two examples of such applications. Recent FPGAs couple a reconfigurable fabric with high bandwidth memory (HBM) to enable more efficient data movement and improve overall performance and energy efficiency. This trend is an example of a paradigm shift to near memory computing. We leverage such an FPGA with high bandwidth memory (HBM) for improving the pre alignment filtering step of genome analysis and representative kernels from a weather prediction model. Our evaluation demonstrates large speedups and energy savings over a high end IBM POWER9 system and a conventional FPGA board with DDR4 memory. We conclude that FPGA based near memory computing has the potential to alleviate the data movement bottleneck for modern data intensive applications.


Domination of semigroups generated by regular forms. We give a representation for regular forms associated with dominated C 0 semigroups which, in turn, characterises domination of C 0 semigroups associated with regular forms. In addition, we prove a relationship between the positivity of (dominated) C 0 semigroups and the locality of the associated forms.


Contactless Series Resistance Imaging of Perovskite Solar Cells via Inhomogeneous Illumination. A contactless effective series resistance imaging method for large area perovskite solar cells that is based on photoluminescence imaging with non uniform illumination is introduced and demonstrated experimentally. The proposed technique is applicable to partially and fully processed perovskite solar cells if laterally conductive layers are present. The capability of the proposed contactless method to detect features with high effective series resistance is validated by comparison with various contacted mode luminescence imaging techniques. The method can reliably provide information regarding the severeness of the detected series resistance through photo excitation pattern manipulation. Application of the method to sub cells in monolithic tandem devices, without the need for electrical contacting the terminals, appears feasible.


Minor exclusion in quasi transitive graphs. In this note, we show that locally finite quasi transitive graphs are quasi isometric to trees if and only if every other locally finite quasi transitive graph quasi isometric to them is minor excluded. This generalizes results by Ostrovskii and Rosenthal and by Khukhro on minor exclusion for groups.


Mediators in Determining what Processing BERT Performs First. Probing neural models for the ability to perform downstream tasks using their activation patterns is often used to localize what parts of the network specialize in performing what tasks. However, little work addressed potential mediating factors in such comparisons. As a test case mediating factor, we consider the prediction's context length, namely the length of the span whose processing is minimally required to perform the prediction. We show that not controlling for context length may lead to contradictory conclusions as to the localization patterns of the network, depending on the distribution of the probing dataset. Indeed, when probing BERT with seven tasks, we find that it is possible to get 196 different rankings between them when manipulating the distribution of context lengths in the probing dataset. We conclude by presenting best practices for conducting such comparisons in the future.


Suppression of plasma instabilities in space and ground nuclear power devices. The conditions for the excitation of current and voltage oscillations in the plasma of a three electrode current and voltage stabilizer are experimentally investigated. It was found that in the regimes under consideration, the plasma has negative conductivity, which causes oscillations. A highly efficient method for suppressing plasma instabilities is proposed, based on controlling the sign of differential plasma conductivity by adjusting the concentration of slow electrons using an external electrode. The proposed method makes it possible to achieve a high level of stability of the energy characteristics of the stabilizer at a discharge current density of up to 5 A cm2 and a power of 500 W cm2.


Promoting global stability in data driven models of quadratic nonlinear dynamics. Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the global stability (i.e., long time boundedness) of these models. The seminal work of Schlegel and Noack (JFM, 2015) provided a theorem outlining necessary and sufficient conditions to ensure global stability in systems with energy preserving, quadratic nonlinearities, with the goal of evaluating the stability of projection based models. In this work, we incorporate this theorem into modern data driven models obtained via machine learning. First, we propose that this theorem should be a standard diagnostic for the stability of projection based and data driven models, examining the conditions under which it holds. Second, we illustrate how to modify the objective function in machine learning algorithms to promote globally stable models, with implications for the modeling of fluid and plasma flows. Specifically, we introduce a modified "trapping SINDy" algorithm based on the sparse identification of nonlinear dynamics (SINDy) method. This method enables the identification of models that, by construction, only produce bounded trajectories. The effectiveness and accuracy of this approach are demonstrated on a broad set of examples of varying model complexity and physical origin, including the vortex shedding in the wake of a circular cylinder.


B Maude A formal executable environment for Abstract Machine Notation Descriptions. We propose B Maude, a prototype executable environment for the Abstract Machine Notation implemented in the Maude language. B Maude is formally defined and results from the implementation of the semantics of AMN as denotations in the pi Framework, a realization of Mosses' Component based Semantics and Plotkin's Interpreting Automata. B Maude endows the B method with execution by rewriting, symbolic search with narrowing and Linear Temporal Logic model checking of AMN descriptions.


An Improved Random Shift Algorithm for Spanners and Low Diameter Decompositions. Spanners have been shown to be a powerful tool in graph algorithms. Many spanner constructions use a certain type of clustering at their core, where each cluster has small diameter and there are relatively few spanner edges between clusters. In this paper, we provide a clustering algorithm that, given k geq 2 , can be used to compute a spanner of stretch 2k 1 and expected size O(n 1 1 k ) in k rounds in the CONGEST model. This improves upon the state of the art (by Elkin, and Neiman TALG'19 ) by making the bounds on both running time and stretch independent of the random choices of the algorithm, whereas they only hold with high probability in previous results. Spanners are used in certain synchronizers, thus our improvement directly carries over to such synchronizers. Furthermore, for keeping the emph total number of inter cluster edges small in low diameter decompositions, our clustering algorithm provides the following guarantees. Given beta in (0,1 , we compute a low diameter decomposition with diameter bound O left( frac log n beta right) such that each edge e in E is an inter cluster edge with probability at most beta cdot w(e) in O left( frac log n beta right) rounds in the CONGEST model. Again, this improves upon the state of the art (by Miller, Peng, and Xu SPAA'13 ) by making the bounds on both running time and diameter independent of the random choices of the algorithm, whereas they only hold with high probability in previous results.


CBNetV2 A Composite Backbone Network Architecture for Object Detection. Modern top performing object detectors depend heavily on backbone networks, whose advances bring consistent performance gains through exploring more effective network structures. In this paper, we propose a novel and flexible backbone framework, namely CBNetV2, to construct high performance detectors using existing open sourced pre trained backbones under the pre training fine tuning paradigm. In particular, CBNetV2 architecture groups multiple identical backbones, which are connected through composite connections. Specifically, it integrates the high and low level features of multiple backbone networks and gradually expands the receptive field to more efficiently perform object detection. We also propose a better training strategy with assistant supervision for CBNet based detectors. Without additional pre training of the composite backbone, CBNetV2 can be adapted to various backbones (CNN based vs. Transformer based) and head designs of most mainstream detectors (one stage vs. two stage, anchor based vs. anchor free based). Experiments provide strong evidence that, compared with simply increasing the depth and width of the network, CBNetV2 introduces a more efficient, effective, and resource friendly way to build high performance backbone networks. Particularly, our Dual Swin L achieves 59.4 box AP and 51.6 mask AP on COCO test dev under the single model and single scale testing protocol, which is significantly better than the state of the art result (57.7 box AP and 50.2 mask AP) achieved by Swin L, while the training schedule is reduced by 6 times . With multi scale testing, we push the current best single model result to a new record of 60.1 box AP and 52.3 mask AP without using extra training data. Code is available at https github.com VDIGPKU CBNetV2.


Idiomatic Expression Paraphrasing without Strong Supervision. Idiomatic expressions (IEs) play an essential role in natural language. In this paper, we study the task of idiomatic sentence paraphrasing (ISP), which aims to paraphrase a sentence with an IE by replacing the IE with its literal paraphrase. The lack of large scale corpora with idiomatic literal parallel sentences is a primary challenge for this task, for which we consider two separate solutions. First, we propose an unsupervised approach to ISP, which leverages an IE's contextual information and definition and does not require a parallel sentence training set. Second, we propose a weakly supervised approach using back translation to jointly perform paraphrasing and generation of sentences with IEs to enlarge the small scale parallel sentence training dataset. Other significant derivatives of the study include a model that replaces a literal phrase in a sentence with an IE to generate an idiomatic expression and a large scale parallel dataset with idiomatic literal sentence pairs. The effectiveness of the proposed solutions compared to competitive baselines is seen in the relative gains of over 5.16 points in BLEU, over 8.75 points in METEOR, and over 19.57 points in SARI when the generated sentences are empirically validated on a parallel dataset using automatic and manual evaluations. We demonstrate the practical utility of ISP as a preprocessing step in En De machine translation.


Sub bit Neural Networks Learning to Compress and Accelerate Binary Neural Networks. In the low bit quantization field, training Binary Neural Networks (BNNs) is the extreme solution to ease the deployment of deep models on resource constrained devices, having the lowest storage cost and significantly cheaper bit wise operations compared to 32 bit floating point counterparts. In this paper, we introduce Sub bit Neural Networks (SNNs), a new type of binary quantization design tailored to compress and accelerate BNNs. SNNs are inspired by an empirical observation, showing that binary kernels learnt at convolutional layers of a BNN model are likely to be distributed over kernel subsets. As a result, unlike existing methods that binarize weights one by one, SNNs are trained with a kernel aware optimization framework, which exploits binary quantization in the fine grained convolutional kernel space. Specifically, our method includes a random sampling step generating layer specific subsets of the kernel space, and a refinement step learning to adjust these subsets of binary kernels via optimization. Experiments on visual recognition benchmarks and the hardware deployment on FPGA validate the great potentials of SNNs. For instance, on ImageNet, SNNs of ResNet 18 ResNet 34 with 0.56 bit weights achieve 3.13 3.33 times runtime speed up and 1.8 times compression over conventional BNNs with moderate drops in recognition accuracy. Promising results are also obtained when applying SNNs to binarize both weights and activations. Our code is available at https github.com yikaiw SNN.


The half space model of pseudo hyperbolic space. In this note we develop a half space model for the pseudo hyperbolic space mathbb H p,q , for any p,q with p geq 1 . This half space model embeds isometrically onto the complement of a degenerate totally geodesic hyperplane in mathbb H p,q . We describe the geodesics, the totally geodesic submanifolds, the horospheres, the isometry group in the half space model, and we explain how to interpret the boundary at infinity in this setting.


Data driven Distributionally Robust MPC An indirect feedback approach. This paper presents a distributionally robust stochastic model predictive control (SMPC) approach for linear discrete time systems subject to unbounded and correlated additive disturbances. We consider hard input constraints and state chance constraints, which are approximated as distributionally robust (DR) Conditional Value at Risk (CVaR) constraints over a Wasserstein ambiguity set. The computational complexity is reduced by resorting to a tube based MPC scheme with indirect feedback, such that the error scenarios can be sampled offline. Recursive feasibility is guaranteed by softening the CVaR constraint. The approach is demonstrated on a four room temperature control example.


SPATL Salient Parameter Aggregation and Transfer Learning for Heterogeneous Clients in Federated Learning. Efficient federated learning is one of the key challenges for training and deploying AI models on edge devices. However, maintaining data privacy in federated learning raises several challenges including data heterogeneity, expensive communication cost, and limited resources. In this paper, we address the above issues by (a) introducing a salient parameter selection agent based on deep reinforcement learning on local clients, and aggregating the selected salient parameters on the central server, and (b) splitting a normal deep learning model (e.g., CNNs) as a shared encoder and a local predictor, and training the shared encoder through federated learning while transferring its knowledge to Non IID clients by the local customized predictor. The proposed method (a) significantly reduces the communication overhead of federated learning and accelerates the model inference, while method (b) addresses the data heterogeneity issue in federated learning. Additionally, we leverage the gradient control mechanism to correct the gradient heterogeneity among clients. This makes the training process more stable and converge faster. The experiments show our approach yields a stable training process and achieves notable results compared with the state of the art methods. Our approach significantly reduces the communication cost by up to 108 GB when training VGG 11, and needed 7.6 times less communication overhead when training ResNet 20, while accelerating the local inference by reducing up to 39.7 FLOPs on VGG 11.


Phrase BERT Improved Phrase Embeddings from BERT with an Application to Corpus Exploration. Phrase representations derived from BERT often do not exhibit complex phrasal compositionality, as the model relies instead on lexical similarity to determine semantic relatedness. In this paper, we propose a contrastive fine tuning objective that enables BERT to produce more powerful phrase embeddings. Our approach (Phrase BERT) relies on a dataset of diverse phrasal paraphrases, which is automatically generated using a paraphrase generation model, as well as a large scale dataset of phrases in context mined from the Books3 corpus. Phrase BERT outperforms baselines across a variety of phrase level similarity tasks, while also demonstrating increased lexical diversity between nearest neighbors in the vector space. Finally, as a case study, we show that Phrase BERT embeddings can be easily integrated with a simple autoencoder to build a phrase based neural topic model that interprets topics as mixtures of words and phrases by performing a nearest neighbor search in the embedding space. Crowdsourced evaluations demonstrate that this phrase based topic model produces more coherent and meaningful topics than baseline word and phrase level topic models, further validating the utility of Phrase BERT.


The persistence exponents of Gaussian random fields connected by the Lamperti transform. The (fractional) Brownian sheet is a simplest example of a Gaussian random field X whose covariance is the tensor product of a finite number (d) of nonnegative correlation functions of self similar Gaussian processes. Let Y be the homogeneous Gaussian field obtained by applying to X the Lamperti transform, which involves the exponential change of time and the amplitude normalization to have unit variance. Under some assumptions, we prove the existence of the persistence exponents for both fields, X and Y, and find the relation between them. The exponent for X is the limit of ln1 P X(t) 1, t in 0,T d (lnT) d, T 1. In terms of Y it has the form lim ln1 P Y(t) 0,t in TG T d Q, T 1, where G is a suitable d simplex and T is a similarity coefficient G can be selected in form 0,c d if d 2 . The exponent Q exists for any continuous Gaussian homogeneous field Y with non negative covariance when G is bounded region with a regular boundary. The problem of the existence and connection of exponents for X and Y was raised by Li and Shao Ann. Probab. 32 1, 2004 and originally concerned the Brownian sheet.


Dynamic Slimmable Network. Current dynamic networks and dynamic pruning methods have shown their promising capability in reducing theoretical computation complexity. However, dynamic sparse patterns on convolutional filters fail to achieve actual acceleration in real world implementation, due to the extra burden of indexing, weight copying, or zero masking. Here, we explore a dynamic network slimming regime, named Dynamic Slimmable Network (DS Net), which aims to achieve good hardware efficiency via dynamically adjusting filter numbers of networks at test time with respect to different inputs, while keeping filters stored statically and contiguously in hardware to prevent the extra burden. Our DS Net is empowered with the ability of dynamic inference by the proposed double headed dynamic gate that comprises an attention head and a slimming head to predictively adjust network width with negligible extra computation cost. To ensure generality of each candidate architecture and the fairness of gate, we propose a disentangled two stage training scheme inspired by one shot NAS. In the first stage, a novel training technique for weight sharing networks named In place Ensemble Bootstrapping is proposed to improve the supernet training efficacy. In the second stage, Sandwich Gate Sparsification is proposed to assist the gate training by identifying easy and hard samples in an online way. Extensive experiments demonstrate our DS Net consistently outperforms its static counterparts as well as state of the art static and dynamic model compression methods by a large margin (up to 5.9 ). Typically, DS Net achieves 2 4x computation reduction and 1.62x real world acceleration over ResNet 50 and MobileNet with minimal accuracy drops on ImageNet. Code release https github.com changlin31 DS Net .


Decentralized Mean Field Games. Multiagent reinforcement learning algorithms have not been widely adopted in large scale environments with many agents as they often scale poorly with the number of agents. Using mean field theory to aggregate agents has been proposed as a solution to this problem. However, almost all previous methods in this area make a strong assumption of a centralized system where all the agents in the environment learn the same policy and are effectively indistinguishable from each other. In this paper, we relax this assumption about indistinguishable agents and propose a new mean field system known as Decentralized Mean Field Games, where each agent can be quite different from others. All agents learn independent policies in a decentralized fashion, based on their local observations. We define a theoretical solution concept for this system and provide a fixed point guarantee for a Q learning based algorithm in this system. A practical consequence of our approach is that we can address a chicken and egg' problem in empirical mean field reinforcement learning algorithms. Further, we provide Q learning and actor critic algorithms that use the decentralized mean field learning approach and give stronger performances compared to common baselines in this area. In our setting, agents do not need to be clones of each other and learn in a fully decentralized fashion. Hence, for the first time, we show the application of mean field learning methods in fully competitive environments, large scale continuous action space environments, and other environments with heterogeneous agents. Importantly, we also apply the mean field method in a ride sharing problem using a real world dataset. We propose a decentralized solution to this problem, which is more practical than existing centralized training methods.


Context Decoupling Augmentation for Weakly Supervised Semantic Segmentation. Data augmentation is vital for deep learning neural networks. By providing massive training samples, it helps to improve the generalization ability of the model. Weakly supervised semantic segmentation (WSSS) is a challenging problem that has been deeply studied in recent years, conventional data augmentation approaches for WSSS usually employ geometrical transformations, random cropping and color jittering. However, merely increasing the same contextual semantic data does not bring much gain to the networks to distinguish the objects, e.g., the correct image level classification of "aeroplane" may be not only due to the recognition of the object itself, but also its co occurrence context like "sky", which will cause the model to focus less on the object features. To this end, we present a Context Decoupling Augmentation (CDA) method, to change the inherent context in which the objects appear and thus drive the network to remove the dependence between object instances and contextual information. To validate the effectiveness of the proposed method, extensive experiments on PASCAL VOC 2012 dataset with several alternative network architectures demonstrate that CDA can boost various popular WSSS methods to the new state of the art by a large margin.


Effects of mutations and immunogenicity on outcomes of anti cancer therapies for secondary lesions. Cancer development is driven by mutations and selective forces, including the action of the immune system and interspecific competition. When administered to patients, anti cancer therapies affect the development and dynamics of tumours, possibly with various degrees of resistance due to immunoediting and microenvironment. Tumours are able to express a variety of competing phenotypes with different attributes and thus respond differently to various anti cancer therapies. In this paper, a mathematical framework incorporating a system of delay differential equations for the immune system activation cycle and an agent based approach for tumour immune interaction is presented. The focus is on those metastatic, secondary solid lesions that are still undetected and non vascularised. By using available experimental data, we analyse the effects of combination therapies on these lesions and investigate the role of mutations on the rates of success of common treatments. Findings show that mutations, growth properties and immunoediting influence therapies' outcomes in nonlinear and complex ways, affecting cancer lesion morphologies, phenotypical compositions and overall proliferation patterns. Cascade effects on final outcomes for secondary lesions are also investigated, showing that actions on primary lesions could sometimes result in unexpected clearances of secondary tumours. This outcome is strongly dependent on the clonal composition of the primary and secondary masses and is shown to allow, in some cases, the control of the disease for years.


Remarks on Fixed Point Assertions in Digital Topology, 5. We discuss published assertions concerning fixed points in digital metric spaces that are incorrect or incorrectly proven, or reduce to triviality.


Over 20 year global magnetohydrodynamic simulation of Earth's magnetosphere. We present our approach to modeling over 20 years of the solar wind magnetosphere ionosphere system using version 5 of the Grand Unified Magnetosphere Ionosphere Coupling Simulation (GUMICS 5). As input we use 16 s magnetic field and 1 min plasma measurements by the Advanced Composition Explorer (ACE) satellite from 1998 to 2019. The modeled interval is divided into 28 h simulations, which include 4 h overlap. We use a maximum magnetospheric resolution of 0.5 Earth radii (R E ) up to about 15 R E from Earth and decreasing resolution further away. In the ionosphere we use a maximum resolution of approximately 100 km poleward of 58 magnetic latitude and decreasing resolution towards the equator. With respect to the previous version GUMICS 4, we have parallelized the magnetosphere of GUMICS 5 using the Message Passing Interface and have made several improvements which have e.g. decreased its numerical diffusion. In total we have performed nearly 8000 simulations which have produced over 10 000 000 ionospheric files and 2 000 000 magnetospheric files requiring over 100 TB ( 10 14 bytes) of disk space. We describe the challenges encountered when working with such a large number of simulations and large data set in a shared supercomputer environment. Automating most tasks of preparing, running and archiving simulations as well as post processing the results is essential. At this scale the available disk space becomes a larger bottleneck than the available processing capacity, since ideally the simulations are stored forever but only have to be executed once. We compare the simulation results to several empirical models, as well as geomagnetic indices derived from ground magnetic field measurements, and show that GUMICS 5 reproduces many solar cycle effects in the magnetosphere and ionosphere.


A study on Machine Learning Approaches for Player Performance and Match Results Prediction. Cricket is unarguably one of the most popular sports in the world. Predicting the outcome of a cricket match has become a fundamental problem as we are advancing in the field of machine learning. Multiple researchers have tried to predict the outcome of a cricket match or a tournament, or to predict the performance of players during a match, or to predict the players who should be selected as per their current performance, form, morale, etc. using machine learning and artificial intelligence techniques keeping in mind extensive detailing, features, and parameters. We discuss some of these techniques along with a brief comparison among these techniques.


Projections in Lipschitz free spaces induced by group actions. We show that given a compact group G acting continuously on a metric space M by bi Lipschitz bijections with uniformly bounded norms, the Lipschitz free space over the space of orbits M G (endowed with Hausdorff distance) is complemented in the Lipschitz free space over M . We also investigate the more general case when G is amenable, locally compact or SIN and its action has bounded orbits. Then we get that the space of Lipschitz functions Lip 0(M G) is complemented in Lip 0(M) . Moreover, if the Lipschitz free space over M , F(M) , is complemented in its bidual, several sufficient conditions on when F(M G) is complemented in F(M) are given. Some applications are discussed. The paper contains preliminaries on projections induced by actions of amenable groups on general Banach spaces.


Remarks on finite time blow up in a fully parabolic attraction repulsion chemotaxis system via reduction to the Keller Segel system. This paper deals with the fully parabolic attraction repulsion chemotaxis system begin align u t Delta u chi nabla cdot (u nabla v) xi nabla cdot(u nabla w), quad v t Delta v v u, quad w t Delta w w u, quad x in Omega, t 0 end align under homogeneous Neumann boundary conditions and initial conditions, where Omega is an open ball in mathbb R n ( n ge 3 ), chi, xi 0 are constants. When w 0 , finite time blow up in the corresponding Keller Segel system has already been obtained. However, finite time blow up in the above attraction repulsion chemotaxis system has not yet been established except for the case n 3 . This paper provides an answer to this open problem by using a transformation which leads to a system presenting structural advantages respect to the original.


Alternating cyclic extrapolation methods for optimization algorithms. This article introduces new acceleration methods for fixed point iterations. Extrapolations are computed using two or three mappings alternately and a new type of step length is proposed with good properties for nonlinear applications. The methods require no problem specific adaptation and are especially efficient in high dimensional contexts. Their computation uses few objective function evaluations, no matrix inversion and little extra memory. A convergence analysis is followed by eight applications including gradient descent acceleration for constrained and unconstrained optimization. Performances are on par with or better than competitive alternatives. The algorithm is available as the Julia package SpeedMapping.jl.


Non invasive Current Density Imaging of Lithium Ion Batteries. The rapid pace of replacing fossil fuel propelled transport by electric vehicles is critically dependent on high performing, high energy density and efficient batteries. Optimal and safe use of existing battery cells and development of much needed novel battery chemistries and geometries require a large range of diagnostic and monitoring tools. While structural and chemical information is readily extracted through a host of imaging techniques, non invasive functional detection of interior battery processes remains limited. Here we introduce sensitive magnetometry performed outside the battery that reveals a battery cell's internal current distribution. As a key application, we use an array of sensors to image the magnetic field present under cycling of a pouch cell between charge states. We find good agreement between measured and modelled fields with sufficient resolution to detect percent level deviations around areas of high current density. This opens the path towards rapid and reliable assessment throughout the battery life cycle, from battery development and manufacturing quality assurance to operational safety and optimised use.


The Distance Energy of Clique Trees. The distance energy of a simple connected graph G is defined as the sum of absolute values of its distance eigenvalues. In this paper, we mainly give a positive answer to a conjecture of distance energy of clique trees proposed by Lin, Liu and Lu H. Q. Lin, R. F. Liu, X. W. Lu, The inertia and energy of the distance matrix of a connected graph, it Linear Algebra Appl., 467 (2015), 29 39.


Impact Mitigation for Dynamic Legged Robots with Steel Wire Transmission Using Nonlinear Active Compliance Control. Impact mitigation is crucial to the stable locomotion of legged robots, especially in high speed dynamic locomotion. This paper presents a leg locomotion system including the nonlinear active compliance control and the active impedance control for the steel wire transmission based legged robot. The developed control system enables high speed dynamic locomotion with excellent impact mitigation and leg position tracking performance, where three strategies are applied. a) The feed forward controller is designed according to the linear motor leg model with the information of Coulomb friction and viscous friction. b) Steel wire transmission model based compensation guarantees ideal virtual spring compliance characteristics. c) Nonlinear active compliance control and active impedance control ensure better impact mitigation performance than linear scheme and guarantee position tracking performance. The proposed control system is verified on a real robot named SCIT Dog and the experiment demonstrates the ideal impact mitigation ability in high speed dynamic locomotion without any passive spring mechanism.


Multi Robot Task Planning under Individual and Collaborative Temporal Logic Specifications. This paper investigates the task coordination of multi robot where each robot has a private individual temporal logic task specification and also has to jointly satisfy a globally given collaborative temporal logic task specification. To efficiently generate feasible and optimized task execution plans for the robots, we propose a hierarchical multi robot temporal task planning framework, in which a central server allocates the collaborative tasks to the robots, and then individual robots can independently synthesize their task execution plans in a decentralized manner. Furthermore, we propose an execution plan adjusting mechanism that allows the robots to iteratively modify their execution plans via privacy preserved inter agent communication, to improve the expected actual execution performance by reducing waiting time in collaborations for the robots. The correctness and efficiency of the proposed method are analyzed and also verified by extensive simulation experiments.


Cross lingual hate speech detection based on multilingual domain specific word embeddings. Automatic hate speech detection in online social networks is an important open problem in Natural Language Processing (NLP). Hate speech is a multidimensional issue, strongly dependant on language and cultural factors. Despite its relevance, research on this topic has been almost exclusively devoted to English. Most supervised learning resources, such as labeled datasets and NLP tools, have been created for this same language. Considering that a large portion of users worldwide speak in languages other than English, there is an important need for creating efficient approaches for multilingual hate speech detection. In this work we propose to address the problem of multilingual hate speech detection from the perspective of transfer learning. Our goal is to determine if knowledge from one particular language can be used to classify other language, and to determine effective ways to achieve this. We propose a hate specific data representation and evaluate its effectiveness against general purpose universal representations most of which, unlike our proposed model, have been trained on massive amounts of data. We focus on a cross lingual setting, in which one needs to classify hate speech in one language without having access to any labeled data for that language. We show that the use of our simple yet specific multilingual hate representations improves classification results. We explain this with a qualitative analysis showing that our specific representation is able to capture some common patterns in how hate speech presents itself in different languages. Our proposal constitutes, to the best of our knowledge, the first attempt for constructing multilingual specific task representations. Despite its simplicity, our model outperformed the previous approaches for most of the experimental setups. Our findings can orient future solutions toward the use of domain specific representations.


Some classifications of conformal biharmonic and k polyharmonic maps. We give a complete classification of local and global conformal biharmonic maps between any two space forms by proving that a conformal map between two space forms is proper biharmonic if and only if the dimension is 4, the domain is flat, and it is a restriction of a M "obius transformation. We also show that proper k polyharmonic conformal maps between Euclidean spaces exist if and only if the dimension is 2k and they are precisely the restrictions of M "obius transformations. This provides infinitely many simple examples of proper k polyharmonic maps with nice geometric structure.


The Specification Language Server Protocol A Proposal for Standardised LSP Extensions. The Language Server Protocol (LSP) changed the field of Integrated Development Environments(IDEs), as it decouples core (programming) language features functionality from editor smarts, thus lowering the effort required to extend an IDE to support a language. The concept is a success and has been adopted by several programming languages and beyond. This is shown by the emergence of several LSP implementations for the many programming and specification languages (languages with a focus on modelling, reasoning, or proofs). However, for such languages LSP has been ad hocly extended with the additional functionalities that are typically not found for programming languages and thus not supported in LSP. This foils the original LSP decoupling goal, because the move towards a new IDE requires yet another re implementation of the ad hoc LSP extension. In this paper we contribute with a conservative extension of LSP providing a first proposal towards a standard protocol decoupling the support of specification languages from the IDE. We hope our research attracts the larger community and motivates the need of a joint task force leading to a standardised LSP extension serving the particular needs of specification languages.


On a Family of Twisted Trace Curves over Finite Fields, and Fibonacci Numbers. We present some results about the number of rational points on a certain family of curves defined over a finite field. In a small number of cases the curves have more rational points than expected. Fibonacci numbers make an appearance, as do cyclotomic polynomials.


Calder 'on Zygmund theory in (k,1) generalized analysis and imaginary powers of (k,1) generalized harmonic oscillator. In this paper we will define and investigate the imaginary powers left( triangle k,1 right) i sigma , sigma in mathbb R of the (k,1) generalized harmonic oscillator triangle k,1 left x right triangle k left x right and prove the L p boundedness (1 p infty) and weak L 1 boundedness of such operators. It is a parallel result to the L p boundedness (1 p infty) and weak L 1 boundedness of the imaginary powers of the Dunkl harmonic oscillator triangle k left x right 2 . To prove this result, we develop the Calder 'on Zygmund theory adapted to the (k,1) generalized setting by constructing the metric space of homogeneous type corresponding to the (k,1) generalized setting, and show that left( triangle k,1 right) i sigma are singular integral operators satisfying the corresponding H "ormander type condition.


Algorithmic properties of first order modal logics of linear Kripke frames in restricted languages. We study the algorithmic properties of first order monomodal logics of frames langle mathbb N , leq rangle , langle mathbb N , rangle , langle mathbb Q , leq rangle , langle mathbb Q , rangle , langle mathbb R , leq rangle , langle mathbb R , rangle , as well as some related logics, in languages with restrictions on the number of individual variables as well as the number and arity of predicate letters. We show that the logics of frames based on mathbb N are Pi 1 1 hard thus, not recursively enumerable in languages with two individual variables, one monadic predicate letter and one proposition letter. We also show that the logics of frames based on mathbb Q and mathbb R are Sigma 0 1 hard in languages with the same restrictions. Similar results are obtained for a number of related logics.


A Bijective Proof of Richard Stanley's Observation that the sum of the cubes of the n th row of Stern's Diatomic array equals 3 times 7 to the power n 1. In a delightful article, Richard Stanley derived, algebraically, the surprisingly simple formula, 3 times 7 to the power n 1, for the sum of the cubes of the n th row of Stern's diatomic array. In this note, we find an elegant bijective proof of this surprising fact, that explains it and gives insight. The novelty is that this gorgeous bijection was discovered by a computer (SBE), with minimal guidance by a human (DZ). This debunks the conventional wisdom, held by some human supremacists, that computers can only compute, but they can't give insight


Dexterous Manipulation Primitives for the Real Robot Challenge. This report describes our approach for Phase 3 of the Real Robot Challenge. To solve cuboid manipulation tasks of varying difficulty, we decompose each task into the following primitives moving the fingers to the cuboid to grasp it, turning it on the table to minimize orientation error, and re positioning it to the goal position. We use model based trajectory optimization and control to plan and execute these primitives. These grasping, turning, and re positioning primitives are sequenced with a state machine that determines which primitive to execute given the current object state and goal. Our method shows robust performance over multiple runs with randomized initial and goal positions. With this approach, our team placed second in the challenge, under the anonymous name "sombertortoise" on the leaderboard. Example runs of our method solving each of the four levels can be seen in this video (https www.youtube.com watch?v I65Kwu9PGmg list PLt9QxrtaftrHGXcp4Oh8 s OnQnBnLtei index 1).


Variance Reduction in Deep Learning More Momentum is All You Need. Variance reduction (VR) techniques have contributed significantly to accelerating learning with massive datasets in the smooth and strongly convex setting (Schmidt et al., 2017 Johnson Zhang, 2013 Roux et al., 2012). However, such techniques have not yet met the same success in the realm of large scale deep learning due to various factors such as the use of data augmentation or regularization methods like dropout (Defazio Bottou, 2019). This challenge has recently motivated the design of novel variance reduction techniques tailored explicitly for deep learning (Arnold et al., 2019 Ma Yarats, 2018). This work is an additional step in this direction. In particular, we exploit the ubiquitous clustering structure of rich datasets used in deep learning to design a family of scalable variance reduced optimization procedures by combining existing optimizers (e.g., SGD Momentum, Quasi Hyperbolic Momentum, Implicit Gradient Transport) with a multi momentum strategy (Yuan et al., 2019). Our proposal leads to faster convergence than vanilla methods on standard benchmark datasets (e.g., CIFAR and ImageNet). It is robust to label noise and amenable to distributed optimization. We provide a parallel implementation in JAX.


What Evidence We Would Miss If We Do Not Use Grey Literature?. Context Over the last years, Grey Literature (GL) is gaining increasing attention in Secondary Studies in Software Engineering (SE). Notably, Multivocal Literature Review (MLR) studies, that search for evidence in both Traditional Literature (TL) and GL, is particularly benefiting from this raise of GL content. Despite the growing interest in MLR based studies, the literature assessing how GL has contributed to MLR studies is still scarce. Objective This research aims to assess how the use of GL contributed to MLR studies. By contributing, we mean, understanding to what extent GL is providing evidence that is indeed used by an MLR to answer its research question. Method We conducted a tertiary study to identify MLR studies published between 2017 and 2019, selecting nine MLRs studies. Using qualitative and quantitative analysis, we identified the GL used and assessed to what extent these MLRs are contributing to MLR studies. Results Our analysis identified that 1) GL provided evidence not found in TL, 2) most of the GL sources were used to provide recommendations to solve problems, explain a topic, and classify the findings, and 3) 19 different GL types were used in the studies these GLs were mainly produced by SE practitioners (including blog posts, slides presentations, or project descriptions). Conclusions We evidence how GL contributed to MLR studies. We observed that if these GLs were not included in the MLR, several findings would have been omitted or weakened. We also described the challenges involved when conducting this investigation, along with potential ways to deal with them, which may help future SE researchers.


Master Stability Functions for metacommunities with two types of habitats. Current questions in ecology revolve around instabilities in the dynamics on spatial networks and particularly the effect of node heterogeneity. We extend the Master Stability Function formalism to inhomogeneous biregular networks having two types of spatial nodes. Notably, this class of systems also allows the investigation of certain types of dynamics on higher order networks. Combined with the Generalized Modelling approach to study the linear stability of steady states, this is a powerful tool to numerically asses the stability of large ensembles of systems. We analyze the stability of ecological metacommunities with two distinct types of habitats analytically and numerically in order to identify several sets of conditions under which the dynamics can become stabilized by dispersal. Our analytical approach allows general insights into stabilizing and destabilizing effects in metapopulations. Specifically, we show that maladaptive dispersal may be stable under certain conditions.


Dynamics of COVID 19 mitigation inefficiency in Brazil. In this work Data Envelopment Analysis (DEA) is employed in thirty day windows to quantify temporal evolution of relative pandemic mitigation inefficiency of Brazilian municipalities. For each thirty day window the results of inefficiency scores of over five thousand Brazilian municipalities are displayed on maps, to address the spatial distribution of the corresponding values. This phenomenological spatiotemporal approach reveals location of the hotspots, in terms of relative pandemic inefficiency of the municipalities, at different points in time along the pandemic. It is expected that the current approach may subsidize decision making through comparative analysis of previous practice, and thus contribute to the future pandemic mitigation efforts.


A Newcomer In The PGAS World UPC vs UPC A Comparative Study. A newcomer in the Partitioned Global Address Space (PGAS) 'world' has arrived in its version 1.0 Unified Parallel C (UPC ). UPC targets distributed data structures where communication is irregular or fine grained. The key abstractions are global pointers, asynchronous programming via RPC, futures and promises. UPC API for moving non contiguous data and handling memories with different optimal access methods resemble those used in modern C . In this study we provide two kernels implemented in UPC a sparse matrix vector multiplication (SpMV) as part of a Partial Differential Equation solver, and an implementation of the Heat Equation on a 2D domain. Code listings of these two kernels are available in the article in order to show the differences in programming style between UPC and UPC . We provide a performance comparison between UPC and UPC using single node, multi node hardware and many core hardware (Intel Xeon Phi Knight's Landing).


Fatigue crack propagation in carbon steel using RVE based model. A representative volume element (RVE) based multi scale method is proposed to investigate the mechanism of fatigue crack propagation by the molecular dynamics (MD) and the extended finite element methods(XFEM) in this study. An atomic model of carbon steel plate is built to study the behavior of fatigue crack at the micro scale by MD method. Then the RVE model for fatigue crack propagation should be built by fitting the data which was obtained from the MD result with the Paris law model. Moreover, the effect of micro structural defects including interstitial atoms, vacancies have also been considered in this study. The results indicate that the micro structural defects can deeply influence the values of Paris law constants and the life of the specimen can be evaluated by the proposed method.


Iterated numerical homogenization for multi scale elliptic equations with monotone nonlinearity. Nonlinear multi scale problems are ubiquitous in materials science and biology. Complicated interactions between nonlinearities and (nonseparable) multiple scales pose a major challenge for analysis and simulation. In this paper, we study the numerical homogenization for multi scale elliptic PDEs with monotone nonlinearity, in particular the Leray Lions problem (a prototypical example is the p Laplacian equation), where the nonlinearity cannot be parameterized with low dimensional parameters, and the linearization error is non negligible. We develop the iterated numerical homogenization scheme by combining numerical homogenization methods for linear equations, and the so called "quasi norm" based iterative approach for monotone nonlinear equation. We propose a residual regularized nonlinear iterative method, and in addition, develop the sparse updating method for the efficient update of coarse spaces. A number of numerical results are presented to complement the analysis and valid the numerical method.


An Investigation into Inconsistency of Software Vulnerability Severity across Data Sources. Software Vulnerability (SV) severity assessment is a vital task for informing SV remediation and triage. Ranking of SV severity scores is often used to advise prioritization of patching efforts. However, severity assessment is a difficult and subjective manual task that relies on expertise, knowledge, and standardized reporting schemes. Consequently, different data sources that perform independent analysis may provide conflicting severity rankings. Inconsistency across these data sources affects the reliability of severity assessment data, and can consequently impact SV prioritization and fixing. In this study, we investigate severity ranking inconsistencies over the SV reporting lifecycle. Our analysis helps characterize the nature of this problem, identify correlated factors, and determine the impacts of inconsistency on downstream tasks. Our findings observe that SV severity often lacks consideration or is underestimated during initial reporting, and such SVs consequently receive lower prioritization. We identify six potential attributes that are correlated to this misjudgment, and show that inconsistency in severity reporting schemes can severely degrade the performance of downstream severity prediction by up to 77 . Our findings help raise awareness of SV severity data inconsistencies and draw attention to this data quality problem. These insights can help developers better consider SV severity data sources, and improve the reliability of consequent SV prioritization. Furthermore, we encourage researchers to provide more attention to SV severity data selection.


A Characterization of the Realizable Matou v s ek Unique Sink Orientations. The Matou v s ek LP type problems were used by Matou v s ek to show that the Sharir Welzl algorithm may require at least subexponential time. Later, G "artner translated this result into the language of Unique Sink Orientations (USOs) and introduced the Matou v s ek USOs, the USOs equivalent to Matou v s ek's LP type problems. He further showed that the Random Facet algorithm only requires quadratic time on the realizable subset of the Matou v s ek USOs, but without characterizing this subset. In this paper, we deliver this missing characterization and also provide concrete realizations for all realizable Matou v s ek USOs. Furthermore, we show that the realizable Matou v s ek USOs are exactly the orientations arising from simple extensions of cyclic P matroids.