DEX Domain Embedding Expansion for Generalized Person Re identification. In recent years, supervised Person Re identification (Person ReID) approaches have demonstrated excellent performance. However, when these methods are applied to inputs from a different camera network, they typically suffer from significant performance degradation. Different from most domain adaptation (DA) approaches addressing this issue, we focus on developing a domain generalization (DG) Person ReID model that can be deployed without additional fine tuning or adaptation. In this paper, we propose the Domain Embedding Expansion (DEX) module. DEX dynamically manipulates and augments deep features based on person and domain labels during training, significantly improving the generalization capability and robustness of Person ReID models to unseen domains. We also developed a light version of DEX (DEXLite), applying negative sampling techniques to scale to larger datasets and reduce memory usage for multi branch networks. Our proposed DEX and DEXLite can be combined with many existing methods, Bag of Tricks (BagTricks), the Multi Granularity Network (MGN), and Part Based Convolutional Baseline (PCB), in a plug and play manner. With DEX and DEXLite, existing methods can gain significant improvements when tested on other unseen datasets, thereby demonstrating the general applicability of our method. Our solution outperforms the state of the art DG Person ReID methods in all large scale benchmarks as well as in most the small scale benchmarks.


Torsion in the space of commuting elements in a Lie group. Let mathrm Hom ( mathbb Z m,G) denote the space of commuting m tuples in a Lie group G . In this paper, we study torsion in the homology of mathrm Hom ( mathbb Z m,G) . We describe mathrm Hom ( mathbb Z m,G) as a homotopy colimit of a functor F m defined by homogeneous spaces of G , and then by analyzing the functor F m , we develop a method for detecting torsion in the homology of mathrm Hom ( mathbb Z m,G) in terms of the extended Dynkin diagram of G . Using this method, we prove that for m ge 2 , mathrm Hom ( mathbb Z m, mathrm SU (n)) has p torsion in homology if and only if p le n . We also compute some torsion in the homology of mathrm Hom ( mathbb Z m,G) for G mathrm Spin (2n) or exceptional. As an another application of the method, we determine the top homology of mathrm Hom ( mathbb Z m,G) for any compact simply connected simple Lie group G .


Lightweight Adapter Tuning for Multilingual Speech Translation. Adapter modules were recently introduced as an efficient alternative to fine tuning in NLP. Adapter tuning consists in freezing pretrained parameters of a model and injecting lightweight modules between layers, resulting in the addition of only a small number of task specific trainable parameters. While adapter tuning was investigated for multilingual neural machine translation, this paper proposes a comprehensive analysis of adapters for multilingual speech translation (ST). Starting from different pre trained models (a multilingual ST trained on parallel data or a multilingual BART (mBART) trained on non parallel multilingual data), we show that adapters can be used to (a) efficiently specialize ST to specific language pairs with a low extra cost in terms of parameters, and (b) transfer from an automatic speech recognition (ASR) task and an mBART pre trained model to a multilingual ST task. Experiments show that adapter tuning offer competitive results to full fine tuning, while being much more parameter efficient.


Consistency Regularization for Cross Lingual Fine Tuning. Fine tuning pre trained cross lingual language models can transfer task specific supervision from one language to the others. In this work, we propose to improve cross lingual fine tuning with consistency regularization. Specifically, we use example consistency regularization to penalize the prediction sensitivity to four types of data augmentations, i.e., subword sampling, Gaussian noise, code switch substitution, and machine translation. In addition, we employ model consistency to regularize the models trained with two augmented versions of the same training set. Experimental results on the XTREME benchmark show that our method significantly improves cross lingual fine tuning across various tasks, including text classification, question answering, and sequence labeling.


Companion points on the eigenvariety with non regular weights. We prove the existence of all companion points on the eigenvariety of definite unitary groups associated with generic crystalline Galois representations with possibly non regular weights under the Taylor Wiles hypothesis, based on the previous results of Breuil Hellmann Schraen in arXiv 1702.02192 in regular cases and the author in arXiv 2103.03823 in non regular cases.


An introduction to the lattice of torsion classes. In this expository note, I present some of the key features of the lattice of torsion classes of a finite dimensional algebra, focussing in particular on its complete semidistributivity and consequences thereof. This is intended to serve as an introduction to recent work by Barnard Carroll Zhu and Demonet Iyama Reading Reiten Thomas.


The Promise of Dataflow Architectures in the Design of Processing Systems for Autonomous Machines. The commercialization of autonomous machines is a thriving sector, and likely to be the next major computing demand driver, after PC, cloud computing, and mobile computing. Nevertheless, a suitable computer architecture for autonomous machines is missing, and many companies are forced to develop ad hoc computing solutions that are neither scalable nor extensible. In this article, we analyze the demands of autonomous machine computing, and argue for the promise of dataflow architectures in autonomous machines.


One Shot Object Affordance Detection in the Wild. Affordance detection refers to identifying the potential action possibilities of objects in an image, which is a crucial ability for robot perception and manipulation. To empower robots with this ability in unseen scenarios, we first study the challenging one shot affordance detection problem in this paper, i.e., given a support image that depicts the action purpose, all objects in a scene with the common affordance should be detected. To this end, we devise a One Shot Affordance Detection Network (OSAD Net) that firstly estimates the human action purpose and then transfers it to help detect the common affordance from all candidate images. Through collaboration learning, OSAD Net can capture the common characteristics between objects having the same underlying affordance and learn a good adaptation capability for perceiving unseen affordances. Besides, we build a large scale Purpose driven Affordance Dataset v2 (PADv2) by collecting and labeling 30k images from 39 affordance and 103 object categories. With complex scenes and rich annotations, our PADv2 dataset can be used as a test bed to benchmark affordance detection methods and may also facilitate downstream vision tasks, such as scene understanding, action recognition, and robot manipulation. Specifically, we conducted comprehensive experiments on PADv2 dataset by including 11 advanced models from several related research fields. Experimental results demonstrate the superiority of our model over previous representative ones in terms of both objective metrics and visual quality. The benchmark suite is available at https github.com lhc1224 OSAD Net.


On integral conditions for the existence of first integrals analytic saddle singularities. We study one parameter analytic integrable deformations of the germ of 2 times(n 2) type complex saddle singularity given by d(xy) 0 at the origin 0 in mathbb C 2 times mathbb C n 2 . Such a deformation writes omega t d(xy) sum limits j 1 infty t j omega j where t in mathbb C,0 is the parameter of the deformation and the coefficients omega j are holomorphic one forms in some neighborhood of the origin 0 in mathbb C n . We prove that, under a nondegeneracy condition of the singular set of the deformation, with respect to the fibration d(xy) 0 , the existence of a holomorphic first integral for each element omega t of the deformation is equivalent to the vanishing of certain line integrals oint gamma c omega t 0, forall gamma c, forall t calculated on cycles gamma c contained in the fibers xy c, ,0 ne c in mathbb C,0 . This result is quite sharp regarding the conditions of the singular set and on the vanishing of the integrals in cycles. It is also not valid for ramified saddles, i.e., for deformations of saddles of the form x ny m c where n m 2 . As an application of our techniques we obtain a criteria for the existence of first integrals for integrable codimension one deformations of quadratic analytic center cylinder type singularities in terms of the vanishing of some easy to compute line integrals.


Amortized Implicit Differentiation for Stochastic Bilevel Optimization. We study a class of algorithms for solving bilevel optimization problems in both stochastic and deterministic settings when the inner level objective is strongly convex. Specifically, we consider algorithms based on inexact implicit differentiation and we exploit a warm start strategy to amortize the estimation of the exact gradient. We then introduce a unified theoretical framework inspired by the study of singularly perturbed systems (Habets, 1974) to analyze such amortized algorithms. By using this framework, our analysis shows these algorithms to match the computational complexity of oracle methods that have access to an unbiased estimate of the gradient, thus outperforming many existing results for bilevel optimization. We illustrate these findings on synthetic experiments and demonstrate the efficiency of these algorithms on hyper parameter optimization experiments involving several thousands of variables.


LRGNet Learnable Region Growing for Class Agnostic Point Cloud Segmentation. 3D point cloud segmentation is an important function that helps robots understand the layout of their surrounding environment and perform tasks such as grasping objects, avoiding obstacles, and finding landmarks. Current segmentation methods are mostly class specific, many of which are tuned to work with specific object categories and may not be generalizable to different types of scenes. This research proposes a learnable region growing method for class agnostic point cloud segmentation, specifically for the task of instance label prediction. The proposed method is able to segment any class of objects using a single deep neural network without any assumptions about their shapes and sizes. The deep neural network is trained to predict how to add or remove points from a point cloud region to morph it into incrementally more complete regions of an object instance. Segmentation results on the S3DIS and ScanNet datasets show that the proposed method outperforms competing methods by 1 9 on 6 different evaluation metrics.


DIML CVL RGB D Dataset 2M RGB D Images of Natural Indoor and Outdoor Scenes. This manual is intended to provide a detailed description of the DIML CVL RGB D dataset. This dataset is comprised of 2M color images and their corresponding depth maps from a great variety of natural indoor and outdoor scenes. The indoor dataset was constructed using the Microsoft Kinect v2, while the outdoor dataset was built using the stereo cameras (ZED stereo camera and built in stereo camera). Table I summarizes the details of our dataset, including acquisition, processing, format, and toolbox. Refer to Section II and III for more details.


The extremal length systole of the Bolza surface. We prove that the extremal length systole of genus two surfaces attains a strict local maximum at the Bolza surface, where it takes the value sqrt 2 .


Visual Analysis of Two Phase Flow Displacement Processes in Porous Media. We present the visual analysis of our novel parameter study of porous media experiments, focusing on gaining a better understanding of drainage processes on the micro scale. We analyze the temporal evolution of extracted characteristic values, and discuss how to directly compare experiments that exhibit processes at different temporal scales due to varying boundary and physical conditions. To enable spatio temporal analysis, we introduce a new abstract visual representation showing which paths through the porous media were occupied to what extent, e.g., allowing for classification into viscous and capillary regimes. This joint work of porous media experts and visualization researchers yields new insights regarding immiscible two phase flow on the micro scale toward the overarching goal of characterizing flow based on boundary conditions and physical fluid properties.


Threshold Ramsey multiplicity for paths and even cycles. The Ramsey number r(H) of a graph H is the minimum integer n such that any two coloring of the edges of the complete graph K n contains a monochromatic copy of H . While this definition only asks for a single monochromatic copy of H , it is often the case that every two edge coloring of the complete graph on r(H) vertices contains many monochromatic copies of H . The minimum number of such copies over all two colorings of K r(H) will be referred to as the threshold Ramsey multiplicity of H . Addressing a problem of Harary and Prins, who were the first to systematically study this quantity, we show that there is a positive constant c such that the threshold Ramsey multiplicity of a path or an even cycle on k vertices is at least (ck) k . This bound is tight up to the constant c . We prove a similar result for odd cycles in a companion paper.


Learning Rates for Multi task Regularization Networks. Multi task learning is an important trend of machine learning in facing the era of artificial intelligence and big data. Despite a large amount of researches on learning rate estimates of various single task machine learning algorithms, there is little parallel work for multi task learning. We present mathematical analysis on the learning rate estimate of multi task learning based on the theory of vector valued reproducing kernel Hilbert spaces and matrix valued reproducing kernels. For the typical multi task regularization networks, an explicit learning rate dependent both on the number of sample data and the number of tasks is obtained. It reveals that the generalization ability of multi task learning algorithms is indeed affected as the number of tasks increases.


Simulating urban dynamics and international governance of transportation infrastructure projects. Systems of cities at the macroscopic scale have their trajectories conditioned by the evolution of infrastructure networks. This leads to complex planning and management situations in the particular case of international transportation infrastructure projects. To understand such dynamics and anticipate future sustainable trajectories, we introduce a co evolution model between cities and transportation networks at the international scale, which simulates network growth by including transportation governance. The model is applied to synthetic systems of cities and the parameter space systematically explored, showing strong interactions between urban dynamics and governance structure. We also study optimisation patterns as compromises between construction cost and accessibility gain, with possible future applications to sustainable long term planning of international transport projects.


Recovery of the Order of Derivation for Fractional Diffusion Equations in an Unknown Medium. In this work, we investigate the recovery of a parameter in a diffusion process given by the order of derivation in time for a class of diffusion type equations, including both classical and time fractional diffusion equations, from the flux measurement observed at one point on the boundary. The mathematical model for time fractional diffusion equations involves a Djrbashian Caputo fractional derivative in time. We prove a uniqueness result in an unknown medium (e.g., diffusion coefficients, obstacle, initial condition and source), i.e., the recovery of the order of derivation in a diffusion process having several pieces of unknown information. The proof relies on the analyticity of the solution at large time, asymptotic decay behavior, strong maximum principle of the elliptic problem and suitable application of the Hopf lemma. Further we provide an easy to implement reconstruction algorithm based on a nonlinear least squares formulation, and several numerical experiments are presented to complement the theoretical analysis.


Switch Spaces Learning Product Spaces with Sparse Gating. Learning embedding spaces of suitable geometry is critical for representation learning. In order for learned representations to be effective and efficient, it is ideal that the geometric inductive bias aligns well with the underlying structure of the data. In this paper, we propose Switch Spaces, a data driven approach for learning representations in product space. Specifically, product spaces (or manifolds) are spaces of mixed curvature, i.e., a combination of multiple euclidean and non euclidean (hyperbolic, spherical) manifolds. To this end, we introduce sparse gating mechanisms that learn to choose, combine and switch spaces, allowing them to be switchable depending on the input data with specialization. Additionally, the proposed method is also efficient and has a constant computational complexity regardless of the model size. Experiments on knowledge graph completion and item recommendations show that the proposed switch space achieves new state of the art performances, outperforming pure product spaces and recently proposed task specific models.


Conference proceedings KI4Industry AI for SMEs The online congress for practical entry into AI for SMEs. The Institute of Materials and Processes, IMP, of the University of Applied Sciences in Karlsruhe, Germany in cooperation with VDI Verein Deutscher Ingenieure e.V, AEN Automotive Engineering Network and their cooperation partners present their competences of AI based solution approaches in the production engineering field. The online congress KI 4 Industry on November 12 and 13, 2020, showed what opportunities the use of artificial intelligence offers for medium sized manufacturing companies, SMEs, and where potential fields of application lie. The main purpose of KI 4 Industry is to increase the transfer of knowledge, research and technology from universities to small and medium sized enterprises, to demystify the term AI and to encourage companies to use AI based solutions in their own value chain or in their products.


An Analysis of Impact Pathways arising from a Mobile based Community Media Platform in Rural India. Our research presents the case study of a mobile phone based, voice driven platform Mobile Vaani, established with a goal to empower poor and marginalized communities to create their own local media. In this paper, we derive a comprehensive theory of change for Mobile Vaani from data gathered using the Most Significant Change technique. This paper contributes towards formulating a theory of change for technology driven community media platforms which can be adapted to other ICTD interventions too.


Getting Genetic Ancestry Right for Science and Society. There is a scientific and ethical imperative to embrace a multidimensional, continuous view of ancestry and move away from continental ancestry categories


From Assistants to Friends Investigating Emotional Intelligence of IPAs in Hindi and English. Intelligent Personal Assistants (IPAs) like Amazon Alexa, Apple Siri, and Google Assistant are increasingly becoming a part of our everyday. As IPAs become ubiquitous and their applications expand, users turn to them for not just routine tasks, but also intelligent conversations. In this study, we measure the emotional intelligence (EI) displayed by IPAs in the English and Hindi languages to our knowledge, this is a pioneering effort in probing the emotional intelligence of IPAs in Indian languages. We pose utterances that convey the Sadness or Humor emotion and evaluate IPA responses. We build on previous research to propose a quantitative and qualitative evaluation scheme encompassing new criteria from social science perspectives (display of empathy, wit, understanding) and IPA specific features (voice modulation, search redirects). We find EI displayed by Google Assistant in Hindi is comparable to EI displayed in English, with the assistant employing both voice modulation and emojis in text. However, we do find that IPAs are unable to understand and respond intelligently to all queries, sometimes even offering counter productive and problematic responses. Our experiment offers evidence and directions to augment the potential for EI in IPAs.


EEGminer Discovering Interpretable Features of Brain Activity with Learnable Filters. Patterns of brain activity are associated with different brain processes and can be used to identify different brain states and make behavioral predictions. However, the relevant features are not readily apparent and accessible. To mine informative latent representations from multichannel recordings of ongoing EEG activity, we propose a novel differentiable decoding pipeline consisting of learnable filters and a pre determined feature extraction module. Specifically, we introduce filters parameterized by generalized Gaussian functions that offer a smooth derivative for stable end to end model training and allow for learning interpretable features. For the feature module, we use signal magnitude and functional connectivity estimates. We demonstrate the utility of our model towards emotion recognition from EEG signals on the SEED dataset, as well as on a new EEG dataset of unprecedented size (i.e., 761 subjects), where we identify consistent trends of music perception and related individual differences. The discovered features align with previous neuroscience studies and offer new insights, such as marked differences in the functional connectivity profile between left and right temporal areas during music listening. This agrees with the respective specialisation of the temporal lobes regarding music perception proposed in the literature.


Research on Third Party Libraries in AndroidApps A Taxonomy and Systematic LiteratureReview. Third party libraries (TPLs) have been widely used in mobile apps, which play an essential part in the entire Android ecosystem. However, TPL is a double edged sword. On the one hand, it can ease the development of mobile apps. On the other hand, it also brings security risks such as privacy leaks or increased attack surfaces (e.g., by introducing over privileged permissions) to mobile apps. Although there are already many studies for characterizing third party libraries, including automated detection, security and privacy analysis of TPLs, TPL attributes analysis, etc., what strikes us odd is that there is no systematic study to summarize those studies' endeavors. To this end, we conduct the first systematic literature review on Android TPL related research. Following a well defined systematic literature review protocol, we collected 74 primary research papers closely related to the Android third party library from 2012 to 2020. After carefully examining these studies, we designed a taxonomy of TPL related research studies and conducted a systematic study to summarize current solutions, limitations, challenges and possible implications of new research directions related to third party library analysis. We hope that these contributions can give readers a clear overview of existing TPL related studies and inspire them to go beyond the current status quo by advancing the discipline with innovative approaches.


NUS IDS at FinCausal 2021 Dependency Tree in Graph Neural Network for Better Cause Effect Span Detection. Automatic identification of cause effect spans in financial documents is important for causality modelling and understanding reasons that lead to financial events. To exploit the observation that words are more connected to other words with the same cause effect type in a dependency tree, we construct useful graph embeddings by incorporating dependency relation features through a graph neural network. Our model builds on a baseline BERT token classifier with Viterbi decoding, and outperforms this baseline in cross validation and during the competition. In the official run of FinCausal 2021, we obtained Precision, Recall, and F1 scores of 95.56 , 95.56 and 95.57 that all ranked 1st place, and an Exact Match score of 86.05 which ranked 3rd place.


Quotients Of Admissible Formal Schemes and Adic Spaces by Finite Groups. In this paper we give a self contained treatment of finite group quotients of admissible (formal) schemes and adic spaces that are locally topologically finite type over a locally strongly noetherian adic space.


A note on fractional Askey Wilson integrals. In this paper, we generalize fractional q integrals by the method of q difference equation. In addition, we deduce fractional Askey Wilson integral, reversal type fractional Askey Wilson integral and Ramanujan type fractional Askey Wilson integral.


Proximal Gradient Algorithms under Local Lipschitz Gradient Continuity A Convergence and Robustness Analysis of PANOC. Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local Lipschitz gradient continuity for the smooth part of the objective function. We investigate an adaptive scheme for PANOC type methods (Stella et al. in Proceedings of the IEEE 56th CDC, 1939 1944, 2017), namely accelerated linesearch algorithms requiring only the simple oracle of proximal gradient. While including the classical proximal gradient method, our theoretical results cover a broader class of algorithms and provide convergence guarantees for accelerated methods with possibly inexact computation of the proximal mapping. These findings have also significant practical impact, as they widen scope and performance of existing, and possibly future, general purpose optimization software that invoke PANOC as inner solver.


Contextualized Scene Imagination for Generative Commonsense Reasoning. Humans use natural language to compose common concepts from their environment into plausible, day to day scene descriptions. However, such generative commonsense reasoning (GCSR) skills are lacking in state of the art text generation methods. Descriptive sentences about arbitrary concepts generated by neural text generation models (e.g., pre trained text to text Transformers) are often grammatically fluent but may not correspond to human common sense, largely due to their lack of mechanisms to capture concept relations, to identify implicit concepts, and to perform generalizable reasoning about unseen concept compositions. In this paper, we propose an Imagine and Verbalize (I V) method, which learns to imagine a relational scene knowledge graph (SKG) with relations between the input concepts, and leverage the SKG as a constraint when generating a plausible scene description. We collect and harmonize a set of knowledge resources from different domains and modalities, providing a rich auxiliary supervision signal for I V. The experiments demonstrate the effectiveness of I V in improving language models on both concept to sentence and concept to story generation tasks, while enabling the model to learn well from fewer task examples and generate SKGs that make common sense to human annotators.


Multinomial expansion and Nichols algebras associated to permutation solutions of the Yang Baxter equation. In this paper, we investigate Nichols algebras mathfrak B (W m, tau ) associated to permutation solutions of the Yang Baxter equation. Infinite examples of finite dimensional Nichols algebras are obtained, including those of dimension n m with m , n in Bbb Z geq 2 . It turns out that Nichols algebras mathfrak B (W m, tau ) have interesting relations with multinomial expansion. This is a generalization of the work in arXiv 2103.06489, which built a connection between the Nichols algebras of squared dimension and the Pascal's triangle.


A Study of the New Zealand Mathematics Curriculum. Given the profound and uncritiqued changes that have been implemented in Aotearoa New Zealand education since the 1990s, this paper provides a critical commentary on the characterising features of the New Zealand mathematics' curriculum in the context of the first stage of a study. The emphasis is on the importance of research design that begins with an explicit, evidence based hypothesis. To that end, we describe evidence that informs and identifies the study's hypothesised problem and causes. The study itself will show whether or not the hypothesis is justified that is, is the absence of standardised prescribed content in New Zealand mathematics' curriculum the reason for the country's declining mathematics rankings? The study aims to increase understanding in the field of mathematics education by exploring the effects on New Zealand year 7 public school teachers' mathematics curriculum selection and design practices, teaching practices, and subsequently student achievement.


Incentivizing Compliance with Algorithmic Instruments. Randomized experiments can be susceptible to selection bias due to potential non compliance by the participants. While much of the existing work has studied compliance as a static behavior, we propose a game theoretic model to study compliance as dynamic behavior that may change over time. In rounds, a social planner interacts with a sequence of heterogeneous agents who arrive with their unobserved private type that determines both their prior preferences across the actions (e.g., control and treatment) and their baseline rewards without taking any treatment. The planner provides each agent with a randomized recommendation that may alter their beliefs and their action selection. We develop a novel recommendation mechanism that views the planner's recommendation as a form of instrumental variable (IV) that only affects an agents' action selection, but not the observed rewards. We construct such IVs by carefully mapping the history the interactions between the planner and the previous agents to a random recommendation. Even though the initial agents may be completely non compliant, our mechanism can incentivize compliance over time, thereby enabling the estimation of the treatment effect of each treatment, and minimizing the cumulative regret of the planner whose goal is to identify the optimal treatment.


First Measurements of Nuclear Detonation Debris with Decay Energy Spectroscopy. We report the first isotopic composition measurements of trinitite, nuclear detonation debris from the Trinity test, using the novel forensics technique of decay energy spectroscopy (DES). DES measures the unique total decay energy (Q value) of each alpha decaying isotope in a small radioactive sample embedded in a microcalorimeter detector. We find that DES can measure the major alpha decaying isotopes in small particles of trinitite with no dissolution or chemical processing. These first measurements demonstrate the potential of DES to provide a radiometric isotopic characterization method with sensitivity and precision to complement traditional forensics techniques.


Metagenome2Vec Building Contextualized Representations for Scalable Metagenome Analysis. Advances in next generation metagenome sequencing have the potential to revolutionize the point of care diagnosis of novel pathogen infections, which could help prevent potential widespread transmission of diseases. Given the high volume of metagenome sequences, there is a need for scalable frameworks to analyze and segment metagenome sequences from clinical samples, which can be highly imbalanced. There is an increased need for learning robust representations from metagenome reads since pathogens within a family can have highly similar genome structures (some more than 90 ) and hence enable the segmentation and identification of novel pathogen sequences with limited labeled data. In this work, we propose Metagenome2Vec a contextualized representation that captures the global structural properties inherent in metagenome data and local contextualized properties through self supervised representation learning. We show that the learned representations can help detect six (6) related pathogens from clinical samples with less than 100 labeled sequences. Extensive experiments on simulated and clinical metagenome data show that the proposed representation encodes compositional properties that can generalize beyond annotations to segment novel pathogens in an unsupervised setting.


The control of particles in the Stokes limit. There are numerous ways to control objects in the Stokes regime, with microscale examples ranging from the use of optical tweezers to the application of external magnetic fields. In contrast, there are relatively few explorations of theoretical controllability, which investigate whether or not refined and precise control is indeed possible in a given system. In this work, seeking to highlight the utility and broad applicability of such rigorous analysis, we recount and illustrate key concepts of geometric control theory in the context of multiple particles in Stokesian fluids interacting with each other, such that they may be readily and widely applied in this largely unexplored fluid dynamical setting. Motivated both by experimental and abstract questions of control, we exemplify these techniques by explicit and detailed application to multiple problems concerning the control of particles, such as the motion of tracers in flow and the guidance of one sphere by another. Further, we showcase how this analysis of controllability can directly lead to the construction of schemes for control, in addition to facilitating explorations of mechanical efficiency and contributing to our overall understanding of non local hydrodynamic interactions in the Stokes limit.


An optimal control problem for the stationary Navier Stokes equations with point sources. The aim of this work is to analyze a two dimensional optimal control problem for the Navier Stokes equations where the control variable corresponds to the amplitude of forces modeled as point sources control constraints are also considered. This particular setting leads to solutions to the state equation exhibiting reduced regularity properties. We operate within the theory of Muckenhoupt weights, Muckenhoupt weighted Sobolev spaces, and the corresponding weighted norm inequalities and derive the existence of optimal solutions and first and, necessary and sufficient, second order optimality conditions.


Vision Transformers are Robust Learners. Transformers, composed of multiple self attention layers, hold strong promises toward a generic learning primitive applicable to different data modalities, including the recent breakthroughs in computer vision achieving state of the art (SOTA) standard accuracy. What remains largely unexplored is their robustness evaluation and attribution. In this work, we study the robustness of the Vision Transformer (ViT) against common corruptions and perturbations, distribution shifts, and natural adversarial examples. We use six different diverse ImageNet datasets concerning robust classification to conduct a comprehensive performance comparison of ViT models and SOTA convolutional neural networks (CNNs), Big Transfer. Through a series of six systematically designed experiments, we then present analyses that provide both quantitative and qualitative indications to explain why ViTs are indeed more robust learners. For example, with fewer parameters and similar dataset and pre training combinations, ViT gives a top 1 accuracy of 28.10 on ImageNet A which is 4.3x higher than a comparable variant of BiT. Our analyses on image masking, Fourier spectrum sensitivity, and spread on discrete cosine energy spectrum reveal intriguing properties of ViT attributing to improved robustness. Code for reproducing our experiments is available at https git.io J3VO0.


LSSED a large scale dataset and benchmark for speech emotion recognition. Speech emotion recognition is a vital contributor to the next generation of human computer interaction (HCI). However, current existing small scale databases have limited the development of related research. In this paper, we present LSSED, a challenging large scale english speech emotion dataset, which has data collected from 820 subjects to simulate real world distribution. In addition, we release some pre trained models based on LSSED, which can not only promote the development of speech emotion recognition, but can also be transferred to related downstream tasks such as mental health analysis where data is extremely difficult to collect. Finally, our experiments show the necessity of large scale datasets and the effectiveness of pre trained models. The dateset will be released on https github.com tobefans LSSED.


Book free 3 Uniform Hypergraphs. One of the first problems in extremal graph theory was the maximum number of edges that a triangle free graph can have. Mantel solved this, which built the foundations of what we know as extremal graph theory. The natural progression was to ask the maximum number of edges in a k book free graph. A k book, denoted by B k , is k triangles sharing a common edge. In the early 2000s, Gy H o ri cite gyori1 solved the hypergraph analog of the maximum number of hyperedges in a triangle free hypergraph. In a hypergraph, k book denotes k Berge triangles sharing a common edge. Let text ex 3(n, mathcal F ) denote the maximum number of hyperedges in a Berge mathcal F free hypergraph on n vertices. In this paper, we prove text ex 3(n,B k) frac n 2 8 (1 o(1)) .


Modeling CoVid 19 Diffusion with Intelligent Computational Techniques is not Working. What Are We Doing Wrong?. As Europe is experiencing a second violent CoVid 19 storm, with the PCR based testing system deteriorating due to the high volumes of people to be tested daily, there is a general reconsideration of the mathematical theories at the basis of our contact tracing and testing approaches. Drawing upon the concept of super spreader, we propose the use of (less sensitive) rapid tests to detect those secondary infections that do not need the use of PCRs, thus saving the most part of PCR tests currently used. This before the system fails.


A variational characterization of 2 soliton profiles for the KdV equation. We use profile decomposition to characterize 2 soliton solutions of the KdV equation as global minimizers to a constrained variational problem involving three of the polynomial conservation laws for the KdV equation.


LOB modeling using Hawkes processes with a state dependent factor. A point process model for order flows in limit order books is proposed, in which the conditional intensity is the product of a Hawkes component and a state dependent factor. In the LOB context, state observations may include the observed imbalance or the observed spread. Full technical details for the computationally efficient estimation of such a process are provided, using either direct likelihood maximization or EM type estimation. Applications include models for bid and ask market orders, or for upwards and downwards price movements. Empirical results on multiple stocks traded in Euronext Paris underline the benefits of state dependent formulations for LOB modeling, e.g. in terms of goodness of fit to financial data.


A model problem for multiplicative chaos in number theory. Resolving a conjecture of Helson, Harper recently established that partial sums of random multiplicative functions typically exhibit more than square root cancellation. Harper's work gives an example of a problem in number theory that is closely linked to ideas in probability theory connected with multiplicative chaos another such closely related problem is the Fyodorov Hiary Keating conjecture on the maximum size of the Riemann zeta function in intervals of bounded length on the critical line. In this paper we consider a problem that might be thought of as a simplified function field version of Helson's conjecture. We develop and simplify the ideas of Harper in this context, with the hope that the simplified proof would be of use to readers seeking a gentle entry point to this fascinating area.


Using Throughput Centric Byzantine Broadcast to Tolerate Malicious Majority in Blockchains. Fault tolerance of a blockchain is often characterized by the fraction f of "adversarial power" that it can tolerate in the system. Despite the fast progress in blockchain designs in recent years, existing blockchain systems can still only tolerate f below 0.5 . Can practically usable blockchains tolerate a malicious majority, i.e., f above 0.5 ? This work presents a positive answer to this question. We first note that the well known impossibility of em byzantine consensus for f above 0.5 does not carry over to blockchains. To tolerate f above 0.5 , we use em byzantine broadcast , instead of byzantine consensus, as the core of the blockchain. A major obstacle in doing so, however, is that the resulting blockchain may have extremely low throughput. To overcome this central technical challenge, we propose a novel byzantine broadcast protocol OverlayBB, that can tolerate f above 0.5 while achieving good throughput. Using OverlayBB as the core, we present the design, implementation, and evaluation of a novel Proof of Stake blockchain called BCube. BCube can tolerate a malicious majority, while achieving practically usable transaction throughput and confirmation latency in our experiments with 10000 nodes and under f 0.7 . To our knowledge, BCube is the first blockchain that can achieve such properties.


Bayesian propensity score matching in automotive embedded software engineering. Randomised field experiments, such as A B testing, have long been the gold standard for evaluating the value that new software brings to customers. However, running randomised field experiments is not always desired, possible or even ethical in the development of automotive embedded software. In the face of such restrictions, we propose the use of the Bayesian propensity score matching technique for causal inference of observational studies in the automotive domain. In this paper, we present a method based on the Bayesian propensity score matching framework, applied in the unique setting of automotive software engineering. This method is used to generate balanced control and treatment groups from an observational online evaluation and estimate causal treatment effects from the software changes, even with limited samples in the treatment group. We exemplify the method with a proof of concept in the automotive domain. In the example, we have a larger control ( N c 1100 ) fleet of cars using the current software and a small treatment fleet ( N t 38 ), in which we introduce a new software variant. We demonstrate a scenario that shipping of a new software to all users is restricted, as a result, a fully randomised experiment could not be conducted. Therefore, we utilised the Bayesian propensity score matching method with 14 observed covariates as inputs. The results show more balanced groups, suitable for estimating causal treatment effects from the collected observational data. We describe the method in detail and share our configuration. Furthermore, we discuss how can such a method be used for online evaluation of new software utilising small groups of samples.


A Unified Transformer based Framework for Duplex Text Normalization. Text normalization (TN) and inverse text normalization (ITN) are essential preprocessing and postprocessing steps for text to speech synthesis and automatic speech recognition, respectively. Many methods have been proposed for either TN or ITN, ranging from weighted finite state transducers to neural networks. Despite their impressive performance, these methods aim to tackle only one of the two tasks but not both. As a result, in a complete spoken dialog system, two separate models for TN and ITN need to be built. This heterogeneity increases the technical complexity of the system, which in turn increases the cost of maintenance in a production setting. Motivated by this observation, we propose a unified framework for building a single neural duplex system that can simultaneously handle TN and ITN. Combined with a simple but effective data augmentation method, our systems achieve state of the art results on the Google TN dataset for English and Russian. They can also reach over 95 sentence level accuracy on an internal English TN dataset without any additional fine tuning. In addition, we also create a cleaned dataset from the Spoken Wikipedia Corpora for German and report the performance of our systems on the dataset. Overall, experimental results demonstrate the proposed duplex text normalization framework is highly effective and applicable to a range of domains and languages


Minimizing costs of communication with random constant weight codes. We present a framework for minimizing costs in constant weight codes while maintaining a certain amount of differentiable codewords. Our calculations are based on a combinatorial view of constant weight codes and relay on simple approximations.


What we can learn from how programmers debug their code. Researchers have developed numerous debugging approaches to help programmers in the debugging process, but these approaches are rarely used in practice. In this paper, we investigate how programmers debug their code and what researchers should consider when developing debugging approaches. We conducted an online questionnaire where 102 programmers provided information about recently fixed bugs. We found that the majority of bugs (69.6 ) are semantic bugs. Memory and concurrency bugs do not occur as frequently (6.9 and 8.8 ), but they consume more debugging time. Locating a bug is more difficult than reproducing and fixing it. Programmers often use only IDE build in tools for debugging. Furthermore, programmers frequently use a replication observation deduction pattern when debugging. These results suggest that debugging support is particularly valuable for memory and concurrency bugs. Furthermore, researchers should focus on the fault localization phase and integrate their tools into commonly used IDEs.


The differential on Graph Operator S G . Let G (V(G),E(G)) be a simple graph with vertex set V(G) and edge set E(G) . Let S be a subset of V(G) , and let B(S) be the set of neighbours of S in V(G) setminus S . The differential partial(S) of S is defined as B(S) S . The maximum value of partial(S) taken over all subsets S subseteq V is the differential partial(G) of G . A graph operator is a mapping F G rightarrow G' , where G and G' are families of graphs.The graph S G is defined as the graph obtained from G con bipartici 'on de v 'ertices V(G) cup E(G) , donde hay tantas aristas entre v in V(G) y e in E(G) , como veces e sea incidente con v en G . In this paper we study the relationship between partial(G) and partial( S G ) . Besides, we relate the differential of a graph with known parameters of a graph, namely, its domination and independence number.


On the distance transitivity of the square graph of the hypercube. Let Gamma (V,E) be a graph. The square graph Gamma 2 of the graph Gamma is the graph with the vertex set V( Gamma 2) V in which two vertices are adjacent if and only if their distance in Gamma is at most two. The square graph of the hypercube Q n has some interesting properties. For instance, it is highly symmetric and panconnected. In this paper, we investigate some algebraic properties of the graph Q 2 n . In particular, we show that the graph Q 2 n is distance transitive. We show that the graph Q 2 n is an imprimitive distance transitive graph if and only if n is an odd integer. Also, we determine the spectrum of the graph Q n 2 . Moreover, we show that when n 2 is an even integer, then Q 2 n is an automorphic graph, that is, Q n 2 is a distance transitive primitive graph which is not a complete or a line graph.


A Stochastic Proximal Gradient Framework for Decentralized Non Convex Composite Optimization Topology Independent Sample Complexity and Communication Efficiency. Decentralized optimization is a promising parallel computation paradigm for large scale data analytics and machine learning problems defined over a network of nodes. This paper is concerned with decentralized non convex composite problems with population or empirical risk. In particular, the networked nodes are tasked to find an approximate stationary point of the average of local, smooth, possibly non convex risk functions plus a possibly non differentiable extended valued convex regularizer. Under this general formulation, we propose the first provably efficient, stochastic proximal gradient framework, called ProxGT. Specifically, we construct and analyze several instances of ProxGT that are tailored respectively for different problem classes of interest. Remarkably, we show that the sample complexities of these instances are network topology independent and achieve linear speedups compared to that of the corresponding centralized optimal methods implemented on a single node.


Repairing Serializability Bugs in Distributed Database Programs via Automated Schema Refactoring. Serializability is a well understood concurrency control mechanism that eases reasoning about highly concurrent database programs. Unfortunately, enforcing serializability has a high performance cost, especially on geographically distributed database clusters. Consequently, many databases allow programmers to choose when a transaction must be executed under serializability, with the expectation that transactions would only be so marked when necessary to avoid serious concurrency bugs. However, this is a significant burden to impose on developers, requiring them to (a) reason about subtle concurrent interactions among potentially interfering transactions, (b) determine when such interactions would violate desired invariants, and (c) then identify the minimum number of transactions whose executions should be serialized to prevent these violations. To mitigate this burden, in this paper we present a sound and fully automated schema refactoring procedure that transforms a program's data layout rather than its concurrency control logic to eliminate statically identified concurrency bugs, allowing more transactions to be safely executed under weaker and more performant database guarantees. Experimental results over a range of database benchmarks indicate that our approach is highly effective in eliminating concurrency bugs, with safe refactored programs showing an average of 120 higher throughput and 45 lower latency compared to the baselines.


Algorithmic aspects of arithmetical structures. Arithmetical structures on graphs were first introduced in cite Lorenzini89 . Later in cite arithmetical they were further studied in the setting of square non negative integer matrices. In both cases, necessary and sufficient conditions for the finiteness of the set of arithmetical structures were given. More precisely, an arithmetical structure on a non negative integer matrix L with zero diagonal is a pair ( mathbf d , mathbf r ) in mathbb N n times mathbb N n such that ( textrm Diag ( mathbf d ) L) mathbf r t mathbf 0 t text and gcd(r 1, ldots,r n) 1. Thus, arithmetical structures on L are solutions of the polynomial Diophantine equation f L(X) det( text Diag (X) L) 0. Therefore, it is of interest to ask for an algorithm that compute them. We present an algorithm that computes arithmetical structures on a square integer non negative matrix L with zero diagonal. In order to do this we introduce a new class of Z matrices, which we call quasi M matrices.


An Optimised Flow for Futures From Theory to Practice. A future is an entity representing the result of an ongoing computation. A synchronisation with a "get" operation blocks the caller until the computation is over, to return the corresponding value. When a computation in charge of fulfilling a future delegates part of its processing to another task, mainstream languages return nested futures, and several "get" operations are needed to retrieve the computed value (we call such futures "control flow futures"). Several approaches were proposed to tackle this issues the "forward" construct, that allows the programmer to make delegation explicit and avoid nested futures, and "data flow explicit futures" which natively collapse nested futures into plain futures. This paper supports the claim that data flow explicit futures form a powerful set of language primitives, on top of which other approaches can be built. We prove the equivalence, in the context of data flow explicit futures, between the "forward" construct and classical "return" from functions. The proof relies on a branching bisimulation between a program using "forward" and its "return" counterpart. This result allows language designers to consider "forward" as an optimisation directive rather than as a language primitive. Following the principles of the Godot system, we provide a library implementation of control flow futures, based on data flow explicit futures implemented in the compiler. This small library supports the claim that the implementation of classical futures based on data flow ones is easier than the opposite. Our benchmarks show the viability of the approach from a performance point of view.


Electrochemical Modeling of Calendar Capacity Loss of Nickel Manganese Cobalt (NMC) Graphite Lithium Ion Batteries. Li ion batteries with nickel manganese cobalt (NMC) cathode and graphite anode are popularly used in portable electronic devices and electric vehicles. Calendar loss of the lithium ion battery is a dominating factor in battery degradation. However, few modeling work was reported on studying the calendar capacity loss of NMC graphite Li ion batteries. In this work, an electrochemical model for NMC graphite Li ion battery was developed to investigate its calendar loss behavior. Various factors affecting the calendar loss of the NMC graphite batteries were systematically investigated, with the results validated with experimental data of a Sanyo 18,650 cylindrical cell. It was found that at 25 o C working temperature and 100 SOC, the capacity drops 6.4 of its original capacity after 10 months. Also, when the anode particle size decreases from 26.2 mu m to 6.55 mu m, the capacity drop ratio is over 22 after 10 months under the same operation condition. Our simulation results demonstrate that a smaller SOC, a lower cell working temperature and a larger particle size could prolong the battery life during the storage period. This modeling work can help better understand the calendar loss behavior of NMC graphite Li ion batteries, and serve as a robust reference for the battery performance optimization in future.


Magnetic helicity, weak solutions and relaxation of ideal MHD. We revisit the issue of conservation of magnetic helicity and the Woltjer Taylor relaxation theory in magnetohydrodynamics in the context of weak solutions. We introduce a relaxed system for the ideal MHD system, which decouples the effects of hydrodynamic turbulence such as the appearance of a Reynolds stress term from the magnetic helicity conservation in a manner consistent with observations in plasma turbulence. As by products we answer two open questions in the field We show the sharpness of the L 3 integrability condition for magnetic helicity conservation and provide turbulent bounded solutions for MHD dissipating energy and cross helicity but with (arbitrary) constant magnetic helicity.


The Taylor resolution over a skew polynomial ring. Let Bbbk be a field and let I be a monomial ideal in the polynomial ring Q Bbbk x 1, ldots,x n . In her thesis, Taylor introduced a complex which provides a finite free resolution for Q I as a Q module. Later, Gemeda constructed a differential graded structure on the Taylor resolution. More recently, Avramov showed that this differential graded algebra admits divided powers. We generalize each of these results to monomial ideals in a skew polynomial ring R . Under the hypothesis that the skew commuting parameters defining R are roots of unity, we prove as an application that as I varies among all ideals generated by a fixed number of monomials of degree at least two in R , there is only a finite number of possibilities for the Poincar ' e series of Bbbk over R I and for the isomorphism classes of the homotopy Lie algebra of R I in cohomological degree larger or equal to two.


Homology and K theory of dynamical systems. II. Smale spaces with totally disconnected transversal. We apply our previous work on the relation between groupoid homology and K theory to Smale spaces. More precisely, we consider the unstable equivalence relation of a Smale space with totally disconnected stable sets, and prove that the associated spectral sequence shows Putnam's stable homology groups on the second sheet. Moreover, this homology is in fact isomorphic to the groupoid homology of unstable equivalence relation.


UPANets Learning from the Universal Pixel Attention Networks. Among image classification, skip and densely connection based networks have dominated most leaderboards. Recently, from the successful development of multi head attention in natural language processing, it is sure that now is a time of either using a Transformer like model or hybrid CNNs with attention. However, the former need a tremendous resource to train, and the latter is in the perfect balance in this direction. In this work, to make CNNs handle global and local information, we proposed UPANets, which equips channel wise attention with a hybrid skip densely connection structure. Also, the extreme connection structure makes UPANets robust with a smoother loss landscape. In experiments, UPANets surpassed most well known and widely used SOTAs with an accuracy of 96.47 in Cifar 10, 80.29 in Cifar 100, and 67.67 in Tiny Imagenet. Most importantly, these performances have high parameters efficiency and only trained in one customer based GPU. We share implementing code of UPANets in https github.com hanktseng131415go UPANets.


mu DARTS Model Uncertainty Aware Differentiable Architecture Search. We present a Model Uncertainty aware Differentiable ARchiTecture Search ( mu DARTS) that optimizes neural networks to simultaneously achieve high accuracy and low uncertainty. We introduce concrete dropout within DARTS cells and include a Monte Carlo regularizer within the training loss to optimize the concrete dropout probabilities. A predictive variance term is introduced in the validation loss to enable searching for architecture with minimal model uncertainty. The experiments on CIFAR10, CIFAR100, SVHN, and ImageNet verify the effectiveness of mu DARTS in improving accuracy and reducing uncertainty compared to existing DARTS methods. Moreover, the final architecture obtained from mu DARTS shows higher robustness to noise at the input image and model parameters compared to the architecture obtained from existing DARTS methods.


A Non Linear Structural Probe. Probes are models devised to investigate the encoding of knowledge e.g. syntactic structure in contextual representations. Probes are often designed for simplicity, which has led to restrictions on probe design that may not allow for the full exploitation of the structure of encoded information one such restriction is linearity. We examine the case of a structural probe (Hewitt and Manning, 2019), which aims to investigate the encoding of syntactic structure in contextual representations through learning only linear transformations. By observing that the structural probe learns a metric, we are able to kernelize it and develop a novel non linear variant with an identical number of parameters. We test on 6 languages and find that the radial basis function (RBF) kernel, in conjunction with regularization, achieves a statistically significant improvement over the baseline in all languages implying that at least part of the syntactic knowledge is encoded non linearly. We conclude by discussing how the RBF kernel resembles BERT's self attention layers and speculate that this resemblance leads to the RBF based probe's stronger performance.


On planar sampling with Gaussian kernel in spaces of bandlimited functions. Let I (a,b) times(c,d) subset mathbb R 2 be an index set and let G alpha (x) alpha in I be a collection of Gaussian functions, i.e. G alpha (x) exp( alpha 1 x 1 2 alpha 2 x 2 2) , where alpha ( alpha 1, alpha 2) in I, , x (x 1, x 2) in mathbb R 2 . We present a complete description of the uniformly discrete sets Lambda subset mathbb R 2 such that every bandlimited signal f admits a stable reconstruction from the samples f ast G alpha ( lambda) lambda in Lambda .


Coresets for (k, ell) Median Clustering under the Fr 'echet Distance. We present an algorithm for computing epsilon coresets for (k, ell) median clustering of polygonal curves in mathbb R d under the Fr 'echet distance. This type of clustering is an adaption of Euclidean k median clustering we are given a set of n polygonal curves in mathbb R d , each of complexity (number of vertices) at most m , and want to compute k median curves such that the sum of distances from the given curves to their closest median curve is minimal. Additionally, we restrict the complexity of the median curves to be at most ell each, to suppress overfitting, a problem specific for sequential data. Our algorithm has running time linear in n , sub quartic in m and quadratic in epsilon 1 . With high probability it returns epsilon coresets of size quadratic in epsilon 1 and logarithmic in n and m . We achieve this result by applying the improved epsilon coreset framework by Langberg and Feldman to a generalized k median problem over an arbitrary metric space. Later we combine this result with the recent result by Driemel et al. on the VC dimension of metric balls under the Fr 'echet distance. Furthermore, our framework yields epsilon coresets for any generalized k median problem where the range space induced by the open metric balls of the underlying space has bounded VC dimension, which is of independent interest. Finally, we show that our epsilon coresets can be used to improve the running time of an existing approximation algorithm for (1, ell) median clustering.


Spot Market versus Full Charter Fleet Decisions Support for Full Truck Load Tenders. This paper presents an approach to help business decision makers gain market share by providing competitive tender offers for Full Truck Load (FTL) services. In particular, we compare operating a fleet of Full Charter Trucks (FCT), using spot market (SM) capacity and a mixture of both options against each other. A Pickup and Delivery Problem is modeled, and solved using an Adaptive Large Neighborhood Search heuristic. Computational results indicate strong service benefits combining FCT and SM usage. Numerical experiments are presented in detail to support the findings. Additionally, a real life case study originating from DB Schenker is presented.


Evaluating the fairness of fine tuning strategies in self supervised learning. In this work we examine how fine tuning impacts the fairness of contrastive Self Supervised Learning (SSL) models. Our findings indicate that Batch Normalization (BN) statistics play a crucial role, and that updating only the BN statistics of a pre trained SSL backbone improves its downstream fairness (36 worst subgroup, 25 mean subgroup gap). This procedure is competitive with supervised learning, while taking 4.4x less time to train and requiring only 0.35 as many parameters to be updated. Finally, inspired by recent work in supervised learning, we find that updating BN statistics and training residual skip connections (12.3 of the parameters) achieves parity with a fully fine tuned model, while taking 1.33x less time to train.


Ideal Containment in Commutative Rings. Let R be a commutative ring with identity. An ideal I of R is said to be a big ideal (resp. an upper big ideal) if whenever J subsetneqq I (resp. I subsetneqq J ), J n subsetneqq I n (resp. I n subsetneqq J n ) for every n geq 1 and R itself is a big ideal ring provided that every ideal of R is a big ideal. In this paper we study the notions of big ideals, upper big ideals and big ideal rings in different contexts of commutative rings such us integrally closed domains, pullbacks and trivial ring extensions etc. We show that the notions of big and upper big ideals are completely different. The notion of big ideal is correlated to the notion of basic ideal and the notion of upper big ideal is correlated to the notion of mathcal C ideals. We give a new characterization of Pr "ufer domains via big ideal domains and we characterize some particular cases of pullback rings that are big ideal domains. Also we give some classes of big and upper big ideals in rings with zero divisors via trivial ring extensions.


A unified numerical approach for soft to hard magneto viscoelastically coupled polymers. The last decade has witnessed the emergence of magneto active polymers (MAPs) as one of the most advanced multi functional soft composites. Depending on the magnetisation mechanisms and responsive behaviour, MAPs are mainly classified into two groups i) hard magnetic MAPs in which a large residual magnetic flux density sustains even after the removal of the external magnetic field, and ii) soft magnetic MAPs where the magnetisation of the filler particles disappear upon the removal of the external magnetic field. Polymeric materials are widely treated as fully incompressible solids that require special numerical treatment to solve the associated boundary value problem. Furthermore, both soft and hard magnetic particles filled soft polymers are inherently viscoelastic. Therefore, the aim of this paper is to devise a unified finite element method based numerical framework for magneto mechanically coupled systems that can work for compressible and fully incompressible materials and from hard to soft MAPs, including the effects of the time dependent viscoelastic behaviour of the underlying matrix. First, variational formulations for the uncoupled problem for hard MAPs and the coupled problem for soft MAPs are derived. The weak forms are then discretised with higher order B 'ezier elements while the evolution equation for internal variables in viscoelastic models is solved using the generalised alpha time integration scheme, which is implicit and second order accurate. Finally, a series of experimentally driven boundary value problems consisting of the beam and robotic gripper models are solved in magneto mechanically coupled settings, demonstrating the versatility of the proposed numerical framework. The effect of viscoelastic material parameters on the response characteristics of MAPs under coupled magneto mechanical loading is also studied.


Higher Order MDS Codes. An improved Singleton type upper bound is presented for the list decoding radius of linear codes, in terms of the code parameters n,k,d and the list size L. L MDS codes are then defined as codes that attain this bound (under a slightly stronger notion of list decodability), with 1 MDS codes corresponding to ordinary linear MDS codes. Several properties of such codes are presented in particular, it is shown that the 2 MDS property is preserved under duality. Finally, explicit constructions for 2 MDS codes are presented through generalized Reed Solomon (GRS) codes.


A Polynomial Time Test to Detect Number with Many Exceptional Points. For each algebraic number alpha and each positive real number t , the t metric Mahler measure m t( alpha) creates an extremal problem whose solution varies depending on the value of t . The second author studied the points t at which the solution changes, called it exceptional points for alpha . Although each algebraic number has only finitely many exceptional points, it is conjectured that, for every N in mathbb N , there exists a number having at least N exceptional points. In this article, we describe a polynomial time algorithm for establishing the existence of numbers with at least N exceptional points. Our work constitutes an improvement over the best known existing algorithm which requires exponential time. We apply our main result to show that there exist numbers with at least 37 exceptional points, another improvement over previous work which was only able to reach 11 exceptional points.


Dive into Ambiguity Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition. Due to the subjective annotation and the inherent interclass similarity of facial expressions, one of key challenges in Facial Expression Recognition (FER) is the annotation ambiguity. In this paper, we proposes a solution, named DMUE, to address the problem of annotation ambiguity from two perspectives the latent Distribution Mining and the pairwise Uncertainty Estimation. For the former, an auxiliary multi branch learning framework is introduced to better mine and describe the latent distribution in the label space. For the latter, the pairwise relationship of semantic feature between instances are fully exploited to estimate the ambiguity extent in the instance space. The proposed method is independent to the backbone architectures, and brings no extra burden for inference. The experiments are conducted on the popular real world benchmarks and the synthetic noisy datasets. Either way, the proposed DMUE stably achieves leading performance.


Analytical impedance of oxygen transport in the channel and gas diffusion layer of a PEM fuel cell. Analytical model for impedance of oxygen transport in the gas diffusion layer (GDL) and cathode channel of a PEM fuel cell is developed. The model is based on transient oxygen mass conservation equations coupled to the proton current conservation equation in the catalyst layer. Analytical formula for the "GDL channel" impedance is derived assuming that the oxygen and proton transport in the cathode catalyst layer (CCL) are fast. In the Nyquist plot, the resulting impedance consists of two arcs describing oxygen transport in the air channel (low frequency arc) and in the GDL. The characteristic frequency of GDL arc depends on the CCL thickness large CCL thickness strongly lowers this frequency. At small CCL thickness, the high frequency feature on the arc shape forms. This effect is important for identification of peaks in distribution of relaxation times spectra of low Pt PEMFCs.


Protecting Privacy and Transforming COVID 19 Case Surveillance Datasets for Public Use. Objectives Federal open data initiatives that promote increased sharing of federally collected data are important for transparency, data quality, trust, and relationships with the public and state, tribal, local, and territorial (STLT) partners. These initiatives advance understanding of health conditions and diseases by providing data to more researchers, scientists, and policymakers for analysis, collaboration, and valuable use outside CDC responders. This is particularly true for emerging conditions such as COVID 19 where we have much to learn and have evolving data needs. Since the beginning of the outbreak, CDC has collected person level, de identified data from jurisdictions and currently has over 8 million records, increasing each day. This paper describes how CDC designed and produces two de identified public datasets from these collected data. Materials and Methods Data elements were included based on the usefulness, public request, and privacy implications specific field values were suppressed to reduce risk of reidentification and exposure of confidential information. Datasets were created and verified for privacy and confidentiality using data management platform analytic tools as well as R scripts. Results Unrestricted data are available to the public through Data.CDC.gov and restricted data, with additional fields, are available with a data use agreement through a private repository on GitHub.com. Practice Implications Enriched understanding of the available public data, the methods used to create these data, and the algorithms used to protect privacy of de identified individuals allow for improved data use. Automating data generation procedures allows greater and more timely sharing of data.


Power sum polynomials in a discrete tomography perspective. For a point of the projective space PG(n,q) , its R 'edei factor is the linear polynomial in n 1 variables, whose coefficients are the point coordinates. The power sum polynomial of a subset S of PG(n,q) is the sum of the (q 1) th powers of the R 'edei factors of the points of S . The fact that many subsets may share the same power sum polynomial offers a natural connection to discrete tomography. In this paper we deal with the two dimensional case and show that the notion of ghost, whose employment enables to find all solutions of the tomographic problem, can be rephrased in the finite geometry context, where subsets with null power sum polynomial are called ghosts as well. In the latter case, one can add ghosts still preserving the power sum polynomial by means of the multiset sum (modulo the field characteristic). We prove some general results on ghosts in PG(2,q) and compute their number in case q is a prime.


Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators. Heavily pre trained transformers for language modelling, such as BERT, have shown to be remarkably effective for Information Retrieval (IR) tasks, typically applied to re rank the results of a first stage retrieval model. IR benchmarks evaluate the effectiveness of retrieval pipelines based on the premise that a single query is used to instantiate the underlying information need. However, previous research has shown that (I) queries generated by users for a fixed information need are extremely variable and, in particular, (II) neural models are brittle and often make mistakes when tested with modified inputs. Motivated by those observations we aim to answer the following question how robust are retrieval pipelines with respect to different variations in queries that do not change the queries' semantics? In order to obtain queries that are representative of users' querying variability, we first created a taxonomy based on the manual annotation of transformations occurring in a dataset (UQV100) of user created query variations. For each syntax changing category of our taxonomy, we employed different automatic methods that when applied to a query generate a query variation. Our experimental results across two datasets for two IR tasks reveal that retrieval pipelines are not robust to these query variations, with effectiveness drops of approx20 on average. The code and datasets are available at https github.com Guzpenha query variation generators.


A Query Language for Summarizing and Analyzing Business Process Data. In modern enterprises, Business Processes (BPs) are realized over a mix of workflows, IT systems, Web services and direct collaborations of people. Accordingly, process data (i.e., BP execution data such as logs containing events, interaction messages and other process artifacts) is scattered across several systems and data sources, and increasingly show all typical properties of the Big Data. Understanding the execution of process data is challenging as key business insights remain hidden in the interactions among process entities most objects are interconnected, forming complex, heterogeneous but often semi structured networks. In the context of business processes, we consider the Big Data problem as a massive number of interconnected data islands from personal, shared and business data. We present a framework to model process data as graphs, i.e., Process Graph, and present abstractions to summarize the process graph and to discover concept hierarchies for entities based on both data objects and their interactions in process graphs. We present a language, namely BP SPARQL, for the explorative querying and understanding of process graphs from various user perspectives. We have implemented a scalable architecture for querying, exploration and analysis of process graphs. We report on experiments performed on both synthetic and real world datasets that show the viability and efficiency of the approach.


RST Parsing from Scratch. We introduce a novel top down end to end formulation of document level discourse parsing in the Rhetorical Structure Theory (RST) framework. In this formulation, we consider discourse parsing as a sequence of splitting decisions at token boundaries and use a seq2seq network to model the splitting decisions. Our framework facilitates discourse parsing from scratch without requiring discourse segmentation as a prerequisite rather, it yields segmentation as part of the parsing process. Our unified parsing model adopts a beam search to decode the best tree structure by searching through a space of high scoring trees. With extensive experiments on the standard English RST discourse treebank, we demonstrate that our parser outperforms existing methods by a good margin in both end to end parsing and parsing with gold segmentation. More importantly, it does so without using any handcrafted features, making it faster and easily adaptable to new languages and domains.


The Complexity of Learning Linear Temporal Formulas from Examples. In this paper we initiate the study of the computational complexity of learning linear temporal logic (LTL) formulas from examples. We construct approximation algorithms for fragments of LTL and prove hardness results in particular we obtain tight bounds for approximation of the fragment containing only the next operator and conjunctions, and prove NP completeness results for many fragments.


A Hurwitz divisor on the Moduli of Prym curves. For genus g 2i geq4 and the length g 1 partition mu (4,2, ldots,2, 2, ldots, 2) of 0, we compute the first coefficients of the class of overline D ( mu) in mathrm Pic mathbb Q ( overline mathcal R g) , where D( mu) is the divisor consisting of pairs C, eta in mathcal R g with eta cong mathcal O C(2x 1 x 2 cdots x i 1 x i cdots x 2i 1 ) for some points x 1, ldots, x 2i 1 on C . We further provide several enumerative results that will be used for this computation.


Music Circles Can Music Be Represented With Numbers?. The world today is experiencing an abundance of music like no other time, and attempts to group music into clusters have become increasingly prevalent. Common standards for grouping music were songs, artists, and genres, with artists or songs exploring similar genres of music seen as related. These clustering attempts serve critical purposes for various stakeholders involved in the music industry. For end users of music services, they may want to group their music so that they can easily navigate inside their music library for music streaming platforms like Spotify, companies may want to establish a solid dataset of related songs in order to successfully provide personalized music recommendations and coherent playlists to their users. Due to increased competition in the streaming market, platforms are trying their best to find novel ways of learning similarities between audio to gain competitive advantage. Our team, comprised of music lovers with different tastes, was interested in the same issue, and created Music Circles, an interactive visualization of music from the Billboard. Music Circles links audio feature data offered by Spotify to popular songs to create unique vectors for each song, and calculate similarities between these vectors to cluster them. Through interacting with Music Circles, users can gain understandings of audio features, view characteristic trends in popular music, and find out which music cluster they belong to.


Speaker and Time aware Joint Contextual Learning for Dialogue act Classification in Counselling Conversations. The onset of the COVID 19 pandemic has brought the mental health of people under risk. Social counselling has gained remarkable significance in this environment. Unlike general goal oriented dialogues, a conversation between a patient and a therapist is considerably implicit, though the objective of the conversation is quite apparent. In such a case, understanding the intent of the patient is imperative in providing effective counselling in therapy sessions, and the same applies to a dialogue system as well. In this work, we take forward a small but an important step in the development of an automated dialogue system for mental health counselling. We develop a novel dataset, named HOPE, to provide a platform for the dialogue act classification in counselling conversations. We identify the requirement of such conversation and propose twelve domain specific dialogue act (DAC) labels. We collect 12.9K utterances from publicly available counselling session videos on YouTube, extract their transcripts, clean, and annotate them with DAC labels. Further, we propose SPARTA, a transformer based architecture with a novel speaker and time aware contextual learning for the dialogue act classification. Our evaluation shows convincing performance over several baselines, achieving state of the art on HOPE. We also supplement our experiments with extensive empirical and qualitative analyses of SPARTA.


Existence and stability of smooth traveling circular pairs for the generalized surface quasi geostrophic equation. In this paper, we construct smooth travelling counter rotating vortex pairs with circular supports for the generalized surface quasi geostrophic equation. These vortex pairs are analogues of the Lamb dipoles for the two dimensional incompressible Euler equation. The solutions are obtained by maximization of the energy over some appropriate classes of admissible functions. We establish the uniqueness of maximizers and compactness of maximizing sequences in our variational setting. Using these facts, we further prove the orbital stability of the circular vortex pairs for the gSQG equation.


A Theory of Rectangularly Dualizable Graphs. A plane graph is called a rectangular graph if each of its edges can be oriented either horizontally or vertically, each of its interior regions is a four sided region and all interior regions can be fitted in a rectangular enclosure. Only planar graphs can be dualized. If the dual of a plane graph is a rectangular graph, then the plane graph is a rectangularly dualizable graph. In 1985, Ko 'zmi 'nski and Kinnen presented a necessary and sufficient condition for the existence of a rectangularly dualizable graph for a separable connected plane graph. In this paper, we present a counter example for which the conditions given by them for separable connected plane graphs fail and hence, we derive a necessary and sufficient condition for a plane graph to be a rectangularly dualizable graph.


Attention Flows are Shapley Value Explanations. Shapley Values, a solution to the credit assignment problem in cooperative game theory, are a popular type of explanation in machine learning, having been used to explain the importance of features, embeddings, and even neurons. In NLP, however, leave one out and attention based explanations still predominate. Can we draw a connection between these different methods? We formally prove that save for the degenerate case attention weights and leave one out values cannot be Shapley Values. textit Attention flow is a post processed variant of attention weights obtained by running the max flow algorithm on the attention graph. Perhaps surprisingly, we prove that attention flows are indeed Shapley Values, at least at the layerwise level. Given the many desirable theoretical qualities of Shapley Values which has driven their adoption among the ML community we argue that NLP practitioners should, when possible, adopt attention flow explanations alongside more traditional ones.


Scattering for the non radial focusing inhomogeneous nonlinear Schr "odinger Choquard equation. In this paper, we study the long time behavior of global solutions to the Schr "odinger Choquard equation i partial tu Delta u (I alpha ast cdot b u p ) cdot b u p 2 u. Inspired by Murphy, who gave a simple proof of scattering for the non radial inhomogeneous NLS, we prove scattering theory below the ground state for the intercritical case in energy space without radial assumption.


On critical dipoles in dimensions n geq 3 . We reconsider generalizations of Hardy's inequality corresponding to the case of (point) dipole potentials V gamma (x) gamma (u, x) x 3 , x in mathbb R n backslash 0 , gamma in 0, infty) , u in mathbb R n , u 1 , n in mathbb N , n geq 3 . More precisely, for n geq 3 , we provide an alternative proof of the existence of a critical dipole coupling constant gamma c,n 0 , such that begin align text for all gamma in 0, gamma c,n , and all u in mathbb R n , u 1 , quad int mathbb R n d n x , ( nabla f)(x) 2 geq pm gamma int mathbb R n d n x , (u, x) x 3 f(x) 2, quad f in D 1( mathbb R n). end align with D 1( mathbb R n) denoting the completion of C 0 infty ( mathbb R n) with respect to the norm induced by the gradient. Here gamma c,n is sharp, that is, the largest possible such constant, and we discuss a numerical scheme for its computation. Moreover, we discuss upper and lower bounds for gamma c,n 0 . We also consider the case of multicenter dipole interactions with dipoles centered on an infinite discrete set.


Vectorial adaptive optics. Adaptive optics normally concerns the feedback correction of phase aberrations. Such correction has been of benefit in various optical systems, with applications ranging in scale from astronomical telescopes to super resolution microscopes. Here we extend this powerful tool into the vectorial domain, encompassing higher dimensional feedback correction of both polarisation and phase. This technique is termed vectorial adaptive optics (V AO). We show that V AO can be implemented using sensor feedback, indirectly using sensorless AO, or in hybrid form combining aspects of both. We validate improvements in both vector field state and the focal quality of an optical system, through correction for commonplace vectorial aberration sources, ranging from objective lenses to biological samples. This technique pushes the boundaries of traditional scalar beam shaping by providing feedback control of extra vectorial degrees of freedom. This paves the way for next generation AO functionality by manipulating the complex vectorial field.


A Computational Study of Perspective Cuts. The benefits of cutting planes based on the perspective function are well known for many specific classes of mixed integer nonlinear programs with on off structures. However, we are not aware of any empirical studies that evaluate their applicability and computational impact over large, heterogeneous test sets in general purpose solvers. This paper provides a detailed computational study of perspective cuts within a linear programming based branch and cut solver for general mixed integer nonlinear programs. Within this study, we extend the applicability of perspective cuts from convex to nonconvex nonlinearities. This generalization is achieved by applying a perspective strengthening to valid linear inequalities which separate solutions of linear relaxations. The resulting method can be applied to any constraint where all variables appearing in nonlinear terms are semi continuous and depend on at least one common indicator variable. Our computational experiments show that adding perspective cuts for convex constraints yields a consistent improvement of performance, and adding perspective cuts for nonconvex constraints reduces branch and bound tree sizes and strengthens the root node relaxation, but has no significant impact on the overall mean time.


Invariant theory for the commuting scheme of symplectic Lie algebras. We prove the Chevalley restriction theorem for the commuting scheme of symplectic Lie algebras. The key step is the construction of the inverse map of the Chevalley restriction map called the spectral data map. Along the way, we establish a certain multiplicative property of the Pfaffian which is of independent interest.


Equation of state driven radiative models for simulation of lightning strikes. This work is concerned with the numerical simulation of plasma arc interaction with aerospace substrates under conditions akin to lightning strike and in particular with the accurate calculation of radiative heat losses. These are important because they have a direct effect on the calculation of thermal and pressure loads on the substrates, which can lead to material damage under certain conditions. Direct numerical solution of the radiation transport equation (RTE) in mesoscale simulations is not viable due to its computational cost, so for practical applications reduced models are usually employed. To this end, four approximations for solving the RTE are considered in this work, ranging from a simple local thermodynamical behaviour consideration, to a more complex spectral absorption dependent on the arc geometry. Their performance is initially tested on a one dimensional cylindrical arc, before implementing them in a multi dimensional magnetohydrodynamics code. Results indicate that inclusion of spectral absorption is necessary in order to obtain consistent results. However, the approaches accounting for the arc geometry require repeated solution of the computationally intensive Helmholtz equations, making them prohibitive for multi dimensional simulations. As an alternative, a method using the net emission coefficient is employed, which provides a balance between computational efficiency and accuracy, as shown by comparisons against experimental measurements for a plasma arc attaching to an aluminium substrate.


Reverse Engineering Variability in an Industrial Product Line Observations and Lessons Learned. Ideally, a variability model is a correct and complete representation of product line features and constraints among them. Together with a mapping between features and code, this ensures that only valid products can be configured and derived. However, in practice the modeled constraints might be neither complete nor correct, which causes problems in the configuration and product derivation phases. This paper presents an approach to reverse engineer variability constraints from the implementation, and thus improve the correctness and completeness of variability models. We extended the concept of feature effect analysis to extract variability constraints from code artifacts of the Bosch PS EC large scale product line. We present an industrial application of the approach and discuss its required modifications to handle non Boolean variability and heterogeneous artifact types.


Study on S2 Flow Path Design and Three dimensional Numerical Simulation Parameter Calibration in Axial Compressor. Aerodynamic design process of multi stage axial flow compressor usually uses the way that combines the S2 flow design and three dimensional CFD numerical simulation analysis. Based on Mr. Wu Zhonghua's " Three dimensional flow theory ", aiming at the S2 flow design matching parameters and the three dimensional CFD numerical simulation data, through autonomous programming, the S2 design parameter distribution and the corresponding CGNS format CFD calculation results are extracted. Then make the comparative analysis of the two and provide the modification suggestion of the design. The examples have been tested by the comparison and correction of the eight stage axial flow compressor calculation and finally improve the design performance of the compressor design. The design adiabatic efficiency increases by 0.5 . The surge margin increases by more than 5 . The validity and feasibility of the method are verified.


Transformer in Convolutional Neural Networks. We tackle the low efficiency flaw of vision transformer caused by the high computational space complexity in Multi Head Self Attention (MHSA). To this end, we propose the Hierarchical MHSA (H MHSA), whose representation is computed in a hierarchical manner. Specifically, our H MHSA first learns feature relationships within small grids by viewing image patches as tokens. Then, small grids are merged into larger ones, within which feature relationship is learned by viewing each small grid at the preceding step as a token. This process is iterated to gradually reduce the number of tokens. The H MHSA module is readily pluggable into any CNN architectures and amenable to training via backpropagation. We call this new backbone TransCNN, and it essentially inherits the advantages of both transformer and CNN. Experiments demonstrate that TransCNN achieves state of the art accuracy for image recognition. Code and pretrained models are available at https github.com yun liu TransCNN. This technical report will keep updating by adding more experiments.


Multivariate Vandermonde matrices with separated nodes on the unit circle are stable. We prove explicit lower bounds for the smallest singular value and upper bounds for the condition number of rectangular, multivariate Vandermonde matrices with scattered nodes on the complex unit circle. Analogously to the Shannon Nyquist criterion, the nodes are assumed to be separated by a constant divided by the used polynomial degree. If this constant grows linearly with the spatial dimension, the condition number is uniformly bounded. If it grows only logarithmically with the spatial dimension, the condition number grows slightly stronger than exponentially with the spatial dimension. Both results are quasi optimal and improve over all previously known results of such type.


Singularly perturbed reaction diffusion problems as first order systems. We consider a singularly perturbed reaction diffusion problem as a first order two by two system. Using piecewise discontinuous polynomials for the first component and H div conforming elements for the second component we provide a convergence analysis on layer adapted meshes and an optimal convergence order in a balanced norm that is comparable with a balanced H 2 norm for the second order formulation.


Standing on Shoulders or Feet? An Extended Study on the Usage of the MSR Data Papers. Context The establishment of the Mining Software Repositories (MSR) data showcase conference track has encouraged researchers to provide data sets as a basis for further empirical studies. Objective Examine the usage of data papers published in the MSR proceedings in terms of use frequency, users, and use purpose. Method Data track papers were collected from the MSR data showcase track and through the manual inspection of older MSR proceedings. The use of data papers was established through manual citation searching followed by reading the citing studies and dividing them into strong and weak citations. Contrary to weak, strong citations truly use the data set of a data paper. Data papers were then manually clustered based on their content, whereas their strong citations were classified by hand according to the knowledge areas of the Guide to the Software Engineering Body of Knowledge. A survey study on 108 authors and users of data papers provided further insights regarding motivation and effort in data paper production, encouraging and discouraging factors in data set use, and future desired direction regarding data papers. Results We found that 65 of the data papers have been used in other studies, with a long tail distribution in the number of strong citations. Weak citations to data papers usually refer to them as an example. MSR data papers are cited in total less than other MSR papers. A considerable number of the strong citations stem from the teams that authored the data papers. Publications providing Version Control System (VCS) primary and derived data are the most frequent data papers and the most often strongly cited ones. Enhanced developer data papers are the least common ones, and the second least frequently strongly cited. Data paper authors tend to gather data in the context of other research. ...


Video Text Pre training with Learned Regions. Video Text pre training aims at learning transferable representations from large scale video text pairs via aligning the semantics between visual and textual information. State of the art approaches extract visual features from raw pixels in an end to end fashion. However, these methods operate at frame level directly and thus overlook the spatio temporal structure of objects in video, which yet has a strong synergy with nouns in textual descriptions. In this work, we propose a simple yet effective module for video text representation learning, namely RegionLearner, which can take into account the structure of objects during pre training on large scale video text pairs. Given a video, our module (1) first quantizes visual features into semantic clusters, then (2) generates learnable masks and uses them to aggregate the features belonging to the same semantic region, and finally (3) models the interactions between different aggregated regions. In contrast to using off the shelf object detectors, our proposed module does not require explicit supervision and is much more computationally efficient. We pre train the proposed approach on the public WebVid2M and CC3M datasets. Extensive evaluations on four downstream video text retrieval benchmarks clearly demonstrate the effectiveness of our RegionLearner. The code will be available at https github.com ruiyan1995 Region Learner.