Fair Visual Recognition in Limited Data Regime using Self Supervision and Self Distillation. Deep learning models generally learn the biases present in the training data. Researchers have proposed several approaches to mitigate such biases and make the model fair. Bias mitigation techniques assume that a sufficiently large number of training examples are present. However, we observe that if the training data is limited, then the effectiveness of bias mitigation methods is severely degraded. In this paper, we propose a novel approach to address this problem. Specifically, we adapt self supervision and self distillation to reduce the impact of biases on the model in this setting. Self supervision and self distillation are not used for bias mitigation. However, through this work, we demonstrate for the first time that these techniques are very effective in bias mitigation. We empirically show that our approach can significantly reduce the biases learned by the model. Further, we experimentally demonstrate that our approach is complementary to other bias mitigation strategies. Our approach significantly improves their performance and further reduces the model biases in the limited data regime. Specifically, on the L CIFAR 10S skewed dataset, our approach significantly reduces the bias score of the baseline model by 78.22 and outperforms it in terms of accuracy by a significant absolute margin of 8.89 . It also significantly reduces the bias score for the state of the art domain independent bias mitigation method by 59.26 and improves its performance by a significant absolute margin of 7.08 .


Foliations by curves on threefolds. We study the conormal sheaves and singular schemes of 1 dimensional foliations on smooth projective varieties X of dimension 3 and Picard rank 1. We prove that if the singular scheme has dimension 0, then the conormal sheaf is mu stable whenever the tangent bundle TX is stable, and apply this fact to the characterization of certain irreducible components of the moduli space of rank 2 reflexive sheaves on mathbb P 3 and on a smooth quadric hypersurface Q 3 subset mathbb P 4 . Finally, we give a classification of local complete intersection foliations, that is, foliations with locally free conormal sheaves, of degree 0 and 1 on Q 3 .


Restoring Hebrew Diacritics Without a Dictionary. We demonstrate that it is feasible to diacritize Hebrew script without any human curated resources other than plain diacritized text. We present NAKDIMON, a two layer character level LSTM, that performs on par with much more complicated curation dependent systems, across a diverse array of modern Hebrew sources.


On real analytic Levi flat hypersurfaces and holomorphic webs. We investigate holomorphic webs tangent to real analytic Levi flat hypersurfaces on compact complex surfaces. Under certain conditions, we prove that a holomorphic web tangent to a real analytic Levi flat hypersurface admits a multiple valued meromorphic first integral. We also prove that the Levi foliation of a Levi flat hypersurface induced by an irreducible real analytic curve in the Grassmannian G(n 1,n) extends to an algebraic web on the complex projective space.


On the logarithmic coarse structures of Lie groups and hyperbolic spaces. We characterize the Lie groups with finitely many connected components that are O(u) bilipschitz equivalent (almost quasiisometric in the sense that the sublinear function u replaces the additive bounds of quasiisometry) to the real hyperbolic space, or to the complex hyperbolic plane. The characterizations are expressed in terms of deformations of Lie algebras and in terms of pinching of sectional curvature of left invariant Riemannian metrics in the real case. We also compare sublinear bilipschitz equivalence and coarse equivalence, and prove that every coarse equivalence between the logarithmic coarse structures of geodesic spaces is a O( log) bilipschitz equivalence. The Lie groups characterized are exactly those whose logarithmic coarse structure is equivalent to that of a real hyperbolic space or the complex hyperbolic plane. Finally we point out that a conjecture made by Tyson about the conformal dimensions of the boundaries of certain hyperbolic buildings holds conditionally to the four exponentials conjecture.


Road Extraction from Overhead Images with Graph Neural Networks. Automatic road graph extraction from aerial and satellite images is a long standing challenge. Existing algorithms are either based on pixel level segmentation followed by vectorization, or on iterative graph construction using next move prediction. Both of these strategies suffer from severe drawbacks, in particular high computing resources and incomplete outputs. By contrast, we propose a method that directly infers the final road graph in a single pass. The key idea consists in combining a Fully Convolutional Network in charge of locating points of interest such as intersections, dead ends and turns, and a Graph Neural Network which predicts links between these points. Such a strategy is more efficient than iterative methods and allows us to streamline the training process by removing the need for generation of starting locations while keeping the training end to end. We evaluate our method against existing works on the popular RoadTracer dataset and achieve competitive results. We also benchmark the speed of our method and show that it outperforms existing approaches. This opens the possibility of in flight processing on embedded devices.


A Survey of Large Scale Deep Learning Serving System Optimization Challenges and Opportunities. Deep Learning (DL) models have achieved superior performance in many application domains, including vision, language, medical, commercial ads, entertainment, etc. With the fast development, both DL applications and the underlying serving hardware have demonstrated strong scaling trends, i.e., Model Scaling and Compute Scaling, for example, the recent pre trained model with hundreds of billions of parameters with TB level memory consumption, as well as the newest GPU accelerators providing hundreds of TFLOPS. With both scaling trends, new problems and challenges emerge in DL inference serving systems, which gradually trends towards Large scale Deep learning Serving systems (LDS). This survey aims to summarize and categorize the emerging challenges and optimization opportunities for large scale deep learning serving systems. By providing a novel taxonomy, summarizing the computing paradigms, and elaborating the recent technique advances, we hope that this survey could shed light on new optimization perspectives and motivate novel works in large scale deep learning system optimization.


Large scale focusing joint inversion of gravity and magnetic data with Gramian constraint. A fast algorithm for the large scale joint inversion of gravity and magnetic data is developed. It uses a nonlinear Gramian constraint to impose correlation between density and susceptibility of reconstructed models. The global objective function is formulated in the space of the weighted parameters, but the Gramian constraint is implemented in the original space, and the nonlinear constraint is imposed using two separate Lagrange parameters, one for each model domain. This combined approach provides more similarity between the reconstructed models. It is assumed that the measured data are obtained on a uniform grid and that a consistent regular discretization of the volume domain is imposed. The sensitivity matrices exhibit a block Toeplitz Toeplitz block structure for each depth layer of the model domain. Forward and transpose operations with the matrices can be implemented efficiently using two dimensional fast Fourier transforms. This makes it feasible to solve for large scale problems with respect to both computational costs and memory demands, and to solve the nonlinear problem by applying iterative methods that rely only on matrix vector multiplications. As such, the use of the regularized reweighted conjugate gradient algorithm, in conjunction with the structure of the sensitivity matrices, leads to a fast methodology for large scale joint inversion of geophysical data sets. Numerical simulations demonstrate that it is possible to apply a nonlinear joint inversion algorithm, with L p norm stabilisers, for the reconstruction of large model domains on a standard laptop computer. It is demonstrated, that the p 1 choice provides sparse reconstructed solutions with sharp boundaries, and p 2 provides smooth and blurred models. Gravity and magnetic data obtained over an area in northwest of Mesoproterozoic St. Francois Terrane, southeast of Missouri, USA are inverted.


Evolving Open Complexity. Information theoretic analysis of large evolved programs produced by running genetic programming for up to a million generations has shown even functions as smooth and well behaved as floating point addition and multiplication loose entropy and consequently are robust and fail to propagate disruption to their outputs. This means, while dependent upon fitness tests, many genetic changes deep within trees are silent. For evolution to proceed at reasonable rate it must be possible to measure the impact of most code changes, yet in large trees most crossover sites are distant from the root node. We suggest to evolve very large very complex programs, it will be necessary to adopt an open architecture where most mutation sites are within 10 to 100 levels of the organism's environment.


The Bochner Riesz problem an old approach revisited. We show that the recent techniques developed to study the Fourier restriction problem apply equally well to the Bochner Riesz problem. This is achieved via applying a pseudo conformal transformation and a two parameter induction on scales argument. As a consequence, we improve the Bochner Riesz problem to the best known range of the Fourier restriction problem in all high dimensions.


Propagation of Chaos for the Cucker Smale Systems under heavy tail communication. In this work we study propagation of chaos for solutions of the Liouville equation for the classical discrete Cucker Smale system. Assuming that the communication kernel satisfies the heavy tail condition known to be necessary to induce exponential alignment we obtain a linear in time convergence rate of the k th marginals f (k) to the product of k solutions of the corresponding Vlasov Alignment equation, f otimes k . Specifically, the following estimate holds in terms of Wasserstein 2 metric begin equation label e abst mathcal W 2(f (k) t,f otimes k t) leq C k 1 2 min left 1, frac t sqrt N right . end equation For systems with the Rayleigh type friction and self propulsion force, we obtain a similar result for sectorial solutions. Such solutions are known to align exponentially fast via the method of Grassmannian reduction, cite LRS friction . We recast the method in the kinetic settings and show that the bound eqref e abst persists but with the quadratic dependence on time. In both the forceless and forced cases, the result represents an improvement over the exponential bounds established earlier in the work of Natalini and Paul, cite NP2021 orig , although those bounds hold for general kernels. The main message of our work is that flocking dynamics improves the rate considerably.


Fully Unleashing the Power of Paying Multiplexing Only Once in Stochastic Network Calculus. The stochastic network calculus (SNC) holds promise as a versatile and uniform framework to calculate probabilistic performance bounds in networks of queues. A great challenge to accurate bounds and efficient calculations are stochastic dependencies between flows due to resource sharing inside the network. However, by carefully utilizing the basic SNC concepts in the network analysis the necessity of taking these dependencies into account can be minimized. To that end, we fully unleash the power of the pay multiplexing only once principle (PMOO, known from the deterministic network calculus) in the SNC analysis. We choose an analytic combinatorics presentation of the results in order to ease complex calculations. In tree reducible networks, a subclass of general feedforward networks, we obtain a perfect analysis in terms of avoiding the need to take internal flow dependencies into account. In a comprehensive numerical evaluation, we demonstrate how this unleashed PMOO analysis can reduce the known gap between simulations and SNC calculations significantly, and how it favourably compares to state of the art SNC calculations in terms of accuracy and computational effort. Motivated by these promising results, we also consider general feedforward networks, when some flow dependencies have to be taken into account. To that end, the unleashed PMOO analysis is extended to the partially dependent case and a case study of a canonical example topology, known as the diamond network, is provided, again displaying favourable results over the state of the art.


Efficient algorithms for collecting the statistics of large scale IP address data. Compiling the statistics of large scale IP address data is an essential task in network traffic measurement. The statistical results are used to evaluate the potential impact of user behaviors on network traffic. This requires algorithms that are capable of storing and retrieving a high volume of IP addresses within time and memory constraints. In this paper, we present two efficient algorithms for collecting the statistics of large scale IP addresses that balance time efficiency and memory consumption. The proposed solutions take into account the sparse nature of the statistics of IP addresses while building the hash function and maintain a dynamic balance among layered memory blocks. There are two layers in the first proposed method, each of which contains a limited number of memory blocks. Each memory block contains 256 elements of size 256 times 8 bytes for a 64 bit system. In contrast to built in hash mapping functions, the proposed solution completely avoids expensive hash collisions while retaining the linear time complexity of hash based solutions. Moreover, the mechanism dynamically determines the hash index length according to the range of IP addresses, and can balance the time and memory constraints. In addition, we propose an efficient parallel scheme to speed up the collection of statistics. The experimental results on several synthetic datasets show that the proposed method substantially outperforms the baselines with respect to time and memory space efficiency.


Classification of PS and ABS Black Plastics for WEEE Recycling Applications. Pollution and climate change are some of the biggest challenges that humanity is facing. In such a context, efficient recycling is a crucial tool for a sustainable future. This work is aimed at creating a system that can classify different types of plastics by using picture analysis, in particular, black plastics of the type Polystyrene (PS) and Acrylonitrile Butadiene Styrene (ABS). They are two common plastics from Waste from Electrical and Electronic Equipment (WEEE). For this purpose, a Convolutional Neural Network has been tested and retrained, obtaining a validation accuracy of 95 . Using a separate test set, average accuracy goes down to 86.6 , but a further look at the results shows that the ABS type is correctly classified 100 of the time, so it is the PS type that accumulates all the errors. Overall, this demonstrates the feasibility of classifying black plastics using CNN machine learning techniques. It is believed that if a more diverse and extensive image dataset becomes available, a system with higher reliability that generalizes well could be developed using the proposed methodology.


An IoT Based Framework for Remote Fall Monitoring. Fall detection is a serious healthcare issue that needs to be solved. Falling without quick medical intervention would lower the chances of survival for the elderly, especially if living alone. Hence, the need is there for developing fall detection algorithms with high accuracy. This paper presents a novel IoT based system for fall detection that includes a sensing device transmitting data to a mobile application through a cloud connected gateway device. Then, the focus is shifted to the algorithmic aspect where multiple features are extracted from 3 axis accelerometer data taken from existing datasets. The results emphasize on the significance of Continuous Wavelet Transform (CWT) as an influential feature for determining falls. CWT, Signal Energy (SE), Signal Magnitude Area (SMA), and Signal Vector Magnitude (SVM) features have shown promising classification results using K Nearest Neighbors (KNN) and E Nearest Neighbors (ENN). For all performance metrics (accuracy, recall, precision, specificity, and F1 Score), the achieved results are higher than 95 for a dataset of small size, while more than 98.47 score is achieved in the aforementioned criteria over the UniMiB SHAR dataset by the same algorithms, where the classification time for a single test record is extremely efficient and is real time


Introduction to Quantum Reinforcement Learning Theory and PennyLane based Implementation. The emergence of quantum computing enables for researchers to apply quantum circuit on many existing studies. Utilizing quantum circuit and quantum differential programming, many research are conducted such as textit Quantum Machine Learning (QML). In particular, quantum reinforcement learning is a good field to test the possibility of quantum machine learning, and a lot of research is being done. This work will introduce the concept of quantum reinforcement learning using a variational quantum circuit, and confirm its possibility through implementation and experimentation. We will first present the background knowledge and working principle of quantum reinforcement learning, and then guide the implementation method using the PennyLane library. We will also discuss the power and possibility of quantum reinforcement learning from the experimental results obtained through this work.


Adaptive Multigrid Strategy for Large scale Molecular Mechanics Optimization. In this paper, we present an efficient adaptive multigrid strategy for large scale molecular mechanics optimization. The oneway multigrid method is used with inexact approximations, such as the quasi atomistic (QA) approximation or the blended ghost force correction (BGFC) approximation on each coarse level, combined with adaptive mesh refinements based on the gradient based a posteriori error estimator. For crystalline defects, like vacancies, micro crack and dislocation, sublinear complexity is observed numerically when the adaptive BGFC method is employed. For systems with more than ten millions atoms, this strategy has a fivefold acceleration in terms of CPU time.


Data Processing Matters SRPH Konvergen AI's Machine Translation System for WMT'21. In this paper, we describe the submission of the joint Samsung Research Philippines Konvergen AI team for the WMT'21 Large Scale Multilingual Translation Task Small Track 2. We submit a standard Seq2Seq Transformer model to the shared task without any training or architecture tricks, relying mainly on the strength of our data preprocessing techniques to boost performance. Our final submission model scored 22.92 average BLEU on the FLORES 101 devtest set, and scored 22.97 average BLEU on the contest's hidden test set, ranking us sixth overall. Despite using only a standard Transformer, our model ranked first in Indonesian to Javanese, showing that data preprocessing matters equally, if not more, than cutting edge model architectures and training techniques.


From Modular Decomposition Trees to Rooted Median Graphs. The modular decomposition of a symmetric map delta colon X times X to Upsilon (or, equivalently, a set of symmetric binary relations, a 2 structure, or an edge colored undirected graph) is a natural construction to capture key features of delta in labeled trees. A map delta is explained by a vertex labeled rooted tree (T,t) if the label delta(x,y) coincides with the label of the last common ancestor of x and y in T , i.e., if delta(x,y) t( mathrm lca (x,y)) . Only maps whose modular decomposition does not contain prime nodes, i.e., the symbolic ultrametrics, can be exaplained in this manner. Here we consider rooted median graphs as a generalization to (modular decomposition) trees to explain symmetric maps. We first show that every symmetric map can be explained by "extended" hypercubes and half grids. We then derive a a linear time algorithm that stepwisely resolves prime vertices in the modular decomposition tree to obtain a rooted and labeled median graph that explains a given symmetric map delta . We argue that the resulting "tree like" median graphs may be of use in phylogenetics as a model of evolutionary relationships.


Sparse shot Learning with Exclusive Cross Entropy for Extremely Many Localisations. Object localisation, in the context of regular images, often depicts objects like people or cars. In these images, there is typically a relatively small number of objects per class, which usually is manageable to annotate. However, outside the setting of regular images, we are often confronted with a different situation. In computational pathology, digitised tissue sections are extremely large images, whose dimensions quickly exceed 250'000x250'000 pixels, where relevant objects, such as tumour cells or lymphocytes can quickly number in the millions. Annotating them all is practically impossible and annotating sparsely a few, out of many more, is the only possibility. Unfortunately, learning from sparse annotations, or sparse shot learning, clashes with standard supervised learning because what is not annotated is treated as a negative. However, assigning negative labels to what are true positives leads to confusion in the gradients and biased learning. To this end, we present exclusive cross entropy, which slows down the biased learning by examining the second order loss derivatives in order to drop the loss terms corresponding to likely biased terms. Experiments on nine datasets and two different localisation tasks, detection with YOLLO and segmentation with Unet, show that we obtain considerable improvements compared to cross entropy or focal loss, while often reaching the best possible performance for the model with only 10 40 of annotations.


Random Simple Homotopy Theory. We implement an algorithm RSHT (Random Simple Homotopy) to study the simple homotopy types of simplicial complexes, with a particular focus on contractible spaces and on finding substructures in higher dimensional complexes. The algorithm combines elementary simplicial collapses with pure elementary expansions. For triangulated d manifolds with d 7, we show that RSHT reduces to (random) bistellar flips. Among the many examples on which we test RSHT, we describe an explicit 15 vertex triangulation of the Abalone, and more generally, (14k 1) vertex triangulations of Bing's houses with k rooms, which all can be deformed to a point using only six pure elementary expansions.


N Omniglot a Large scale Neuromorphic Dataset for Spatio Temporal Sparse Few shot Learning. Few shot learning (learning with a few samples) is one of the most important capacities of the human brain. However, the current artificial intelligence systems meet difficulties in achieving this ability, so as the biologically plausible spiking neural networks (SNNs). Datasets for traditional few shot learning domains provide few amounts of temporal information. And the absence of the neuromorphic datasets has hindered the development of few shot learning for SNNs. Here, we provide the first neuromorphic dataset N Omniglot, using the Dynamic Vision Sensor (DVS). It contains 1623 categories of handwritten characters, with only 20 samples per class. N Omniglot eliminates the need for a neuromorphic dataset for SNNs with high spareness and tremendous temporal coherence. Additionally, the dataset provides a powerful challenge and a suitable benchmark for developing SNNs algorithm in the few shot learning domain due to the chronological information of strokes. We also provide the improved nearest neighbor, convolutional network, SiameseNet, and meta learning algorithm in spiking version for verification.


A note concerning the invertibility of certain alternant matrices. This brief note concerns the invertibility of certain alternant matrices. In particular those that consisting of polynomials and products of polynomials and logarithms are shown to be invertible under appropriate conditions on the degrees of the polynomials.


Style Normalization and Restitution for Domain Generalization and Adaptation. For many practical computer vision applications, the learned models usually have high performance on the datasets used for training but suffer from significant performance degradation when deployed in new environments, where there are usually style differences between the training images and the testing images. An effective domain generalizable model is expected to be able to learn feature representations that are both generalizable and discriminative. In this paper, we design a novel Style Normalization and Restitution module (SNR) to simultaneously ensure both high generalization and discrimination capability of the networks. In the SNR module, particularly, we filter out the style variations (e.g, illumination, color contrast) by performing Instance Normalization (IN) to obtain style normalized features, where the discrepancy among different samples and domains is reduced. However, such a process is task ignorant and inevitably removes some task relevant discriminative information, which could hurt the performance. To remedy this, we propose to distill task relevant discriminative features from the residual (i.e, the difference between the original feature and the style normalized feature) and add them back to the network to ensure high discrimination. Moreover, for better disentanglement, we enforce a dual causality loss constraint in the restitution step to encourage the better separation of task relevant and task irrelevant features. We validate the effectiveness of our SNR on different computer vision tasks, including classification, semantic segmentation, and object detection. Experiments demonstrate that our SNR module is capable of improving the performance of networks for domain generalization (DG) and unsupervised domain adaptation (UDA) on many tasks. Code are available at https github.com microsoft SNR.


Online Sign Identification Minimization of the Number of Errors in Thresholding Bandits. In the fixed budget thresholding bandit problem, an algorithm sequentially allocates a budgeted number of samples to different distributions. It then predicts whether the mean of each distribution is larger or lower than a given threshold. We introduce a large family of algorithms (containing most existing relevant ones), inspired by the Frank Wolfe algorithm, and provide a thorough yet generic analysis of their performance. This allowed us to construct new explicit algorithms, for a broad class of problems, whose losses are within a small constant factor of the non adaptive oracle ones. Quite interestingly, we observed that adaptive methods empirically greatly out perform non adaptive oracles, an uncommon behavior in standard online learning settings, such as regret minimization. We explain this surprising phenomenon on an insightful toy problem.


Understanding the Representation and Representativeness of Age in AI Data Sets. A diverse representation of different demographic groups in AI training data sets is important in ensuring that the models will work for a large range of users. To this end, recent efforts in AI fairness and inclusion have advocated for creating AI data sets that are well balanced across race, gender, socioeconomic status, and disability status. In this paper, we contribute to this line of work by focusing on the representation of age by asking whether older adults are represented proportionally to the population at large in AI data sets. We examine publicly available information about 92 face data sets to understand how they codify age as a case study to investigate how the subjects' ages are recorded and whether older generations are represented. We find that older adults are very under represented five data sets in the study that explicitly documented the closed age intervals of their subjects included older adults (defined as older than 65 years), while only one included oldest old adults (defined as older than 85 years). Additionally, we find that only 24 of the data sets include any age related information in their documentation or metadata, and that there is no consistent method followed across these data sets to collect and record the subjects' ages. We recognize the unique difficulties in creating representative data sets in terms of age, but raise it as an important dimension that researchers and engineers interested in inclusive AI should consider.


High carbon stock mapping at large scale with optical satellite imagery and spaceborne LIDAR. The increasing demand for commodities is leading to changes in land use worldwide. In the tropics, deforestation, which causes high carbon emissions and threatens biodiversity, is often linked to agricultural expansion. While the need for deforestation free global supply chains is widely recognized, making progress in practice remains a challenge. Here, we propose an automated approach that aims to support conservation and sustainable land use planning decisions by mapping tropical landscapes at large scale and high spatial resolution following the High Carbon Stock (HCS) approach. A deep learning approach is developed that estimates canopy height for each 10 m Sentinel 2 pixel by learning from sparse GEDI LIDAR reference data, achieving an overall RMSE of 6.3 m. We show that these wall to wall maps of canopy top height are predictive for classifying HCS forests and degraded areas with an overall accuracy of 86 and produce a first high carbon stock map for Indonesia, Malaysia, and the Philippines.


On link of Lipschitz normally embedded sets. A path connected subanalytic subset in mathbb R n is naturally equipped with two metrics the inner and the outer metrics. We say that a subset is Lipschitz normally embedded (LNE) if these two metrics are equivalent. In this article, we give some criteria for a subanalytic set to be LNE. It is a fundamental question to know if the LNE property is a conical property, i.e., if it is possible to describe the LNE property of a germ of a subanalytic set in terms of properties of its link. We answer this question, introducing a new notion called link Lipschitz normally embedding. We prove that this notion is equivalent to the LNE notion in the case of sets with connected links. Some examples and applications of this result are also presented. For example, we characterize the real Brieskorn's surfaces which are LNE and we give conditions for a given set to be (or not) LNE in terms of its sections.


Accuracy and precision a new view on kinematic assessment of solid state hinges and compliant mechanisms. Compliant mechanisms are alternatives to conventional mechanisms which exploit elastic strain to produce desired deformations instead of using moveable parts. They are designed for a kinematic task (providing desired deformations) but do not possess a kinematics in the strict sense. This leads to difficulties while assessing the quality of a compliant mechanism's design. The kinematics of a compliant mechanism can be seen as a fuzzy property. There is no unique kinematics, since every deformation need a particular force system to act however, certain deformations are easier to obtain than others. A parallel can be made with measurement theory the measured value of a quantity is not unique, but exists as statistic distribution of measures. A representative measure of this distribution can be chosen to evaluate how far the measures divert from a reference value. Based on this analogy, the concept of accuracy and precision of compliant systems are introduced and discussed in this paper. A quantitative determination of these qualities based on the eigenvalue analysis of the hinge's stiffness is proposed. This new approach is capable of removing most of the ambiguities included in the state of the art assessment criteria (usually based on the concepts of path deviation and parasitic motion).


Seed Classification using Synthetic Image Datasets Generated from Low Altitude UAV Imagery. Plant breeding programs extensively monitor the evolution of seed kernels for seed certification, wherein lies the need to appropriately label the seed kernels by type and quality. However, the breeding environments are large where the monitoring of seed kernels can be challenging due to the minuscule size of seed kernels. The use of unmanned aerial vehicles aids in seed monitoring and labeling since they can capture images at low altitudes whilst being able to access even the remotest areas in the environment. A key bottleneck in the labeling of seeds using UAV imagery is drone altitude i.e. the classification accuracy decreases as the altitude increases due to lower image detail. Convolutional neural networks are a great tool for multi class image classification when there is a training dataset that closely represents the different scenarios that the network might encounter during evaluation. The article addresses the challenge of training data creation using Domain Randomization wherein synthetic image datasets are generated from a meager sample of seeds captured by the bottom camera of an autonomously driven Parrot AR Drone 2.0. Besides, the article proposes a seed classification framework as a proof of concept using the convolutional neural networks of Microsoft's ResNet 100, Oxford's VGG 16, and VGG 19. To enhance the classification accuracy of the framework, an ensemble model is developed resulting in an overall accuracy of 94.6 .


Detecting model drift using polynomial relations. Machine learning models serve critical functions, such as classifying loan applicants as good or bad risks. Each model is trained under the assumption that the data used in training and in the field come from the same underlying unknown distribution. Often, this assumption is broken in practice. It is desirable to identify when this occurs, to minimize the impact on model performance. We suggest a new approach to detecting change in the data distribution by identifying polynomial relations between the data features. We measure the strength of each identified relation using its R square value. A strong polynomial relation captures a significant trait of the data which should remain stable if the data distribution does not change. We thus use a set of learned strong polynomial relations to identify drift. For a set of polynomial relations that are stronger than a given threshold, we calculate the amount of drift observed for that relation. The amount of drift is measured by calculating the Bayes Factor for the polynomial relation likelihood of the baseline data versus field data. We empirically validate the approach by simulating a range of changes, and identify drift using the Bayes Factor of the polynomial relation likelihood change.


Automatic Curricula via Expert Demonstrations. We propose Automatic Curricula via Expert Demonstrations (ACED), a reinforcement learning (RL) approach that combines the ideas of imitation learning and curriculum learning in order to solve challenging robotic manipulation tasks with sparse reward functions. Curriculum learning solves complicated RL tasks by introducing a sequence of auxiliary tasks with increasing difficulty, yet how to automatically design effective and generalizable curricula remains a challenging research problem. ACED extracts curricula from a small amount of expert demonstration trajectories by dividing demonstrations into sections and initializing training episodes to states sampled from different sections of demonstrations. Through moving the reset states from the end to the beginning of demonstrations as the learning agent improves its performance, ACED not only learns challenging manipulation tasks with unseen initializations and goals, but also discovers novel solutions that are distinct from the demonstrations. In addition, ACED can be naturally combined with other imitation learning methods to utilize expert demonstrations in a more efficient manner, and we show that a combination of ACED with behavior cloning allows pick and place tasks to be learned with as few as 1 demonstration and block stacking tasks to be learned with 20 demonstrations.


Simultaneous microscopic imaging of thickness and refractive index of thin layers by heterodyne interferometric reflectometry (HiRef). The detection of spatial or temporal variations in very thin samples has important applications in the biological sciences. For example, cellular membranes exhibit changes in lipid composition and order, which in turn modulate their function in space and time. Simultaneous measurement of thickness and refractive index would be one way to observe these variations, yet doing it noninvasively remains an elusive goal. Here we present a microscopic imaging technique to simultaneously measure the thickness and refractive index of thin layers in a spatially resolved manner using reflectometry. The heterodyne detected interference between a light field reflected by the sample and a reference field allows measurement of the amplitude and phase of the reflected field and thus determination of the complex reflection coefficient. Comparing the results with the simulated reflection of a thin layer under coherent illumination of high numerical aperture by the microscope objective, the refractive index and thickness of the layer can be determined. We present results on a layer of polyvinylacetate (PVA) with a thickness of approximately 80 nm. These results have a precision better than 10 in the thickness and better than 1 in the refractive index and are consistent within error with measurements by quantitative differential interference contrast (qDIC) and literature values. We discuss the significance of these results, and the possibility of performing accurate measurements on nanometric layers. Notably, the shot noise limit of the technique is below 0.5 nm in thickness and 0.0005 in refractive index for millisecond measurement times.


Sharp double inequality for complete elliptic integral of the first kind. For r in(0,1) , the function K(r) int 0 pi 2 (1 r 2 sin 2t) 1 2 dt is known as the complete elliptic integral of the first kind. In this paper, we prove the absolute monotonicity of two functions involving K(r) . As a consequence, we improve Alzer and Richards' result.


Boosting Co teaching with Compression Regularization for Label Noise. In this paper, we study the problem of learning image classification models in the presence of label noise. We revisit a simple compression regularization named Nested Dropout. We find that Nested Dropout, though originally proposed to perform fast information retrieval and adaptive data compression, can properly regularize a neural network to combat label noise. Moreover, owing to its simplicity, it can be easily combined with Co teaching to further boost the performance. Our final model remains simple yet effective it achieves comparable or even better performance than the state of the art approaches on two real world datasets with label noise which are Clothing1M and ANIMAL 10N. On Clothing1M, our approach obtains 74.9 accuracy which is slightly better than that of DivideMix. On ANIMAL 10N, we achieve 84.1 accuracy while the best public result by PLC is 83.4 . We hope that our simple approach can be served as a strong baseline for learning with label noise. Our implementation is available at https github.com yingyichen cyy Nested Co teaching.


A multilayer network model of Covid 19 implications in public health policy in Costa Rica. Successful partnerships between researchers, experts and public health authorities has been critical to navigate the challenges of the Covid 19 pandemic worldwide. In Costa Rica, we constructed a multilayer network model that incorporates a diverse contact structure for each individual (node). The different layers which constitute the individual's contact structure include family, friends, and sporadic interactions. Different scenarios were constructed to forecast and have a better understanding of the possible routes of the pandemic in the country, given the information that was available at the time and the different measures implemented by the health authorities of the country. Strong collaboration within our diverse team allowed using the model to tailor advice on contingency measures to health authorities. The model helped develop informed strategies to prepare the public health system in Costa Rica. The development, evolution and applications of a multilayer network model of Covid 19 in the adoption of sanitary measures in Costa Rica has been an example of the potential of such partnerships.


Deep Automatic Natural Image Matting. Automatic image matting (AIM) refers to estimating the soft foreground from an arbitrary natural image without any auxiliary input like trimap, which is useful for image editing. Prior methods try to learn semantic features to aid the matting process while being limited to images with salient opaque foregrounds such as humans and animals. In this paper, we investigate the difficulties when extending them to natural images with salient transparent meticulous foregrounds or non salient foregrounds. To address the problem, a novel end to end matting network is proposed, which can predict a generalized trimap for any image of the above types as a unified semantic representation. Simultaneously, the learned semantic features guide the matting network to focus on the transition areas via an attention mechanism. We also construct a test set AIM 500 that contains 500 diverse natural images covering all types along with manually labeled alpha mattes, making it feasible to benchmark the generalization ability of AIM models. Results of the experiments demonstrate that our network trained on available composite matting datasets outperforms existing methods both objectively and subjectively. The source code and dataset are available at https github.com JizhiziLi AIM.


Approximation Bounds for Sparse Programs. We show that sparsity constrained optimization problems over low dimensional spaces tend to have a small duality gap. We use the Shapley Folkman theorem to derive both data driven bounds on the duality gap, and an efficient primalization procedure to recover feasible points satisfying these bounds. These error bounds are proportional to the rate of growth of the objective with the target cardinality, which means in particular that the relaxation is nearly tight as soon as the target cardinality is large enough so that only uninformative features are added.


CKConv Continuous Kernel Convolution For Sequential Data. Conventional neural architectures for sequential data present important limitations. Recurrent networks suffer from exploding and vanishing gradients, small effective memory horizons, and must be trained sequentially. Convolutional networks are unable to handle sequences of unknown size and their memory horizon must be defined a priori. In this work, we show that all these problems can be solved by formulating convolutional kernels in CNNs as continuous functions. The resulting Continuous Kernel Convolution (CKConv) allows us to model arbitrarily long sequences in a parallel manner, within a single operation, and without relying on any form of recurrence. We show that Continuous Kernel Convolutional Networks (CKCNNs) obtain state of the art results in multiple datasets, e.g., permuted MNIST, and, thanks to their continuous nature, are able to handle non uniformly sampled datasets and irregularly sampled data natively. CKCNNs match or perform better than neural ODEs designed for these purposes in a faster and simpler manner.


The Pursuit and Evasion of Drones Attacking an Automated Turret. This paper investigates the pursuit evasion problem of a defensive gun turret and one or more attacking drones. The turret must visit" each attacking drone once, as quickly as possible, to defeat the threat. This constitutes a Shortest Hamiltonian Path (SHP) through the drones. The investigation considers situations with increasing fidelity, starting with a 2D kinematic model and progressing to a 3D dynamic model. In 2D we determine the region from which one or more drones can always reach a turret, or the region close enough to it where they can evade the turret. This provides optimal starting angles for n drones around a turret and the maximum starting radius for one and two drones. We show that safety regions also exist in 3D and provide a controller so that a drone in this region can evade the pan tilt turret. Through simulations we explore the maximum range n drones can start and still have at least one reach the turret, and analyze the effect of turret behavior and the drones' number, starting configuration, and behaviors.


A continuous time Ehrenfest model with catastrophes and its jump diffusion approximation. We consider a continuous time Ehrenfest model defined over the integers from N to N, and subject to catastrophes occurring at constant rate. The effect of each catastrophe instantaneously resets the process to state 0. We investigate both the transient and steady state probabilities of the above model. Further, the first passage time through state 0 is discussed. We perform a jump diffusion approximation of the above model, which leads to the Ornstein Uhlenbeck process with catastrophes. The underlying jump diffusion process is finally studied, with special attention to the symmetric case arising when the Ehrenfest model has equal upward and downward transition rates.


Move Schedules Fast persistence computations in coarse dynamic settings. The standard procedure for computing the persistent homology of a filtered simplicial complex is the matrix reduction algorithm. Its output is a particular decomposition of the total boundary matrix, from which the persistence diagrams and generating cycles can be derived. Persistence diagrams are known to vary continuously with respect to their input, which motivates the algorithmic study of persistence computations for time varying filtered complexes. Computationally, simulating persistence dynamically can be reduced to maintaining a valid decomposition under adjacent transpositions in the filtration order. In practice, the quadratic scaling in the number of such transpositions often makes this maintenance procedure slower than simply computing the decomposition from scratch, limiting the application of dynamic persistence to relatively small data sets. In this work, we propose a coarser strategy for maintaining the decomposition over a 1 parameter family of filtrations. Our first result is an analysis of a simple linear time strategy which reduces the number of column operations needed to simulate persistence across a fixed homotopy by at most a factor of 2. We show a modification of this technique which maintains only a sublinear number of valid states, as opposed to a quadratic number of states, and we provide tight lower bounds for this technique. Finally, we present results showing that the decrease in operations to compute diagrams across a family of filtrations is proportional to the difference between the expected quadratic number of states, and the proposed sublinear coarsening. Applications to multi dimensional persistence and crocker stacks are also presented.


LoveDA A Remote Sensing Land Cover Dataset for Domain Adaptive Semantic Segmentation. Deep learning approaches have shown promising results in remote sensing high spatial resolution (HSR) land cover mapping. However, urban and rural scenes can show completely different geographical landscapes, and the inadequate generalizability of these algorithms hinders city level or national level mapping. Most of the existing HSR land cover datasets mainly promote the research of learning semantic representation, thereby ignoring the model transferability. In this paper, we introduce the Land cOVEr Domain Adaptive semantic segmentation (LoveDA) dataset to advance semantic and transferable learning. The LoveDA dataset contains 5987 HSR images with 166768 annotated objects from three different cities. Compared to the existing datasets, the LoveDA dataset encompasses two domains (urban and rural), which brings considerable challenges due to the 1) multi scale objects 2) complex background samples and 3) inconsistent class distributions. The LoveDA dataset is suitable for both land cover semantic segmentation and unsupervised domain adaptation (UDA) tasks. Accordingly, we benchmarked the LoveDA dataset on eleven semantic segmentation methods and eight UDA methods. Some exploratory studies including multi scale architectures and strategies, additional background supervision, and pseudo label analysis were also carried out to address these challenges. The code and data are available at https github.com Junjue Wang LoveDA.


Local limit theorems for inhomogeneous Markov chains. We prove the Local Limit Theorems for bounded additive functionals of uniformly elliptic inhomogeneous Markov arrays. As an application we obtain the precise asymptotics in the large deviation regime for bounded additive functionals of uniformly elliptic Markov chains. The proofs rely on new reduction theorems for Markov arrays.


Exact dimension of Furstenberg measures. For a probability measure mu on SL d (R), we consider the Furstenberg stationary measure on the space of flags. Under general non degeneracy conditions, if mu is discrete and if g log g d mu (g) infty , then the measure nu is exact dimensional.


Full Text and URL Search Over Web Archives. Web archives are a historically valuable source of information. In some respects, web archives are the only record of the evolution of human society in the last two decades. They preserve a mix of personal and collective memories, the importance of which tends to grow as they age. However, the value of web archives depends on their users being able to search and access the information they require in efficient and effective ways. Without the possibility of exploring and exploiting the archived contents, web archives are useless. Web archive access functionalities range from basic browsing to advanced search and analytical services, accessed through user friendly interfaces. Full text and URL search have become the predominant and preferred forms of information discovery in web archives, fulfilling user needs and supporting search APIs that feed complex applications. Both full text and URL search are based on the technology developed for modern web search engines, since the Web is the main resource targeted by both systems. However, while web search engines enable searching over the most recent web snapshot, web archives enable searching over multiple snapshots from the past. This means that web archives have to deal with a temporal dimension that is the cause of new challenges and opportunities, discussed throughout this chapter.


A Normal Distribution Transform Based Radar Odometry Designed For Scanning and Automotive Radars. Existing radar sensors can be classified into automotive and scanning radars. While most radar odometry (RO) methods are only designed for a specific type of radar, our RO method adapts to both scanning and automotive radars. Our RO is simple yet effective, where the pipeline consists of thresholding, probabilistic submap building, and an NDT based radar scan matching. The proposed RO has been tested on two public radar datasets the Oxford Radar RobotCar dataset and the nuScenes dataset, which provide scanning and automotive radar data respectively. The results show that our approach surpasses state of the art RO using either automotive or scanning radar by reducing translational error by 51 and 30 , respectively, and rotational error by 17 and 29 , respectively. Besides, we show that our RO achieves centimeter level accuracy as lidar odometry, and automotive and scanning RO have similar accuracy.


Staggered mesh method for correlation energy calculations of solids Random phase approximation in direct ring coupled cluster doubles and adiabatic connection formalisms. We propose a staggered mesh method for correlation energy calculations of periodic systems under the random phase approximation (RPA), which generalizes the recently developed staggered mesh method for periodic second order M o ller Plesset perturbation theory (MP2) calculations Xing, Li, Lin, JCTC 2021 . Compared to standard RPA calculations, the staggered mesh method introduces negligible additional computational cost. It avoids a significant portion of the finite size error, and can be asymptotically advantageous for quasi 1D systems and certain quasi 2D and 3D systems with high symmetries. We demonstrate the applicability of the method using two different formalisms the direct ring coupled cluster doubles (drCCD) theory, and the adiabatic connection (AC) fluctuation dissipation theory. In the drCCD formalism, the second order screened exchange (SOSEX) correction can also be readily obtained using the staggered mesh method. In the AC formalism, the staggered mesh method naturally avoids the need of performing "head wing" corrections to the dielectric operator. The effectiveness of the staggered mesh method for insulating systems is theoretically justified by investigating the finite size error of each individual perturbative term in the RPA correlation energy, expanded as an infinite series of terms associated with ring diagrams. As a side contribution, our analysis provides a proof that the finite size error of each perturbative term of standard RPA and SOSEX calculations scales as mathcal O (N mathbf k 1 ) , where N mathbf k is the number of grid points in a Monkhorst Pack mesh.


Surrogate Assisted Strategies (The Parameterisation of an Infectious Disease Agent Based Model). Parameter calibration is a significant challenge in agent based modelling and simulation (ABMS). An agent based model's (ABM) complexity grows as the number of parameters required to be calibrated increases. This parameter expansion leads to the ABMS equivalent of the say curse of dimensionality . In particular, infeasible computational requirements searching an infinite parameter space. We propose a more comprehensive and adaptive ABMS Framework that can effectively swap out parameterisation strategies and surrogate models to parameterise an infectious disease ABM. This framework allows us to evaluate different strategy surrogate combinations' performance in accuracy and efficiency (speedup). We show that we achieve better than parity in accuracy across the surrogate assisted sampling strategies and the baselines. Also, we identify that the Metric Stochastic Response Surface strategy combined with the Support Vector Machine surrogate is the best overall in getting closest to the true synthetic parameters. Also, we show that DYnamic COOrdindate Search Using Response Surface Models with XGBoost as a surrogate attains in combination the highest probability of approximating a cumulative synthetic daily infection data distribution and achieves the most significant speedup with regards to our analysis. Lastly, we show in a real world setting that DYCORS XGBoost and MSRS SVM can approximate the real world cumulative daily infection distribution with 97.12 and 96.75 similarity respectively.


Chaos embedded opposition based learning for gravitational search algorithm. Due to its robust search mechanism, Gravitational search algorithm (GSA) has achieved lots of popularity from different research communities. However, stagnation reduces its searchability towards global optima for rigid and complex multi modal problems. This paper proposes a GSA variant that incorporates chaos embedded opposition based learning into the basic GSA for the stagnation free search. Additionally, a sine cosine based chaotic gravitational constant is introduced to balance the trade off between exploration and exploitation capabilities more effectively. The proposed variant is tested over 23 classical benchmark problems, 15 test problems of CEC 2015 test suite, and 15 test problems of CEC 2014 test suite. Different graphical, as well as empirical analyses, reveal the superiority of the proposed algorithm over conventional meta heuristics and most recent GSA variants.


Branched covering simply connected 4 manifolds. We prove that any closed simply connected smooth 4 manifold is 16 fold branched covered by a product of an orientable surface with the 2 torus, where the construction is natural with respect to spin structures. In particular this solves Problem 4.113(C) in Kirby's list. We also discuss analogous results for other families of 4 manifolds with infinite fundamental groups.


Schwarz lemma from a K "ahler manifold into a complex Finsler manifold. Suppose that M is a K "ahler manifold with a pole such that its holomorphic sectional curvature is bounded from below by a constant and its radial sectional curvature is also bounded from below. Suppose that N is a strongly pseudoconvex complex Finsler manifold such that its holomorphic sectional curvature is bounded from above by a negative constant. In this paper, we establish a Schwarz lemma for holomorphic mappings f form M into N . As applications, we obtain a Liouville type rigidity result for holomorphic mappings f from M into N , as well as a rigidity theorem for bimeromorphic mappings from a compact complex manifold into a compact complex Finsler manifold.


Benchmarking Deep Deblurring Algorithms A Large Scale Multi Cause Dataset and A New Baseline Model. Blur artifacts can seriously degrade the visual quality of images, and numerous deblurring methods have been proposed for specific scenarios. However, in most real world images, blur is caused by different factors, e.g., motion and defocus. In this paper, we address how different deblurring methods perform on general types of blur. For in depth performance evaluation, we construct a new large scale multi cause image deblurring dataset called (MC Blur) including real world and synthesized blurry images with mixed factors of blurs. The images in the proposed MC Blur dataset are collected using different techniques convolving Ultra High Definition (UHD) sharp images with large kernels, averaging sharp images captured by a 1000 fps high speed camera, adding defocus to images, and real world blurred images captured by various camera models. These results provide a comprehensive overview of the advantages and limitations of current deblurring methods. Further, we propose a new baseline model, level attention deblurring network, to adapt to multiple causes of blurs. By including different weights of attention to the different levels of features, the proposed network derives more powerful features with larger weights assigned to more important levels, thereby enhancing the feature representation. Extensive experimental results on the new dataset demonstrate the effectiveness of the proposed model for the multi cause blur scenarios.


General primitivity in the mapping class group. For g geq 2 , let mathrm Mod (S g) be the mapping class group of the closed orientable surface S g of genus g . In this paper, we obtain necessary and sufficient conditions under which a given pseudo periodic mapping class can be a root of another up to conjugacy. Using this characterization, the canonical decomposition of (non periodic) mapping classes, and some known algorithms, we give an efficient algorithm for computing roots of arbitrary mapping classes up to conjugacy. Furthermore, we derive realizable bounds on the degrees of roots of pseudo periodic mapping classes in mathrm Mod (S g) , the Torelli group, the level m subgroup of mathrm Mod (S g) , and the commutator subgroup of mathrm Mod (S 2) . In particular, we show that the highest possible (realizable) degree of a root of a pseudo periodic mapping class F is 3q(F)(g 1)(g 2) , where q(F) is a unique positive integer associated with the conjugacy class of F . Moreover, this bound is realized by the roots of the powers of Dehn twist about a separating curve of genus g 2 in S g . Finally, for g geq 3 , we show that any pseudo periodic mapping class having a nontrivial periodic component that is not the hyperelliptic involution, normally generates mathrm Mod (S g) . Consequently, we establish that there exist roots of bounding pair maps and powers of Dehn twists that normally generate mathrm Mod (S g) .


Guiding Query Position and Performing Similar Attention for Transformer Based Detection Heads. After DETR was proposed, this novel transformer based detection paradigm which performs several cross attentions between object queries and feature maps for predictions has subsequently derived a series of transformer based detection heads. These models iterate object queries after each cross attention. However, they don't renew the query position which indicates object queries' position information. Thus model needs extra learning to figure out the newest regions that query position should express and need more attention. To fix this issue, we propose the Guided Query Position (GQPos) method to embed the latest location information of object queries to query position iteratively. Another problem of such transformer based detection heads is the high complexity to perform attention on multi scale feature maps, which hinders them from improving detection performance at all scales. Therefore we propose a novel fusion scheme named Similar Attention (SiA) besides the feature maps is fused, SiA also fuse the attention weights maps to accelerate the learning of high resolution attention weight map by well learned low resolution attention weight map. Our experiments show that the proposed GQPos improves the performance of a series of models, including DETR, SMCA, YoloS, and HoiTransformer and SiA consistently improve the performance of multi scale transformer based detection heads like DETR and HoiTransformer.


On Delta for parameterized Curve Singularities. We consider families of parameterizations of reduced curve singularities over a Noetherian base scheme and prove that the delta invariant is semicontinuous. In our setting, each curve singularity in the family is the image of a parameterization and not the fiber of a morphism. The problem came up in connection with the right left classification of parameterizations of curve singularities defined over a field of positive characteristic. We prove a bound for right left determinacy of a parameterization in terms of delta and the semicontinuity theorem provides a simultaneous bound for the determinacy in a family. The fact that the base space can be an arbitrary Noetherian scheme causes some difficulties but is (not only) of interest for computational purposes.


Constant mean curvature surfaces based on fundamental quadrilaterals. We describe the construction of CMC surfaces with symmetries in mathbb S 3 and mathbb R 3 using a CMC quadrilateral in a fundamental tetrahedron of a tessellation of the space. The fundamental piece is constructed by the generalized Weierstrass representation using a geometric flow on the space of potentials.


A functional characterization of almost greedy and partially greedy bases. In 2003, S. J. Dilworth et al. ( 8 ) introduced the notion of almost greedy (resp. partially greedy) bases. These bases were characterized in terms of quasi greediness and democracy (resp. conservativeness). In this paper we will show a new functional characterization of these type of bases in general Banach spaces following the spirit of the characterization of greediness proved in 5 .


Multi scale Edge based U shape Network for Salient Object Detection. Deep learning based salient object detection methods achieve great improvements. However, there are still problems existing in the predictions, such as blurry boundary and inaccurate location, which is mainly caused by inadequate feature extraction and integration. In this paper, we propose a Multi scale Edge based U shape Network (MEUN) to integrate various features at different scales to achieve better performance. To extract more useful information for boundary prediction, U shape Edge Network modules are embedded in each decoder units. Besides, the additional down sampling module alleviates the location inaccuracy. Experimental results on four benchmark datasets demonstrate the validity and reliability of the proposed method. Multi scale Edge based U shape Network also shows its superiority when compared with 15 state of the art salient object detection methods.


Spherical Transformer Adapting Spherical Signal to CNNs. Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or spherical projections, as the sphere is an unstructured grid. In this paper, we present Spherical Transformer which can transform spherical signals into vectors that can be directly processed by standard CNNs such that many well designed CNNs architectures can be reused across tasks and datasets by pretraining. To this end, the proposed method first uses locally structured sampling methods such as HEALPix to construct a transformer grid by using the information of spherical points and its adjacent points, and then transforms the spherical signals to the vectors through the grid. By building the Spherical Transformer module, we can use multiple CNN architectures directly. We evaluate our approach on the tasks of spherical MNIST recognition, 3D object classification and omnidirectional image semantic segmentation. For 3D object classification, we further propose a rendering based projection method to improve the performance and a rotational equivariant model to improve the anti rotation ability. Experimental results on three tasks show that our approach achieves superior performance over state of the art methods.


On the cuspidal locus in the dual varieties of Segre quartic surface. Motivated by a kind of Penrose correspondence, we investigate the space of hyperplane sections of Segre quartic surfaces which have an ordinary cusp. We show that the space of such hyperplane sections is empty for two kinds of Segre surfaces, and it is a connected surface for all other kinds of Segre surfaces. We also show that when it is non empty, the closure of the space is either birational to the surface itself or birational to a double covering of the surface, whose branch divisor consists of some specific lines on the surface.


Alleviating Vulnerabilities of the Possible Outbreaks of Measles A Data Trend Analysis and Prediction of Possible Cases. Measles is considered as a highly contagious disease that leads to serious complications around the world. Thus, the paper determined the trend and the five year forecasted data of the Measles in the Philippines. This study utilized the time series data for trend analysis and data forecasting using the ARIMA model to visualize the measles cases. Figures for the time series and forecasted results are individually presented with the use of GRETL software. Results showed that there was an increasing pattern of the disease from 2016 to 2019. However, there was a decreasing pattern of its occurrence in the next five years based on the five year forecast. Nevertheless, with the results of the study, there is still a need to improve the different intervention plans of the authority in alleviating the occurrence of the disease though it yielded a decreasing pattern in the future since it is evident that the figure of the forecasted data is still approximately 15,000 and above.


Quantitative weak mixing for interval exchange transformations. We establish a dichotomy for the rate of the decay of the Ces aro averages of correlations of sufficiently regular functions for typical interval exchange transformations (IET) which are not rigid rotations (for which weak mixing had been previously established in the works of Katok Stepin, Veech, and Avila Forni). We show that the rate of decay is either logarithmic or polynomial, according to whether the IET is of rotation class (i.e., it can be obtained as the induced map of a rigid rotation) or not. In the latter case, we also establish that the spectral measures of Lipschitz functions have local dimension bounded away from zero (by a constant depending only on the number of intervals). In our approach, upper bounds are obtained through estimates of twisted Birkhoff sums of Lipschitz functions, while the logarithmic lower bounds are based on the slow deviation of ergodic averages that govern the relation between rigid rotations and their induced maps.


Piezoelectric beam with magnetic effect, time varying delay and time varying weights. The main result of this work is to obtain the exponential decay of the solutions of a piezoelectric beam model with magnetic effect and delay term. The dampings are inserted into the equation of longitudinal displacement. The terms of damping, whose weight associated with them varies over time, are of the friction type, and one of them has delay. This work will also address the issue of existence and uniqueness of solution for the model.


CLCC Contrastive Learning for Color Constancy. In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high quality visual representations for image classification. One key aspect to yield useful representations for image classification is to design illuminant invariant augmentations. However, the illuminant invariant assumption conflicts with the nature of the color constancy task, which aims to estimate the illuminant given a raw image. Therefore, we construct effective contrastive pairs for learning better illuminant dependent features via a novel raw domain color augmentation. On the NUS 8 dataset, our method provides 17.5 relative improvements over a strong baseline, reaching state of the art performance without increasing model complexity. Furthermore, our method achieves competitive performance on the Gehler dataset with 3 times fewer parameters compared to top ranking deep learning methods. More importantly, we show that our model is more robust to different scenes under close proximity of illuminants, significantly reducing 28.7 worst case error in data sparse regions.


Zeros of higher derivatives of Riemann zeta function. In this article, we refined the error term of some results of Levinson and Montgomery cite LM , Ki and Lee cite KL on zero density estimates of zeta (k) . We also have shown that all most all zeros of Matsumoto Tanigawa's eta k function are near the critical line frac 1 2 . Moreover, we obtain an asymptotic expression for the mean square of the product of higher derivatives of Hardy's Z function with Dirichlet polynomials whose n th coefficient is arbitrary and of size ll n epsilon , for epsilon 0 . For k 0 our result recovers the result of Balasubramanian, Conrey and Heath Brown cite BCH and also we for shorter intervals with relatively small mollifier length. More generally, we consider the mean square of the product of two arbitrary order derivatives of Hardy Z function with Dirichlet polynomials and by using this we obtain a similar type of mean square result for the product of two arbitrary order derivatives of the Riemann zeta function with mollifiers.


"You made me feel this way" Investigating Partners' Influence in Predicting Emotions in Couples' Conflict Interactions using Speech Data. How romantic partners interact with each other during a conflict influences how they feel at the end of the interaction and is predictive of whether the partners stay together in the long term. Hence understanding the emotions of each partner is important. Yet current approaches that are used include self reports which are burdensome and hence limit the frequency of this data collection. Automatic emotion prediction could address this challenge. Insights from psychology research indicate that partners' behaviors influence each other's emotions in conflict interaction and hence, the behavior of both partners could be considered to better predict each partner's emotion. However, it is yet to be investigated how doing so compares to only using each partner's own behavior in terms of emotion prediction performance. In this work, we used BERT to extract linguistic features (i.e., what partners said) and openSMILE to extract paralinguistic features (i.e., how they said it) from a data set of 368 German speaking Swiss couples (N 736 individuals) who were videotaped during an 8 minutes conflict interaction in the laboratory. Based on those features, we trained machine learning models to predict if partners feel positive or negative after the conflict interaction. Our results show that including the behavior of the other partner improves the prediction performance. Furthermore, for men, considering how their female partners spoke is most important and for women considering what their male partner said is most important in getting better prediction performance. This work is a step towards automatically recognizing each partners' emotion based on the behavior of both, which would enable a better understanding of couples in research, therapy, and the real world.


Enabling equation free modeling via diffusion maps. Equation free modeling aims at extracting low dimensional macroscopic dynamics from complex high dimensional systems that govern the evolution of microscopic states. This algorithm relies on lifting and restriction operators that map macroscopic states to microscopic states and vice versa. Combined with simulations of the microscopic state, this algorithm can be used to apply Newton solvers to the implicitly defined low dimensional macroscopic system or solve it more efficiently using direct numerical simulations. The key challenge is the construction of the lifting and restrictions operators that usually require a priori insight into the underlying application. In this paper, we design an application independent algorithm that uses diffusion maps to construct these operators from simulation data. Code is available at https doi.org 10.5281 zenodo.5793299.


Lifelong Hyper Policy Optimization with Multiple Importance Sampling Regularization. Learning in a lifelong setting, where the dynamics continually evolve, is a hard challenge for current reinforcement learning algorithms. Yet this would be a much needed feature for practical applications. In this paper, we propose an approach which learns a hyper policy, whose input is time, that outputs the parameters of the policy to be queried at that time. This hyper policy is trained to maximize the estimated future performance, efficiently reusing past data by means of importance sampling, at the cost of introducing a controlled bias. We combine the future performance estimate with the past performance to mitigate catastrophic forgetting. To avoid overfitting the collected data, we derive a differentiable variance bound that we embed as a penalization term. Finally, we empirically validate our approach, in comparison with state of the art algorithms, on realistic environments, including water resource management and trading.


An efficient IMEX DG solver for the compressible Navier Stokes equations with a general equation of state. We propose an efficient, accurate and robust IMEX solver for the compressible Navier Stokes equation with general equation of state. The method, which is based on an h adaptive Discontinuos Galerkin spatial discretization and on an Additive Runge Kutta IMEX method for time discretization, is tailored for low Mach number applications and allows to simulate low Mach regimes at a significantly reduced computational cost, while maintaining full second order accuracy also for higher Mach number regimes. The method has been implemented in the framework of the deal.II numerical library, whose adaptive mesh refinement capabilities are employed to enhance efficiency. Refinement indicators appropriate for real gas phenomena have been introduced. A number of numerical experiments on classical benchmarks for compressible flows and their extension to real gases demonstrate the properties of the proposed method.


Envisioning Communities A Participatory Approach Towards AI for Social Good. Research in artificial intelligence (AI) for social good presupposes some definition of social good, but potential definitions have been seldom suggested and never agreed upon. The normative question of what AI for social good research should be "for" is not thoughtfully elaborated, or is frequently addressed with a utilitarian outlook that prioritizes the needs of the majority over those who have been historically marginalized, brushing aside realities of injustice and inequity. We argue that AI for social good ought to be assessed by the communities that the AI system will impact, using as a guide the capabilities approach, a framework to measure the ability of different policies to improve human welfare equity. Furthermore, we lay out how AI research has the potential to catalyze social progress by expanding and equalizing capabilities. We show how the capabilities approach aligns with a participatory approach for the design and implementation of AI for social good research in a framework we introduce called PACT, in which community members affected should be brought in as partners and their input prioritized throughout the project. We conclude by providing an incomplete set of guiding questions for carrying out such participatory AI research in a way that elicits and respects a community's own definition of social good.


Bipartite Graph Matching Algorithms for Clean Clean Entity Resolution An Empirical Evaluation. Entity Resolution (ER) is the task of finding records that refer to the same real world entities. A common scenario is when entities across two clean sources need to be resolved, which we refer to as Clean Clean ER. In this paper, we perform an extensive empirical evaluation of 8 bipartite graph matching algorithms that take in as input a bipartite similarity graph and provide as output a set of matched entities. We consider a wide range of matching algorithms, including algorithms that have not previously been applied to ER, or have been evaluated only in other ER settings. We assess the relative performance of the algorithms with respect to accuracy and time efficiency over 10 established, real datasets, from which we extract 700 different similarity graphs. Our results provide insights into the relative performance of these algorithms and guidelines for choosing the best one, depending on the data at hand.


A Tale of Two Limits An Extremal Pagerank Problem. For a directed graph, the Pagerank algorithm emulates a random walker on the graph that occasionally "jumps" to a random vertex based on a jumping parameter alpha . Upon completion, the algorithm generates a stochastic vector whose entries correspond to the limiting probability that the walker will be at that vertex. This vector is a right eigenvector of a corresponding Markov trasition matrix. Undoubtedly, this vector can drastically change based upon the jumping parameter alpha . In this article, we investigate the maximum possible discrepancy for different Pagerank vectors on the same unweighted directed (perhaps with loops) graph as measured by the 2 norm. We show that the limsup of this discrepancy can be as large as sqrt frac 67 50 using a very specific construction. (For contrast, the norm of the difference for any two stochastic vectors is at most sqrt 2 .) Interestingly, on this construction this discrepancy occurs when alpha 1 and when alpha is very close to 1.


MS MDA Multisource Marginal Distribution Adaptation for Cross subject and Cross session EEG Emotion Recognition. As an essential element for the diagnosis and rehabilitation of psychiatric disorders, the electroencephalogram (EEG) based emotion recognition has achieved significant progress due to its high precision and reliability. However, one obstacle to practicality lies in the variability between subjects and sessions. Although several studies have adopted domain adaptation (DA) approaches to tackle this problem, most of them treat multiple EEG data from different subjects and sessions together as a single source domain for transfer, which either fails to satisfy the assumption of domain adaptation that the source has a certain marginal distribution, or increases the difficulty of adaptation. We therefore propose the multi source marginal distribution adaptation (MS MDA) for EEG emotion recognition, which takes both domain invariant and domain specific features into consideration. First, we assume that different EEG data share the same low level features, then we construct independent branches for multiple EEG data source domains to adopt one to one domain adaptation and extract domain specific features. Finally, the inference is made by multiple branches. We evaluate our method on SEED and SEED IV for recognizing three and four emotions, respectively. Experimental results show that the MS MDA outperforms the comparison methods and state of the art models in cross session and cross subject transfer scenarios in our settings. Codes at https github.com VoiceBeer MS MDA.


Tweeting for the Cause Network analysis of UK petition sharing. Online government petitions represent a new data rich mode of political participation. This work examines the thus far understudied dynamics of sharing petitions on social media in order to garner signatures and, ultimately, a government response. Using 20 months of Twitter data comprising over 1 million tweets linking to a petition, we perform analyses of networks constructed of petitions and supporters on Twitter, revealing implicit social dynamics therein. We find that Twitter users do not exclusively share petitions on one issue nor do they share exclusively popular petitions. Among the over 240,000 Twitter users, we find latent support groups, with the most central users primarily being politically active "average" individuals. Twitter as a platform for sharing government petitions, thus, appears to hold potential to foster the creation of and coordination among a new form of latent support interest groups online.


ironbci. Open source. Brain computer interface with the embedded board to monitor the physiological subject's condition and environmental parameters. This manuscript presented brain computer interface (STM32 and ADS1299) with the embedded board with sensors to monitor the subject's state and environment. To reduce power consumption and device size, we used sensors made in Micro Electro Mechanical Systems technology (MEMS) a gyroscope, accelerometer, and environmental monitoring sensors CO2, temperature, humidity, ambient sound, and pulse and blood oxygen saturation. Data from the device is transmitted using TCP PI (UART by Bluetooth) protocol to a computer or mobile device. Open source https github.com Ildaron ironbci


Visualizing hierarchies in scRNA seq data using a density tree biased autoencoder. Motivation Single cell RNA sequencing (scRNA seq) data makes studying the development of cells possible at unparalleled resolution. Given that many cellular differentiation processes are hierarchical, their scRNA seq data is expected to be approximately tree shaped in gene expression space. Inference and representation of this tree structure in two dimensions is highly desirable for biological interpretation and exploratory analysis.Results Our two contributions are an approach for identifying a meaningful tree structure from high dimensional scRNA seq data, and a visualization method respecting the tree structure. We extract the tree structure by means of a density based minimum spanning tree on a vector quantization of the data and show that it captures biological information well. We then introduce DTAE, a tree biased autoencoder that emphasizes the tree structure of the data in low dimensional space. We compare to other dimension reduction methods and demonstrate the success of our method both qualitatively and quantitatively on real and toy data.Availability Our implementation relying on PyTorch and Higra is available at https github.com hci unihd DTAE.


Almost volume cone implies almost metric cone for annuluses centered at a compact set in RCD(K, N) spaces. In cite CC1 , Cheeger Colding considered manifolds with lower Ricci curvature bound and gave some almost rigidity results about warped products including almost metric cone rigidity and quantitative splitting theorem. As a generalization of manifolds with lower Ricci curvature bound, for metric measure spaces in RCD(K, N) , 1 N infty , splitting theorem cite Gi13 and "volume cone implies metric cone" rigidity for balls and annuluses of a point cite PG have been proved. In this paper we will generalize Cheeger Colding's cite CC1 result about "almost volume cone implies almost metric cone for annuluses of a compact subset " to RCD(K, N) spaces. More precisely, consider a RCD(K, N) space (X, d, mathfrak m) and a Borel subset Omega subset X . If the closed subset S partial Omega has finite outer curvature, the diameter diam (S) leq D and the mean curvature of S satisfies m(x) leq m, , forall x in S, and begin equation mathfrak m(A a, b (S)) geq (1 epsilon) int a b left( sn ' H(r) frac m n 1 sn H(r) right) n 1 dr mathfrak m S(S) end equation then A a', b' (S) is measured Gromov Hausdorff close to a warped product (a', b') times sn ' H(r) frac m n 1 sn H(r) Y, A a, b (S) x in X setminus Omega, , a d(x, S) b , a a' b' b , Y is a metric space with finite components with each component is a RCD(0, N 1) space when m 0, K 0 and is a RCD(N 2, N 1) space for other cases and H frac K N 1 . Note that when m 0, K 0 , our result is a kind of quantitative splitting theorem and in other cases it is an almost metric cone rigidity. To prove this result, different from cite Gi13, PG , we will use cite GiT 's second order differentiation formula and a method similar as cite CC1 .


Positive semigroups in lattices and totally real number fields. Let L be a full rank lattice in mathbb R d and write L for the semigroup of all vectors with nonnegative coordinates in L . We call a basis X for L positive if it is contained in L . There are infinitely many such bases, and each of them spans a conical semigroup S(X) consisting of all nonnegative integer linear combinations of the vectors of X . Such S(X) is a sub semigroup of L , and we investigate the distribution of the gaps of S(X) in L , i.e. the points in L setminus S(X) . We describe some basic properties and counting estimates for these gaps. Our main focus is on the restrictive successive minima of L and of L setminus S(X) , for which we produce bounds in the spirit of Minkowski's successive minima theorem and its recent generalizations. We apply these results to obtain analogous bounds for the successive minima with respect to Weil height of totally positive sub semigroups of ideals in totally real number fields.


Quasinormal modes expansions for nanoresonators made of absorbing dielectric materials study of the role of static modes. The interaction of light with photonic resonators is determined by the eigenmodes of the system. Modal theories based on quasinormal modes provide a natural tool to calculate and understand light scattering by nanoresonators. We show that, in the case of resonators made of absorbing dielectric materials, eigenmodes with zero eigenfrequency (static modes) play a key role in the modal formalism. The excitation of static modes builds a non resonant contribution to the modal expansion of the scattered field. This non resonant term plays a crucial physical role since it largely contributes to the off resonance signal to which resonances are added in amplitude, possibly leading to interference phenomena and Fano resonances. By considering light scattering by a silicon nanosphere, we quantify the impact of static modes. This study shows that the importance of static modes is not just formal. Modal expansions without static modes reconstruct an incorrect internal field and incorrect extinction and absorption cross sections. Static modes are of prime importance in an expansion truncated to only a few modes.


Cohomology ring of tree braid groups and exterior face rings. For a tree T and a positive integer n , let B nT denote the n strand braid group on T . We use discrete Morse theory techniques to show that the cohomology ring H (B nT) is encoded by an explicit abstract simplicial complex K nT that measures n local interactions among essential vertices of T . We show that, in many cases (for instance when T is a binary tree), H (B nT) is the exterior face ring determined by K nT .


A Skew Dividing Surface for Accurate Nonadiabatic Mean Field Ring Polymer Rates. Mean Field Ring Polymer Molecular Dynamics (MF RPMD) is a powerful, efficient, and accurate method for approximate quantum dynamic simulations of multi level system dynamics. Initial efforts to compute nonadiabatic reaction rates using MF RPMD were not successful recent work showed that this can be remedied by including a simple, if adhoc, correction term that accounts for the formation of kinked' or mixed electronic state ring polymer configurations. Here, we build on this idea, introducing a electronic state population based reaction coordinate and novel skew dividing surface that constrains nuclear positions to configurations where the reactant and product state potentials are near degenerate and that samples kinked electronic state configurations. We then demonstrate the numerical accuracy of this method in computing rates for a series of nonadiabatic model systems.


MixNorm Test Time Adaptation Through Online Normalization Estimation. We present a simple and effective way to estimate the batch norm statistics during test time, to fast adapt a source model to target test samples. Known as Test Time Adaptation, most prior works studying this task follow two assumptions in their evaluation where (1) test samples come together as a large batch, and (2) all from a single test distribution. However, in practice, these two assumptions may not stand, the reasons for which we propose two new evaluation settings where batch sizes are arbitrary and multiple distributions are considered. Unlike the previous methods that require a large batch of single distribution during test time to calculate stable batch norm statistics, our method avoid any dependency on large online batches and is able to estimate accurate batch norm statistics with a single sample. The proposed method significantly outperforms the State Of The Art in the newly proposed settings in Test Time Adaptation Task, and also demonstrates improvements in various other settings such as Source Free Unsupervised Domain Adaptation and Zero Shot Classification.


Networks of Twin Peaks the Dale Cooper Effect. In this work, we analyse character networks in the cult TV show Twin Peaks. In the small scale community network of Twin Peaks we discovered a new storytelling network phenomenon we called the Dale Cooper Effect, a phase transition in network structure. It is a sharp demarcation between the two statistically and topologically distinct networks of characters, where the point of demarcation is the protagonist himself (Special Agent Dale Cooper) introduced as a median character.


Convergent Graph Solvers. We propose the convergent graph solver (CGS), a deep learning method that learns iterative mappings to predict the properties of a graph system at its stationary state (fixed point) with guaranteed convergence. CGS systematically computes the fixed points of a target graph system and decodes them to estimate the stationary properties of the system without the prior knowledge of existing solvers or intermediate solutions. The forward propagation of CGS proceeds in three steps (1) constructing the input dependent linear contracting iterative maps, (2) computing the fixed points of the linear maps, and (3) decoding the fixed points to estimate the properties. The contractivity of the constructed linear maps guarantees the existence and uniqueness of the fixed points following the Banach fixed point theorem. To train CGS efficiently, we also derive a tractable analytical expression for its gradient by leveraging the implicit function theorem. We evaluate the performance of CGS by applying it to various network analytic and graph benchmark problems. The results indicate that CGS has competitive capabilities for predicting the stationary properties of graph systems, irrespective of whether the target systems are linear or non linear. CGS also shows high performance for graph classification problems where the existence or the meaning of a fixed point is hard to be clearly defined, which highlights the potential of CGS as a general graph neural network architecture.


The generalized Langevin equation in harmonic potentials Anomalous diffusion and equipartition of energy. We consider the generalized Langevin equation (GLE) in a harmonic potential with power law decay memory. We study the anomalous diffusion of the particle's displacement and velocity. By comparison with the free particle situation in which the velocity was previously shown to be either diffusive or subdiffusive, we find that, when trapped in a harmonic potential, the particle's displacement may either be diffusive or superdiffusive. Under slightly stronger assumptions on the memory kernel, namely, for kernels related to the broad class of completely monotonic functions, we show that both the free particle and the harmonically bounded GLE satisfy the equipartition of energy condition. This generalizes previously known results for the GLE under particular kernel instances such as the generalized Rouse kernel or (exactly) a power law function.


A practical introduction to the Rational Speech Act modeling framework. Recent advances in computational cognitive science (i.e., simulation based probabilistic programs) have paved the way for significant progress in formal, implementable models of pragmatics. Rather than describing a pragmatic reasoning process in prose, these models formalize and implement one, deriving both qualitative and quantitative predictions of human behavior predictions that consistently prove correct, demonstrating the viability and value of the framework. The current paper provides a practical introduction to and critical assessment of the Bayesian Rational Speech Act modeling framework, unpacking theoretical foundations, exploring technological innovations, and drawing connections to issues beyond current applications.


Smoothness of the diffusion coefficients for particle systems in continuous space. For a class of particle systems in continuous space with local interactions, we show that the asymptotic diffusion matrix is an infinitely differentiable function of the density of particles. Our method allows us to identify relatively explicit descriptions of the derivatives of the diffusion matrix in terms of correctors.


Classifying concepts via visual properties. We assume that substances in the world are represented by two types of concepts, namely substance concepts and classification concepts, the former instrumental to (visual) perception, the latter to (language based) classification. Based on this distinction, we introduce a general methodology for building lexico semantic hierarchies of substance concepts, where nodes are annotated with the media, e.g.,videos or photos, from which substance concepts are extracted, and are associated with the corresponding classification concepts. The methodology is based on Ranganathan's original faceted approach, contextualized to the problem of classifying substance concepts. The key novelty is that the hierarchy is built exploiting the visual properties of substance concepts, while the linguistically defined properties of classification concepts are only used to describe substance concepts. The validity of the approach is exemplified by providing some highlights of an ongoing project whose goal is to build a large scale multimedia multilingual concept hierarchy.


UniLog Deploy One Model and Specialize it for All Log Analysis Tasks. UniLog Deploy One Model and Specialize it for All Log Analysis Tasks


Visualizing Trace Variants From Partially Ordered Event Data. Executing operational processes generates event data, which contain information on the executed process activities. Process mining techniques allow to systematically analyze event data to gain insights that are then used to optimize processes. Visual analytics for event data are essential for the application of process mining. Visualizing unique process executions also called trace variants, i.e., unique sequences of executed process activities is a common technique implemented in many scientific and industrial process mining applications. Most existing visualizations assume a total order on the executed process activities, i.e., these techniques assume that process activities are atomic and were executed at a specific point in time. In reality, however, the executions of activities are not atomic. Multiple timestamps are recorded for an executed process activity, e.g., a start timestamp and a complete timestamp. Therefore, the execution of process activities may overlap and, thus, cannot be represented as a total order if more than one timestamp is to be considered. In this paper, we present a visualization approach for trace variants that incorporates start and complete timestamps of activities.


Discover the Hidden Attack Path in Multi domain Cyberspace Based on Reinforcement Learning. In this work, we present a learning based approach to analysis cyberspace security configuration. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater number of agents as attackers, our method becomes better at discovering hidden attack paths for previously methods, especially in multi domain cyberspace. To achieve these results, we pose discovering attack paths as a Reinforcement Learning (RL) problem and train an agent to discover multi domain cyberspace attack paths. To enable our RL policy to discover more hidden attack paths and shorter attack paths, we ground representation introduction an multi domain action select module in RL. Our objective is to discover more hidden attack paths and shorter attack paths by our proposed method, to analysis the weakness of cyberspace security configuration. At last, we designed a simulated cyberspace experimental environment to verify our proposed method, the experimental results show that our method can discover more hidden multi domain attack paths and shorter attack paths than existing baseline methods.