Passing Through Narrow Gaps with Deep Reinforcement Learning. The U.S. Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge requires teams of robots to traverse difficult and diverse underground environments. Traversing small gaps is one of the challenging scenarios that robots encounter. Imperfect sensor information makes it difficult for classical navigation methods, where behaviours require significant manual fine tuning. In this paper we present a deep reinforcement learning method for autonomously navigating through small gaps, where contact between the robot and the gap may be required. We first learn a gap behaviour policy to get through small gaps (only centimeters wider than the robot). We then learn a goal conditioned behaviour selection policy that determines when to activate the gap behaviour policy. We train our policies in simulation and demonstrate their effectiveness with a large tracked robot in simulation and on the real platform. In simulation experiments, our approach achieves 93 success rate when the gap behaviour is activated manually by an operator, and 63 with autonomous activation using the behaviour selection policy. In real robot experiments, our approach achieves a success rate of 73 with manual activation, and 40 with autonomous behaviour selection. While we show the feasibility of our approach in simulation, the difference in performance between simulated and real world scenarios highlight the difficulty of direct sim to real transfer for deep reinforcement learning policies. In both the simulated and real world environments alternative methods were unable to traverse the gap.


The Information Geometry of Unsupervised Reinforcement Learning. How can a reinforcement learning (RL) agent prepare to solve downstream tasks if those tasks are not known a priori? One approach is unsupervised skill discovery, a class of algorithms that learn a set of policies without access to a reward function. Such algorithms bear a close resemblance to representation learning algorithms (e.g., contrastive learning) in supervised learning, in that both are pretraining algorithms that maximize some approximation to a mutual information objective. While prior work has shown that the set of skills learned by such methods can accelerate downstream RL tasks, prior work offers little analysis into whether these skill learning algorithms are optimal, or even what notion of optimality would be appropriate to apply to them. In this work, we show that unsupervised skill discovery algorithms based on mutual information maximization do not learn skills that are optimal for every possible reward function. However, we show that the distribution over skills provides an optimal initialization minimizing regret against adversarially chosen reward functions, assuming a certain type of adaptation procedure. Our analysis also provides a geometric perspective on these skill learning methods.


Do We Expect More from Radiology AI than from Radiologists?. What we expect from radiology AI algorithms will shape the selection and implementation of AI in the radiologic practice. In this paper I consider prevailing expectations of AI and compare them to expectations that we have of human readers. I observe that the expectations from AI and radiologists are fundamentally different. The expectations of AI are based on a strong and justified mistrust about the way that AI makes decisions. Because AI decisions are not well understood, it is difficult to know how the algorithms will behave in new, unexpected situations. However, this mistrust is not mirrored in our expectations of human readers. Despite well proven idiosyncrasies and biases in human decision making, we take comfort from the assumption that others make decisions in a way as we do, and we trust our own decision making. Despite poor ability to explain decision making processes in humans, we accept explanations of decisions given by other humans. Because the goal of radiology is the most accurate radiologic interpretation, our expectations of radiologists and AI should be similar, and both should reflect a healthy mistrust of complicated and partially opaque decision processes undergoing in computer algorithms and human brains. This is generally not the case now.


Learning Intuitive Physics with Multimodal Generative Models. Predicting the future interaction of objects when they come into contact with their environment is key for autonomous agents to take intelligent and anticipatory actions. This paper presents a perception framework that fuses visual and tactile feedback to make predictions about the expected motion of objects in dynamic scenes. Visual information captures object properties such as 3D shape and location, while tactile information provides critical cues about interaction forces and resulting object motion when it makes contact with the environment. Utilizing a novel See Through your Skin (STS) sensor that provides high resolution multimodal sensing of contact surfaces, our system captures both the visual appearance and the tactile properties of objects. We interpret the dual stream signals from the sensor using a Multimodal Variational Autoencoder (MVAE), allowing us to capture both modalities of contacting objects and to develop a mapping from visual to tactile interaction and vice versa. Additionally, the perceptual system can be used to infer the outcome of future physical interactions, which we validate through simulated and real world experiments in which the resting state of an object is predicted from given initial conditions.


An Axiom System for Feedback Centralities. In recent years, the axiomatic approach to centrality measures has attracted attention in the literature. However, most papers propose a collection of axioms dedicated to one or two considered centrality measures. In result, it is hard to capture the differences and similarities between various measures. In this paper, we propose an axiom system for four classic feedback centralities Eigenvector centrality, Katz centrality, Katz prestige and PageRank. We prove that each of these four centrality measures can be uniquely characterized with a subset of our axioms. Our system is the first one in the literature that considers all four feedback centralities.


Compressing Visual linguistic Model via Knowledge Distillation. Despite exciting progress in pre training for visual linguistic (VL) representations, very few aspire to a small VL model. In this paper, we study knowledge distillation (KD) to effectively compress a transformer based large VL model into a small VL model. The major challenge arises from the inconsistent regional visual tokens extracted from different detectors of Teacher and Student, resulting in the misalignment of hidden representations and attention distributions. To address the problem, we retrain and adapt the Teacher by using the same region proposals from Student's detector while the features are from Teacher's own object detector. With aligned network inputs, the adapted Teacher is capable of transferring the knowledge through the intermediate representations. Specifically, we use the mean square error loss to mimic the attention distribution inside the transformer block and present a token wise noise contrastive loss to align the hidden state by contrasting with negative representations stored in a sample queue. To this end, we show that our proposed distillation significantly improves the performance of small VL models on image captioning and visual question answering tasks. It reaches 120.8 in CIDEr score on COCO captioning, an improvement of 5.1 over its non distilled counterpart and an accuracy of 69.8 on VQA 2.0, a 0.8 gain from the baseline. Our extensive experiments and ablations confirm the effectiveness of VL distillation in both pre training and fine tuning stages.


Lattice Based Minimum Distortion Data Hiding. Lattices have been conceived as a powerful tool for data hiding. While conventional studies and applications focus on achieving the optimal robustness versus distortion tradeoff, in some applications such as data hiding in medical physiological signals, the primary concern is to achieve a minimum amount of distortion to the cover signal. In this paper, we revisit the celebrated quantization index modulation (QIM) scheme and propose a minimum distortion version of it, referred to as MD QIM. The crux of MD QIM is to move the data point to only the boundary of the Voronoi region of the lattice point indexed by a message, which suffices for subsequent correct decoding. At any fixed code rate, the scheme achieves the minimum amount of distortion by sacrificing the robustness to the additive white Gaussian noise (AWGN) attacks. Simulation results confirm that our scheme significantly outperforms QIM in terms of mean square error (MSE), peak signal to noise ratio (PSNR) and percentage residual difference (PRD).


Strong convergence for the alternating Halpern Mann iteration in CAT(0) spaces. In this paper we consider, in the general context of CAT(0) spaces, an iterative schema which alternates between Halpern and Krasnoselskii Mann style iterations. We prove, under suitable conditions, the strong convergence of this algorithm, benefiting from ideas from the proof mining program. We give quantitative information in the form of effective rates of asymptotic regularity and of metastability (in the sense of Tao). Motivated by these results we are also able to obtain strongly convergent versions of the forward backward and the Douglas Rachford algorithms. Our results generalize recent work by Bo c t , Csetnek and Meier, and Cheval and Leu c s tean.


Valeurs z eta multiples. This survey article is the written version of two talks given at the Journ 'ees X UPS 2019 "P 'eriodes et transcendance" at 'Ecole polytechnique. We give a gentle introduction to the study of multiple zeta values, from Euler's solution to the Basel problem to modern Galois theoretic tools. We emphasize the role of the theory of motives which conjecturally controls the structure of the algebra of multiple zeta values.


PlantStereo A Stereo Matching Benchmark for Plant Surface Dense Reconstruction. Stereo matching is an important task in computer vision which has drawn tremendous research attention for decades. While in terms of disparity accuracy, density and data size, public stereo datasets are difficult to meet the requirements of models. In this paper, we aim to address the issue between datasets and models and propose a large scale stereo dataset with high accuracy disparity ground truth named PlantStereo. We used a semi automatic way to construct the dataset after camera calibration and image registration, high accuracy disparity images can be obtained from the depth images. In total, PlantStereo contains 812 image pairs covering a diverse set of plants spinach, tomato, pepper and pumpkin. We firstly evaluated our PlantStereo dataset on four different stereo matching methods. Extensive experiments on different models and plants show that compared with ground truth in integer accuracy, high accuracy disparity images provided by PlantStereo can remarkably improve the training effect of deep learning models. This paper provided a feasible and reliable method to realize plant surface dense reconstruction. The PlantStereo dataset and relative code are available at https www.github.com wangqingyu985 PlantStereo


SwAMP Swapped Assignment of Multi Modal Pairs for Cross Modal Retrieval. We tackle the cross modal retrieval problem, where the training is only supervised by the relevant multi modal pairs in the data. The contrastive learning is the most popular approach for this task. However, its sampling complexity for learning is quadratic in the number of training data points. Moreover, it makes potentially wrong assumption that the instances in different pairs are automatically irrelevant. To address these issues, we propose a novel loss function that is based on self labeling of the unknown classes. Specifically, we aim to predict class labels of the data instances in each modality, and assign those labels to the corresponding instances in the other modality (i.e., swapping the pseudo labels). With these swapped labels, we learn the data embedding for each modality using the supervised cross entropy loss, hence leading to linear sampling complexity. We also maintain the queues for storing the embeddings of the latest batches, for which clustering assignment and embedding learning are done at the same time in an online fashion. This removes computational overhead of injecting intermittent epochs of entire training data sweep for offline clustering. We tested our approach on several real world cross modal retrieval problems, including text based video retrieval, sketch based image retrieval, and image text retrieval, and for all these tasks our method achieves significant performance improvement over the contrastive learning.


Equilibrium on Toeplitz extensions of higher dimensional noncommutative tori. The C algebra generated by the left regular representation of mathbb N n twisted by a 2 cocycle is a Toeplitz extension of an n dimensional noncommutative torus, on which each vector r in 0, infty) n determines a one parameter subgroup of the gauge action. We show that the equilibrium states of the resulting C dynamical system are parametrised by tracial states of the noncommutative torus corresponding to the restriction of the cocycle to the vanishing coordinates of r . These in turn correspond to probability measures on a classical torus whose dimension depends on a certain degeneracy index of the restricted cocycle. Our results generalise the phase transition on the Toeplitz noncommutative tori used as building blocks in recent work of Brownlowe, Hawkins and Sims, and of Afsar, an Huef, Raeburn and Sims.


Cybersecurity Awareness Platform with Virtual Coach and Automated Challenge Assessment. Over the last years, the number of cyber attacks on industrial control systems has been steadily increasing. Among several factors, proper software development plays a vital role in keeping these systems secure. To achieve secure software, developers need to be aware of secure coding guidelines and secure coding best practices. This work presents a platform geared towards software developers in the industry that aims to increase awareness of secure software development. The authors also introduce an interactive game component, a virtual coach, which implements a simple artificial intelligence engine based on the laddering technique for interviews. Through a survey, a preliminary evaluation of the implemented artifact with real world players (from academia and industry) shows a positive acceptance of the developed platform. Furthermore, the players agree that the platform is adequate for training their secure coding skills. The impact of our work is to introduce a new automatic challenge evaluation method together with a virtual coach to improve existing cybersecurity awareness training programs. These training workshops can be easily held remotely or off line.


Iterating the Big Pieces operator and larger sets. We show that if an Ahlfors David regular set E of dimension k has Big Pieces of Big Pieces of Lipschitz Graphs (denoted usually by BP(BP(LG)) ), then E subset tilde E where tilde E is Ahlfors David regular of dimension k and has Big Pieces of Lipschitz Graphs (denoted usually by BP(LG) . Our results are quantitative and, in fact, are proven in the setting of a metric space for any family of Ahlfors David regular sets mathcal F replacing LG . A simple corollary is the stability of the BP operator after 2 iterations. This was previously only known in the Euclidean setting for the case mathcal F LG with substantially more complicated proofs.


Risk Aware Lane Selection on Highway with Dynamic Obstacles. This paper proposes a discretionary lane selection algorithm. In particular, highway driving is considered as a targeted scenario, where each lane has a different level of traffic flow. When lane changing is discretionary, it is advised not to change lanes unless highly beneficial, e.g., reducing travel time significantly or securing higher safety. Evaluating such "benefit" is a challenge, along with multiple surrounding vehicles in dynamic speed and heading with uncertainty. We propose a real time lane selection algorithm with careful cost considerations and with modularity in design. The algorithm is a search based optimization method that evaluates uncertain dynamic positions of other vehicles under a continuous time and space domain. For demonstration, we incorporate a state of the art motion planner framework (Neural Networks integrated Model Predictive Control) under a CARLA simulation environment.


Learning from What's Right and Learning from What's Wrong. The concept of updating (or conditioning or revising) a probability distribution is fundamental in (machine) learning and in predictive coding theory. The two main approaches for doing so are called Pearl's rule and Jeffrey's rule. Here we make, for the first time, mathematically precise what distinguishes them Pearl's rule increases validity (expected value) and Jeffrey's rule decreases (Kullback Leibler) divergence. This forms an instance of a more general distinction between learning from what's right and learning from what's wrong. The difference between these two approaches is illustrated in a mock cognitive scenario.


Coast Sargassum Level Estimation from Smartphone Pictures. Since 2011, significant and atypical arrival of two species of surface dwelling algae, Sargassum natans and Sargassum Fluitans, have been detected in the Mexican Caribbean. This massive accumulation of algae has had a great environmental and economic impact. Therefore, for the government, ecologists, and local businesses, it is important to keep track of the amount of sargassum that arrives on the Caribbean coast. High resolution satellite imagery is expensive or may be time delayed. Therefore, we propose to estimate the amount of sargassum based on ground level smartphone photographs. From the computer vision perspective, the problem is quite difficult since no information about the 3D world is provided, in consequence, we have to model it as a classification problem, where a set of five labels define the amount. For this purpose, we have built a dataset with more than one thousand examples from public forums such as Facebook or Instagram and we have tested several state of the art convolutional networks. As a result, the VGG network trained under fine tuning showed the best performance. Even though the reached accuracy could be improved with more examples, the current prediction distribution is narrow, so the predictions are adequate for keeping a record and taking quick ecological actions.


Deep Ensembling with No Overhead for either Training or Testing The All Round Blessings of Dynamic Sparsity. The success of deep ensembles on improving predictive performance, uncertainty estimation, and out of distribution robustness has been extensively studied in the machine learning literature. Albeit the promising results, naively training multiple deep neural networks and combining their predictions at inference leads to prohibitive computational costs and memory requirements. Recently proposed efficient ensemble approaches reach the performance of the traditional deep ensembles with significantly lower costs. However, the training resources required by these approaches are still at least the same as training a single dense model. In this work, we draw a unique connection between sparse neural network training and deep ensembles, yielding a novel efficient ensemble learning framework called FreeTickets. Instead of training multiple dense networks and averaging them, we directly train sparse subnetworks from scratch and extract diverse yet accurate subnetworks during this efficient, sparse to sparse training. Our framework, FreeTickets, is defined as the ensemble of these relatively cheap sparse subnetworks. Despite being an ensemble method, FreeTickets has even fewer parameters and training FLOPs than a single dense model. This seemingly counter intuitive outcome is due to the ultra training inference efficiency of dynamic sparse training. FreeTickets surpasses the dense baseline in all the following criteria prediction accuracy, uncertainty estimation, out of distribution (OoD) robustness, as well as efficiency for both training and inference. Impressively, FreeTickets outperforms the naive deep ensemble with ResNet50 on ImageNet using around only 1 5 of the training FLOPs required by the latter. We have released our source code at https github.com VITA Group FreeTickets.


Coarse entropy of metric spaces. Coarse geometry studies metric spaces on the large scale. The recently introduced notion of coarse entropy is a tool to study dynamics from the coarse point of view. We prove that all isometries of a given metric space have the same coarse entropy and that this value is a coarse invariant. We call this value the coarse entropy of the space and investigate its connections with other properties of the space. We prove that it can only be either zero or infinity, and although for many spaces this dichotomy coincides with the subexponential exponential growth dichotomy, there is no relation between coarse entropy and volume growth more generally. We completely characterise this dichotomy for spaces with bounded geometry and for quasi geodesic spaces. As an application, we provide an example where coarse entropy yields an obstruction for a coarse embedding, where such an embedding is not precluded by considerations of volume growth.


Cyclic Arbitrage in Decentralized Exchanges. Decentralized Exchanges (DEXes) enable users to create markets for exchanging any pair of cryptocurrencies. The direct exchange rate of two tokens may not match the cross exchange rate in the market, and such price discrepancies open up arbitrage possibilities with trading through different cryptocurrencies cyclically. In this paper, we conduct a systematic investigation on cyclic arbitrages in DEXes. We propose a theoretical framework for studying cyclic arbitrage. With our framework, we analyze the profitability conditions and optimal trading strategies of cyclic transactions. We further examine exploitable arbitrage opportunities and the market size of cyclic arbitrages with transaction level data of Uniswap V2. We find that traders have executed 292,606 cyclic arbitrages over eleven months and exploited more than 138 million USD in revenue. However, the revenue of the most profitable unexploited opportunity is persistently higher than 1 ETH (4,000 USD), which indicates that DEX markets may not be efficient enough. By analyzing how traders implement cyclic arbitrages, we find that traders can utilize smart contracts to issue atomic transactions and the atomic implementations could mitigate users' financial loss in cyclic arbitrage from the price impact.


Do Different Tracking Tasks Require Different Appearance Models?. Tracking objects of interest in a video is one of the most popular and widely applicable problems in computer vision. However, with the years, a Cambrian explosion of use cases and benchmarks has fragmented the problem in a multitude of different experimental setups. As a consequence, the literature has fragmented too, and now novel approaches proposed by the community are usually specialised to fit only one specific setup. To understand to what extent this specialisation is necessary, in this work we present UniTrack, a solution to address five different tasks within the same framework. UniTrack consists of a single and task agnostic appearance model, which can be learned in a supervised or self supervised fashion, and multiple heads'' that address individual tasks and do not require training. We show how most tracking tasks can be solved within this framework, and that the same appearance model can be successfully used to obtain results that are competitive against specialised methods for most of the tasks considered. The framework also allows us to analyse appearance models obtained with the most recent self supervised methods, thus extending their evaluation and comparison to a larger variety of important problems.


An Abstract Beurling's Theorem for Several Complex Variables I. How to extend Beurling's theorem on the shift invariant subspaces of Hardy class H 2 of the unit disk to several complex variables has been an open problem at least since 1964. In this paper, we prove a generalization of Beurling's theorem to valuation Hilbert modules over valuation algebras. We shall apply our abstract Beurling's theorem to obtain a complete description of the closed invariant subspaces of H 2 of the polydisk. As we shall show in a subsequent paper, further consequences of our abstract Beurling's theorem are complete extensions of Beurling's theorem to many more Hilbert spaces of analytic functions in several complex variables.


Load Balanced Semantic Aware Distributed RDF Graph. The modern day semantic applications store data as Resource Description Framework (RDF) data.Due to Proliferation of RDF Data, the efficient management of huge RDF data has become essential. A number of approaches pertaining to both relational and graph based have been devised to handle this huge data. As the relational approach suffers from query joins, we propose a semantic aware graph based partitioning method. The partitioned fragments are further allocated in a load balanced way. For efficient query processing, partial replication is implemented. It reduces Inter node Communication thereby accelerating queries on distributed RDF Graph. This approach has been demonstrated in two phases partitioning and Distribution of Linked Observation Data (LOD). The time complexity for partitioning and distribution of Load Balanced Semantic Aware RDF Graph (LBSD) is O(n) where n is the number of triples which is demonstrated by linear increment in algorithm execution time (AET) for LOD data scaled from 1x to 5x. LBSD has been found to behave well till 4x. LBSD is compared with the state of the art relational and graph based partitioning techniques. LBSD records 71 QET gain when averaged over all the four query types. For most frequent query types, Linear and Star, on an average 65 QET gain is recorded over original configuration for scaling experiments. The optimal replication level has been found to be 12 of original data.


Chimera Efficiently Training Large Scale Neural Networks with Bidirectional Pipelines. Training large deep learning models at scale is very challenging. This paper proposes Chimera, a novel pipeline parallelism scheme which combines bidirectional pipelines for efficiently training large scale models. Chimera is a synchronous approach and therefore no loss of accuracy, which is more convergence friendly than asynchronous approaches. Compared with the latest synchronous pipeline approach, Chimera reduces the number of bubbles by up to 50 benefiting from the sophisticated scheduling of bidirectional pipelines, Chimera has a more balanced activation memory consumption. Evaluations are conducted on Transformer based language models. For a GPT 2 model with 1.3 billion parameters running on 2,048 GPU nodes of the Piz Daint supercomputer, Chimera improves the training throughput by 1.16x 2.34x over the state of the art synchronous and asynchronous pipeline approaches.


Approximations for Allocating Indivisible Items with Concave Additive Valuations. We study a general allocation setting where agent valuations are concave additive. In this model, a collection of items must be uniquely distributed among a set of agents, where each agent item pair has a specified utility. The objective is to maximize the sum of agent valuations, each of which is an arbitrary non decreasing concave function of the agent's total additive utility. This setting was studied by Devanur and Jain (STOC 2012) in the online setting for divisible items. In this paper, we obtain both tight multiplicative and additive approximations in the offline setting for indivisible items. Our approximations depend on novel parameters that measure the local multiplicative additive curvatures of each agent valuation, which we show correspond directly to the integrality gap of the natural assignment convex program of the problem. Furthermore, we extend our additive guarantees to obtain constant multiplicative approximations for Asymmetric Nash Welfare Maximization when agents have smooth valuations (Fain et al. EC 2018, Fluschnik et al. AAAI 2019). This algorithm also yields an interesting tatonnement style interpretation, where agents adjust uniform prices and items are assigned according to maximum weighted bang per buck ratios.


Scaling Laws for Transfer. We study empirical scaling laws for transfer learning between distributions in an unsupervised, fine tuning setting. When we train increasingly large neural networks from scratch on a fixed size dataset, they eventually become data limited and stop improving in performance (cross entropy loss). When we do the same for models pre trained on a large language dataset, the slope in performance gains is merely reduced rather than going to zero. We calculate the effective data "transferred" from pre training by determining how much data a transformer of the same size would have required to achieve the same loss when training from scratch. In other words, we focus on units of data while holding everything else fixed. We find that the effective data transferred is described well in the low data regime by a power law of parameter count and fine tuning dataset size. We believe the exponents in these power laws correspond to measures of the generality of a model and proximity of distributions (in a directed rather than symmetric sense). We find that pre training effectively multiplies the fine tuning dataset size. Transfer, like overall performance, scales predictably in terms of parameters, data, and compute.


Second order perturbative correlation energy functional in the ensemble density functional theory. We derive the second order approximation (PT2) to the ensemble correlation energy functional by applying the G " o rling Levy perturbation theory on the ensemble density functional theory (EDFT). Its performance is checked by calculating excitation energies with the direct ensemble correction method in 1D model systems and 3D atoms using numerically exact Kohn Sham orbitals and potentials. Comparing with the exchange only approximation, the inclusion of the ensemble PT2 correlation improves the excitation energies in 1D model systems in most cases, including double excitations and charge transfer excitations. However, the excitation energies for atoms are generally worse with PT2. We find that the failure of PT2 in atoms is due to the two contributions of an orbital dependent functional to excitation energies being inconsistent in the calculations. We also analyze the convergence of PT2 excitation energies with respect to the number of unoccupied orbitals.


Fast and Robust Structural Damage Analysis of Civil Infrastructure Using UAV Imagery. The usage of Unmanned Aerial Vehicles (UAVs) in the context of structural health inspection is recently gaining tremendous popularity. Camera mounted UAVs enable the fast acquisition of a large number of images often used for mapping, 3D model reconstruction, and as an assisting tool for inspectors. Due to the number of images captured during large scale UAV surveys, a manual image based inspection analysis of entire assets cannot be efficiently performed by qualified engineers. Additionally, comparing defects to past inspections requires the retrieval of relevant images which is often impractical without extensive metadata or computer vision based algorithms. In this paper, we propose an end to end method for automated structural inspection damage analysis. Using automated object detection and segmentation we accurately localize defects, bridge utilities and elements. Next, given the high overlap in UAV imagery, points of interest are extracted, and defects are located and matched throughout the image database, considerably reducing data redundancy while maintaining a detailed record of the defects. Our technique not only enables fast and robust damage analysis of UAV imagery, as we show herein, but is also effective for analyzing manually acquired images.


On the use of Wasserstein metric in topological clustering of distributional data. This paper deals with a clustering algorithm for histogram data based on a Self Organizing Map (SOM) learning. It combines a dimension reduction by SOM and the clustering of the data in a reduced space. Related to the kind of data, a suitable dissimilarity measure between distributions is introduced the L 2 Wasserstein distance. Moreover, the number of clusters is not fixed in advance but it is automatically found according to a local data density estimation in the original space. Applications on synthetic and real data sets corroborate the proposed strategy.


Singular subelliptic equations and Sobolev inequalities on nilpotent Lie groups. In this article we study singular subelliptic p Laplace equations and best constants in Sobolev inequalities on nilpotent Lie groups. We prove solvability of these subelliptic p Laplace equations and existence of the minimizer of the corresponding variational problem. It leads to existence of the best constant in the corresponding (q,p) Sobolev inequality, 0 q 1 , 1 p nu .


Measuring Outcomes in Healthcare Economics using Artificial Intelligence with Application to Resource Management. The quality of service in healthcare is constantly challenged by outlier events such as pandemics (i.e. Covid 19) and natural disasters (such as hurricanes and earthquakes). In most cases, such events lead to critical uncertainties in decision making, as well as in multiple medical and economic aspects at a hospital. External (geographic) or internal factors (medical and managerial), lead to shifts in planning and budgeting, but most importantly, reduces confidence in conventional processes. In some cases, support from other hospitals proves necessary, which exacerbates the planning aspect. This manuscript presents three data driven methods that provide data driven indicators to help healthcare managers organize their economics and identify the most optimum plan for resources allocation and sharing. Conventional decision making methods fall short in recommending validated policies for managers. Using reinforcement learning, genetic algorithms, traveling salesman, and clustering, we experimented with different healthcare variables and presented tools and outcomes that could be applied at health institutes. Experiments are performed the results are recorded, evaluated, and presented.


Random walks and Laplacians on hypergraphs When do they match?. We develop a general theory of random walks on hypergraphs which includes, as special cases, the different models that are found in literature. In particular, we introduce and analyze general random walk Laplacians for hypergraphs, and we compare them to hypergraph normalized Laplacians that are not necessarily related to random walks, but which are motivated by biological and chemical networks. We show that, although these two classes of Laplacians coincide in the case of graphs, they appear to have important conceptual differences in the general case. We study the spectral properties of both classes, as well as their applications to Coupled Hypergraph Maps discrete time dynamical systems that generalize the well known Coupled Map Lattices on graphs. Our results also show why for some hypergraph Laplacian variants one expects more classical results from (weighted) graphs to generalize directly, while these results must fail for other hypergraph Laplacians.


Formation of colloidal threads in geometrically varying flow focusing channels. When two miscible fluids are brought into contact with each other, the concentration gradients induce stresses. These are referred to as Korteweg stresses and are analogous to interfacial tension between two immiscible fluids, thereby acting as an effective interfacial tension (EIT) in inhomogeneous miscible systems. EIT governs the formation of a viscous thread in flow focusing of two miscible fluids. To further investigate its significance, we have studied thread formation of a colloidal dispersion focused by its own solvent. Experiments are combined with three dimensional numerical models to systematically expand previous knowledge utilising different flow focusing channel setups. In the reference setup, the sheath flows impinge the core flow orthogonally while in four other channel setups, the sheath flows impinge the core flow at an oblique angle that is both positive and negative with respect to the reference sheath direction. As an initial estimate of the EIT, we fit the experimentally determined thread shape in the reference setup to a master curve that depends on EIT through an effective capillary number. By numerically reproducing these experimental results, it is concluded that the estimated EIT is within 25 of the optimal EIT value that can be deduced by iteratively fitting the numerical results to the experimental measurements. Regardless of channel setups, further numerical calculations performed using the optimal EIT evaluated from the reference setup show good agreement with the experimental findings in terms of thread shapes, wetted region morphologies, and velocity flow fields. The one to one comparison of numerical and experimental findings unveil the crucial role of EIT on the thread detachment from the top and bottom walls of the channel, bringing useful insights to understand the physical phenomenons involved in miscible systems with a high viscosity contrast.


Challenges and Applications of Automated Extraction of Socio political Events from Text (CASE 2021) Workshop and Shared Task Report. This workshop is the fourth issue of a series of workshops on automatic extraction of socio political events from news, organized by the Emerging Market Welfare Project, with the support of the Joint Research Centre of the European Commission and with contributions from many other prominent scholars in this field. The purpose of this series of workshops is to foster research and development of reliable, valid, robust, and practical solutions for automatically detecting descriptions of socio political events, such as protests, riots, wars and armed conflicts, in text streams. This year workshop contributors make use of the state of the art NLP technologies, such as Deep Learning, Word Embeddings and Transformers and cover a wide range of topics from text classification to news bias detection. Around 40 teams have registered and 15 teams contributed to three tasks that are i) multilingual protest news detection, ii) fine grained classification of socio political events, and iii) discovering Black Lives Matter protest events. The workshop also highlights two keynote and four invited talks about various aspects of creating event data sets and multi and cross lingual machine learning in few and zero shot settings.


On the efficiency of a general attack against the MOBS cryptosystem. All instances of the semidirect key exchange protocol, a generalisation of the famous Diffie Hellman key exchange protocol, satisfy the so called "telescoping equality" in some cases, this equality has been used to construct an attack. In this report we present computational evidence suggesting that an instance of the scheme called MOBS' is an example of a scheme where the telescoping equality has too many solutions to be a practically viable means to conduct an attack.


Constructing long short stock portfolio with a new listwise learn to rank algorithm. Factor strategies have gained growing popularity in industry with the fast development of machine learning. Usually, multi factors are fed to an algorithm for some cross sectional return predictions, which are further used to construct a long short portfolio. Instead of predicting the value of the stock return, emerging studies predict a ranked stock list using the mature learn to rank technology. In this study, we propose a new listwise learn to rank loss function which aims to emphasize both the top and the bottom of a rank list. Our loss function, motivated by the long short strategy, is endogenously shift invariant and can be viewed as a direct generalization of ListMLE. Under different transformation functions, our loss can lead to consistency with binary classification loss or permutation level 0 1 loss. A probabilistic explanation for our model is also given as a generalized Plackett Luce model. Based on a dataset of 68 factors in China A share market from 2006 to 2019, our empirical study has demonstrated the strength of our method which achieves an out of sample annual return of 38 with the Sharpe ratio being 2.


Absolutely Continuous Invariant Measure for Generalized Horseshoe Maps. In this paper, we study the SRB measures of generalized horseshoe map. We prove that under the conditions of transversality and fatness, the SRB measure is actually absolutely continuous with respect to the Lebesgue measure.


Parameter uniform numerical methods for singularly perturbed linear transport problems. Pointwise accurate numerical methods are constructed and analysed for three classes of singularly perturbed first order transport problems. The methods involve piecewise uniform Shishkin meshes and the numerical approximations are shown to be parameter uniformly convergent in the maximum norm. A transport problem from the modelling of fluid particle interaction is formulated and used as a test problem for these numerical methods. Numerical results are presented to illustrate the performance of the numerical methods and to confirm the theoretical error bounds established in the paper.


SU(2) 2 invariant gauge theory on asymptotically conical Calabi Yau 3 folds. We give a complete description of the behaviour of Calabi Yau instantons and monopoles with an SU(2) 2 symmetry, on Calabi Yau 3 folds with asymptotically conical geometry and SU(2) 2 acting with co homogeneity one. We consider gauge theory on the smoothing and the small resolution of the conifold, and on the canonical bundle of mathbb CP 1 times mathbb CP 1 , with their known asymptotically conical co homogeneity one Calabi Yau metrics, and find new one parameter families of invariant instantons. We also entirely classify the relevant moduli spaces of instantons and monopoles satisfying a natural curvature decay condition, and show that the expected bubbling phenomena occur in these families of instantons.


Full Surround Monodepth from Multiple Cameras. Self supervised monocular depth and ego motion estimation is a promising approach to replace or supplement expensive depth sensors such as LiDAR for robotics applications like autonomous driving. However, most research in this area focuses on a single monocular camera or stereo pairs that cover only a fraction of the scene around the vehicle. In this work, we extend monocular self supervised depth and ego motion estimation to large baseline multi camera rigs. Using generalized spatio temporal contexts, pose consistency constraints, and carefully designed photometric loss masking, we learn a single network generating dense, consistent, and scale aware point clouds that cover the same full surround 360 degree field of view as a typical LiDAR scanner. We also propose a new scale consistent evaluation metric more suitable to multi camera settings. Experiments on two challenging benchmarks illustrate the benefits of our approach over strong baselines.


Classical length 5 pattern avoiding permutations. We have made a systematic numerical study of the 16 Wilf classes of length 5 classical pattern avoiding permutations from their generating function coefficients. We have extended the number of known coefficients in fourteen of the sixteen classes. Careful analysis, including sequence extension, has allowed us to estimate the growth constant of all classes, and in some cases to estimate the sub dominant power law term associated with the exponential growth. In six of the sixteen classes we find the familiar power law behaviour, so that the coefficients behave like s n sim C cdot mu n cdot n g, while in the remaining ten cases we find a stretched exponential as the most likely sub dominant term, so that the coefficients behave like s n sim C cdot mu n cdot mu 1 n sigma cdot n g, where 0 sigma 1. We have also classified the 120 possible permutations into the 16 distinct classes. We give compelling numerical evidence, and in one case a proof, that all 16 Wilf class generating function coefficients can be represented as moments of a non negative measure on 0, infty). Such sequences are known as em Stieltjes moment sequences . They have a number of nice properties, such as log convexity, which can be used to provide quite strong rigorous lower bounds. Stronger bounds still can be established under plausible monotonicity assumptions about the terms in the continued fraction expansion of the generating functions implied by the Stieltjes property. In this way we provide strong (non rigorous) lower bounds to the growth constants, which are sometimes within a few percent of the exact value.


From Bench to Bedside The First Live Robotic Surgery on the dVRK to Enable Remote Telesurgery with Motion Scaling. Innovations from surgical robotic research rarely translates to live surgery due to the significant difference between the lab and a live environment. Live environments require considerations that are often overlooked during early stages of research such as surgical staff, surgical procedure, and the challenges of working with live tissue. One such example is the da Vinci Research Kit (dVRK) which is used by over 40 robotics research groups and represents an open sourced version of the da Vinci Surgical System. Despite dVRK being available for nearly a decade and the ideal candidate for translating research to practice on over 5,000 da Vinci Systems used in hospitals around the world, not one live surgery has been conducted with it. In this paper, we address the challenges, considerations, and solutions for translating surgical robotic research from bench to bedside. This is explained from the perspective of a remote telesurgery scenario where motion scaling solutions previously experimented in a lab setting are translated to a live pig surgery. This study presents results from the first ever use of a dVRK in a live animal and discusses how the surgical robotics community can approach translating their research to practice.


Revisiting Pre analysis Information Based Rate Control in x265. Due to the excellent compression and high real time performance, x265 is widely used in practical applications. Combined with CU tree based pre analysis, x265 rate control can obtain high rate distortion (R D) performance. However, the pre analysis information is not fully utilized, and the accuracy of rate control is not satisfactory in x265 because of an empirical linear model. In this paper, we propose an improved cost guided rate control scheme for x265. Firstly, the pre analysis information is further used to refine the bit allocation. Secondly, CU tree is combined with the lambda domain model for more accurate rate control and higher R D performance. Experimental results show that compared with the original x265, our method can achieve 10.3 BD rate gain with only 0.22 textperthousand bitrate error.


Sharp bounds for the spherical restriction Fourier transform in classical Lebesgue Riesz and Grand Lebesgue spaces for ordinary and radial functions. We derive bilateral estimates for the constants appearing in the Fourier transform restricted theorems on the Euclidean sphere for the ordinary and especially radial functions belonging to the Lebesgue Riesz spaces as well as belonging to the Grand Lebesgue Spaces. We obtain an exact estimate for the norm of the restriction Fourier transform operator acting on the radial functions.


A scaling law chaotic system. In this article, we propose an anomalous chaotic system of the scaling law ordinary differential equations involving the Mandelbrot scaling law. This chaotic behavior shows the "Wukong" effect. The comparison among the Lorenz and scaling law attractors is discussed in detail. We also suggest the conjecture for the fixed point theory for the fractal SL attractor. The scaling law chaos may be open a new door in the study of the chaos theory.


Relationships Between Mutations of Brauer Configuration Algebras and Some Diophantine Equations. Mutations on Brauer configurations are introduced and associated with some suitable automata in order to solve generalizations of the Chicken McNugget problem. Besides, based on marked order polytopes a new class of diophantine equations called Gelfand Tsetlin equations are also solved. The approach allows giving an algebraic description of the schedule of an AES key via some suitable non deterministic finite automata (NFA).


Policy Search using Dynamic Mirror Descent MPC for Model Free Off Policy RL. Recent works in Reinforcement Learning (RL) combine model free (Mf) RL algorithms with model based (Mb) RL approaches to get the best from both asymptotic performance of Mf RL and high sample efficiency of Mb RL. Inspired by these works, we propose a hierarchical framework that integrates online learning for the Mb trajectory optimization with off policy methods for the Mf RL. In particular, two loops are proposed, where the Dynamic Mirror Descent based Model Predictive Control (DMD MPC) is used as the inner loop to obtain an optimal sequence of actions. These actions are in turn used to significantly accelerate the outer loop Mf RL. We show that our formulation is generic for a broad class of MPC based policies and objectives, and includes some of the well known Mb Mf approaches. Based on the framework we define two algorithms to increase sample efficiency of Off Policy RL and to guide end to end RL algorithms for online adaption respectively. Thus we finally introduce two novel algorithms Dynamic Mirror Descent Model Predictive RL(DeMoRL), which uses the method of elite fractions for the inner loop and Soft Actor Critic (SAC) as the off policy RL for the outer loop and Dynamic Mirror Descent Model Predictive Layer(DeMo Layer), a special case of the hierarchical framework which guides linear policies trained using Augmented Random Search(ARS). Our experiments show faster convergence of the proposed DeMo RL, and better or equal performance compared to other Mf Mb approaches on benchmark MuJoCo control tasks. The DeMo Layer was tested on classical Cartpole and custom built Quadruped trained using Linear Policy.


CondLaneNet a Top to down Lane Detection Framework Based on Conditional Convolution. Modern deep learning based lane detection methods are successful in most scenarios but struggling for lane lines with complex topologies. In this work, we propose CondLaneNet, a novel top to down lane detection framework that detects the lane instances first and then dynamically predicts the line shape for each instance. Aiming to resolve lane instance level discrimination problem, we introduce a conditional lane detection strategy based on conditional convolution and row wise formulation. Further, we design the Recurrent Instance Module(RIM) to overcome the problem of detecting lane lines with complex topologies such as dense lines and fork lines. Benefit from the end to end pipeline which requires little post process, our method has real time efficiency. We extensively evaluate our method on three benchmarks of lane detection. Results show that our method achieves state of the art performance on all three benchmark datasets. Moreover, our method has the coexistence of accuracy and efficiency, e.g. a 78.14 F1 score and 220 FPS on CULane. Our code is available at https github.com aliyun conditional lane detection.


HelpViz Automatic Generation of Contextual Visual MobileTutorials from Text Based Instructions. We present HelpViz, a tool for generating contextual visual mobile tutorials from text based instructions that are abundant on the web. HelpViz transforms text instructions to graphical tutorials in batch, by extracting a sequence of actions from each text instruction through an instruction parsing model, and executing the extracted actions on a simulation infrastructure that manages an array of Android emulators. The automatic execution of each instruction produces a set of graphical and structural assets, including images, videos, and metadata such as clicked elements for each step. HelpViz then synthesizes a tutorial by combining parsed text instructions with the generated assets, and contextualizes the tutorial to user interaction by tracking the user's progress and highlighting the next step. Our experiments with HelpViz indicate that our pipeline improved tutorial execution robustness and that participants preferred tutorials generated by HelpViz over text based instructions. HelpViz promises a cost effective approach for generating contextual visual tutorials for mobile interaction at scale.


S2Engine A Novel Systolic Architecture for Sparse Convolutional Neural Networks. Convolutional neural networks (CNNs) have achieved great success in performing cognitive tasks. However, execution of CNNs requires a large amount of computing resources and generates heavy memory traffic, which imposes a severe challenge on computing system design. Through optimizing parallel executions and data reuse in convolution, systolic architecture demonstrates great advantages in accelerating CNN computations. However, regular internal data transmission path in traditional systolic architecture prevents the systolic architecture from completely leveraging the benefits introduced by neural network sparsity. Deployment of fine grained sparsity on the existing systolic architectures is greatly hindered by the incurred computational overheads. In this work, we propose S2Engine a novel systolic architecture that can fully exploit the sparsity in CNNs with maximized data reuse. S2Engine transmits compressed data internally and allows each processing element to dynamically select an aligned data from the compressed dataflow in convolution. Compared to the naive systolic array, S2Engine achieves about 3.2 times and about 3.0 times improvements on speed and energy efficiency, respectively.


An Extended Gate Field Effect Transistor (EGFET) based pH Microsensor Utilizing a Polypyyrole Coated pH Microelectrode. Here, an ultra small size, simple and inexpensive metal oxide semiconductor field effect transistor (MOSFET) integrated needle type EGFET pH microsensor was fabricated. The EGFET pH microsensor has the potential to be applied to fast and precise local pH measurements. The system was composed of two components a pH sensitive probe and a MOSFET. The pH sensitive probe was made by electrochemically coating the surface of a Pt ultra micro electrode with polypyrrole, a semiconductor polymer. The pH sensitive probe was then integrated with the gate of the MOSFET to carry out measurements in PBS at different pH values. The real time response of the EGFET pH microsensor was also tested by cycling the probe in three solutions at different pH. The results showed that the developed pH microsensor is sensitive to pH change. It is expected that the EGFET pH microsensor will allow local pH analysis in biological samples or corrosion studies.


Uncertainty guided Model Generalization to Unseen Domains. We study a worst case scenario in generalization Out of domain generalization from a single source. The goal is to learn a robust model from a single source and expect it to generalize over many unknown distributions. This challenging problem has been seldom investigated while existing solutions suffer from various limitations. In this paper, we propose a new solution. The key idea is to augment the source capacity in both input and label spaces, while the augmentation is guided by uncertainty assessment. To the best of our knowledge, this is the first work to (1) access the generalization uncertainty from a single source and (2) leverage it to guide both input and label augmentation for robust generalization. The model training and deployment are effectively organized in a Bayesian meta learning framework. We conduct extensive comparisons and ablation study to validate our approach. The results prove our superior performance in a wide scope of tasks including image classification, semantic segmentation, text classification, and speech recognition.


Lauricella hypergeometric function and its application to the solution of the Neumann problem for a multidimensional elliptic equation with several singular coefficients in an infinite domain. At present, the fundamental solutions of the multidimensional elliptic equation with the several singular coefficients are known and they are expressed in terms of the Lauricella hypergeometric function of many variables. In this paper we study the Neumann problem for a multidimensional elliptic equation with several singular coefficients in the infinite domain. Using the method of the integral energy the uniqueness of solution has been proved. In the course of proving the existence of the explicit solution of the Neumann problem, a differentiation formula, some adjacent and limiting relations for the Lauricella hypergeometric functions and the values of some multidimensional improper integrals are used.


Unsupervised Learning to Subphenotype Delirium Patients from Electronic Health Records. Delirium is a common acute onset brain dysfunction in the emergency setting and is associated with higher mortality. It is difficult to detect and monitor since its presentations and risk factors can be different depending on the underlying medical condition of patients. In our study, we aimed to identify subtypes within the delirium population and build subgroup specific predictive models to detect delirium using Medical Information Mart for Intensive Care IV (MIMIC IV) data. We showed that clusters exist within the delirium population. Differences in feature importance were also observed for subgroup specific predictive models. Our work could recalibrate existing delirium prediction models for each delirium subgroup and improve the precision of delirium detection and monitoring for ICU or emergency department patients who had highly heterogeneous medical conditions.


Dual variational formulations for a large class of non convex models in the calculus of variations. This short communication develops dual variational formulations for a large class of models in variational optimization. The results are established through basic tools of functional analysis, convex analysis and duality theory. The main duality principle is developed as an application to a Ginzburg Landau type system in superconductivity in the absence of a magnetic field. Finally, in the last section, we develop a new convex dual variational formulation also suitable for the non convex global optimization for a large class of models in physics and engineering.


A robust single pixel particle image velocimetry based on fully convolutional networks with cross correlation embedded. Particle image velocimetry (PIV) is essential in experimental fluid dynamics. In the current work, we propose a new velocity field estimation paradigm, which achieves a synergetic combination of the deep learning method and the traditional cross correlation method. Specifically, the deep learning method is used to optimize and correct a coarse velocity guess to achieve a super resolution calculation. And the cross correlation method provides the initial velocity field based on a coarse correlation with a large interrogation window. As a reference, the coarse velocity guess helps with improving the robustness of the proposed algorithm. This fully convolutional network with embedded cross correlation is named as CC FCN. CC FCN has two types of input layers, one is for the particle images, and the other is for the initial velocity field calculated using cross correlation with a coarse resolution. Firstly, two pyramidal modules extract features of particle images and initial velocity field respectively. Then the fusion module appropriately fuses these features. Finally, CC FCN achieves the super resolution calculation through a series of deconvolution layers to obtain the single pixel velocity field. As the supervised learning strategy is considered, synthetic data sets including ground truth fluid motions are generated to train the network parameters. Synthetic and real experimental PIV data sets are used to test the trained neural network in terms of accuracy, precision, spatial resolution and robustness. The test results show that these attributes of CC FCN are further improved compared with those of other tested PIV algorithms. The proposed model could therefore provide competitive and robust estimations for PIV experiments.


Asymptotic Bounds on the Combinatorial Diameter of Random Polytopes. The combinatorial diameter operatorname diam (P) of a polytope P is the maximum shortest path distance between any pair of vertices. In this paper, we provide upper and lower bounds on the combinatorial diameter of a random "spherical" polytope, which is tight to within one factor of dimension when the number of inequalities is large compared to the dimension. More precisely, for an n dimensional polytope P defined by the intersection of m i.i.d. half spaces whose normals are chosen uniformly from the sphere, we show that operatorname diam (P) is Omega(n m frac 1 n 1 ) and O(n 2 m frac 1 n 1 n 5 4 n) with high probability when m geq 2 Omega(n) . For the upper bound, we first prove that the number of vertices in any fixed two dimensional projection sharply concentrates around its expectation when m is large, where we rely on the Theta(n 2 m frac 1 n 1 ) bound on the expectation due to Borgwardt Math. Oper. Res., 1999 . To obtain the diameter upper bound, we stitch these shadows paths'' together over a suitable net using worst case diameter bounds to connect vertices to the nearest shadow. For the lower bound, we first reduce to lower bounding the diameter of the dual polytope P circ , corresponding to a random convex hull, by showing the relation operatorname diam (P) geq (n 1)( operatorname diam (P circ) 2) . We then prove that the shortest path between any nearly'' antipodal pair vertices of P circ has length Omega(m frac 1 n 1 ) .


Online Adaptation for Implicit Object Tracking and Shape Reconstruction in the Wild. Tracking and reconstructing 3D objects from cluttered scenes are the key components for computer vision, robotics and autonomous driving systems. While recent progress in implicit function (e.g., DeepSDF) has shown encouraging results on high quality 3D shape reconstruction, it is still very challenging to generalize to cluttered and partially observable LiDAR data. In this paper, we propose to leverage the continuity in video data. We introduce a novel and unified framework which utilizes a DeepSDF model to simultaneously track and reconstruct 3D objects in the wild. We online adapt the DeepSDF model in the video, iteratively improving the shape reconstruction while in return improving the tracking, and vice versa. We experiment with both Waymo and KITTI datasets, and show significant improvements over state of the art methods for both tracking and shape reconstruction.


Numerical Approximation of Optimal Convex and Rotationally Symmetric Shapes for an Eigenvalue Problem arising in Optimal Insulation. We are interested in the optimization of convex domains under a PDE constraint. Due to the difficulties of approximating convex domains in mathbb R 3 , the restriction to rotationally symmetric domains is used to reduce shape optimization problems to a two dimensional setting. For the optimization of an eigenvalue arising in a problem of optimal insulation, the existence of an optimal domain is proven. An algorithm is proposed that can be applied to general shape optimization problems under the geometric constraints of convexity and rotational symmetry. The approximated optimal domains for the eigenvalue problem in optimal insulation are discussed.


Three New Infinite Families of Optimal Locally Repairable Codes from Matrix Product Codes. Locally repairable codes have become a key instrument in large scale distributed storage systems. This paper focuses on the construction of locally repairable codes with (r, delta) locality that achieve the equality in the Singleton type bound. We use matrix product codes to propose two infinite families of q ary optimal (r, delta) locally repairable codes of lengths up to q 2 q . The ingredients in the matrix product codes are either linear maximum distance separable codes or optimal locally repairable codes of small lengths. Further analysis and refinement yield a construction of another infinite family of optimal (r, delta) locally repairable codes. The codes in this third family have unbounded lengths not divisible by (r delta 1) . The three families of optimal (r, delta) locally repairable codes constructed here are new. Previously constructed codes in the literature have not covered the same sets of parameters. Our construction proposals are flexible since one can easily vary r and delta to come up with particular parameters that can suit numerous scenarios.


Asymptotic topology of excursion and nodal sets of Gaussian random fields. Let M be a compact smooth manifold of dimension n with or without boundary, and f M rightarrow R be a smooth Gaussian random field. It is very natural to suppose that for a large positive real u, the random excursion set f ge u is mostly composed of a union of disjoint topological n balls. Using the constructive part of (stratified) Morse theory we prove that in average, this intuition is true, and provide for large u the asymptotic of the expected number of such balls, and so of connected components of f ge u , see Theorem 1.2. We similarly show that in average, the high nodal sets f u are mostly composed of spheres, with the same asymptotic than the one for excursion set. A refinement of these results using the average of the Euler characteristic given by 2 provides a striking asymptotic of the constant defined by F. Nazarov and M. Sodin, again for large u, see Theorem 1.11. This new Morse theoretical approach of random topology also applies to spherical spin glasses with large dimension, see Theorem 1.14.


Bott Chern and bar partial Harmonic forms on Almost Hermitian 4 manifolds. We prove that on a compact almost Hermitian 4 manifold the space of bar partial harmonic (1,1) forms always has dimension h bar partial 1,1 b 1 or b , whilst the space of Bott Chern harmonic (1,1) forms always has dimension h BC 1,1 b 1 . We also perform calculations of h 2,1 BC and h 1,2 BC on the Kodaira Thurston manifold, thereby providing a full account of when h p,q BC is or is not invariant of the choice of almost Hermitian metric. Finally, we introduce a decomposition of the space of L 2 functions on all torus bundles over S 1 , which has proven useful for solving linear PDEs, and we demonstrate its use in the calculation of h p,q bar partial .


Modeling Gate Level Abstraction Hierarchy Using Graph Convolutional Neural Networks to Predict Functional De Rating Factors. The paper is proposing a methodology for modeling a gate level netlist using a Graph Convolutional Network (GCN). The model predicts the overall functional de rating factors of sequential elements of a given circuit. In the preliminary phase of the work, the important goal is making a GCN which able to take a gate level netlist as input information after transforming it into the Probabilistic Bayesian Graph in the form of Graph Modeling Language (GML). This part enables the GCN to learn the structural information of netlist in graph domains. In the second phase of the work, the modeled GCN trained with the a functional de rating factor of a very low number of individual sequential elements (flip flops). The third phase includes understanding of GCN models accuracy to model an arbitrary circuit netlist. The designed model was validated for two circuits. One is the IEEE 754 standard double precision floating point adder and the second one is the 10 Gigabit Ethernet MAC IEEE802.3 standard. The predicted results compared to the standard fault injection campaign results of the error called Single EventUpset (SEU). The validated results are graphically pictured in the form of the histogram and sorted probabilities and evaluated with the Confidence Interval (CI) metric between the predicted and simulated fault injection results.


Salience Aware Event Chain Modeling for Narrative Understanding. Storytelling, whether via fables, news reports, documentaries, or memoirs, can be thought of as the communication of interesting and related events that, taken together, form a concrete process. It is desirable to extract the event chains that represent such processes. However, this extraction remains a challenging problem. We posit that this is due to the nature of the texts from which chains are discovered. Natural language text interleaves a narrative of concrete, salient events with background information, contextualization, opinion, and other elements that are important for a variety of necessary discourse and pragmatics acts but are not part of the principal chain of events being communicated. We introduce methods for extracting this principal chain from natural language text, by filtering away non salient events and supportive sentences. We demonstrate the effectiveness of our methods at isolating critical event chains by comparing their effect on downstream tasks. We show that by pre training large language models on our extracted chains, we obtain improvements in two tasks that benefit from a clear understanding of event chains narrative prediction and event based temporal question answering. The demonstrated improvements and ablative studies confirm that our extraction method isolates critical event chains.


Towards fuzzification of adaptation rules in self adaptive architectures. In this paper, we focus on exploiting neural networks for the analysis and planning stage in self adaptive architectures. The studied motivating cases in the paper involve existing (legacy) self adaptive architectures and their adaptation logic, which has been specified by logical rules. We further assume that there is a need to endow these systems with the ability to learn based on examples of inputs and expected outputs. One simple option to address such a need is to replace the reasoning based on logical rules with a neural network. However, this step brings several problems that often create at least a temporary regress. The reason is the logical rules typically represent a large and tested body of domain knowledge, which may be lost if the logical rules are replaced by a neural network. Further, the black box nature of generic neural networks obfuscates how the systems work inside and consequently introduces more uncertainty. In this paper, we present a method that makes it possible to endow an existing self adaptive architectures with the ability to learn using neural networks, while preserving domain knowledge existing in the logical rules. We introduce a continuum between the existing rule based system and a system based on a generic neural network. We show how to navigate in this continuum and create a neural network architecture that naturally embeds the original logical rules and how to gradually scale the learning potential of the network, thus controlling the uncertainty inherent to all soft computing models. We showcase and evaluate the approach on representative excerpts from two larger real life use cases.


A rodent paradigm for studying perceptual decisions under asymmetric reward. Many real life decisions involve both perceptual processes and weighing the consequences of different actions. However, the neural mechanisms underlying perceptual decisions have typically been examined separately from those underlying economic decisions. Here, we trained rats to make choices informed by both perceptual and value cues on a trial by trial basis. As in typical perceptual tasks, subjects were rewarded for correctly categorizing a tone relative to a learned threshold. To add an economic component, a light indicated, on each trial, whether correct responses to one side gave higher rewards than correct responses to the other side. As such, on trials with some perceptual uncertainty, it could be worthwhile to choose the unlikely option, if it had higher expected value. We found that, despite subjects sensitivity to the frequency of the cue and the reward sizes, their behavior was not optimal subjects tended to shift their choices in a stimulus independent way following light flashes. Moreover, subjects tended to under shift, which could be interpreted as being over confident in their perceptual beliefs or as being risk averse.


Multiobjective Bilevel Evolutionary Approach for Off Grid Direction of Arrival Estimation. The source number identification is an essential step in direction of arrival (DOA) estimation. Existing methods may provide a wrong source number due to inferior statistical properties (in low SNR or limited snapshots) or modeling errors (caused by relaxing sparse penalties), especially in impulsive noise. To address this issue, we propose a novel idea of simultaneous source number identification and DOA estimation. We formulate a multiobjective off grid DOA estimation model to realize this idea, by which the source number can be automatically identified together with DOA estimation. In particular, the source number is properly exploited by the l 0 norm of impinging signals without relaxations, guaranteeing accuracy. Furthermore, we design a multiobjective bilevel evolutionary algorithm to solve the proposed model. The source number identification and sparse recovery are simultaneously optimized at the on grid (lower) level. A forward search strategy is developed to further refine the grid at the off grid (upper) level. This strategy does not need linear approximations and can eliminate the off grid gap with low computational complexity. Simulation results demonstrate the outperformance of our method in terms of source number and root mean square error.


On the Influence of Machine Translation on Language Origin Obfuscation. In the last decade, machine translation has become a popular means to deal with multilingual digital content. By providing higher quality translations, obfuscating the source language of a text becomes more attractive. In this paper, we analyze the ability to detect the source language from the translated output of two widely used commercial machine translation systems by utilizing machine learning algorithms with basic textual features like n grams. Evaluations show that the source language can be reconstructed with high accuracy for documents that contain a sufficient amount of translated text. In addition, we analyze how the document size influences the performance of the prediction, as well as how limiting the set of possible source languages improves the classification accuracy.


Quaternion Based Graph Convolution Network for Recommendation. Graph Convolution Network (GCN) has been widely applied in recommender systems for its representation learning capability on user and item embeddings. However, GCN is vulnerable to noisy and incomplete graphs, which are common in real world, due to its recursive message propagation mechanism. In the literature, some work propose to remove the feature transformation during message propagation, but making it unable to effectively capture the graph structural features. Moreover, they model users and items in the Euclidean space, which has been demonstrated to have high distortion when modeling complex graphs, further degrading the capability to capture the graph structural features and leading to sub optimal performance. To this end, in this paper, we propose a simple yet effective Quaternion based Graph Convolution Network (QGCN) recommendation model. In the proposed model, we utilize the hyper complex Quaternion space to learn user and item representations and feature transformation to improve both performance and robustness. Specifically, we first embed all users and items into the Quaternion space. Then, we introduce the quaternion embedding propagation layers with quaternion feature transformation to perform message propagation. Finally, we combine the embeddings generated at each layer with the mean pooling strategy to obtain the final embeddings for recommendation. Extensive experiments on three public benchmark datasets demonstrate that our proposed QGCN model outperforms baseline methods by a large margin.


A Novel Key Generation Scheme Using Quaternary PUF Responses and Wiretap Polar Coding. Physical unclonable functions (PUFs) are widely considered in secret key generation for resource constrained devices. However, PUFs require additional hardware overhead. In this paper, we focus on developing a PUF efficient, robust, and secure key generation scheme. First, a novel method for extracting quaternary PUF responses is proposed to increase the entropy of a PUF response, in which a 2 bit response is extracted from evaluating a single PUF cell multiple times. The probability masses of the responses can be adjusted by setting parameters appropriately. Then, a chosen secret model based fuzzy extractor (FE) is designed to extract secret keys from the quaternary PUF responses. To improve the security of this FE, it is modeled as a wiretap channel system, and wiretap polar coding is adopted to reduce secrecy leakage. An upper bound of secrecy leakage is also given in this paper, and it suggests that an arbitrarily small (even zero) leakage can be achieved by properly choosing parameters of the quaternary PUF responses generation. Comparison results show that the required number of PUF cells to achieve the same level of secrecy in our scheme is as low as half that of the state of the art schemes.


Finding citations for PubMed A large scale comparison between five freely available bibliographic data sources. As an important biomedical database, PubMed provides users with free access to abstracts of its documents. However, citations between these documents need to be collected from external data sources. Although previous studies have investigated the coverage of various data sources, the quality of citations is underexplored. In response, this study compares the coverage and citation quality of five freely available data sources on 30 million PubMed documents, including OpenCitations Index of CrossRef open DOI to DOI citations (COCI), Dimensions, Microsoft Academic Graph (MAG), National Institutes of Health Open Citation Collection (NIH OCC), and Semantic Scholar Open Research Corpus (S2ORC). Three gold standards and five metrics are introduced to evaluate the correctness and completeness of citations. Our results indicate that Dimensions is the most comprehensive data source that provides references for 62.4 of PubMed documents, outperforming the official NIH OCC dataset (56.7 ). Over 90 of citation links in other data sources can also be found in Dimensions. The coverage of MAG, COCI, and S2ORC is 59.6 , 34.7 , and 23.5 , respectively. Regarding the citation quality, Dimensions and NIH OCC achieve the best overall results. Almost all data sources have a precision higher than 90 , but their recall is much lower. All databases have better performances on recent publications than earlier ones. Meanwhile, the gaps between different data sources have diminished for the documents published in recent years. This study provides evidence for researchers to choose suitable PubMed citation sources, which is also helpful for evaluating the citation quality of free bibliographic databases.


Asking Clarifying Questions Based on Negative Feedback in Conversational Search. Users often need to look through multiple search result pages or reformulate queries when they have complex information seeking needs. Conversational search systems make it possible to improve user satisfaction by asking questions to clarify users' search intents. This, however, can take significant effort to answer a series of questions starting with "what why how". To quickly identify user intent and reduce effort during interactions, we propose an intent clarification task based on yes no questions where the system needs to ask the correct question about intents within the fewest conversation turns. In this task, it is essential to use negative feedback about the previous questions in the conversation history. To this end, we propose a Maximum Marginal Relevance (MMR) based BERT model (MMR BERT) to leverage negative feedback based on the MMR principle for the next clarifying question selection. Experiments on the Qulac dataset show that MMR BERT outperforms state of the art baselines significantly on the intent identification task and the selected questions also achieve significantly better performance in the associated document retrieval tasks.


Breaking symmetries for equivariant coarse homology theories. We describe a symmetry breaking construction in coarse geometry which allows to obtain information about equivariant coarse homology classes by restriction to smaller groups and spaces. In the case of equivariant coarse K homology theory we give an analytic interpretation of this construction. As a consequence we obtain applications to the spectral theory of invariant differential operators.


Direct 0D 3D coupling of a lattice Boltzmann methodology for fluid structure hemodynamics simulations. This work introduces a numerical approach for the implementation and direct coupling of arbitrary complex ordinary differential equation (ODE )governed boundary conditions to three dimensional (3D) lattice Boltzmann based fluid equations for fluid structure hemodynamics simulations. In particular, a most complex configuration is treated by considering a dynamic left ventricle (LV )elastance heart model which is governed by (and applied as) a nonlinear, non stationary hybrid ODE Dirichlet system. The complete 0D 3D solver, including its treatment of the fluid and solid equations as well as their interactions, is validated through a variety of benchmark and convergence studies that demonstrate the ability of the coupled 0D 3D methodology in generating physiological pressure and flow waveforms ultimately enabling the exploration of various physical and physiological parameters for hemodynamics studies of the coupled LV arterial system. The methods proposed in this paper can be easily applied to other ODE based boundary conditions (such as those based on Windkessel lumped parameter models) as well as to other fluid problems that are modeled by 3D lattice Boltzmann equations and that require direct coupling of dynamic 0D conditions.


Am I fit for this physical activity? Neural embedding of physical conditioning from inertial sensors. Inertial Measurement Unit (IMU) sensors are present in everyday devices such as smartphones and fitness watches. As a result, the array of health related research and applications that tap onto this data has been growing, but little attention has been devoted to the prediction of an individual's heart rate (HR) from IMU data, when undergoing a physical activity. Would that be even possible? If so, this could be used to design personalized sets of aerobic exercises, for instance. In this work, we show that it is viable to obtain accurate HR predictions from IMU data using Recurrent Neural Networks, provided only access to HR and IMU data from a short lived, previously executed activity. We propose a novel method for initializing an RNN's hidden state vectors, using a specialized network that attempts to extract an embedding of the physical conditioning (PCE) of a subject. We show that using a discriminator in the training phase to help the model learn whether two PCEs belong to the same individual further reduces the prediction error. We evaluate the proposed model when predicting the HR of 23 subjects performing a variety of physical activities from IMU data available in public datasets (PAMAP2, PPG DaLiA). For comparison, we use as baselines the only model specifically proposed for this task and an adapted state of the art model for Human Activity Recognition (HAR), a closely related task. Our method, PCE LSTM, yields over 10 lower mean absolute error. We demonstrate empirically that this error reduction is in part due to the use of the PCE. Last, we use the two datasets (PPG DaLiA, WESAD) to show that PCE LSTM can also be successfully applied when photoplethysmography (PPG) sensors are available, outperforming the state of the art deep learning baselines by more than 30 .


Identifying centres of interest in paintings using alignment and edge detection Case studies on works by Luc Tuymans. What is the creative process through which an artist goes from an original image to a painting? Can we examine this process using techniques from computer vision and pattern recognition? Here we set the first preliminary steps to algorithmically deconstruct some of the transformations that an artist applies to an original image in order to establish centres of interest, which are focal areas of a painting that carry meaning. We introduce a comparative methodology that first cuts out the minimal segment from the original image on which the painting is based, then aligns the painting with this source, investigates micro differences to identify centres of interest and attempts to understand their role. In this paper we focus exclusively on micro differences with respect to edges. We believe that research into where and how artists create centres of interest in paintings is valuable for curators, art historians, viewers, and art educators, and might even help artists to understand and refine their own artistic method.


Rational singularities of nested Hilbert schemes. The Hilbert scheme of points mathrm Hilb n(S) of a smooth surface S is a well studied parameter space, lying at the interface of algebraic geometry, commutative algebra, representation theory, combinatorics, and mathematical physics. The foundational result is a classical theorem of Fogarty, stating that mathrm Hilb n(S) is a smooth variety of dimension 2n . In recent years there has been growing interest in a natural generalization of mathrm Hilb n(S) , the nested Hilbert schemes mathrm Hilb (n 1,n 2) (S) , which parametrize nested pairs of zero dimensional subschemes Z 1 supseteq Z 2 of S with mathrm deg (Z i) n i . In contrast to Fogarty's theorem, mathrm Hilb (n 1,n 2) (S) is almost always singular, and very little is known about its singularities. In this paper we aim to advance the knowledge of the geometry of these nested Hilbert schemes. Work by Fogarty in the 70's shows that mathrm Hilb (n,1) (S) is a normal Cohen Macaulay variety, and Song more recently proved that it has rational singularities. In our main result, we prove that the nested Hilbert scheme mathrm Hilb (n,2) (S) has rational singularities. We employ an array of tools from commutative algebra to prove this theorem. Using Gr "obner bases, we establish a connection between mathrm Hilb (n,2) (S) and a certain variety of matrices with an action of the general linear group. This variety of matrices plays a central role in our work, and we analyze it by various algebraic techniques, including square free Gr "obner degenerations, the Stanley Reisner correspondence, and the Kempf Lascoux Weyman technique of calculating syzygies. Along the way, we also obtain results on irreducible and reducible classes of nested Hilbert schemes, dimension of singular loci, and F singularities in positive characteristic.


Addressing the Vulnerability of NMT in Input Perturbations. Neural Machine Translation (NMT) has achieved significant breakthrough in performance but is known to suffer vulnerability to input perturbations. As real input noise is difficult to predict during training, robustness is a big issue for system deployment. In this paper, we improve the robustness of NMT models by reducing the effect of noisy words through a Context Enhanced Reconstruction (CER) approach. CER trains the model to resist noise in two steps (1) perturbation step that breaks the naturalness of input sequence with made up words (2) reconstruction step that defends the noise propagation by generating better and more robust contextual representation. Experimental results on Chinese English (ZH EN) and French English (FR EN) translation tasks demonstrate robustness improvement on both news and social media text. Further fine tuning experiments on social media text show our approach can converge at a higher position and provide a better adaptation.


Rethinking Common Assumptions to Mitigate Racial Bias in Face Recognition Datasets. Many existing works have made great strides towards reducing racial bias in face recognition. However, most of these methods attempt to rectify bias that manifests in models during training instead of directly addressing a major source of the bias, the dataset itself. Exceptions to this are BUPT Balancedface RFW and Fairface, but these works assume that primarily training on a single race or not racially balancing the dataset are inherently disadvantageous. We demonstrate that these assumptions are not necessarily valid. In our experiments, training on only African faces induced less bias than training on a balanced distribution of faces and distributions skewed to include more African faces produced more equitable models. We additionally notice that adding more images of existing identities to a dataset in place of adding new identities can lead to accuracy boosts across racial categories. Our code is available at https github.com j alex hanson rethinking race face datasets.


OpenSSLNTRU Faster post quantum TLS key exchange. Google's CECPQ1 experiment in 2016 integrated a post quantum key exchange algorithm, newhope1024, into TLS 1.2. The Google Cloudflare CECPQ2 experiment in 2019 integrated a more efficient key exchange algorithm, ntruhrss701, into TLS 1.3. This paper revisits the choices made in CECPQ2, and shows how to achieve higher performance for post quantum key exchange in TLS 1.3 using a higher security algorithm, sntrup761. Previous work had indicated that ntruhrss701 key generation was much faster than sntrup761 key generation, but this paper makes sntrup761 key generation much faster by generating a batch of keys at once. Batch key generation is invisible at the TLS protocol layer, but raises software engineering questions regarding the difficulty of integrating batch key exchange into existing TLS libraries and applications. This paper shows that careful choices of software layers make it easy to integrate fast post quantum software, including batch key exchange, into TLS with minor changes to TLS libraries and no changes to applications. As a demonstration of feasibility, this paper reports successful integration of its fast sntrup761 library, via a lightly patched OpenSSL, into an unmodified web browser and an unmodified TLS terminator. This paper also reports TLS 1.3 handshake benchmarks, achieving more TLS 1.3 handshakes per second than any software included in OpenSSL.


Model categories for o minimal geometry. We introduce a model category of spaces based on the definable sets of an o minimal expansion of a real closed field. As a model category, it resembles the category of topological spaces, but its underlying category is a coherent topos. We will show in future work that its cofibrant objects are precisely the "weak polytopes" of Knebusch.


Geometric Unsupervised Domain Adaptation for Semantic Segmentation. Simulators can efficiently generate large amounts of labeled synthetic data with perfect supervision for hard to label tasks like semantic segmentation. However, they introduce a domain gap that severely hurts real world performance. We propose to use self supervised monocular depth estimation as a proxy task to bridge this gap and improve sim to real unsupervised domain adaptation (UDA). Our Geometric Unsupervised Domain Adaptation method (GUDA) learns a domain invariant representation via a multi task objective combining synthetic semantic supervision with real world geometric constraints on videos. GUDA establishes a new state of the art in UDA for semantic segmentation on three benchmarks, outperforming methods that use domain adversarial learning, self training, or other self supervised proxy tasks. Furthermore, we show that our method scales well with the quality and quantity of synthetic data while also improving depth prediction.


Non Archimedean second main theorem sharing small functions. In this paper, we establish a new second main theorem for meromorphic functions on a non Archimedean field and small functions with counting functions truncated to level 1. As an application, we show that two meromorphic functions on a non Archimedean field must coincide to each other if they share q , (q geq 5) distinct small functions ignoring multiplicities. In particular, if two non Archimedean meromorphic functions share 5 small functions ignoring multiplicities, they must be identical. Thus, our work improves the results in cite EY .


Scene adaptive Knowledge Distillation for Sequential Recommendation via Differentiable Architecture Search. Sequential recommender systems (SRS) have become a research hotspot due to its power in modeling user dynamic interests and sequential behavioral patterns. To maximize model expressive ability, a default choice is to apply a larger and deeper network architecture, which, however, often brings high network latency when generating online recommendations. Naturally, we argue that compressing the heavy recommendation models into middle or light weight neural networks is of great importance for practical production systems. To realize such a goal, we propose AdaRec, a knowledge distillation (KD) framework which compresses knowledge of a teacher model into a student model adaptively according to its recommendation scene by using differentiable Neural Architecture Search (NAS). Specifically, we introduce a target oriented distillation loss to guide the structure search process for finding the student network architecture, and a cost sensitive loss as constraints for model size, which achieves a superior trade off between recommendation effectiveness and efficiency. In addition, we leverage Earth Mover's Distance (EMD) to realize many to many layer mapping during knowledge distillation, which enables each intermediate student layer to learn from other intermediate teacher layers adaptively. Extensive experiments on real world recommendation datasets demonstrate that our model achieves competitive or better accuracy with notable inference speedup comparing to strong counterparts, while discovering diverse neural architectures for sequential recommender models under different recommendation scenes.


Rate of coalescence of pairs of lineages in the spatial lambda Fleming Viot process. We revisit the spatial lambda Fleming Viot process introduced in 1 . Particularly, we are interested in the time T 0 to the most recent common ancestor for two lineages. We distinguish between the case where the process acts on the entire two dimensional plane, and on a finite rectangle. Utilizing a differential equation linking T 0 with the physical distance between the lineages, we arrive at simple and reasonably accurate approximation schemes for both cases. Furthermore, our analysis enables us to address the question of whether the genealogical process of the model "comes down from infinity", which has been partly answered before in 2 .


On Expressivity and Trainability of Quadratic Networks. Inspired by the diversity of biological neurons, quadratic artificial neurons can play an important role in deep learning models. The type of quadratic neurons of our interest replaces the inner product operation in the conventional neuron with a quadratic function. Despite promising results so far achieved by networks of quadratic neurons, there are important issues not well addressed. Theoretically, the superior expressivity of a quadratic network over either a conventional network or a conventional network via quadratic activation is not fully elucidated, which makes the use of quadratic networks not well grounded. Practically, although a quadratic network can be trained via generic backpropagation, it can be subject to a higher risk of collapse than the conventional counterpart. To address these issues, we first apply the spline theory and a measure from algebraic geometry to give two theorems that demonstrate better model expressivity of a quadratic network than the conventional counterpart with or without quadratic activation. Then, we propose an effective and efficient training strategy referred to as ReLinear to stabilize the training process of a quadratic network, thereby unleashing the full potential in its associated machine learning tasks. Comprehensive experiments on popular datasets are performed to support our findings and evaluate the performance of quadratic deep learning.


On the Foundation of Sparse Sensing (Part II) Diophantine Sampling and Array Configuration. In the second part of the series papers, we set out to study the algorithmic efficiency of sparse sensing. Stemmed from co prime sensing, we propose a generalized framework, termed Diophantine sensing, which utilizes generic Diophantine equation theory and higher order sparse ruler to strengthen the sampling time, the degree of freedom (DoF), and the sampling sparsity, simultaneously. Resorting to higher moment statistics, the proposed Diophantine framework presents two fundamental improvements. First, on frequency estimation, we prove that given arbitrarily large down sampling rates, there exist sampling schemes where the number of samples needed is only proportional to the sum of DoF and the number of snapshots required, which implies a linear sampling time. Second, on Direction of arrival (DoA) estimation, we propose two generic array constructions such that given N sensors, the minimal distance between sensors can be as large as a polynomial of N, O(N q), which indicates that an arbitrarily sparse array (with arbitrarily small mutual coupling) exists given sufficiently many sensors. In addition, asymptotically, the proposed array configurations produce the best known DoF bound compared to existing sparse array designs.