Discovering Diverse Multi Agent Strategic Behavior via Reward Randomization. We propose a simple, general and effective technique, Reward Randomization for discovering diverse strategic policies in complex multi agent games. Combining reward randomization and policy gradient, we derive a new algorithm, Reward Randomized Policy Gradient (RPG). RPG is able to discover multiple distinctive human interpretable strategies in challenging temporal trust dilemmas, including grid world games and a real world game Agar.io, where multiple equilibria exist but standard multi agent policy gradient algorithms always converge to a fixed one with a sub optimal payoff for every player even using state of the art exploration techniques. Furthermore, with the set of diverse strategies from RPG, we can (1) achieve higher payoffs by fine tuning the best policy from the set and (2) obtain an adaptive agent by using this set of strategies as its training opponents. The source code and example videos can be found in our website https sites.google.com view staghuntrpg.


Representative volume elements for matrix inclusion composites a computational study on periodizing the ensemble. We investigate volume element sampling strategies for the stochastic homogenization of particle reinforced composites and show, via computational experiments, that an improper treatment of particles intersecting the boundary of the computational cell may affect the accuracy of the computed effective properties. Motivated by recent results on a superior convergence rate of the systematic error for periodized ensembles compared to taking snapshots of ensembles, we conduct computational experiments for microstructures with circular, spherical and cylindrical inclusions and monitor the systematic errors in the effective thermal conductivity for snapshots of ensembles compared to working with microstructures sampled from periodized ensembles. We observe that the standard deviation of the apparent properties computed on microstructures sampled from the periodized ensembles decays at the scaling expected from the central limit theorem. In contrast, the standard deviation for the snapshot ensembles shows an inferior decay rate at high filler content. The latter effect is caused by additional long range correlations that necessarily appear in particle reinforced composites at high, industrially relevant, volume fractions. Periodized ensembles, however, appear to be less affected by these correlations. Our findings provide guidelines for working with digital volume images of material microstructures and the design of representative volume elements for computational homogenization.


The classification of Kleinian groups of Hausdorff dimensions at most one and Burnside's conjecture. In this paper we provide the complete classification of convex cocompact Kleinian group of Hausdorff dimensions less than 1. In particular, we prove that every convex cocompact Kleinian group of Hausdorff dimension 1 is a classical Schottky group. This upper bound is sharp. The result implies that the converse of Burside's conjecture cite Burside is true All non classical Schottky groups must have Hausdorff dimension ge1 . The prove of the theorem relies on the result of Hou cite Hou .


Three dimensional supersonic flows of Euler Poisson system for potential flow. We prove the unique existence of supersonic solutions of the Euler Poisson system for potential flow in a three dimensional rectangular cylinder when prescribing the velocity and the strength of electric field at the entrance. Overall, the main framework is similar to 1 , but there are several technical differences to be taken care of vary carefully. And, it is our main goal to treat all the technical differences occurring when one considers a three dimensional supersonic solution of the steady Euler Poisson system.


TLDR Twin Learning for Dimensionality Reduction. Dimensionality reduction methods are unsupervised approaches which learn low dimensional spaces where some properties of the initial space, typically the notion of "neighborhood", are preserved. They are a crucial component of diverse tasks like visualization, compression, indexing, and retrieval. Aiming for a totally different goal, self supervised visual representation learning has been shown to produce transferable representation functions by learning models that encode invariance to artificially created distortions, e.g. a set of hand crafted image transformations. Unlike manifold learning methods that usually require propagation on large k NN graphs or complicated optimization solvers, self supervised learning approaches rely on simpler and more scalable frameworks for learning. In this paper, we unify these two families of approaches from the angle of manifold learning and propose TLDR, a dimensionality reduction method for generic input spaces that is porting the simple self supervised learning framework of Barlow Twins to a setting where it is hard or impossible to define an appropriate set of distortions by hand. We propose to use nearest neighbors to build pairs from a training set and a redundancy reduction loss borrowed from the self supervised literature to learn an encoder that produces representations invariant across such pairs. TLDR is a method that is simple, easy to implement and train, and of broad applicability it consists of an offline nearest neighbor computation step that can be highly approximated, and a straightforward learning process that does not require mining negative samples to contrast, eigendecompositions, or cumbersome optimization solvers. By replacing PCA with TLDR, we are able to increase the performance of GeM AP by 4 mAP for 128 dimensions, and to retain its performance with 16x fewer dimensions.


From Zero Shot Machine Learning to Zero Day Attack Detection. The standard ML methodology assumes that the test samples are derived from a set of pre observed classes used in the training phase. Where the model extracts and learns useful patterns to detect new data samples belonging to the same data classes. However, in certain applications such as Network Intrusion Detection Systems, it is challenging to obtain data samples for all attack classes that the model will most likely observe in production. ML based NIDSs face new attack traffic known as zero day attacks, that are not used in the training of the learning models due to their non existence at the time. In this paper, a zero shot learning methodology has been proposed to evaluate the ML model performance in the detection of zero day attack scenarios. In the attribute learning stage, the ML models map the network data features to distinguish semantic attributes from known attack (seen) classes. In the inference stage, the models are evaluated in the detection of zero day attack (unseen) classes by constructing the relationships between known attacks and zero day attacks. A new metric is defined as Zero day Detection Rate, which measures the effectiveness of the learning model in the inference stage. The results demonstrate that while the majority of the attack classes do not represent significant risks to organisations adopting an ML based NIDS in a zero day attack scenario. However, for certain attack groups identified in this paper, such systems are not effective in applying the learnt attributes of attack behaviour to detect them as malicious. Further Analysis was conducted using the Wasserstein Distance technique to measure how different such attacks are from other attack types used in the training of the ML model. The results demonstrate that sophisticated attacks with a low zero day detection rate have a significantly distinct feature distribution compared to the other attack classes.


100 GHz Micrometer compact broadband Monolithic ITO Mach Zehnder Interferometer Modulator enabling 3500 times higher Packing Density. Electro optic modulators provide a key function in optical transceivers and increasingly in photonic programmable Application Specific Integrated Circuits (ASICs) for machine learning and signal processing. However, both foundry ready silicon based modulators and conventional material based devices utilizing Lithium niobate fall short in simultaneously providing high chip packaging density and fast speed. Current driven ITO based modulators have the potential to achieve both enabled by efficient light matter interactions. Here, we introduce micrometer compact Mach Zehnder Interferometer (MZI) based modulators capable of exceeding 100 GHz switching rates. Integrating ITO thin films atop a photonic waveguide, spectrally broadband, and compact MZI phase shifter. Remarkably, this allows integrating more than 3500 of these modulators within the same chip area as only one single silicon MZI modulator. The modulator design introduced here features a holistic photonic, electronic, and RF based optimization and includes an asymmetric MZI tuning step to optimize the Extinction Ratio (ER) to Insertion Loss (IL) and dielectric thickness sweep to balance the tradeoffs between ER and speed. Driven by CMOS compatible bias voltage levels, this device is the first to address next generation modulator demands for processors of the machine intelligence revolution, in addition to the edge and cloud computing demands as well as optical transceivers alike.


The growth of COVID 19 scientific literature A forecast analysis of different daily time series in specific settings. We present a forecasting analysis on the growth of scientific literature related to COVID 19 expected for 2021. Considering the paramount scientific and financial efforts made by the research community to find solutions to end the COVID 19 pandemic, an unprecedented volume of scientific outputs is being produced. This questions the capacity of scientists, politicians and citizens to maintain infrastructure, digest content and take scientifically informed decisions. A crucial aspect is to make predictions to prepare for such a large corpus of scientific literature. Here we base our predictions on the ARIMA model and use two different data sources the Dimensions and World Health Organization COVID 19 databases. These two sources have the particularity of including in the metadata information the date in which papers were indexed. We present global predictions, plus predictions in three specific settings type of access (Open Access), NLM source (PubMed and PMC), and domain specific repository (SSRN and MedRxiv). We conclude by discussing our findings.


Proceedings of the 29th International Symposium on Graph Drawing and Network Visualization (GD 2021). This is the arXiv index for the electronic proceedings of GD 2021, which contains the peer reviewed and revised accepted papers with an optional appendix. Proceedings (without appendices) are also to be published by Springer in the Lecture Notes in Computer Science series.


ProphetNet X Large Scale Pre training Models for English, Chinese, Multi lingual, Dialog, and Code Generation. Now, the pre training technique is ubiquitous in natural language processing field. ProphetNet is a pre training based natural language generation method which shows powerful performance on English text summarization and question generation tasks. In this paper, we extend ProphetNet into other domains and languages, and present the ProphetNet family pre training models, named ProphetNet X, where X can be English, Chinese, Multi lingual, and so on. We pre train a cross lingual generation model ProphetNet Multi, a Chinese generation model ProphetNet Zh, two open domain dialog generation models ProphetNet Dialog En and ProphetNet Dialog Zh. And also, we provide a PLG (Programming Language Generation) model ProphetNet Code to show the generation performance besides NLG (Natural Language Generation) tasks. In our experiments, ProphetNet X models achieve new state of the art performance on 10 benchmarks. All the models of ProphetNet X share the same model structure, which allows users to easily switch between different models. We make the code and models publicly available, and we will keep updating more pre training models and finetuning scripts.


Dynamics and Sensitivity of Signaling Pathways. Signaling pathways serve to communicate information about extracellular conditions into the cell, to both the nucleus and cytoplasmic processes to control cell responses. Genetic mutations in signaling network components are frequently associated with cancer and can result in cells acquiring an ability to divide and grow uncontrollably. Because signaling pathways play such a significant role in cancer initiation and advancement, their constituent proteins are attractive therapeutic targets. In this review, we discuss how signaling pathway modeling can assist with identifying effective drugs for treating diseases, such as cancer. An achievement that would facilitate the use of such models is their ability to identify controlling biochemical parameters in signaling pathways, such as molecular abundances and chemical reaction rates, because this would help determine effective points of attack by therapeutics.


Decarbonising the EU Power Sector a Technological and Socio economic Analysis and the Role of Nuclear. Low carbon electricity is a key enabler in combating climate change. Decarbonising the power sector is now at the centre of global and European policies. As the IPCC highlights, pathways where the power sector rapidly decarbonises by 2030 have higher chances of keeping global warming below 1.5 circ C. The electricity sector should be fully decarbonised by 2050 to meet either the 1.5 circ C or 2 circ C targets. This means that EU policy efforts should focus on supporting a maximum reduction of emissions per unit of electricity by 2030 and net zero emissions by 2050. Reaching these targets is one of the most pressing questions EU policymakers face today. In light of the COVID 19 crisis, EU policies should guide a cost effective, reliable and environmentally sound transition of the power sector, benefiting EU research and innovation and its citizens. This meta analysis provides a novel view on historical data and compares data from modelling scenarios identified in the literature. It assesses the current and future role of nuclear energy in decarbonizing the EU power sector, while reviewing socio economic implications that could arise if limited public support nearly excludes nuclear fission electricity from the future EU power mix. This work highlights relevant socio economic policy implications and actionable policy recommendations.


Virtual Reality based Digital Twin System for remote laboratories and online practical learning. There is a need for remote learning and virtual learning applications such as virtual reality (VR) and tablet based solutions which the current pandemic has demonstrated. Creating complex learning scenarios by developers is highly time consuming and can take over a year. There is a need to provide a simple method to enable lecturers to create their own content for their laboratory tutorials. Research is currently being undertaken into developing generic models to enable the semi automatic creation of a virtual learning application. A case study describing the creation of a virtual learning application for an electrical laboratory tutorial is presented.


Poisson Approximation to Weighted Sums of Independent Random Variables. This paper deals with Poisson approximation to weighted sums of double indexed independent random variables using Stein's method. The obtained results improved the existing bounds. As applications, limit theorems for sums of weighted Bernoulli and geometric random variables are discussed.


Unmasking the mask studies why the effectiveness of surgical masks in preventing respiratory infections has been underestimated. Face masks have been widely used as a protective measure against COVID 19. However, pre pandemic empirical studies have produced mixed statistical results on the effectiveness of masks against respiratory viruses. The implications of the studies' recognized limitations have not been quantitatively and statistically analyzed, leading to confusion regarding the effectiveness of masks. Such confusion may have contributed to organizations such as the WHO and CDC initially not recommending that the general public wear masks. Here we show that when the adherence to mask usage guidelines is taken into account, the empirical evidence indicates that masks prevent disease transmission all studies we analyzed that did not find surgical masks to be effective were under powered to such an extent that even if masks were 100 effective, the studies in question would still have been unlikely to find a statistically significant effect. We also provide a framework for understanding the effect of masks on the probability of infection for single and repeated exposures. The framework demonstrates that more frequently wearing a mask provides super linearly compounding protection, as does both the susceptible and infected individual wearing a mask. This work shows (1) that both theoretical and empirical evidence is consistent with masks protecting against respiratory infections and (2) that nonlinear effects and statistical considerations regarding the percentage of exposures for which masks are worn must be taken into account when designing empirical studies and interpreting their results.


Influence of sampling on the convergence rates of greedy algorithms for parameter dependent random variables. The main focus of this article is to provide a mathematical study of the algorithm proposed in cite boyaval2010variance where the authors proposed a variance reduction technique for the computation of parameter dependent expectations using a reduced basis paradigm. We study the effect of Monte Carlo sampling on the theoretical properties of greedy algorithms. In particular, using concentration inequalities for the empirical measure in Wasserstein distance proved in cite fournier2015rate , we provide sufficient conditions on the number of samples used for the computation of empirical variances at each iteration of the greedy procedure to guarantee that the resulting method algorithm is a weak greedy algorithm with high probability. These theoretical results are not fully practical and we therefore propose a heuristic procedure to choose the number of Monte Carlo samples at each iteration, inspired from this theoretical study, which provides satisfactory results on several numerical test cases.


CASSOD Net Cascaded and Separable Structures of Dilated Convolution for Embedded Vision Systems and Applications. The field of view (FOV) of convolutional neural networks is highly related to the accuracy of inference. Dilated convolutions are known as an effective solution to the problems which require large FOVs. However, for general purpose hardware or dedicated hardware, it usually takes extra time to handle dilated convolutions compared with standard convolutions. In this paper, we propose a network module, Cascaded and Separable Structure of Dilated (CASSOD) Convolution, and a special hardware system to handle the CASSOD networks efficiently. A CASSOD Net includes multiple cascaded 2 times 2 dilated filters, which can be used to replace the traditional 3 times 3 dilated filters without decreasing the accuracy of inference. Two example applications, face detection and image segmentation, are tested with dilated convolutions and the proposed CASSOD modules. The new network for face detection achieves higher accuracy than the previous work with only 47 of filter weights in the dilated convolution layers of the context module. Moreover, the proposed hardware system can accelerate the computations of dilated convolutions, and it is 2.78 times faster than traditional hardware systems when the filter size is 3 times 3 .


Non Autoregressive Translation by Learning Target Categorical Codes. Non autoregressive Transformer is a promising text generation model. However, current non autoregressive models still fall behind their autoregressive counterparts in translation quality. We attribute this accuracy gap to the lack of dependency modeling among decoder inputs. In this paper, we propose CNAT, which learns implicitly categorical codes as latent variables into the non autoregressive decoding. The interaction among these categorical codes remedies the missing dependencies and improves the model capacity. Experiment results show that our model achieves comparable or better performance in machine translation tasks, compared with several strong baselines.


Qualitative analysis of a mathematical model for Xylella fastidiosa epidemics. In Southern Italy, since 2013, there has been an ongoing Olive Quick Decline Syndrome (OQDS) outbreak, due to the bacterium Xylella fastidiosa. In a couple of previous papers, the authors have proposed a mathematical approach for identifying possible control strategies for eliminating or at least reduce the economic impact of such event. The main players involved in OQDS are represented by the insect vector, Philaenus spumarius, its host plants (olive trees and weeds) and the bacterium, X. fastidiosa. A basic mathematical model has been expressed in terms of a system of ordinary differential equations a preliminary analysis already provided interesting results about possible control strategies within an integrated pest management framework, not requiring the removal of the productive resource represented by the olive trees. The same conjectures have been later confirmed by analyzing the impact of possible spatial heterogeneities on controlling a X. fastidiosa epidemic. These encouraging facts have stimulated a more detailed and rigorous mathematical analysis of the same system, as presented in this paper. A clear picture of the possible steady states (equilibria) and their stability properties has been outlined, within a variety of different parameter scenarios, for the original spatially homogeneous ecosystem. The results obtained here confirm, in a mathematically rigorous way, what had been conjectured in the previous papers, i.e. that the removal of a suitable amount of weed biomass (reservoir of the juvenile stages of the insect vector of X. fastidiosa from olive orchards and surrounding areas is the most acceptable strategy to control the spread of the OQDS. In addition, as expected, the adoption of more resistant olive tree cultivars has been shown to be a good strategy, though less cost effective, in controlling the pathogen.


K stable Fano threefolds of rank 2 and degree 30. We find all K stable smooth Fano threefolds in the family No. 2.22.


Boosting RANSAC via Dual Principal Component Pursuit. In this paper, we revisit the problem of local optimization in RANSAC. Once a so far the best model has been found, we refine it via Dual Principal Component Pursuit (DPCP), a robust subspace learning method with strong theoretical support and efficient algorithms. The proposed DPCP RANSAC has far fewer parameters than existing methods and is scalable. Experiments on estimating two view homographies, fundamental and essential matrices, and three view homographic tensors using large scale datasets show that our approach consistently has higher accuracy than state of the art alternatives.


Smallest non cyclic quotients of braid and mapping class groups. We show that the smallest non cyclic quotients of braid groups are symmetric groups, proving a conjecture of Margalit. Moreover we recover results of Artin and Lin about the classification of homomorphisms from braid groups on n strands to symmetric groups on k letters, where k is at most n. Unlike the original proofs, our method does not use the Bertrand Chebyshev theorem, answering a question of Artin. Similarly for mapping class group of closed orientable surfaces, the smallest non cyclic quotient is given by the mod two reduction of the symplectic representation. We provide an elementary proof of this result, originally due to Kielak Pierro, which proves a conjecture of Zimmermann.


On the differential transcendentality of the Morita p adic gamma function. In this note we prove that for any given prime number p the Morita p adic gamma function Gamma p is differentially transcendental over mathbb C p(X) .


LANTENNA Exfiltrating Data from Air Gapped Networks via Ethernet Cables. Air gapped networks are wired with Ethernet cables since wireless connections are strictly prohibited. In this paper we present LANTENNA a new type of electromagnetic attack allowing adversaries to leak sensitive data from isolated, air gapped networks. Malicious code in air gapped computers gathers sensitive data and then encodes it over radio waves emanating from the Ethernet cables, using them as antennas. A nearby receiving device can intercept the signals wirelessly, decode the data, and send it to the attacker. We discuss the exfiltration techniques, examine the covert channel characteristics, and provide implementation details. Notably, the malicious code can run in an ordinary user mode process and successfully operate from within a virtual machine. We evaluate the covert channel in different scenarios and present a set of countermeasures. Our experiments show that with the LANTENNA attack, data can be exfiltrated from air gapped computers to a distance of several meters away.


Bounding the Last Mile Efficient Learned String Indexing. We introduce the RadixStringSpline (RSS) learned index structure for efficiently indexing strings. RSS is a tree of radix splines each indexing a fixed number of bytes. RSS approaches or exceeds the performance of traditional string indexes while using 7 70 times less memory. RSS achieves this by using the minimal string prefix to sufficiently distinguish the data unlike most learned approaches which index the entire string. Additionally, the bounded error nature of RSS accelerates the last mile search and also enables a memory efficient hash table lookup accelerator. We benchmark RSS on several real world string datasets against ART and HOT. Our experiments suggest this line of research may be promising for future memory intensive database applications.


Haldane's asymptotics for Supercritical Branching Processes in an iid Random Environment. Branching processes in a random environment are a natural generalisation of Galton Watson processes. In this paper we analyse the asymptotic decay of the survival probability for a sequence of slightly supercritical branching processes in a random environment, where the offspring expectation converges from above to 1 . We prove that Haldane's asymptotics, known from classical Galton Watson processes, turns up again in the random environment case, provided that one stays away from the critical or subcritical regimes. A central building block is a connection to and a limit theorem for perpetuities with asymptotically vanishing interest rates.


Annihilators of local cohomology modules via a classification theorem of the dominant resolving subcategories. This paper investigates when local cohomology modules have an annihilator that does not depend on the choice of an ideal. Takahashi classified the dominant resolving subcategories of the category of finitely generated modules over a commutative Noetherian ring. We show that his classification theorem describes annihilation results of local cohomology modules over a finite dimensional ring with certain assumptions or a Cohen Macaulay ring.


R PCC A Baseline for Range Image based Point Cloud Compression. In autonomous vehicles or robots, point clouds from LiDAR can provide accurate depth information of objects compared with 2D images, but they also suffer a large volume of data, which is inconvenient for data storage or transmission. In this paper, we propose a Range image based Point Cloud Compression method, R PCC, which can reconstruct the point cloud with uniform or non uniform accuracy loss. We segment the original large scale point cloud into small and compact regions for spatial redundancy and salient region classification. Compared with other voxel based or image based compression methods, our method can keep and align all points from the original point cloud in the reconstructed point cloud. It can also control the maximum reconstruction error for each point through a quantization module. In the experiments, we prove that our easier FPS based segmentation method can achieve better performance than instance based segmentation methods such as DBSCAN. To verify the advantages of our proposed method, we evaluate the reconstruction quality and fidelity for 3D object detection and SLAM, as the downstream tasks. The experimental results show that our elegant framework can achieve 30 times compression ratio without affecting downstream tasks, and our non uniform compression framework shows a great improvement on the downstream tasks compared with the state of the art large scale point cloud compression methods. Our real time method is efficient and effective enough to act as a baseline for range image based point cloud compression. The code is available on https github.com StevenWang30 R PCC.git.


On the Markov extremal problem in the L 2 norm with the classical weight functions. This paper is devoted to Markov's extremal problems of the form M n,k sup p in PP n setminus 0 p (k) X p X (1 le k le n) , where PP n is the set of all algebraic polynomials of degree at most n and X is a normed space, starting with original Markov's result in uniform norm on X C 1,1 from the end of the 19th century. The central part is devoted to extremal problems on the space X L 2 (a,b) w for the classical weights w on ( 1,1) , (0, infty) and ( infty, infty) . Beside a short account on basic properties of the (classical) orthogonal polynomials on the real line, the explicit formulas for expressing k th derivative of the classical orthonormal polynomials in terms of the same polynomials are presented, which are important in our study of this kind of extremal problems, using methods of linear algebra. Several results for all cases of the classical weights, including algorithms for numerical computation of the best constants M n,k , as well as their lower and upper bounds, asymptotic behaviour, etc., are also given. Finally, some results on Markov's extremal problems on certain restricted classes of polynomials are also mentioned.


Rethinking InfoNCE How Many Negative Samples Do You Need?. InfoNCE loss is a widely used loss function for contrastive model training. It aims to estimate the mutual information between a pair of variables by discriminating between each positive pair and its associated K negative pairs. It is proved that when the sample labels are clean, the lower bound of mutual information estimation is tighter when more negative samples are incorporated, which usually yields better model performance. However, in many real world tasks the labels often contain noise, and incorporating too many noisy negative samples for model training may be suboptimal. In this paper, we study how many negative samples are optimal for InfoNCE in different scenarios via a semi quantitative theoretical framework. More specifically, we first propose a probabilistic model to analyze the influence of the negative sampling ratio K on training sample informativeness. Then, we design a training effectiveness function to measure the overall influence of training samples on model learning based on their informativeness. We estimate the optimal negative sampling ratio using the K value that maximizes the training effectiveness function. Based on our framework, we further propose an adaptive negative sampling method that can dynamically adjust the negative sampling ratio to improve InfoNCE based model training. Extensive experiments on different real world datasets show our framework can accurately predict the optimal negative sampling ratio in different tasks, and our proposed adaptive negative sampling method can achieve better performance than the commonly used fixed negative sampling ratio strategy.


Multilingual Code Switching for Zero Shot Cross Lingual Intent Prediction and Slot Filling. Predicting user intent and detecting the corresponding slots from text are two key problems in Natural Language Understanding (NLU). In the context of zero shot learning, this task is typically approached by either using representations from pre trained multilingual transformers such as mBERT, or by machine translating the source data into the known target language and then fine tuning. Our work focuses on a particular scenario where the target language is unknown during training. To this goal, we propose a novel method to augment the monolingual source data using multilingual code switching via random translations to enhance a transformer's language neutrality when fine tuning it for a downstream task. This method also helps discover novel insights on how code switching with different language families around the world impact the performance on the target language. Experiments on the benchmark dataset of MultiATIS yielded an average improvement of 4.2 in accuracy for intent task and 1.8 in F1 for slot task using our method over the state of the art across 8 different languages. Furthermore, we present an application of our method for crisis informatics using a new human annotated tweet dataset of slot filling in English and Haitian Creole, collected during Haiti earthquake disaster.


A closed loop gradient descent algorithm applied to Rosenbrock's function. We introduce a novel adaptive damping technique for an inertial gradient system which finds application as a gradient descent algorithm for unconstrained optimisation. In an example using the non convex Rosenbrock's function, we show an improvement on existing momentum based gradient optimisation methods. Also using Lyapunov stability analysis, we demonstrate the performance of the continuous time version of the algorithm. Using numerical simulations, we consider the performance of its discrete time counterpart obtained by using the symplectic Euler method of discretisation.


Positive least energy solutions for k coupled Schr "odinger system with critical exponent the higher dimension and cooperative case. In this paper, we study the following k coupled nonlinear Schr "odinger system with Sobolev critical exponent begin equation left begin aligned Delta u i lambda iu i mu i u i 2 1 sum j 1,j ne i k beta ij u i frac 2 2 1 u j frac 2 2 quad hbox in Omega, newline u i 0 quad hbox in Omega quad hbox and quad u i 0 quad hbox on partial Omega, quad i 1,2, cdots, k. end aligned right. end equation Here Omega subset mathbb R N is a smooth bounded domain, 2 frac 2N N 2 is the Sobolev critical exponent, lambda 1( Omega) lambda i 0, mu i 0 and beta ij beta ji ne 0 , where lambda 1( Omega) is the first eigenvalue of Delta with the Dirichlet boundary condition. We characterize the positive least energy solution of the k coupled system for the purely cooperative case beta ij 0 , in higher dimension N ge 5 . Since the k coupled case is much more delicated, we shall introduce the idea of induction. We point out that the key idea is to give a more accurate upper bound of the least energy. It's interesting to see that the least energy of the k coupled system decreases as k grows. Moreover, we establish the existence of positive least energy solution of the limit system in mathbb R N , as well as classification results.


Delay Bounded Scheduling Without Delay! (Extended Technical Report). We consider the broad problem of analyzing safety properties of asynchronous concurrent programs under arbitrary thread interleavings. Delay bounded deterministic scheduling, introduced in prior work, is an efficient bug finding technique to curb the large cost associated with full scheduling nondeterminism. In this paper we first present a technique to lift the delay bound for the case of finite domain variable programs, thus adding to the efficiency of bug detection the ability to prove safety of programs under arbitrary thread interleavings. Second, we demonstrate how, combined with predicate abstraction, our technique can both refute and verify safety properties of programs with unbounded variable domains, even for unbounded thread counts. Previous work has established that, for non trivial concurrency routines, predicate abstraction induces a highly complex abstract program semantics. Our technique, however, never statically constructs an abstract parametric program it only requires some abstract states set to be closed under certain actions, thus eliminating the dependence on the existence of verification algorithms for abstract programs. We demonstrate the efficiency of our technique on many examples used in prior work, and showcase its simplicity compared to earlier approaches on the unbounded thread Ticket Lock protocol.


Deep neural network methods for solving forward and inverse problems of time fractional diffusion equations with conformable derivative. Physics informed neural networks (PINNs) show great advantages in solving partial differential equations. In this paper, we for the first time propose to study conformable time fractional diffusion equations by using PINNs. By solving the supervise learning task, we design a new spatio temporal function approximator with high data efficiency. L BFGS algorithm is used to optimize our loss function, and back propagation algorithm is used to update our parameters to give our numerical solutions. For the forward problem, we can take IC BCs as the data, and use PINN to solve the corresponding partial differential equation. Three numerical examples are are carried out to demonstrate the effectiveness of our methods. In particular, when the order of the conformable fractional derivative alpha tends to 1 , a class of weighted PINNs is introduced to overcome the accuracy degradation caused by the singularity of solutions. For the inverse problem, we use the data obtained to train the neural network, and the estimation of parameter lambda in the equation is elaborated. Similarly, we give three numerical examples to show that our method can accurately identify the parameters, even if the training data is corrupted with 1 uncorrelated noise.


QWin Enforcing Tail Latency SLO at Shared Storage Backend. Consolidating latency critical (LC) and best effort (BE) tenants at storage backend helps to increase resources utilization. Even if tenants use dedicated queues and threads to achieve performance isolation, threads are still contend for CPU cores. Therefore, we argue that it is necessary to partition cores between LC and BE tenants, and meanwhile each core is dedicated to run a thread. Expect for frequently changing bursty load, fluctuated service time at storage backend also drastically changes the need of cores. In order to guarantee tail latency service level objectives (SLOs), the abrupt changing need of cores must be satisfied immediately. Otherwise, tail latency SLO violation happens. Unfortunately, partitioning based approaches lack the ability to react the changing need of cores, resulting in extreme spikes in latency and SLO violation happens. In this paper, we present QWin, a tail latency SLO aware core allocation to enforce tail latency SLO at shared storage backend. QWin consists of an SLO to core calculation model that accurately calculates the number of cores combining with definitive runtime load determined by a flexible request based window, and an autonomous core allocation that adjusts cores at adaptive frequency by dynamically changing core policies. When consolidating multiple LC and BE tenants, QWin outperforms the state of the art approaches in guaranteeing tail latency SLO for LC tenants and meanwhile increasing bandwidth of BE tenants by up to 31x.


PR Net Preference Reasoning for Personalized Video Highlight Detection. Personalized video highlight detection aims to shorten a long video to interesting moments according to a user's preference, which has recently raised the community's attention. Current methods regard the user's history as holistic information to predict the user's preference but negating the inherent diversity of the user's interests, resulting in vague preference representation. In this paper, we propose a simple yet efficient preference reasoning framework (PR Net) to explicitly take the diverse interests into account for frame level highlight prediction. Specifically, distinct user specific preferences for each input query frame are produced, presented as the similarity weighted sum of history highlights to the corresponding query frame. Next, distinct comprehensive preferences are formed by the user specific preferences and a learnable generic preference for more overall highlight measurement. Lastly, the degree of highlight and non highlight for each query frame is calculated as semantic similarity to its comprehensive and non highlight preferences, respectively. Besides, to alleviate the ambiguity due to the incomplete annotation, a new bi directional contrastive loss is proposed to ensure a compact and differentiable metric space. In this way, our method significantly outperforms state of the art methods with a relative improvement of 12 in mean accuracy precision.


The Turan problems of directed paths and cycles in digraphs. Let overrightarrow P k and overrightarrow C k denote the directed path and the directed cycle of order k , respectively. In this paper, we determine the precise maximum size of overrightarrow P k free digraphs of order n as well as the extremal digraphs attaining the maximum size for large n . For all n , we also determine the precise maximum size of overrightarrow C k free digraphs of order n as well as the extremal digraphs attaining the maximum size. In addition, Huang and Lyu textit Discrete Math. 343(5) 2020 characterized the extremal digraphs avoiding an orientation of C 4 . For all other orientations of C 4 , we also study the maximum size and the extremal digraphs avoiding them.


Depth lower bounds in Stabbing Planes for combinatorial principles. Stabbing Planes (also known as Branch and Cut) is a proof system introduced very recently which, informally speaking, extends the DPLL method by branching on integer linear inequalities instead of single variables. The techniques known so far to prove size and depth lower bounds for Stabbing Planes are generalizations of those used for the Cutting Planes proof system established via communication complexity arguments. As such they work for the lifted version of combinatorial statements. Rank lower bounds for Cutting Planes are also obtained by geometric arguments called protection lemmas. In this work we introduce two new geometric approaches to prove size depth lower bounds in Stabbing Planes working for any formula (1) the antichain method, relying on Sperner's Theorem and (2) the covering method which uses results on essential coverings of the boolean cube by linear polynomials, which in turn relies on Alon's combinatorial Nullenstellensatz. We demonstrate their use on classes of combinatorial principles such as the Pigeonhole principle, the Tseitin contradictions and the Linear Ordering Principle. By the first method we prove almost linear size lower bounds and optimal logarithmic depth lower bounds for the Pigeonhole principle and analogous lower bounds for the Tseitin contradictions over the complete graph and for the Linear Ordering Principle. By the covering method we obtain a superlinear size lower bound and a logarithmic depth lower bound for Stabbing Planes proof of Tseitin contradictions over a grid graph.


Cohomologies and generalized derivation extensions of n Lie algebras. A cohomology theory, associated to a n Lie algebra and a representation space of it, is introduced. It is observed that this cohomology theory is qualified to encode the generalized derivation extensions, and that it coincides, for n 3 , with the known cohomology of n Lie algebras. The abelian extensions and infinitesimal deformations of n Lie algebras, on the other hand, are shown to be characterized by the usual cohomology of n Lie algebras. Furthermore, the Hochschild Serre spectral sequence of the Lie algebra cohomology is upgraded to the level of n Lie algebras, and is applied to the cohomology of generalized derivation extensions.


On the price of explainability for some clustering problems. The price of explainability for a clustering task can be defined as the unavoidable loss,in terms of the objective function, if we force the final partition to be explainable. Here, we study this price for the following clustering problems k means, k medians, k centers and maximum spacing. We provide upper and lower bounds for a natural model where explainability is achieved via decision trees. For the k means and k medians problems our upper bounds improve those obtained by Moshkovitz et. al, ICML 20 for low dimensions. Another contribution is a simple and efficient algorithm for building explainable clusterings for the k means problem. We provide empirical evidence that its performance is better than the current state of the art for decision tree based explainable clustering.


Learning Visual Models using a Knowledge Graph as a Trainer. Traditional computer vision approaches, based on neural networks (NN), are typically trained on a large amount of image data. By minimizing the cross entropy loss between a prediction and a given class label, the NN and its visual embedding space are learned to fulfill a given task. However, due to the sole dependence on the image data distribution of the training domain, these models tend to fail when applied to a target domain that differs from their source domain. To learn a more robust NN to domain shifts, we propose the knowledge graph neural network (KG NN), a neuro symbolic approach that supervises the training using image data invariant auxiliary knowledge. The auxiliary knowledge is first encoded in a knowledge graph with respective concepts and their relationships, which is then transformed into a dense vector representation via an embedding method. Using a contrastive loss function, KG NN learns to adapt its visual embedding space and thus its weights according to the image data invariant knowledge graph embedding space. We evaluate KG NN on visual transfer learning tasks for classification using the mini ImageNet dataset and its derivatives, as well as road sign recognition datasets from Germany and China. The results show that a visual model trained with a knowledge graph as a trainer outperforms a model trained with cross entropy in all experiments, in particular when the domain gap increases. Besides better performance and stronger robustness to domain shifts, these KG NN adapts to multiple datasets and classes without suffering heavily from catastrophic forgetting.


Error State Extended Kalman Filter Multi Sensor Fusion for Unmanned Aerial Vehicle Localization in GPS and Magnetometer Denied Indoor Environments. This paper addresses the issues of unmanned aerial vehicle (UAV) indoor navigation, specifically in areas where GPS and magnetometer sensor measurements are unavailable or unreliable. The proposed solution is to use an error state extended Kalman filter (ES EKF) in the context of multi sensor fusion. Its implementation is adapted to fuse measurements from multiple sensor sources and the state model is extended to account for sensor drift and possible calibration inaccuracies. Experimental validation is performed by fusing IMU data obtained from the PixHawk 2.1 flight controller with pose measurements from LiDAR Cartographer SLAM, visual odometry provided by the Intel T265 camera and position measurements from the Pozyx UWB indoor positioning system. The estimated odometry from ES EKF is validated against ground truth data from the Optitrack motion capture system and its use in a position control loop to stabilize the UAV is demonstrated.


A privacy preserving approach to streaming eye tracking data. Eye tracking technology is being increasingly integrated into mixed reality devices. Although critical applications are being enabled, there are significant possibilities for violating user privacy expectations. We show that there is an appreciable risk of unique user identification even under natural viewing conditions in virtual reality. This identification would allow an app to connect a user's personal ID with their work ID without needing their consent, for example. To mitigate such risks we propose a framework that incorporates gatekeeping via the design of the application programming interface and via software implemented privacy mechanisms. Our results indicate that these mechanisms can reduce the rate of identification from as much as 85 to as low as 30 . The impact of introducing these mechanisms is less than 1.5 circ error in gaze position for gaze prediction. Gaze data streams can thus be made private while still allowing for gaze prediction, for example, during foveated rendering. Our approach is the first to support privacy by design in the flow of eye tracking data within mixed reality use cases.


The secretary problem with biased arrival order via a Mallows distribution. We solve the secretary problem in the case that the ranked items arrive in a statistically biased order rather than in uniformly random order. The bias is given by a Mallows distribution with parameter q in(0,1) , so that higher ranked items tend to arrive later and lower ranked items tend to arrive sooner. In the classical problem, the asymptotically optimal strategy is to reject the first M n items, where M n sim frac ne , and then to select the first item ranked higher than any of the first M n items (if such an item exists). This yields frac1e as the limiting probability of success. The Mallows distribution with parameter q 1 is the uniform distribution. For the regime q n 1 frac cn , with c 0 , the case of weak bias, the optimal strategy occurs with M n sim n Big( frac1c log big(1 frac e c 1 e big) Big) , with the limiting probability of success being frac1e . For the regime q n 1 frac c n alpha , with c 0 and alpha in(0,1) , the case of moderate bias, the optimal strategy occurs with n M n sim frac n alpha c , with the limiting probability of success being frac1e . For fixed q in(0,1) , the case of strong bias, the optimal strategy occurs with M n n L where frac L 1 L q le frac L L 1 , with limiting probability of success being (1 q)q L 1 L frac1e .


On short wave long wave interactions in the relativistic context. In this paper we introduce models of short wave long wave interactions in the relativistic setting. In this context the nonlinear Schr "odinger equation is no longer adequate for describing short waves and is replaced by a nonlinear Dirac equation. Two specific examples are considered the case where the long waves are governed by a scalar conservation law and the case where the long waves are governed by the augmented Born Infeld equations in electromagnetism.


Root cause prediction based on bug reports. This paper proposes a supervised machine learning approach for predicting the root cause of a given bug report. Knowing the root cause of a bug can help developers in the debugging process either directly or indirectly by choosing proper tool support for the debugging task. We mined 54755 closed bug reports from the issue trackers of 103 GitHub projects and applied a set of heuristics to create a benchmark consisting of 10459 reports. A subset was manually classified into three groups (semantic, memory, and concurrency) based on the bugs' root causes. Since the types of root cause are not equally distributed, a combination of keyword search and random selection was applied. Our data set for the machine learning approach consists of 369 bug reports (122 concurrency, 121 memory, and 126 semantic bugs). The bug reports are used as input to a natural language processing algorithm. We evaluated the performance of several classifiers for predicting the root causes for the given bug reports. Linear Support Vector machines achieved the highest mean precision (0.74) and recall (0.72) scores. The created bug data set and classification are publicly available.


Influence of rotation on axisymmetric plasma equilibria double null DTT scenario. We study the dependence of some relevant tokamak equilibrium quantities on the toroidal plasma rotation. The Grad Shafranov equation generalised to the rotating case is analytically solved employing two different representations for the homogenous solution. Using an expression in terms of polynomials, we describe the separatrix shape by a few geometrical parameters, reproducing different plasma scenarios such as double null and inverse triangularity. In this setting, the introduction of toroidal rotation corresponds to variations on relevant plasma quantities, most notably an enhancement of the poloidal beta. Using a more general expression in terms of Bessel functions, we reconstruct the full plasma boundary of the double null configuration proposed for the upcoming DTT experiment, demonstrating how said configuration is compatible with different values of the plasma velocity.


Measurement of the Angular Distribution of Wavelength Shifted Light Emitted by TPB. We present measurements of the angular distribution of re emitted light from tetraphenyl butadiene thin films when exposed to SI 128 nm light in vacuum. Films ranging from SI 250 nm to SI 5.5 micron in thickness are measured. All films were fabricated by evaporation deposition on ultraviolet transmitting (UVT) acrylic substrates. Preliminary comparisons of the angular distribution to that produced by a detailed Monte Carlo model are also presented. The current shortcomings of the model are discussed and future plans briefly outlined.


Arboreal models and their stability. This is the first in a series of papers by the authors on the arborealization program. The main goal of the paper is the proof of uniqueness of arboreal models, defined as the closure of the class of smooth germs of Lagrangian submanifolds under the operation of taking iterated transverse Liouville cones. The parametric version of the stability result implies that the space of germs of symplectomorphisms that preserve a canonical model is weakly homotopy equivalent to the space of automorphisms of the corresponding signed rooted tree. Hence the local symplectic topology around a canonical model reduces to combinatorics, even parametrically.


Twisted motivic Chern class and stable envelopes. We present a definition of em twisted motivic Chern classes for singular pairs (X, Delta) consisting of a singular space X and a mathbb Q Cartier divisor containing the singularities of X . The definition is a mixture of the construction of motivic Chern classes previously defined by Brasselet Sch "u rmann Yokura with the construction of multiplier ideals. The twisted motivic Chern classes are the limits of the elliptic classes defined by Borisov Libgober. We show that with a suitable choice of the divisor Delta the twisted motivic Chern classes satisfy the axioms of the stable envelopes in the K theory. Our construction is an extension of the results proven by the first author for the fundamental slope.


Duality for Normal Lattice Expansions and Sorted, Residuated Frames with Relations. We revisit the problem of Stone duality for lattices with various quasioperators, first studied in 14 , presenting a fresh duality result. The new result is an improvement over that of 14 in two important respects. First, the axiomatization of frames in 14 was rather cumbersome and it is now simplified, partly by incorporating Gehrke's proposal 8 of section stability for relations. Second, morphisms are redefined so as to preserve Galois stable (and co stable) sets and we rely for this, partly again, on Goldblatt's 11 recently proposed definition of bounded morphisms for polarities, though we need to strengthen the definition in order to get a Stone duality result. In studying the dual algebraic structures associated to polarities with relations we demonstrate that stable co stable set operators result as the Galois closure of the restriction of classical (though sorted) image operators generated by the frame relations to Galois stable co stable sets. This provides a proof, at the representation level, that non distributive logics can be viewed as fragments of sorted, residuated (poly)modal logics, a research direction initiated in 16,17 .


Interpolating estimates with applications to some quantitative symmetry results. We prove interpolating estimates providing a bound for the oscillation of a function in terms of two L p norms of its gradient. They are based on a pointwise bound of a function on cones in terms of the Riesz potential of its gradient. The estimates hold for a general class of domains, including, e.g., Lipschitz domains. All the constants involved can be explicitly computed. As an application, we show how to use these estimates to obtain stability for Alexandrov's Soap Bubble Theorem and Serrin's overdetermined boundary value problem. The new approach results in several novelties and benefits for these problems.


Gigapixel Histopathological Image Analysis using Attention based Neural Networks. Although CNNs are widely considered as the state of the art models in various applications of image analysis, one of the main challenges still open is the training of a CNN on high resolution images. Different strategies have been proposed involving either a rescaling of the image or an individual processing of parts of the image. Such strategies cannot be applied to images, such as gigapixel histopathological images, for which a high reduction in resolution inherently effects a loss of discriminative information, and in respect of which the analysis of single parts of the image suffers from a lack of global information or implies a high workload in terms of annotating the training images in such a way as to select significant parts. We propose a method for the analysis of gigapixel histopathological images solely by using weak image level labels. In particular, two analysis tasks are taken into account a binary classification and a prediction of the tumor proliferation score. Our method is based on a CNN structure consisting of a compressing path and a learning path. In the compressing path, the gigapixel image is packed into a grid based feature map by using a residual network devoted to the feature extraction of each patch into which the image has been divided. In the learning path, attention modules are applied to the grid based feature map, taking into account spatial correlations of neighboring patch features to find regions of interest, which are then used for the final whole slide analysis. Our method integrates both global and local information, is flexible with regard to the size of the input images and only requires weak image level labels. Comparisons with different methods of the state of the art on two well known datasets, Camelyon16 and TUPAC16, have been made to confirm the validity of the proposed model.


Nonfinitely based ai semirings with finitely based semigroup reducts. We present some general results implying nonfinite axiomatisability of many additively idempotent semirings with finitely based semigroup reducts. The smallest is a 3 element commutative example, which we show also has texttt NP hard membership for its variety. As well as being the only nonfinite axiomatisable ai semiring on 3 elements, we are able to show that its nonfinite basis property infects many related semirings, including the natural ai semiring structure on the semigroup B 2 1 . We also extend previous group theory based examples significantly, by showing that any finite additively idempotent semiring with a nonabelian nilpotent subgroup is not finitely axiomatisable for its identities.


Latin writing styles analysis with Machine Learning New approach to old questions. In the Middle Ages texts were learned by heart and spread using oral means of communication from generation to generation. Adaptation of the art of prose and poems allowed keeping particular descriptions and compositions characteristic for many literary genres. Taking into account such a specific construction of literature composed in Latin, we can search for and indicate the probability patterns of familiar sources of specific narrative texts. Consideration of Natural Language Processing tools allowed us the transformation of textual objects into numerical ones and then application of machine learning algorithms to extract information from the dataset. We carried out the task consisting of the practical use of those concepts and observation to create a tool for analyzing narrative texts basing on open source databases. The tool focused on creating specific search tools resources which could enable us detailed searching throughout the text. The main objectives of the study take into account finding similarities between sentences and between documents. Next, we applied machine learning algorithms on chosen texts to calculate specific features of them (for instance authorship or centuries) and to recognize sources of anonymous texts with a certain percentage.


Efficient Locally Optimal Number Set Partitioning for Scheduling, Allocation and Fair Selection. We study the optimization version of the set partition problem (where the difference between the partition sums are minimized), which has numerous applications in decision theory literature. While the set partitioning problem is NP hard and requires exponential complexity to solve (i.e., intractable) we formulate a weaker version of this NP hard problem, where the goal is to find a locally optimal solution. We show that our proposed algorithms can find a locally optimal solution in near linear time. Our algorithms require neither positive nor integer elements in the input set, hence, they are more widely applicable.


Role based lateral movement detection with unsupervised learning. Adversarial lateral movement via compromised accounts remains difficult to discover via traditional rule based defenses because it generally lacks explicit indicators of compromise. We propose a behavior based, unsupervised framework comprising two methods of lateral movement detection on enterprise networks one aimed at generic lateral movement via either exploit or authenticated connections, and one targeting the specific techniques of process injection and hijacking. The first method is based on the premise that the role of a system the functions it performs on the network determines the roles of the systems it should make connections with. The adversary meanwhile might move between any systems whatever, possibly seeking out systems with unusual roles that facilitate certain accesses. We use unsupervised learning to cluster systems according to role and identify connections to systems with novel roles as potentially malicious. The second method is based on the premise that the temporal patterns of inter system processes that facilitate these connections depend on the roles of the systems involved. If a process is compromised by an attacker, these normal patterns might be disrupted in discernible ways. We apply frequent itemset mining to process sequences to establish regular patterns of communication between systems based on role, and identify rare process sequences as signalling potentially malicious connections.


Compact groups with probabilistically central monothetic subgroups. If K is a closed subgroup of a compact group G , the probability that randomly chosen pair of elements from K and G commute is denoted by Pr(K,G) . Say that a subgroup K leq G is epsilon central in G if Pr( langle g rangle,G) geq epsilon for any g in K . Here langle g rangle denotes the monothetic subgroup generated by g in G . Our main result is that if K is epsilon central in G , then there is an epsilon bounded number e and a normal subgroup T leq G such that the index G T and the order of the commutator subgroup K e,T both are finite and epsilon bounded. In particular, if G is a compact group for which there is epsilon 0 such that Pr( langle g rangle,G) geq epsilon for any g in G , then there is an epsilon bounded number e and a normal subgroup T such that the index G T and the order of G e,T both are finite and epsilon bounded.


Landscape analysis of an improved power method for tensor decomposition. In this work, we consider the optimization formulation for symmetric tensor decomposition recently introduced in the Subspace Power Method (SPM) of Kileel and Pereira. Unlike popular alternative functionals for tensor decomposition, the SPM objective function has the desirable properties that its maximal value is known in advance, and its global optima are exactly the rank 1 components of the tensor when the input is sufficiently low rank. We analyze the non convex optimization landscape associated with the SPM objective. Our analysis accounts for working with noisy tensors. We derive quantitative bounds such that any second order critical point with SPM objective value exceeding the bound must equal a tensor component in the noiseless case, and must approximate a tensor component in the noisy case. For decomposing tensors of size D times m , we obtain a near global guarantee up to rank widetilde o (D lfloor m 2 rfloor ) under a random tensor model, and a global guarantee up to rank mathcal O (D) assuming deterministic frame conditions. This implies that SPM with suitable initialization is a provable, efficient, robust algorithm for low rank symmetric tensor decomposition. We conclude with numerics that show a practical preferability for using the SPM functional over a more established counterpart.


Exponential stability and asymptotic properties of the optimal filter for signals with deterministic hyperbolic dynamics. The problem of stability of the optimal filter is revisited. The optimal filter (or filtering process) is the conditional probability of the current state of some stochastic process (the signal process), given both present and past values of another process (the observation process). Typically the filtering process satisfies a dynamical equation, and the question investigated here concerns the stability of this dynamics. In contrast to previous work, signal processes given by the iterations of a deterministic mapping f are considered, with only the initial condition being random. While the stability of the filter may emerge from strong randomness of the signal processes, different and more dynamical effects will be exploited in the present work. More specifically, we consider uniformly hyperbolic f with strong instabilities providing the necessary mixing. This however requires that the filtering process is initialised with densities exhibiting already a certain level of smoothness. Furthermore, f may also have stable directions along which the filtering process will eventually not have a density, a major technical difficulty. Further results show that the filtering process is asymptotically concentrated on the attractor and furthermore will have densities with respect to the invariant (SRB) measure along instable manifolds of f .


B Pref Benchmarking Preference Based Reinforcement Learning. Reinforcement learning (RL) requires access to a reward function that incentivizes the right behavior, but these are notoriously hard to specify for complex tasks. Preference based RL provides an alternative learning policies using a teacher's preferences without pre defined rewards, thus overcoming concerns associated with reward engineering. However, it is difficult to quantify the progress in preference based RL due to the lack of a commonly adopted benchmark. In this paper, we introduce B Pref a benchmark specially designed for preference based RL. A key challenge with such a benchmark is providing the ability to evaluate candidate algorithms quickly, which makes relying on real human input for evaluation prohibitive. At the same time, simulating human input as giving perfect preferences for the ground truth reward function is unrealistic. B Pref alleviates this by simulating teachers with a wide array of irrationalities, and proposes metrics not solely for performance but also for robustness to these potential irrationalities. We showcase the utility of B Pref by using it to analyze algorithmic design choices, such as selecting informative queries, for state of the art preference based RL algorithms. We hope that B Pref can serve as a common starting point to study preference based RL more systematically. Source code is available at https github.com rll research B Pref.


Knowledge Based Paranoia Search in Trick Taking. This paper proposes emph knowledge based paraonoia search (KBPS) to find forced wins during trick taking in the card game Skat for some one of the most interesting card games for three players. It combines efficient partial information game tree search with knowledge representation and reasoning. This worst case analysis, initiated after a small number of tricks, leads to a prioritized choice of cards. We provide variants of KBPS for the declarer and the opponents, and an approximation to find a forced win against most worlds in the belief space. Replaying thousands of expert games, our evaluation indicates that the AIs with the new algorithms perform better than humans in their play, achieving an average score of over 1,000 points in the agreed standard for evaluating Skat tournaments, the extended Seeger system.


New (TH)GEM coating materials characterised using spectroscopy methods. In this work GEM and single hole Thick GEM structures, composed of different coating materials, are studied. The used foils incorporate conductive layers made of copper, aluminium, molybdenum, stainless steel, tungsten and tantalum. The main focus of the study is the determination of the material dependence of the formation of electrical discharges in GEM based detectors. For this task, discharge probability measurements are conducted with several Thick GEM samples using a basic electronics readout chain. In addition to that, optical spectroscopy methods are employed to study the light emitted during discharges from the different foils. It is observed that the light spectra of GEMs include emission lines from the conductive layer material. This indicates the presence of the foil material in the discharge plasma after the initial spark. However, no lines associated with the coating material are observed while studying spark discharges induced in Thick GEMs. It is concluded that the conductive layer material does not play a substantial role in terms of stability against primary discharges. However, a strong material dependence is observed in the case of secondary discharge formation, pointing to molybdenum coating as the one providing increased stability.


What is worthy of investigation? Philosophical attitudes and their impact on mathematical development by the example of discovering 10 adic numbers. We describe in dialogue form a possible way of discovering and investigating 10 adic numbers starting from the naive question about a largest natural number'. Among the topics we pursue are possibilities of extensions to transfinite 10 adic numbers, 10 adic representations of rational numbers, zero divisors, square roots and 10 adic roots of higher degree of natural numbers, and applications of 10 adic number representation in computer arithmetic. The participants of the dialogue are idealized embodiments of different philosophical attitudes towards mathematics. The article aims at illustrating how these attitudes interact, in both jarring and stimulating ways, and how they impact mathematical development.


On the Virality of Animated GIFs on Tumblr. Animated GIFs are becoming increasingly popular in online communication. People use them to express emotion, share their interests and enhance (or even replace) short form texting they are a new means to tell visual stories. Some creative animated GIFs are highly addictive to watch, and eventually become viral they circulate rapidly and widely within the network. What makes certain animated GIFs go viral? In this paper, we study the virality of animated GIFs by analyzing over 10 months of complete data logs (more than 1B posts and 12B reblogs) on Tumblr, one of the largest repositories of animated GIFs on the Internet. We conduct a series of quantitative and comparative studies on Tumblr data, comparing major types of online content text, images, videos, and animated GIFs. We report on a number of interesting, new findings on animated GIFs. We show that people tend to make animated GIFs easily searchable and discoverable by adding more hashtags than other content types. We also show that animated GIFs tend to go more viral than images and videos on Tumblr. With more in depth analysis, we present that animated GIFs tend to get reblogged more and followed more from non followers, while animated GIFs have more recurrence of a post. Lastly, we show that the virality of animated GIFs is more easily predictable than that of images and videos.


Coverage Control in Multi Robot Systems via Graph Neural Networks. This paper develops a decentralized approach to mobile sensor coverage by a multi robot system. We consider a scenario where a team of robots with limited sensing range must position itself to effectively detect events of interest in a region characterized by areas of varying importance. Towards this end, we develop a decentralized control policy for the robots realized via a Graph Neural Network which uses inter robot communication to leverage non local information for control decisions. By explicitly sharing information between multi hop neighbors, the decentralized controller achieves a higher quality of coverage when compared to classical approaches that do not communicate and leverage only local information available to each robot. Simulated experiments demonstrate the efficacy of multi hop communication for multi robot coverage and evaluate the scalability and transferability of the learning based controllers.


Does the Goal Matter? Emotion Recognition Tasks Can Change the Social Value of Facial Mimicry towards Artificial Agents. In this paper, we present a study aimed at understanding whether the embodiment and humanlikeness of an artificial agent can affect people's spontaneous and instructed mimicry of its facial expressions. The study followed a mixed experimental design and revolved around an emotion recognition task. Participants were randomly assigned to one level of humanlikeness (between subject variable humanlike, characterlike, or morph facial texture of the artificial agents) and observed the facial expressions displayed by a human (control) and three artificial agents differing in embodiment (within subject variable video recorded robot, physical robot, and virtual agent). To study both spontaneous and instructed facial mimicry, we divided the experimental sessions into two phases. In the first phase, we asked participants to observe and recognize the emotions displayed by the agents. In the second phase, we asked them to look at the agents' facial expressions, replicate their dynamics as closely as possible, and then identify the observed emotions. In both cases, we assessed participants' facial expressions with an automated Action Unit (AU) intensity detector. Contrary to our hypotheses, our results disclose that the agent that was perceived as the least uncanny, and most anthropomorphic, likable, and co present, was the one spontaneously mimicked the least. Moreover, they show that instructed facial mimicry negatively predicts spontaneous facial mimicry. Further exploratory analyses revealed that spontaneous facial mimicry appeared when participants were less certain of the emotion they recognized. Hence, we postulate that an emotion recognition goal can flip the social value of facial mimicry as it transforms a likable artificial agent into a distractor.


A short review and discussion about the limiting factors, which can hold back wind and photovoltaic power plants from its presently exponential growth. The present nearly exponential growth of the cumulative installation power of wind and photovoltaic power plants is very promising in the context of a rapid reduction of the emission of CO2, which can lead to a swift mitigation climate change if this growth behavior is maintained in the future. In this review we identify a set of ten limiting factors that can restrain, or halt back, an exponential growth of these variable renewable power plants (VREs) in the future. If the exponential growth slows down to a linear growth, such a case would extent considerably the time to reduce the CO2 emissions and the related mitigation of climate change. A scenario that would result to a much higher risk of a future continuation of the economic grow and thrive of the global economy and human society. We argue that if these limiting factors are adequately addressed to an exponential expansion VRE power plants is feasible and can result in the nearly complete avoidance of CO2 emissions as related to energy generation and consumption in 2030.


Stock Market Analysis with Text Data A Review. Stock market movements are influenced by public and private information shared through news articles, company reports, and social media discussions. Analyzing these vast sources of data can give market participants an edge to make profit. However, the majority of the studies in the literature are based on traditional approaches that come short in analyzing unstructured, vast textual data. In this study, we provide a review on the immense amount of existing literature of text based stock market analysis. We present input data types and cover main textual data sources and variations. Feature representation techniques are then presented. Then, we cover the analysis techniques and create a taxonomy of the main stock market forecast models. Importantly, we discuss representative work in each category of the taxonomy, analyzing their respective contributions. Finally, this paper shows the findings on unaddressed open problems and gives suggestions for future work. The aim of this study is to survey the main stock market analysis models, text representation techniques for financial market prediction, shortcomings of existing techniques, and propose promising directions for future research.


Location of concentrated vortices in planar steady Euler flows. In this paper, we study two dimensional steady incompressible Euler flows in which the vorticity is sharply concentrated in a finite number of regions of small diameter in a bounded domain. Mathematical analysis of such flows is an interesting and physically important research topic in fluid mechanics. The main purpose of this paper is to prove that in such flows the locations of these concentrated blobs of vorticity must be in the vicinity of some critical point of the Kirchhoff Routh function, which is determined by the geometry of the domain. The vorticity is assumed to be only in L 4 3 , which is the optimal regularity for weak solutions to make sense. As a by product, we prove a nonexistence result for concentrated multiple vortex flows in convex domains.


Programming for All Understanding the Nature of Programs. Computer programs are part of our daily life, we use them, we provide them with data, they support our decisions, they help us remember, they control machines, etc. Programs are made by people, but in most cases we are not their authors, so we have to decide if we can trust them. Programs enable computers and computer controlled machines to behave in a large variety of ways. They bring the intrinsic power of computers to life. Programs have a variety of properties that all citizens must be aware of. Due to the intangible nature of programs, most of these properties are very unusual, but important to understand the digital world. In this position paper, we describe the Nature of Programs in the form of knowledge statements, accompanied by examples from everyday life to clarify their meaning. Everything is formulated in an easily understandable manner and avoids obscure technical language. We suggest that these knowledge statements must be imparted to all teachers and school students. A great way to learn and experience the nature of programs is to develop programs yourself.


Simulations of ion heating due to ion acoustic instabilities in the presheath. Particle in cell direct simulation Monte Carlo simulations reveal that ion acoustic instabilities excited in presheaths can cause significant ion heating. Ion acoustic instabilities are excited by the ion flow toward a sheath when the neutral gas pressure is small enough and the electron temperature is large enough. A series of 1D simulations were conducted in which neutral plasma (electrons and ions) was uniformly sourced with an ion temperature of 0.026 eV and different electron temperatures (0.1 50 eV). Ion heating was observed when the electron to ion temperature ratio exceeded the minimum value predicted by linear response theory to excite ion acoustic instabilities at the sheath edge ( T e T i approx28 ). When this threshold was exceeded, the temperature equilibriation rate between ions and electrons rapidly increased near the sheath so that the local temperature ratio did not significantly exceed the threshold for instability. This resulted in significant ion heating near the sheath edge, which also extended back into the bulk plasma presumably due to wave reflection from the sheath. This ion acoustic wave heating mechanism was found to decrease for higher neutral pressures, where ion neutral collisions damp the ion acoustic waves and ion heating is instead dominated by inelastic collisions in the presheath.


When in Doubt, Summon the Titans Efficient Inference with Large Models. Scaling neural networks to "large" sizes, with billions of parameters, has been shown to yield impressive results on many challenging problems. However, the inference cost incurred by such large models often prevents their application in most real world settings. In this paper, we propose a two stage framework based on distillation that realizes the modelling benefits of the large models, while largely preserving the computational benefits of inference with more lightweight models. In a nutshell, we use the large teacher models to guide the lightweight student models to only make correct predictions on a subset of "easy" examples for the "hard" examples, we fall back to the teacher. Such an approach allows us to efficiently employ large models in practical scenarios where easy examples are much more frequent than rare hard examples. Our proposed use of distillation to only handle easy instances allows for a more aggressive trade off in the student size, thereby reducing the amortized cost of inference and achieving better accuracy than standard distillation. Empirically, we demonstrate the benefits of our approach on both image classification and natural language processing benchmarks.


On the existence of vortex wave systems to inviscid gSQG equation. We study the existence of different vortex wave systems for inviscid gSQG flow, where the total circulation are produced by point vortices and vortices with compact support. To overcome several difficulties caused by the singular formulation and infinite kinetic energy, we introduce a modified reduction method. Several asymptotic properties of the system are also given.


A finite atlas for solution manifolds of differential systems with discrete state dependent delays. Let r 0, n in mathbb N , bf k in mathbb N . Consider the delay differential equation x'(t) g(x(t d 1(Lx t)), ldots,x(t d bf k (Lx t))) for g ( mathbb R n) bf k supset V to mathbb R n continuously differentiable, L a continuous linear map from C( r,0 , mathbb R n) into a finite dimensional vectorspace F , each d k F supset W to 0,r , k 1, ldots, bf k , continuously differentiable, and x t(s) x(t s) . The solutions define a semiflow of continuously differentiable solution operators on the submanifold X f subset C 1( r,0 , mathbb R n) which is given by the compatibility condition phi'(0) f( phi) with f( phi) g( phi( d 1(L phi)), ldots, phi( d bf k (L phi))). We prove that X f has a finite atlas of at most 2 bf k manifold charts, whose domains are almost graphs over X 0 . The size of the atlas depends solely on the zerosets of the delay functions d k .


On minimal kernels and Levi currents on weakly complete complex manifolds. A complex manifold X is emph weakly complete if it admits a continuous plurisubharmonic exhaustion function phi . The minimal kernels Sigma X k, k in 0, infty (the loci where are all mathcal C k plurisubharmonic exhaustion functions fail to be strictly plurisubharmonic),introduced by Slodkowski Tomassini, and the Levi currents, introduced by Sibony, are both concepts aimed at measuring how far X is from being Stein. We compare these notions, prove that all Levi currents are supported by all the Sigma X k 's, and give sufficient conditions for points in Sigma X k to be in the support of some Levi current. When X is a surface and phi can be chosen analytic, building on previous work by the second author, Slodkowski, and Tomassini,we prove the existence of a Levi current precisely supported on Sigma X infty , and give a classification of Levi currents on X . In particular,unless X is a modification of a Stein space, every point in X is in the support of some Levi current.


First order phase transformation at constant volume a continuous transition?. We describe a first order phase transition of a simple system in a process where the volume is kept constant. We show that, unlike what happens when the pressure is constant, (i) the transformation extends over a finite temperature (and pressure) range, (ii) each and every extensive potential (internal energy U , enthalpy H , Helmholtz energy F and Gibbs energy G ), and the entropy S , is continuous across the transition, and (iii) the constant volume heat capacity does not diverge during the transition, only exhibits discrete jumps. These non intuitive results highlight the importance of controlling the correct variables in order to distinguish between continuous and discontinuous transitions. Additionally, they provide a didactic tool to further discuss the phase transitions phenomena. We apply our results to describe the transition between ice VI and liquid water using thermodynamic information available in the literature.


High level camera LiDAR fusion for 3D object detection with machine learning. This paper tackles the 3D object detection problem, which is of vital importance for applications such as autonomous driving. Our framework uses a Machine Learning (ML) pipeline on a combination of monocular camera and LiDAR data to detect vehicles in the surrounding 3D space of a moving platform. It uses frustum region proposals generated by State Of The Art (SOTA) 2D object detectors to segment LiDAR point clouds into point clusters which represent potentially individual objects. We evaluate the performance of classical ML algorithms as part of an holistic pipeline for estimating the parameters of 3D bounding boxes which surround the vehicles around the moving platform. Our results demonstrate an efficient and accurate inference on a validation set, achieving an overall accuracy of 87.1 .


DeepWalking Backwards From Embeddings Back to Graphs. Low dimensional node embeddings play a key role in analyzing graph datasets. However, little work studies exactly what information is encoded by popular embedding methods, and how this information correlates with performance in downstream machine learning tasks. We tackle this question by studying whether embeddings can be inverted to (approximately) recover the graph used to generate them. Focusing on a variant of the popular DeepWalk method (Perozzi et al., 2014 Qiu et al., 2018), we present algorithms for accurate embedding inversion i.e., from the low dimensional embedding of a graph G, we can find a graph H with a very similar embedding. We perform numerous experiments on real world networks, observing that significant information about G, such as specific edges and bulk properties like triangle density, is often lost in H. However, community structure is often preserved or even enhanced. Our findings are a step towards a more rigorous understanding of exactly what information embeddings encode about the input graph, and why this information is useful for learning tasks.


A translation of L. Euler's "An easy method for calculating the motion of celestial bodies perturbed in any manner avoiding astronomical computations". This is a translation from Latin of E348 'Methodus facilis motus corporum coelestium utcunque perturbatos ad rationem calculi astronomici revocandi', in which Euler develops a method to alleviate the astronomical computations in a typical celestial three body problem represented by Sun, Earth and Moon. In this work, Euler's approach consists of two parts geometrical and mechanical. The geometrical part contains most of the analytical developments, in which Euler makes use of Cartesian and spherical trigonometry as well the latter not always in a clear enough way. With few sketches to show the geometrical constructions envisaged by Euler represented by several geometrical variables , it is a hard to follow publication. The Translator, on trying to clear the way to the non specialized reader, used the best of his abilities to add his own figures to the translation. In the latter part of the work, Euler particularizes his developments to the Moon, ending up with eight coupled differential equations for resolving the perturbed motion of this celestial body, which makes his claim of an "easy method" as being rather fallacious. Despite showing great analytical skills, Euler did not give indications on how this system of equations could be solved, which renders his efforts practically useless in the determination of the variations of the nodal line and inclination of the Moon's orbit.


Neuromorphic scaling advantages for energy efficient random walk computation. Computing stands to be radically improved by neuromorphic computing (NMC) approaches inspired by the brain's incredible efficiency and capabilities. Most NMC research, which aims to replicate the brain's computational structure and architecture in man made hardware, has focused on artificial intelligence however, less explored is whether this brain inspired hardware can provide value beyond cognitive tasks. We demonstrate that high degree parallelism and configurability of spiking neuromorphic architectures makes them well suited to implement random walks via discrete time Markov chains. Such random walks are useful in Monte Carlo methods, which represent a fundamental computational tool for solving a wide range of numerical computing tasks. Additionally, we show how the mathematical basis for a probabilistic solution involving a class of stochastic differential equations can leverage those simulations to provide solutions for a range of broadly applicable computational tasks. Despite being in an early development stage, we find that NMC platforms, at a sufficient scale, can drastically reduce the energy demands of high performance computing (HPC) platforms.


United We Learn Better Harvesting Learning Improvements From Class Hierarchies Across Tasks. Attempts of learning from hierarchical taxonomies in computer vision have been mostly focusing on image classification. Though ways of best harvesting learning improvements from hierarchies in classification are far from being solved, there is a need to target these problems in other vision tasks such as object detection. As progress on the classification side is often dependent on hierarchical cross entropy losses, novel detection architectures using sigmoid as an output function instead of softmax cannot easily apply these advances, requiring novel methods in detection. In this work we establish a theoretical framework based on probability and set theory for extracting parent predictions and a hierarchical loss that can be used across tasks, showing results across classification and detection benchmarks and opening up the possibility of hierarchical learning for sigmoid based detection architectures.


Attacks on Visualization Based Malware Detection Balancing Effectiveness and Executability. With the rapid development of machine learning for image classification, researchers have found new applications of visualization techniques in malware detection. By converting binary code into images, researchers have shown satisfactory results in applying machine learning to extract features that are difficult to discover manually. Such visualization based malware detection methods can capture malware patterns from many different malware families and improve malware detection speed. On the other hand, recent research has also shown adversarial attacks against such visualization based malware detection. Attackers can generate adversarial examples by perturbing the malware binary in non reachable regions, such as padding at the end of the binary. Alternatively, attackers can perturb the malware image embedding and then verify the executability of the malware post transformation. One major limitation of the first attack scenario is that a simple pre processing step can remove the perturbations before classification. For the second attack scenario, it is hard to maintain the original malware's executability and functionality. In this work, we provide literature review on existing malware visualization techniques and attacks against them. We summarize the limitation of the previous work, and design a new adversarial example attack against visualization based malware detection that can evade pre processing filtering and maintain the original malware functionality. We test our attack on a public malware dataset and achieve a 98 success rate.


Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non nominal Contexts. We explore the reinforcement learning approach to designing controllers by extensively discussing the case of a quadcopter attitude controller. We provide all details allowing to reproduce our approach, starting with a model of the dynamics of a crazyflie 2.0 under various nominal and non nominal conditions, including partial motor failures and wind gusts. We develop a robust form of a signal temporal logic to quantitatively evaluate the vehicle's behavior and measure the performance of controllers. The paper thoroughly describes the choices in training algorithms, neural net architecture, hyperparameters, observation space in view of the different performance metrics we have introduced. We discuss the robustness of the obtained controllers, both to partial loss of power for one rotor and to wind gusts and finish by drawing conclusions on practical controller design by reinforcement learning.


Efficient Representation of Interaction Patterns with Hyperbolic Hierarchical Clustering for Classification of Users on Twitter. Social media platforms play an important role in democratic processes. During the 2019 General Elections of India, political parties and politicians widely used Twitter to share their ideals, advocate their agenda and gain popularity. Twitter served as a ground for journalists, politicians and voters to interact. The organic nature of these interactions can be upended by malicious accounts on Twitter, which end up being suspended or deleted from the platform. Such accounts aim to modify the reach of content by inorganically interacting with particular handles. These interactions are a threat to the integrity of the platform, as such activity has the potential to affect entire results of democratic processes. In this work, we design a feature extraction framework which compactly captures potentially insidious interaction patterns. Our proposed features are designed to bring out communities amongst the users that work to boost the content of particular accounts. We use Hyperbolic Hierarchical Clustering (HypHC) which represents the features in the hyperbolic manifold to further separate such communities. HypHC gives the added benefit of representing these features in a lower dimensional space thus serving as a dimensionality reduction technique. We use these features to distinguish between different classes of users that emerged in the aftermath of the 2019 General Elections of India. Amongst the users active on Twitter during the elections, 2.8 of the users participating were suspended and 1 of the users were deleted from the platform. We demonstrate the effectiveness of our proposed features in differentiating between regular users (users who were neither suspended nor deleted), suspended users and deleted users. By leveraging HypHC in our pipeline, we obtain F1 scores of upto 93 .


Fine Selmer groups of congruent p adic Galois representations. We compare the Pontryagin duals of fine Selmer groups of two congruent p adic Galois representations over admissible pro p , p adic Lie extensions K infty of number fields K . We prove that in several natural settings the pi primary submodules of the Pontryagin duals are pseudo isomorphic over the Iwasawa algebra if the coranks of the fine Selmer groups are not equal, then we can still prove inequalities between the mu invariants. In the special case of a mathbb Z p extension K infty K , we also compare the Iwasawa lambda invariants of the fine Selmer groups, even in situations where the mu invariants are non zero. Finally, we prove similar results for certain abelian non p extensions.


The Climate Extended Risk Model (CERM). This paper addresses estimates of climate risk embedded within a bank credit portfolio. The proposed Climate Extended Risk Model (CERM) adapts well known credit risk models and makes it possible to calculate incremental credit losses on a loan portfolio that are rooted into physical and transition risks. The paper provides detailed description of the model hypotheses and steps.


SyzScope Revealing High Risk Security Impacts of Fuzzer Exposed Bugs in Linux kernel. Fuzzing has become one of the most effective bug finding approach for software. In recent years, 24 7 continuous fuzzing platforms have emerged to test critical pieces of software, e.g., Linux kernel. Though capable of discovering many bugs and providing reproducers (e.g., proof of concepts), a major problem is that they neglect a critical function that should have been built in, i.e., evaluation of a bug's security impact. It is well known that the lack of understanding of security impact can lead to delayed bug fixes as well as patch propagation. In this paper, we develop SyzScope, a system that can automatically uncover new "high risk" impacts given a bug with seemingly "low risk" impacts. From analyzing over a thousand low risk bugs on syzbot, SyzScope successfully determined that 183 low risk bugs (more than 15 ) in fact contain high risk impacts, e.g., control flow hijack and arbitrary memory write, some of which still do not have patches available yet.