PageRank computation for Higher Order Networks. Higher order networks are efficient representations of sequential data. Unlike the classic first order network approach, they capture indirect dependencies between items composing the input sequences by the use of textit memory nodes . We focus in this study on the variable order network model introduced in Xu et al. (2016) Saebi et al. (2020) . Authors suggested that random walk based mining tools can be directly applied to these networks. We discuss the case of the PageRank measure. We show the existence of a bias due to the distribution of the number of representations of the items. We propose an adaptation of the PageRank model in order to correct it. Application on real world data shows important differences in the achieved rankings. keywords Higher order Networks, Sequential data, Random walks, PageRank


Convolutors of translation modulation invariant Banach spaces of ultradistributions. We study the space of tempered ultradistributions whose convolutions with test functions are all contained in a given translation modulation invariant Banach space of ultradistributions. Our main result will be the first structural theorem for the aforementioned space. As an application we consider several extensions of convolution.


Spatial and Semantic Consistency Regularizations for Pedestrian Attribute Recognition. While recent studies on pedestrian attribute recognition have shown remarkable progress in leveraging complicated networks and attention mechanisms, most of them neglect the inter image relations and an important prior spatial consistency and semantic consistency of attributes under surveillance scenarios. The spatial locations of the same attribute should be consistent between different pedestrian images, eg, the hat" attribute and the boots" attribute are always located at the top and bottom of the picture respectively. In addition, the inherent semantic feature of the hat" attribute should be consistent, whether it is a baseball cap, beret, or helmet. To fully exploit inter image relations and aggregate human prior in the model learning process, we construct a Spatial and Semantic Consistency (SSC) framework that consists of two complementary regularizations to achieve spatial and semantic consistency for each attribute. Specifically, we first propose a spatial consistency regularization to focus on reliable and stable attribute related regions. Based on the precise attribute locations, we further propose a semantic consistency regularization to extract intrinsic and discriminative semantic features. We conduct extensive experiments on popular benchmarks including PA100K, RAP, and PETA. Results show that the proposed method performs favorably against state of the art methods without increasing parameters.


A Radon Transform on the Cylinder. We define a parametric Radon transform R that assigns to a Sobolev function on the cylinder mathbb S times mathbb R in mathbb R 3 its mean values along sets E zeta formed by the intersections of planes through the origin and the cylinder. We show that R is a continuous operator, prove an inversion formula, provide a support theorem, as well as a characterization of its null space. We conclude by presenting a formula for the dual transform R . We show that R and its dual R are related to the right sided and left sided Chebyshev fractional integrals. Using this relationship, we characterize the null space of R and R and provide an inversion formula for R .


Antinorms on cones duality and applications. An antinorm is a concave nonnegative homogeneous functional on a convex cone. It is shown that if the cone is polyhedral, then every antinorm has a unique continuous extension from the interior of the cone. The main facts of the duality theory in convex analysis, in particular, the Fenchel Moreau theorem, are generalized to antinorms. However, it is shown that the duality relation for antinorms is discontinuous. In every dimension there are infinitely many self dual antinorms on the positive orthant and, in particular, infinitely many autopolar polyhedra. For the two dimensional case, we characterise them all. The classification in higher dimensions is left as an open problem. Applications to linear dynamical systems, to the Lyapunov exponent of random matrix products, to the lower spectral radius of nonnegative matrices, and to convex trigonometry are considered.


The Geometry of Deep Generative Image Models and its Applications. Generative adversarial networks (GANs) have emerged as a powerful unsupervised method to model the statistical patterns of real world data sets, such as natural images. These networks are trained to map random inputs in their latent space to new samples representative of the learned data. However, the structure of the latent space is hard to intuit due to its high dimensionality and the non linearity of the generator, which limits the usefulness of the models. Understanding the latent space requires a way to identify input codes for existing real world images (inversion), and a way to identify directions with known image transformations (interpretability). Here, we use a geometric framework to address both issues simultaneously. We develop an architecture agnostic method to compute the Riemannian metric of the image manifold created by GANs. The eigen decomposition of the metric isolates axes that account for different levels of image variability. An empirical analysis of several pretrained GANs shows that image variation around each position is concentrated along surprisingly few major axes (the space is highly anisotropic) and the directions that create this large variation are similar at different positions in the space (the space is homogeneous). We show that many of the top eigenvectors correspond to interpretable transforms in the image space, with a substantial part of eigenspace corresponding to minor transforms which could be compressed out. This geometric understanding unifies key previous results related to GAN interpretability. We show that the use of this metric allows for more efficient optimization in the latent space (e.g. GAN inversion) and facilitates unsupervised discovery of interpretable axes. Our results illustrate that defining the geometry of the GAN image manifold can serve as a general framework for understanding GANs.


FLASHE Additively Symmetric Homomorphic Encryption for Cross Silo Federated Learning. Homomorphic encryption (HE) is a promising privacy preserving technique for cross silo federated learning (FL), where organizations perform collaborative model training on decentralized data. Despite the strong privacy guarantee, general HE schemes result in significant computation and communication overhead. Prior works employ batch encryption to address this problem, but it is still suboptimal in mitigating communication overhead and is incompatible with sparsification techniques. In this paper, we propose FLASHE, an HE scheme tailored for cross silo FL. To capture the minimum requirements of security and functionality, FLASHE drops the asymmetric key design and only involves modular addition operations with random numbers. Depending on whether to accommodate sparsification techniques, FLASHE is optimized in computation efficiency with different approaches. We have implemented FLASHE as a pluggable module atop FATE, an industrial platform for cross silo FL. Compared to plaintext training, FLASHE slightly increases the training time by leq6 , with no communication overhead.


The spaces of rational curves on del Pezzo threefolds of degree one. We prove the irreducibility of moduli spaces of rational curves on a general del Pezzo threefold of Picard rank 1 and degree 1 . As corollaries, we confirm Geometric Manin's conjecture and enumerativity of certain Gromov Witten invariants for these threefolds.


The geometry of antisymplectic involutions, I. We study fixed loci of antisymplectic involutions on projective hyperk "ahler manifolds. When the involution is induced by an ample class of square 2 in the Beauville Bogomolov Fujiki lattice, we show that the number of connected components of the fixed locus is equal to the divisibility of the class, which is either 1 or 2.


The exact worst case convergence rate of the gradient method with fixed step lengths for L smooth functions. In this paper, we study the convergence rate of the gradient (or steepest descent) method with fixed step lengths for finding a stationary point of an L smooth function. We establish a new convergence rate, and show that the bound may be exact in some cases, in particular when all step lengths lie in the interval (0,1 L . In addition, we derive an optimal step length with respect to the new bound.


Selective Replay Enhances Learning in Online Continual Analogical Reasoning. In continual learning, a system learns from non stationary data streams or batches without catastrophic forgetting. While this problem has been heavily studied in supervised image classification and reinforcement learning, continual learning in neural networks designed for abstract reasoning has not yet been studied. Here, we study continual learning of analogical reasoning. Analogical reasoning tests such as Raven's Progressive Matrices (RPMs) are commonly used to measure non verbal abstract reasoning in humans, and recently offline neural networks for the RPM problem have been proposed. In this paper, we establish experimental baselines, protocols, and forward and backward transfer metrics to evaluate continual learners on RPMs. We employ experience replay to mitigate catastrophic forgetting. Prior work using replay for image classification tasks has found that selectively choosing the samples to replay offers little, if any, benefit over random selection. In contrast, we find that selective replay can significantly outperform random selection for the RPM task.


Expose Uncertainty, Instill Distrust, Avoid Explanations Towards Ethical Guidelines for AI. In this position paper, I argue that the best way to help and protect humans using AI technology is to make them aware of the intrinsic limitations and problems of AI algorithms. To accomplish this, I suggest three ethical guidelines to be used in the presentation of results, mandating AI systems to expose uncertainty, to instill distrust, and, contrary to traditional views, to avoid explanations. The paper does a preliminary discussion of the guidelines and provides some arguments for their adoption, aiming to start a debate in the community about AI ethics in practice.


A next generation platform for Cyber Range as a Service. In the last years, Cyber Ranges have become a widespread solution to train professionals for responding to cyber threats and attacks. Cloud computing plays a key role in this context since it enables the creation of virtual infrastructures on which Cyber Ranges are based. However, the setup and management of Cyber Ranges are expensive and time consuming activities. In this paper, we highlight the novel features for the next generation Cyber Range platforms. In particular, these features include the creation of a virtual clone for an actual corporate infrastructure, relieving the security managers from the setup of the training scenarios and sessions, the automatic monitoring of the participants' activities, and the emulation of their behavior.


Efficient Deep Feature Calibration for Cross Modal Joint Embedding Learning. This paper introduces a two phase deep feature calibration framework for efficient learning of semantics enhanced text image cross modal joint embedding, which clearly separates the deep feature calibration in data preprocessing from training the joint embedding model. We use the Recipe1M dataset for the technical description and empirical validation. In preprocessing, we perform deep feature calibration by combining deep feature engineering with semantic context features derived from raw text image input data. We leverage LSTM to identify key terms, NLP methods to produce ranking scores for key terms before generating the key term feature. We leverage wideResNet50 to extract and encode the image category semantics to help semantic alignment of the learned recipe and image embeddings in the joint latent space. In joint embedding learning, we perform deep feature calibration by optimizing the batch hard triplet loss function with soft margin and double negative sampling, also utilizing the category based alignment loss and discriminator based alignment loss. Extensive experiments demonstrate that our SEJE approach with the deep feature calibration significantly outperforms the state of the art approaches.


Accountable Fine grained Blockchain Rewriting in the Permissionless Setting. Blockchain rewriting with fine grained access control allows a user to create a transaction associated with a set of attributes, while another user (or modifier) who possesses enough rewriting privileges from a trusted authority satisfying the attribute set can rewrite the transaction. However, it lacks accountability and is not designed for open blockchains that require no trust assumptions. In this work, we introduce accountable fine grained blockchain rewriting in a permissionless setting. The property of accountability allows the modifier's identity and her rewriting privileges to be held accountable for the modified transactions in case of malicious rewriting (e.g., modify the registered content from good to bad). We first present a generic framework to secure blockchain rewriting in the permissionless setting. Second, we present an instantiation of our approach and show its practicality through evaluation analysis. Last, we demonstrate that our proof of concept implementation can be effectively integrated into open blockchains.


Enhance to Read Better A Multi Task Adversarial Network for Handwritten Document Image Enhancement. Handwritten document images can be highly affected by degradation for different reasons Paper ageing, daily life scenarios (wrinkles, dust, etc.), bad scanning process and so on. These artifacts raise many readability issues for current Handwritten Text Recognition (HTR) algorithms and severely devalue their efficiency. In this paper, we propose an end to end architecture based on Generative Adversarial Networks (GANs) to recover the degraded documents into a clean and readable form. Unlike the most well known document binarization methods, which try to improve the visual quality of the degraded document, the proposed architecture integrates a handwritten text recognizer that promotes the generated document image to be more readable. To the best of our knowledge, this is the first work to use the text information while binarizing handwritten documents. Extensive experiments conducted on degraded Arabic and Latin handwritten documents demonstrate the usefulness of integrating the recognizer within the GAN architecture, which improves both the visual quality and the readability of the degraded document images. Moreover, we outperform the state of the art in H DIBCO challenges, after fine tuning our pre trained model with synthetically degraded Latin handwritten images, on this task.


Explicit motion planning in digital projective product spaces. We introduce the digital projective product spaces based on Davis' projective product spaces. We determine an upper bound for the digital LS category of the digital projective product spaces. In addition, we obtain an upper bound for the digital topological complexity of these spaces. We prove the relation between the digital topological complexity of the digital projective product spaces and sum of the digital topological complexity of the digital projective space by associating with the first digital sphere and the digital topological complexity of the remaining digital spheres through an explicit motion planning construction, which shows digital perspective validity of the results given by S. Fi c s ekci and L. Vandembroucq. We apply our outcomes on specific spaces in order to be more clear.


Unravelling ultrashort laser excitation of nickel at 800 nm wavelength. The optical response of nickel is studied in a wide range of laser fluence, below and above the ablation threshold, by selfreflectivity measurements of ultrashort 800nm single laser pulses. At the ablation threshold, the reflectivity remains unchanged with respect to its unperturbed value irrespective of the pulse duration, from 15 to 100 fs, consistently with the steadiness of the laser induced ablation threshold fluence Fth for all pulse durations tested. Until the ablation threshold ( F le F th ) and whatever the pulse duration, the disturbances caused to the initial structure of the electron gas distribution by the laser energy deposition are limited, having no significant impact on the transient optical response of nickel and on its ablation threshold. At higher laser fluences ( F F th ), the reflectivity becomes rapidly dominated by the contribution to the optical response of the fast thermalized free electrons (4s band) with energy largely above the Fermi energy level. In these conditions, the reflectivity decreases for all pulse durations enhancing laser energy coupling and larger optical absorption at the surface of nickel. The optical response of nickel under ultrashort (15 100 fs) irradiation is thus fully elucidated on a wide range of fluence (0.3 F th 30 F th ) and for pulse duration down to few optical cycle pulse duration. As a key parameter for benchmarking laser matter interaction in poorly known conditions yet, the evolution of the effective electron collision rate is determined as a function of fluence and pulse duration in very good consistency with experiments.


Generic and dense distributional chaos with shadowing. For continuous self maps of compact metric spaces, we consider the notions of generic and dense chaos introduced by Lasota and Snoha and their variations for the distributional chaos, under the assumption of shadowing. We give some equivalent properties to generic uniform (distributional) chaos in terms of chains and prove their equivalence to generic (distributional) chaos under the shadowing. Several examples illustrating the main results are also given.


Unsupervised Neural Machine Translation with Generative Language Models Only. We show how to derive state of the art unsupervised neural machine translation systems from generatively pre trained language models. Our method consists of three steps few shot amplification, distillation, and backtranslation. We first use the zero shot translation ability of large pre trained language models to generate translations for a small set of unlabeled sentences. We then amplify these zero shot translations by using them as few shot demonstrations for sampling a larger synthetic dataset. This dataset is distilled by discarding the few shot demonstrations and then fine tuning. During backtranslation, we repeatedly generate translations for a set of inputs and then fine tune a single language model on both directions of the translation task at once, ensuring cycle consistency by swapping the roles of gold monotext and generated translations when fine tuning. By using our method to leverage GPT 3's zero shot translation capability, we achieve a new state of the art in unsupervised translation on the WMT14 English French benchmark, attaining a BLEU score of 42.1.


A posteriori error analysis for a distributed optimal control problem governed by the von K ' a rm ' a n equations. This article discusses numerical analysis of the distributed optimal control problem governed by the von K ' a rm ' a n equations defined on a polygonal domain in mathbb R 2 . The state and adjoint variables are discretised using the nonconforming Morley finite element method and the control is discretized using piecewise constant functions. A priori and a posteriori error estimates are derived for the state, adjoint and control variables. The a posteriori error estimates are shown to be efficient. Numerical results that confirm the theoretical estimates are presented.


Bergman kernel and period map for curves. As for any symmetric space the tangent space to Siegel upper half space is endowed with an operation coming from the Lie bracket on the Lie algebra. We consider the pull back of this operation to the moduli space of curves via the Torelli map. We characterize it in terms of the geometry of the curve, using the Bergman kernel form associated to the curve. It is known that the second fundamental form of the Torelli map outside the hyperelliptic locus can be seen as the multiplication by a certain meromorphic form. Our second result says that the Bergman kernel form is the harmonic representative in a suitable sense of this meromorphic form.


Scalable computation of dynamic flow problems via multi marginal graph structured optimal transport. In this work, we develop a new framework for dynamic network flow problems based on optimal transport theory. We show that the dynamic multi commodity minimum cost network flow problem can be formulated as a multi marginal optimal transport problem, where the cost function and the constraints on the marginals are associated with a graph structure. By exploiting these structures and building on recent advances in optimal transport theory, we develop an efficient method for such entropy regularized optimal transport problems. In particular, the graph structure is utilized to efficiently compute the projections needed in the corresponding Sinkhorn iterations, and we arrive at a scheme that is both highly computationally efficient and easy to implement. To illustrate the performance of our algorithm, we compare it with a state of the art Linear programming (LP) solver. We achieve good approximations to the solution at least one order of magnitude faster than the LP solver. Finally, we showcase the methodology on a traffic routing problem with a large number of commodities.


MMGET A Markov model for generalized evidence theory. In real life, lots of information merges from time to time. To appropriately describe the actual situations, lots of theories have been proposed. Among them, Dempster Shafer evidence theory is a very useful tool in managing uncertain information. To better adapt to complex situations of open world, a generalized evidence theory is designed. However, everything occurs in sequence and owns some underlying relationships with each other. In order to further embody the details of information and better conforms to situations of real world, a Markov model is introduced into the generalized evidence theory which helps extract complete information volume from evidence provided. Besides, some numerical examples is offered to verify the correctness and rationality of the proposed method.


An Algebra of Properties of Binary Relations. We consider all 16 unary operations that, given a homogeneous binary relation R, define a new one by a boolean combination of xRy and yRx. Operations can be composed, and connected by pointwise defined logical junctors. We consider the usual properties of relations, and allow them to be lifted by prepending an operation. We investigate extensional equality between lifted properties (e.g. a relation is connex iff its complement is asymmetric), and give a table to decide this equality. Supported by a counter example generator and a resolution theorem prover, we investigate all 3 atom implications between lifted properties, and give a sound and complete axiom set for them (containing e.g. "if R's complement is left Euclidean and R is right serial, then R's symmetric kernel is left serial").


Concave Utility Reinforcement Learning the Mean Field Game Viewpoint. Concave Utility Reinforcement Learning (CURL) extends RL from linear to concave utilities in the occupancy measure induced by the agent's policy. This encompasses not only RL but also imitation learning and exploration, among others. Yet, this more general paradigm invalidates the classical Bellman equations, and calls for new algorithms. Mean field Games (MFGs) are a continuous approximation of many agent RL. They consider the limit case of a continuous distribution of identical agents, anonymous with symmetric interests, and reduce the problem to the study of a single representative agent in interaction with the full population. Our core contribution consists in showing that CURL is a subclass of MFGs. We think this important to bridge together both communities. It also allows to shed light on aspects of both fields we show the equivalence between concavity in CURL and monotonicity in the associated MFG, between optimality conditions in CURL and Nash equilibrium in MFG, or that Fictitious Play (FP) for this class of MFGs is simply Frank Wolfe, bringing the first convergence rate for discrete time FP for MFGs. We also experimentally demonstrate that, using algorithms recently introduced for solving MFGs, we can address the CURL problem more efficiently.


Data Efficient Masked Language Modeling for Vision and Language. Masked language modeling (MLM) is one of the key sub tasks in vision language pretraining. In the cross modal setting, tokens in the sentence are masked at random, and the model predicts the masked tokens given the image and the text. In this paper, we observe several key disadvantages of MLM in this setting. First, as captions tend to be short, in a third of the sentences no token is sampled. Second, the majority of masked tokens are stop words and punctuation, leading to under utilization of the image. We investigate a range of alternative masking strategies specific to the cross modal setting that address these shortcomings, aiming for better fusion of text and image in the learned representation. When pre training the LXMERT model, our alternative masking strategies consistently improve over the original masking strategy on three downstream tasks, especially in low resource settings. Further, our pre training approach substantially outperforms the baseline model on a prompt based probing task designed to elicit image objects. These results and our analysis indicate that our method allows for better utilization of the training data.


Mutual Consistency Learning for Semi supervised Medical Image Segmentation. In this paper, we propose a novel mutual consistency network (MC Net ) to effectively exploit the unlabeled data for semi supervised medical image segmentation. The MC Net model is motivated by the observation that deep models trained with limited annotations are prone to output highly uncertain and easily mis classified predictions in ambiguous regions (e.g., adhesive edges or thin branches) for medical image segmentation. Leveraging these region level challenging samples can make the semi supervised segmentation model training more effective. Therefore, our proposed MC Net model consists of two new designs. First, the model contains one shared encoder and multiple slightly different decoders (i.e., using different up sampling strategies). The statistical discrepancy of multiple decoders' outputs is computed to denote the model's uncertainty, which indicates the unlabeled hard regions. Second, we apply a novel mutual consistency constraint between one decoder's probability output and other decoders' soft pseudo labels. In this way, we minimize the discrepancy of multiple outputs (i.e., the model uncertainty) during training and force the model to generate invariant results in such challenging regions, aiming at capturing more useful features. We compared the segmentation results of our MC Net with five state of the art semi supervised approaches on three public medical datasets. Extension experiments with two common semi supervised settings demonstrate the superior performance of our model over other existing methods, which sets a new state of the art for semi supervised medical image segmentation.


Shimura subvarieties in the Prym locus of ramified Galois coverings. We study Shimura (special) subvarieties in the moduli space A p,D of complex abelian varieties of dimension p and polarization type D . These subvarieties arise from families of covers compatible with a fixed group action on the base curve such that the quotient of the base curve by the group is isomorphic to mathbb P 1 . We give a criterion for the image of these families under the Prym map to be a special subvariety and, using computer algebra, obtain 210 Shimura subvarieties contained in the Prym locus.


Faa T A Transparent Auto Scaling Cache for Serverless Applications. Function as a Service (FaaS) has become an increasingly popular way for users to deploy their applications without the burden of managing the underlying infrastructure. However, existing FaaS platforms rely on remote storage to maintain state, limiting the set of applications that can be run efficiently. Recent caching work for FaaS platforms has tried to address this problem, but has fallen short it disregards the widely different characteristics of FaaS applications, does not scale the cache based on data access patterns, or requires changes to applications. To address these limitations, we present Faa T, a transparent auto scaling distributed cache for serverless applications. Each application gets its own Faa T cache. After a function executes and the application becomes inactive, the cache is unloaded from memory with the application. Upon reloading for the next invocation, Faa T pre warms the cache with objects likely to be accessed. In addition to traditional compute based scaling, Faa T scales based on working set and object sizes to manage cache space and I O bandwidth. We motivate our design with a comprehensive study of data access patterns in a large scale commercial FaaS provider. We implement Faa T for the provider's production FaaS platform. Our experiments show that Faa T can improve performance by up to 92 (57 on average) for challenging applications, and reduce cost for most users compared to state of the art caching systems, i.e. the cost of having to stand up additional serverful resources.


A Survey on Low Resource Neural Machine Translation. Neural approaches have achieved state of the art accuracy on machine translation but suffer from the high cost of collecting large scale parallel data. Thus, a lot of research has been conducted for neural machine translation (NMT) with very limited parallel data, i.e., the low resource setting. In this paper, we provide a survey for low resource NMT and classify related works into three categories according to the auxiliary data they used (1) exploiting monolingual data of source and or target languages, (2) exploiting data from auxiliary languages, and (3) exploiting multi modal data. We hope that our survey can help researchers to better understand this field and inspire them to design better algorithms, and help industry practitioners to choose appropriate algorithms for their applications.


Physical limits on electromagnetic response. Photonic devices play an increasingly important role in advancing physics and engineering, and while improvements in nanofabrication and computational methods have driven dramatic progress in expanding the range of achievable optical characteristics, they have also greatly increased design complexity. These developments have led to heightened relevance for the study of fundamental limits on optical response. Here, we review recent progress in our understanding of these limits with special focus on an emerging theoretical framework that combines computational optimization with conservation laws to yield physical limits capturing all relevant wave effects. Results pertaining to canonical electromagnetic problems such as thermal emission, scattering cross sections, Purcell enhancement, and power routing are presented. Finally, we identify areas for additional research, including conceptual extensions and efficient numerical schemes for handling large scale problems.


On the number of ergodic measures of maximal entropy for partially hyperbolic diffeomorphisms with compact center leaves. In this paper, we study the number of ergodic measures of maximal entropy for partially hyperbolic diffeomorphisms defined on 3 torus with compact center leaves. Assuming the existence of a periodic leaf with Morse Smale dynamics we prove a sharp upper bound for the number of maximal measures in terms of the number of sources and sinks of Morse Smale dynamics. A well known class of examples for which our results apply are the so called Kan type diffeomorphisms admitting physical measures with intermingled basins.


p Completely bounded weighted homomorphisms on the p analog of the Fourier Stieltjes algebra. In this paper we study p completely boundedness of weighted maps on the p analog of the Fourier Stieltjes algebras, based on the p operator structure defined by the authors. We study p completely boundedness of homomorphisms, which are induced by continuous and proper piecewise affine maps, that is a generalization of Ilie's results on Fig a Talamanca Herz algebras.


A Technical Primer on the Physical Modeling of Diffusion Encoded Magnetic Resonance Experiments A Random Process Perspective. Diffusion encoded magnetic resonance (MR) experiments can provide important insights into the microstructural characteristics of a variety of biological tissues and other fluid or gas filled porous media. The physics of diffusion encoding has been studied extensively over the span of many decades, and many excellent descriptions can be found in the literature see, e.g., Refs. 1 5 . However, many of these descriptions spend relatively little time focusing on random process descriptions of the diffusion process, instead relying on different abstractions. In this primer, we describe diffusion encoded MR experiments from a random process perspective. While the results we derive from this perspective are quite standard (and match the results obtained with other arguments), we expect that the alternative derivations may be insightful for some readers. This primer is intended for technical readers who have a graduate level understanding of random processes. Readers are also expected to already have good familiarity with the basics of MR, and we anticipate that a signal processing perspective on MR 6 will be especially complementary to the random process perspectives presented herein.


Technical Note MC GPU breast dosimetry validations with other Monte Carlo codes and Phase Space File implementation. Purpose To validate the MC GPU Monte Carlo code for dosimetric studies in x ray breast imaging modalities mammography, digital breast tomosynthesis, contrast enhanced digital mammography and breast CT. Moreover, to implement and validate a phase space file generation routine. Methods The MC GPU code (v. 1.5 DBT) was modified in order to generate phase space files and to be compatible with PENELOPE v. 2018 derived cross section database. Simulations were performed with homogeneous and anthropomorphic breast phantoms for different breast imaging techniques. The glandular dose was computed for each case and compared with results from the PENELOPE (v. 2014) penEasy (v. 2015) and egs brachy (EGSnrc) Monte Carlo codes. Afterwards, several phase space files were generated with MC GPU and the scored photon spectra were compared between the codes. Results MC GPU showed good agreement with the other codes when calculating the glandular dose distribution for mammography, mean glandular dose for digital breast tomosynthesis, and normalized glandular dose for breast CT. The latter case showed average maximum relative differences of 2.3 27 , respectively, compared to other literature works, with the larger differences observed at low energies (around 10 keV). The recorded photon spectra entering a voxel were similar (within statistical uncertainties) between the three Monte Carlo codes. Conclusions The results indicate that MC GPU code is suitable for breast dosimetric studies for different x ray breast imaging modalities, with the advantage of a high performance. The phase space file implementation was validated and is compatible with the IAEA standard, allowing multiscale Monte Carlo simulations with a combination of CPU and GPU codes.


On the quasi steady state approximation in an open Michaelis Menten reaction mechanism. The conditions for the validity of the standard quasi steady state approximation in the Michaelis Menten mechanism in a closed reaction vessel have been well studied, but much less so the conditions for the validity of this approximation for the system with substrate inflow. We analyze quasi steady state scenarios for the open system attributable to singular perturbations, as well as less restrictive conditions. For both settings we obtain distinguished invariant slow manifolds and time scale estimates, and we highlight the special role of singular perturbation parameters in higher order approximations of slow manifolds. We close the paper with a discussion of distinguished invariant manifolds in the global phase portrait.


A Physics informed data reconciliation framework for real time electricity and emissions tracking. To encourage and guide decarbonization efforts, better tools are needed to monitor real time CO2 and criteria air pollutant emissions from electricity consumption, production, imports, and exports. Using real time data from the electricity system is especially challenging for quantitative applications requiring high quality and physically consistent data. Until now, time intensive, ad hoc and manual data verification and cleaning strategies have been used to prepare the data for quantitative analysis. As an alternative to existing techniques, here we provide a physics informed framework to greatly accelerate and automate data processing to enable internally consistent electric system consumption, production, import, and export data in near real time. A key component of this framework is an optimization program to minimize the data adjustments required to satisfy energy conservation equations. The effectiveness of this method is demonstrated by applying it to the continental United States electricity network. The resulting publicly available data set, which provides in near real time, hourly updates on electricity generation, consumption, imports, exports and associated emissions, is the first of this nature.


A Robust and Generalized Framework for Adversarial Graph Embedding. Graph embedding is essential for graph mining tasks. With the prevalence of graph data in real world applications, many methods have been proposed in recent years to learn high quality graph embedding vectors various types of graphs. However, most existing methods usually randomly select the negative samples from the original graph to enhance the training data without considering the noise. In addition, most of these methods only focus on the explicit graph structures and cannot fully capture complex semantics of edges such as various relationships or asymmetry. In order to address these issues, we propose a robust and generalized framework for adversarial graph embedding based on generative adversarial networks. Inspired by generative adversarial network, we propose a robust and generalized framework for adversarial graph embedding, named AGE. AGE generates the fake neighbor nodes as the enhanced negative samples from the implicit distribution, and enables the discriminator and generator to jointly learn each node's robust and generalized representation. Based on this framework, we propose three models to handle three types of graph data and derive the corresponding optimization algorithms, i.e., UG AGE and DG AGE for undirected and directed homogeneous graphs, respectively, and HIN AGE for heterogeneous information networks. Extensive experiments show that our methods consistently and significantly outperform existing state of the art methods across multiple graph mining tasks, including link prediction, node classification, and graph reconstruction.


Sequential approximations for types and Keisler measures. This paper is a modified chapter of the author's Ph.D. thesis. We introduce the notions of sequentially approximated types and sequentially approximated Keisler measures. As the names imply, these are types which can be approximated by a sequence of realized types and measures which can be approximated by a sequence of averaging measures' on tuples of realized types. We show that both generically stable types (in arbitrary theories) and Keisler measures which are finitely satisfiable over a countable model (in NIP theories) are sequentially approximated. We also introduce the notion of a smooth sequence in a measure over a model and give an equivalent characterization of generically stable measures (in NIP theories) via this definition. In the last section, we take the opportunity to generalize the main result of 8 .


Autonomous Deep Quality Monitoring in Streaming Environments. The common practice of quality monitoring in industry relies on manual inspection well known to be slow, error prone and operator dependent. This issue raises strong demand for automated real time quality monitoring developed from data driven approaches thus alleviating from operator dependence and adapting to various process uncertainties. Nonetheless, current approaches do not take into account the streaming nature of sensory information while relying heavily on hand crafted features making them application specific. This paper proposes the online quality monitoring methodology developed from recently developed deep learning algorithms for data streams, Neural Networks with Dynamically Evolved Capacity (NADINE), namely NADINE . It features the integration of 1 D and 2 D convolutional layers to extract natural features of time series and visual data streams captured from sensors and cameras of the injection molding machines from our own project. Real time experiments have been conducted where the online quality monitoring task is simulated on the fly under the prequential test then train fashion the prominent data stream evaluation protocol. Comparison with the state of the art techniques clearly exhibits the advantage of NADINE with 4.68 improvement on average for the quality monitoring task in streaming environments. To support the reproducible research initiative, codes, results of NADINE along with supplementary materials and injection molding dataset are made available in url https github.com ContinualAL NADINE IJCNN2021 .


Fast and Scalable Image Search For Histology. The expanding adoption of digital pathology has enabled the curation of large repositories of histology whole slide images (WSIs), which contain a wealth of information. Similar pathology image search offers the opportunity to comb through large historical repositories of gigapixel WSIs to identify cases with similar morphological features and can be particularly useful for diagnosing rare diseases, identifying similar cases for predicting prognosis, treatment outcomes, and potential clinical trial success. A critical challenge in developing a WSI search and retrieval system is scalability, which is uniquely challenging given the need to search a growing number of slides that each can consist of billions of pixels and are several gigabytes in size. Such systems are typically slow and retrieval speed often scales with the size of the repository they search through, making their clinical adoption tedious and are not feasible for repositories that are constantly growing. Here we present Fast Image Search for Histopathology (FISH), a histology image search pipeline that is infinitely scalable and achieves constant search speed that is independent of the image database size while being interpretable and without requiring detailed annotations. FISH uses self supervised deep learning to encode meaningful representations from WSIs and a Van Emde Boas tree for fast search, followed by an uncertainty based ranking algorithm to retrieve similar WSIs. We evaluated FISH on multiple tasks and datasets with over 22,000 patient cases spanning 56 disease subtypes. We additionally demonstrate that FISH can be used to assist with the diagnosis of rare cancer types where sufficient cases may not be available to train traditional supervised deep models. FISH is available as an easy to use, open source software package (https github.com mahmoodlab FISH).


Asymptotics of higher order hyperbolic equations with one or two dissipative lower order terms. In this paper, we consider the Cauchy problem for a hyperbolic equation Q( partial t, partial x)u 0 of any order m geq3 , where t geq0 and x in mathbb R n , and Q P m P m 1 P m 2 is a sum of homogeneous hyperbolic polynomials P m j of order m j . We assume the sufficient and necessary condition which guarantees the strict stability of the polynomial Q( lambda,i xi) , for any xi neq0 . Under this assumption, we derive a polynomial decay rate for the energy of the problem, in different scenarios of interlacing of the polynomials P m j ( lambda, xi) , and we describe the asymptotic profile of the solution as t to infty , assuming a moment condition on the initial data. In order to do this, we study the asymptotic behavior of the m roots of the full symbol Q( lambda,i xi) , as xi to0 and as xi to infty . Examples of models to which the results may be applied include the theory of acoustic waves and the theory of electromagnetic elastic waves. Also, as an application, we prove the existence of global small data solutions to the problem with supercritical power nonlinearities of type D alpha u p , with alpha leq m 2 .


Real Time Detection of Crowded Buses via Mobile Phones. Automated passenger counting (APC) technology is central to many aspects of the public transit experience. APC information informs public transit planners about utilization in a public transit system and operations about dynamic fluctuations in demand. Perhaps most importantly, APC information provides one metric to the rider experience standing during a long ride because of a crowded vehicle is an unpleasant experience. Several technologies have been successfully used for APC including light beam sensing and video image analysis. However, these technologies are expensive and must be installed in buses. In this paper, we analyze a new source of data using statistical models rider smartphone accelerometers. Smartphones are ubiquitous in society and accelerometers have been shown to accurately model user states such as walking and sitting. We extend these models to use accelerometers to detect if the rider is standing or sitting on a bus. Standing riders are a signal that the bus is crowded. This paper provides evidence that user smartphones are a valid source of participatory sensing and thus a new source of automated passenger counting data.


Seeking Common but Distinguishing Difference, A Joint Aspect based Sentiment Analysis Model. Aspect based sentiment analysis (ABSA) task consists of three typical subtasks aspect term extraction, opinion term extraction, and sentiment polarity classification. These three subtasks are usually performed jointly to save resources and reduce the error propagation in the pipeline. However, most of the existing joint models only focus on the benefits of encoder sharing between subtasks but ignore the difference. Therefore, we propose a joint ABSA model, which not only enjoys the benefits of encoder sharing but also focuses on the difference to improve the effectiveness of the model. In detail, we introduce a dual encoder design, in which a pair encoder especially focuses on candidate aspect opinion pair classification, and the original encoder keeps attention on sequence labeling. Empirical results show that our proposed model shows robustness and significantly outperforms the previous state of the art on four benchmark datasets.


Privacy Regularization Joint Privacy Utility Optimization in Language Models. Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy implications when training models on user content such as email correspondence. Differential privacy (DP), a popular choice to train models with privacy guarantees, comes with significant costs in terms of utility degradation and disparate impact on subgroups of users. In this work, we introduce two privacy preserving regularization methods for training language models that enable joint optimization of utility and privacy through (1) the use of a discriminator and (2) the inclusion of a triplet loss term. We compare our methods with DP through extensive evaluation. We show the advantages of our regularizers with favorable utility privacy trade off, faster training with the ability to tap into existing optimization approaches, and ensuring uniform treatment of under represented subgroups.


A note on degenerate generalized Laguerre polynomials and Lah numbers. The aim of this paper is to introduce the degenerate generalized Laguerre polynomials as the degenerate version of the generalized Laguerre polynomials and to derive some properties related to those polynomials and Lah numbers, including an explicit expression, a Rodrigues' type formula and expressions for the derivatives. The novelty of the present paper is that it is the first paper on degenerate versions of orthogonal polynomials.


2 minute science A Science Communication Project for Astrophysics. Two minute science (2 minute science) is a science communication project initiated and supported by early career Greek astrophysicists. With this endeavor, which started in December 2020, we try to bridge the gap between the scientific community and the public. This project is based on the simple idea of writing short articles with an approximate reading time of two minutes. These articles cover several topics and their difficulty scales to cover a broad audience range, from young students to experienced adults. We support the idea of ask an expert in Astrophysics in Greece, where any reader can pose a question. We offer the appropriate answer either by writing it ourselves or by contacting the field experts from the Greek astronomical society. Furthermore, our previous science communication experience leads us to design educational activities for students and or adults based on pedagogical means. A successful one was an escape zoom titled Escape to Other Worlds , a digital version of an escape room. Further activities are Astronomy workshops for teenagers, online talks to schools, and our participation in a scientific podcast to trigger the public interest in Astrophysics. We communicate this work through social media, where several thousands of people already follow our work.


Projections of modular forms on Eisenstein series and its application to Siegel's formula. Let k geq 2 and N be positive integers and let chi be a Dirichlet character modulo N . Let f(z) be a modular form in M k( Gamma 0(N), chi) . Then we have a unique decomposition f(z) E f(z) S f(z) , where E f(z) in E k( Gamma 0(N), chi) and S f(z) in S k( Gamma 0(N), chi) . In this paper we give an explicit formula for E f(z) in terms of Eisenstein series. Then we apply our result to certain families of eta quotients and to representations of positive integers by 2k ary positive definite quadratic forms in order to give an alternative version of Siegel's formula for the weighted average number of representations of an integer by quadratic forms in the same genus. Our formula for the latter is in terms of generalized divisor functions and does not involve computation of local densities.


Measurement of two point coherence functions of electromagnetic optical fields and applications of optical coherence. For stationary light fields, manifestation of statistical properties such as coherence and polarization are attributed to the same physical phenomena, i.e. correlations in fluctuations of optical fields. In order to explain various properties associated with electromagnetic optical fields, both coherence and polarization need to be placed at same footings. This leads to two point (space or time) generalization of single point properties such as Stokes parameters and elements of coherency matrix. This paper reviews the basic aspects concerning vectorial optical fields and experimental methods developed during last couple of decades for the measurement of two point correlation functions of electromagnetic optical fields in spatial and temporal domain. Studies related to coherence properties of optical fields have led to several important technological applications during last seven decades, which are also discussed briefly in this review.


Probabilistic Attention for Interactive Segmentation. We provide a probabilistic interpretation of attention and show that the standard dot product attention in transformers is a special case of Maximum A Posteriori (MAP) inference. The proposed approach suggests the use of Expectation Maximization algorithms for online adaptation of key and value model parameters. This approach is useful for cases in which external agents, e.g., annotators, provide inference time information about the correct values of some tokens, e.g, the semantic category of some pixels, and we need for this new information to propagate to other tokens in a principled manner. We illustrate the approach on an interactive semantic segmentation task in which annotators and models collaborate online to improve annotation efficiency. Using standard benchmarks, we observe that key adaptation boosts model performance ( sim10 mIoU) in the low feedback regime and value propagation improves model responsiveness in the high feedback regime. A PyTorch layer implementation of our probabilistic attention model will be made publicly available here https github.com apple ml probabilistic attention.


Honest but Curious Nets Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs. It is known that deep neural networks, trained for the classification of non sensitive target attributes, can reveal sensitive attributes of their input data through internal representations extracted by the classifier. We take a step forward and show that deep classifiers can be trained to secretly encode a sensitive attribute of their input data into the classifier's outputs for the target attribute, at inference time. Our proposed attack works even if users have a full white box view of the classifier, can keep all internal representations hidden, and only release the classifier's estimations for the target attribute. We introduce an information theoretical formulation for such attacks and present efficient empirical implementations for training honest but curious (HBC) classifiers classifiers that can be accurate in predicting their target attribute, but can also exploit their outputs to secretly encode a sensitive attribute. Our work highlights a vulnerability that can be exploited by malicious machine learning service providers to attack their user's privacy in several seemingly safe scenarios such as encrypted inferences, computations at the edge, or private knowledge distillation. Experimental results on several attributes in two face image datasets show that a semi trusted server can train classifiers that are not only perfectly honest but also accurately curious. We conclude by showing the difficulties in distinguishing between standard and HBC classifiers, discussing challenges in defending against this vulnerability of deep classifiers, and enumerating related open directions for future studies.


Generic Event Boundary Detection Challenge at CVPR 2021 Technical Report Cascaded Temporal Attention Network (CASTANET). This report presents the approach used in the submission of Generic Event Boundary Detection (GEBD) Challenge at CVPR21. In this work, we design a Cascaded Temporal Attention Network (CASTANET) for GEBD, which is formed by three parts, the backbone network, the temporal attention module, and the classification module. Specifically, the Channel Separated Convolutional Network (CSN) is used as the backbone network to extract features, and the temporal attention module is designed to enforce the network to focus on the discriminative features. After that, the cascaded architecture is used in the classification module to generate more accurate boundaries. In addition, the ensemble strategy is used to further improve the performance of the proposed method. The proposed method achieves 83.30 F1 score on Kinetics GEBD test set, which improves 20.5 F1 score compared to the baseline method. Code is available at https github.com DexiangHong Cascade PC.


On the density of nonlinear statistics. In this note, we revisit a classical problem related to the density of nonlinear statistics. We obtain a new representation of densities and, for the first time, a necessary and sufficient condition for the existence of densities is provided.


UnNatural Language Inference. Recent investigations into the inner workings of state of the art large scale pre trained Transformer based Natural Language Understanding (NLU) models indicate that they appear to know humanlike syntax, at least to some extent. We provide novel evidence that complicates this claim we find that state of the art Natural Language Inference (NLI) models assign the same labels to permuted examples as they do to the original, i.e. they are largely invariant to random word order permutations. This behavior notably differs from that of humans we struggle with ungrammatical sentences. To measure the severity of this issue, we propose a suite of metrics and investigate which properties of particular permutations lead models to be word order invariant. In the MNLI dataset, for example, we find almost all (98.7 ) examples contain at least one permutation which elicits the gold label. Models are sometimes even able to assign gold labels to permutations that they originally failed to predict correctly. We provide a comprehensive empirical evaluation of this phenomenon, and further show that this issue exists for both Transformers and pre Transformer RNN ConvNet based encoders, as well as across multiple languages (English and Mandarin Chinese). Our code and data are available at https github.com facebookresearch unlu.


A Bombieri Vinogradov type theorem with prime power moduli. In 2020, Roger Baker cite Bak proved a result on the exceptional set of moduli in the prime number theorem for arithmetic progressions of the following kind. Let mathcal S be a set of pairwise coprime moduli q le x 9 40 . Then the primes l le x distribute as expected in arithmetic progressions mod q , except for a subset of mathcal S whose cardinality is bounded by a power of log x . We use a p adic variant Harman's sieve to extend Baker's range to q le x 1 4 varepsilon if mathcal S is restricted to prime powers p N , where p le ( log x) C for some fixed but arbitrary C 0 . For large enough C , we thus get an almost all result. Previously, an asymptotic estimate for pi(x p N,a) of the expected kind, with p being an odd prime, was established in the wider range p N le x 3 8 varepsilon by Barban, Linnik and Chudakov cite BLC . Gallagher cite Gal extended this range to p N le x 2 5 varepsilon and Huxley cite Hux2 improved Gallagher's exponent to 5 12 . A lower bound of the correct order of magnitude was recently established by Banks and Shparlinski cite BaS for the even wider range p N le x 0.4736 . However, all these results hold for it fixed primes p , and the O constants in the relevant estimates depend on p . Therefore, they do not contain our result. In a part of our article, we describe how our method relates to these results.


Visual Sensor Pose Optimisation Using Rendering based Visibility Models for Robust Cooperative Perception. Visual Sensor Networks can be used in a variety of perception applications such as infrastructure support for autonomous driving in complex road segments. The pose of the sensors in such networks directly determines the coverage of the environment and objects therein, which impacts the performance of applications such as object detection and tracking. Existing sensor pose optimisation methods in the literature either maximise the coverage of ground surfaces, or consider the visibility of the target objects as binary variables, which cannot represent various degrees of visibility. Such formulations cannot guarantee the visibility of the target objects as they fail to consider occlusions. This paper proposes two novel sensor pose optimisation methods, based on gradient ascent and Integer Programming techniques, which maximise the visibility of multiple target objects in cluttered environments. Both methods consider a realistic visibility model based on a rendering engine that provides pixel level visibility information about the target objects. The proposed methods are evaluated in a complex environment and compared to existing methods in the literature. The evaluation results indicate that explicitly modelling the visibility of target objects is critical to avoid occlusions in cluttered environments. Furthermore, both methods significantly outperform existing methods in terms of object visibility.


Equivariant bifurcation, quadratic equivariants, and symmetry breaking for the standard representation of S n . Motivated by questions originating from the study of a class of shallow student teacher neural networks, methods are developed for the analysis of spurious minima in classes of gradient equivariant dynamics related to neural nets. In the symmetric case, methods depend on the generic equivariant bifurcation theory of irreducible representations of the symmetric group on n symbols, S n in particular, the standard representation of S n . It is shown that spurious minima do not arise from spontaneous symmetry breaking but rather through a complex deformation of the landscape geometry that can be encoded by a generic S n equivariant bifurcation. We describe minimal models for forced symmetry breaking that give a lower bound on the dynamic complexity involved in the creation of spurious minima when there is no symmetry. Results on generic bifurcation when there are quadratic equivariants are also proved this work extends and clarifies results of Ihrig Golubitsky and Chossat, Lauterback Melbourne on the instability of solutions when there are quadratic equivariants.


Robust On Policy Data Collection for Data Efficient Policy Evaluation. This paper considers how to complement offline reinforcement learning (RL) data with additional data collection for the task of policy evaluation. In policy evaluation, the task is to estimate the expected return of an evaluation policy on an environment of interest. Prior work on offline policy evaluation typically only considers a static dataset. We consider a setting where we can collect a small amount of additional data to combine with a potentially larger offline RL dataset. We show that simply running the evaluation policy on policy data collection is sub optimal for this setting. We then introduce two new data collection strategies for policy evaluation, both of which consider previously collected data when collecting future data so as to reduce distribution shift (or sampling error) in the entire dataset collected. Our empirical results show that compared to on policy sampling, our strategies produce data with lower sampling error and generally lead to lower mean squared error in policy evaluation for any total dataset size. We also show that these strategies can start from initial off policy data, collect additional data, and then use both the initial and new data to produce low mean squared error policy evaluation without using off policy corrections.


Point supervised Segmentation of Microscopy Images and Volumes via Objectness Regularization. Annotation is a major hurdle in the semantic segmentation of microscopy images and volumes due to its prerequisite expertise and effort. This work enables the training of semantic segmentation networks on images with only a single point for training per instance, an extreme case of weak supervision which drastically reduces the burden of annotation. Our approach has two key aspects (1) we construct a graph theoretic soft segmentation using individual seeds to be used within a regularizer during training and (2) we use an objective function that enables learning from the constructed soft labels. We achieve competitive results against the state of the art in point supervised semantic segmentation on challenging datasets in digital pathology. Finally, we scale our methodology to point supervised segmentation in 3D fluorescence microscopy volumes, obviating the need for arduous manual volumetric delineation. Our code is freely available.


Monitoring with Verified Guarantees. Runtime monitoring is generally considered a light weight alternative to formal verification. In safety critical systems, however, the monitor itself is a critical component. For example, if the monitor is responsible for initiating emergency protocols, as proposed in a recent aviation standard, then the safety of the entire system critically depends on guarantees of the correctness of the monitor. In this paper, we present a verification extension to the Lola monitoring language that integrates the efficient specification of the monitor with Hoare style annotations that guarantee the correctness of the monitor specification. We add two new operators, assume and assert, which specify assumptions of the monitor and expectations on its output, respectively. The validity of the annotations is established by an integrated SMT solver. We report on experience in applying the approach to specifications from the avionics domain, where the annotation with assumptions and assertions has lead to the discovery of safety critical errors in the specifications. The errors range from incorrect default values in offset computations to complex algorithmic errors that result in unexpected temporal patterns.


Dynamic characterization of control SIR type systems and optimal single interval control. Although modeling studies are focused on the control of SIR based systems describing epidemic data sets (particularly the COVID 19), few of them present a formal dynamic characterization in terms of equilibrium sets and stability. Such concepts can be crucial to understand not only how the virus spreads in a population, but also how to tailor government interventions such as social distancing, isolation measures, etc. The objective of this work is to provide a full dynamic characterization of SIR type systems under single interval control actions and, based on it, to find the control action that produces the smallest number of infected individuals at the end of the epidemic that avoids second wave outbreaks. Because of its simplicity, the latter result is intended to be just a reference baseline for more complex control strategies related to general nonpharmaceutical measure ( textit i.e ., those accounting for the health system capacity, the number of deaths, etc.). Simulations illustrate the benefits of the aforementioned results in terms of the herd immunity threshold.


Crowdsourcing with Meta Workers A New Way to Save the Budget. Due to the unreliability of Internet workers, it's difficult to complete a crowdsourcing project satisfactorily, especially when the tasks are multiple and the budget is limited. Recently, meta learning has brought new vitality to few shot learning, making it possible to obtain a classifier with a fair performance using only a few training samples. Here we introduce the concept of emph meta worker , a machine annotator trained by meta learning for types of tasks (i.e., image classification) that are well fit for AI. Unlike regular crowd workers, meta workers can be reliable, stable, and more importantly, tireless and free. We first cluster unlabeled data and ask crowd workers to repeatedly annotate the instances nearby the cluster centers we then leverage the annotated data and meta training datasets to build a cluster of meta workers using different meta learning algorithms. Subsequently, meta workers are asked to annotate the remaining crowdsourced tasks. The Jensen Shannon divergence is used to measure the disagreement among the annotations provided by the meta workers, which determines whether or not crowd workers should be invited for further annotation of the same task. Finally, we model meta workers' preferences and compute the consensus annotation by weighted majority voting. Our empirical study confirms that, by combining machine and human intelligence, we can accomplish a crowdsourcing project with a lower budget than state of the art task assignment methods, while achieving a superior or comparable quality.


A Fait Accompli? An Empirical Study into the Absence of Consent to Third Party Tracking in Android Apps. Third party tracking allows companies to collect users' behavioural data and track their activity across digital devices. This can put deep insights into users' private lives into the hands of strangers, and often happens without users' awareness or explicit consent. EU and UK data protection law, however, requires consent, both 1) to access and store information on users' devices and 2) to legitimate the processing of personal data as part of third party tracking, as we analyse in this paper. This paper further investigates whether and to what extent consent is implemented in mobile apps. First, we analyse a representative sample of apps from the Google Play Store. We find that most apps engage in third party tracking, but few obtained consent before doing so, indicating potentially widespread violations of EU and UK privacy law. Second, we examine the most common third party tracking libraries in detail. While most acknowledge that they rely on app developers to obtain consent on their behalf, they typically fail to put in place robust measures to ensure this disclosure of consent requirements is limited default consent implementations are lacking and compliance guidance is difficult to find, hard to read, and poorly maintained.


Interference Alignment Using Reaction in Molecular Interference Channels. Interference alignment (IA) is a promising scheme to increase the throughput of the system with shared mediums. In this paper, we propose a novel IA scheme in molecular interference channels (IFCs) based on the choice of releasing sampling times. To cancel the aligned interference signals and reduce the signal dependent noise, we use molecular reaction in the proposed IA scheme. We obtain the feasible region for the releasing sampling times in the IA scheme using reaction. Further, we investigate the error performance of the proposed scheme. Our results show that the proposed IA scheme using reaction improves the performance significantly.


Covering dimension of Cuntz semigroups. We introduce a notion of covering dimension for Cuntz semigroups of C algebras. This dimension is always bounded by the nuclear dimension of the C algebra, and for subhomogeneous C algebras both dimensions agree. Cuntz semigroups of Z stable C algebras have dimension at most one. Further, the Cuntz semigroup of a simple, Z stable C algebra is zero dimensional if and only if the C algebra has real rank zero or is stably projectionless.


Positive mass theorem and the CR Yamabe equation on 5 dimensional contact spin manifolds. We consider the CR Yamabe equation with critical Sobolev exponent on a closed contact manifold M of dimension 2n 1. The problem of finding solutions with minimum energy has been resolved for all dimensions except dimension 5 (n 2). In this paper we prove the existence of minimum energy solutions in the 5 dimensional case when M is spin. The proof is based on a positive mass theorem built up through a spinorial approach.


Compilation of Aggregates in ASP. Answer Set Programming (ASP) is a well known problem solving formalism in computational logic. Nowadays, ASP is used in many real world scenarios thanks to ASP solvers. Standard evaluation of ASP programs suffers from an intrinsic limitation, knows as Grounding Bottleneck, due to the grounding of some rules that could fit all the available memory. As a result, there exist instances of real world problems that are untractable using the standard Ground and Solve approach. In order to tackle this problem, different strategies have been proposed. Among them we focus on a recent approach based on compilation of problematic constraints as propagators, which revealed to be very promising but is currently limited to constraints without aggregates. Since aggregates are widely used in ASP, in this paper we extend such an approach also to constraints containing aggregates. Good results, that proof the effectiveness of the proposed approach, have been reached.


A gradient sampling method with complexity guarantees for Lipschitz functions in high and low dimensions. Zhang et al. introduced a novel modification of Goldstein's classical subgradient method, with an efficiency guarantee of O( varepsilon 4 ) for minimizing Lipschitz functions. Their work, however, makes use of a nonstandard subgradient oracle model and requires the function to be directionally differentiable. In this paper, we show that both of these assumptions can be dropped by simply adding a small random perturbation in each step of their algorithm. The resulting method works on any Lipschitz function whose value and gradient can be evaluated at points of differentiability. We additionally present a new cutting plane algorithm that achieves better efficiency in low dimensions O(d varepsilon 3 ) for Lipschitz functions and O(d varepsilon 2 ) for those that are weakly convex.


Hierarchical Self supervised Augmented Knowledge Distillation. Knowledge distillation often involves how to define and transfer knowledge from teacher to student effectively. Although recent self supervised contrastive knowledge achieves the best performance, forcing the network to learn such knowledge may damage the representation learning of the original class recognition task. We therefore adopt an alternative self supervised augmented task to guide the network to learn the joint distribution of the original recognition task and self supervised auxiliary task. It is demonstrated as a richer knowledge to improve the representation power without losing the normal classification capability. Moreover, it is incomplete that previous methods only transfer the probabilistic knowledge between the final layers. We propose to append several auxiliary classifiers to hierarchical intermediate feature maps to generate diverse self supervised knowledge and perform the one to one transfer to teach the student network thoroughly. Our method significantly surpasses the previous SOTA SSKD with an average improvement of 2.56 on CIFAR 100 and an improvement of 0.77 on ImageNet across widely used network pairs. Codes are available at https github.com winycg HSAKD.


Plethysms of Chromatic and Tutte Symmetric Functions. Plethysm is a fundamental operation in symmetric function theory, derived directly from its connection with representation theory. However, it does not admit a simple combinatorial interpretation, and finding coefficients of Schur function plethysms is a major open question. In this paper, we introduce a graph theoretic interpretation for any plethysm based on the chromatic symmetric function. We use this interpretation to give simple proofs of new and previously known plethystic identities, as well as chromatic symmetric function identities.


Particle Physics in High School Part I Quantum Electrodynamics. This is the first paper of a series aiming to present a new teaching sequence for Particle Physics in high school. We propose a systematic discussion of the subject, covering not only the understanding of its key concepts, but also of the very nature of Science, of the factors that surround its practice and of its relations to technology, society and the environment, in a framework towards scientific literacy. In this work we present the first part of this teaching sequence, focused on the quantum theory of electromagnetism Quantum Electrodynamics. We analyze the potentialities of the material proposed here, when applied in a dialogic manner by the teacher, by evaluating the presence of scientific literacy and engagement indicators throughout interventions at a full time public school in Espirito Santo, Brazil.


Inference of population level disease transmissibility from household structured symptom onset data. First Few X (FFX) studies collect household stratified data in the early stages of a pandemic, in order to infer severity and transmissibility of an emerging disease. We present a Bayesian method to approximately infer population level transmissibility for the first time from such data previous studies have only inferred household level transmissibility. To do this we perform the inference at two levels, assuming one transmission rate parameter for within household infection, and another transmission rate parameter for infection between different households. We use a simplifying assumption that between household infections always occur in naive households while still performing full joint inference on the within household infection parameters. In addition, a novel technique is used to remove systematic bias when the number of new infections per day is growing or decaying, as is common in real outbreaks, without the need for contemporaneous estimates of the serial interval. The method is validated on simulated data and is shown to perform well, even when the number of infected households is relatively small.


Relative energy estimates for the Cahn Hilliard equation with concentration dependent mobility. Based on relative energy estimates, we study the stability of solutions to the Cahn Hilliard equation with concentration dependent mobility with respect to perturbations. As a by product of our analysis, we obtain a weak strong uniqueness principle on the continuous level under realistic regularity assumptions on strong solutions. We then show that the stability estimates can be further inherited almost verbatim by appropriate Galerkin approximations in space and time. This allows us to derive sharp bounds for the discretization error in terms of certain projection errors and to establish order optimal a priori error estimates for semi and fully discrete approximation schemes.


Semiconcavity and Sensitivity Analysis in Mean Field Optimal Control and Applications. In this article, we investigate some of the fine properties of the value function associated to an optimal control problem in the Wasserstein space of probability measures. Building on new interpolation and linearisation formulas for non local flows, we prove semiconcavity estimates for the value function, and establish several variants of the so called sensitivity relations which provide connections between its superdifferential and the adjoint curves stemming from the maximum principle. We subsequently make use of these results to study the propagation of regularity for the value function along optimal trajectories, as well as to investigate sufficient optimality conditions and optimal feedbacks for mean field optimal control problems.


Dynamic Emotions of Supporters and Opponents of Anti racism Movement from George Floyd Protests. Social media empowers citizens to raise the voice and expressed civil outrage leads to collective action to change the society. Since social media welcomes anyone regardless of the political ideology or perspectives, social media is where the supporters and opponents of specific issue discuss. This study attempts to empirically examine a recent anti racism movement initiated by the death of George Floyd with the lens of stance prediction and aspect based sentiment analysis (ABSA). First, this study found the stance of the tweet and users do change over the course of the protest. Furthermore, there are more users who shifted the stance compared to those who maintained the stance. Second, both supporters and opponents expressed negative sentiment more on nine extracted aspects. This indicates that there was no significant difference of sentiment among supporters and opponents and raise a caution in predicting stance based on the sentiment. The contribution of the study is two fold. First, ABSA was explored in the context of computational social science and second, stance prediction was first attempted at scale.


A Design of Governmental Policies for the Eradication of COVID 19 in Jakarta Using an SIR Type Mathematical Model. Using a discretised version of our recently developed SIR type mathematical model for the spread of COVID 19, we construct a design of governmental policies for the eradication of the disease in the province of DKI Jakarta, Indonesia, taking as a basis the actual data of mid 2021. The design takes the form of a precise, quantitative method to determine the appropriate level(s) of restrictions on community activities (PPKM) which should be enforced in the province on any given day, based on the current values of the disease's effective reproduction number and the hospitals' bed occupancy rate.


Evo ViT Slow Fast Token Evolution for Dynamic Vision Transformer. Vision transformers (ViTs) have recently received explosive popularity, but the huge computational cost is still a severe issue. Since the computation complexity of ViT is quadratic with respect to the input sequence length, a mainstream paradigm for computation reduction is to reduce the number of tokens. Existing designs include structured spatial compression that uses a progressive shrinking pyramid to reduce the computations of large feature maps, and unstructured token pruning that dynamically drops redundant tokens. However, the limitation of existing token pruning lies in two folds 1) the incomplete spatial structure caused by pruning is not compatible with structured spatial compression that is commonly used in modern deep narrow transformers 2) it usually requires a time consuming pre training procedure. To tackle the limitations and expand the applicable scenario of token pruning, we present Evo ViT, a self motivated slow fast token evolution approach for vision transformers. Specifically, we conduct unstructured instance wise token selection by taking advantage of the simple and effective global class attention that is native to vision transformers. Then, we propose to update the selected informative tokens and uninformative tokens with different computation paths, namely, slow fast updating. Since slow fast updating mechanism maintains the spatial structure and information flow, Evo ViT can accelerate vanilla transformers of both flat and deep narrow structures from the very beginning of the training process. Experimental results demonstrate that our method significantly reduces the computational cost of vision transformers while maintaining comparable performance on image classification.


On Complexity of Computing Bottleneck and Lexicographic Optimal Cycles in a Homology Class. Homology features of spaces which appear in applications, for instance 3D meshes, are among the most important topological properties of these objects. Given a non trivial cycle in a homology class, we consider the problem of computing a representative in that homology class which is optimal. We study two measures of optimality, namely, the lexicographic order of cycles (the lex optimal cycle) and the bottleneck norm (a bottleneck optimal cycle). We give a simple algorithm for computing the lex optimal cycle for a 1 homology lass in a closed orientable surface. In contrast to this, our main result is that, in the case of 3 Manifolds of size n 2 in the Euclidean 3 space, the problem of finding a bottleneck optimal cycle cannot be solved more efficiently than solving a system of linear equations with an n times n sparse matrix. From this reduction, we deduce several hardness results. Most notably, we show that for 3 manifolds given as a subset of the 3 space of size n 2 , persistent homology computations are at least as hard as rank computation (for sparse matrices) while ordinary homology computations can be done in O(n 2 log n) time. This is the first such distinction between these two computations. Moreover, it follows that the same disparity exists between the height persistent homology computation and general sub level set persistent homology computation for simplicial complexes in the 3 space.


tgEDMD Approximation of the Kolmogorov Operator in Tensor Train Format. Extracting information about dynamical systems from models learned off simulation data has become an increasingly important research topic in the natural and engineering sciences. Modeling the Koopman operator semigroup has played a central role in this context. As the approximation quality of any such model critically depends on the basis set, recent work has focused on deriving data efficient representations of the Koopman operator in low rank tensor formats, enabling the use of powerful model classes while avoiding over fitting. On the other hand, detailed information about the system at hand can be extracted from models for the infinitesimal generator, also called Kolmogorov backward operator for stochastic differential equations. In this work, we present a data driven method to efficiently approximate the generator using the tensor train (TT) format. The centerpiece of the method is a TT representation of the tensor of generator evaluations at all data sites. We analyze consistency and complexity of the method, present extensions to practically relevant settings, and demonstrate its applicability to benchmark numerical examples.


Technical Report Expected Exploitability Predicting the Development of Functional Vulnerability Exploits. Assessing the exploitability of software vulnerabilities at the time of disclosure is difficult and error prone, as features extracted via technical analysis by existing metrics are poor predictors for exploit development. Moreover, exploitability assessments suffer from a class bias because "not exploitable" labels could be inaccurate. To overcome these challenges, we propose a new metric, called Expected Exploitability (EE), which reflects, over time, the likelihood that functional exploits will be developed. Key to our solution is a time varying view of exploitability, a departure from existing metrics. This allows us to learn EE using data driven techniques from artifacts published after disclosure, such as technical write ups and proof of concept exploits, for which we design novel feature sets. This view also allows us to investigate the effect of the label biases on the classifiers. We characterize the noise generating process for exploit prediction, showing that our problem is subject to the most challenging type of label noise, and propose techniques to learn EE in the presence of noise. On a dataset of 103,137 vulnerabilities, we show that EE increases precision from 49 to 86 over existing metrics, including two state of the art exploit classifiers, while its precision substantially improves over time. We also highlight the practical utility of EE for predicting imminent exploits and prioritizing critical vulnerabilities. We develop EE into an online platform which is publicly available at https exploitability.app .


Interpretable Convolutional Neural Networks for Subject Independent Motor Imagery Classification. Deep learning frameworks have become increasingly popular in brain computer interface (BCI) study thanks to their outstanding performance. However, in terms of the classification model alone, they are treated as black box as they do not provide any information on what led them to reach a particular decision. In other words, we cannot convince whether the high performance was aroused by the neuro physiological factors or simply noise. Because of this disadvantage, it is difficult to ensure adequate reliability compared to their high performance. In this study, we propose an explainable deep learning model for BCI. Specifically, we aim to classify EEG signal which is obtained from the motor imagery (MI) task. In addition, we adopted layer wise relevance propagation (LRP) to the model to interpret the reason that the model derived certain classification output. We visualized the heatmap which indicates the output of the LRP in form of topography to certify neuro physiological factors. Furthermore, we classified EEG with the subject independent manner to learn robust and generalized EEG features by avoiding subject dependency. The methodology also provides the advantage of avoiding the expense of building training data for each subject. With our proposed model, we obtained generalized heatmap patterns for all subjects. As a result, we can conclude that our proposed model provides neuro physiologically reliable interpretation.


Temperature Equilibration Due to Charge State Fluctuations in Dense Plasmas. The charge states of ions in dense plasmas fluctuate due to collisional ionization and recombination. Here we show how, by modifying the ion interaction potential, these fluctuations can mediate energy exchange between the plasma electrons and ions. Moreover, we develop a theory for this novel electron ion energy transfer mechanism. Calculations using a random walk approach for the fluctuations suggest that the energy exchange rate from charge state fluctuations could be comparable to direct electron ion collisions. This mechanism is, however, predicted to exhibit a complex dependence on the temperature and ionization state of the plasma, which could contribute to our understanding of significant variation in experimental measurements of equilibration times.


Halidon Rings and their Applications. Halidon rings are rings with a unit element, containing a primitive m th root of unity and m is invertible in the ring. The field of complex numbers is a halidon ring with any index m geq 1 . In this article, the author examines the computational aspects of a new class of rings called Halidon rings and their applications with the help of computer codes. In representation theory, Maschke's theorem has an important role in studying the irreducible subrepresentations of a given group representation. Mainly the study is related to a finite field of characteristic which does not divide the order of the given finite group or the field of real or complex numbers. This article also examines the possibility of replacing the finite field in the theorem with halidon rings in such a way that the theorem is still valid. Halidon rings are rings with the unit element, containing a primitive m th root of unity and m is invertible in the ring. The field of complex numbers is a halidon ring with any index m geq 1 . Some computer codes have been developed to establish the existence of halidon rings which are not fields and the computation of units, involutions and idempotents in both halidon rings and halidon group rings. The application halidon rings in Discrete Fourier Transform (DFT) is studied and two computer codes have been developed to calculate DFT and inverse DFT


A well balanced reconstruction with bounded velocities for the shallow water equations by convex combination. Finite volume schemes for hyperbolic balance laws require a piecewise polynomial reconstruction of the cell averaged values, and a reconstruction is termed well balanced' if it is able to simulate steady states at higher order than time evolving states. For the shallow water system this involves reconstructing in surface elevation, to which modifications must be made as the fluid depth becomes small to ensure positivity, and for many reconstruction schemes a modification of the inertial field is also required to ensure the velocities are bounded. We propose here a reconstruction based on a convex combination of surface and depth reconstructions which ensures that the depth increases with the cell average depth. We also discuss how, for cells that are much shallower than their neighbours, reducing the variation in the reconstructed flux yields bounds on the velocities. This approach is generalisable to high order schemes, problems in multiple spacial dimensions, and to more complicated systems of equations. We present reconstructions and associated technical results for three systems, the standard shallow water equations, shallow water in a channel of varying width, and a shallow water model of a particle driven current. Positivity preserving time stepping is also discussed.


Decentralized Ability Aware Adaptive Control for Multi robot Collaborative Manipulation. Multi robot teams can achieve more dexterous, complex and heavier payload tasks than a single robot, yet effective collaboration is required. Multi robot collaboration is extremely challenging due to the different kinematic and dynamics capabilities of the robots, the limited communication between them, and the uncertainty of the system parameters. In this paper, a Decentralized Ability Aware Adaptive Control is proposed to address these challenges based on two key features. Firstly, the common manipulation task is represented by the proposed nominal task ellipsoid, which is used to maximize each robot force capability online via optimizing its configuration. Secondly, a decentralized adaptive controller is designed to be Lyapunov stable in spite of heterogeneous actuation constraints of the robots and uncertain physical parameters of the object and environment. In the proposed framework, decentralized coordination and load distribution between the robots is achieved without communication, while only the control deficiency is broadcast if any of the robots reaches its force limits. In this case, the object reference trajectory is modified in a decentralized manner to guarantee stable interaction. Finally, we perform several numerical and physical simulations to analyse and verify the proposed method with heterogeneous multi robot teams in collaborative manipulation tasks.


Moduli Spaces of Morphisms Into Solvable Algebraic Groups. We construct (in significant generality) moduli spaces representing the functor of morphisms from a scheme into a solvable algebraic group.


Chemistry42 An AI based platform for de novo molecular design. Chemistry42 is a software platform for de novo small molecule design that integrates Artificial Intelligence (AI) techniques with computational and medicinal chemistry methods. Chemistry42 is unique in its ability to generate novel molecular structures with predefined properties validated through in vitro and in vivo studies. Chemistry42 is a core component of Insilico Medicine Pharma.ai drug discovery suite that also includes target discovery and multi omics data analysis (PandaOmics) and clinical trial outcomes predictions (InClinico).


Across Task Neural Architecture Search via Meta Learning. Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta learning scenarios with limited compute resources and data. In this paper, an across task neural architecture search (AT NAS) is proposed to address the problem through combining gradient based meta learning with EA based NAS to learn over the distribution of tasks. The supernet is learned over an entire set of tasks by meta learning its weights. Architecture encodes of subnets sampled from the supernet are iteratively adapted by evolutionary algorithms while simultaneously searching for a task sensitive meta network. Searched meta network can be adapted to a novel task via a few learning steps and only costs a little search time. Empirical results show that AT NAS surpasses the related approaches on few shot classification accuracy. The performance of AT NAS on classification benchmarks is comparable to that of models searched from scratch, by adapting the architecture in less than an hour from a 5 GPU day pretrained meta network.


CoMP Enabled RAN Slicing for Tactile Internet. Tactile Internet (TI) enables the omnipresence and exchange of tactile experiences across the global via the ultra reliable and ultra responsive connectivity. This article argues for coordinated multi point (CoMP) enabled radio access network (RAN) slicing as an efficient solution that satisfies the stringent reliable and responsive connectivity requirements for supporting tactile applications. This article presents the emerging challenges when accommodating CoMP enabled RAN slicing in the TI ecosystem and expounds the functional split of CoMP enabled RAN. Besides, this article elaborates on the implementation prototype of CoMP enabled RAN slicing for TI with the coexistence of diverse vertical applications. Finally, this article studies a use case of enabling TI included application multiplexing as an example of CoMP enabled RAN slicing for TI.


Planar diagrammatics of self adjoint functors and recognizable tree series. A pair of biadjoint functors between two categories produces a collection of elements in the centers of these categories, one for each isotopy class of nested circles in the plane. If the centers are equipped with a trace map into the ground field, then one assigns an element of that field to a diagram of nested circles. We focus on the self adjoint functor case of this construction and study the reverse problem of recovering such a functor and a category given values associated to diagrams of nested circles.


Adaptive First and Second Order Algorithms for Large Scale Machine Learning. In this paper, we consider both first and second order techniques to address continuous optimization problems arising in machine learning. In the first order case, we propose a framework of transition from deterministic or semi deterministic to stochastic quadratic regularization methods. We leverage the two phase nature of stochastic optimization to propose a novel first order algorithm with adaptive sampling and adaptive step size. In the second order case, we propose a novel stochastic damped L BFGS method that improves on previous algorithms in the highly nonconvex context of deep learning. Both algorithms are evaluated on well known deep learning datasets and exhibit promising performance.