Spectral Triples and Zeta Cycles. We exhibit very small eigenvalues of the quadratic form associated to the Weil explicit formulas restricted to test functions whose support is within a fixed interval with upper bound S. We show both numerically and conceptually that the associated eigenvectors are obtained by a simple arithmetic operation of finite sum using prolate spheroidal wave functions associated to the scale S. Then we use these functions to condition the canonical spectral triple of the circle of length L 2 Log(S) in such a way that they belong to the kernel of the perturbed Dirac operator. We give numerical evidence that, when one varies L, the low lying spectrum of the perturbed spectral triple resembles the low lying zeros of the Riemann zeta function. We justify conceptually this result and show that, for each eigenvalue, the coincidence is perfect for the special values of the length L of the circle for which the two natural ways of realizing the perturbation give the same eigenvalue. This fact is tested numerically by reproducing the first thirty one zeros of the Riemann zeta function from our spectral side, and estimate the probability of having obtained this agreement at random, as a very small number whose first fifty decimal places are all zero. The theoretical concept which emerges is that of zeta cycle and our main result establishes its relation with the critical zeros of the Riemann zeta function and with the spectral realization of these zeros obtained by the first author.


Do Neural Optimal Transport Solvers Work? A Continuous Wasserstein 2 Benchmark. Despite the recent popularity of neural network based solvers for optimal transport (OT), there is no standard quantitative way to evaluate their performance. In this paper, we address this issue for quadratic cost transport specifically, computation of the Wasserstein 2 distance, a commonly used formulation of optimal transport in machine learning. To overcome the challenge of computing ground truth transport maps between continuous measures needed to assess these solvers, we use input convex neural networks (ICNN) to construct pairs of measures whose ground truth OT maps can be obtained analytically. This strategy yields pairs of continuous benchmark measures in high dimensional spaces such as spaces of images. We thoroughly evaluate existing optimal transport solvers using these benchmark measures. Even though these solvers perform well in downstream tasks, many do not faithfully recover optimal transport maps. To investigate the cause of this discrepancy, we further test the solvers in a setting of image generation. Our study reveals crucial limitations of existing solvers and shows that increased OT accuracy does not necessarily correlate to better results downstream.


k Mixup Regularization for Deep Learning via Optimal Transport. Mixup is a popular regularization technique for training deep neural networks that can improve generalization and increase adversarial robustness. It perturbs input training data in the direction of other randomly chosen instances in the training set. To better leverage the structure of the data, we extend mixup to emph k mixup by perturbing k batches of training points in the direction of other k batches using displacement interpolation, interpolation under the Wasserstein metric. We demonstrate theoretically and in simulations that k mixup preserves cluster and manifold structures, and we extend theory studying efficacy of standard mixup. Our empirical results show that training with k mixup further improves generalization and robustness on benchmark datasets.


Eulerian simulation of complex suspensions and biolocomotion in three dimensions. We present a numerical method specifically designed for simulating three dimensional fluid structure interaction (FSI) problems based on the reference map technique (RMT). The RMT is a fully Eulerian FSI numerical method that allows fluids and large deformation elastic solids to be represented on a single fixed computational grid. This eliminates the need for meshing complex geometries typical in other FSI approaches, and greatly simplifies the coupling between fluid and solids. We develop the first three dimensional implementation of the RMT, parallelized using the distributed memory paradigm, to simulate incompressible FSI with neo Hookean solids. As part of our new method, we develop a new field extrapolation scheme that works efficiently in parallel. Through representative examples, we demonstrate the method's accuracy and convergence, as well as its suitability in investigating many body and active systems. The examples include settling of a mixture of heavy and buoyant soft ellipsoids, lid driven cavity flow containing a soft sphere, and swimmers actuated via active stress.


Generation and Analysis of Feature Dependent Pseudo Noise for Training Deep Neural Networks. Training Deep neural networks (DNNs) on noisy labeled datasets is a challenging problem, because learning on mislabeled examples deteriorates the performance of the network. As the ground truth availability is limited with real world noisy datasets, previous papers created synthetic noisy datasets by randomly modifying the labels of training examples of clean datasets. However, no final conclusions can be derived by just using this random noise, since it excludes feature dependent noise. Thus, it is imperative to generate feature dependent noisy datasets that additionally provide ground truth. Therefore, we propose an intuitive approach to creating feature dependent noisy datasets by utilizing the training predictions of DNNs on clean datasets that also retain true label information. We refer to these datasets as "Pseudo Noisy datasets". We conduct several experiments to establish that Pseudo noisy datasets resemble feature dependent noisy datasets across different conditions. We further randomly generate synthetic noisy datasets with the same noise distribution as that of Pseudo noise (referred as "Randomized Noise") to empirically show that i) learning is easier with feature dependent label noise compared to random noise, ii) irrespective of noise distribution, Pseudo noisy datasets mimic feature dependent label noise and iii) current training methods are not generalizable to feature dependent label noise. Therefore, we believe that Pseudo noisy datasets will be quite helpful to study and develop robust training methods.


Measuring Hidden Bias within Face Recognition via Racial Phenotypes. Recent work reports disparate performance for intersectional racial groups across face recognition tasks face verification and identification. However, the definition of those racial groups has a significant impact on the underlying findings of such racial bias analysis. Previous studies define these groups based on either demographic information (e.g. African, Asian etc.) or skin tone (e.g. lighter or darker skins). The use of such sensitive or broad group definitions has disadvantages for bias investigation and subsequent counter bias solutions design. By contrast, this study introduces an alternative racial bias analysis methodology via facial phenotype attributes for face recognition. We use the set of observable characteristics of an individual face where a race related facial phenotype is hence specific to the human face and correlated to the racial profile of the subject. We propose categorical test cases to investigate the individual influence of those attributes on bias within face recognition tasks. We compare our phenotype based grouping methodology with previous grouping strategies and show that phenotype based groupings uncover hidden bias without reliance upon any potentially protected attributes or ill defined grouping strategies. Furthermore, we contribute corresponding phenotype attribute category labels for two face recognition tasks RFW for face verification and VGGFace2 (test set) for face identification.


Feller Generators with measurable lower order terms. We study perturbations of Feller generators under lower order terms' with measurable coefficients. We investigate which properties of the original semigroup such as positivity, conservativeness and the Feller property are passed to the perturbed semigroup. We give several examples and discuss applications in the theory of martingale problems and stochastic differential equations with measurable coefficients.


On Moments of non normal number fields. Let K be a number field over mathbb Q and let a K(m) denote the number of integral ideals of K of norm equal to m in mathbb N . In this paper we obtain asymptotic formulae for sums of the form sum m leq X a l K(m) thereby generalizing the previous works on the problem. Previously such asymptotics were known only in the case when K is Galois or when K was a non normal cubic extension and l 2,3 . The present work subsumes both these cases.


RbSyn Type and Effect Guided Program Synthesis. In recent years, researchers have explored component based synthesis, which aims to automatically construct programs that operate by composing calls to existing APIs. However, prior work has not considered efficient synthesis of methods with side effects, e.g., web app methods that update a database. In this paper, we introduce RbSyn, a novel type and effect guided synthesis tool for Ruby. An RbSyn synthesis goal is specified as the type for the target method and a series of test cases it must pass. RbSyn works by recursively generating well typed candidate method bodies whose write effects match the read effects of the test case assertions. After finding a set of candidates that separately satisfy each test, RbSyn synthesizes a solution that branches to execute the correct candidate code under the appropriate conditions. We formalize RbSyn on a core, object oriented language lambda syn and describe how the key ideas of the model are scaled up in our implementation for Ruby. We evaluated RbSyn on 19 benchmarks, 12 of which come from popular, open source Ruby apps. We found that RbSyn synthesizes correct solutions for all benchmarks, with 15 benchmarks synthesizing in under 9 seconds, while the slowest benchmark takes 83 seconds. Using observed reads to guide synthesize is effective using type guidance alone times out on 10 of 12 app benchmarks. We also found that using less precise effect annotations leads to worse synthesis performance. In summary, we believe type and effect guided synthesis is an important step forward in synthesis of effectful methods from test cases.


How to avoid machine learning pitfalls a guide for academic researchers. This document gives a concise outline of some of the common mistakes that occur when using machine learning techniques, and what can be done to avoid them. It is intended primarily as a guide for research students, and focuses on issues that are of particular concern within academic research, such as the need to do rigorous comparisons and reach valid conclusions. It covers five stages of the machine learning process what to do before model building, how to reliably build models, how to robustly evaluate models, how to compare models fairly, and how to report results.


On t relaxed coloring of complete multi partite graphs. Let G be a graph and t a nonnegative integer. Suppose f is a mapping from the vertex set of G to 1,2, dots, k . If, for any vertex u of G , the number of neighbors v of u with f(v) f(u) is less than or equal to t , then f is called a t relaxed k coloring of G . And G is said to be (k,t) colorable. The t relaxed chromatic number of G , denote by chi t(G) , is defined as the minimum integer k such that G is (k,t) colorable. A set S of vertices in G is t sparse if S induces a graph with a maximum degree of at most t . Thus G is (k,t) colorable if and only if the vertex set of G can be partitioned into k t sparse sets. It was proved by Belmonte, Lampis and Mitsou (2017) that the problem of deciding if a complete multi partite graph is (k,t) colorable is NP complete. In this paper, we first give tight lower and up bounds for the t relaxed chromatic number of complete multi partite graphs. And then we design an algorithm to compute maximum t sparse sets of complete multi partite graphs running in O((t 1) 2) time. Applying this algorithm, we show that the greedy algorithm for chi t(G) is 2 approximate and runs in O(tn) time steps (where n is the vertex number of G ). In particular, we prove that for t in 1,2,3,4,5,6 , the greedy algorithm produces an optimal t relaxed coloring of a complete multi partite graph. While, for t ge 7 , examples are given to illustrate that the greedy strategy does not always construct an optimal t relaxed coloring.


Zeros, chaotic ratios and the computational complexity of approximating the independence polynomial. The independence polynomial originates in statistical physics as the partition function of the hard core model. The location of the complex zeros of the polynomial is related to phase transitions, and plays an important role in the design of efficient algorithms to approximately compute evaluations of the polynomial. In this paper we directly relate the location of the complex zeros of the independence polynomial to computational hardness of approximating evaluations of the independence polynomial. We do this by moreover relating the location of zeros to chaotic behaviour of a naturally associated family of rational functions the occupation ratios.


Enabling Security Oriented Orchestration of Microservices. As cloud providers push multi tenancy to new levels to meet growing scalability demands, ensuring that externally developed untrusted microservices will preserve tenant isolation has become a high priority. Developers, in turn, lack a means for expressing and automatically enforcing high level application security requirements at deployment time. In this paper, we observe that orchestration systems are ideally situated between developers and the cloud provider to address these issues. We propose a security policy framework that enables security oriented orchestration of microservices by capturing and auditing code properties that are incorporated into microservice code throughout the software supply chain. Orchestrators can leverage these properties to deploy microservices on a node that matches both the developer's and cloud provider's security policy and their resource requirements. We demonstrate our approach with a proof of concept based on the Private Data Objects 1 confidential smart contract framework, deploying code only after checking its provenance.


Including Signed Languages in Natural Language Processing. Signed languages are the primary means of communication for many deaf and hard of hearing individuals. Since signed languages exhibit all the fundamental linguistic properties of natural language, we believe that tools and theories of Natural Language Processing (NLP) are crucial towards its modeling. However, existing research in Sign Language Processing (SLP) seldom attempt to explore and leverage the linguistic organization of signed languages. This position paper calls on the NLP community to include signed languages as a research area with high social and scientific impact. We first discuss the linguistic properties of signed languages to consider during their modeling. Then, we review the limitations of current SLP models and identify the open challenges to extend NLP to signed languages. Finally, we urge (1) the adoption of an efficient tokenization method (2) the development of linguistically informed models (3) the collection of real world signed language data (4) the inclusion of local signed language communities as an active and leading voice in the direction of research.


Approximation schemes for stochastic compliance based topology optimization with many loading scenarios. In this paper, approximation schemes are proposed for handling load uncertainty in compliance based topology optimization problems, where the uncertainty is described in the form of a set of finitely many loading scenarios. Efficient approximate methods are proposed to approximately evaluate and differentiate either 1) the mean compliance, or 2) a class of scalar valued function of the individual load compliances such as the weighted sum of the mean and standard deviation. The computational time complexities of the proposed algorithms are analyzed, compared to the exact approaches and then experimentally verified. Finally, some mean compliance minimization problems and some risk averse compliance minimization problems are solved for verification.


High Throughput VLSI architecture for Soft Decision decoding with ORBGRAND. Guessing Random Additive Noise Decoding (GRAND) is a recently proposed approximate Maximum Likelihood (ML) decoding technique that can decode any linear error correcting block code. Ordered Reliability Bits GRAND (ORBGRAND) is a powerful variant of GRAND, which outperforms the original GRAND technique by generating error patterns in a specific order. Moreover, their simplicity at the algorithm level renders GRAND family a desirable candidate for applications that demand very high throughput. This work reports the first ever hardware architecture for ORBGRAND, which achieves an average throughput of up to 42.5 Gbps for a code length of 128 at an SNR of 10 dB. Moreover, the proposed hardware can be used to decode any code provided the length and rate constraints. Compared to the state of the art fast dynamic successive cancellation flip decoder (Fast DSCF) using a 5G polar (128,105) code, the proposed VLSI implementation has 49 times more average throughput while maintaining similar decoding performance.


Autoencoder based Condition Monitoring and Anomaly Detection Method for Rotating Machines. Rotating machines like engines, pumps, or turbines are ubiquitous in modern day societies. Their mechanical parts such as electrical engines, rotors, or bearings are the major components and any failure in them may result in their total shutdown. Anomaly detection in such critical systems is very important to monitor the system's health. As the requirement to obtain a dataset from rotating machines where all possible faults are explicitly labeled is difficult to satisfy, we propose a method that focuses on the normal behavior of the machine instead. We propose an autoencoder model based method for condition monitoring of rotating machines by using an anomaly detection approach. The method learns the characteristics of a rotating machine using the normal vibration signals to model the healthy state of the machine. A threshold based approach is then applied to the reconstruction error of unseen data, thus enabling the detection of unseen anomalies. The proposed method can directly extract the salient features from raw vibration signals and eliminate the need for manually engineered features. We demonstrate the effectiveness of the proposed method by employing two rotating machine datasets and the quality of the automatically learned features is compared with a set of handcrafted features by training an Isolation Forest model on either of these two sets. Experimental results on two real world datasets indicate that our proposed solution gives promising results, achieving an average F1 score of 99.6 .


Gender Bias Amplification During Speed Quality Optimization in Neural Machine Translation. Is bias amplified when neural machine translation (NMT) models are optimized for speed and evaluated on generic test sets using BLEU? We investigate architectures and techniques commonly used to speed up decoding in Transformer based models, such as greedy search, quantization, average attention networks (AANs) and shallow decoder models and show their effect on gendered noun translation. We construct a new gender bias test set, SimpleGEN, based on gendered noun phrases in which there is a single, unambiguous, correct answer. While we find minimal overall BLEU degradation as we apply speed optimizations, we observe that gendered noun translation performance degrades at a much faster rate.


A hybrid algorithm based on Community Detection and Multi Attribute Decision Making for Influence Maximization. The influence maximization problem is trying to identify a set of K nodes by which the spread of influence, diseases, or information is maximized. The optimization of influence by finding such a set is an NP hard problem and a key issue in analyzing complex networks. In this paper, a new greedy and hybrid approach based on a community detection algorithm and a MADM technique (TOPSIS) is proposed to cope with the problem, called, Greedy TOPSIS and Community Based (GTaCB) algorithm. The paper concisely introduces community detection and the TOPSIS technique, then it presents the pseudo code of the proposed algorithm. Afterward, it compares the performance of the solution which is found by GTaCB with some well known greedy algorithms, based on Degree Centrality, Closeness Centrality, Betweenness Centrality, PageRank as well as TOPSIS, from two aspects diffusion quality and diffusion speed. In order to evaluate the performance of GTaCB, computational experiments on nine different types of real world networks are provided. The tests are conducted via one of the renowned epidemic diffusion models, namely, Susceptible Infected Recovered (SIR) model. The simulations exhibit that in most of the cases the proposed algorithm significantly outperforms the others, chiefly as the number of initial nodes or probability of infection increases.


Pure and Linear Frequency Converter Temporal Metasurface. Metasurfaces are ultrathin structures which are constituted by an array of subwavelength scatterers with designable scattering responses. They have opened up unprecedented exciting opportunities for extraordinary wave engineering processes. On the other hand, frequency converters have drawn wide attention due to their vital applications in telecommunication systems, health care devices, radio astronomy, military radars and biological sensing systems. Here, we show that a spurious free and linear frequency converter metasurface can be realized by leveraging unique properties of engineered transmissive temporal supercells. Such a metasurface is formed by time modulated supercells themselves are composed of temporal and static patch resonators and phase shifters. This represents the first frequency converter metasurface possessing large frequency conversion ratio with controllable frequency bands and transmission magnitude. In contrast to conventional nonlinear mixers, the proposed temporal frequency converter offers a linear response. In addition, by taking advantage of the proposed surface interconnector phaser surface (SIPS) architecture, a spurious free and linear frequency conversion is achievable, where all undesired mixing products are strongly suppressed. The proposed metasurface may be digitally controlled and programmed through a field programmable gate array. This makes the spurious free and linear frequency converter metasurface a prominent solution for wireless and satellite telecommunication systems, as well as invisibility cloaks and radars. This study opens a way to realize more complicated and enhanced efficiency spectrum changing metasurface.


GCExplainer Human in the Loop Concept based Explanations for Graph Neural Networks. While graph neural networks (GNNs) have been shown to perform well on graph based data from a variety of fields, they suffer from a lack of transparency and accountability, which hinders trust and consequently the deployment of such models in high stake and safety critical scenarios. Even though recent research has investigated methods for explaining GNNs, these methods are limited to single instance explanations, also known as local explanations. Motivated by the aim of providing global explanations, we adapt the well known Automated Concept based Explanation approach (Ghorbani et al., 2019) to GNN node and graph classification, and propose GCExplainer. GCExplainer is an unsupervised approach for post hoc discovery and extraction of global concept based explanations for GNNs, which puts the human in the loop. We demonstrate the success of our technique on five node classification datasets and two graph classification datasets, showing that we are able to discover and extract high quality concept representations by putting the human in the loop. We achieve a maximum completeness score of 1 and an average completeness score of 0.753 across the datasets. Finally, we show that the concept based explanations provide an improved insight into the datasets and GNN models compared to the state of the art explanations produced by GNNExplainer (Ying et al., 2019).


Overprotective Training Environments Fall Short at Testing Time Let Models Contribute to Their Own Training. Despite important progress, conversational systems often generate dialogues that sound unnatural to humans. We conjecture that the reason lies in their different training and testing conditions agents are trained in a controlled "lab" setting but tested in the "wild". During training, they learn to generate an utterance given the human dialogue history. On the other hand, during testing, they must interact with each other, and hence deal with noisy data. We propose to fill this gap by training the model with mixed batches containing both samples of human and machine generated dialogues. We assess the validity of the proposed method on GuessWhat?!, a visual referential game.


physics.optics physics.comp-ph physics.ins-det physics.med-ph

Aberration measurement and correction on a large field of view in fluorescence microscopy. The aberrations induced by the sample and or by the sample holder limit the resolution of optical microscopes. Wavefront correction can be achieved using a deformable mirror with wavefront sensorless optimization algorithms but, despite the complexity of these systems, the level of correction is often limited to a small area in the field of view of the microscope. In this work, we present a plug and play module for aberration measurement and correction. The wavefront correction is performed through direct wavefront reconstruction using the spinning pupil aberration measurement and controlling a deformable lens in closed loop. The lens corrects the aberrations in the center of the field of view, leaving residual aberrations at the margins, that are removed by anisoplanatic deconvolution. We present experimental results obtained in fluorescence microscopy, with a wide field and a light sheet fluorescence microscope. These results indicate that detection and correction over the full field of view can be achieved with a compact transmissive module placed in the detection path of the fluorescence microscope.


Fast real and complex root finding methods for well conditioned polynomials. Given a polynomial p of degree d and a bound kappa on a condition number of p , we present the first root finding algorithms that return all its real and complex roots with a number of bit operations quasi linear in d log 2( kappa) . More precisely, several condition numbers can be defined depending on the norm chosen on the coefficients of the polynomial. Let p(x) sum k 0 d a k x k sum k 0 d sqrt binom d k b k x k . We call the condition number associated with a perturbation of the a k the hyperbolic condition number kappa h , and the one associated with a perturbation of the b k the elliptic condition number kappa e . For each of these condition numbers, we present algorithms that find the real and the complex roots of p in O left(d log 2(d kappa) text polylog ( log(d kappa)) right) bit operations.Our algorithms are well suited for random polynomials since kappa h (resp. kappa e ) is bounded by a polynomial in d with high probability if the a k (resp. the b k ) are independent, centered Gaussian variables of variance 1 .


A lockdown survey on cDV singularities. This is an expository survey article on compound Du Val (cDV) singularities, with emphasis on recent homological approaches, including noncommutative resolutions, tilting theory, contraction algebras, classification, derived categories, autoequivalences, stability conditions, deformation theory, and cluster tilting theory.


Intelligent Online Selling Point Extraction for E Commerce Recommendation. In the past decade, automatic product description generation for e commerce have witnessed significant advancement. As the services provided by e commerce platforms become diverse, it is necessary to dynamically adapt the patterns of descriptions generated. The selling point of products is an important type of product description for which the length should be as short as possible while still conveying key information. In addition, this kind of product description should be eye catching to the readers. Currently, product selling points are normally written by human experts. Thus, the creation and maintenance of these contents incur high costs. These costs can be significantly reduced if product selling points can be automatically generated by machines. In this paper, we report our experience developing and deploying the Intelligent Online Selling Point Extraction (IOSPE) system to serve the recommendation system in the JD.com e commerce platform. Since July 2020, IOSPE has become a core service for 62 key categories of products (covering more than 4 million products). So far, it has generated more than 0.1 billion selling points, thereby significantly scaling up the selling point creation operation and saving human labour. These IOSPE generated selling points have increased the click through rate (CTR) by 1.89 and the average duration the customers spent on the products by more than 2.03 compared to the previous practice, which are significant improvements for such a large scale e commerce platform.


Preconditioners for model order reduction by interpolation and random sketching of operators. The performance of projection based model order reduction methods for solving parameter dependent systems of equations highly depends on the properties of the operator, which can be improved by preconditioning. In this paper we present strategies to construct a parameter dependent preconditioner by an interpolation of operator's inverse. The interpolation is obtained by minimizing a discrepancy between the (preconditioned) operator and the matrix defining the metric of interest. The discrepancy measure is chosen such that its minimization can be efficiently performed online for each parameter value by the solution of a small least squares problem. Furthermore, we show how to tune the discrepancy measure for improving the quality of Petrov Galerkin projection or residual based error estimation. This paper also addresses preconditioning for the randomized model order reduction methods from Balabanov and Nouy 2019, Part I . Our methodology can be readily used for efficient and stable solution of ill conditioned parametric systems and an effective error estimation certification without the need to estimate expensive stability constants. The proposed approach involves heavy computations in both offline and online stages that are circumvented by random sketching. The norms of high dimensional matrices and vectors are estimated by l2 norms of their low dimensional images, called sketches, through random embeddings. For this we extend the framework from Balabanov and Nouy 2019, Part I to random embeddings of operators.


Rate equations model for multiple magnetic mirrors in various thermodynamic scenarios. Axial particle loss is one of the main challenges for fusion aimed, linear magnetic mirror plasma configurations. One way to mitigate this disadvantage and increase the confinement time is to use a multiple mirrors setup. The idea is to reduce the outgoing flux by collisions in the outer magnetic cells. Here, we develop a semi kinetic rate equation model for the ions' density dynamics, including scattering within the magnetic cell and the transmission between neighboring cells. The dominant parameter is the ions' mean free path, which depends on the temperature and density in each cell. The steady state flow is studied analytically and numerically for three thermodynamic scenarios isothermal plasma, adiabatic expansion, and constant diffusion. It is found that the confinement time varies about five fold over the different scenarios, where the adiabatic cooling is the best confining scenario.


Obtaining Better Static Word Embeddings Using Contextual Embedding Models. The advent of contextual word embeddings representations of words which incorporate semantic and syntactic information from their context has led to tremendous improvements on a wide variety of NLP tasks. However, recent contextual models have prohibitively high computational cost in many use cases and are often hard to interpret. In this work, we demonstrate that our proposed distillation method, which is a simple extension of CBOW based training, allows to significantly improve computational efficiency of NLP applications, while outperforming the quality of existing static embeddings trained from scratch as well as those distilled from previously proposed methods. As a side effect, our approach also allows a fair comparison of both contextual and static embeddings via standard lexical evaluation tasks.


Mining Large Scale Low Resource Pronunciation Data From Wikipedia. Pronunciation modeling is a key task for building speech technology in new languages, and while solid grapheme to phoneme (G2P) mapping systems exist, language coverage can stand to be improved. The information needed to build G2P models for many more languages can easily be found on Wikipedia, but unfortunately, it is stored in disparate formats. We report on a system we built to mine a pronunciation data set in 819 languages from loosely structured tables within Wikipedia. The data includes phoneme inventories, and for 63 low resource languages, also includes the grapheme to phoneme (G2P) mapping. 54 of these languages do not have easily findable G2P mappings online otherwise. We turned the information from Wikipedia into a structured, machine readable TSV format, and make the resulting data set publicly available so it can be improved further and used in a variety of applications involving low resource languages.


Ruin Theory for User Association and Energy Optimization in Multi access Edge Computing. In this letter, a novel framework is proposed for analyzing data offloading in a multi access edge computing system. Specifically, a two phase algorithm, is proposed, including two key phases user association phase and task offloading phase. In the first phase, a ruin theory based approach is developed to obtain the users association considering the users' transmission reliability. Meanwhile, in the second phase, an optimization based algorithm is used to optimize the data offloading process. In particular, ruin theory is used to manage the user association phase, and a ruin probability based preference profile is considered to control the priority of proposing users. Here, ruin probability is derived by the surplus buffer space of each edge node at each time slot. Giving the association results, an optimization problem is formulated to optimize the amount of offloaded data aiming at minimizing the energy consumption of users. Simulation results show that the developed solutions guarantee system reliability under a tolerable value of surplus buffer size and minimize the total energy consumption of all users.


A New Approach to Complex Dynamic Geofencing for Unmanned Aerial Vehicles. The anticipated widespread use of unmanned aerial vehicles (UAVs) raises significant safety and security concerns, including trespassing in restricted areas, colliding with other UAVs, and disrupting high traffic airspaces. To mitigate these risks, geofences have been proposed as one line of defence, which limit UAVs from flying into the perimeters of other UAVs and restricted locations. In this paper, we address the concern that existing geometric geofencing algorithms lack accuracy during the calculation of complex geofences, particularly in dynamic urban environments. We propose a new algorithm based on alpha shapes and Voronoi diagrams, which we integrate into an on drone framework using an open source mapping database from OpenStreetMap. To demonstrate its efficacy, we present performance results using Microsoft's AirSim and a low cost commercial UAV platform in a real world urban environment.


No speedup for geometric theories. Geometric theories based on classical logic are conservative over their intuitionistic counterparts for geometric implications. The latter result (sometimes referred to as Barr's theorem) is squarely a consequence of Gentzen's Hauptsatz. Prima facie though, cut elimination can result in superexponentially longer proofs. In this paper it is shown that the transformation of a classical proof of a geometric implication in a geometric theory into an intuitionistic proof can be achieved in feasibly many steps.


Modeling Protein Using Large scale Pretrain Language Model. Protein is linked to almost every life process. Therefore, analyzing the biological structure and property of protein sequences is critical to the exploration of life, as well as disease detection and drug discovery. Traditional protein analysis methods tend to be labor intensive and time consuming. The emergence of deep learning models makes modeling data patterns in large quantities of data possible. Interdisciplinary researchers have begun to leverage deep learning methods to model large biological datasets, e.g. using long short term memory and convolutional neural network for protein sequence classification. After millions of years of evolution, evolutionary information is encoded in protein sequences. Inspired by the similarity between natural language and protein sequences, we use large scale language models to model evolutionary scale protein sequences, encoding protein biology information in representation. Significant improvements are observed in both token level and sequence level tasks, demonstrating that our large scale model can accurately capture evolution information from pretraining on evolutionary scale individual sequences. Our code and model are available at https github.com THUDM ProteinLM.


Towards automation of threat modeling based on a semantic model of attack patterns and weaknesses. This works considers challenges of building and usage a formal knowledge base (model), which unites the ATT CK, CAPEC, CWE, CVE security enumerations. The proposed model can be used to learn relations between attack techniques, attack pattern, weaknesses, and vulnerabilities in order to build various threat landscapes, in particular, for threat modeling. The model is created as an ontology with freely available datasets in the OWL and RDF formats. The use of ontologies is an alternative of structural and graph based approaches to integrate the security enumerations. In this work we consider an approach of threat modeling with the data components of ATT CK based on the knowledge base and an ontology driven threat modeling framework. Also, some evaluations are made, how it can be possible to use the ontological approach of threat modeling and which challenges this can be faced.


Propri 'et 'e de Bogomolov pour certaines extensions infinies non ab 'eliennes d'un corps totalement v adique. Let E be an elliptic curve defined over a number field K and let v be a finite place of K . Write K tv the maximal extension of K in which v is totally split and L the field generated over K tv by all torsion points of E . Under some conditions, we will show that the absolute logarithmic Weil height (resp. N 'eron Tate height) of any element of L (resp. E(L) ) is either 0 or bounded from below by a positive constant depending only on E, K and v . This lower bound will be explicit in the toric case when K mathbb Q .


Point processes, cost, and the growth of rank in locally compact groups. Let G be a locally compact, second countable, unimodular group that is nondiscrete and noncompact. We explore the theory of invariant point processes on G . We show that every free probability measure preserving (pmp) action of G can be realized by an invariant point process. We analyze the cost of pmp actions of G using this language. We show that among free pmp actions, the cost is maximal on the Poisson processes. This follows from showing that every free point process weakly factors onto any Poisson process and that the cost is monotone for weak factors, up to some restrictions. We apply this to show that G times mathbb Z has fixed price 1 , solving a problem of Carderi. We also show that when G is a semisimple real Lie group, the rank gradient of any Farber sequence of lattices in G is dominated by the cost of the Poisson process of G . This, in particular, implies that if the cost of the Poisson process of SL 2 ( mathbb C ) vanishes, then the ratio of the Heegaard genus and the rank of a hyperbolic 3 manifold tends to infinity over Farber chains.


Optimal discrete Neumann energy in a ball and a circular ring. In this paper, we prove some exact estimates for the discrete Neumann energy of a ball and a circular ring in Euclidean space for points located on circles. The proofs are based on dissymmetrization and analysis of the asymptotic behavior of the Dirichlet integral of the potential function.


Lagrangian cobordism functor in microlocal sheaf theory. Given a Lagrangian cobordism L of Legendrian submanifolds from Lambda to Lambda , we construct a functor Phi L Sh c Lambda (M) rightarrow Sh c Lambda (M) otimes C ( Omega Lambda ) C ( Omega L) between sheaf categories of compact objects with singular support on Lambda pm and its adjoint on sheaf categories of proper objects, using Nadler Shende's work. This gives a sheaf theory description analogous to the Lagrangian cobordism map on Legendrian contact homologies and the adjoint on their unital augmentation categories. We also deduce some long exact sequences and new obstructions to Lagrangian cobordisms between high dimensional Legendrian submanifolds.


The Euler Bernoulli limit of thin brittle linearized elastic beams. We show that the linear brittle Griffith energy on a thin rectangle Gamma converges after rescaling to the linear one dimensional brittle Euler Bernoulli beam energy. We also prove a precise compactness result for sequences with finite energy, deriving a sharp upper estimate for the number of jumps by the limit of jump lengths.


Auto White Balance Correction for Mixed Illuminant Scenes. Auto white balance (AWB) is applied by camera hardware at capture time to remove the color cast caused by the scene illumination. The vast majority of white balance algorithms assume a single light source illuminates the scene however, real scenes often have mixed lighting conditions. This paper presents an effective AWB method to deal with such mixed illuminant scenes. A unique departure from conventional AWB, our method does not require illuminant estimation, as is the case in traditional camera AWB modules. Instead, our method proposes to render the captured scene with a small set of predefined white balance settings. Given this set of rendered images, our method learns to estimate weighting maps that are used to blend the rendered images to generate the final corrected image. Through extensive experiments, we show this proposed method produces promising results compared to other alternatives for single and mixed illuminant scene color correction. Our source code and trained models are available at https github.com mahmoudnafifi mixedillWB.


Keeping it Simple Language Models can learn Complex Molecular Distributions. Deep generative models of molecules have grown immensely in popularity, trained on relevant datasets, these models are used to search through chemical space. The downstream utility of generative models for the inverse design of novel functional compounds depends on their ability to learn a training distribution of molecules. The most simple example is a language model that takes the form of a recurrent neural network and generates molecules using a string representation. More sophisticated are graph generative models, which sequentially construct molecular graphs and typically achieve state of the art results. However, recent work has shown that language models are more capable than once thought, particularly in the low data regime. In this work, we investigate the capacity of simple language models to learn distributions of molecules. For this purpose, we introduce several challenging generative modeling tasks by compiling especially complex distributions of molecules. On each task, we evaluate the ability of language models as compared with two widely used graph generative models. The results demonstrate that language models are powerful generative models, capable of adeptly learning complex molecular distributions and yield better performance than the graph models. Language models can accurately generate distributions of the highest scoring penalized LogP molecules in ZINC15, multi modal molecular distributions as well as the largest molecules in PubChem.


Knot Dynamics. We examine computer experiments that can be performed to understand the dynamics of knots under self repulsion. In the course of specific computer exploration we use the knot theory of rational knots and rational tangles to produce classes of unknots with complex initial configurations that we call hard unknots, and corresponding complex configurations that are topologically equivalent to simpler knots. We shall see that these hard unknots and complexified knots give examples that do not reduce in the experimental space of the computer program. That is, we find unknotted configurations that will not reduce to simple circular forms under self repulsion, and we find complex versions of knots that will not reduce to simpler forms under the self repulsion. It is clear to us that the phenomena that we have discovered depend very little on the details of the computer program as long as it conforms to a general description of self repulsion. Thus, we suggest on the basis of our experiments that sufficiently complex examples of hard unknots and sufficiently complex examples of complexified knots will not reduce to global minimal energy states in self repulsion environments. In the course of the paper we make the character of these examples precise. It is a challenge to other program environments to verify or disprove these assertions.


On bipartite distance regular Cayley graphs with small diameter. We study bipartite distance regular Cayley graphs with diameter three or four. We give sufficient conditions under which a bipartite Cayley graph can be constructed on the semidirect product of a group the part of this bipartite Cayley graph which contains the identity element and mathbb Z 2 . We apply this to the case of bipartite distance regular Cayley graphs with diameter three, and consider cases where the sufficient conditions are not satisfied for some specific groups such as the dihedral group. We also extend a result by Miklavi v c and Poto v c nik that relates difference sets to bipartite distance regular Cayley graphs with diameter three to the case of diameter four. This new case involves certain partial geometric difference sets and in the antipodal case relative difference sets.


Kuperberg Dreams. The Seifert Conjecture'' stated, Every non singular vector field on the 3 sphere mathbb S 3 has a periodic orbit''. In a celebrated work, Krystyna Kuperberg gave a construction of a smooth aperiodic vector field on a plug, which is then used to construct counter examples to the Seifert Conjecture for smooth flows on the 3 sphere, and on compact 3 manifolds in general. The dynamics of the flows in these plugs have been extensively studied, with more precise results known in special generic'' cases of the construction. Moreover, the dynamical properties of smooth perturbations of Kuperberg's construction have been considered. In this work, we discuss the genesi of Kuperberg's construction as an evolution from the Schweitzer construction of an aperiodic plug. We discuss some of the known results for Kuperberg flows, and discuss some of the many interesting questions and problems that remain open about their dynamical and ergodic properties.


Two formulas for plane paritions. We give a direct deduction and proof of two identities in the theory of plane partitions. The first one is known to enumerate the traces of plane partitions. The second one comes without any combinatorial interpretation.


Automatic de identification of Data Download Packages. The General Data Protection Regulation (GDPR) grants all natural persons the right of access to their personal data if this is being processed by data controllers. The data controllers are obliged to share the data in an electronic format and often provide the data in a so called Data Download Package (DDP). These DDPs contain all data collected by public and private entities during the course of citizens' digital life and form a treasure trove for social scientists. However, the data can be deeply private. To protect the privacy of research participants while using their DDPs for scientific research, we developed de identification software that is able to handle typical characteristics of DDPs such as regularly changing file structures, visual and textual content, different file formats, different file structures and accounting for usernames. We investigate the performance of the software and illustrate how the software can be tailored towards specific DDP structures.


Material structure integrated design for ultra broadband microwave metamaterial absorber. We propose herein a method of material structure integrated design for broadband absorption of dielectric metamaterial, which is achieved by combination of genetic algorithm and simulation platform. A multi layered metamaterial absorber with an ultra broadband absorption from 5.3 to 18 GHz (a relative bandwidth of as high as 109 ) is realized numerically and experimentally. In addition, simulated results demonstrate the proposed metamaterial exhibits good incident angle and polarization tolerance, which also are significant criteria for practical applications. By investigating the working principle with theoretical calculation and numerical simulation, it can be found that merging of multiple resonance modes encompassing quarter wavelength interference cancellation, spoof surface plasmon polariton mode, dielectric resonance mode and grating mode is responsible for a remarkable ultra broadband absorption. Analysis of respective contribution of material and structure indicates that either of them plays an indispensable role in activating different resonance modes, and symphony of material and structure is essential to afford desirable target performance. The material structure integrated design philosophy highlights the superiority of coupling material and structure and provides an effective comprehensive optimization strategy for dielectric metamaterials.


Recursive Causal Structure Learning in the Presence of Latent Variables and Selection Bias. We consider the problem of learning the causal MAG of a system from observational data in the presence of latent variables and selection bias. Constraint based methods are one of the main approaches for solving this problem, but the existing methods are either computationally impractical when dealing with large graphs or lacking completeness guarantees. We propose a novel computationally efficient recursive constraint based method that is sound and complete. The key idea of our approach is that at each iteration a specific type of variable is identified and removed. This allows us to learn the structure efficiently and recursively, as this technique reduces both the number of required conditional independence (CI) tests and the size of the conditioning sets. The former substantially reduces the computational complexity, while the latter results in more reliable CI tests. We provide an upper bound on the number of required CI tests in the worst case. To the best of our knowledge, this is the tightest bound in the literature. We further provide a lower bound on the number of CI tests required by any constraint based method. The upper bound of our proposed approach and the lower bound at most differ by a factor equal to the number of variables in the worst case. We provide experimental results to compare the proposed approach with the state of the art on both synthetic and real world structures.


Hybrid Power Law Models of Network Traffic. The availability of large scale streaming network data has reinforced the ubiquity of power law distributions in observations and enabled precision measurements of the distribution parameters. The increased accuracy of these measurements allows new underlying generative network models to be explored. The preferential attachment model is a natural starting point for these models. This work adds additional model components to account for observed phenomena in the distributions. In this model, preferential attachment is supplemented to provide a more accurate theoretical model of network traffic. Specifically, a probabilistic complex network model is proposed using preferential attachment as well as additional parameters to describe the newly observed prevalence of leaves and unattached nodes. Example distributions from this model are generated by considering random sampling of the networks created by the model in such a way that replicates the current data collection methods.


Sheffer operation in relational systems. The concept of a Sheffer operation known for Boolean algebras and orthomodular lattices is extended to arbitrary directed relational systems with involution. It is proved that to every such relational system there can be assigned a Sheffer groupoid and also, conversely, every Sheffer groupoid induces a directed relational system with involution. Hence, investigations of these relational systems can be transformed to the treaty of special groupoids which form a variety of algebras. If the Sheffer operation is also commutative then the induced binary relation is antisymmetric. Moreover, commutative Sheffer groupoids form a congruence distributive variety. We characterize symmertry, antisymmetry and treansitivity of binary relations by identities and quasi identities satisfied by an assigned Sheffer operation. The concepts of twist products of relational systems and of Kleene relational systems are introduced. We prove that every directed relational system can be embedded into a directed relational system with involution via the twist product construction. If the relation in question is even transitive, then the directed relational system can be embedded into a Kleene relational system. Any Sheffer operation assigned to a directed relational system A with involution induces a Sheffer operation assigned to the twist product of A.


Data completion algorithms and their applications in inverse acoustic scattering with limited aperture backscattering data. We introduce two data completion algorithms for the limited aperture problems in inverse acoustic scattering. Both completion algorithms are independent of the topological and physical properties of the unknown scatterers. The main idea is to relate the limited aperture data to the full aperture data via the prolate matrix. The data completion algorithms are simple and fast since only the approximate inversion of the prolate matrix is involved. We then combine the data completion algorithms with imaging methods such as factorization method and direct sampling method for the object reconstructions. A variety of numerical examples are presented to illustrate the effectiveness and robustness of the proposed algorithms.


Implicit gradients based novel conservative numerical scheme for compressible flows. This paper introduces a novel approach to compute the numerical fluxes at the cell boundaries for a cell centered conservative numerical scheme. Explicit gradients used in deriving the reconstruction polynomials are replaced by high order gradients computed by compact finite differences, referred to as implicit gradients in this paper. The new approach has superior dispersion and dissipation properties in comparison to the compact reconstruction approach. A problem independent shock capturing approach via Boundary Variation Diminishing (BVD) algorithm is used to suppress oscillations for the simulation of flows with shocks and material interfaces. Several numerical test cases are carried out to verify the proposed method's capability using the implicit gradient method for compressible flows.


Temporal Shift Reinforcement Learning. The function approximators employed by traditional image based Deep Reinforcement Learning (DRL) algorithms usually lack a temporal learning component and instead focus on learning the spatial component. We propose a technique, Temporal Shift Reinforcement Learning (TSRL), wherein both temporal, as well as spatial components are jointly learned. Moreover, TSRL does not require additional parameters to perform temporal learning. We show that TSRL outperforms the commonly used frame stacking heuristic on both of the Atari environments we test on while beating the SOTA for one of them. This investigation has implications in the robotics as well as sequential decision making domains.


Non uniform Motion Deblurring with Blurry Component Divided Guidance. Blind image deblurring is a fundamental and challenging computer vision problem, which aims to recover both the blur kernel and the latent sharp image from only a blurry observation. Despite the superiority of deep learning methods in image deblurring have displayed, there still exists major challenge with various non uniform motion blur. Previous methods simply take all the image features as the input to the decoder, which handles different degrees (e.g. large blur, small blur) simultaneously, leading to challenges for sharp image generation. To tackle the above problems, we present a deep two branch network to deal with blurry images via a component divided module, which divides an image into two components based on the representation of blurry degree. Specifically, two component attentive blocks are employed to learn attention maps to exploit useful deblurring feature representations on both large and small blurry regions. Then, the blur aware features are fed into two branch reconstruction decoders respectively. In addition, a new feature fusion mechanism, orientation based feature fusion, is proposed to merge sharp features of the two branches. Both qualitative and quantitative experimental results show that our method performs favorably against the state of the art approaches.


Almost Cohen Macaulay bipartite graphs and connected in codimension two. In this paper we study almost Cohen Macaulay bipartite graphs. Furthermore, we prove that if G is almost Cohen Macaulay bipartite graph with at least one vertex of positive degree, then there is a vertex of deg(v) leq 2 . In particular, if G is an almost Cohen Macaulay bipartite graph and u is a vertex of degree one of G and v its adjacent vertex, then G setminus v is almost Cohen Macaulay. Also, we show that an unmixed Ferrers graph is almost Cohen Macaulay if and only if it is connected in codimension two. Moreover, we give some examples.


Method Towards CVPR 2021 SimLocMatch Challenge. This report describes Megvii 3D team's approach towards SimLocMatch Challenge CVPR 2021 Image Matching Workshop.


zkHawk Practical Private Smart Contracts from MPC based Hawk. Cryptocurrencies have received a lot of research attention in recent years following the release of the first cryptocurrency Bitcoin. With the rise in cryptocurrency transactions, the need for smart contracts has also increased. Smart contracts, in a nutshell, are digitally executed contracts wherein some parties execute a common goal. The main problem with most of the current smart contracts is that there is no privacy for a party's input to the contract from either the blockchain or the other parties. Our research builds on the Hawk project that provides transaction privacy along with support for smart contracts. However, Hawk relies on a special trusted party known as a manager, which must be trusted not to leak each party's input to the smart contract. In this paper, we present a practical private smart contract protocol that replaces the manager with an MPC protocol such that the function to be executed by the MPC protocol is relatively lightweight, involving little overhead added to the smart contract function, and uses practical sigma protocols and homomorphic commitments to prove to the blockchain that the sum of the incoming balances to the smart contract matches the sum of the outgoing balances.


ICOS Efficient and Highly Robust Rotation Search and Point Cloud Registration with Correspondences. Rotation search and point cloud registration are two fundamental problems in robotics and computer vision, which aim to estimate the rotation and the transformation between the 3D vector sets and point clouds, respectively. Due to the presence of outliers, probably in very large numbers, among the putative vector or point correspondences in real world applications, robust estimation is of great importance. In this paper, we present ICOS (Inlier searching using COmpatible Structures), a novel, efficient and highly robust solver for both the correspondence based rotation search and point cloud registration problems. Specifically, we (i) propose and construct a series of compatible structures for the two problems where various invariants can be established, and (ii) design three time efficient frameworks, the first for rotation search, the second for known scale registration and the third for unknown scale registration, to filter out outliers and seek inliers from the invariant constrained random sampling based on the compatible structures proposed. In this manner, even with extreme outlier ratios, inliers can be sifted out and collected for solving the optimal rotation and transformation effectively, leading to our robust solver ICOS. Through plentiful experiments over standard datasets, we demonstrate that (i) our solver ICOS is fast, accurate, robust against over 95 outliers with nearly 100 recall ratio of inliers for rotation search and both known scale and unknown scale registration, outperforming other state of the art methods, and (ii) ICOS is practical for use in multiple real world applications.


Sequentially Cohen Macaulay binomial edge ideals of closed graphs. We give a necessary and sufficient condition for the binomial edge ideals of closed graphs to be sequentially Cohen Macaulay.


Online Resource Allocation with Time Flexible Customers. In classic online resource allocation problems, a decision maker tries to maximize her reward through making immediate and irrevocable choices regarding arriving demand points (agents). However, in many settings, some arriving agents may be patient and willing to wait a short amount of time for the resource. Motivated by this, we study the online resource allocation problem in the presence of time flexible agents under an adversarial online arrival model. We present a setting with flexible and inflexible agents who seek a resource or service that replenishes periodically. Inflexible agents demand the resource immediately upon arrival while flexible agents are willing to wait a short period of time. Our work presents a class of POLYtope based Resource Allocation (POLYRA) algorithms that achieve optimal or near optimal competitive ratios under an adversarial arrival process. Such POLYRA algorithms work by consulting a particular polytope and only making decisions that guarantee the algorithm's state remains feasible in this polytope. When the number of agent types is either two or three, POLYRA algorithms can obtain the optimal competitive ratio. We design these polytopes by constructing an upper bound on the competitive ratio of any algorithm, which is characterized via a linear program (LP) that considers a collection of overlapping worst case input sequences. Our designed POLYRA algorithms then mimic the optimal solution of this upper bound LP via its polytope's definition, obtaining the optimal competitive ratio. When there are more than three types, we show that our overlapping worst case input sequences do not result in an attainable competitive ratio, adding an additional challenge to the problem. Considering this, we present a near optimal nested POLYRA algorithm which achieves at least 80 of the optimal competitive ratio while having a simple and interpretable structure.


Identifying super spreaders in information epidemic coevolving dynamics on multiplex networks. Identifying super spreaders in epidemics is important to suppress the spreading of disease especially when the medical resource is limited.In the modern society, the information on epidemics transmits swiftly through various communication channels which contributes much to the suppression of epidemics. Here we study on the identification of super spreaders in the information disease coupled spreading dynamics. Firstly, we find that the centralities in physical contact layer are no longer effective to identify super spreaders in epidemics, which is due to the suppression effects from the information spreading. Then by considering the structural and dynamical couplings between the communication layer and physical contact layer, we propose a centrality measure called coupling sensitive centrality to identify super spreaders in disease spreading. Simulation results on synthesized and real world multiplex networks show that the proposed measure is not only much more accurate than centralities on the single network, but also outperforms two typical multilayer centralities in identifying super spreaders. These findings imply that considering the structural and dynamical couplings between layers is very necessary in identifying the key roles in the coupled multilayer systems.


Domain Adaptive Pretraining Methods for Dialogue Understanding. Language models like BERT and SpanBERT pretrained on open domain data have obtained impressive gains on various NLP tasks. In this paper, we probe the effectiveness of domain adaptive pretraining objectives on downstream tasks. In particular, three objectives, including a novel objective focusing on modeling predicate argument relations, are evaluated on two challenging dialogue understanding tasks. Experimental results demonstrate that domain adaptive pretraining with proper objectives can significantly improve the performance of a strong baseline on these tasks, achieving the new state of the art performances.


Safety of Flow Decompositions in DAGs. Network flows are one of the most studied combinatorial optimization problems with innumerable applications. Any flow on a directed acyclic graph (DAG) G having n vertices and m edges can be decomposed into a set of O(m) paths, with applications from network routing to assembly of biological sequences. In some applications, the flow decomposition corresponds to some particular data that need to be reconstructed from the flow, which require finding paths (or subpaths) appearing in all possible flow decompositions, referred to as safe paths. Recently, Ma et al. WABI 2020 addressed a related problem in a probabilistic framework. Later, they gave a quadratic time algorithm based on a global criterion, for a generalized version (AND Quant) of the corresponding problem, i.e., reporting if a given flow path is safe. Our contributions are as follows 1 A simple characterization for the safety of a given path based on a local criterion, which can be directly adapted to give an optimal linear time verification algorithm. 2 A simple enumeration algorithm that reports all maximal safe paths on a flow network in O(mn) time. The algorithm reports all safe paths using a compact representation of the solution (called cal P c ), which is Omega(mn) in the worst case, but merely O(m n) in the best case. 3 An improved enumeration algorithm where all safe paths ending at every vertex are represented as funnels using O(n 2 cal P c ) space. These can be computed and used to report all maximal safe paths, using time linear in the total space required by funnels, with an extra logarithmic factor. Overall we present a simple characterization for the problem leading to an optimal verification algorithm and a simple enumeration algorithm. The enumeration algorithm is improved using the funnel structures for safe paths, which may be of independent interest.


Quantitative dynamics of irreversible enzyme reaction diffusion systems. In this work we investigate the convergence to equilibrium for mass action reaction diffusion systems which model irreversible enzyme reactions. Using the standard entropy method in this situation is not feasible as the irreversibility of the system implies that the concentrations of the substrate and the complex decay to zero. The key idea we utilise in this work to circumvent this issue is to introduce a family of cut off partial entropy functions which, when combined with the dissipation of a mass like term of the substrate and the complex, yield an explicit exponential convergence to equilibrium. This method is also applicable in the case where the enzyme and complex molecules do not diffuse, corresponding to chemically relevant situation where these molecules are large in size.


Synchronous Glacial Cycles in a Nonsmooth Conceptual Climate Model with Asymmetric Hemispheres. We present a new conceptual model of the Earth's glacial interglacial cycles, one leading to governing equations for which the vector field has a hyperplane of discontinuities. This work extends the classic Budyko and Sellers type conceptual energy balance models of temperature albedo feedback by removing the standard assumption of planetary symmetry about the equator. The dynamics of separate Northern and Southern Hemisphere ice caps are coupled to an equation representing the annual global mean surface temperature. The system has a discontinuous switching mechanism based on mass balance principles for the Northern Hemisphere ice sheet. We show the associated Filippov system admits a unique nonsmooth and attracting limit cycle that represents the cycling between glacial and interglacial states. Due to the vastly different time scales involved, the model presents a nonsmooth geometric perturbation problem, for which we use ad hoc mathematical techniques to produce the periodic orbit. We find climatic changes in the Northern Hemisphere drive synchronous changes in the Southern Hemisphere, as is observed for the Earth on orbital time scales.


Knowing More About Questions Can Help Improving Calibration in Question Answering. We study calibration in question answering, estimating whether model correctly predicts answer for each question. Unlike prior work which mainly rely on the model's confidence score, our calibrator incorporates information about the input example (e.g., question and the evidence context). Together with data augmentation via back translation, our simple approach achieves 5 10 gains in calibration accuracy on reading comprehension benchmarks. Furthermore, we present the first calibration study in the open retrieval setting, comparing the calibration accuracy of retrieval based span prediction models and answer generation models. Here again, our approach shows consistent gains over calibrators relying on the model confidence. Our simple and efficient calibrator can be easily adapted to many tasks and model architectures, showing robust gains in all settings.


Are all outliers alike? On Understanding the Diversity of Outliers for Detecting OODs. Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out of distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high assurance systems such as autonomous driving, air traffic management, and medical diagnosis. This challenge has received significant attention recently, and several techniques have been developed to detect inputs where the model's prediction cannot be trusted. These techniques use different statistical, geometric, or topological signatures. This paper presents a taxonomy of OOD outlier inputs based on their source and nature of uncertainty. We demonstrate how different existing detection approaches fail to detect certain types of outliers. We utilize these insights to develop a novel integrated detection approach that uses multiple attributes corresponding to different types of outliers. Our results include experiments on CIFAR10, SVHN and MNIST as in distribution data and Imagenet, LSUN, SVHN (for CIFAR10), CIFAR10 (for SVHN), KMNIST, and F MNIST as OOD data across different DNN architectures such as ResNet34, WideResNet, DenseNet, and LeNet5.


Robustness Disparities in Commercial Face Detection. Facial detection and analysis systems have been deployed by large companies and critiqued by scholars and activists for the past decade. Critiques that focus on system performance analyze disparity of the system's output, i.e., how frequently is a face detected for different Fitzpatrick skin types or perceived genders. However, we focus on the robustness of these system outputs under noisy natural perturbations. We present the first of its kind detailed benchmark of the robustness of three such systems Amazon Rekognition, Microsoft Azure, and Google Cloud Platform. We use both standard and recently released academic facial datasets to quantitatively analyze trends in robustness for each. Across all the datasets and systems, we generally find that photos of individuals who are older, masculine presenting, of darker skin type, or have dim lighting are more susceptible to errors than their counterparts in other identities.


Competition Report CHC COMP 21. CHC COMP 21 is the fourth competition of solvers for Constrained Horn Clauses. In this year, 7 solvers participated at the competition, and were evaluated in 7 separate tracks on problems in linear integer arithmetic, linear real arithmetic, arrays, and algebraic data types. The competition was run in March 2021 using the StarExec computing cluster. This report gives an overview of the competition design, explains the organisation of the competition, and presents the competition results.


Textile Taxonomy and Classification Using Pulling and Twisting. Identification of textile properties is an important milestone toward advanced robotic manipulation tasks that consider interaction with clothing items such as assisted dressing, laundry folding, automated sewing, textile recycling and reusing. Despite the abundance of work considering this class of deformable objects, many open problems remain. These relate to the choice and modelling of the sensory feedback as well as the control and planning of the interaction and manipulation strategies. Most importantly, there is no structured approach for studying and assessing different approaches that may bridge the gap between the robotics community and textile production industry. To this end, we outline a textile taxonomy considering fiber types and production methods, commonly used in textile industry. We devise datasets according to the taxonomy, and study how robotic actions, such as pulling and twisting of the textile samples, can be used for the classification. We also provide important insights from the perspective of visualization and interpretability of the gathered data.


Overview of the Micro bunching Instability in Electron Storage Rings and Evolving Diagnostics. The micro bunching instability is a longitudinal instability that leads to dynamical deformations of the charge distribution in the longitudinal phase space. It affects the longitudinal charge distribution, and thus the emitted coherent synchrotron radiation spectra, as well as the energy distribution of the electron bunch. Not only the threshold in the bunch current above which the instability occurs, but also the dynamics above the instability threshold strongly depends on machine parameters, e.g. accelerating voltage, momentum compaction factor, and beam energy. All this makes the understanding and potential mitigation or control of the micro bunching instability an important topic for the next generation of light sources and circular e e colliders. This contribution will give an overview of the micro bunching instability and discuss how technological advances in the turn by turn and bunch by bunch diagnostics are leading to a deeper understanding of this intriguing phenomenon.


Deep Ensemble Collaborative Learning by using Knowledge transfer Graph for Fine grained Object Classification. Mutual learning, in which multiple networks learn by sharing their knowledge, improves the performance of each network. However, the performance of ensembles of networks that have undergone mutual learning does not improve significantly from that of normal ensembles without mutual learning, even though the performance of each network has improved significantly. This may be due to the relationship between the knowledge in mutual learning and the individuality of the networks in the ensemble. In this study, we propose an ensemble method using knowledge transfer to improve the accuracy of ensembles by introducing a loss design that promotes diversity among networks in mutual learning. We use an attention map as knowledge, which represents the probability distribution and information in the middle layer of a network. There are many ways to combine networks and loss designs for knowledge transfer methods. Therefore, we use the automatic optimization of knowledge transfer graphs to consider a variety of knowledge transfer methods by graphically representing conventional mutual learning and distillation methods and optimizing each element through hyperparameter search. The proposed method consists of a mechanism for constructing an ensemble in a knowledge transfer graph, attention loss, and a loss design that promotes diversity among networks. We explore optimal ensemble learning by optimizing a knowledge transfer graph to maximize ensemble accuracy. From exploration of graphs and evaluation experiments using the datasets of Stanford Dogs, Stanford Cars, and CUB 200 2011, we confirm that the proposed method is more accurate than a conventional ensemble method.


Composite acousto optical modulation. We propose a composite acousto optical modulation (AOM) scheme for wide band, efficient modulation of CW and pulsed lasers. We show that by adjusting the amplitudes and phases of weakly driven daughter AOMs, diffraction beyond the Bragg condition can be achieved with exceptional efficiencies. Furthermore, by imaging pairs of AOMs in a counter propagating configuration, high contrast switching of output orders can be achieved at the driving radio frequency (rf) limit, thereby enabling efficient bidirectional routing of a synchronized mode locked laser. Here we demonstrate a simplest example of such scheme with a double AOM setup for efficient diffraction across an octave of rf bandwidth, and for routing a mode locked pulse train with up to f rm rep 400 MHz repetition rate. We discuss extension of the composite scheme toward multi path routing and time domain multiplexing, so as to individually shape each pulses of ultrafast lasers for novel quantum control applications.


Throughput and Latency in the Distributed Q Learning Random Access mMTC Networks. In mMTC mode, with thousands of devices trying to access network resources sporadically, the problem of random access (RA) and collisions between devices that select the same resources becomes crucial. A promising approach to solve such an RA problem is to use learning mechanisms, especially the Q learning algorithm, where the devices learn about the best time slot periods to transmit through rewards sent by the central node. In this work, we propose a distributed packet based learning method by varying the reward from the central node that favors devices having a larger number of remaining packets to transmit. Our numerical results indicated that the proposed distributed packet based Q learning method attains a much better throughput latency trade off than the alternative independent and collaborative techniques in practical scenarios of interest. In contrast, the number of payload bits of the packet based technique is reduced regarding the collaborative Q learning RA technique for achieving the same normalized throughput.


Project Level Encoding for Neural Source Code Summarization of Subroutines. Source code summarization of a subroutine is the task of writing a short, natural language description of that subroutine. The description usually serves in documentation aimed at programmers, where even brief phrase (e.g. "compresses data to a zip file") can help readers rapidly comprehend what a subroutine does without resorting to reading the code itself. Techniques based on neural networks (and encoder decoder model designs in particular) have established themselves as the state of the art. Yet a problem widely recognized with these models is that they assume the information needed to create a summary is present within the code being summarized itself an assumption which is at odds with program comprehension literature. Thus a current research frontier lies in the question of encoding source code context into neural models of summarization. In this paper, we present a project level encoder to improve models of code summarization. By project level, we mean that we create a vectorized representation of selected code files in a software project, and use that representation to augment the encoder of state of the art neural code summarization techniques. We demonstrate how our encoder improves several existing models, and provide guidelines for maximizing improvement while controlling time and resource costs in model size.


Perception Point Identifying Critical Learning Periods in Speech for Bilingual Networks. Recent studies in speech perception have been closely linked to fields of cognitive psychology, phonology, and phonetics in linguistics. During perceptual attunement, a critical and sensitive developmental trajectory has been examined in bilingual and monolingual infants where they can best discriminate common phonemes. In this paper, we compare and identify these cognitive aspects on deep neural based visual lip reading models. We conduct experiments on the two most extensive public visual speech recognition datasets for English and Mandarin. Through our experimental results, we observe a strong correlation between these theories in cognitive psychology and our unique modeling. We inspect how these computational models develop similar phases in speech perception and acquisitions.


A deep language model to predict metabolic network equilibria. We show that deep learning models, and especially architectures like the Transformer, originally intended for natural language, can be trained on randomly generated datasets to predict to very high accuracy both the qualitative and quantitative features of metabolic networks. Using standard mathematical techniques, we create large sets (40 million elements) of random networks that can be used to train our models. These trained models can predict network equilibrium on random graphs in more than 99 of cases. They can also generalize to graphs with different structure than those encountered at training. Finally, they can predict almost perfectly the equilibria of a small set of known biological networks. Our approach is both very economical in experimental data and uses only small and shallow deep learning model, far from the large architectures commonly used in machine translation. Such results pave the way for larger use of deep learning models for problems related to biological networks in key areas such as quantitative systems pharmacology, systems biology, and synthetic biology.


Collision Aware Target Driven Object Grasping in Constrained Environments. Grasping a novel target object in constrained environments (e.g., walls, bins, and shelves) requires intensive reasoning about grasp pose reachability to avoid collisions with the surrounding structures. Typical 6 DoF robotic grasping systems rely on the prior knowledge about the environment and intensive planning computation, which is ungeneralizable and inefficient. In contrast, we propose a novel Collision Aware Reachability Predictor (CARP) for 6 DoF grasping systems. The CARP learns to estimate the collision free probabilities for grasp poses and significantly improves grasping in challenging environments. The deep neural networks in our approach are trained fully by self supervision in simulation. The experiments in both simulation and the real world show that our approach achieves more than 75 grasping rate on novel objects in various surrounding structures. The ablation study demonstrates the effectiveness of the CARP, which improves the 6 DoF grasping rate by 95.7 .


Informatiekunde Visie 2003. This document discusses (in Dutch) the vision underlying the business informatics (Informatiekunde) curriculum and research programme at the Nijmegen Institute for Informatics and Information Science (NIII). The ultimate aim of this document is to provide a 'repository' with regard to these visions, and a basis for the specific structure of the program's curriculum and research plans. Since business informatics is a relatively new area for teaching and research at NIII, the current (2003) version of this document primarily focuses on the educational perspective. It is to be expected that in the coming years, updates to this document will also pay more attention to business informatics research. The fact that this document can be updated annually does not mean, however, that we expect an annual change of course. The ambition with regard to the stability of what is described in this document is 5 to 6 years. In the current version, this applies specifically to the vision of the information science study program. The research part of this document will have to be fleshed out even more specifically in the coming years.


Polycyclic Codes Associated with Trinomials Good Codes and Open Questions. Polycyclic codes are a generalization of cyclic and constacyclic codes. Even though they have been known since 1972 and received some attention more recently, there have not been many studies on polycyclic codes. This paper presents an in depth investigation of polycyclic codes associated with trinomials. Our results include a number of facts about trinomials, some properties of polycyclic codes, and many new quantum codes derived from polycyclic codes. We also state several conjectures about polynomials and polycyclic codes. Hence, we show useful features of polycyclic codes and present some open problems related to them.


On Covariate Shift of Latent Confounders in Imitation and Reinforcement Learning. We consider the problem of using expert data with unobserved confounders for imitation and reinforcement learning. We begin by defining the problem of learning from confounded expert data in a contextual MDP setup. We analyze the limitations of learning from such data with and without external reward, and propose an adjustment of standard imitation learning algorithms to fit this setup. We then discuss the problem of distribution shift between the expert data and the online environment when the data is only partially observable. We prove possibility and impossibility results for imitation learning under arbitrary distribution shift of the missing covariates. When additional external reward is provided, we propose a sampling procedure that addresses the unknown shift and prove convergence to an optimal solution. Finally, we validate our claims empirically on challenging assistive healthcare and recommender system simulation tasks.


Jacobi type algorithms for homogeneous polynomial optimization on Stiefel manifolds with applications to tensor approximations. In this paper, we mainly study the gradient based Jacobi type algorithms to maximize two classes of homogeneous polynomials with orthogonality constraints, and establish their convergence properties. For the first class of homogeneous polynomials subject to a constraint on a Stiefel manifold, we reformulate it as an optimization problem on a unitary group, which makes it possible to apply the gradient based Jacobi type (Jacobi G) algorithm. Then, if the subproblem can be always represented as a quadratic form, we establish the global convergence of Jacobi G under any one of the three conditions (A1), (A2) and (A3). The convergence result for (A1) is an easy extension of the result in Usevich et al. SIOPT 2020 , while (A2) and (A3) are two new ones. This algorithm and the convergence properties apply to the well known joint approximate symmetric tensor diagonalization and joint approximate symmetric trace maximization. For the second class of homogeneous polynomials subject to constraints on the product of Stiefel manifolds, we similarly reformulate it as an optimization problem on the product of unitary groups, and then develop a new gradient based multi block Jacobi type (Jacobi MG) algorithm to solve it. We similarly establish the global convergence of Jacobi MG under any one of the three conditions (A1), (A2) and (A3), if the subproblem can be always represented as a quadratic form. This algorithm and the convergence properties apply to the well known joint approximate tensor diagonalization and joint approximate tensor compression. As the proximal variants of Jacobi G and Jacobi MG, we also propose the Jacobi GP and Jacobi MGP algorithms, and establish their global convergence without any further condition. Some numerical results are provided indicating the efficiency of the proposed algorithms.


Reasoning about Iteration and Recursion Uniformly based on Big step Semantics. A reliable technique for deductive program verification should be proven sound with respect to the semantics of the programming language. For each different language, the construction of a separate soundness proof is often a laborious undertaking. In language independent program verification, common aspects of computer programs are addressed to enable sound reasoning for all languages. In this work, we propose a solution for the sound reasoning about iteration and recursion based on the big step operational semantics of any programming language. We give inductive proofs on the soundness and relative completeness of our reasoning technique. We illustrate the technique at simplified programming languages of the imperative and functional paradigms, with diverse features. We also mechanism all formal results in the Coq proof assistant.


On potentials of It o's processes with drift in L d 1 . This paper is a natural continuation of cite Kr 20 2 , where strong Markov processes are constructed in time inhomogeneous setting with Borel measurable uniformly bounded and uniformly nondegenerate diffusion and drift in L d 1 ( mathbb R d 1 ) . Here we study some properties of these processes such as the probability to pass through narrow tubes, higher summability of Green's functions, and so on. The results seem to be new even if the diffusion is constant.


Trans4E Link Prediction on Scholarly Knowledge Graphs. The incompleteness of Knowledge Graphs (KGs) is a crucial issue affecting the quality of AI based services. In the scholarly domain, KGs describing research publications typically lack important information, hindering our ability to analyse and predict research dynamics. In recent years, link prediction approaches based on Knowledge Graph Embedding models became the first aid for this issue. In this work, we present Trans4E, a novel embedding model that is particularly fit for KGs which include N to M relations with N gg M. This is typical for KGs that categorize a large number of entities (e.g., research articles, patents, persons) according to a relatively small set of categories. Trans4E was applied on two large scale knowledge graphs, the Academia Industry DynAmics (AIDA) and Microsoft Academic Graph (MAG), for completing the information about Fields of Study (e.g., 'neural networks', 'machine learning', 'artificial intelligence'), and affiliation types (e.g., 'education', 'company', 'government'), improving the scope and accuracy of the resulting data. We evaluated our approach against alternative solutions on AIDA, MAG, and four other benchmarks (FB15k, FB15k 237, WN18, and WN18RR). Trans4E outperforms the other models when using low embedding dimensions and obtains competitive results in high dimensions.


Learning Intra Batch Connections for Deep Metric Learning. The goal of metric learning is to learn a function that maps samples to a lower dimensional space where similar samples lie closer than dissimilar ones. Particularly, deep metric learning utilizes neural networks to learn such a mapping. Most approaches rely on losses that only take the relations between pairs or triplets of samples into account, which either belong to the same class or two different classes. However, these methods do not explore the embedding space in its entirety. To this end, we propose an approach based on message passing networks that takes all the relations in a mini batch into account. We refine embedding vectors by exchanging messages among all samples in a given batch allowing the training process to be aware of its overall structure. Since not all samples are equally important to predict a decision boundary, we use an attention mechanism during message passing to allow samples to weigh the importance of each neighbor accordingly. We achieve state of the art results on clustering and image retrieval on the CUB 200 2011, Cars196, Stanford Online Products, and In Shop Clothes datasets. To facilitate further research, we make available the code and the models at https github.com dvl tum intra batch connections.


Sparse Distillation Speeding Up Text Classification by Using Bigger Models. Distilling state of the art transformer models into lightweight student models is an effective way to reduce computation cost at inference time. However, the improved inference speed may be still unsatisfactory for certain time sensitive applications. In this paper, we aim to further push the limit of inference speed by exploring a new area in the design space of the student model. More specifically, we consider distilling a transformer based text classifier into a billion parameter, sparsely activated student model with a embedding averaging architecture. Our experiments show that the student models retain 97 of the RoBERTa Large teacher performance on a collection of six text classification tasks. Meanwhile, the student model achieves up to 600x speed up on both GPUs and CPUs, compared to the teacher models. Further investigation shows that our pipeline is also effective in privacy preserving and domain generalization settings.


One Shot Face Swapping on Megapixels. Face swapping has both positive applications such as entertainment, human computer interaction, etc., and negative applications such as DeepFake threats to politics, economics, etc. Nevertheless, it is necessary to understand the scheme of advanced methods for high quality face swapping and generate enough and representative face swapping images to train DeepFake detection algorithms. This paper proposes the first Megapixel level method for one shot Face Swapping (or MegaFS for short). Firstly, MegaFS organizes face representation hierarchically by the proposed Hierarchical Representation Face Encoder (HieRFE) in an extended latent space to maintain more facial details, rather than compressed representation in previous face swapping methods. Secondly, a carefully designed Face Transfer Module (FTM) is proposed to transfer the identity from a source image to the target by a non linear trajectory without explicit feature disentanglement. Finally, the swapped faces can be synthesized by StyleGAN2 with the benefits of its training stability and powerful generative capability. Each part of MegaFS can be trained separately so the requirement of our model for GPU memory can be satisfied for megapixel face swapping. In summary, complete face representation, stable training, and limited memory usage are the three novel contributions to the success of our method. Extensive experiments demonstrate the superiority of MegaFS and the first megapixel level face swapping database is released for research on DeepFake detection and face image editing in the public domain. The dataset is at this link.


Optimal Gagliardo Nirenberg interpolation inequality for rearrangement invariant spaces. We prove optimality of the Gagliardo Nirenberg inequality nabla u X lesssim nabla 2 u Y 1 2 u Z 1 2 , where Y, Z are rearrangement invariant Banach function spaces and X Y 1 2 Z 1 2 is the Calder 'on Lozanovskii space. By optimality, we mean that for a certain pair of spaces on the right hand side, one cannot reduce the space on the left hand, remaining in the class of rearrangement invariant spaces. The optimality for the Lorentz and Orlicz spaces is given as a consequence, exceeding previous results. We also discuss pointwise inequalities, their importance and counterexample prohibiting an improvement.


De Novo Molecular Generation with Stacked Adversarial Model. Generating novel drug molecules with desired biological properties is a time consuming and complex task. Conditional generative adversarial models have recently been proposed as promising approaches for de novo drug design. In this paper, we propose a new generative model which extends an existing adversarial autoencoder (AAE) based model by stacking two models together. Our stacked approach generates more valid molecules, as well as molecules that are more similar to known drugs. We break down this challenging task into two sub problems. A first stage model to learn primitive features from the molecules and gene expression data. A second stage model then takes these features to learn properties of the molecules and refine more valid molecules. Experiments and comparison to baseline methods on the LINCS L1000 dataset demonstrate that our proposed model has promising performance for molecular generation.


Second Order Specifications and Quantifier Elimination for Consistent Query Answering in Databases. Consistent answers to a query from a possibly inconsistent database are answers that are simultaneously retrieved from every possible repair of the database. Repairs are consistent instances that minimally differ from the original inconsistent instance. It has been shown before that database repairs can be specified as the stable models of a disjunctive logic program. In this paper we show how to use the repair programs to transform the problem of consistent query answering into a problem of reasoning w.r.t. a theory written in second order predicate logic. It also investigated how a first order theory can be obtained instead by applying second order quantifier elimination techniques.