The spectral radius of graphs with no intersecting odd cycles. Let H s,t 1, ldots ,t k be the graph with s triangles and k odd cycles of lengths t 1, ldots ,t k ge 5 intersecting in exactly one common vertex. Recently, Hou, Qiu and Liu Discrete Math. 341 (2018) 126 137 , and Yuan J. Graph Theory 89 (1) (2018) 26 39 determined independently the maximum number of edges in an n vertex graph that does not contain H s,t 1, ldots ,t k as a subgraph. In this paper, we determine the graphs of order n that attain the maximum spectral radius among all graphs containing no H s,t 1, ldots ,t k for n large enough.


Comment on Linear energy transfer incorporated intensity modulated proton therapy optimization'. Cao et al (2018) published an article on inverse planning based on dose averaged linear energy transfer (LET). Their claim that the problem can be cast as a linear optimization model relies on an incorrect application of the Charnes Cooper transformation. In this comment we show that their linear model is simlar to one where dose averaged LET is multiplied with dose, explaining why their model was nonetheless able to improve the LET distribution.


Mind the Gap Assessing Temporal Generalization in Neural Language Models. Our world is open ended, non stationary, and constantly evolving thus what we talk about and how we talk about it change over time. This inherent dynamic nature of language contrasts with the current static language modelling paradigm, which trains and evaluates models on utterances from overlapping time periods. Despite impressive recent progress, we demonstrate that Transformer XL language models perform worse in the realistic setup of predicting future utterances from beyond their training period, and that model performance becomes increasingly worse with time. We find that, while increasing model size alone a key driver behind recent progress does not solve this problem, having models that continually update their knowledge with new information can indeed mitigate this performance degradation over time. Hence, given the compilation of ever larger language modelling datasets, combined with the growing list of language model based NLP applications that require up to date factual knowledge about the world, we argue that now is the right time to rethink the static way in which we currently train and evaluate our language models, and develop adaptive language models that can remain up to date with respect to our ever changing and non stationary world. We publicly release our dynamic, streaming language modelling benchmarks for WMT and arXiv to facilitate language model evaluation that takes temporal dynamics into account.


Lattices of t structures and thick subcategories for discrete cluster categories. We classify t structures and thick subcategories in discrete cluster categories mathcal C ( mathcal Z ) of Dynkin type A , and show that the set of all t structures on mathcal C ( mathcal Z ) is a lattice under inclusion of aisles, with meet given by their intersection. We show that both the lattice of t structures on mathcal C ( mathcal Z ) obtained in this way and the lattice of thick subcategories of mathcal C ( mathcal Z ) are intimately related to the lattice of non crossing partitions of type A . In particular, the lattice of equivalence classes of non degenerate t structures on such a category is isomorphic to the lattice of non crossing partitions of a finite linearly ordered set.


Uplink Power Control in Integrated Access and Backhaul Networks. Integrated access and backhaul (IAB) network is a novel radio access network (RAN) solution, enabling network densification for 5G and beyond. In this paper, we use power control combined with resource allocation algorithms to develop efficient IAB networks with high service coverage. Particularly, we develop a genetic algorithm based solution for the power control of both user equipments and IAB nodes such that the network uplink service coverage probability is maximized. Finally, considering millimeter wave channel models, we study the effect of different parameters including minimum data rate requirement, coverage distance and transmit power on the network performance. As we show, a power allocation schemes with well tuned parameters can improve the uplink performance of IAB networks considerably. Moreover, with millimeter wave communications and a proper network deployment, the effect of interference on the service coverage probability is negligible.


BACKDOORL Backdoor Attack against Competitive Reinforcement Learning. Recent research has confirmed the feasibility of backdoor attacks in deep reinforcement learning (RL) systems. However, the existing attacks require the ability to arbitrarily modify an agent's observation, constraining the application scope to simple RL systems such as Atari games. In this paper, we migrate backdoor attacks to more complex RL systems involving multiple agents and explore the possibility of triggering the backdoor without directly manipulating the agent's observation. As a proof of concept, we demonstrate that an adversary agent can trigger the backdoor of the victim agent with its own action in two player competitive RL systems. We prototype and evaluate BACKDOORL in four competitive environments. The results show that when the backdoor is activated, the winning rate of the victim drops by 17 to 37 compared to when not activated.


Commuting normal operators and joint numerical range. Let mathcal H be a complex Hilbert space and let mathcal B ( mathcal H ) be the algebra of all bounded linear operators on mathcal H . For a positive integer k less than the dimension of mathcal H and mathbf A (A 1, dots, A m) in mathcal B ( mathcal H ) m , the joint k numerical range W k( mathbf A ) is the set of ( alpha 1, dots, alpha m) in mathbb C m such that alpha i sum j 1 k langle A ix j, x j rangle for an orthonormal set x 1, ldots, x k in mathcal H . Relations between the geometric properties of W k( mathbf A ) and the algebraic and analytic properties of A 1, dots, A m are studied. It is shown that there is k in mathbb N such that W k( mathbf A ) is a polyhedral set, i.e., the convex hull of a finite set, if and only if A 1, dots, A k have a common reducing subspace mathbf V of finite dimension such that the compression of A 1, dots, A m on the subspace mathbf V are diagonal operators D 1, dots, D m and W k( mathbf A ) W k(D 1, dots, D m) . Characterization is also given to bf A such that the closure of W k( mathbf A ) is polyhedral. The conditions are related to the joint essential numerical range of mathbf A . These results are used to study bf A such that (a) A 1, dots, A m is a commuting family of normal operators, or (b) W k(A 1, dots, A m) is polyhedral for every positive integer k . It is shown that conditions (a) and (b) are equivalent for finite rank operators but it is no longer true for compact operators. Characterizations are given for compact operators A 1, dots, A m satisfying (a) and (b), respectively. Results are also obtained for general non compact operators.


The Choice of Knowledge Base in Automated Claim Checking. Automated claim checking is the task of determining the veracity of a claim given evidence found in a knowledge base of trustworthy facts. While previous work has taken the knowledge base as given and optimized the claim checking pipeline, we take the opposite approach taking the pipeline as given, we explore the choice of knowledge base. Our first insight is that a claim checking pipeline can be transferred to a new domain of claims with access to a knowledge base from the new domain. Second, we do not find a "universally best" knowledge base higher domain overlap of a task dataset and a knowledge base tends to produce better label accuracy. Third, combining multiple knowledge bases does not tend to improve performance beyond using the closest domain knowledge base. Finally, we show that the claim checking pipeline's confidence score for selecting evidence can be used to assess whether a knowledge base will perform well for a new set of claims, even in the absence of ground truth labels.


Asymptotic growth of Mordell Weil ranks of elliptic curves in noncommutative towers. Let E be an elliptic curve defined over a number field F with good ordinary reduction at all primes above p , and let F infty be a finitely ramified uniform pro p extension of F containing the cyclotomic mathbb Z p extension F cyc . Set F (n) be the n th layer of the tower, and F (n) cyc the cyclotomic mathbb Z p extension of F (n) . We study the growth of the rank of E(F (n) ) by analyzing the growth of the lambda invariant of the Selmer group over F (n) cyc as n rightarrow infty . This method has its origins in work of A.Cuoco, who studied mathbb Z p 2 extensions. Refined estimates for growth are proved that are close to conjectured estimates. The results are illustrated in special cases.


High accuracy liquid sample beta NMR setup at ISOLDE. Recently there has been an increased interest to apply the sensitive beta decay asymmetry detected nuclear magnetic resonance ( beta NMR) technique to biological studies. A liquid sample beta NMR setup was build at ISOLDE to allow such investigations and to use the resolution gain of liquid state NMR in nuclear physics. As part of this setup a magnetic field locking system, a set of printed circuit board shimming coils, a sample exchange system, a set of compact beta detectors and a custom experimental vacuum chamber were developed. The main magnetic field was stabilized down to the ppm level by the locking system while allowing the direct determination of the absolute magnetic field. The homogeneity of the magnetic field was improved to leq 5 ppm over the sample volume by the shimming coils. Time spent on changing samples was reduced by a factor of five by the liquid sample exchange system. During experiments it was possible to continuously observe the liquid sample thanks to the custom chamber and compact beta detectors. The absolute field determination allows for a novel way to reference beta NMR measurements, removing the need for time consuming reference measurements. The improved accuracy and resolution resulting from these innovations allows the study of the distribution of nuclear magnetization and (bio)chemicals using high accuracy liquid sample beta NMR.


Recursive Periodicity Shifting for Semi Persistent Scheduling of Time Sensitive Communication in 5G. Various legacy and emerging industrial control applications create the requirement of periodic and time sensitive communication (TSC) for 5G 6G networks. State of the art semi persistent scheduling (SPS) techniques fall short of meeting the requirements of this type of critical traffic due to periodicity misalignment between assignments and arriving packets that lead to significant waiting delays. To tackle this challenge, we develop a novel recursive periodicity shifting (RPS) SPS scheme that provides an optimal scheduling policy by recursively aligning the period of assignments until the timing mismatch is minimized. RPS can be realized in 5G wireless networks with minimal modifications to the scheduling framework. Performance evaluation shows the effectiveness of the proposed scheme in terms of minimizing misalignment delay with arbitrary traffic periodicity.


An open source framework for ExpFinder integrating N gram Vector Space Model and mu CO HITS. Finding experts drives successful collaborations and high quality product development in academic and research domains. To contribute to the expert finding research community, we have developed ExpFinder which is a novel ensemble model for expert finding by integrating an N gram vector space model ( n VSM) and a graph based model ( mu CO HITS). This paper provides descriptions of ExpFinder's architecture, key components, functionalities, and illustrative examples. ExpFinder is an effective and competitive model for expert finding, significantly outperforming a number of expert finding models.


An Empirical Study of Extrapolation in Text Generation with Scalar Control. We conduct an empirical evaluation of extrapolation performance when conditioning on scalar control inputs like desired output length, desired edit from an input sentence, and desired sentiment across three text generation tasks. Specifically, we examine a zero shot setting where models are asked to generalize to ranges of control values not seen during training. We focus on evaluating popular embedding methods for scalar inputs, including both learnable and sinusoidal embeddings, as well as simpler approaches. Surprisingly, our findings indicate that the simplest strategy of using scalar inputs directly, without further encoding, most reliably allows for successful extrapolation.


On the value of a general stochastic differential game with ergodic payoff. In this paper we study a type of zero sum stochastic differential games with ergodic payoff in which the diffusion system does not need to be non degenerate. We first show the existence of a viscosity solution of the associated ergodic Hamilton Jacobi Bellman Isaacs equation under the dissipativity condition. With the help of this viscosity solution, we then give the estimates for the upper and lower ergodic value functions by constructing a series of non degenerate approximating processes and using the sup and inf convolution techniques. Finally, we obtain the existence of a value under the Isaacs condition and its representation formulae. In addition, we apply our results to study a type of pollution accumulation problems with the long run average social welfare.


Missing Data Estimation in Temporal Multilayer Position aware Graph Neural Network (TMP GNN). GNNs have been proven to perform highly effective in various node level, edge level, and graph level prediction tasks in several domains. Existing approaches mainly focus on static graphs. However, many graphs change over time with their edge may disappear, or node edge attribute may alter from one time to the other. It is essential to consider such evolution in representation learning of nodes in time varying graphs. In this paper, we propose a Temporal Multi layered Position aware Graph Neural Network (TMP GNN), a node embedding approach for dynamic graph that incorporates the interdependence of temporal relations into embedding computation. We evaluate the performance of TMP GNN on two different representations of temporal multilayered graphs. The performance is assessed against the most popular GNNs on node level prediction tasks. Then, we incorporate TMP GNN into a deep learning framework to estimate missing data and compare the performance with their corresponding competent GNNs from our former experiment, and a baseline method. Experimental results on four real world datasets yield up to 58 of lower ROC AUC for pairwise node classification task, and 96 of lower MAE in missing feature estimation, particularly for graphs with a relatively high number of nodes and lower mean degree of connectivity.


TENT Text Classification Based on ENcoding Tree Learning. Text classification is a primary task in natural language processing (NLP). Recently, graph neural networks (GNNs) have developed rapidly and been applied to text classification tasks. Although more complex models tend to achieve better performance, research highly depends on the computing power of the device used. In this article, we propose TENT (https github.com Daisean TENT) to obtain better text classification performance and reduce the reliance on computing power. Specifically, we first establish a dependency analysis graph for each text and then convert each graph into its corresponding encoding tree. The representation of the entire graph is obtained by updating the representation of the non leaf nodes in the encoding tree. Experimental results show that our method outperforms other baselines on several datasets while having a simple structure and few parameters.


CVEfixes Automated Collection of Vulnerabilities and Their Fixes from Open Source Software. Data driven research on the automated discovery and repair of security vulnerabilities in source code requires comprehensive datasets of real life vulnerable code and their fixes. To assist in such research, we propose a method to automatically collect and curate a comprehensive vulnerability dataset from Common Vulnerabilities and Exposures (CVE) records in the public National Vulnerability Database (NVD). We implement our approach in a fully automated dataset collection tool and share an initial release of the resulting vulnerability dataset named CVEfixes. The CVEfixes collection tool automatically fetches all available CVE records from the NVD, gathers the vulnerable code and corresponding fixes from associated open source repositories, and organizes the collected information in a relational database. Moreover, the dataset is enriched with meta data such as programming language, and detailed code and security metrics at five levels of abstraction. The collection can easily be repeated to keep up to date with newly discovered or patched vulnerabilities. The initial release of CVEfixes spans all published CVEs up to 9 June 2021, covering 5365 CVE records for 1754 open source projects that were addressed in a total of 5495 vulnerability fixing commits. CVEfixes supports various types of data driven software security research, such as vulnerability prediction, vulnerability classification, vulnerability severity prediction, analysis of vulnerability related code changes, and automated vulnerability repair.


A Compression Compilation Framework for On mobile Real time BERT Applications. Transformer based deep learning models have increasingly demonstrated high accuracy on many natural language processing (NLP) tasks. In this paper, we propose a compression compilation co design framework that can guarantee the identified model to meet both resource and real time specifications of mobile devices. Our framework applies a compiler aware neural architecture optimization method (CANAO), which can generate the optimal compressed model that balances both accuracy and latency. We are able to achieve up to 7.8x speedup compared with TensorFlow Lite with only minor accuracy loss. We present two types of BERT applications on mobile devices Question Answering (QA) and Text Generation. Both can be executed in real time with latency as low as 45ms. Videos for demonstrating the framework can be found on https www.youtube.com watch?v WIRvK 2PZI


Flexibility and regularity of the hydration structure of a sodium ion. Nonempirical insight. The stationary nonempirical simulations of Na (H2O)n clusters with n in a range of 28 to 51 carried out at the density functional level with a hybrid B3LYP functional and the Born Oppenheimer molecular dynamics modeling of the size selected clusters reveal the interrelated structural and energetic peculiarities of sodium hydration structures. Surface, bulk, and transient configurations of the clusters are distinguished with the different location of the sodium nucleus (close to either the spatial center of the structure or one of its side faces) and its consistently changing coordination number (which typically equals five or six). The rNaO mean Na O distances for the first shell water molecules are found to depend both on the spatial character of the structure and the local coordination of sodium. The rNaO values are compared to different experimental estimates, and the virtual discrepancy of the latter is explained based on the results of the cluster simulations. Different coordination neighborhoods of sodium are predicted depending on its local fraction in the actual specimens.


Comment on Stochastic Polyak Step Size Performance of ALI G. This is a short note on the performance of the ALI G algorithm (Berrada et al., 2020) as reported in (Loizou et al., 2021). ALI G (Berrada et al., 2020) and SPS (Loizou et al., 2021) are both adaptations of the Polyak step size to optimize machine learning models that can interpolate the training data. The main algorithmic differences are that (1) SPS employs a multiplicative constant in the denominator of the learning rate while ALI G uses an additive constant, and (2) SPS uses an iteration dependent maximal learning rate while ALI G uses a constant one. There are also differences in the analysis provided by the two works, with less restrictive assumptions proposed in (Loizou et al., 2021). In their experiments, (Loizou et al., 2021) did not use momentum for ALI G (which is a standard part of the algorithm) or standard hyper parameter tuning (for e.g. learning rate and regularization). Hence this note as a reference for the improved performance that ALI G can obtain with well chosen hyper parameters. In particular, we show that when training a ResNet 34 on CIFAR 10 and CIFAR 100, the performance of ALI G can reach respectively 93.5 ( 6 ) and 76 ( 8 ) with a very small amount of tuning. Thus ALI G remains a very competitive method for training interpolating neural networks.


Telescopers for differential forms with one parameter. Telescopers for a function are linear differential (resp. difference) operators annihilated by the definite integral (resp. definite sum) of this function. They play a key role in Wilf Zeilberger theory and algorithms for computing them have been extensively studied in the past thirty years. In this paper, we introduce the notion of telescopers for differential forms with D finite function coefficients. These telescopers appear in several areas of mathematics, for instance parametrized differential Galois theory and mirror symmetry. We give a sufficient and necessary condition for the existence of telescopers for a differential form and describe a method to compute them if they exist. Algorithms for verifying this condition are also given.


On the Heterogeneity of Independent Learning Dynamics in Zero sum Stochastic Games. We analyze the convergence properties of the two timescale fictitious play combining the classical fictitious play with the Q learning for two player zero sum stochastic games with player dependent learning rates. We show its almost sure convergence under the standard assumptions in two timescale stochastic approximation methods when the discount factor is less than the product of the ratios of player dependent step sizes. To this end, we formulate a novel Lyapunov function formulation and present a one sided asynchronous convergence result.


Teaching Information Security Management Using an Incident of Intellectual Property Leakage. Case based learning is a powerful pedagogical method of creating dialogue between theory and practice. CBL is particularly suited to executive learning as it instigates critical discussion and draws out relevant experiences. In this paper we used a real world case to teach Information Security Management to students in Management Information Systems. The real world case is described in a legal indictment, T mobile USA Inc v Huawei Device USA Inc. and Huawei Technologies Co. LTD, alleging theft of intellectual property and breaches of contract concerning confidentiality and disclosure of sensitive information. The incident scenario is interesting as it relates to a business asset that has both digital and physical components that has been compromised through an unconventional cyber physical attack facilitated by insiders. The scenario sparked an interesting debate among students about the scope and definition of security incidents, the role and structure of the security unit, the utility of compliance based approaches to security, and the inadequate use of threat intelligence in modern security strategies.


A H "ormander Mikhlin multiplier theory for free groups and amalgamated free products of von Neumann algebras. We establish a platform to transfer L p completely bounded maps on tensor products of von Neumann algebras to L p completely bounded maps on the corresponding amalgamated free products. As a consequence, we obtain a H "ormander Mikhlin multiplier theory for free products of groups. Let mathbb F infty be a free group on infinite generators g 1, g 2, cdots . Given d ge1 and a bounded symbol m on mathbb Z d satisfying the classical H "ormander Mikhlin condition, the linear map M m mathbb C mathbb F infty to mathbb C mathbb F infty defined by lambda(g) mapsto m(k 1, cdots, k d) lambda(g) for g g i 1 k 1 cdots g i n k n in mathbb F infty in reduced form (with k l 0 in m(k 1, cdots, k d) for l n ), extends to a complete bounded map on L p( widehat mathbb F infty) for all 1 p infty , where widehat mathbb F infty is the group von Neumann algebra of mathbb F infty . A similar result holds for any free product of discrete groups.


Quasi relativistic approach to analytical gradients of parity violating potentials. An analytic gradient approach for the computation of derivatives of parity violating (PV) potentials with respect to displacements of the nuclei in chiral molecules is described and implemented within a quasirelativistic mean field framework. Calculated PV potential gradients are utilised for estimating PV frequency splittings between enantiomers in rotational and vibrational spectra of four chiral polyhalomethanes, i.e. CHBrClF, CHClFI, CHBrFI and CHAtFI. Values calculated within the single mode approximation for the frequency shifts agree well with previously reported theoretical values. The influence of non separable anharmonic effects (multi mode effects) on the vibrational frequency shifts, which are readily accessible with the present analytic derivative approach, are estimated for the C F stretching fundamental of all four molecules and computed for each of the fundamentals in CHBrClF and CHAtFI. Multi mode effects are found to be significant, in particular for the C F stretching modes, being for some modes and cases of similar size as the single mode contribution.


Single and Multi objective Test Cases Prioritization for Self driving Cars in Virtual Environments. Testing with simulation environments helps to identify critical failing scenarios for self driving cars (SDCs). Simulation based tests are safer than in field operational tests and allow detecting software defects before deployment. However, these tests are very expensive and are too many to be run frequently within limited time constraints. In this paper, we investigate test case prioritization techniques to increase the ability to detect SDC regression faults with virtual tests earlier. Our approach, called SDC Prioritizer, prioritizes virtual tests for SDCs according to static features of the roads we designed to be used within the driving scenarios. These features can be collected without running the tests, which means that they do not require past execution results. We introduce two evolutionary approaches to prioritize the test cases using diversity metrics (black box heuristics) computed on these static features. These two approaches, called SO SDC Prioritizer and MO SDC Prioritizer, use single objective and multi objective genetic algorithms, respectively, to find trade offs between executing the less expensive tests and the most diverse test cases earlier. Our empirical study conducted in the SDC domain shows that MO SDC Prioritizer significantly improves the ability to detect safety critical failures at the same level of execution time compared to baselines random and greedy based test case orderings. Besides, our study indicates that multi objective meta heuristics outperform single objective approaches when prioritizing simulation based tests for SDCs. MO SDC Prioritizer prioritizes test cases with a large improvement in fault detection while its overhead (up to 0.45 of the test execution cost) is negligible.


Mean dimension of product spaces a fundamental formula. Mean dimension is a topological invariant of dynamical systems, which originates with Mikhail Gromov in 1999 and which was studied with deep applications around 2000 by Elon Lindenstrauss and Benjamin Weiss within the framework of amenable group actions. Let a countable discrete amenable group G act continuously on compact metrizable spaces X and Y . Consider the product action of G on the product space X times Y . The product inequality for mean dimension is well known mathrm mdim (X times Y,G) le mathrm mdim (X,G) mathrm mdim (Y,G) , while it was unknown for a long time if the product inequality could be an equality. In 2019, Masaki Tsukamoto constructed the first example of two different continuous actions of G on compact metrizable spaces X and Y , respectively, such that the product inequality becomes strict. However, there is still one longstanding problem which remains open in this direction, asking if there exists a continuous action of G on some compact metrizable space X such that mathrm mdim (X times X,G) 2 cdot mathrm mdim (X,G) . We solve this problem. Somewhat surprisingly, we prove, in contrast to (topological) dimension theory, a rather satisfactory theorem If an infinite (countable discrete) amenable group G acts continuously on a compact metrizable space X , then we have mathrm mdim (X n,G) n cdot mathrm mdim (X,G) , for any positive integer n . Our product formula for mean dimension, together with the example and inequality (stated previously), eventually allows mean dimension of product actions to be fully understood.


Thirty Minutes Before the Dawn Trinity. The Trinity test of July 16, 1945 marked the scientific apex of the Manhattan Project. Often recognized as the symbolic birth of the nuclear age, Trinity's multifaceted legacy remains just as captivating and complex as it did 75 years ago. This paper examines why the test was necessary from a technical standpoint, shows how Los Alamos scientists planned the event, and explores the physical and emotional aftermaths of Trinity. The author also uses rarely accessed original records to reconstruct the story of Trinity's health hazards, as seen through the eyes of radiation technicians and medical doctors as events unfolded. Trinity was conducted as the Potsdam Conference began, weeks after the collapse of Nazi Germany. It was considered necessary to let President Harry S. Truman know whether the United States possessed a nuclear capability ahead of his negotiations with Joseph Stalin, the Soviet premier. The author examines the competing priorities that drove the timetable for the test international politics, security and safety. Three weeks after Trinity, a gun assembled enriched uranium bomb called Little Boy was used against the Japanese city of Hiroshima. Three days later, Fat Man, a weaponized version of the imploding Trinity device, was dropped on Nagasaki. The author briefly examines these strikes and what impact they may have had on the Japanese surrender. The paper concludes by examining the legacy of the Trinity test 75 years into the age it helped usher in.


A note on homological systems. I give an elementary proof of the known fact that the category mathfrak F left( Delta right) of Delta filtered modules, associated to a given finite homological system left( Delta Omega , leq right) , is closed under direct summands.


Catastrophic Forgetting in Deep Graph Networks an Introductory Benchmark for Graph Classification. In this work, we study the phenomenon of catastrophic forgetting in the graph representation learning scenario. The primary objective of the analysis is to understand whether classical continual learning techniques for flat and sequential data have a tangible impact on performances when applied to graph data. To do so, we experiment with a structure agnostic model and a deep graph network in a robust and controlled environment on three different datasets. The benchmark is complemented by an investigation on the effect of structure preserving regularization techniques on catastrophic forgetting. We find that replay is the most effective strategy in so far, which also benefits the most from the use of regularization. Our findings suggest interesting future research at the intersection of the continual and graph representation learning fields. Finally, we provide researchers with a flexible software framework to reproduce our results and carry out further experiments.


Transformer Acceleration with Dynamic Sparse Attention. Transformers are the mainstream of NLP applications and are becoming increasingly popular in other domains such as Computer Vision. Despite the improvements in model quality, the enormous computation costs make Transformers difficult at deployment, especially when the sequence length is large in emerging applications. Processing attention mechanism as the essential component of Transformer is the bottleneck of execution due to the quadratic complexity. Prior art explores sparse patterns in attention to support long sequence modeling, but those pieces of work are on static or fixed patterns. We demonstrate that the sparse patterns are dynamic, depending on input sequences. Thus, we propose the Dynamic Sparse Attention (DSA) that can efficiently exploit the dynamic sparsity in the attention of Transformers. Compared with other methods, our approach can achieve better trade offs between accuracy and model complexity. Moving forward, we identify challenges and provide solutions to implement DSA on existing hardware (GPUs) and specialized hardware in order to achieve practical speedup and efficiency improvements for Transformer execution.


Out of Scope Intent Detection with Self Supervision and Discriminative Training. Out of scope intent detection is of practical importance in task oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on strong assumptions on data distribution such as mixture of Gaussians to make inference, resulting in either complex multi step training procedures or hand crafted rules such as confidence threshold selection for outlier detection. In this paper, we propose a simple yet effective method to train an out of scope intent classifier in a fully end to end manner by simulating the test scenario in training, which requires no assumption on data distribution and no additional post processing or threshold setting. Specifically, we construct a set of pseudo outliers in the training stage, by generating synthetic outliers using inliner features via self supervision and sampling out of scope sentences from easily available open domain datasets. The pseudo outliers are used to train a discriminative classifier that can be directly applied to and generalize well on the test task. We evaluate our method extensively on four benchmark dialogue datasets and observe significant improvements over state of the art approaches. Our code has been released at https github.com liam0949 DCLOOS.


On Demand Networking for Ubiquitous Connectivity and Network Resilience A Network in a Box Solution. Recently, the wireless community has initiated research on the sixth generation (6G) cellular network for the next decade. The 6G visions are still under development but are converging toward ubiquitous, sustainable, and automated digital society. A network in a box (NIB) is a portable and fully fledged networking solution that has many potentials to stimulate 6G visions, especially for ubiquitous and resilient network connectivity. In this article, we highlight how NIB features suit 6G use cases and requirements and how it can be used for 6G communications. In addition, we discuss the challenges of the potential enabling technologies of 6G that can reinforce the NIB performance.


Citizen centric optimal electric vehicle charging stations locations in a full city case of Malaga. This article presents the problem of locating electric vehicle (EV) charging stations in a city by defining the Electric Vehicle Charging Stations Locations (EV CSL) problem. The idea is to minimize the distance the citizens have to travel to charge their vehicles. EV CSL takes into account the maximum number of charging stations to install and the electric power requirements. Two metaheuristics are applied to address the relying optimization problem a genetic algorithm (GA) and a variable neighborhood search (VNS). The experimental analysis over a realistic scenario of Malaga city, Spain, shows that the metaheuristics are able to find competitive solutions which dramatically improve the actual installation of the stations in Malaga. GA provided statistically the best results.


Convolutional Neural Nets in Chemical Engineering Foundations, Computations, and Applications. In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and optimization, ii) demystifying underlying computations, and iii) identifying new types of applications. CNNs are powerful machine learning models that highlight features from grid data to make predictions (regression and classification). The grid data object can be represented as vectors (in 1D), matrices (in 2D), or tensors (in 3D or higher dimensions) and can incorporate multiple channels (thus providing high flexibility in the input data representation). CNNs highlight features from the grid data by performing convolution operations with different types of operators. The operators highlight different types of features (e.g., patterns, gradients, geometrical features) and are learned by using optimization techniques. In other words, CNNs seek to identify optimal operators that best map the input data to the output data. A common misconception is that CNNs are only capable of processing image or video data but their application scope is much wider specifically, datasets encountered in diverse applications can be expressed as grid data. Here, we show how to apply CNNs to new types of applications such as optimal control, flow cytometry, multivariate process monitoring, and molecular simulations.


Interpretable Goal Recognition in the Presence of Occluded Factors for Autonomous Vehicles. Recognising the goals or intentions of observed vehicles is a key step towards predicting the long term future behaviour of other agents in an autonomous driving scenario. When there are unseen obstacles or occluded vehicles in a scenario, goal recognition may be confounded by the effects of these unseen entities on the behaviour of observed vehicles. Existing prediction algorithms that assume rational behaviour with respect to inferred goals may fail to make accurate long horizon predictions because they ignore the possibility that the behaviour is influenced by such unseen entities. We introduce the Goal and Occluded Factor Inference (GOFI) algorithm which bases inference on inverse planning to jointly infer a probabilistic belief over goals and potential occluded factors. We then show how these beliefs can be integrated into Monte Carlo Tree Search (MCTS). We demonstrate that jointly inferring goals and occluded factors leads to more accurate beliefs with respect to the true world state and allows an agent to safely navigate several scenarios where other baselines take unsafe actions leading to collisions.


A Deeper Look into DeepCap. Human performance capture is a highly important computer vision problem with many applications in movie production and virtual augmented reality. Many previous performance capture approaches either required expensive multi view setups or did not recover dense space time coherent geometry with frame to frame correspondences. We propose a novel deep learning approach for monocular dense human performance capture. Our method is trained in a weakly supervised manner based on multi view supervision completely removing the need for training data with 3D ground truth annotations. The network architecture is based on two separate networks that disentangle the task into a pose estimation and a non rigid surface deformation step. Extensive qualitative and quantitative evaluations show that our approach outperforms the state of the art in terms of quality and robustness. This work is an extended version of DeepCap where we provide more detailed explanations, comparisons and results as well as applications.


Boosting Video Captioning with Dynamic Loss Network. Video captioning is one of the challenging problems at the intersection of vision and language, having many real life applications in video retrieval, video surveillance, assisting visually challenged people, Human machine interface, and many more. Recent deep learning based methods have shown promising results but are still on the lower side than other vision tasks (such as image classification, object detection). A significant drawback with existing video captioning methods is that they are optimized over cross entropy loss function, which is uncorrelated to the de facto evaluation metrics (BLEU, METEOR, CIDER, ROUGE). In other words, cross entropy is not a proper surrogate of the true loss function for video captioning. To mitigate this, methods like REINFORCE, Actor Critic, and Minimum Risk Training (MRT) have been applied but have limitations and are not very effective. This paper proposes an alternate solution by introducing a dynamic loss network (DLN), providing an additional feedback signal that reflects the evaluation metrics directly. Our solution proves to be more efficient than other solutions and can be easily adapted to similar tasks. Our results on Microsoft Research Video Description Corpus (MSVD) and MSR Video to Text (MSRVTT) datasets outperform previous methods.


Ultra Broadband Dispersion Manipulated Dielectric Metalenses by Nonlinear Dispersive Phase Compensation. Dispersion decomposes compound light into monochromatic components at different spatial locations, which needs to be eliminated in imaging but utilized in spectral detection. Metasurfaces provide a unique path to modulate the dispersion only by adjusting the structural parameters without changing the material as required for refractive elements. However, the common linear phase compensation does not conform to the dispersion characteristics of the meta unit limiting dispersion modulation in broader wavelength bands, which is desired for ultra broadband or multiband imaging. Here, we propose a nonlinear dispersive phase compensation method to design polarization insensitive achromatic metalenses from 400 nm to 1000 nm constructed with single layer high aspect ratio nanostructures. This band matches the response spectrum of a typical CMOS sensor for both visible and near infrared imaging applications without additional lens replacement. Moreover, the capability of the method in achieving arbitrary dispersion modulation is demonstrated for applications such as chromatography imaging and spectral detection.


A Discussion On the Validity of Manifold Learning. Dimensionality reduction (DR) and manifold learning (ManL) have been applied extensively in many machine learning tasks, including signal processing, speech recognition, and neuroinformatics. However, the understanding of whether DR and ManL models can generate valid learning results remains unclear. In this work, we investigate the validity of learning results of some widely used DR and ManL methods through the chart mapping function of a manifold. We identify a fundamental problem of these methods the mapping functions induced by these methods violate the basic settings of manifolds, and hence they are not learning manifold in the mathematical sense. To address this problem, we provide a provably correct algorithm called fixed points Laplacian mapping (FPLM), that has the geometric guarantee to find a valid manifold representation (up to a homeomorphism). Combining one additional condition(orientation preserving), we discuss a sufficient condition for an algorithm to be bijective for any d simplex decomposition result on a d manifold. However, constructing such a mapping function and its computational method satisfying these conditions is still an open problem in mathematics.


Branching in a Markovian Environment. A branching process in a Markovian environment consists of an irreducible Markov chain on a set of "environments" together with an offspring distribution for each environment. At each time step the chain transitions to a new random environment, and one individual is replaced by a random number of offspring whose distribution depends on the new environment. We give a first moment condition that determines whether this process survives forever with positive probability. On the event of survival we prove a law of large numbers and a central limit theorem for the population size. We also define a matrix valued generating function for which the extinction matrix (whose entries are the probability of extinction in state j given that the initial state is i) is a fixed point, and we prove that iterates of the generating function starting with the zero matrix converge to the extinction matrix.


Correlation Analysis between the Robustness of Sparse Neural Networks and their Random Hidden Structural Priors. Deep learning models have been shown to be vulnerable to adversarial attacks. This perception led to analyzing deep learning models not only from the perspective of their performance measures but also their robustness to certain types of adversarial attacks. We take another step forward in relating the architectural structure of neural networks from a graph theoretic perspective to their robustness. We aim to investigate any existing correlations between graph theoretic properties and the robustness of Sparse Neural Networks. Our hypothesis is, that graph theoretic properties as a prior of neural network structures are related to their robustness. To answer to this hypothesis, we designed an empirical study with neural network models obtained through random graphs used as sparse structural priors for the networks. We additionally investigated the evaluation of a randomly pruned fully connected network as a point of reference. We found that robustness measures are independent of initialization methods but show weak correlations with graph properties higher graph densities correlate with lower robustness, but higher average path lengths and average node eccentricities show negative correlations with robustness measures. We hope to motivate further empirical and analytical research to tightening an answer to our hypothesis.


Biermann Battery Magnetic Fields in ICF Capsules Total Magnetic Flux Generation. This paper focuses on the process of magnetic flux generation in ICF implosions. Hot spots are shown to be dominated by fields generated during stagnation, when the temperature and density gradients are largest. A scaling of hot spot magnetic flux is derived and compared with simulations, revealing that perturbations with both larger amplitudes and higher mode numbers generate more magnetic flux. The model allows for greater understanding of which target designs will be susceptible to MHD effects. For example, the model can be used to ascertain the time when most magnetic flux is generated. If generation is weighted more towards early times, then more high mode magnetic field loops will be present. A hot spot with no high mode perturbations at time of peak neutron production can still contain significant magnetic flux on those scales. By assuming that magnetic flux is deposited at the hot spot edge by Nernst advection, the model can be used to post process radiation hydrodynamics data to estimate magnetic field strengths and magnetizations.


Intrusive deconvolutional neural networks for enhancing PIC FLIP solutions. Traditional fluid flow predictions require large computational resources. Despite recent progress in parallel and GPU computing, the ability to run fluid flow predictions in real time is often infeasible. Recently developed machine learning approaches, which are trained on high fidelity data, perform unsatisfactorily outside the training set and remove the ability of utilising legacy codes after training. We propose a novel methodology that uses a deep learning approach that can be used within a low fidelity fluid flow solver to significantly increase the accuracy of the low fidelity simulations. The resulting solver enables accurate while reducing computational times up to 100 times. The deep neural network is trained on a combination of low and high fidelity data, and the resulting solver is referred to as a multi fidelity solver. The proposed methodology is demonstrated by means of enhancing a fluid flow simulator, known as PIC FLIP, which is a popular fluid flow simulator in the field of computer generated imagery.


Efficient recurrence for the enumeration of permutations with fixed pinnacle set. Initiated by Davis, Nelson, Petersen and Tenner (2018), the enumerative study of pinnacle sets of permutations has attracted a fair amount of attention recently. In this article, we provide a recurrence that can be used to compute efficiently the number mathfrak S n(P) of permutations of size n with a given pinnacle set P , with arithmetic complexity O(k 4 k log n) for P of size k . A symbolic expression can also be computed in this way for pinnacle sets of fixed size. A weighted sum q n(P) of mathfrak S n(P) proposed in Davis, Nelson, Petersen and Tenner (2018) seems to have a simple form, and a conjectural form is given recently by Flaque, Novelli and Thibon (2021 ). We settle the problem by providing and proving an alternative form of q n(P) , which has a strong combinatorial flavor. We also study admissible orderings of a given pinnacle set, first considered by Rusu (2020) and characterized by Rusu and Tenner (2021), and we give an efficient algorithm for their counting.


Coupling Power Laws Offers a Powerful Method for Problems such as Biodiversity and COVID 19 Fatality Predictions. Power laws have been found to describe a wide variety of natural (physical, biological, astronomic, meteorological, geological) and man made (social, financial, computational) phenomena over a wide range of magnitudes, although their underlying mechanisms are not always clear. In statistics, power law distribution is often found to fit data exceptionally well when the normal (Gaussian) distribution fails. Nevertheless, predicting power law phenomena is notoriously difficult because some of its idiosyncratic properties such as lack of well defined average value, and potentially unbounded variance. TPL (Taylor's power law), a power law first discovered to characterize the spatial and or temporal distribution of biological populations and recently extended to describe the spatiotemporal heterogeneities (distributions) of human microbiomes and other natural and artificial systems such as fitness distribution in computational (artificial) intelligence. The power law with exponential cutoff (PLEC) is a variant of power law function that tapers off the exponential growth of power law function ultimately and can be particularly useful for certain predictive problems such as biodiversity estimation and turning point prediction for COVID 19 infection fatality. Here, we propose coupling (integration) of TPL and PLEC to offer improved prediction quality of certain power law phenomena. The coupling takes advantages of variance prediction using TPL and the asymptote estimation using PLEC and delivers confidence interval for the asymptote. We demonstrate the integrated approach to the estimation of potential (dark) biodiversity and turning point of COVID 19 fatality. We expect this integrative approach should have wide applications given the duel relationship between power law and normal statistical distributions.


Regularity of stable solutions to reaction diffusion elliptic equations. The boundedness of stable solutions to semilinear (or reaction diffusion) elliptic PDEs has been studied since the 1970's. In dimensions 10 and higher, there exist stable energy solutions which are unbounded (or singular). This note describes, for non expert readers, a recent work in collaboration with Figalli, Ros Oton, and Serra, where we prove that stable solutions are smooth up to the optimal dimension 9. This answers to an open problem posed by Brezis in the mid nineties concerning the regularity of extremal solutions to Gelfand type problems. We also describe, briefly, a famous analogue question in differential geometry the regularity of stable minimal surfaces.


A Representation Learning Perspective on the Importance of Train Validation Splitting in Meta Learning. An effective approach in meta learning is to utilize multiple "train tasks" to learn a good initialization for model parameters that can help solve unseen "test tasks" with very few samples by fine tuning from this initialization. Although successful in practice, theoretical understanding of such methods is limited. This work studies an important aspect of these methods splitting the data from each task into train (support) and validation (query) sets during meta training. Inspired by recent work (Raghu et al., 2020), we view such meta learning methods through the lens of representation learning and argue that the train validation split encourages the learned representation to be low rank without compromising on expressivity, as opposed to the non splitting variant that encourages high rank representations. Since sample efficiency benefits from low rankness, the splitting strategy will require very few samples to solve unseen test tasks. We present theoretical results that formalize this idea for linear representation learning on a subspace meta learning instance, and experimentally verify this practical benefit of splitting in simulations and on standard meta learning benchmarks.


Conservative Discontinuous Cut Finite Element Methods. We develop a conservative cut finite element method for an elliptic coupled bulk interface problem. The method is based on a discontinuous Galerkin framework where stabilization is added in such a way that we retain conservation on macro elements containing one element with a large intersection with the domain and possibly a number of elements with small intersections. We derive error estimates and present confirming numerical results


An isoperimetric inequality for a biharmonic Steklov problem. For the biharmonic Steklov eigenvalue problem considered in this paper, we show that among all bounded Euclidean domains of class C 1 with fixed measure, the ball maximizes the first positive eigenvalue.


A deep dive into the accuracy of IP Geolocation Databases and its impact on online advertising. The quest for every time more personalized Internet experience relies on the enriched contextual information about each user. Online advertising also follows this approach. Among the context information that advertising stakeholders leverage, location information is certainly one of them. However, when this information is not directly available from the end users, advertising stakeholders infer it using geolocation databases, matching IP addresses to a position on earth. The accuracy of this approach has often been questioned in the past however, the reality check on an advertising DSP shows that this technique accounts for a large fraction of the served advertisements. In this paper, we revisit the work in the field, that is mostly from almost one decade ago, through the lenses of big data. More specifically, we, i) benchmark two commercial Internet geolocation databases, evaluate the quality of their information using a ground truth database of user positions containing more than 2 billion samples, ii) analyze the internals of these databases, devising a theoretical upper bound for the quality of the Internet geolocation approach, and iii) we run an empirical study that unveils the monetary impact of this technology by considering the costs associated with a real world ad impressions dataset. We show that when factoring cost in, IP geolocation technology may be, under certain campaign characteristics, a better alternative than GPS from an economic point of view, despite its inferior performance.


AffectGAN Affect Based Generative Art Driven by Semantics. This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state of the art deep learning methods for visual generation (through generative adversarial networks), semantic models from OpenAI, and the annotated dataset of the visual art encyclopedia WikiArt, our AffectGAN model is able to generate images based on specific or broad semantic prompts and intended affective outcomes. A small dataset of 32 images generated by AffectGAN is annotated by 50 participants in terms of the particular emotion they elicit, as well as their quality and novelty. Results show that for most instances the intended emotion used as a prompt for image generation matches the participants' responses. This small scale study brings forth a new vision towards blending affective computing with computational creativity, enabling generative systems with intentionality in terms of the emotions they wish their output to elicit.


Strong Field Ionization of Water Nuclear Dynamics Revealed by Varying the Pulse Duration. Polyatomic molecules in strong laser fields can undergo substantial nuclear motion within tens of femtoseconds. Ion imaging methods based on dissociation or Coulomb explosion therefore have difficulty faithfully recording the geometry dependence of the field ionization that initiates the dissociation process. Here we compare the strong field double ionization and subsequent dissociation of water (both H 2 O and D 2 O) in 10 fs and 40 fs 800 nm laser pulses. We find that 10 fs pulses turn off before substantial internuclear motion occurs, whereas rapid internuclear motion can take place during the double ionization process for 40 fs pulses. The short pulse measurements are consistent with a simple tunnel ionization picture, whose predictions help interpret the motion observed in the long pulse measurements.


SL2 tilting modules in the mixed case. Using the non semisimple Temperley Lieb calculus, we study the additive and monoidal structure of the category of tilting modules for mathrm SL 2 in the mixed case. This simultaneously generalizes the semisimple situation, the case of the complex quantum group at a root of unity, and the algebraic group case in positive characteristic. We describe character formulas and give a presentation of the category of tilting modules as an additive category via a quiver with relations. Turning to the monoidal structure, we describe fusion rules and obtain an explicit recursive description of the appropriate analog of Jones Wenzl projectors. We also discuss certain theta values, the tensor ideals, mixed Verlinde quotients and the non degeneracy of the braiding.


Public Release and Validation of SPEC CPU2017 PinPoints. Phase based statistical sampling methods such as SimPoints have proven to be effective at dramatically reducing the long time for architectural simulators to run large workloads such as SPEC CPU2017. However, generating and validating them is a long and tenuous process. While checkpoints of program phases, or "pinballs", of SPEC CPU2017 have been collected by other researchers and shared with the research community, they are outdated and produce errors when used with the latest versions of the Sniper architectural simulator. To facilitate our own research as well as contribute to the community, we collect and validate our own pinballs for the SPEC CPU2017 SPECspeed suite and release them to the public domain. In this work we document our methodology, the hardware and software details of the collection process, and our validation results. In terms of CPI, our pinballs have an average error rate of 12 when compared with the native whole program benchmark execution.


Bounding Box Free Instance Segmentation Using Semi Supervised Learning for Generating a City Scale Vehicle Dataset. Vehicle classification is a hot computer vision topic, with studies ranging from ground view up to top view imagery. In remote sensing, the usage of top view images allows for understanding city patterns, vehicle concentration, traffic management, and others. However, there are some difficulties when aiming for pixel wise classification (a) most vehicle classification studies use object detection methods, and most publicly available datasets are designed for this task, (b) creating instance segmentation datasets is laborious, and (c) traditional instance segmentation methods underperform on this task since the objects are small. Thus, the present research objectives are (1) propose a novel semi supervised iterative learning approach using GIS software, (2) propose a box free instance segmentation approach, and (3) provide a city scale vehicle dataset. The iterative learning procedure considered (1) label a small number of vehicles, (2) train on those samples, (3) use the model to classify the entire image, (4) convert the image prediction into a polygon shapefile, (5) correct some areas with errors and include them in the training data, and (6) repeat until results are satisfactory. To separate instances, we considered vehicle interior and vehicle borders, and the DL model was the U net with the Efficient net B7 backbone. When removing the borders, the vehicle interior becomes isolated, allowing for unique object identification. To recover the deleted 1 pixel borders, we proposed a simple method to expand each prediction. The results show better pixel wise metrics when compared to the Mask RCNN (82 against 67 in IoU). On per object analysis, the overall accuracy, precision, and recall were greater than 90 . This pipeline applies to any remote sensing target, being very efficient for segmentation and generating datasets.


Friendly bisections of random graphs. Resolving a conjecture of F "uredi from 1988, we prove that with high probability, the random graph G(n,1 2) admits a friendly bisection of its vertex set, i.e., a partition of its vertex set into two parts whose sizes differ by at most one in which n o(n) vertices have at least as many neighbours in their own part as across. The engine of our proof is a new method to study stochastic processes driven by degree information in random graphs this involves combining enumeration techniques with an abstract second moment argument.


Exact order of extreme L p discrepancy of infinite sequences in arbitrary dimension. We study the extreme L p discrepancy of infinite sequences in the d dimensional unit cube, which uses arbitrary sub intervals of the unit cube as test sets. This is in contrast to the classical star L p discrepancy, which uses exclusively intervals that are anchored in the origin as test sets. We show that for any dimension d and any p 1 the extreme L p discrepancy of every infinite sequence in 0,1) d is at least of order of magnitude ( log N) d 2 , where N is the number of considered initial terms of the sequence. For p in (1, infty) this order of magnitude is best possible.


Improved Training of Sparse Coding Variational Autoencoder via Weight Normalization. Learning a generative model of visual information with sparse and compositional features has been a challenge for both theoretical neuroscience and machine learning communities. Sparse coding models have achieved great success in explaining the receptive fields of mammalian primary visual cortex with sparsely activated latent representation. In this paper, we focus on a recently proposed model, sparse coding variational autoencoder (SVAE) (Barello et al., 2018), and show that the end to end training scheme of SVAE leads to a large group of decoding filters not fully optimized with noise like receptive fields. We propose a few heuristics to improve the training of SVAE and show that a unit L 2 norm constraint on the decoder is critical to produce sparse coding filters. Such normalization can be considered as local lateral inhibition in the cortex. We verify this claim empirically on both natural image patches and MNIST dataset and show that projection of the filters onto unit norm drastically increases the number of active filters. Our results highlight the importance of weight normalization for learning sparse representation from data and suggest a new way of reducing the number of inactive latent components in VAE learning.


Lower bound on the Voronoi diagram of lines in mathbb R d . This note gives a lower bound of Omega(n lceil 2d 3 rceil ) on the maximal complexity of the Euclidean Voronoi diagram of n non intersecting lines in mathbb R d for d 2 .


UNIQORN Unified Question Answering over RDF Knowledge Graphs and Natural Language Text. Question answering over knowledge graphs and other RDF data has been greatly advanced, with a number of good systems providing crisp answers for natural language questions or telegraphic queries. Some of these systems incorporate textual sources as additional evidence for the answering process, but cannot compute answers that are present in text alone. Conversely, systems from the IR and NLP communities have addressed QA over text, but such systems barely utilize semantic data and knowledge. This paper presents the first QA system that can seamlessly operate over RDF datasets and text corpora, or both together, in a unified framework. Our method, called UNIQORN, builds a context graph on the fly, by retrieving question relevant evidences from the RDF data and or a text corpus, using fine tuned BERT models. The resulting graph is typically rich but highly noisy. UNIQORN copes with this input by a graph algorithm for Group Steiner Trees, that identifies the best answer candidates in the context graph. Experimental results on several benchmarks of complex questions with multiple entities and relations, show that UNIQORN significantly outperforms state of the art methods for QA over heterogeneous sources. The graph based methodology provides user interpretable evidence for the complete answering process.


Tight Computationally Efficient Approximation of Matrix Norms with Applications. We address the problems of computing operator norms of matrices induced by given norms on the argument and the image space. It is known that aside of a fistful of "solvable cases," most notably, the case when both given norms are Euclidean, computing operator norm of a matrix is NP hard. We specify rather general families of norms on the argument and the images space ("ellitopic" and "co ellitopic," respectively) allowing for reasonably tight computationally efficient upper bounding of the associated operator norms. We extend these results to bounding "robust operator norm of uncertain matrix with box uncertainty," that is, the maximum of operator norms of matrices representable as a linear combination, with coefficients of magnitude leq1 , of a collection of given matrices. Finally, we consider some applications of norm bounding, in particular, (1) computationally efficient synthesis of affine non anticipative finite horizon control of discrete time linear dynamical systems under bounds on the peak to peak gains, (2) signal recovery with uncertainties in sensing matrix, and (3) identification of parameters of time invariant discrete time linear dynamical systems via noisy observations of states and inputs on a given time horizon, in the case of "uncertain but bounded" noise varying in a box.


Expressiveness of Extended Bounded Response LTL. Extended Bounded Response LTL with Past (LTLEBR P) is a safety fragment of Linear Temporal Logic with Past (LTL P) that has been recently introduced in the context of reactive synthesis. The strength of LTLEBR P is a fully symbolic compilation of formulas into symbolic deterministic automata. Its syntax is organized in four levels. The first three levels feature (a particular combination of) future temporal modalities, the last one admits only past temporal operators. At the base of such a structuring there are algorithmic motivations each level corresponds to a step of the algorithm for the automaton construction. The complex syntax of LTLEBR P made it difficult to precisely characterize its expressive power, and to compare it with other LTL P safety fragments. In this paper, we first prove that LTLEBR P is expressively complete with respect to the safety fragment of LTL P, that is, any safety language definable in LTL P can be formalized in LTLEBR P, and vice versa. From this, it follows that LTLEBR P and Safety LTL are expressively equivalent. Then, we show that past modalities play an essential role in LTLEBR P we prove that the future fragment of LTLEBR P is strictly less expressive than full LTLEBR P.


What can we learn from universal Turing machines?. In the present paper, we construct what we call a pedagogical universal Turing machine. We try to understand which comparisons with biological phenomena can be deduced from its encoding and from its working.


DeltaCharger Charging Robot with Inverted Delta Mechanism and CNN driven High Fidelity Tactile Perception for Precise 3D Positioning. DeltaCharger is a novel charging robot with an Inverted Delta structure for 3D positioning of electrodes to achieve robust and safe transferring energy between two mobile robots. The embedded high fidelity tactile sensors allow to estimate the angular, vertical and horizontal misalignments between electrodes on the charger mechanism and electrodes on the target robot using pressure data on the contact surfaces. This is crucial for preventing a short circuit. In this paper, the mechanism of the developed prototype and evaluation study of different machine learning models for misalignment prediction are presented. The experimental results showed that the proposed system can measure the angle, vertical and horizontal values of misalignment from pressure data with an accuracy of 95.46 , 98.2 , and 86.9 , respectively, using a Convolutional Neural Network (CNN). DeltaCharger can potentially bring a new level of charging systems and improve the prevalence of mobile autonomous robots.


Multiscale Finite Element Methods for an Elliptic Optimal Control Problem with Rough Coefficients. We investigate multiscale finite element methods for an elliptic distributed optimal control problem with rough coefficients. They are based on the (local) orthogonal decomposition methodology of M aa lqvist and Peterseim.


A Survey of Open Source User Activity Traces with Applications to User Mobility Characterization and Modeling. The current state of the art in user mobility research has extensively relied on open source mobility traces captured from pedestrian and vehicular activity through a variety of communication technologies as users engage in a wide range of applications, including connected healthcare, localization, social media, e commerce, etc. Most of these traces are feature rich and diverse, not only in the information they provide, but also in how they can be used and leveraged. This diversity poses two main challenges for researchers and practitioners who wish to make use of available mobility datasets. First, it is quite difficult to get a bird's eye view of the available traces without spending considerable time looking them up. Second, once they have found the traces, they still need to figure out whether the traces are adequate to their needs. The purpose of this survey is three fold. It proposes a taxonomy to classify open source mobility traces including their mobility mode, data source and collection technology. It then uses the proposed taxonomy to classify existing open source mobility traces and finally, highlights three case studies using popular publicly available datasets to showcase how our taxonomy can tease out feature sets in traces to help determine their applicability to specific use cases.


Competitive MA DRL for Transmit Power Pool Design in Semi Grant Free NOMA Systems. In this paper, we exploit the capability of multi agent deep reinforcement learning (MA DRL) technique to generate a transmit power pool (PP) for Internet of things (IoT) networks with semi grant free non orthogonal multiple access (SGF NOMA). The PP is mapped with each resource block (RB) to achieve distributed transmit power control (DPC). We first formulate the resource (sub channel and transmit power) selection problem as stochastic Markov game, and then solve it using two competitive MA DRL algorithms, namely double deep Q network (DDQN) and Dueling DDQN. Each GF user as an agent tries to find out the optimal transmit power level and RB to form the desired PP. With the aid of dueling processes, the learning process can be enhanced by evaluating the valuable state without considering the effect of each action at each state. Therefore, DDQN is designed for communication scenarios with a small size action state space, while Dueling DDQN is for a large size case. Our results show that the proposed MA Dueling DDQN based SGF NOMA with DPC outperforms the SGF NOMA system with the fixed power control mechanism and networks with pure GF protocols with 17.5 and 22.2 gain in terms of the system throughput, respectively. Moreover, to decrease the training time, we eliminate invalid actions (high transmit power levels) to reduce the action space. We show that our proposed algorithm is computationally scalable to massive IoT networks. Finally, to control the interference and guarantee the quality of service requirements of grant based users, we find the optimal number of GF users for each sub channel.


The Cardan grille approach to the Voynich MS taken to the next level. The Voynich MS is an illustrated 15th century manuscript, whose text is written in an unknown alphabet, which has not been translated until today. In 2004 Gordon Rugg published a paper in which he proposed that this text is likely to be meaningless, and could have been composed by an alternative application of a so called Cardan Grille, namely by moving a piece of cardboard with holes over a large table of word fragments, and writing down the words that thus appear. This paper caused considerable discussion in the circles of people interested in the Voynich MS text, but it has not found many followers, even until today. The present paper takes a closer look at the mechanics of this method. Based on this, a more generic method is proposed, which is considerably simpler, both to set up and to execute. It is shown that the unusual word length distribution of the Voynich MS, which is very close to binomial, could be a consequence of the application of such a method. Furthermore, it is argued that this method could not only be used to create meaningless text, but also to encode meaningful text. A first high level analysis looks at whether such a method could indeed have been applied to create the Voynich MS text, but this is certainly far from conclusive. The main aim of this paper is to inspire further research of the Voynich MS text into a new direction that has not yet been explored in great detail.


Size adjustable Ring shape Photoacoustic Tomography System. Photoacoustic tomography (PAT) combines the advantages of the spectroscopic optical absorption contrast and acoustic resolution with deep penetration, and becomes an important novel biomedical imaging technology for scientific research and clinical diagnosis. In this paper, an imaging size adjustable PAT system is proposed for clinical applications, which can adapt for different size imaging targets. Comparing with the conventional PAT system setup which with a fixed radius ring shape ultrasound transducer (UT) array, the proposed system, which is based on sectorial ultrasound transducer array (SUTA), is more flexible for different size targets imaging. There are 32 elements for each SUTA, and four SUTAs form a 128 channel UT array for photoacoustic wave detection. The four SUTAs are controlled by four stepper motors, and change the SUTAs distribute positon that adapt for imaging applications. The radius of the proposed system imaging region of interest (ROI) can be adjusted from 50 mm to 90 mm, which is much more flexible than the conventional full ring UT array PAT system. The simulation results generated by the MATLAB k wave toolbox very well demonstrate the feasibility of the proposed system. To further validate the proposed system for size adjustable imaging, a vascular mimicking phantom and ex vivo pork breast with indocyanine green (ICG) injected are imaged to prove its feasibility for clinical applications.


Wakefields in Hollow Channel of Magnetized Plasma. Wakefield particle acceleration in hollow plasma channels is under extensive study nowadays. Here we consider an externally magnetized plasma layer (external magnetic field of arbitrary magnitude is along the structure axis) and investigate wakefields generated by a point charge passing along the layer axis.


Automated generation of 0D and 1D reduced order models of patient specific blood flow. Three dimensional (3D) cardiovascular fluid dynamics simulations typically require hours to days of computing time on a high performance computer. One dimensional (1D) and lumped parameter zero dimensional (0D) models show great promise for accurately predicting blood flow and pressure with only a fraction of the cost. They can accelerate uncertainty quantification, optimization, and design parameterization studies. Previously, these models needed to be created laboriously by hand, and this limited assessment of their approximation accuracy to very few models in prior studies. This work proposes a fully automated and openly available framework to generate and simulate 0D and 1D models from 3D patient specific geometries. Our only input is the 3D geometry we do not use any prior knowledge from 3D simulations. All computational tools presented in this work are implemented in the open source software platform SimVascular. We demonstrate the reduced order approximation quality against full 3D solutions in a comprehensive comparison with N 73 publicly available models from various anatomies, vessel types, and disease conditions. Relative average approximation errors of flows and pressures typically ranged from 1 to 10 for both 0D and 1D models, at the caps and inside the vessel branches. Though they have minimally higher approximation errors than 1D, we recommend using 0D models due to their robustness and computational efficiency. Automatically generated reduced order models can significantly speed up model development and shift the computational load from high performance to personal computers.


Counting H free orientations of graphs. In 1974, Erd H o s posed the following problem. Given an oriented graph H , determine or estimate the maximum possible number of H free orientations of an n vertex graph. When H is a tournament, the answer was determined precisely for sufficiently large n by Alon and Yuster. In general, when the underlying undirected graph of H contains a cycle, one can obtain accurate bounds by combining an observation of Kozma and Moran with celebrated results on the number of F free graphs. As the main contribution of the paper, we resolve all remaining cases in an asymptotic sense, thereby giving a rather complete answer to Erd H o s's question. Moreover, we determine the answer exactly when H is an odd cycle and n is sufficiently large, answering a question of Ara 'ujo, Botler and Mota.


On the Prunability of Attention Heads in Multilingual BERT. Large multilingual models, such as mBERT, have shown promise in crosslingual transfer. In this work, we employ pruning to quantify the robustness and interpret layer wise importance of mBERT. On four GLUE tasks, the relative drops in accuracy due to pruning have almost identical results on mBERT and BERT suggesting that the reduced attention capacity of the multilingual models does not affect robustness to pruning. For the crosslingual task XNLI, we report higher drops in accuracy with pruning indicating lower robustness in crosslingual transfer. Also, the importance of the encoder layers sensitively depends on the language family and the pre training corpus size. The top layers, which are relatively more influenced by fine tuning, encode important information for languages similar to English (SVO) while the bottom layers, which are relatively less influenced by fine tuning, are particularly important for agglutinative and low resource languages.


New constructions of MDS self dual and self orthogonal codes via GRS codes. Recently, the construction of new MDS Euclidean self dual codes has been widely investigated. In this paper, for square q, we utilize generalized Reed Solomon (GRS) codes and their extended codes to provide four generic families of q ary MDS Euclidean self dual codes. In particular, for large square q, our constructions take up a proportion of generally more than 34 in all the possible lengths of q ary MDS Euclidean self dual codes, which is larger than the previous results. Moreover, two new families of MDS Euclidean self orthogonal codes and two new families of MDS Euclidean almost self dual codes are given similarly.


Exponential and strong ergodicity for one dimensional symmetric stable jump diffusions. We obtain explicit criteria for both exponential ergodicity and strong ergodicity for one dimensional time changed symmetric stable processes with alpha in(1,2) . Explicit lower bounds for ergodic convergence rates are given.


A Preamble Based MAC Mechanism in Ad Hoc Network. In this paper, we propose a preamble based medium access control (P MAC) mechanism in Ad Hoc network. Different from traditional carrier sense multiple access (CSMA) in Ad Hoc network, P MAC uses much shorter preamble to establish the network. First, we propose the P MAC mechanism to shorten the time of establishing the Ad Hoc network. Based on the P MAC, we propose a more efficient way to maintain the network. Next, focusing on the power line communication (PLC) network which is a kind of Ad Hoc network, we propose a frequency division power line communication (FD PLC) network architecture to obtain the best communication frequency. To obtain the best frequency, i.e., highest SNR, we design the frequency sweeping mechanism which can determine the frequency of uplink and downlink communication before the transmitter and receiver communicate. Due to the large scale networks in industry, P MAC can be exploited to speed up the establishment of the Ad Hoc PLC network. Finally, we compare our mechanism with CSMA. Numerical results indicate that our strategy greatly shortens the time of establishing the Ad Hoc network.


The complexity of quantified constraints collapsibility, switchability and the algebraic formulation. Let A be an idempotent algebra on a finite domain. By mediating between results of Chen and Zhuk, we argue that if A satisfies the polynomially generated powers property (PGP) and B is a constraint language invariant under A (that is, in Inv(A)), then QCSP(B) is in NP. In doing this we study the special forms of PGP, switchability and collapsibility, in detail, both algebraically and logically, addressing various questions such as decidability on the way. We then prove a complexity theoretic converse in the case of infinite constraint languages encoded in propositional logic, that if Inv(A) satisfies the exponentially generated powers property (EGP), then QCSP(Inv(A)) is co NP hard. Since Zhuk proved that only PGP and EGP are possible, we derive a full dichotomy for the QCSP, justifying what we term the Revised Chen Conjecture. This result becomes more significant now the original Chen Conjecture is known to be false. Switchability was introduced by Chen as a generalisation of the already known collapsibility. For three element domain algebras A that are switchable and omit a G set, we prove that, for every finite subset D of Inv(A), Pol(D) is collapsible. The significance of this is that, for QCSP on finite structures (over a three element domain), all QCSP tractability (in P) explained by switchability is already explained by collapsibility.


Multi Scale Feature Aggregation by Cross Scale Pixel to Region Relation Operation for Semantic Segmentation. Exploiting multi scale features has shown great potential in tackling semantic segmentation problems. The aggregation is commonly done with sum or concatenation (concat) followed by convolutional (conv) layers. However, it fully passes down the high level context to the following hierarchy without considering their interrelation. In this work, we aim to enable the low level feature to aggregate the complementary context from adjacent high level feature maps by a cross scale pixel to region relation operation. We leverage cross scale context propagation to make the long range dependency capturable even by the high resolution low level features. To this end, we employ an efficient feature pyramid network to obtain multi scale features. We propose a Relational Semantics Extractor (RSE) and Relational Semantics Propagator (RSP) for context extraction and propagation respectively. Then we stack several RSP into an RSP head to achieve the progressive top down distribution of the context. Experiment results on two challenging datasets Cityscapes and COCO demonstrate that the RSP head performs competitively on both semantic segmentation and panoptic segmentation with high efficiency. It outperforms DeeplabV3 1 by 0.7 with 75 fewer FLOPs (multiply adds) in the semantic segmentation task.


Distilling Relation Embeddings from Pre trained Language Models. Pre trained language models have been found to capture a surprisingly rich amount of lexical knowledge, ranging from commonsense properties of everyday concepts to detailed factual knowledge about named entities. Among others, this makes it possible to distill high quality word vectors from pre trained language models. However, it is currently unclear to what extent it is possible to distill relation embeddings, i.e. vectors that characterize the relationship between two words. Such relation embeddings are appealing because they can, in principle, encode relational knowledge in a more fine grained way than is possible with knowledge graphs. To obtain relation embeddings from a pre trained language model, we encode word pairs using a (manually or automatically generated) prompt, and we fine tune the language model such that relationally similar word pairs yield similar output vectors. We find that the resulting relation embeddings are highly competitive on analogy (unsupervised) and relation classification (supervised) benchmarks, even without any task specific fine tuning. Source code to reproduce our experimental results and the model checkpoints are available in the following repository https github.com asahi417 relbert


Alternating knots do not admit cosmetic crossings. By examining the homology groups of a 4 manifold associated to an integral surgery on a knot K in a rational homology 3 sphere Y yielding a rational homology 3 sphere Y with surgery dual knot K , we show that the subgroups generated by K and K in H 1(Y) and H 1(Y ) , respectively, have co prime orders. We obtain an immediate corollary that, in conjunction with an argument of Lidman and Moore, proves the cosmetic crossing conjecture for knots whose branched double covers are Heegaard Floer L spaces.


Generalized Ornstein Uhlenbeck Semigroups in weighted L p spaces on Riemannian Manifolds. Let mathcal E be a Hermitian vector bundle over a Riemannian manifold M with metric g , let nabla be a metric covariant derivative on mathcal E . We study the generalized Ornstein Uhlenbeck differential expression P nabla nabla dagger nabla u nabla (d phi) sharp u nabla X u Vu , where nabla dagger is the formal adjoint of nabla , (d phi) sharp is the vector field corresponding to d phi via g , X is a smooth real vector field on M , and V is a self adjoint locally integrable section of the bundle textrm End mathcal E . We show that (the negative of) the maximal realization H p, max of P nabla generates an analytic quasi contractive semigroup in L p mu ( mathcal E ) , 1 p infty , where d mu e phi d nu g , with nu g being the volume measure. Additionally, we describe a Feynman Kac representation for the semigroup generated by H p, max . For the Ornstein Uhlenbeck differential expression acting on functions, that is, P d Delta u (d phi) sharp u Xu Vu , where Delta is the (non negative) scalar Laplacian on M and V is a locally integrable real valued function, we consider another way of realizing P d as an operator in L p mu (M) and, by imposing certain geometric conditions on M , we prove another semigroup generation result.


Winning the NIST Contest A scalable and general approach to differentially private synthetic data. We propose a general approach for differentially private synthetic data generation, that consists of three steps (1) select a collection of low dimensional marginals, (2) measure those marginals with a noise addition mechanism, and (3) generate synthetic data that preserves the measured marginals well. Central to this approach is Private PGM, a post processing method that is used to estimate a high dimensional data distribution from noisy measurements of its marginals. We present two mechanisms, NIST MST and MST, that are instances of this general approach. NIST MST was the winning mechanism in the 2018 NIST differential privacy synthetic data competition, and MST is a new mechanism that can work in more general settings, while still performing comparably to NIST MST. We believe our general approach should be of broad interest, and can be adopted in future mechanisms for synthetic data generation.


Axiomatizing AECs and applications. For any abstract elementary class (AEC) bf K with lambda LS( bf K ) , the following holds 1. K has an axiomatization in L (2 lambda) , lambda , allowing game quantification. If bf K has arbitrarily large models, the lambda amalgamation property and is categorical both in lambda and lambda , then it has an axiomatization in L lambda , lambda with game quantification. These extend Kueker's result which assumes finite character and lambda aleph 0 . 2. If K is universal and categorical in lambda , then it is axiomatizable in L lambda , lambda . 3. Shelah's celebrated presentation theorem asserts that for any AEC bf K there is a first order theory in an expansion of L( bf K ) , and a set Gamma of 2 lambda many T types such that K PC(T, Gamma,L( bf K )) . We provide a better bound on Gamma in terms of I 2( lambda, bf K ) . 4. We present additional applications which extend, simplify and generalize results of Shelah and Shelah Vasey. Some of our main results generalize to mu AECs.


COTORRA COntext aware Testbed fOR Robotic Applications. Edge Fog computing have received considerable attention as promising candidates for the evolution of robotic systems. In this letter, we propose COTORRA, an Edge Fog driven robotic testbed that combines context information with robot sensor data to validate innovative concepts for robotic systems prior to being applied in a production environment. In lab university, we established COTORRA as an easy applicable and modular testbed on top of heterogeneous network infrastructure. COTORRA is open for pluggable robotic applications. To verify its feasibility and assess its performance, we ran set of experiments that show how autonomous navigation applications can achieve target latencies bellow 15ms or perform an inter domain (DLT) federation within 19 seconds.


NN LUT Neural Approximation of Non Linear Operations for Efficient Transformer Inference. Non linear operations such as GELU, Layer normalization, and Softmax are essential yet costly building blocks of Transformer models. Several prior works simplified these operations with look up tables or integer computations, but such approximations suffer inferior accuracy or considerable hardware cost with long latency. This paper proposes an accurate and hardware friendly approximation framework for efficient Transformer inference. Our framework employs a simple neural network as a universal approximator with its structure equivalently transformed into a LUT. The proposed framework called NN LUT can accurately replace all the non linear operations in popular BERT models with significant reductions in area, power consumption, and latency.


Rethinking the Variational Interpretation of Nesterov's Accelerated Method. The continuous time model of Nesterov's momentum provides a thought provoking perspective for understanding the nature of the acceleration phenomenon in convex optimization. One of the main ideas in this line of research comes from the field of classical mechanics and proposes to link Nesterov's trajectory to the solution of a set of Euler Lagrange equations relative to the so called Bregman Lagrangian. In the last years, this approach led to the discovery of many new (stochastic) accelerated algorithms and provided a solid theoretical foundation for the design of structure preserving accelerated methods. In this work, we revisit this idea and provide an in depth analysis of the action relative to the Bregman Lagrangian from the point of view of calculus of variations. Our main finding is that, while Nesterov's method is a stationary point for the action, it is often not a minimizer but instead a saddle point for this functional in the space of differentiable curves. This finding challenges the main intuition behind the variational interpretation of Nesterov's method and provides additional insights into the intriguing geometry of accelerated paths.


Repeated Games, Optimal Channel Capture, and Open Problems for Slotted Multiple Access. This paper revisits a classical problem of slotted multiple access with success, idle, and collision events on each slot. First, results of a 2 user multiple access game are reported. The game was conducted at the University of Southern California over multiple semesters and involved competitions between student designed algorithms. An algorithm called 4 State was a consistent winner. This algorithm is analyzed and shown to have an optimal expected score when competing against an independent version of itself. The structure of 4 State motivates exploration of the open question of how to minimize the expected time to capture the channel for a n user situation. It is assumed that the system delivers perfect feedback on the number of users who transmitted at the end of each slot. An efficient algorithm is developed and conjectured to have an optimal expected capture time for all positive integers n . Optimality is proven in the special cases n in 1, 2, 3, 4, 6 using a novel analytical technique that introduces virtual users with enhanced capabilities.


Text Mining Drug Chemical Protein Interactions using an Ensemble of BERT and T5 Based Models. In Track 1 of the BioCreative VII Challenge participants are asked to identify interactions between drugs chemicals and proteins. In context named entity annotations for each drug chemical and protein are provided and one of fourteen different interactions must be automatically predicted. For this relation extraction task, we attempt both a BERT based sentence classification approach, and a more novel text to text approach using a T5 model. We find that larger BERT based models perform better in general, with our BioMegatron based model achieving the highest scores across all metrics, achieving 0.74 F1 score. Though our novel T5 text to text method did not perform as well as most of our BERT based models, it outperformed those trained on similar data, showing promising results, achieving 0.65 F1 score. We believe a text to text approach to relation extraction has some competitive advantages and there is a lot of room for research advancement.


Dynamic Distribution of Edge Intelligence at the Node Level for Internet of Things. In this paper, dynamic deployment of Convolutional Neural Network (CNN) architecture is proposed utilizing only IoT level devices. By partitioning and pipelining the CNN, it horizontally distributes the computation load among resource constrained devices (called horizontal collaboration), which in turn increases the throughput. Through partitioning, we can decrease the computation and energy consumption on individual IoT devices and increase the throughput without sacrificing accuracy. Also, by processing the data at the generation point, data privacy can be achieved. The results show that throughput can be increased by 1.55x to 1.75x for sharing the CNN into two and three resource constrained devices, respectively.


Non intrusive reduced order modeling of parametrized PDEs by kernel POD and neural networks. We propose a nonlinear reduced basis method for the efficient approximation of parametrized partial differential equations (PDEs), exploiting kernel proper orthogonal decomposition (KPOD) for the generation of a reduced order space and neural networks for the evaluation of the reduced order approximation. In particular, we use KPOD in place of the more classical POD, on a set of high fidelity solutions of the problem at hand to extract a reduced basis. This method provides a more accurate approximation of the snapshots' set featuring a lower dimension, while maintaining the same efficiency as POD. A neural network (NN) is then used to find the coefficients of the reduced basis by following a supervised learning paradigm and shown to be effective in learning the map between the time parameter values and the projection of the high fidelity snapshots onto the reduced space. In this NN, both the number of hidden layers and the number of neurons vary according to the intrinsic dimension of the differential problem at hand and the size of the reduced space. This adaptively built NN attains good performances in both the learning and the testing phases. Our approach is then tested on two benchmark problems, a one dimensional wave equation and a two dimensional nonlinear lid driven cavity problem. We finally compare the proposed KPOD NN technique with a POD NN strategy, showing that KPOD allows a reduction of the number of modes that must be retained to reach a given accuracy in the reduced basis approximation. For this reason, the NN built to find the coefficients of the KPOD expansion is smaller, easier and less computationally demanding to train than the one used in the POD NN strategy.


Column expansion identities and quadratic spanning forest identities. Column expansion identities of determinants give a source of quadratic spanning forest polynomial identities and allow us determine the dimension of the space of certain quadratic spanning forest identities, settling a conjecture of one of us with Vlasev from 2012. Furthermore, we give a combinatorial interpretation of such spanning forest identities via an edge swapping argument previously developed by one of us in 2019. Quadratic spanning forest polynomials identities are of particular interest because they are useful for quantum field theory calculations in four dimensions.