MST Masked Self Supervised Transformer for Visual Representation. Transformer has been widely used for self supervised pre training in Natural Language Processing (NLP) and achieved great success. However, it has not been fully explored in visual self supervised learning. Meanwhile, previous methods only consider the high level feature and learning representation from a global perspective, which may fail to transfer to the downstream dense prediction tasks focusing on local features. In this paper, we present a novel Masked Self supervised Transformer approach named MST, which can explicitly capture the local context of an image while preserving the global semantic information. Specifically, inspired by the Masked Language Modeling (MLM) in NLP, we propose a masked token strategy based on the multi head self attention map, which dynamically masks some tokens of local patches without damaging the crucial structure for self supervised learning. More importantly, the masked tokens together with the remaining tokens are further recovered by a global image decoder, which preserves the spatial information of the image and is more friendly to the downstream dense prediction tasks. The experiments on multiple datasets demonstrate the effectiveness and generality of the proposed method. For instance, MST achieves Top 1 accuracy of 76.9 with DeiT S only using 300 epoch pre training by linear evaluation, which outperforms supervised methods with the same epoch by 0.4 and its comparable variant DINO by 1.0 . For dense prediction tasks, MST also achieves 42.7 mAP on MS COCO object detection and 74.04 mIoU on Cityscapes segmentation only with 100 epoch pre training.


Real Time Multi View 3D Human Pose Estimation using Semantic Feedback to Smart Edge Sensors. We present a novel method for estimation of 3D human poses from a multi camera setup, employing distributed smart edge sensors coupled with a backend through a semantic feedback loop. 2D joint detection for each camera view is performed locally on a dedicated embedded inference processor. Only the semantic skeleton representation is transmitted over the network and raw images remain on the sensor board. 3D poses are recovered from 2D joints on a central backend, based on triangulation and a body model which incorporates prior knowledge of the human skeleton. A feedback channel from backend to individual sensors is implemented on a semantic level. The allocentric 3D pose is backprojected into the sensor views where it is fused with 2D joint detections. The local semantic model on each sensor can thus be improved by incorporating global context information. The whole pipeline is capable of real time operation. We evaluate our method on three public datasets, where we achieve state of the art results and show the benefits of our feedback architecture, as well as in our own setup for multi person experiments. Using the feedback signal improves the 2D joint detections and in turn the estimated 3D poses.


Online Advertising Revenue Forecasting An Interpretable Deep Learning Approach. Online advertising revenues account for an increasing share of publishers' revenue streams, especially for small and medium sized publishers who depend on the advertisement networks of tech companies such as Google and Facebook. Thus publishers may benefit significantly from accurate online advertising revenue forecasts to better manage their website monetization strategies. However, publishers who only have access to their own revenue data lack a holistic view of the total ad market of publishers, which in turn limits their ability to generate insights into their own future online advertising revenues. To address this business issue, we leverage a proprietary database encompassing Google Adsense revenues from a large collection of publishers in diverse areas. We adopt the Temporal Fusion Transformer (TFT) model, a novel attention based architecture to predict publishers' advertising revenues. We leverage multiple covariates, including not only the publisher's own characteristics but also other publishers' advertising revenues. Our prediction results outperform several benchmark deep learning time series forecast models over multiple time horizons. Moreover, we interpret the results by analyzing variable importance weights to identify significant features and self attention weights to reveal persistent temporal patterns.


Membership in random ratio sets. Let mathcal A be a random set constructed by picking independently each element of 1, dots, n with probability alpha in (0, 1) . We give a formula for the probability that a rational number q belong to the random ratio set mathcal A ! mathcal A a b a,b in mathcal A . This generalizes a previous result of Cilleruelo and Guijarro Ord 'o nez. Moreover, we make some considerations about formulas for the probability of the event bigvee i 1 k ! big(q i in mathcal A ! mathcal A big) , where q 1, dots, q k are rational numbers, showing that they are related to the study of the connected components of certain graphs. In particular, we give formulas for the probability that q e in mathcal A ! mathcal A for some e in mathcal E , where mathcal E is a finite or cofinite set of positive integers with 1 in mathcal E .


ShinRL A Library for Evaluating RL Algorithms from Theoretical and Practical Perspectives. We present ShinRL, an open source library specialized for the evaluation of reinforcement learning (RL) algorithms from both theoretical and practical perspectives. Existing RL libraries typically allow users to evaluate practical performances of deep RL algorithms through returns. Nevertheless, these libraries are not necessarily useful for analyzing if the algorithms perform as theoretically expected, such as if Q learning really achieves the optimal Q function. In contrast, ShinRL provides an RL environment interface that can compute metrics for delving into the behaviors of RL algorithms, such as the gap between learned and the optimal Q values and state visitation frequencies. In addition, we introduce a flexible solver interface for evaluating both theoretically justified algorithms (e.g., dynamic programming and tabular RL) and practically effective ones (i.e., deep RL, typically with some additional extensions and regularizations) in a consistent fashion. As a case study, we show that how combining these two features of ShinRL makes it easier to analyze the behavior of deep Q learning. Furthermore, we demonstrate that ShinRL can be used to empirically validate recent theoretical findings such as the effect of KL regularization for value iteration and for deep Q learning, and the robustness of entropy regularized policies to adversarial rewards. The source code for ShinRL is available on GitHub https github.com omron sinicx ShinRL.


Fine grained Meta Theorems for Vertex Integrity. Vertex Integrity is a graph measure which sits squarely between two more well studied notions, namely vertex cover and tree depth, and that has recently gained attention as a structural graph parameter. In this paper we investigate the algorithmic trade offs involved with this parameter from the point of view of algorithmic meta theorems for First Order (FO) and Monadic Second Order (MSO) logic. Our positive results are the following (i) given a graph G of vertex integrity k and an FO formula phi with q quantifiers, deciding if G satisfies phi can be done in time 2 O(k 2q q log q) n O(1) (ii) for MSO formulas with q quantifiers, the same can be done in time 2 2 O(k 2 kq) n O(1) . Both results are obtained using kernelization arguments, which pre process the input to sizes 2 O(k 2) q and 2 O(k 2 kq) respectively. The complexities of our meta theorems are significantly better than the corresponding meta theorems for tree depth, which involve towers of exponentials. However, they are worse than the roughly 2 O(kq) and 2 2 O(k q) complexities known for corresponding meta theorems for vertex cover. To explain this deterioration we present two formula constructions which lead to fine grained complexity lower bounds and establish that the dependence of our meta theorems on k is best possible. More precisely, we show that it is not possible to decide FO formulas with q quantifiers in time 2 o(k 2q) , and that there exists a constant size MSO formula which cannot be decided in time 2 2 o(k 2) , both under the ETH. Hence, the quadratic blow up in the dependence on k is unavoidable and vertex integrity has a complexity for FO and MSO logic which is truly intermediate between vertex cover and tree depth.


Singular Rational Curves on Elliptic K3 Surfaces. We show that on every elliptic K3 surface X there are rational curves (R i) i in mathbb N such that R i 2 to infty , i.e., of unbounded arithmetic genus. Moreover, we show that the union of the lifts of these curves to mathbb P ( Omega X) is dense in the Zariski topology. As an application we give a simple proof of a theorem of Kobayashi in the elliptic case, i.e., there are no globally defined symmetric differential forms.


Priberam Labs at the NTCIR 15 SHINRA2020 ML Classification Task. Wikipedia is an online encyclopedia available in 285 languages. It composes an extremely relevant Knowledge Base (KB), which could be leveraged by automatic systems for several purposes. However, the structure and organisation of such information are not prone to automatic parsing and understanding and it is, therefore, necessary to structure this knowledge. The goal of the current SHINRA2020 ML task is to leverage Wikipedia pages in order to categorise their corresponding entities across 268 hierarchical categories, belonging to the Extended Named Entity (ENE) ontology. In this work, we propose three distinct models based on the contextualised embeddings yielded by Multilingual BERT. We explore the performances of a linear layer with and without explicit usage of the ontology's hierarchy, and a Gated Recurrent Units (GRU) layer. We also test several pooling strategies to leverage BERT's embeddings and selection criteria based on the labels' scores. We were able to achieve good performance across a large variety of languages, including those not seen during the fine tuning process (zero shot languages).


Generating Bug Fixes Using Pretrained Transformers. Detecting and fixing bugs are two of the most important yet frustrating parts of the software development cycle. Existing bug detection tools are based mainly on static analyzers, which rely on mathematical logic and symbolic reasoning about the program execution to detect common types of bugs. Fixing bugs is typically left out to the developer. In this work we introduce DeepDebug a data driven program repair approach which learns to detect and fix bugs in Java methods mined from real world GitHub repositories. We frame bug patching as a sequence to sequence learning task consisting of two steps (i) denoising pretraining, and (ii) supervised finetuning on the target translation task. We show that pretraining on source code programs improves the number of patches found by 33 as compared to supervised training from scratch, while domain adaptive pretraining from natural language to code further improves the accuracy by another 32 . We refine the standard accuracy evaluation metric into non deletion and deletion only fixes, and show that our best model generates 75 more non deletion fixes than the previous state of the art. In contrast to prior work, we attain our best results when generating raw code, as opposed to working with abstracted code that tends to only benefit smaller capacity models. Finally, we observe a subtle improvement from adding syntax embeddings along with the standard positional embeddings, as well as with adding an auxiliary task to predict each token's syntactic class. Despite focusing on Java, our approach is language agnostic, requiring only a general purpose parser such as tree sitter.


Weyl chamber length compactification of the rm PSL (2, mathbb R) times rm PSL (2, mathbb R) maximal character variety. We study the vectorial length compactification of the space of conjugacy classes of maximal representations of the fundamental group Gamma of a closed hyperbolic surface Sigma in rm PSL (2, mathbb R) n . We identify the boundary with the sphere mathbb P(( mathcal ML ) n) , where mathcal ML is the space of measured geodesic laminations on Sigma . In the case n 2 , we give a geometric interpretation of the boundary as the space of homothety classes of mathbb R 2 mixed structures on Sigma . We associate to such a structure a dual tree graded space endowed with an mathbb R 2 valued metric, which we show to be universal with respect to actions on products of two mathbb R trees with the given length spectrum.


Local Pair and Bundle Discovery over Co Evolving Time Series. Time series exploration and mining has many applications across several industrial and scientific domains. In this paper, we consider the problem of detecting locally similar pairs and groups, called bundles, over co evolving time series. These are pairs or groups of subsequences whose values do not differ by more than epsilon for at least delta consecutive timestamps, thus indicating common local patterns and trends. We first present a baseline algorithm that performs a sweep line scan across all timestamps to identify matches. Then, we propose a filter verification technique that only examines candidate matches at judiciously chosen checkpoints across time. Specifically, we introduce two block scanning algorithms for discovering local pairs and bundles respectively, which leverage the potential of checkpoints to aggressively prune the search space. We experimentally evaluate our methods against real world and synthetic datasets, demonstrating a speed up in execution time by an order of magnitude over the baseline. This paper has been published in the 16th International Symposium on Spatial and Temporal Databases (SSTD19).


Deep graph convolution neural network with non negative matrix factorization for community discovery. Community discovery is an important task for graph mining. Owing to the nonstructure, the high dimensionality, and the sparsity of graph data, it is not easy to obtain an appropriate community partition. In this paper, a deep graph convolution neural network with non negative matrix factorization (DGCN NMF) is proposed for community discovery. DGCN NMF employs multiple graph convolution layers to obtain the low dimensional embedding. In each layer, the last output and the non negative matrix factorization's results of the previous outputs are inputted into the current layer. The community partition of the inputted graph can be outputted by an end to end approach. The proposed algorithm and the comparison algorithms are conducted on the experimental data sets. The experimental results show that the proposed algorithm outperforms the comparison algorithms on the experimental data sets. The experimental results demonstrate that DGCN NMF is an effective algorithm for community discovery.


Spiral Language Modeling. In almost all text generation applications, word sequences are constructed in a left to right (L2R) or right to left (R2L) manner, as natural language sentences are written either L2R or R2L. However, we find that the natural language written order is not essential for text generation. In this paper, we propose Spiral Language Modeling (SLM), a general approach that enables one to construct natural language sentences beyond the L2R and R2L order. SLM allows one to form natural language text by starting from an arbitrary token inside the result text and expanding the rest tokens around the selected ones. It makes the decoding order a new optimization objective besides the language model perplexity, which further improves the diversity and quality of the generated text. Furthermore, SLM makes it possible to manipulate the text construction process by selecting a proper starting token. SLM also introduces generation orderings as additional regularization to improve model robustness in low resource scenarios. Experiments on 8 widely studied Neural Machine Translation (NMT) tasks show that SLM is constantly effective with up to 4.7 BLEU increase comparing to the conventional L2R decoding approach.


Effective vaccination strategy using graph neural network ansatz. The effectiveness of vaccination highly depends on the choice of individuals to vaccinate, even if the same number of individuals are vaccinated. Vaccinating individuals with high centrality measures such as betweenness centrality (BC) and eigenvector centrality (EC) are effective in containing epidemics. However, in many real world cases, each individual has distinct epidemic characteristics such as contagion, recovery, fatality rate, efficacy, and probability of severe reaction to a vaccine. Moreover, the relative effectiveness of vaccination strategies depends on the number of available vaccine shots. Centrality based strategies cannot take the variability of epidemic characteristics or the availability of vaccines into account. Here, we propose a framework for vaccination strategy based on graph neural network ansatz (GNNA) and microscopic Markov chain approach (MMCA). In this framework, we can formulate an effective vaccination strategy that considers the properties of each node, and tailor the vaccination strategy according to the availability of vaccines. Our approach is highly scalable to large networks. We validate the method in many real world networks for network dismantling, the susceptible infected susceptible (SIS) model with homogeneous and heterogeneous contagion recovery rates, and the susceptible infected recovered dead (SIRD) model. We also extend our method to edge immunization strategy, which represents non pharmaceutical containment measures such as travel regulations and social distancing.


Characterizing Concurrency Mechanisms for NVIDIA GPUs under Deep Learning Workloads. We investigate the performance of the concurrency mechanisms available on NVIDIA's new Ampere GPU microarchitecture under deep learning training and inference workloads. In contrast to previous studies that treat the GPU as a black box, we examine scheduling at the microarchitectural level. We find that the lack of fine grained preemption mechanisms, robust task prioritization options, and contention aware thread block placement policies limits the effectiveness of NVIDIA's concurrency mechanisms. In summary, the sequential nature of deep learning workloads and their fluctuating resource requirements and kernel runtimes make executing such workloads while maintaining consistently high utilization and low, predictable turnaround times difficult on current NVIDIA hardware.


Direct PET Image Reconstruction Incorporating Deep Image Prior and a Forward Projection Model. Convolutional neural networks (CNNs) have recently achieved remarkable performance in positron emission tomography (PET) image reconstruction. In particular, CNN based direct PET image reconstruction, which directly generates the reconstructed image from the sinogram, has potential applicability to PET image enhancements because it does not require image reconstruction algorithms, which often produce some artifacts. However, these deep learning based, direct PET image reconstruction algorithms have the disadvantage that they require a large number of high quality training datasets. In this study, we propose an unsupervised direct PET image reconstruction method that incorporates a deep image prior framework. Our proposed method incorporates a forward projection model with a loss function to achieve unsupervised direct PET image reconstruction from sinograms. To compare our proposed direct reconstruction method with the filtered back projection (FBP) and maximum likelihood expectation maximization (ML EM) algorithms, we evaluated using Monte Carlo simulation data of brain 18 F FDG PET scans. The results demonstrate that our proposed direct reconstruction quantitatively and qualitatively outperforms the FBP and ML EM algorithms with respect to peak signal to noise ratio and structural similarity index.


Accurate Visual Inertial SLAM by Feature Re identification. We propose a novel feature re identification method for real time visual inertial SLAM. The front end module of the state of the art visual inertial SLAM methods (e.g. visual feature extraction and matching schemes) relies on feature tracks across image frames, which are easily broken in challenging scenarios, resulting in insufficient visual measurement and accumulated error in pose estimation. In this paper, we propose an efficient drift less SLAM method by re identifying existing features from a spatial temporal sensitive sub global map. The re identified features over a long time span serve as augmented visual measurements and are incorporated into the optimization module which can gradually decrease the accumulative error in the long run, and further build a drift less global map in the system. Extensive experiments show that our feature re identification method is both effective and efficient. Specifically, when combining the feature re identification with the state of the art SLAM method 11 , our method achieves 67.3 and 87.5 absolute translation error reduction with only a small additional computational cost on two public SLAM benchmark DBs EuRoC and TUM VI respectively.


Quasi Newton methods for minimizing a quadratic function subject to uncertainty. We investigate quasi Newton methods for minimizing a strictly convex quadratic function which is subject to errors in the evaluation of the gradients. The methods all give identical behavior in exact arithmetic, generating minimizers of Krylov subspaces of increasing dimensions, thereby having finite termination. A BFGS quasi Newton method is empirically known to behave very well on a quadratic problem subject to small errors. We also investigate large error scenarios, in which the expected behavior is not so clear. In particular, we are interested in the behavior of quasi Newton matrices that differ from the identity by a low rank matrix, such as a memoryless BFGS method. Our numerical results indicate that for large errors, a memory less quasi Newton method often outperforms a BFGS method. We also consider a more advanced model for generating search directions, based on solving a chance constrained optimization problem. Our results indicate that such a model often gives a slight advantage in final accuracy, although the computational cost is significantly higher.


Pulling Up by the Causal Bootstraps Causal Data Augmentation for Pre training Debiasing. Machine learning models achieve state of the art performance on many supervised learning tasks. However, prior evidence suggests that these models may learn to rely on shortcut biases or spurious correlations (intuitively, correlations that do not hold in the test as they hold in train) for good predictive performance. Such models cannot be trusted in deployment environments to provide accurate predictions. While viewing the problem from a causal lens is known to be useful, the seamless integration of causation techniques into machine learning pipelines remains cumbersome and expensive. In this work, we study and extend a causal pre training debiasing technique called causal bootstrapping (CB) under five practical confounded data generation acquisition scenarios (with known and unknown confounding). Under these settings, we systematically investigate the effect of confounding bias on deep learning model performance, demonstrating their propensity to rely on shortcut biases when these biases are not properly accounted for. We demonstrate that such a causal pre training technique can significantly outperform existing base practices to mitigate confounding bias on real world domain generalization benchmarking tasks. This systematic investigation underlines the importance of accounting for the underlying data generating mechanisms and fortifying data preprocessing pipelines with a causal framework to develop methods robust to confounding biases.


On Properties of the Dirichlet Green's function for linear diffusions on a half line. This paper is concerned with the study of Green's functions for one dimensional diffusions with constant diffusion coefficient and linear time inhomogeneous drift. It is well know that the whole line Green's function is given by a Gaussian. Formulas for the Dirichlet Green's function on the half line are only known in special cases. The main object of study in the paper is the ratio of the Dirichlet to whole line Green's functions. Bounds, asymptotic behavior in the limit as the diffusion coefficient vanishes, and a log concavity result are obtained for this ratio.


An Actor Critic Method for Simulation Based Optimization. We focus on a simulation based optimization problem of choosing the best design from the feasible space. Although the simulation model can be queried with finite samples, its internal processing rule cannot be utilized in the optimization process. We formulate the sampling process as a policy searching problem and give a solution from the perspective of Reinforcement Learning (RL). Concretely, Actor Critic (AC) framework is applied, where the Actor serves as a surrogate model to predict the performance on unknown designs, whereas the actor encodes the sampling policy to be optimized. We design the updating rule and propose two algorithms for the cases where the feasible spaces are continuous and discrete respectively. Some experiments are designed to validate the effectiveness of proposed algorithms, including two toy examples, which intuitively explain the algorithms, and two more complex tasks, i.e., adversarial attack task and RL task, which validate the effectiveness in large scale problems. The results show that the proposed algorithms can successfully deal with these problems. Especially note that in the RL task, our methods give a new perspective to robot control by treating the task as a simulation model and solving it by optimizing the policy generating process, while existing works commonly optimize the policy itself directly.


Lie Type maps on alternative algebras. Let A and A' be two alternative algebras with identities 1 A and 1 A', respectively, and e 1 and e 2 1 A e 1 nontrivial symmetric idempotents in A. In this paper we study the characterization of multiplicative Lie type maps. As application, we get a result on alternative W algebras.


Shaking the foundations delusions in sequence models for interaction and control. The recent phenomenal success of language models has reinvigorated machine learning research, and large sequence models such as transformers are being applied to a variety of domains. One important problem class that has remained relatively elusive however is purposeful adaptive behavior. Currently there is a common perception that sequence models "lack the understanding of the cause and effect of their actions" leading them to draw incorrect inferences due to auto suggestive delusions. In this report we explain where this mismatch originates, and show that it can be resolved by treating actions as causal interventions. Finally, we show that in supervised learning, one can teach a system to condition or intervene on data by training with factual and counterfactual error signals respectively.


Instability of B 'ezout's Theorem and arbitrarily large intersection between symplectic surfaces. We investigate the failure of B 'ezout's Theorem for two symplectic surfaces in mathbb C mathrm P 2 (and more generally on an algebraic surface), by proving that every plane algebraic curve C can be perturbed in the mathscr C 1 topology to an arbitrarily close smooth symplectic surface C epsilon with the property that the cardinality C epsilon cap Z d of the transversal intersection of C epsilon with an algebraic plane curve Z d of degree d , as a function of d can grow arbitrarily fast. As a consequence we obtain that, although B 'ezout's Theorem is true for pseudoholomorphic curves with respect to the same almost complex structure, it is "arbitrarily false" for pseudoholomorphic curves with respect to different (but arbitrarily close) almost complex structures (we call this phenomenon "instability of B 'ezout's Theorem").


Continuants with equal values, a combinatorial approach. A regular continuant is the denominator K of a terminating regular continued fraction, interpreted as a function of the partial quotients. We regard K as a function defined on the set of all finite words on the alphabet 1 2 3 dots with values in the positive integers. Given a word w w 1 cdots w n with w i in mathbb N we define its multiplicity mu(w) as the number of times the value K(w) is assumed in the Abelian class mathcal X (w) of all permutations of the word w. We prove that there is an infinity of different lacunary alphabets of the form b 1 dots b t l 1 l 2 dots s with b j, t, l, s in mathbb N and s sufficiently large such that mu takes arbitrarily large values for words on these alphabets. The method of proof relies in part on a combinatorial characterisation of the word w max in the class mathcal X (w) where K assumes its maximum.


Automorphism Groups and Isometries for Cyclic Orbit Codes. We study orbit codes in the field extension mathbb F q n . First we show that the automorphism group of a cyclic orbit code is contained in the normalizer of the Singer subgroup if the orbit is generated by a subspace that is not contained in a proper subfield of mathbb F q n . We then generalize to orbits under the normalizer of the Singer subgroup. In that situation some exceptional cases arise and some open cases remain. Finally we characterize linear isometries between such codes.


Gemini Practical Reconfigurable Datacenter Networks with Topology and Traffic Engineering. To reduce cost, datacenter network operators are exploring blocking network designs. An example of such a design is a "spine free" form of a Fat Tree, in which pods directly connect to each other, rather than via spine blocks. To maintain application perceived performance in the face of dynamic workloads, these new designs must be able to reconfigure routing and the inter pod topology. Gemini is a system designed to achieve these goals on commodity hardware while reconfiguring the network infrequently, rendering these blocking designs practical enough for deployment in the near future. The key to Gemini is the joint optimization of topology and routing, using as input a robust estimation of future traffic derived from multiple historical traffic matrices. Gemini "hedges" against unpredicted bursts, by spreading these bursts across multiple paths, to minimize packet loss in exchange for a small increase in path lengths. It incorporates a robust decision algorithm to determine when to reconfigure, and whether to use hedging. Data from tens of production fabrics allows us to categorize these as either low or high volatility these categories seem stable. For the former, Gemini finds topologies and routing with near optimal performance and cost. For the latter, Gemini's use of multi traffic matrix optimization and hedging avoids the need for frequent topology reconfiguration, with only marginal increases in path length. As a result, Gemini can support existing workloads on these production fabrics using a spine free topology that is half the cost of the existing topology on these fabrics.


Construct Informative Triplet with Two stage Hard sample Generation. In this paper, we propose a robust sample generation scheme to construct informative triplets. The proposed hard sample generation is a two stage synthesis framework that produces hard samples through effective positive and negative sample generators in two stages, respectively. The first stage stretches the anchor positive pairs with piecewise linear manipulation and enhances the quality of generated samples by skillfully designing a conditional generative adversarial network to lower the risk of mode collapse. The second stage utilizes an adaptive reverse metric constraint to generate the final hard samples. Extensive experiments on several benchmark datasets verify that our method achieves superior performance than the existing hard sample generation algorithms. Besides, we also find that our proposed hard sample generation method combining the existing triplet mining strategies can further boost the deep metric learning performance.


Secure and Efficient Blockchain based Knowledge Sharing for Intelligent Connected Vehicles. The emergence of Intelligent Connected Vehicles (ICVs) shows great potential for future intelligent traffic systems, enhancing both traffic safety and road efficiency. However, the ICVs relying on data driven perception and driving models face many challenges, including the lack of comprehensive knowledge to deal with complicated driving context. In this paper, we are motivated to investigate cooperative knowledge sharing for ICVs. We propose a secure and efficient directed acyclic graph (DAG) blockchain based knowledge sharing framework, aiming to cater for the micro transaction based vehicular networks. The framework can realize both local and cross regional knowledge sharing. Then, the framework is applied to autonomous driving applications, wherein machine learning based models for autonomous driving control can be shared. A lightweight tip selection algorithm (TSA) is proposed for the DAG based knowledge sharing framework to achieve consensus and identity verification for cross regional vehicles. To enhance model accuracy as well as minimizing bandwidth consumption, an adaptive asynchronous distributed learning (ADL) based scheme is proposed for model uploading and downloading. Experiment results show that the blockchain based knowledge sharing is secure, and it can resist attacks from malicious users. In addition, the proposed adaptive ADL scheme can enhance driving safety related performance compared to several existing algorithms.


Non resonant circles for strong magnetic fields on surfaces. We study non resonant circles for strong magnetic fields on a closed, connected, oriented surface and show how these can be used to prove the existence of trapping regions and of periodic magnetic geodesics with prescribed low speed. As a corollary, there exist infinitely many periodic magnetic geodesics for every low speed in the following cases i) the surface is not the two sphere, ii) the magnetic field vanishes somewhere.


Virtual Multi Modality Self Supervised Foreground Matting for Human Object Interaction. Most existing human matting algorithms tried to separate pure human only foreground from the background. In this paper, we propose a Virtual Multi modality Foreground Matting (VMFM) method to learn human object interactive foreground (human and objects interacted with him or her) from a raw RGB image. The VMFM method requires no additional inputs, e.g. trimap or known background. We reformulate foreground matting as a self supervised multi modality problem factor each input image into estimated depth map, segmentation mask, and interaction heatmap using three auto encoders. In order to fully utilize the characteristics of each modality, we first train a dual encoder to decoder network to estimate the same alpha matte. Then we introduce a self supervised method Complementary Learning(CL) to predict deviation probability map and exchange reliable gradients across modalities without label. We conducted extensive experiments to analyze the effectiveness of each modality and the significance of different components in complementary learning. We demonstrate that our model outperforms the state of the art methods.


Quantum Resistant Security for Software Updates on Low power Networked Embedded Devices. As the Internet of Things (IoT) rolls out today to devices whose lifetime may well exceed a decade, conservative threat models should consider attackers with access to quantum computing power. The SUIT standard (specified by the IETF) defines a security architecture for IoT software updates, standardizing the metadata and the cryptographic tools namely, digital signatures and hash functions that guarantee the legitimacy of software updates. While the performance of SUIT has previously been evaluated in the pre quantum context, it has not yet been studied in a post quantum context. Taking the open source implementation of SUIT available in RIOT as a case study, we overview post quantum considerations, and quantum resistant digital signatures in particular, focusing on lowpower, microcontroller based IoT devices which have stringent resource constraints in terms of memory, CPU, and energy consumption. We benchmark a selection of proposed post quantum signature schemes (LMS, Falcon, and Dilithium) and compare them with current pre quantum signature schemes (Ed25519 and ECDSA). Our benchmarks are carried out on a variety of IoT hardware including ARM Cortex M, RISC V, and Espressif (ESP32), which form the bulk of modern 32 bit microcontroller architectures. We interpret our benchmark results in the context of SUIT, and estimate the real world impact of post quantum alternatives for a range of typical software update categories. CCS CONCEPTS bullet Computer systems organization rightarrow Embedded systems.


Dissipative measure valued solutions to the Euler Poisson equation. We consider several pressureless variants of the compressible Euler equation driven by nonlocal repulsionattraction and alignment forces with Poisson interaction. Under an energy admissibility criterion, we prove existence of global measure valued solutions, i.e., very weak solutions described by a classical Young measure together with appropriate concentration defects. We then investigate the evolution of a relative energy functional to compare a measure valued solution to a regular solution emanating from the same initial datum. This leads to a (partial) weak strong uniqueness principle.


Uniqueness of exact Borel subalgebras and bocses. Together with Koenig and Ovsienko, the first author showed that every quasi hereditary algebra can be obtained as the (left or right) dual of a directed bocs. In this monograph, we prove that if one additionally assumes that the bocs is basic, a notion we define, then this bocs is unique up to isomorphism. This should be seen as a generalisation of the statement that the basic algebra of an arbitrary associative algebra is unique up to isomorphism. The proof associates to a given presentation of the bocs an A infty structure on the operatorname Ext algebra of the standard modules of the corresponding quasi hereditary algebra. Uniqueness then follows from an application of Kadeishvili's theorem.


Design Smells in Deep Learning Programs An Empirical Study. Nowadays, we are witnessing an increasing adoption of Deep Learning (DL) based software systems in many industries. Designing a DL program requires constructing a deep neural network (DNN) and then training it on a dataset. This process requires that developers make multiple architectural (e.g., type, size, number, and order of layers) and configuration (e.g., optimizer, regularization methods, and activation functions) choices that affect the quality of the DL models, and consequently software quality. An under specified or poorly designed DL model may train successfully but is likely to perform poorly when deployed in production. Design smells in DL programs are poor design and or configuration decisions taken during the development of DL components, that are likely to have a negative impact on the performance (i.e., prediction accuracy) and then quality of DL based software systems. In this paper, we present a catalogue of 8 design smells for a popular DL architecture, namely deep Feedforward Neural Networks which is widely employed in industrial applications. The design smells were identified through a review of the existing literature on DL design and a manual inspection of 659 DL programs with performance issues and design inefficiencies. The smells are specified by describing their context, consequences, and recommended refactorings. To provide empirical evidence on the relevance and perceived impact of the proposed design smells, we conducted a survey with 81 DL developers. In general, the developers perceived the proposed design smells as reflective of design or implementation problems, with agreement levels varying between 47 and 68 .


Dynamical low rank approximation for Burgers' equation with uncertainty. Quantifying uncertainties in hyperbolic equations is a source of several challenges. First, the solution forms shocks leading to oscillatory behaviour in the numerical approximation of the solution. Second, the number of unknowns required for an effective discretization of the solution grows exponentially with the dimension of the uncertainties, yielding high computational costs and large memory requirements. An efficient representation of the solution via adequate basis functions permits to tackle these difficulties. The generalized polynomial chaos (gPC) polynomials allow such an efficient representation when the distribution of the uncertainties is known. These distributions are usually only available for input uncertainties such as initial conditions, therefore the efficiency of this ansatz can get lost during runtime. In this paper, we make use of the dynamical low rank approximation (DLRA) to obtain a memory wise efficient solution approximation on a lower dimensional manifold. We investigate the use of the matrix projector splitting integrator and the unconventional integrator for dynamical low rank approximation, deriving separate time evolution equations for the spatial and uncertain basis functions, respectively. This guarantees an efficient approximation of the solution even if the underlying probability distributions change over time. Furthermore, filters to mitigate the appearance of spurious oscillations are implemented, and a strategy to enforce boundary conditions is introduced. The proposed methodology is analyzed for Burgers' equation equipped with uncertain initial values represented by a two dimensional random vector. The numerical results show a reduction of the memory requirements, and that the important characteristics of the original system are well captured.


Radiation Protection at ELI Beamlines A Unique LaserDriven Accelerator Facility. The Extreme Light Infrastructure (ELI) Beamlines is a laser driven accelerator facility located in the outskirts of the city of Prague. With its state of the art lasers, it will carry out an ambitious and diverse research program. Activities at ELI Beamlines can be broken down in complementary areas of scientific interest development and testing of novel technologies for multi PW laser systems, plasma physics, high field physics experiments, production of femtosecond secondary sources of ionizing radiation (extreme ultraviolet radiation, X rays, gamma, electrons, and protons)to be used in interdisciplinary applications in physics, biology, medicine, and material sciences.In house experiments are already taking place since the first half of 2018, first user calls and experiments started in 2019.In this contribution, the ELI Beamlines accelerator facility and its current status of operation are presented in more details. Particular attention is paid to the design and implementation of the radiation protection program, with emphasis on the unique challenges this laser facility poses in terms of radiation safety.


Mathematical Modeling, In Human Evaluation and Analysis of Volume Kinetics and Kidney Function after Burn Injury and Resuscitation. Existing burn resuscitation protocols exhibit large variability in treatment efficacy. Hence, they must be further optimized based on comprehensive knowledge of burn pathophysiology. A physics based mathematical model that can replicate physiological responses in diverse burn patients can serve as an attractive basis to perform non clinical testing of burn resuscitation protocols and to expand knowledge on burn pathophysiology. We intend to develop, optimize, validate, and analyze a mathematical model to replicate physiological responses in burn patients. Using clinical datasets collected from 233 burn patients receiving burn resuscitation, we developed and validated a mathematical model applicable to computer aided in human burn resuscitation trial and knowledge expansion. Using the validated mathematical model, we examined possible physiological mechanisms responsible for the cohort dependent differences in burn pathophysiology between younger versus older patients, female versus male patients, and patients with versus without inhalational injury. We demonstrated that the mathematical model could replicate physiological responses in burn patients associated with wide demographic characteristics and injury severity and that an increased inflammatory response to injury may be a key contributing factor in increasing the mortality risk of older patients and patients with inhalation injury via an increase in the fluid retention. The mathematical model may provide an attractive platform to conduct non clinical testing of burn resuscitation protocols and test new hypotheses on burn pathophysiology.


FIPAC Thwarting Fault and Software Induced Control Flow Attacks with ARM Pointer Authentication. With the improvements of computing technology, more and more applications embed powerful ARM processors into their devices. These systems can be attacked by redirecting the control flow of a program to bypass critical pieces of code such as privilege checks or signature verifications. Control flow hijacks can be performed using classical software vulnerabilities, physical fault attacks, or software induced fault attacks. To cope with this threat and to protect the control flow, dedicated countermeasures are needed. To counteract control flow hijacks, control flow integrity (CFI) aims to be a generic solution. However, software based CFI typically either protects against software or fault attacks, but not against both. While hardware assisted CFI can mitigate both types of attacks, they require extensive hardware modifications. As hardware changes are unrealistic for existing ARM architectures, a wide range of systems remains unprotected and vulnerable to control flow attacks. In this work, we present FIPAC, an efficient software based CFI scheme protecting the execution at basic block granularity of ARM based devices against software and fault attacks. FIPAC exploits ARM pointer authentication of ARMv8.6 A to implement a cryptographically signed control flow graph. We cryptographically link the correct sequence of executed basic blocks to enforce CFI at this granularity. We use an LLVM based toolchain to automatically instrument programs. The evaluation on SPEC2017 with different security policies shows a code overhead between 54 97 and a runtime overhead between 35 105 . While these overheads are higher than for countermeasures against software attacks, FIPAC outperforms related work protecting the control flow against fault attacks. FIPAC is an efficient solution to provide protection against software and fault based CFI attacks on basic block level on modern ARM devices.


Multi Agent Curricula and Emergent Implicit Signaling. Emergent communication has made strides towards learning communication from scratch, but has focused primarily on protocols that resemble human language. In nature, multi agent cooperation gives rise to a wide range of communication that varies in structure and complexity. In this work, we recognize the full spectrum of communication that exists in nature and propose studying lower level communication. Specifically, we study emergent implicit signaling in the context of decentralized multi agent learning in difficult, sparse reward environments. However, learning to coordinate in such environments is challenging. We propose a curriculum driven strategy that combines (i) velocity based environment shaping, tailored to the skill level of the multi agent team and (ii) a behavioral curriculum that helps agents learn successful single agent behaviors as a precursor to learning multi agent behaviors. Pursuit evasion experiments show that our approach learns effective coordination, significantly outperforming sophisticated analytical and learned policies. Our method completes the pursuit evasion task even when pursuers move at half of the evader's speed, whereas the highest performing baseline fails at 80 of the evader's speed. Moreover, we examine the use of implicit signals in coordination through position based social influence. We show that pursuers trained with our strategy exchange more than twice as much information (in bits) than baseline methods, indicating that our method has learned, and relies heavily on, the exchange of implicit signals.


A Dynamic Head Importance Computation Mechanism for Neural Machine Translation. Multiple parallel attention mechanisms that use multiple attention heads facilitate greater performance of the Transformer model for various applications e.g., Neural Machine Translation (NMT), text classification. In multi head attention mechanism, different heads attend to different parts of the input. However, the limitation is that multiple heads might attend to the same part of the input, resulting in multiple heads being redundant. Thus, the model resources are under utilized. One approach to avoid this is to prune least important heads based on certain importance score. In this work, we focus on designing a Dynamic Head Importance Computation Mechanism (DHICM) to dynamically calculate the importance of a head with respect to the input. Our insight is to design an additional attention layer together with multi head attention, and utilize the outputs of the multi head attention along with the input, to compute the importance for each head. Additionally, we add an extra loss function to prevent the model from assigning same score to all heads, to identify more important heads and improvise performance. We analyzed performance of DHICM for NMT with different languages. Experiments on different datasets show that DHICM outperforms traditional Transformer based approach by large margin, especially, when less training data is available.


Active Inference for Stochastic Control. Active inference has emerged as an alternative approach to control problems given its intuitive (probabilistic) formalism. However, despite its theoretical utility, computational implementations have largely been restricted to low dimensional, deterministic settings. This paper highlights that this is a consequence of the inability to adequately model stochastic transition dynamics, particularly when an extensive policy (i.e., action trajectory) space must be evaluated during planning. Fortunately, recent advancements propose a modified planning algorithm for finite temporal horizons. We build upon this work to assess the utility of active inference for a stochastic control setting. For this, we simulate the classic windy grid world task with additional complexities, namely 1) environment stochasticity 2) learning of transition dynamics and 3) partial observability. Our results demonstrate the advantage of using active inference, compared to reinforcement learning, in both deterministic and stochastic settings.


On the geometry of irreversible metric measure spaces Convergence, Stability and Analytic aspects. The paper is devoted to the study of Gromov Hausdorff convergence and stability of irreversible metric measure spaces, both in the compact and noncompact cases. While the compact setting is mostly similar to the reversible case developed by J. Lott, K. T. Sturm and C. Villani, the noncompact case provides various surprising phenomena. Since the reversibility of noncompact irreversible spaces might be infinite, it is motivated to introduce a suitable nondecreasing function that bounds the reversibility of larger and larger balls. By this approach, we are able to prove satisfactory convergence stability results in a suitable reversibility depending Gromov Hausdorff topology. A wide class of irreversible spaces is provided by Finsler manifolds, which serve to construct various model examples by pointing out genuine differences between the reversible and irreversible settings. We conclude the paper by proving various geometric and functional inequalities (as Brunn Minkowski, Bishop Gromov, log Sobolev and Lichnerowicz inequalities) on irreversible structures.


A Decomposition Method for Solving Multicommodity Network Equilibrium. We consider the numerical aspect of the multicommodity network equilibrium problem proposed by Rockafellar in 1995. Our method relies on the flexible monotone operator splitting framework recently proposed by Combettes and Eckstein.


Reducing Information Bottleneck for Weakly Supervised Semantic Segmentation. Weakly supervised semantic segmentation produces pixel level localization from class labels however, a classifier trained on such labels is likely to focus on a small discriminative region of the target object. We interpret this phenomenon using the information bottleneck principle the final layer of a deep neural network, activated by the sigmoid or softmax activation functions, causes an information bottleneck, and as a result, only a subset of the task relevant information is passed on to the output. We first support this argument through a simulated toy experiment and then propose a method to reduce the information bottleneck by removing the last activation function. In addition, we introduce a new pooling method that further encourages the transmission of information from non discriminative regions to the classification. Our experimental evaluations demonstrate that this simple modification significantly improves the quality of localization maps on both the PASCAL VOC 2012 and MS COCO 2014 datasets, exhibiting a new state of the art performance for weakly supervised semantic segmentation. The code is available at https github.com jbeomlee93 RIB.


Fast and Accurate Model Scaling. In this work we analyze strategies for convolutional neural network scaling that is, the process of scaling a base convolutional network to endow it with greater computational complexity and consequently representational power. Example scaling strategies may include increasing model width, depth, resolution, etc. While various scaling strategies exist, their tradeoffs are not fully understood. Existing analysis typically focuses on the interplay of accuracy and flops (floating point operations). Yet, as we demonstrate, various scaling strategies affect model parameters, activations, and consequently actual runtime quite differently. In our experiments we show the surprising result that numerous scaling strategies yield networks with similar accuracy but with widely varying properties. This leads us to propose a simple fast compound scaling strategy that encourages primarily scaling model width, while scaling depth and resolution to a lesser extent. Unlike currently popular scaling strategies, which result in about O(s) increase in model activation w.r.t. scaling flops by a factor of s , the proposed fast compound scaling results in close to O( sqrt s ) increase in activations, while achieving excellent accuracy. This leads to comparable speedups on modern memory limited hardware (e.g., GPU, TPU). More generally, we hope this work provides a framework for analyzing and selecting scaling strategies under various computational constraints.


Parisian ruin probability for two dimensional Brownian risk model. Let (W 1(s), W 2(t)), s,t ge 0 be a bivariate Brownian motion with standard Brownian motion marginals and constant correlation rho in ( 1,1). Parisian ruin is defined as a classical ruin that happens over an extended period of time, the so called time in red. We derive exact asymptotics for the non simultaneous Parisian ruin of the company conditioned on the event of non simultaneous ruin happening. We are interested in finding asymptotics of such problem as u to infty and with the length of time in red being of order frac 1 u 2 , where u represents initial capital for the companies. Approximation of this problem is of interest for the analysis of Parisian ruin probability in bivariate Brownian risk model, which is a standard way of defining prolonged ruin models in the financial markets.


On the necessary and sufficient conditions for Peng's law of large numbers under sublinear expectations. In this paper, we firstly establish the weak laws of large numbers on the canonical space ( br bn, cb( br bn)) by traditional truncation method and Chebyshev's inequality as in the classical probability theory. Then we extend them from the canonical space to the general sublinear expectation space. The necessary and sufficient conditions for Peng's law of large numbers are obtained.


On exterior differential systems involving differentials of H " o lder functions. We study the validity of an extension of Frobenius theorem on integral manifolds for some classes of Pfaff type systems of partial differential equations involving multidimensional "rough" signals, i.e. "differentials" of given H "older continuous functions interpreted in a suitable way, similarly to Young Differential Equations in Rough Paths theory. This can be seen as a tool to study solvability of exterior differential systems involving rough differential forms, i.e. the forms involving weak (distributional) derivatives of highly irregular (e.g. H "older continuous) functions the solutions (integral manifolds) being also some very weakly regular geometric structures.


A Sketch of a Proof Theoretic Semantics for Necessity. This paper considers proof theoretic semantics for necessity within Dummett's and Prawitz's framework. Inspired by a system of Pfenning's and Davies's, the language of intuitionist logic is extended by a higher order operator which captures a notion of validity. A notion of relative necessary is defined in terms of it, which expresses a necessary connection between the assumptions and the conclusion of a deduction.


DySR A Dynamic Representation Learning and Aligning based Model for Service Bundle Recommendation. An increasing number and diversity of services are available, which result in significant challenges to effective reuse service during requirement satisfaction. There have been many service bundle recommendation studies and achieved remarkable results. However, there is still plenty of room for improvement in the performance of these methods. The fundamental problem with these studies is that they ignore the evolution of services over time and the representation gap between services and requirements. In this paper, we propose a dynamic representation learning and aligning based model called DySR to tackle these issues. DySR eliminates the representation gap between services and requirements by learning a transformation function and obtains service representations in an evolving social environment through dynamic graph representation learning. Extensive experiments conducted on a real world dataset from ProgrammableWeb show that DySR outperforms existing state of the art methods in commonly used evaluation metrics, improving F1 5 from 36.1 to 69.3 .


A Class of Trees Having Near Best Balance. Full binary trees naturally represent commutative non associative products. There are many important examples of these products finite precision floating point addition and NAND gates, among others. Balance in such a tree is highly desirable for efficiency in calculation. The best balance is attained with a divide and conquer approach. However, this may not be the optimal solution, since the success of many calculations is dependent on the grouping and ordering of the calculation, for reasons ranging from the avoidance of rounding error, to calculating with varying precision, to the placement of calculation within a heterogeneous system. We introduce a new class of computational trees having near best balance in terms of the Colless index from mathematical phylogenetics. These trees are easily constructed from the binary decomposition of the number of terms in the problem. They also permit much more flexibility than the optimally balanced divide and conquer trees. This gives needed freedom in the grouping and ordering of calculation, and allows intelligent efficiency trade offs.


Deterministic and Probabilistic Error Bounds for Floating Point Summation Algorithms. We analyse the forward error in the floating point summation of real numbers, from algorithms that do not require recourse to higher precision or better hardware. We derive informative explicit expressions, and new deterministic and probabilistic bounds for errors in three classes of algorithms general summation,shifted general summation, and compensated (sequential) summation. Our probabilistic bounds for general and shifted general summation hold to all orders. For compensated summation, we also present deterministic and probabilistic first and second order bounds, with a first order bound that differs from existing ones. Numerical experiments illustrate that the bounds are informative and that among the three algorithm classes, compensated summation is generally the most accurate method.


The Trade off Strategy between Railroads and Customers A Case Study for Low frequency Entire Trains. Some large freight railroads ship a number of shipments over the rail network annually. To reduce unnecessary reclassifications of shipments on their routes, each railroad is willing to operate the entire train for an individual shipment. In other words, the motivation for providing the entire train service lies in a simple realization that door to door transportation (directly from origin to destination) can reduce operating costs by decreasing classification. However, this mode will increase inventory costs for customers when commodities are transported by low frequency entire train services. Thus, this study proposes the trade off strategy to keep a balance between saving operating costs of railroads and increasing inventory costs of customers. We analyze the revenue and losses after a shipment shifting from the transfer transportation which contains a series of train services to the direct transportation by entire train service.


DARTS for Inverse Problems a Study on Hyperparameter Sensitivity. Differentiable architecture search (DARTS) is a widely researched tool for the discovery of novel architectures, due to its promising results for image classification. The main benefit of DARTS is the effectiveness achieved through the weight sharing one shot paradigm, which allows efficient architecture search. In this work, we investigate DARTS in a systematic case study of inverse problems, which allows us to analyze these potential benefits in a controlled manner. We demonstrate that the success of DARTS can be extended from image classification to signal reconstruction, in principle. However, our experiments also expose three fundamental difficulties in the evaluation of DARTS based methods in inverse problems First, the results show a large variance in all test cases. Second, the final performance is highly dependent on the hyperparameters of the optimizer. And third, the performance of the weight sharing architecture used during training does not reflect the final performance of the found architecture well. Thus, we conclude the necessity to 1) report the results of any DARTS based methods from several runs along with its underlying performance statistics, 2) show the correlation of the training and final architecture performance, and 3) carefully consider if the computational efficiency of DARTS outweighs the costs of hyperparameter optimization and multiple runs.


Large Dimensional Random Matrix Theory and Its Applications in Deep Learning and Wireless Communications. Large dimensional random matrix theory, RMT for short, which originates from the research field of quantum physics, has shown tremendous capability in providing deep insights into large dimensional systems. With the fact that we have entered an unprecedented era full of massive amounts of data and large complex systems, RMT is expected to play more important roles in the analysis and design of modern systems. In this paper, we review the key results of RMT and its applications in two emerging fields wireless communications and deep learning. In wireless communications, we show that RMT can be exploited to design the spectrum sensing algorithms for cognitive radio systems and to perform the design and asymptotic analysis for large communication systems. In deep learning, RMT can be utilized to analyze the Hessian, input output Jacobian and data covariance matrix of the deep neural networks, thereby to understand and improve the convergence and the learning speed of the neural networks. Finally, we highlight some challenges and opportunities in applying RMT to the practical large dimensional systems.


Technical Report Edge centric Programming for IoT Applications with EdgeProg. IoT application development usually involves separate programming at the device side and server side. While separate programming style is sufficient for many simple applications, it is not suitable for many complex applications that involve complex interactions and intensive data processing. We propose EdgeProg, an edge centric programming approach to simplify IoT application programming, motivated by the increasing popularity of edge computing. With EdgeProg, users could write application logic in a centralized manner with an augmented If This Then That (IFTTT) syntax and virtual sensor mechanism. The program can be processed at the edge server, which can automatically generate the actual application code and intelligently partition the code into device code and server code, for achieving the optimal latency. EdgeProg employs dynamic linking and loading to deploy the device code on a variety of IoT devices, which do not run any application specific codes at the start. Results show that EdgeProg achieves an average reduction of 20.96 , 27.8 and 79.41 in terms of execution latency, energy consumption, and lines of code compared with state of the art approaches.


Do Proportionate Algorithms Exploit Sparsity?. Adaptive filters exploiting sparsity have been a very active research field, among which the algorithms that follow the "proportional update principle", the so called proportionate type algorithms, are very popular. Indeed, there are hundreds of works on proportionate type algorithms and, therefore, their advantages are widely known. This paper addresses the unexplored drawbacks and limitations of using proportional updates and their practical impacts. Our findings include the theoretical justification for the poor performance of these algorithms in several sparse scenarios, and also when dealing with non stationary and compressible systems. Simulation results corroborating the theory are presented.


Computer Science Communities Who is Speaking, and Who is Listening to the Women? Using an Ethics of Care to Promote Diverse Voices. Those working on policy, digital ethics and governance often refer to issues in computer science', that includes, but is not limited to, common subfields of Artificial Intelligence (AI), Computer Science (CS) Computer Security (InfoSec), Computer Vision (CV), Human Computer Interaction (HCI), Information Systems, (IS), Machine Learning (ML), Natural Language Processing (NLP) and Systems Architecture. Within this framework, this paper is a preliminary exploration of two hypotheses, namely 1) Each community has differing inclusion of minoritised groups (using women as our test case) and 2) Even where women exist in a community, they are not published representatively. Using data from 20,000 research records, totalling 503,318 names, preliminary data supported our hypothesis. We argue that ACM has an ethical duty of care to its community to increase these ratios, and to hold individual computing communities to account in order to do so, by providing incentives and a regular reporting system, in order to uphold its own Code.


A new model for acoustic poroelastic coupling of compressional body and Stoneley waves at a fault zone. In vertical seismic profiling (VSP), Stoneley (tube) waves are generated due to the coupling between the borehole fluid and the surrounding poroelastic formation. The tube waves have been exploited in the past to infer the in situ hydraulic properties. In order to understand better the physical mechanisms underlying the generation of tube waves at a fault zone, we develop a new model that calculates the pressure responses in a borehole. The model incorporates simultaneous effects of elastic impedance boundaries, fluid infiltration from poroelastic formation, and irregularities in the borehole radius. The analytical tube wave amplitudes are derived from the new model assuming a normally incident plane P wave, verified by complete numerical solutions for Biot's theory of dynamic poroelasticity. We find that the upgoing and downgoing tube waves due to an elastic impedance boundary have opposite polarities, and those excited by a thin poroelastic layer have different wave shapes. The model also enables the prediction of a VSP response at a major fault zone in Japan (Nojima fault). Our quantitative evaluation suggests that tube waves are generated by elastic impedance boundaries and borehole irregularities around the main shear zone of the fault, as well as due to the presence of several porous layers. We also find that the modeled amplitudes agree well with the observation, especially when assuming a heterogeneous permeability distribution. The developed model and the presented results will be crucial in quantitatively interpreting the VSP data in order to estimate the fault zone's hydraulic properties.


Contextual Bandit Applications in Customer Support Bot. Virtual support agents have grown in popularity as a way for businesses to provide better and more accessible customer service. Some challenges in this domain include ambiguous user queries as well as changing support topics and user behavior (non stationarity). We do, however, have access to partial feedback provided by the user (clicks, surveys, and other events) which can be leveraged to improve the user experience. Adaptable learning techniques, like contextual bandits, are a natural fit for this problem setting. In this paper, we discuss real world implementations of contextual bandits (CB) for the Microsoft virtual agent. It includes intent disambiguation based on neural linear bandits (NLB) and contextual recommendations based on a collection of multi armed bandits (MAB). Our solutions have been deployed to production and have improved key business metrics of the Microsoft virtual agent, as confirmed by A B experiments. Results include a relative increase of over 12 in problem resolution rate and relative decrease of over 4 in escalations to a human operator. While our current use cases focus on intent disambiguation and contextual recommendation for support bots, we believe our methods can be extended to other domains.


Transient Polarization and Dendrite Initiation Dynamics in Ceramic Electrolytes. Solid state electrolytes, by enabling lithium metal anodes, may significantly increase the energy density of current lithium ion batteries. However, similar to their liquid counterparts, these hard and stiff electrolytes can still be penetrated by soft Li metal, above a critical current density (CCD). The prevailing method to determine the CCD employs step wise galvanostatic cycling, which suffers from inconsistent active interfacial areas due to void formations after repeated stripping and plating, leaving large variance in the reported data that preclude precision understandings. Here, we combine a one way polarization technique with electrochemical impedance spectroscopy to uncover, for the first time, the existence of significant polarization dynamics in ceramic electrolytes. In contrast to the diverging transient current due to metal penetration, the current peaks we observed suggest a diffusion limited mechanism that follows the classic Randles Sevcik equation for analyzing the diffusion limited processes in liquid electrolytes. Our results allow a rigorous self consistent analysis to reveal that the CCD is a diffusion limited current density, while the system specific limiting current density for ceramic electrolytes is still lower than CCD, which suggests that the ion transport mechanism preceding the dendrite penetration in ceramic electrolytes is unifiable with that in liquid electrolytes.


Vision Language Navigation A Survey and Taxonomy. Vision Language Navigation (VLN) tasks require an agent to follow human language instructions to navigate in previously unseen environments. This challenging field involving problems in natural language processing, computer vision, robotics, etc., has spawn many excellent works focusing on various VLN tasks. This paper provides a comprehensive survey and an insightful taxonomy of these tasks based on the different characteristics of language instructions in these tasks. Depending on whether the navigation instructions are given for once or multiple times, this paper divides the tasks into two categories, i.e., single turn and multi turn tasks. For single turn tasks, we further subdivide them into goal oriented and route oriented based on whether the instructions designate a single goal location or specify a sequence of multiple locations. For multi turn tasks, we subdivide them into passive and interactive tasks based on whether the agent is allowed to question the instruction or not. These tasks require different capabilities of the agent and entail various model designs. We identify progress made on the tasks and look into the limitations of existing VLN models and task settings. Finally, we discuss several open issues of VLN and point out some opportunities in the future, i.e., incorporating knowledge with VLN models and implementing them in the real physical world.


Looking Beyond Two Frames End to End Multi Object Tracking Using Spatial and Temporal Transformers. Tracking a time varying indefinite number of objects in a video sequence over time remains a challenge despite recent advances in the field. Ignoring long term temporal information, most existing approaches are not able to properly handle multi object tracking challenges such as occlusion. To address these shortcomings, we present MO3TR a truly end to end Transformer based online multi object tracking (MOT) framework that learns to handle occlusions, track initiation and termination without the need for an explicit data association module or any heuristics post processing. MO3TR encodes object interactions into long term temporal embeddings using a combination of spatial and temporal Transformers, and recursively uses the information jointly with the input data to estimate the states of all tracked objects over time. The spatial attention mechanism enables our framework to learn implicit representations between all the objects and the objects to the measurements, while the temporal attention mechanism focuses on specific parts of past information, allowing our approach to resolve occlusions over multiple frames. Our experiments demonstrate the potential of this new approach, reaching new state of the art results on multiple MOT metrics for two popular multi object tracking benchmarks. Our code will be made publicly available.


Impact of lockdowns and winter temperatures on natural gas consumption in Europe. As the COVID 19 virus spread over the world, governments restricted mobility to slow transmission. Public health measures had different intensities across European countries but all had significant impact on peoples daily lives and economic activities, causing a drop of CO2 emissions of about 10 for the whole year 2020. Here, we analyze changes in natural gas use in the industry and built environment sectors during the first half of year 2020 with daily gas flows data from pipeline and storage facilities in Europe. We find that reductions of industrial gas use reflect decreases in industrial production across most countries. Surprisingly, natural gas use in buildings also decreased despite most people being confined at home and cold spells in March 2020. Those reductions that we attribute to the impacts of COVID 19 remain of comparable magnitude to previous variations induced by cold or warm climate anomalies in the cold season. We conclude that climate variations played a larger role than COVID 19 induced stay home orders in natural gas consumption across Europe.


Stack Index Prediction Using Time Series Analysis. The Prevalence of Community support and engagement for different domains in the tech industry has changed and evolved throughout the years. In this study, we aim to understand, analyze and predict the trends of technology in a scientific manner, having collected data on numerous topics and their growth throughout the years in the past decade. We apply machine learning models on collected data, to understand, analyze and forecast the trends in the advancement of different fields. We show that certain technical concepts such as python, machine learning, and Keras have an undisputed uptrend, finally concluding that the Stackindex model forecasts with high accuracy and can be a viable tool for forecasting different tech domains.


Entity Relation Extraction as Dependency Parsing in Visually Rich Documents. Previous works on key information extraction from visually rich documents (VRDs) mainly focus on labeling the text within each bounding box (i.e., semantic entity), while the relations in between are largely unexplored. In this paper, we adapt the popular dependency parsing model, the biaffine parser, to this entity relation extraction task. Being different from the original dependency parsing model which recognizes dependency relations between words, we identify relations between groups of words with layout information instead. We have compared different representations of the semantic entity, different VRD encoders, and different relation decoders. The results demonstrate that our proposed model achieves 65.96 F1 score on the FUNSD dataset. As for the real world application, our model has been applied to the in house customs data, achieving reliable performance in the production setting.


Revisiting the Primal Dual Method of Multipliers for Optimisation over Centralised Networks. The primal dual method of multipliers (PDMM) was originally designed for solving a decomposable optimisation problem over a general network. In this paper, we revisit PDMM for optimisation over a centralized network. We first note that the recently proposed method FedSplit 1 implements PDMM for a centralized network. In 1 , Inexact FedSplit (i.e., gradient based FedSplit) was also studied both empirically and theoretically. We identify the cause for the poor reported performance of Inexact FedSplit, which is due to the improper initialisation in the gradient operations at the client side. To fix the issue of Inexact FedSplit, we propose two versions of Inexact PDMM, which are referred to as gradient based PDMM (GPDMM) and accelerated GPDMM (AGPDMM), respectively. AGPDMM accelerates GPDMM at the cost of transmitting two times the number of parameters from the server to each client per iteration compared to GPDMM. We provide a new convergence bound for GPDMM for a class of convex optimisation problems. Our new bounds are tighter than those derived for Inexact FedSplit. We also investigate the update expressions of AGPDMM and SCAFFOLD to find their similarities. It is found that when the number K of gradient steps at the client side per iteration is K 1, both AGPDMM and SCAFFOLD reduce to vanilla gradient descent with proper parameter setup. Experimental results indicate that AGPDMM converges faster than SCAFFOLD when K 1 while GPDMM converges slightly worse than SCAFFOLD.


Boosting Anomaly Detection Using Unsupervised Diverse Test Time Augmentation. Anomaly detection is a well known task that involves the identification of abnormal events that occur relatively infrequently. Methods for improving anomaly detection performance have been widely studied. However, no studies utilizing test time augmentation (TTA) for anomaly detection in tabular data have been performed. TTA involves aggregating the predictions of several synthetic versions of a given test sample TTA produces different points of view for a specific test instance and might decrease its prediction bias. We propose the Test Time Augmentation for anomaly Detection (TTAD) technique, a TTA based method aimed at improving anomaly detection performance. TTAD augments a test instance based on its nearest neighbors various methods, including the k Means centroid and SMOTE methods, are used to produce the augmentations. Our technique utilizes a Siamese network to learn an advanced distance metric when retrieving a test instance's neighbors. Our experiments show that the anomaly detector that uses our TTA technique achieved significantly higher AUC results on all datasets evaluated.


Deciding What to Learn A Rate Distortion Approach. Agents that learn to select optimal actions represent a prominent focus of the sequential decision making literature. In the face of a complex environment or constraints on time and resources, however, aiming to synthesize such an optimal policy can become infeasible. These scenarios give rise to an important trade off between the information an agent must acquire to learn and the sub optimality of the resulting policy. While an agent designer has a preference for how this trade off is resolved, existing approaches further require that the designer translate these preferences into a fixed learning target for the agent. In this work, leveraging rate distortion theory, we automate this process such that the designer need only express their preferences via a single hyperparameter and the agent is endowed with the ability to compute its own learning targets that best achieve the desired trade off. We establish a general bound on expected discounted regret for an agent that decides what to learn in this manner along with computational experiments that illustrate the expressiveness of designer preferences and even show improvements over Thompson sampling in identifying an optimal policy.


Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT. The availability of biomedical text data and advances in natural language processing (NLP) have made new applications in biomedical NLP possible. Language models trained or fine tuned using domain specific corpora can outperform general models, but work to date in biomedical NLP has been limited in terms of corpora and tasks. We present BioALBERT, a domain specific adaptation of A Lite Bidirectional Encoder Representations from Transformers (ALBERT), trained on biomedical (PubMed and PubMed Central) and clinical (MIMIC III) corpora and fine tuned for 6 different tasks across 20 benchmark datasets. Experiments show that BioALBERT outperforms the state of the art on named entity recognition ( 11.09 BLURB score improvement), relation extraction ( 0.80 BLURB score), sentence similarity ( 1.05 BLURB score), document classification ( 0.62 F1 score), and question answering ( 2.83 BLURB score). It represents a new state of the art in 17 out of 20 benchmark datasets. By making BioALBERT models and data available, our aim is to help the biomedical NLP community avoid computational costs of training and establish a new set of baselines for future efforts across a broad range of biomedical NLP tasks.


Experimental Observation of Partial Parity Time Symmetry and Its Phase Transition with a Laser Driven Cesium Atomic Gas. Realization and manipulation of parity time (PT) symmetry in multidimensional systems are highly desirable for exploring nontrivial physics and uncovering exotic phenomena in non Hermitian systems. Here, we report the first experimental observation of partial PT (pPT) symmetry in a cesium atomic gas coupled with laser fields, where a two dimensional pPT symmetric optical potential for probe laser beam is created. A transition of the pPT symmetry from an unbroken phase to a broken one is observed through changing the beam waist ratio of the control and probe laser beams, and the domains of unbroken, broken, and non pPT phases are also discriminated unambiguously. Moreover, we develop a technique to precisely determine the location of the exceptional point of the pPT symmetry breaking by measuring the asymmetry degree of the probe beam intensity distribution. The findings reported here pave the way for controlling multidimensional laser beams in non Hermitian systems via laser induced atomic coherence, and have potential applications for designing new types of light amplifiers and attenuators


Descent of derived equivalences in rm SL (2,p n) . We show that the derived equivalences between the full defect p blocks of rm SL (2,p n) and their Brauer correspondents, constructed by Okuyama and Yoshii, descend to mathbb F p . As a corollary, the blockwise Navarro conjecture holds for p blocks of rm SL (2,p n) .


Adversarial Attacks on Black Box Video Classifiers Leveraging the Power of Geometric Transformations. When compared to the image classification models, black box adversarial attacks against video classification models have been largely understudied. This could be possible because, with video, the temporal dimension poses significant additional challenges in gradient estimation. Query efficient black box attacks rely on effectively estimated gradients towards maximizing the probability of misclassifying the target video. In this work, we demonstrate that such effective gradients can be searched for by parameterizing the temporal structure of the search space with geometric transformations. Specifically, we design a novel iterative algorithm Geometric TRAnsformed Perturbations (GEO TRAP), for attacking video classification models. GEO TRAP employs standard geometric transformation operations to reduce the search space for effective gradients into searching for a small group of parameters that define these operations. This group of parameters describes the geometric progression of gradients, resulting in a reduced and structured search space. Our algorithm inherently leads to successful perturbations with surprisingly few queries. For example, adversarial examples generated from GEO TRAP have better attack success rates with 73.55 fewer queries compared to the state of the art method for video adversarial attacks on the widely used Jester dataset. Overall, our algorithm exposes vulnerabilities of diverse video classification models and achieves new state of the art results under black box settings on two large datasets. Code is available here https github.com sli057 Geo TRAP


Few shot Knowledge Graph to Text Generation with Pretrained Language Models. This paper studies how to automatically generate a natural language text that describes the facts in knowledge graph (KG). Considering the few shot setting, we leverage the excellent capacities of pretrained language models (PLMs) in language understanding and generation. We make three major technical contributions, namely representation alignment for bridging the semantic gap between KG encodings and PLMs, relation biased KG linearization for deriving better input representations, and multi task learning for learning the correspondence between KG and text. Extensive experiments on three benchmark datasets have demonstrated the effectiveness of our model on KG to text generation task. In particular, our model outperforms all comparison methods on both fully supervised and few shot settings. Our code and datasets are available at https github.com RUCAIBox Few Shot KG2Text.


Horizontal magnetic fields and improved Hardy inequalities in the Heisenberg group. In this paper we introduce a notion of magnetic field in the Heisenberg group and we study its influence on spectral properties of the corresponding magnetic (sub elliptic) Laplacian. We show that uniform magnetic fields uplift the bottom of the spectrum. For magnetic fields vanishing at infinity, including Aharonov Bohm potentials, we derive magnetic improvements to a variety of Hardy type inequalities for the Heisenberg sub Laplacian. In particular, we establish a sub Riemannian analogue of Laptev and Weidl sub criticality result for magnetic Laplacians in the plane. Instrumental for our argument is the validity of a Hardy type inequality for the Folland Stein operator, that we prove in this paper and has an interest on its own.


Directed Data Processing Inequalities for Systems with Feedback. We present novel data processing inequalities relating the mutual information and the directed information in systems with feedback. The internal blocks within such systems are restricted only to be causal mappings, but are allowed to be non linear, stochastic and time varying. These blocks can for example represent source encoders, decoders or even communication channels. Moreover, the involved signals can be arbitrarily distributed. Our first main result relates mutual and directed informations and can be interpreted as a law of conservation of information flow. Our second main result is a pair of data processing inequalities (one the conditional version of the other) between nested pairs of random sequences entirely within the closed loop. Our third main result is introducing and characterizing the notion of in the loop (ITL) transmission rate for channel coding scenarios in which the messages are internal to the loop. Interestingly, in this case the conventional notions of transmission rate associated with the entropy of the messages and of channel capacity based on maximizing the mutual information between the messages and the output turn out to be inadequate. Instead, as we show, the ITL transmission rate is the unique notion of rate for which a channel code attains zero error probability if and only if such ITL rate does not exceed the corresponding directed information rate from messages to decoded messages. We apply our data processing inequalities to show that the supremum of achievable (in the usual channel coding sense) ITL transmission rates is upper bounded by the supremum of the directed information rate across the communication channel. Moreover, we present an example in which this upper bound is attained. Finally, ...


The Third Transition in Science Beyond Newton and Quantum Mechanics A Statistical Mechanics of Emergence. Since Newton all of classical and quantum physics depends upon the "Newtonian Paradigm" (NP). Here the relevant variables of the system are identified. The boundary conditions creating the phase space of all possible values of the variables are defined. Then, given any initial condition, the differential equations of motion are integrated to yield an entailed trajectory in the pre stated phase space. In the NP the set of possibilities that constitute the phase space is always definable ahead of time. All of this fails for the diachronic evolution of ever new adaptations in our or any biosphere. The central reason is that living cells achieve Constraint Closure and construct themselves. Living cells, evolving via heritable variation and Natural selection, adaptively construct new in the universe possibilities. The new possibilities are opportunities for new adaptations thereafter seized by heritable variation and Natural Selection. Surprisingly, we can neither define nor deduce the evolving phase spaces ahead of time. The reason we cannot deduce the ever evolving phase spaces of life is that we can use no mathematics based on Set Theory to do so. The ever new adaptations with ever new relevant variables constitute the ever changing phase space of evolving biospheres. Because of this, evolving biospheres are entirely outside the NP. One consequence is that for any universe such as ours with one or more evolving biospheres, there can be no final theory that entails all that comes to exist. We face a third major transition in science. We must give up deducing the diachronic evolution of the biosphere. All of physics, classical and quantum, however, apply to the analysis of existing life, a synchronic analysis. We begin to better understand the emergent creativity of an evolving biosphere. We are on the edge of inventing a physics like new statistical mechanics of emergence.


Learning Invariant Representations using Inverse Contrastive Loss. Learning invariant representations is a critical first step in a number of machine learning tasks. A common approach corresponds to the so called information bottleneck principle in which an application dependent function of mutual information is carefully chosen and optimized. Unfortunately, in practice, these functions are not suitable for optimization purposes since these losses are agnostic of the metric structure of the parameters of the model. We introduce a class of losses for learning representations that are invariant to some extraneous variable of interest by inverting the class of contrastive losses, i.e., inverse contrastive loss (ICL). We show that if the extraneous variable is binary, then optimizing ICL is equivalent to optimizing a regularized MMD divergence. More generally, we also show that if we are provided a metric on the sample space, our formulation of ICL can be decomposed into a sum of convex functions of the given distance metric. Our experimental results indicate that models obtained by optimizing ICL achieve significantly better invariance to the extraneous variable for a fixed desired level of accuracy. In a variety of experimental settings, we show applicability of ICL for learning invariant representations for both continuous and discrete extraneous variables.


Factorization of Hilbert class polynomials over prime fields. Let D be a negative integer congruent to 0 or 1 bmod 4 and mathcal O mathcal O D be the corresponding order of K mathbb Q ( sqrt D ) . The Hilbert class polynomial H D(x) is the minimal polynomial of the j invariant j D j( mathbb C mathcal O ) of mathcal O over K . Let n D ( mathcal O mathbb Q ( j D) mathbb Z j D ) denote the index of mathbb Z j D in the ring of integers of mathbb Q (j D) . Suppose p is any prime. We completely determine the factorization of H D(x) in mathbb F p x if either p nmid n D or p nmid D is inert in K and the p adic valuation v p(n D) leq 3 . As an application, we analyze the key space of Oriented Supersingular Isogeny Diffie Hellman (OSIDH) protocol proposed by Col o and Kohel in 2019 which is the roots set of the Hilbert class polynomial in mathbb F p 2 .


Bio Inspired Representation Learning for Visual Attention Prediction. Visual Attention Prediction (VAP) is a significant and imperative issue in the field of computer vision. Most of existing VAP methods are based on deep learning. However, they do not fully take advantage of the low level contrast features while generating the visual attention map. In this paper, a novel VAP method is proposed to generate visual attention map via bio inspired representation learning. The bio inspired representation learning combines both low level contrast and high level semantic features simultaneously, which are developed by the fact that human eye is sensitive to the patches with high contrast and objects with high semantics. The proposed method is composed of three main steps 1) feature extraction, 2) bio inspired representation learning and 3) visual attention map generation. Firstly, the high level semantic feature is extracted from the refined VGG16, while the low level contrast feature is extracted by the proposed contrast feature extraction block in a deep network. Secondly, during bio inspired representation learning, both the extracted low level contrast and high level semantic features are combined by the designed densely connected block, which is proposed to concatenate various features scale by scale. Finally, the weighted fusion layer is exploited to generate the ultimate visual attention map based on the obtained representations after bio inspired representation learning. Extensive experiments are performed to demonstrate the effectiveness of the proposed method.


iFacetSum Coreference based Interactive Faceted Summarization for Multi Document Exploration. We introduce iFacetSum, a web application for exploring topical document sets. iFacetSum integrates interactive summarization together with faceted search, by providing a novel faceted navigation scheme that yields abstractive summaries for the user's selections. This approach offers both a comprehensive overview as well as concise details regarding subtopics of choice. Fine grained facets are automatically produced based on cross document coreference pipelines, rendering generic concepts, entities and statements surfacing in the source texts. We analyze the effectiveness of our application through small scale user studies, which suggest the usefulness of our approach.


A Transformer based Math Language Model for Handwritten Math Expression Recognition. Handwritten mathematical expressions (HMEs) contain ambiguities in their interpretations, even for humans sometimes. Several math symbols are very similar in the writing style, such as dot and comma or 0, O, and o, which is a challenge for HME recognition systems to handle without using contextual information. To address this problem, this paper presents a Transformer based Math Language Model (TMLM). Based on the self attention mechanism, the high level representation of an input token in a sequence of tokens is computed by how it is related to the previous tokens. Thus, TMLM can capture long dependencies and correlations among symbols and relations in a mathematical expression (ME). We trained the proposed language model using a corpus of approximately 70,000 LaTeX sequences provided in CROHME 2016. TMLM achieved the perplexity of 4.42, which outperformed the previous math language models, i.e., the N gram and recurrent neural network based language models. In addition, we combine TMLM into a stochastic context free grammar based HME recognition system using a weighting parameter to re rank the top 10 best candidates. The expression rates on the testing sets of CROHME 2016 and CROHME 2019 were improved by 2.97 and 0.83 percentage points, respectively.