Time Frequency Analysis based Deep Interference Classification for Frequency Hopping System. It is known that, interference classification plays an important role in protecting the authorized communication system and avoiding its performance degradation in the hostile environment. In this paper, the interference classification problem for the frequency hopping communication system is discussed. Considering the possibility of presence multiple interferences in the frequency hopping system, in order to fully extract effective features of the interferences from the received signals, the linear and bilinear transform based composite time frequency analysis method is adopted. Then the time frequency spectrograms obtained from the time frequency analysis are constructed as matching pairs and input to the deep neural network for classification. In particular, the Siamese neural network is used as the classifier, where the paired spectrograms are input into the two sub networks of the deep networks, and these two sub networks extract the features of the paired spectrograms for interference type classification. The simulation results confirm that the proposed algorithm can obtain higher classification accuracy than both traditional single time frequency representation based approach and the AlexNet transfer learning or convolutional neural network based methods.


Response Dynamics of Alkali Metal Noble Gas Hybrid Trispin System. With numerical calculation of coupled Bloch equations, we have simulated the spin dynamics of nuclear magnetic resonance gyroscope based on alkali metal noble gas hybrid trispin system. From the perspective of damping harmonic oscillator, a thorough analysis of the response dynamics is demonstrated. The simulation results shows a linear increasing response of gyroscope signal while the noblge gas nuclear spin magnetization and alkali atomic spin lifetime parameters are at the over damping condition. An upper limit of response is imposed on the NMR gyroscope signal due to the inherent dynamics of the hybrid trispin system. The results agrees with present available experimental results and provide useful guidings for future experiments.


Mixed Sobolev like Inequalities in Lebesgue spaces of variable exponents and in Orlicz spaces. In this short article we show a particular version of the Hedberg inequality which can be used to derive, in a very simple manner, functional inequalities involving Sobolev and Besov spaces in the general setting of Lebesgue spaces of variable exponents and in the framework of Orlicz spaces.


Numerical analysis of a model of two phase compressible fluid flow. We consider a model of a binary mixture of two immiscible compressible fluids. We propose a numerical scheme and discuss its basic properties Stability, consistency, convergence. The convergence is established via the method of generalized weak solutions combined with the weak strong uniqueness principle.


Fast Multi Step Critiquing for VAE based Recommender Systems. Recent studies have shown that providing personalized explanations alongside recommendations increases trust and perceived quality. Furthermore, it gives users an opportunity to refine the recommendations by critiquing parts of the explanations. On one hand, current recommender systems model the recommendation, explanation, and critiquing objectives jointly, but this creates an inherent trade off between their respective performance. On the other hand, although recent latent linear critiquing approaches are built upon an existing recommender system, they suffer from computational inefficiency at inference due to the objective optimized at each conversation's turn. We address these deficiencies with M Ms VAE, a novel variational autoencoder for recommendation and explanation that is based on multimodal modeling assumptions. We train the model under a weak supervision scheme to simulate both fully and partially observed variables. Then, we leverage the generalization ability of a trained M Ms VAE model to embed the user preference and the critique separately. Our work's most important innovation is our critiquing module, which is built upon and trained in a self supervised manner with a simple ranking objective. Experiments on four real world datasets demonstrate that among state of the art models, our system is the first to dominate or match the performance in terms of recommendation, explanation, and multi step critiquing. Moreover, M Ms VAE processes the critiques up to 25.6x faster than the best baselines. Finally, we show that our model infers coherent joint and cross generation, even under weak supervision, thanks to our multimodal based modeling and training scheme.


Going Beyond Neural Architecture Search with Sampling based Neural Ensemble Search. Recently, Neural Architecture Search (NAS) has been widely applied to automate the design of deep neural networks. Various NAS algorithms have been proposed to reduce the search cost and improve the generalization performance of those final selected architectures. However, these NAS algorithms aim to select only a single neural architecture from the search spaces and thus have overlooked the capability of other candidate architectures in helping improve the performance of their final selected architecture. To this end, we present two novel sampling algorithms under our Neural Ensemble Search via Sampling (NESS) framework that can effectively and efficiently select a well performing ensemble of neural architectures from NAS search space. Compared with state of the art NAS algorithms and other well known ensemble search baselines, our NESS algorithms are shown to be able to achieve improved performance in both classification and adversarial defense tasks on various benchmark datasets while incurring a comparable search cost to these NAS algorithms.


Location of high degree vertices in weighted recursive graphs with bounded random weights. We study the asymptotic growth rate of the label size of high degree vertices in weighted recursive graphs (WRG) when the weights are i.i.d. almost surely bounded random variables, and as a result confirm a conjecture by Lodewijks and Ortgiese. WRGs are a generalisation of the random recursive tree (RRT) and directed acyclic graph model (DAG), in which vertices are assigned vertex weights and where new vertices attach to m in mathbb N predecessors, each selected independently with a probability proportional to the vertex weight of the predecessor. Prior work established the asymptotic growth rate of the maximum degree of the WRG model and here we show that there exists a critical exponent mu m , such that the typical label size of the maximum degree vertex equals n mu m(1 o(1)) almost surely as n , the size of the graph, tends to infinity. These results extend and improve on the asymptotic behaviour of the location of the maximum degree, formerly only known for the RRT model, to the more general weighted multigraph case of the WRG model. Moreover, for the Weighted Recursive Tree (WRT) model, that is, the WRG model with m 1 , we prove the joint convergence of the rescaled degree and label of high degree vertices under additional assumptions on the vertex weight distribution, and also extend results on the growth rate of the maximum degree obtained by Eslava, Lodewijks and Ortgiese.


Temporally Coherent Surface Reconstruction via Metric Consistent Atlases. We propose a method for the unsupervised reconstruction of a temporally coherent sequence of surfaces from a sequence of time evolving point clouds, yielding dense, semantically meaningful correspondences between all keyframes. We represent the reconstructed surface as an atlas, using a neural network. Using canonical correspondences defined via the atlas, we encourage the reconstruction to be as isometric as possible across frames, leading to semantically meaningful reconstruction. Through experiments and comparisons, we empirically show that our method achieves results that exceed that state of the art in the accuracy of unsupervised correspondences and accuracy of surface reconstruction.


Consistent Semantic Attacks on Optical Flow. We present a novel approach for semantically targeted adversarial attacks on Optical Flow. In such attacks the goal is to corrupt the flow predictions of a specific object category or instance. Usually, an attacker seeks to hide the adversarial perturbations in the input. However, a quick scan of the output reveals the attack. In contrast, our method helps to hide the attackers intent in the output as well. We achieve this thanks to a regularization term that encourages off target consistency. We perform extensive tests on leading optical flow models to demonstrate the benefits of our approach in both white box and black box settings. Also, we demonstrate the effectiveness of our attack on subsequent tasks that depend on the optical flow.


Cognitive network science quantifies feelings expressed in suicide letters and Reddit mental health communities. Writing messages is key to expressing feelings. This study adopts cognitive network science to reconstruct how individuals report their feelings in clinical narratives like suicide notes or mental health posts. We achieve this by reconstructing syntactic semantic associations between conceptsin texts as co occurrences enriched with affective data. We transform 142 suicide notes and 77,000 Reddit posts from the r anxiety, r depression, r schizophrenia, and r do it your own (r DIY) forums into 5 cognitive networks, each one expressing meanings and emotions as reported by authors. These networks reconstruct the semantic frames surrounding 'feel', enabling a quantification of prominent associations and emotions focused around feelings. We find strong feelings of sadness across all clinical Reddit boards, added to fear r depression, and replaced by joy anticipation in r DIY. Semantic communities and topic modelling both highlight key narrative topics of 'regret', 'unhealthy lifestyle' and 'low mental well being'. Importantly, negative associations and emotions co existed with trustful positive language, focused on 'getting better'. This emotional polarisation provides quantitative evidence that online clinical boards possess a complex structure, where users mix both positive and negative outlooks. This dichotomy is absent in the r DIY reference board and in suicide notes, where negative emotional associations about regret and pain persist but are overwhelmed by positive jargon addressing loved ones. Our quantitative comparisons provide strong evidence that suicide notes encapsulate different ways of expressing feelings compared to online Reddit boards, the latter acting more like personal diaries and relief valve. Our findings provide an interpretable, quantitative aid for supporting psychological inquiries of human feelings in digital and clinical settings.


VisGraphNet a complex network interpretation of convolutional neural features. Here we propose and investigate the use of visibility graphs to model the feature map of a neural network. The model, initially devised for studies on complex networks, is employed here for the classification of texture images. The work is motivated by an alternative viewpoint provided by these graphs over the original data. The performance of the proposed method is verified in the classification of four benchmark databases, namely, KTHTIPS 2b, FMD, UIUC, and UMD and in a practical problem, which is the identification of plant species using scanned images of their leaves. Our method was competitive with other state of the art approaches, confirming the potential of techniques used for data analysis in different contexts to give more meaningful interpretation to the use of neural networks in texture classification.


BAAI VANJEE Roadside Dataset Towards the Connected Automated Vehicle Highway technologies in Challenging Environments of China. As the roadside perception plays an increasingly significant role in the Connected Automated Vehicle Highway(CAVH) technologies, there are immediate needs of challenging real world roadside datasets for bench marking and training various computer vision tasks such as 2D 3D object detection and multi sensor fusion. In this paper, we firstly introduce a challenging BAAI VANJEE roadside dataset which consist of LiDAR data and RGB images collected by VANJEE smart base station placed on the roadside about 4.5m high. This dataset contains 2500 frames of LiDAR data, 5000 frames of RGB images, including 20 collected at the same time. It also contains 12 classes of objects, 74K 3D object annotations and 105K 2D object annotations. By providing a real complex urban intersections and highway scenes, we expect the BAAI VANJEE roadside dataset will actively assist the academic and industrial circles to accelerate the innovation research and achievement transformation in the field of intelligent transportation in big data era.


On the Randomized Metric Distortion Conjecture. In the single winner determination problem, we have n voters and m candidates and each voter j incurs a cost c(i, j) if candidate i is chosen. Our objective is to choose a candidate that minimizes the expected total cost incurred by the voters however as we only have access to the agents' preference rankings over the outcomes, a loss of efficiency is inevitable. This loss of efficiency is quantified by distortion. We give an instance of the metric single winner determination problem for which any randomized social choice function has distortion at least 2.063164. This disproves the long standing conjecture that there exists a randomized social choice function that has a worst case distortion of at most 2.


Quantum Galois groups of subfactors. For a finite index mathrm II 1 subfactor N subset M , we prove the existence of a universal Hopf ast algebra (or, a discrete quantum group in the analytic language) acting on M in a trace preserving fashion and fixing N pointwise. We call this Hopf ast algebra the quantum Galois group for the subfactor and compute it in some examples of interest, notably for arbitrary irreducible finite index depth two subfactors. Along the way, we prove the existence of universal acting Hopf algebras for more general structures (tensors in enriched categories), in the spirit of recent work by Agore, Gordienko and Vercruysse.


Training Bi Encoders for Word Sense Disambiguation. Modern transformer based neural architectures yield impressive results in nearly every NLP task and Word Sense Disambiguation, the problem of discerning the correct sense of a word in a given context, is no exception. State of the art approaches in WSD today leverage lexical information along with pre trained embeddings from these models to achieve results comparable to human inter annotator agreement on standard evaluation benchmarks. In the same vein, we experiment with several strategies to optimize bi encoders for this specific task and propose alternative methods of presenting lexical information to our model. Through our multi stage pre training and fine tuning pipeline we further the state of the art in Word Sense Disambiguation.


CFNet Cascade and Fused Cost Volume for Robust Stereo Matching. Recently, the ever increasing capacity of large scale annotated datasets has led to profound progress in stereo matching. However, most of these successes are limited to a specific dataset and cannot generalize well to other datasets. The main difficulties lie in the large domain differences and unbalanced disparity distribution across a variety of datasets, which greatly limit the real world applicability of current deep stereo matching models. In this paper, we propose CFNet, a Cascade and Fused cost volume based network to improve the robustness of the stereo matching network. First, we propose a fused cost volume representation to deal with the large domain difference. By fusing multiple low resolution dense cost volumes to enlarge the receptive field, we can extract robust structural representations for initial disparity estimation. Second, we propose a cascade cost volume representation to alleviate the unbalanced disparity distribution. Specifically, we employ a variance based uncertainty estimation to adaptively adjust the next stage disparity search space, in this way driving the network progressively prune out the space of unlikely correspondences. By iteratively narrowing down the disparity search space and improving the cost volume resolution, the disparity estimation is gradually refined in a coarse to fine manner. When trained on the same training images and evaluated on KITTI, ETH3D, and Middlebury datasets with the fixed model parameters and hyperparameters, our proposed method achieves the state of the art overall performance and obtains the 1st place on the stereo task of Robust Vision Challenge 2020. The code will be available at https github.com gallenszl CFNet.


MUTEN Boosting Gradient Based Adversarial Attacks via Mutant Based Ensembles. Deep Neural Networks (DNNs) are vulnerable to adversarial examples, which causes serious threats to security critical applications. This motivated much research on providing mechanisms to make models more robust against adversarial attacks. Unfortunately, most of these defenses, such as gradient masking, are easily overcome through different attack means. In this paper, we propose MUTEN, a low cost method to improve the success rate of well known attacks against gradient masking models. Our idea is to apply the attacks on an ensemble model which is built by mutating the original model elements after training. As we found out that mutant diversity is a key factor in improving success rate, we design a greedy algorithm for generating diverse mutants efficiently. Experimental results on MNIST, SVHN, and CIFAR10 show that MUTEN can increase the success rate of four attacks by up to 0.45.


Sparse to dense Feature Matching Intra and Inter domain Cross modal Learning in Domain Adaptation for 3D Semantic Segmentation. Domain adaptation is critical for success when confronting with the lack of annotations in a new domain. As the huge time consumption of labeling process on 3D point cloud, domain adaptation for 3D semantic segmentation is of great expectation. With the rise of multi modal datasets, large amount of 2D images are accessible besides 3D point clouds. In light of this, we propose to further leverage 2D data for 3D domain adaptation by intra and inter domain cross modal learning. As for intra domain cross modal learning, most existing works sample the dense 2D pixel wise features into the same size with sparse 3D point wise features, resulting in the abandon of numerous useful 2D features. To address this problem, we propose Dynamic sparse to dense Cross Modal Learning (DsCML) to increase the sufficiency of multi modality information interaction for domain adaptation. For inter domain cross modal learning, we further advance Cross Modal Adversarial Learning (CMAL) on 2D and 3D data which contains different semantic content aiming to promote high level modal complementarity. We evaluate our model under various multi modality domain adaptation settings including day to night, country to country and dataset to dataset, brings large improvements over both uni modal and multi modal domain adaptation methods on all settings.


Fractional time stepping and adjoint based gradient computation in an inverse problem for a fractionally damped wave equation. In this paper we consider the inverse problem of identifying the initial data in a fractionally damped wave equation from time trace measurements on a surface, as relevant in photoacoustic or thermoacoustic tomography. We derive and analyze a time stepping method for the numerical solution of the corresponding forward problem. Moreover, to efficiently obtain reconstructions by minimizing a Tikhonov regularization functional (or alternatively, by computing the MAP estimator in a Bayesian approach), we develop an adjoint based scheme for gradient computation. Numerical reconstructions in two space dimensions illustrate the performance of the devised methods.


Gibbs measure for the focusing fractional NLS on the torus. We study the construction of the Gibbs measures for the it focusing mass critical fractional nonlinear Schr "odinger equation on the multi dimensional torus. We identify the sharp mass threshold for normalizability and non normalizability of the focusing Gibbs measures, which generalizes the influential works of Lebowitz Rose Speer (1988), Bourgain (1994), and Oh Sosoe Tolomeo (2021) on the one dimensional nonlinear Schr "odinger equations. To this purpose, we establish an almost sharp fractional Gagliardo Nirenberg Sobolev inequality on the torus, which is of independent interest.


Evaluation of gas permeability in porous separators for polymer electrolyte fuel cells CFD simulation based on micro X ray computed tomography images. Pore structures and gas transport properties in porous separators for polymer electrolyte fuel cells are evaluated both experimentally and through simulations. In the experiments, the gas permeabilities of two porous samples, a conventional sample and one with low electrical resistivity, are measured by a capillary flow porometer, and the pore size distributions are evaluated with mercury porosimetry. Local pore structures are directly observed with micro X ray computed tomography (CT). In the simulations, the effective diffusion coefficients of oxygen and the air permeability in porous samples are calculated using random walk Monte Carlo simulations and computational fluid dynamics (CFD) simulations, respectively, based on the X ray CT images. The calculated porosities and air permeabilities of the porous samples are in good agreement with the experimental values. The simulation results also show that the in plane permeability is twice the through plane permeability in the conventional sample, whereas it is slightly higher in the low resistivity sample. The results of this study show that CFD simulation based on micro X ray CT images makes it possible to evaluate anisotropic gas permeabilities in anisotropic porous media.


Radar Odometry Combining Probabilistic Estimation and Unsupervised Feature Learning. This paper presents a radar odometry method that combines probabilistic trajectory estimation and deep learned features without needing groundtruth pose information. The feature network is trained unsupervised, using only the on board radar data. With its theoretical foundation based on a data likelihood objective, our method leverages a deep network for processing rich radar data, and a non differentiable classic estimator for probabilistic inference. We provide extensive experimental results on both the publicly available Oxford Radar RobotCar Dataset and an additional 100 km of driving collected in an urban setting. Our sliding window implementation of radar odometry outperforms most hand crafted methods and approaches the current state of the art without requiring a groundtruth trajectory for training. We also demonstrate the effectiveness of radar odometry under adverse weather conditions. Code for this project can be found at https github.com utiasASRL hero radar odometry


Naive Descriptive Set Theory. The paper is a naive introduction to descriptive set theory. It is aimed mathematicians without a background in logic. The goal is to provide the basic facts used for applications of descriptive set theory to other areas of mathematics, particularly analysis and dynamical systems. The only topological or set theoretic background required is covered in undergraduate courses. It covers the hierarchy of Borel sets and the analytic sets, trees, Suslin's operation A, reductions, norms, separation theorems and uniformization.


Shifting Capsule Networks from the Cloud to the Deep Edge. Capsule networks (CapsNets) are an emerging trend in image processing. In contrast to a convolutional neural network, CapsNets are not vulnerable to object deformation, as the relative spatial information of the objects is preserved across the network. However, their complexity is mainly related with the capsule structure and the dynamic routing mechanism, which makes it almost unreasonable to deploy a CapsNet, in its original form, in a resource constrained device powered by a small microcontroller (MCU). In an era where intelligence is rapidly shifting from the cloud to the edge, this high complexity imposes serious challenges to the adoption of CapsNets at the very edge. To tackle this issue, we present an API for the execution of quantized CapsNets in Cortex M and RISC V MCUs. Our software kernels extend the Arm CMSIS NN and RISC V PULP NN, to support capsule operations with 8 bit integers as operands. Along with it, we propose a framework to perform post training quantization of a CapsNet. Results show a reduction in memory footprint of almost 75 , with a maximum accuracy loss of 1 . In terms of throughput, our software kernels for the Arm Cortex M are, at least, 5.70x faster than a pre quantized CapsNet running on an NVIDIA GTX 980 Ti graphics card. For RISC V, the throughout gain increases to 26.28x and 56.91x for a single and octa core configuration, respectively.


On non uniqueness issues related to the permeability of a porous medium with a random porous structure. This paper discusses the issue of non uniqueness of the permeability of a porous medium with a random structure. The permeability range for 12,000 realizations of a random porous structure is examined using a recently developed modelling approach, which results in up to two orders of magnitude permeability variations in low porosities. These findings are compared with previous results for 13,000 realizations with a scaled down size, and it is shown that the permeability histogram does not converge towards a narrower spectrum using larger domain sizes. The similarity between advective transport in an ensemble of porous media and a random walk phenomenon, accepted in the literature, is revisited and the inadequacy of the assumptions employed is discussed. It is shown that the conventional definition of advective transport in a porous medium, which is generally assumed to follow Hadamard's definition of well posedness, cannot be realised. The reconstruction of a porous structure from macroscopic parameters is in itself an ill posed inverse problem. To clarify this issue, explaining the ontic and epistemic identifications of a porous medium, it is discussed that while ontic identification cannot be employed for transport analysis, epistemic identification leads to non unique solutions. It is finally suggested that a paradigm shift is required for better formulation of the transport characteristics of porous media.


Empirical Analysis on Effectiveness of NLP Methods for Predicting Code Smell. A code smell is a surface indicator of an inherent problem in the system, most often due to deviation from standard coding practices on the developers part during the development phase. Studies observe that code smells made the code more susceptible to call for modifications and corrections than code that did not contain code smells. Restructuring the code at the early stage of development saves the exponentially increasing amount of effort it would require to address the issues stemming from the presence of these code smells. Instead of using traditional features to detect code smells, we use user comments to manually construct features to predict code smells. We use three Extreme learning machine kernels over 629 packages to identify eight code smells by leveraging feature engineering aspects and using sampling techniques. Our findings indicate that the radial basis functional kernel performs best out of the three kernel methods with a mean accuracy of 98.52.


Counterfactual Memorization in Neural Language Models. Modern neural language models widely used in tasks across NLP risk memorizing sensitive information from their training data. As models continue to scale up in parameters, training data, and compute, understanding memorization in language models is both important from a learning theoretical point of view, and is practically crucial in real world applications. An open question in previous studies of memorization in language models is how to filter out "common" memorization. In fact, most memorization criteria strongly correlate with the number of occurrences in the training set, capturing "common" memorization such as familiar phrases, public knowledge or templated texts. In this paper, we provide a principled perspective inspired by a taxonomy of human memory in Psychology. From this perspective, we formulate a notion of counterfactual memorization, which characterizes how a model's predictions change if a particular document is omitted during training. We identify and study counterfactually memorized training examples in standard text datasets. We further estimate the influence of each training example on the validation set and on generated texts, and show that this can provide direct evidence of the source of memorization at test time.


New source for tuning the effective Rabi frequency discovered in multiphoton ionization. The Autler Townes effect due to near resonance transition between 4s 4p states in potassium atoms is mapped out in the photo electron momentum distribution and manifests itself as a splitting in the photo electron kinetic energy spectra. The energy splitting fits well with the calculated Rabi frequency at low laser intensities and shows clear deviation at laser intensities above 1.5x10 11 W cm 2. An effective Rabi frequency formulae including the ionization process explains the observed results. Our results reveal the possibility to tune the effective coupling strength with the cost of the number of level populations.


Virtual Temporal Samples for Recurrent Neural Networks applied to semantic segmentation in agriculture. This paper explores the potential for performing temporal semantic segmentation in the context of agricultural robotics without temporally labelled data. We achieve this by proposing to generate virtual temporal samples from labelled still images. By exploiting the relatively static scene and assuming that the robot (camera) moves we are able to generate virtually labelled temporal sequences with no extra annotation effort. Normally, to train a recurrent neural network (RNN), labelled samples from a video (temporal) sequence are required which is laborious and has stymied work in this direction. By generating virtual temporal samples, we demonstrate that it is possible to train a lightweight RNN to perform semantic segmentation on two challenging agricultural datasets. Our results show that by training a temporal semantic segmenter using virtual samples we can increase the performance by an absolute amount of 4.6 and 4.9 on sweet pepper and sugar beet datasets, respectively. This indicates that our virtual data augmentation technique is able to accurately classify agricultural images temporally without the use of complicated synthetic data generation techniques nor with the overhead of labelling large amounts of temporal sequences.


Finite groups whose real classes have prime power size. We present a characterization of the finite groups in which all real classes have prime powers size.


Robotic Testbed for Rendezvous and Optical Navigation Multi Source Calibration and Machine Learning Use Cases. This work presents the most recent advances of the Robotic Testbed for Rendezvous and Optical Navigation (TRON) at Stanford University the first robotic testbed capable of validating machine learning algorithms for spaceborne optical navigation. The TRON facility consists of two 6 degrees of freedom KUKA robot arms and a set of Vicon motion track cameras to reconfigure an arbitrary relative pose between a camera and a target mockup model. The facility includes multiple Earth albedo light boxes and a sun lamp to recreate the high fidelity spaceborne illumination conditions. After the overview of the facility, this work details the multi source calibration procedure which enables the estimation of the relative pose between the object and the camera with millimeter level position and millidegree level orientation accuracies. Finally, a comparative analysis of the synthetic and TRON simulated imageries is performed using a Convolutional Neural Network (CNN) pre trained on the synthetic images. The result shows a considerable gap in the CNN's performance, suggesting the TRON simulated images can be used to validate the robustness of any machine learning algorithms trained on more easily accessible synthetic imagery from computer graphics.


Towards Understanding Enablers of Digital Transformation in Small and Medium Sized Enterprises. Even though, digital transformation has attracted much attention of both academics and practitioners, a very limited number of studies have investigated the digital transformation process in small and medium sized enterprises (SMEs) and the findings remain fragmented. Given the accessibility and availability of digital technologies to launch digital transformation initiatives and the importance of SMEs in the economy, a profound understanding of enablers of the digital transformation process in SMEs is much needed. As such, to address this, in this paper we conducted a comprehensive review of related literature in information systems, management, and business disciplines, to identify key enablers that facilitate the digital transformation process in SMEs.


Quantum chemistry augmented neural networks for reactivity prediction Performance, generalizability and interpretability. There is a perceived dichotomy between structure based and descriptor based molecular representations used for predictive chemistry tasks. Here, we study the performance, generalizability, and interpretability of the recently proposed quantum mechanics augmented graph neural network (ml QM GNN) architecture as applied to the prediction of regioselectivity (classification) and of activation energies (regression). In our hybrid QM augmented model architecture, structure based representations are first used to predict a set of atom and bond level reactivity descriptors derived from density functional theory (DFT) calculations. These estimated reactivity descriptors are combined with the original structure based representation to make the final reactivity prediction. We demonstrate that our model architecture leads to significant improvements over structure based GNNs in not only overall accuracy, but also in generalization to unseen compounds. Even when provided training sets of only a couple hundred labeled data points, the ml QM GNN outperforms other state of the art model architectures that have been applied to these tasks. Further, because the predictions of our model are grounded in (but not restricted to) QM descriptors, we are able to relate predictions to the conceptual frameworks commonly used to gain qualitative insights into reactivity phenomena. This effort results in a productive synergy between theory and data science, wherein our QM augmented models provide a data driven confirmation of previous qualitative analyses, and these analyses in their turn facilitate insights into the decision making process occurring within ml QM GNNs.


Rational maps from products of curves to surfaces with p g q 0 . We study dominant rational maps from a product of two curves to surfaces with p g q 0 . Given two curves which satisfy a mild genericity assumption and have large genus relative to their gonality, we show that the degree of irrationality of their product is equal to the product of their gonalities. Moreover, we prove that the degree of irrationality of a product of two hyperelliptic curves is 4.


k disjoint st paths activation in polynomial time. In activation network design problems we are given an undirected graph G (V,E) and a pair of activation costs c e u,c e v for each e uv in E . The goal is to find an edge set F subseteq E that satisfies a prescribed property of minimum activation cost tau(F) sum v in V max c e v e in F mbox is incident to v . In the Activation k Disjoint Paths problem we are given s,t in V and an integer k , and seek an edge set F subseteq E of k internally disjoint st paths of minimum activation cost. The problem admits an easy 2 approximation algorithm. However, it was an open question whether the problem is in P even for k 2 and power activation costs, when c e u c e v for all e uv in E . Here we will answer this question by giving a polynomial time algorithm using linear programing. We will also mention several consequences, among them a polynomial time algorithm for the Activation 2 Edge Disjoint Paths problem, and improved approximation ratios for the Min Power k Connected Subgraph problem.


Existence of solution for a class of heat equation involving the 1 Laplacian operator. This paper concerns the existence of global solutions for the following class of heat equation involving the 1 Laplacian operator of the Dirichlet problem left begin array llc u t Delta 1 u f(u) text in Omega times (0, infty) , u 0 text in partial Omega times (0, infty), u(x,0) u 0 (x) text in Omega , end array right. leqno (P) where Omega subset mathbb R N is a smooth bounded domain, N geq 1 and f mathbb R to mathbb R is a continuous function satisfying some technical conditions, and Delta 1 u text div left( frac Du Du right) denotes the 1 Laplacian operator. The existence of global solution is done by using an approximation technique that consists in working with a class of p Laplacian problem associated with (P) and then taking the limit when p to 1 to get our results.


An example of a quasi regular group representation admitting exactly one ideal. It is shown that the action of rm SL (3, mathbb Z ) on the Stone u C ech boundary of rm SL (3, mathbb Z ) rm SL (2, mathbb Z ) is amenable. This confirms a prediction by Bekka and Kalantar.


3D Ensemble Based Online Oceanic Flow Field Estimation for Underwater Glider Path Planning. Estimating ocean flow fields in 3D is a critical step in enabling the reliable operation of underwater gliders and other small, low powered autonomous marine vehicles. Existing methods produce depth averaged 2D layers arranged at discrete vertical intervals, but this type of estimation can lead to severe navigation errors. Based on the observation that real world ocean currents exhibit relatively low velocity vertical components, we propose an accurate 3D estimator that extends our previous work in estimating 2D flow fields as a linear combination of basis flows. The proposed algorithm uses data from ensemble forecasting to build a set of 3D basis flows, and then iteratively updates basis coefficients using point measurements of underwater currents. We report results from experiments using actual ensemble forecasts and synthetic measurements to compare the performance of our method to the direct 3D extension of the previous work. These results show that our method produces estimates with dramatically lower error metrics, with and without measurement noise.


SILT Efficient transformer training for inter lingual inference. The ability of transformers to perform precision tasks such as question answering, Natural Language Inference (NLI) or summarising, have enabled them to be ranked as one of the best paradigm to address Natural Language Processing (NLP) tasks. NLI is one of the best scenarios to test these architectures, due to the knowledge required to understand complex sentences and established relationships between a hypothesis and a premise. Nevertheless, these models suffer from incapacity to generalise to other domains or difficulties to face multilingual and interlingual scenarios. The leading pathway in the literature to address these issues involve designing and training extremely large architectures, which leads to unpredictable behaviours and to establish barriers which impede broad access and fine tuning. In this paper, we propose a new architecture called Siamese Inter Lingual Transformer (SILT), to efficiently align multilingual embeddings for Natural Language Inference, allowing for unmatched language pairs to be processed. SILT leverages siamese pre trained multi lingual transformers with frozen weights where the two input sentences attend each other to later be combined through a matrix alignment method. The experimental results carried out in this paper evidence that SILT allows to reduce drastically the number of trainable parameters while allowing for inter lingual NLI and achieving state of the art performance on common benchmarks. We make our code and dataset available at https github.com jahuerta92 siamese inter lingual transformer.


On the s derivative of weak solutions of the Poisson problem for the regional fractional Laplacian. In this paper, we analyze the s dependence of the solution u s to the fractional Poisson equation ( Delta) s Omega f in an open bounded set Omega subset mathbb R N . Precisely, we show that the solution map (0,1) to L 2( Omega) , s mapsto u s is continuously differentiable. Moreover, when f lambda s u s , we also analyze the one sided differentiability of the first nontrivial eigenvalue of ( Delta) s Omega regarded as a function of s in (0,1) .


Combinatorial vs. classical dynamics Recurrence. Establishing the existence of periodic orbits is one of the crucial and most intricate topics in the study of dynamical systems, and over the years, many methods have been developed to this end. On the other hand, finding closed orbits in discrete contexts, such as graph theory or in the recently developed field of combinatorial dynamics, is straightforward and computationally feasible. In this paper, we present an approach to study classical dynamical systems as given by semiflows or flows using techniques from combinatorial topological dynamics. More precisely, we present a general existence theorem for periodic orbits of semiflows which is based on suitable phase space decompositions, and indicate how combinatorial techniques can be used to satisfy the necessary assumptions. In this way, one can obtain computer assisted proofs for the existence of periodic orbits and even certain chaotic behavior.


On the index of the critical M "obius band in mathbb B 4 . In this paper we prove that the Morse index of the critical M "obius band in the 4 dimensional Euclidean ball mathbb B 4 equals 5. It is conjectured that this is the only embedded non orientable free boundary minimal surface of index 5 in mathbb B 4 . One of the ingredients in the proof is a comparison theorem between the spectral index of the Steklov problem and the energy index. The latter also enables us to give another proof of the well known result that the index of the critical catenoid in mathbb B 3 equals 4.


Single Shot Pruning for Offline Reinforcement Learning. Deep Reinforcement Learning (RL) is a powerful framework for solving complex real world problems. Large neural networks employed in the framework are traditionally associated with better generalization capabilities, but their increased size entails the drawbacks of extensive training duration, substantial hardware resources, and longer inference times. One way to tackle this problem is to prune neural networks leaving only the necessary parameters. State of the art concurrent pruning techniques for imposing sparsity perform demonstrably well in applications where data distributions are fixed. However, they have not yet been substantially explored in the context of RL. We close the gap between RL and single shot pruning techniques and present a general pruning approach to the Offline RL. We leverage a fixed dataset to prune neural networks before the start of RL training. We then run experiments varying the network sparsity level and evaluating the validity of pruning at initialization techniques in continuous control tasks. Our results show that with 95 of the network weights pruned, Offline RL algorithms can still retain performance in the majority of our experiments. To the best of our knowledge, no prior work utilizing pruning in RL retained performance at such high levels of sparsity. Moreover, pruning at initialization techniques can be easily integrated into any existing Offline RL algorithms without changing the learning objective.


C algebraic Schur product theorem, P ' o lya Szeg H o Rudin question and Novak's conjecture. Striking result of Vyb ' i ral textit Adv. Math. 2020 says that Schur product of positive matrices is bounded below by the size of the matrix and the row sums of Schur product. Vyb ' i ral used this result to prove the Novak's conjecture. In this paper, we define Schur product of matrices over arbitrary C algebras and derive the results of Schur and Vyb ' i ral. As an application, we state C algebraic version of Novak's conjecture and solve it for commutative unital C algebras. We formulate P ' o lya Szeg H o Rudin question for the C algebraic Schur product of positive matrices.


STEP Segmenting and Tracking Every Pixel. The task of assigning semantic classes and track identities to every pixel in a video is called video panoptic segmentation. Our work is the first that targets this task in a real world setting requiring dense interpretation in both spatial and temporal domains. As the ground truth for this task is difficult and expensive to obtain, existing datasets are either constructed synthetically or only sparsely annotated within short video clips. To overcome this, we introduce a new benchmark encompassing two datasets, KITTI STEP, and MOTChallenge STEP. The datasets contain long video sequences, providing challenging examples and a test bed for studying long term pixel precise segmentation and tracking under real world conditions. We further propose a novel evaluation metric Segmentation and Tracking Quality (STQ) that fairly balances semantic and tracking aspects of this task and is more appropriate for evaluating sequences of arbitrary length. Finally, we provide several baselines to evaluate the status of existing methods on this new challenging dataset. We have made our datasets, metric, benchmark servers, and baselines publicly available, and hope this will inspire future research.


Radio k Labeling of Cycles for Large k. Let G be a simple connected graph. For any two vertices u and v , let d(u,v) denote the distance between u and v in G . A radio k labeling of G for a fixed positive integer k is a function f which assigns to each vertex a non negative integer label such that for every two vertices u and v in G , f(u) f(v) geq k d(u,v) 1 . The span of f is the difference between the largest and smallest labels of f(V) . The radio k number of a graph G , denoted by rn k(G) , is the smallest span among all radio k labelings admitted by G . A cycle C n has diameter d lfloor n 2 rfloor . In this paper, we combine a lower bound approach with cyclic group structure to determine the value of rn k(C n) for k geq n 3 . For d leq k n 3 , we obtain the values of rn k(C n) when n and k have the same parity, and prove partial results when n and k have different parities. Our results extend the known values of rn d (C n) and rn d 1 (C n) shown by Liu and Zhu, and by Karst, Langowitz, Oehrlein and Troxell, respectively.


Generation of data on discontinuous manifolds via continuous stochastic non invertible networks. The generation of discontinuous distributions is a difficult task for most known frameworks such as generative autoencoders and generative adversarial networks. Generative non invertible models are unable to accurately generate such distributions, require long training and often are subject to mode collapse. Variational autoencoders (VAEs), which are based on the idea of keeping the latent space to be Gaussian for the sake of a simple sampling, allow an accurate reconstruction, while they experience significant limitations at generation task. In this work, instead of trying to keep the latent space to be Gaussian, we use a pre trained contrastive encoder to obtain a clustered latent space. Then, for each cluster, representing a unimodal submanifold, we train a dedicated low complexity network to generate this submanifold from the Gaussian distribution. The proposed framework is based on the information theoretic formulation of mutual information maximization between the input data and latent space representation. We derive a link between the cost functions and the information theoretic formulation. We apply our approach to synthetic 2D distributions to demonstrate both reconstruction and generation of discontinuous distributions using continuous stochastic networks.


physics.plasm-ph cs.NA math.NA physics.comp-ph

The role of noise in PIC and Vlasov simulations of the Buneman instability. The effects of noise in particle in cell (PIC) and Vlasov simulations of the Buneman instability in unmagnetized plasmas are studied. It is found that, in the regime of low drift velocity, the linear stage of the instability in PIC simulations differs significantly from the theoretical predictions, whereas in the Vlasov simulations it does not. A series of highly resolved PIC simulations with increasingly large numbers of macroparticles per cell is performed using a number of different PIC codes. All the simulations predict highly similar growth rates that are several times larger than those calculated from the linear theory. As a result, we find that the true convergence of the PIC simulations in the linear regime is elusive to achieve in practice and can easily be misidentified. The discrepancy between the theoretical and observed growth rates is attributed to the initial noise inherently present in PIC simulations, but not in Vlasov simulations, that causes particle trapping even though the fraction of trapped particles is low. We show analytically that even weak distortions of the electron velocity distribution function (such as flattening due to particle trapping) result in significant modifications of the growth rates. It is also found that the common quiet start method for PIC simulations leads to more accurate growth rates but only if the maximum growth rate mode is perturbed initially. We demonstrate that the quiet start method does not completely remedy the noise problem because the simulations generally exhibit inconsistencies with the linear theory.


A branching process approach to level k phylogenetic networks. The mathematical analysis of random phylogenetic networks via analytic and algorithmic methods has received increasing attention in the past years. In the present work we introduce branching process methods to their study. This approach appears to be new in this context. Our main results focus on random level k networks with n labelled leaves. Although the number of reticulation vertices in such networks is typically linear in n , we prove that their asymptotic global and local shape is tree like in a well defined sense. We show that the depth process of vertices in a large network converges towards a Brownian excursion after rescaling by n 1 2 . We also establish Benjamini Schramm convergence of large random level k networks towards a novel random infinite network.


Team NimbRo's UGV Solution for Autonomous Wall Building and Fire Fighting at MBZIRC 2020. Autonomous robotic systems for various applications including transport, mobile manipulation, and disaster response are becoming more and more complex. Evaluating and analyzing such systems is challenging. Robotic competitions are designed to benchmark complete robotic systems on complex state of the art tasks. Participants compete in defined scenarios under equal conditions. We present our UGV solution developed for the Mohamed Bin Zayed International Robotics Challenge 2020. Our hard and software components to address the challenge tasks of wall building and fire fighting are integrated into a fully autonomous system. The robot consists of a wheeled omnidirectional base, a 6 DoF manipulator arm equipped with a magnetic gripper, a highly efficient storage system to transport box shaped objects, and a water spraying system to fight fires. The robot perceives its environment using 3D LiDAR as well as RGB and thermal camera based perception modules, is capable of picking box shaped objects and constructing a pre defined wall structure, as well as detecting and localizing heat sources in order to extinguish potential fires. A high level planner solves the challenge tasks using the robot skills. We analyze and discuss our successful participation during the MBZIRC 2020 finals, present further experiments, and provide insights to our lessons learned.


Ontology based question answering over corporate structured data. Ontology based approach to the Natural Language Understanding (NLU) processing allows to improve questions answering quality in dialogue systems. We describe our NLU engine architecture and evaluate its implementation. The engine transforms user input into the SPARQL SELECT, ASK or INSERT query to the knowledge graph provided by the ontology based data virtualization platform. The transformation is based on the lexical level of the knowledge graph built according to the Ontolex ontology. The described approach can be applied for graph data population tasks and to the question answering systems implementation, including chat bots. We describe the dialogue engine for a chat bot which can keep the conversation context and ask clarifying questions, simulating some aspects of the human logical thinking. Our approach uses graph based algorithms to avoid gathering datasets, required in the neural nets based approaches, and provide better explainability of our models. Using question answering engine in conjunction with data virtualization layer over the corporate data sources allows extracting facts from the structured data to be used in conversation.


Policy Optimization for Constrained MDPs with Provable Fast Global Convergence. We address the problem of finding the optimal policy of a constrained Markov decision process (CMDP) using a gradient descent based algorithm. Previous results have shown that a primal dual approach can achieve an mathcal O (1 sqrt T ) global convergence rate for both the optimality gap and the constraint violation. We propose a new algorithm called policy mirror descent primal dual (PMD PD) algorithm that can provably achieve a faster mathcal O ( log(T) T) convergence rate for both the optimality gap and the constraint violation. For the primal (policy) update, the PMD PD algorithm utilizes a modified value function and performs natural policy gradient steps, which is equivalent to a mirror descent step with appropriate regularization. For the dual update, the PMD PD algorithm uses modified Lagrange multipliers to ensure a faster convergence rate. We also present two extensions of this approach to the settings with zero constraint violation and sample based estimation. Experimental results demonstrate the faster convergence rate and the better performance of the PMD PD algorithm compared with existing policy gradient based algorithms.


GOPHER Categorical probabilistic forecasting with graph structure via local continuous time dynamics. We consider the problem of probabilistic forecasting over categories with graph structure, where the dynamics at a vertex depends on its local connectivity structure. We present GOPHER, a method that combines the inductive bias of graph neural networks with neural ODEs to capture the intrinsic local continuous time dynamics of our probabilistic forecasts. We study the benefits of these two inductive biases by comparing against baseline models that help disentangle the benefits of each. We find that capturing the graph structure is crucial for accurate in domain probabilistic predictions and more sample efficient models. Surprisingly, our experiments demonstrate that the continuous time evolution inductive bias brings little to no benefit despite reflecting the true probability dynamics.


Improvement in the performance of multilayer insulation technique and impact in the rare physics search experiments. Providing thermal insulation to systems at very low temperature from surroundings, involves blocking the transport of thermal energy regular or enhanced, taking place through radiative, conductive and convective processes. For instance, the enhancement of radiative heat transport that takes place by infra red or far infra red light at low temperature is due to diffractive propagation. The wavelength of light in this part of the spectrum usually lie in the range of mm to cms. Hence it can get bent across an obstacle while propagating forward. Apart from radiative, the convective and conductive processes also get affected due to appearance of non linearities in the modes of lattice vibrations and anomalies in material transport due to the appearance of vorticity and turbulence in the intervening media. The Multilayer insulation technique has offered a robust thermal protective mechanism to provide proper insulation to the cold walls of the cryostats from the heat of the surroundings. This work is focused on the estimation of performance and efficiency of the MLI technique as well as exploration of its versatile applicability. Three different spacer materials such as Dacron, Glass tissue, and Silk net with radiation shields are selected for the intervening medium in the present study. This article explores the thermal performance of MLI system by changing the physical parameters, varying the geometry of the radiation shields perforation styles of radiation shields and by analyzing the effect of arrangement of radiation shields on the conduction heat load. This analysis is concluded by studying the possibility of using MLI technique in the health sector by reducing the evaporation rate of liquid Oxygen during pandemic situations e.g. in COVID19.


Evaluation of silicon carbide as a divertor armor material in DIII D H mode discharges. Silicon carbide (SiC) represents a promising but largely untested plasma facing material (PFM) for next step fusion devices. In this work, an analytic mixed material erosion model is developed by calculating the physical (via SDTrimSP) and chemical (via empirical scalings) sputtering yield from SiC, Si, and C. The Si content in the near surface SiC layer is predicted to increase during D plasma bombardment due to more efficient physical and chemical sputtering of C relative to Si. Silicon erosion from SiC thereby occurs primarily from sputtering of the enriched Si layer, rather than directly from the SiC itself. SiC coatings on ATJ graphite, manufactured via chemical vapor deposition, were exposed to repeated H mode plasma discharges in the DIII D tokamak to test this model. The qualitative trends from analytic modeling are reproduced by the experimental measurements, obtained via spectroscopic inference using the S XB method. Quantitatively the model slightly under predicts measured erosion rates, which is attributed to uncertainties in the ion impact angle distribution, as well as the effect of edge localized modes. After exposure, minimal changes to the macroscopic or microscopic surface morphology of the SiC coatings were observed. Compositional analysis reveals Si enrichment of about 10 , in line with expectations from the erosion model. Extrapolating to a DEMO type device, an order of magnitude decrease in impurity sourcing, and up to a factor of 2 decrease in impurity radiation, is expected with SiC walls, relative to graphite, if low C plasma impurity content can be achieved. These favorable erosion properties motivate further investigations of SiC as a low Z, non metallic PFM.


Towards Explainable Student Group Collaboration Assessment Models Using Temporal Representations of Individual Student Roles. Collaboration is identified as a required and necessary skill for students to be successful in the fields of Science, Technology, Engineering and Mathematics (STEM). However, due to growing student population and limited teaching staff it is difficult for teachers to provide constructive feedback and instill collaborative skills using instructional methods. Development of simple and easily explainable machine learning based automated systems can help address this problem. Improving upon our previous work, in this paper we propose using simple temporal CNN deep learning models to assess student group collaboration that take in temporal representations of individual student roles as input. We check the applicability of dynamically changing feature representations for student group collaboration assessment and how they impact the overall performance. We also use Grad CAM visualizations to better understand and interpret the important temporal indices that led to the deep learning model's decision.


Driver2vec Driver Identification from Automotive Data. With increasing focus on privacy protection, alternative methods to identify vehicle operator without the use of biometric identifiers have gained traction for automotive data analysis. The wide variety of sensors installed on modern vehicles enable autonomous driving, reduce accidents and improve vehicle handling. On the other hand, the data these sensors collect reflect drivers' habit. Drivers' use of turn indicators, following distance, rate of acceleration, etc. can be transformed to an embedding that is representative of their behavior and identity. In this paper, we develop a deep learning architecture (Driver2vec) to map a short interval of driving data into an embedding space that represents the driver's behavior to assist in driver identification. We develop a custom model that leverages performance gains of temporal convolutional networks, embedding separation power of triplet loss and classification accuracy of gradient boosting decision trees. Trained on a dataset of 51 drivers provided by Nervtech, Driver2vec is able to accurately identify the driver from a short 10 second interval of sensor data, achieving an average pairwise driver identification accuracy of 83.1 from this 10 second interval, which is remarkably higher than performance obtained in previous studies. We then analyzed performance of Driver2vec to show that its performance is consistent across scenarios and that modeling choices are sound.


Complete 2 pi Phase Control by Photonic Crystal Slabs. Photonic crystal slabs are the state of the art in studies for the light confinement, optical wave modulating and guiding, as well as nonlinear optical response. Previous studies have shown abundant real world implementations of photonic crystals in planar optics, metamaterials, sensors, and lasers. Here, we report a novel full 2 pi phase control method in the reflected light beam over the interaction with a photonic crystal resonant mode, verified by the temporal coupled mode analysis and S parameter simulations. Enhanced by the asymmetric coupling with the output ports, the 2 pi phase shift can be achieved with the silicon photonics platforms such as Silicon on Silica and Silicon on Insulator heterostructures. Such photonic crystal phase control method provides a general guide in the design of phase shift metamaterials, suggesting a wide range of applications in the field of sensing, spatial light modulation, and beam steering.


Automatic Generation of Word Problems for Academic Education via Natural Language Processing (NLP). Digital learning platforms enable students to learn on a flexible and individual schedule as well as providing instant feedback mechanisms. The field of STEM education requires students to solve numerous training exercises to grasp underlying concepts. It is apparent that there are restrictions in current online education in terms of exercise diversity and individuality. Many exercises show little variance in structure and content, hindering the adoption of abstraction capabilities by students. This thesis proposes an approach to generate diverse, context rich word problems. In addition to requiring the generated language to be grammatically correct, the nature of word problems implies additional constraints on the validity of contents. The proposed approach is proven to be effective in generating valid word problems for mathematical statistics. The experimental results present a tradeoff between generation time and exercise validity. The system can easily be parametrized to handle this tradeoff according to the requirements of specific use cases.


Adaptive Multi Teacher Multi level Knowledge Distillation. Knowledge distillation (KD) is an effective learning paradigm for improving the performance of lightweight student networks by utilizing additional supervision knowledge distilled from teacher networks. Most pioneering studies either learn from only a single teacher in their distillation learning methods, neglecting the potential that a student can learn from multiple teachers simultaneously, or simply treat each teacher to be equally important, unable to reveal the different importance of teachers for specific examples. To bridge this gap, we propose a novel adaptive multi teacher multi level knowledge distillation learning framework (AMTML KD), which consists two novel insights (i) associating each teacher with a latent representation to adaptively learn instance level teacher importance weights which are leveraged for acquiring integrated soft targets (high level knowledge) and (ii) enabling the intermediate level hints (intermediate level knowledge) to be gathered from multiple teachers by the proposed multi group hint strategy. As such, a student model can learn multi level knowledge from multiple teachers through AMTML KD. Extensive results on publicly available datasets demonstrate the proposed learning framework ensures student to achieve improved performance than strong competitors.


Reflected backward stochastic differential equations with optional barriers monotone approximation. In this short note we consider RBSDE with Lipschitz drivers and barrier processes that are optional and right upper semicontinuous. We treat the case when the barrier can be represented as a decreasing limit of cadlag barriers. We combine well known existence results for cadlag barriers with comparison arguments for the control process to construct solutions. Finally, we highlight the connection of such RBSDEs with usual cadlag BSDEs.


Use and Misuse of the Term Experiment in Mining Software Repositories Research. The significant momentum and importance of Mining Software Repositories (MSR) in Software Engineering (SE) has fostered new opportunities and challenges for extensive empirical research. However, MSR researchers seem to struggle to characterize the empirical methods they use into the existing empirical SE body of knowledge. This is especially the case of MSR experiments. To provide evidence on the special characteristics of MSR experiments and their differences with experiments traditionally acknowledged in SE so far, we elicited the hallmarks that differentiate an experiment from other types of empirical studies and characterized the hallmarks and types of experiments in MSR. We analyzed MSR literature obtained from a small scale systematic mapping study to assess the use of the term experiment in MSR. We found that 19 of the papers claiming to be an experiment are indeed not an experiment at all but also observational studies, so they use the term in a misleading way. From the remaining 81 of the papers, only one of them refers to a genuine controlled experiment while the others stand for experiments with limited control. MSR researchers tend to overlook such limitations, compromising the interpretation of the results of their studies. We provide recommendations and insights to support the improvement of MSR experiments.


A Realizable Filtered Intrusive Polynomial Moment Method. Intrusive uncertainty quantification methods for hyperbolic problems exhibit spurious oscillations at shocks, which leads to a significant reduction of the overall approximation quality. Furthermore, a challenging task is to preserve hyperbolicity of the gPC moment system. An intrusive method which guarantees hyperbolicity is the intrusive polynomial moment (IPM) method, which performs the gPC expansion on the entropy variables. The method, while still being subject to oscillations, requires solving a convex optimization problem in every spatial cell and every time step. The aim of this work is to mitigate oscillations in the IPM solution by applying filters. Filters reduce oscillations by damping high order gPC coefficients. Naive filtering, however, may lead to unrealizable moments, which means that the IPM optimization problem does not have a solution and the method breaks down. In this paper, we propose and analyze two separate strategies to guarantee the existence of a solution to the IPM problem. First, we propose a filter which maintains realizability by being constructed from an underlying Fokker Planck equation. Second, we regularize the IPM optimization problem to be able to cope with non realizable gPC coefficients. Consequently, standard filters can be applied to the regularized IPM method. We demonstrate numerical results for the two strategies by investigating the Euler equations with uncertain shock structures in one and two dimensional spatial settings. We are able to show a significant reduction of spurious oscillations by the proposed filters.


Counting integral points on indefinite ternary quadratic equations over number fields. We study an asymptotic formula for counting integral points over an equation defined by a non degenerated indefinite integral ternary quadratic form f representing a non zero integer a such that a cdot det(f) is square over a number field. In particular, we prove that the finite part of this asymptotic formula is given by the product of local density times 1 p 1 over all finite primes p over Bbb Z .


MIMO Networks with One Bit ADCs Receiver Design and Communication Strategies. High resolution analog to digital converters (ADCs) are conventionally used at the receiver terminals to store an accurate digital representation of the received signal, thereby allowing for reliable decoding of transmitted messages. However, in a wide range of applications, such as communication over millimeter wave and massive multiple input multiple output (MIMO) systems, the use of high resolution ADCs is not feasible due to power budget limitations. In the conventional fully digital receiver design, where each receiver antenna is connected to a distinct ADC, reducing the ADC resolution leads to performance loss in terms of achievable rates. One proposed method to mitigate the rate loss is to use analog linear combiners leading to design of hybrid receivers. Here, the hybrid framework is augmented by the addition of delay elements to allow for temporal analog processing. Two new classes of receivers consisting of delay elements, analog linear combiners, and one bit ADCs are proposed. The fundamental limits of communication in single and multi user (uplink and downlink) MIMO systems employing the proposed receivers are investigated. In the high signal to noise ratio regime, it is shown that the proposed receivers achieve the maximum achievable rates among all receivers with the same number of one bit ADCs.


Regional Attention Network (RAN) for Head Pose and Fine grained Gesture Recognition. Affect is often expressed via non verbal body language such as actions gestures, which are vital indicators for human behaviors. Recent studies on recognition of fine grained actions gestures in monocular images have mainly focused on modeling spatial configuration of body parts representing body pose, human objects interactions and variations in local appearance. The results show that this is a brittle approach since it relies on accurate body parts objects detection. In this work, we argue that there exist local discriminative semantic regions, whose "informativeness" can be evaluated by the attention mechanism for inferring fine grained gestures actions. To this end, we propose a novel end to end textbf Regional Attention Network (RAN) , which is a fully Convolutional Neural Network (CNN) to combine multiple contextual regions through attention mechanism, focusing on parts of the images that are most relevant to a given task. Our regions consist of one or more consecutive cells and are adapted from the strategies used in computing HOG (Histogram of Oriented Gradient) descriptor. The model is extensively evaluated on ten datasets belonging to 3 different scenarios 1) head pose recognition, 2) drivers state recognition, and 3) human action and facial expression recognition. The proposed approach outperforms the state of the art by a considerable margin in different metrics.


Divide and conquer based Large Scale Spectral Clustering. Spectral clustering is one of the most popular clustering methods. However, how to balance the efficiency and effectiveness of the large scale spectral clustering with limited computing resources has not been properly solved for a long time. In this paper, we propose a divide and conquer based large scale spectral clustering method to strike a good balance between efficiency and effectiveness. In the proposed method, a divide and conquer based landmark selection algorithm and a novel approximate similarity matrix approach are designed to construct a sparse similarity matrix within low computational complexities. Then clustering results can be computed quickly through a bipartite graph partition process. The proposed method achieves a lower computational complexity than most existing large scale spectral clustering methods. Experimental results on ten large scale datasets have demonstrated the efficiency and effectiveness of the proposed method. The MATLAB code of the proposed method and experimental datasets are available at https github.com Li Hongmin MyPaperWithCode.


Generating 3D structures from a 2D slice with GAN based dimensionality expansion. Generative adversarial networks (GANs) can be trained to generate 3D image data, which is useful for design optimisation. However, this conventionally requires 3D training data, which is challenging to obtain. 2D imaging techniques tend to be faster, higher resolution, better at phase identification and more widely available. Here, we introduce a generative adversarial network architecture, SliceGAN, which is able to synthesise high fidelity 3D datasets using a single representative 2D image. This is especially relevant for the task of material microstructure generation, as a cross sectional micrograph can contain sufficient information to statistically reconstruct 3D samples. Our architecture implements the concept of uniform information density, which both ensures that generated volumes are equally high quality at all points in space, and that arbitrarily large volumes can be generated. SliceGAN has been successfully trained on a diverse set of materials, demonstrating the widespread applicability of this tool. The quality of generated micrographs is shown through a statistical comparison of synthetic and real datasets of a battery electrode in terms of key microstructural metrics. Finally, we find that the generation time for a 10 8 voxel volume is on the order of a few seconds, yielding a path for future studies into high throughput microstructural optimisation.


Debiased Explainable Pairwise Ranking from Implicit Feedback. Recent work in recommender systems has emphasized the importance of fairness, with a particular interest in bias and transparency, in addition to predictive accuracy. In this paper, we focus on the state of the art pairwise ranking model, Bayesian Personalized Ranking (BPR), which has previously been found to outperform pointwise models in predictive accuracy, while also being able to handle implicit feedback. Specifically, we address two limitations of BPR (1) BPR is a black box model that does not explain its outputs, thus limiting the user's trust in the recommendations, and the analyst's ability to scrutinize a model's outputs and (2) BPR is vulnerable to exposure bias due to the data being Missing Not At Random (MNAR). This exposure bias usually translates into an unfairness against the least popular items because they risk being under exposed by the recommender system. In this work, we first propose a novel explainable loss function and a corresponding Matrix Factorization based model called Explainable Bayesian Personalized Ranking (EBPR) that generates recommendations along with item based explanations. Then, we theoretically quantify additional exposure bias resulting from the explainability, and use it as a basis to propose an unbiased estimator for the ideal EBPR loss. The result is a ranking model that aptly captures both debiased and explainable user preferences. Finally, we perform an empirical study on three real world datasets that demonstrate the advantages of our proposed models.


Graph Embedded Subspace Support Vector Data Description. In this paper, we propose a novel subspace learning framework for one class classification. The proposed framework presents the problem in the form of graph embedding. It includes the previously proposed subspace one class techniques as its special cases and provides further insight on what these techniques actually optimize. The framework allows to incorporate other meaningful optimization goals via the graph preserving criterion and reveals spectral and spectral regression based solutions as alternatives to the previously used gradient based technique. We combine the subspace learning framework iteratively with Support Vector Data Description applied in the subspace to formulate Graph Embedded Subspace Support Vector Data Description. We experimentally analyzed the performance of newly proposed different variants. We demonstrate improved performance against the baselines and the recently proposed subspace learning methods for one class classification.


Algebraic sheaves of Floer homology groups via algebraic torus actions on the Fukaya category. Let (M, omega M) be a monotone or negatively monotone symplectic manifold, or a Weinstein manifold. One can construct an "action" of H 1(M, mathbb G m) on the Fukaya category (wrapped Fukaya category in the exact case) that reflects the action of Symp 0(M, omega M) on the set of Lagrangian branes. A priori this action is only analytic. The purpose of this work is to show the algebraicity of this action under some assumptions. We use this to prove a tameness result for the sheaf of Lagrangian Floer homology groups obtained by moving one of the Lagrangians via global symplectic isotopies. We also show the algebraicity of the locus of z in H 1(M, mathbb G m) that fix a Lagrangian brane in the Fukaya category. The latter has applications to Lagrangian flux. Finally, we prove a statement in mirror symmetry in the Weinstein case, assume that M is mirror to an affine or projective variety X , that there exists an exact Lagrangian torus L subset M such that H 1(M) to H 1(L) is surjective, and that L is sent to a smooth point of x in X under the mirror equivalence. Then we construct a Zariski chart of X containing x , that is isomorphic to H 1(L, mathbb G m) , and such that other points of this chart correspond to non exact deformations of L (possibly equipped with unitary local systems). In particular, this implies rationality of the irreducible component containing x however, it is stronger. Under our assumptions, one can construct an algebraic action of H 1(M, mathbb G m) , namely the action by non unitary local systems. By combining techniques from family Floer homology and non commutative geometry, we prove that this action coincides with the geometric action mentioned in the first paragraph. We use this to deduce the theorems above.


Generalized adaptive partition based method for two stage stochastic linear programs convergence and generalization. Adaptive Partition based Methods (APM) are numerical methods to solve two stage stochastic linear problems (2SLP). The core idea is to iteratively construct an adapted partition of the space of alea in order to aggregate scenarios while conserving the true value of the cost to go for the current first stage control. Relying on the normal fan of the dual admissible set, we extend the classical and generalized APM method by i) extending the method to almost arbitrary 2SLP, ii) giving a necessary and sufficient condition for a partition to be adapted even for non finite distribution, and iii) proving the convergence of the method. We give some additional insights by linking APM to the L shaped algorithm.


The structure of arbitrary Conze Lesigne systems. Let Gamma be a countable abelian group. An (abstract) Gamma system mathrm X that is, an (abstract) probability space equipped with an (abstract) probability preserving action of Gamma is said to be a Conze Lesigne system if it is equal to its second Host Kra Ziegler factor mathrm Z 2( mathrm X ) . The main result of this paper is a structural description of such Conze Lesigne systems for arbitrary countable abelian Gamma , namely that they are the inverse limit of translational systems G n Lambda n arising from locally compact nilpotent groups G n of nilpotency class 2 , quotiented by a lattice Lambda n . Results of this type were previously known when Gamma was finitely generated, or the product of cyclic groups. In a companion paper, two of us will apply this structure theorem to obtain an inverse theorem for the Gowers U 3(G) norm for arbitrary finite abelian groups G .


Generative Adversarial Networks with Physical Evaluators for Spray Simulation of Pintle Injector. Due to the adjustable geometry, pintle injectors are specially suitable for the liquid rocket engines which require a widely throttleable range. While applying the conventional computational fluid dynamics approaches to simulate the complex spray phenomena in the whole range still remains to be a great challenge. In this paper, a novel deep learning approach used to simulate instantaneous spray fields under continuous operating conditions is explored. Based on one specific type of neural networks and the idea of physics constraint, a Generative Adversarial Networks with Physics Evaluators (GAN PE) framework is proposed. The geometry design and mass flux information are embedded as the inputs. After the adversarial training between the generator and discriminator, the generated field solutions are fed into the two physics evaluators. In this framework, mass conversation evaluator is designed to improve the training robustness and convergence. And the spray angle evaluator, which is composed of a down sampling CNN and theoretical model, guides the networks generating the spray solutions more according with the injection conditions. The characterization of the simulated spray, including the spray morphology, droplet distribution and spray angle, is well predicted. The work suggests a great potential of the prior physics knowledge employment in the simulation of instantaneous flow fields.


Explainable Graph based Search for Lessons Learned Documents in the Semiconductor Industry. Industrial processes produce a considerable volume of data and thus information. Whether it is structured sensory data or semi to unstructured textual data, the knowledge that can be derived from it is critical to the sustainable development of the industrial process. A key challenge of this sustainability is the intelligent management of the generated data, as well as the knowledge extracted from it, in order to utilize this knowledge for improving future procedures. This challenge is a result of the tailored documentation methods and domain specific requirements, which include the need for quick visibility of the documented knowledge. In this paper, we utilize the expert knowledge documented in chip design failure reports in supporting user access to information that is relevant to a current chip design. Unstructured, free, textual data in previous failure documentations provides a valuable source of lessons learned, which expert design engineers have experienced, solved and documented. To achieve a sustainable utilization of knowledge within the company, not only the inherent knowledge has to be mined from unstructured textual data, but also the relations between the lessons learned, uncovering potentially unknown links. In this research, a knowledge graph is constructed, in order to represent and use the interconnections between reported design failures. A search engine is developed and applied onto the graph to answer queries. In contrast to mere keyword based searching, the searchability of the knowledge graph offers enhanced search results beyond direct matches and acts as a mean for generating explainable results and result recommendations. Results are provided to the design engineer through an interactive search interface, in which, the feedback from the user is used to further optimize relations for future iterations of the knowledge graph.


The 5th AI City Challenge. The AI City Challenge was created with two goals in mind (1) pushing the boundaries of research and development in intelligent video analysis for smarter cities use cases, and (2) assessing tasks where the level of performance is enough to cause real world adoption. Transportation is a segment ripe for such adoption. The fifth AI City Challenge attracted 305 participating teams across 38 countries, who leveraged city scale real traffic data and high quality synthetic data to compete in five challenge tracks. Track 1 addressed video based automatic vehicle counting, where the evaluation being conducted on both algorithmic effectiveness and computational efficiency. Track 2 addressed city scale vehicle re identification with augmented synthetic data to substantially increase the training set for the task. Track 3 addressed city scale multi target multi camera vehicle tracking. Track 4 addressed traffic anomaly detection. Track 5 was a new track addressing vehicle retrieval using natural language descriptions. The evaluation system shows a general leader board of all submitted results, and a public leader board of results limited to the contest participation rules, where teams are not allowed to use external data in their work. The public leader board shows results more close to real world situations where annotated data is limited. Results show the promise of AI in Smarter Transportation. State of the art performance for some tasks shows that these technologies are ready for adoption in real world systems.


Harmonic functions with polynomial growth on manifolds with nonnegative Ricci curvature. Suppose (M,g) is a Riemannian manifold having dimension n , nonnegative Ricci curvature, maximal volume growth and unique tangent cone at infinity. In this case, the tangent cone at infinity C(X) is an Euclidean cone over the cross section X . Denote by alpha lim r rightarrow infty frac mathrm Vol (B r (p)) r n the asymptotic volume ratio. Let h k h k (M) be the dimension of the space of harmonic functions with polynomial growth of growth order at most k . In this paper, we prove a upper bound of h k in terms of the counting function of eigenvalues of X . As a corollary, we obtain lim k rightarrow infty k 1 n h k frac 2 alpha (n 1)! omega n . These results are sharp, as they recover the corresponding well known properties of h k ( mathbb R n ) . In particular, these results hold on manifolds with nonnegative sectional curvature and maximal volume growth.


Neural Network Attribution Methods for Problems in Geoscience A Novel Synthetic Benchmark Dataset. Despite the increasingly successful application of neural networks to many problems in the geosciences, their complex and nonlinear structure makes the interpretation of their predictions difficult, which limits model trust and does not allow scientists to gain physical insights about the problem at hand. Many different methods have been introduced in the emerging field of eXplainable Artificial Intelligence (XAI), which aim at attributing the network's prediction to specific features in the input domain. XAI methods are usually assessed by using benchmark datasets (like MNIST or ImageNet for image classification), or through deletion insertion techniques. In either case, however, an objective, theoretically derived ground truth for the attribution is lacking, making the assessment of XAI in many cases subjective. Also, benchmark datasets for problems in geosciences are rare. Here, we provide a framework, based on the use of additively separable functions, to generate attribution benchmark datasets for regression problems for which the ground truth of the attribution is known a priori. We generate a long benchmark dataset and train a fully connected network to learn the underlying function that was used for simulation. We then compare estimated attribution heatmaps from different XAI methods to the ground truth in order to identify examples where specific XAI methods perform well or poorly. We believe that attribution benchmarks as the ones introduced herein are of great importance for further application of neural networks in the geosciences, and for accurate implementation of XAI methods, which will increase model trust and assist in discovering new science.


WEC Deriving a Large scale Cross document Event Coreference dataset from Wikipedia. Cross document event coreference resolution is a foundational task for NLP applications involving multi text processing. However, existing corpora for this task are scarce and relatively small, while annotating only modest size clusters of documents belonging to the same topic. To complement these resources and enhance future research, we present Wikipedia Event Coreference (WEC), an efficient methodology for gathering a large scale dataset for cross document event coreference from Wikipedia, where coreference links are not restricted within predefined topics. We apply this methodology to the English Wikipedia and extract our large scale WEC Eng dataset. Notably, our dataset creation method is generic and can be applied with relatively little effort to other Wikipedia languages. To set baseline results, we develop an algorithm that adapts components of state of the art models for within document coreference resolution to the cross document setting. Our model is suitably efficient and outperforms previously published state of the art results for the task.


Evolutionary Optimization of High Coverage Budgeted Classifiers. Classifiers are often utilized in time constrained settings where labels must be assigned to inputs quickly. To address these scenarios, budgeted multi stage classifiers (MSC) process inputs through a sequence of partial feature acquisition and evaluation steps with early exit options until a confident prediction can be made. This allows for fast evaluation that can prevent expensive, unnecessary feature acquisition in time critical instances. However, performance of MSCs is highly sensitive to several design aspects making optimization of these systems an important but difficult problem. To approximate an initially intractable combinatorial problem, current approaches to MSC configuration rely on well behaved surrogate loss functions accounting for two primary objectives (processing cost, error). These approaches have proven useful in many scenarios but are limited by analytic constraints (convexity, smoothness, etc.) and do not manage additional performance objectives. Notably, such methods do not explicitly account for an important aspect of real time detection systems the ratio of "accepted" predictions satisfying some confidence criterion imposed by a risk averse monitor. This paper proposes a problem specific genetic algorithm, EMSCO, that incorporates a terminal reject option for indecisive predictions and treats MSC design as an evolutionary optimization problem with distinct objectives (accuracy, cost, coverage). The algorithm's design emphasizes Pareto efficiency while respecting a notion of aggregated performance via a unique scalarization. Experiments are conducted to demonstrate EMSCO's ability to find global optima in a variety of Theta(k n) solution spaces, and multiple experiments show EMSCO is competitive with alternative budgeted approaches.


Exceptional loci in Lefschetz theory. Let phi X rightarrow mathbb P n be a morphism of varieties. Given a hyperplane H in mathbb P n , there is a Gysin map from the compactly supported cohomology of phi 1 (H) to that of X . We give conditions on the degree of the cohomology under which this map is an isomorphism for all but a low dimensional set of hyperplanes, generalizing results due to Skorobogatov, Benoist, and Poonen Slavov. Our argument is based on Beilinson's theory of singular supports for 'etale sheaves.


Probabilistic Approach for Road Users Detection. Object detection in autonomous driving applications implies that the detection and tracking of semantic objects are commonly native to urban driving environments, as pedestrians and vehicles. One of the major challenges in state of the art deep learning based object detection is false positive which occurrences with overconfident scores. This is highly undesirable in autonomous driving and other critical robotic perception domains because of safety concerns. This paper proposes an approach to alleviate the problem of overconfident predictions by introducing a novel probabilistic layer to deep object detection networks in testing. The suggested approach avoids the traditional Sigmoid or Softmax prediction layer which often produces overconfident predictions. It is demonstrated that the proposed technique reduces overconfidence in the false positives without degrading the performance on the true positives. The approach is validated on the 2D KITTI objection detection through the YOLOV4 and SECOND (Lidar based detector). The proposed approach enables enabling interpretable probabilistic predictions without the requirement of re training the network and therefore is very practical.


Examining correlation between trust and transparency with explainable artificial intelligence. Trust between humans and artificial intelligence(AI) is an issue which has implications in many fields of human computer interaction. The current issue with artificial intelligence is a lack of transparency into its decision making, and literature shows that increasing transparency increases trust. Explainable artificial intelligence has the ability to increase transparency of AI, which could potentially increase trust for humans. This paper attempts to use the task of predicting yelp review star ratings with assistance from an explainable and non explainable artificial intelligence to see if trust is increased with increased transparency. Results show that for these tasks, explainable artificial intelligence provided significant increase in trust as a measure of influence.


From Average Embeddings To Nearest Neighbor Search. In this note, we show that one can use average embeddings, introduced recently in Naor'20, arXiv 1905.01280 , to obtain efficient algorithms for approximate nearest neighbor search. In particular, a metric X embeds into ell 2 on average, with distortion D , if, for any distribution mu on X , the embedding is D Lipschitz and the (square of) distance does not decrease on average (wrt mu ). In particular existence of such an embedding (assuming it is efficient) implies a O(D 3) approximate nearest neighbor search under X . This can be seen as a strengthening of the classic (bi Lipschitz) embedding approach to nearest neighbor search, and is another application of data dependent hashing paradigm.


Nonlinear MHD simulations of external kinks in quasi axisymmetric stellarators using an axisymmetric external rotational transform approximation. Reduced magnetohydrodynamic (MHD) equations are used to study the nonlinear dynamics of external kinks in a quasi axisymmetric (QA) stellarator with varying fractions of external rotational transform. The large bootstrap currents associated with high beta plasmas may make QA configurations susceptible to low n external modes, limiting their operational space. The violence of the nonlinear dynamics, and, in particular, when these modes lead to a disruption, is not yet understood. In this paper, the nonlinear phase of external kinks in an unstable QA configuration with an edge safety factor below two is simulated. An axisymmetric approximation of this stellarator is constructed in the nonlinear MHD code, JOREK, capturing the influence of the external rotational transform. The use of this approximation for the considered stellarator is validated by comparing the linear dynamics against the linear viscoresistive MHD code, CASTOR3D. The nonlinear dynamics of this stellarator approximation are compared with an equivalent tokamak to understand the influence of a relatively small external rotational transform. While the external rotational transform does have a stabilising influence on the MHD activity, it remains violent. To explore the first order influence of a larger external rotational transform, this equilibrium parameter is artificially increased for the considered stellarator, reducing the effective plasma current. The violence of the kink instability is quantified, and shown to reduce with the increasing external rotational transform. At the same time, the external kink triggers internal modes that exacerbate the loss in confinement during the nonlinear phase, such that it remains large over much of the parameter space. It is only with a significant fraction of external rotational transform that these subsequent modes are stabilised.


On the spectral asymptotics for the buckling problem. We provide a direct proof of Weyl's law for the buckling eigenvalues of the biharmonic operator on a wide class of domains of mathbb R d including bounded Lipschitz domains. The proof relies on asymptotically sharp lower and upper bounds that we develop for the Riesz mean R 2(z) . Lower bounds are obtained by making use of the so called "averaged variational principle". Upper bounds are obtained in the spirit of Berezin Li Yau. Moreover, we state a conjecture for the second term in Weyl's law and prove its correctness in two special cases balls in mathbb R d and bounded intervals in mathbb R .


Legal Transformer Models May Not Always Help. Deep learning based Natural Language Processing methods, especially transformers, have achieved impressive performance in the last few years. Applying those state of the art NLP methods to legal activities to automate or simplify some simple work is of great value. This work investigates the value of domain adaptive pre training and language adapters in legal NLP tasks. By comparing the performance of language models with domain adaptive pre training on different tasks and different dataset splits, we show that domain adaptive pre training is only helpful with low resource downstream tasks, thus far from being a panacea. We also benchmark the performance of adapters in a typical legal NLP task and show that they can yield similar performance to full model tuning with much smaller training costs. As an additional result, we release LegalRoBERTa, a RoBERTa model further pre trained on legal corpora.