Algorithme de recherche approximative dans un dictionnaire fond 'e sur une distance d' 'edition d 'efinie par blocs. We propose an algorithm for approximative dictionary lookup, where altered strings are matched against reference forms. The algorithm makes use of a divergence function between strings broadly belonging to the family of edit distances it finds dictionary entries whose distance to the search string is below a certain threshold. The divergence function is not the classical edit distance (DL distance) it is adaptable to a particular corpus, and is based on elementary alteration costs defined on character blocks, rather than on individual characters. Nous proposons un algorithme de recherche approximative de cha ines dans un dictionnaire a partir de formes alt 'er 'ees. Cet algorithme est fond 'e sur une fonction de divergence entre cha ines une sorte de distance d' 'edition il recherche des entr 'ees pour lesquelles la distance a la cha ine cherch 'ee est inf 'erieure a un certain seuil. La fonction utilis 'ee n'est pas la distance d' 'edition classique (distance DL) elle est adapt 'ee a un corpus, et se fonde sur la prise en compte de co uts d'alt 'eration 'el 'ementaires d 'efinis non pas sur des caract eres, mais sur des sous cha ines (des blocs de caract eres).


Transfer based adaptive tree for multimodal sentiment analysis based on user latent aspects. Multimodal sentiment analysis benefits various applications such as human computer interaction and recommendation systems. It aims to infer the users' bipolar ideas using visual, textual, and acoustic signals. Although researchers affirm the association between cognitive cues and emotional manifestations, most of the current multimodal approaches in sentiment analysis disregard user specific aspects. To tackle this issue, we devise a novel method to perform multimodal sentiment prediction using cognitive cues, such as personality. Our framework constructs an adaptive tree by hierarchically dividing users and trains the LSTM based submodels, utilizing an attention based fusion to transfer cognitive oriented knowledge within the tree. Subsequently, the framework consumes the conclusive agglomerative knowledge from the adaptive tree to predict final sentiments. We also devise a dynamic dropout method to facilitate data sharing between neighboring nodes, reducing data sparsity. The empirical results on real world datasets determine that our proposed model for sentiment prediction can surpass trending rivals. Moreover, compared to other ensemble approaches, the proposed transfer based algorithm can better utilize the latent cognitive cues and foster the prediction outcomes. Based on the given extrinsic and intrinsic analysis results, we note that compared to other theoretical based techniques, the proposed hierarchical clustering approach can better group the users within the adaptive tree.


Vessel and Port Efficiency Metrics through Validated AIS data. Automatic Identification System (AIS) data represents a rich source of information about maritime traffic and offers a great potential for data analytics and predictive modeling solutions, which can help optimizing logistic chains and to reduce environmental impacts. In this work, we address the main limitations of the validity of AIS navigational data fields, by proposing a machine learning based data driven methodology to detect and (to the possible extent) also correct erroneous data. Additionally, we propose a metric that can be used by vessel operators and ports to express numerically their business and environmental efficiency through time and spatial dimensions, enabled with the obtained validated AIS data. We also demonstrate Port Area Vessel Movements (PARES) tool, which demonstrates the proposed solutions.


Well posedness and optimal control for a Cahn Hilliard Oono system with control in the mass term. The paper treats the problem of optimal distributed control of a Cahn Hilliard Oono system in mathbb R d , 1 leq d leq 3 , with the control located in the mass term and admitting general potentials that include both the case of a regular potential and the case of some singular potential. The first part of the paper is concerned with the dependence of the phase variable on the control variable. For this purpose, suitable regularity and continuous dependence results are shown. In particular, in the case of a logarithmic potential, we need to prove an ad hoc strict separation property, and for this reason we have to restrict ourselves to the case d 2 . In the rest of the work, we study the necessary first order optimality conditions, which are proved under suitable compatibility conditions on the initial datum of the phase variable and the time derivative of the control, at least in case of potentials having unbounded domain.


Measuring Linguistic Diversity During COVID 19. Computational measures of linguistic diversity help us understand the linguistic landscape using digital language data. The contribution of this paper is to calibrate measures of linguistic diversity using restrictions on international travel resulting from the COVID 19 pandemic. Previous work has mapped the distribution of languages using geo referenced social media and web data. The goal, however, has been to describe these corpora themselves rather than to make inferences about underlying populations. This paper shows that a difference in differences method based on the Herfindahl Hirschman Index can identify the bias in digital corpora that is introduced by non local populations. These methods tell us where significant changes have taken place and whether this leads to increased or decreased diversity. This is an important step in aligning digital corpora like social media with the real world populations that have produced them.


Two scale elastic shape optimization for additive manufacturing. In this paper, a two scale approach for elastic shape optimization of fine scale structures in additive manufacturing is investigated. To this end, a free material optimization is performed on the macro scale using elasticity tensors in a set of microscopically realizable tensors. A database of these realizable tensors and their cost values is obtained with a shape and topology optimization on microscopic cells, working within a fixed set of elasticity tensors samples. This microscopic optimization takes into account manufacturability constraints via predefined material bridges to neighbouring cells at the faces of the microscopic fundamental cell. For the actual additive manufacturing on a chosen fine scale, a piece wise constant elasticity tensor ansatz on grid cells of a macroscopic mesh is applied. The macroscopic optimization is performed in an efficient online phase, whereas the associated cell wise optimal material patterns are retrieved from the database that was computed offline. For that, the set of admissible realizable elasticity tensors is parametrized using tensor product cubic B splines over the unit square matching the precomputed samples. This representation is then efficiently used in an interior point method for the free material optimization on the macro scale.


LiveView Dynamic Target Centered MPI for View Synthesis. Existing Multi Plane Image (MPI) based view synthesis methods generate an MPI aligned with the input view using a fixed number of planes in one forward pass. These methods produce fast, high quality rendering of novel views, but rely on slow and computationally expensive MPI generation methods unsuitable for real time applications. In addition, most MPI techniques use fixed depth disparity planes which cannot be modified once the training is complete, hence offering very little flexibility at run time. We propose LiveView a novel MPI generation and rendering technique that produces high quality view synthesis in real time. Our method can also offer the flexibility to select scene dependent MPI planes (number of planes and spacing between them) at run time. LiveView first warps input images to target view (target centered) and then learns to generate a target view centered MPI, one depth plane at a time (dynamically). The method generates high quality renderings, while also enabling fast MPI generation and novel view synthesis. As a result, LiveView enables real time view synthesis applications where an MPI needs to be updated frequently based on a video stream of input views. We demonstrate that LiveView improves the quality of view synthesis while being 70 times faster at run time compared to state of the art MPI based methods.


Rational endomorphisms of Fano hypersurfaces. We show that the degrees of rational endomorphisms of very general complex Fano and Calabi Yau hypersurfaces satisfy certain congruence conditions by specializing to characteristic p. As a corollary we show that very general n dimensional hypersurfaces of degree d ge 5 lceil (n 3) 6 rceil are not birational to elliptic fibrations. A key part of the argument is to resolve singularities of general p cyclic covers in mixed characteristic p.


Topological Hochschild homology of truncated Brown Peterson spectra I. We compute topological Hochschild homology of sufficiently structured forms of truncated Brown Peterson spectra with coefficients. In particular, we compute operatorname THH ( operatorname taf D M) for M in H mathbb Z (3) ,k(1),k(2) where operatorname taf D is the E infty form of BP langle 2 rangle constructed by Hill Lawson. We compute operatorname THH ( operatorname tmf 1(3) M) when M in H mathbb Z (2) ,k(2) where operatorname tmf 1(3) is the E infty form of BP langle 2 rangle constructed by Lawson Naumann. We also compute operatorname THH (B langle n rangle M) for M H mathbb Z (p) and certain E 3 forms B langle n rangle of BP langle n rangle . For example at p 2 , this result applies to the E 3 forms of BP langle n rangle constructed by Hahn Wilson.


Shintani correspondence for Maass forms of level N and prehomogeneous zeta functions. A Shintani Katok Sarnak type correspondence for Maass cusp forms of level N is shown to be derived from analytic properties of prehomogeneous zeta functions whose coefficients involve periods of Maass forms.


Gluconate and hexitols effects on C S H solubility. This study investigates the effect of gluconate, a carboxylate ion, and three uncharged hexitols, D sorbitol, D mannitol and D galactitol on the solubility of C S H. Thermodynamic modeling was used to determine the kind and amount of Ca organic silicate OH complexes that potentially form in the conditions studied. All the organics form complexes with calcium and hydroxide, In addition, heteropolynuclear organics complexes with calcium, hydroxide and silicate are observed at high pH values and high calcium concentrations with the exception of mannitol. The strength of complexation with silicate decreases from gluconate sorbitol galactitol. The adsorption of the selected organics on portlandite and C S H systems follows the order gluconate sorbitol mannitol galactitol. For C S H system buffered with Ca(OH)2, a typical Langmuir isotherm was found and adsorption on C S H increased with the Ca Si ratio as well as with the increase of the organic concentration.


Upper bounds for the constants of Bennett's inequality and the Gale Berlekamp switching game. In 1977 , G. Bennett proved, by means of non deterministic methods, an inequality which plays a fundamental role in optimization problems. More precisely, it was shown that, for p 1 ,p 2 in lbrack1, infty and all positive integers n 1 ,n 2 , there exists a bilinear form A n 1 ,n 2 colon ell p 1 n 1 times ell p 2 n 2 longrightarrow mathbb R (or mathbb C ) with coefficients pm1 satisfying left Vert A n 1 ,n 2 right Vert leq C p 1 ,p 2 max left n 1 1 p 1 ast n 2 max left frac 1 2 frac 1 p 2 ,0 right ,n 2 1 p 2 ast n 1 max left frac 1 2 frac 1 p 1 ,0 right right for a certain constant C p 1 ,p 2 depending just on p 1 ,p 2 (and the exponents of n 1 ,n 2 cannot be improved). In this paper, using a constructive approach, we prove that C p 1 ,p 2 leq sqrt 8 5 whenever p 1 ,p 2 in left 2, infty right or p 1 p 2 p in left 1, infty right our techniques are applied to provide new upper bounds for the constants of the Gale Berlekamp switching game, improving estimates obtained by Carlson and Stolarski in 2004 .


Automated System for Ship Detection from Medium Resolution Satellite Optical Imagery. In this paper, we present a ship detection pipeline for low cost medium resolution satellite optical imagery obtained from ESA Sentinel 2 and Planet Labs Dove constellations. This optical satellite imagery is readily available for any place on Earth and underutilized in the maritime domain, compared to existing solutions based on synthetic aperture radar (SAR) imagery. We developed a ship detection method based on a state of the art deep learning based object detection method which was developed and evaluated on a large scale dataset that was collected and automatically annotated with the help of Automatic Identification System (AIS) data.


Applications of Earth to Air Heat Exchangers A Holistic Review. The building sector is responsible for 40 of primary energy consumption, with heating cooling covering the most significant portion. Thus, passive heating cooling applications have gained significant ground during the last three decades, with many research activities on the subject. Among passive cooling heating applications, ground cooling (especially earth to air heat exchangers) has been highlighted as a remarkably attractive technological research subjects because of its significant contribution to the reduction of heating cooling energy loads the improvement of indoor thermal comfort conditions and the amelioration of the urban environment. This paper presents a holistic review of state of the art research, methodologies, and technologies of earth to air heat exchangers that help achieve energy conservation and thermal comfort in the built environment. The review covers the critical subject of the thermal performance of earth to air heat exchanger systems experimental studies and applications parametric studies for investigating the impact of their main characteristics on thermal efficiency and recent advances and trends including hybrid technologies and systems. The models describing the thermal performance of earth to air heat exchangers systems were classified in numerical, analytical, and data driven their main theoretical principles were presented and experimental validation was mentioned when carried out. System parameters were grouped into three categories system design, soil types, and soil surface coverage. System design parameters, especially length and burial depth, bore the most important influence on the thermal efficiency of the system. The paper was rounded up with an economic assessment of system application, and the conclusions highlighted the need for more experimental work including laboratory simulators.


Isotropic Riemannian Maps and Helices along Riemannian Maps. This work has two main purposes. The first aim is to study isotropic Riemannian maps as a generalization of isotropic immersions. For this purpose, the concept of isotropic Riemannian map is presented, an example is given and a characterization is obtained. The second aim is to study the helices along Riemannian map. For this purpose, by using the notion of isotropic Riemannian map and the notion of helix on the manifold, a characterization is obtained for the transportation of a helix on the total manifold to the target manifold along a Riemannian map.


DMRVisNet Deep Multi head Regression Network for Pixel wise Visibility Estimation Under Foggy Weather. Scene perception is essential for driving decision making and traffic safety. However, fog, as a kind of common weather, frequently appears in the real world, especially in the mountain areas, making it difficult to accurately observe the surrounding environments. Therefore, precisely estimating the visibility under foggy weather can significantly benefit traffic management and safety. To address this, most current methods use professional instruments outfitted at fixed locations on the roads to perform the visibility measurement these methods are expensive and less flexible. In this paper, we propose an innovative end to end convolutional neural network framework to estimate the visibility leveraging Koschmieder's law exclusively using the image data. The proposed method estimates the visibility by integrating the physical model into the proposed framework, instead of directly predicting the visibility value via the convolutional neural work. Moreover, we estimate the visibility as a pixel wise visibility map against those of previous visibility measurement methods which solely predict a single value for an entire image. Thus, the estimated result of our method is more informative, particularly in uneven fog scenarios, which can benefit to developing a more precise early warning system for foggy weather, thereby better protecting the intelligent transportation infrastructure systems and promoting its development. To validate the proposed framework, a virtual dataset, FACI, containing 3,000 foggy images in different concentrations, is collected using the AirSim platform. Detailed experiments show that the proposed method achieves performance competitive to those of state of the art methods.


Prophet Matching Meets Probing with Commitment. We consider the online stochastic matching problem for bipartite graphs where edges adjacent to an online node must be probed to determine if they exist, based on known edge probabilities. Our algorithms respect commitment, in that if a probed edge exists, it must be used in the matching. We study this matching problem subject to a downward closed constraint on each online node's allowable edge probes. Our setting generalizes the commonly studied patience (or time out) constraint which limits the number of probes that can be made to an online node's adjacent edges. We introduce a new LP that we prove is a relaxation of an optimal offline probing algorithm (the adaptive benchmark) and which overcomes the limitations of previous LP relaxations. (1) A tight frac 1 2 ratio when the stochastic graph is generated from a known stochastic type graph where the t th online node is drawn independently from a known distribution scr D pi(t) and pi is chosen adversarially. We refer to this setting as the known i.d. stochastic matching problem with adversarial arrivals. (2) A 1 1 e ratio when the stochastic graph is generated from a known stochastic type graph where the t th online node is drawn independently from a known distribution scr D pi(t) and pi is a random permutation. We refer to this setting as the known i.d. stochastic matching problem with random order arrivals. Our results improve upon the previous best competitive ratio of 0.46 in the known i.i.d. setting against the standard adaptive benchmark. Moreover, we are the first to study the prophet secretary matching problem in the context of probing, where we match the best known classical result.


You Only Compress Once Towards Effective and Elastic BERT Compression via Exploit Explore Stochastic Nature Gradient. Despite superior performance on various natural language processing tasks, pre trained models such as BERT are challenged by deploying on resource constraint devices. Most existing model compression approaches require re compression or fine tuning across diverse constraints to accommodate various hardware deployments. This practically limits the further application of model compression. Moreover, the ineffective training and searching process of existing elastic compression paradigms 4,27 prevents the direct migration to BERT compression. Motivated by the necessity of efficient inference across various constraints on BERT, we propose a novel approach, YOCO BERT, to achieve compress once and deploy everywhere. Specifically, we first construct a huge search space with 10 13 architectures, which covers nearly all configurations in BERT model. Then, we propose a novel stochastic nature gradient optimization method to guide the generation of optimal candidate architecture which could keep a balanced trade off between explorations and exploitation. When a certain resource constraint is given, a lightweight distribution optimization approach is utilized to obtain the optimal network for target deployment without fine tuning. Compared with state of the art algorithms, YOCO BERT provides more compact models, yet achieving 2.1 4.5 average accuracy improvement on the GLUE benchmark. Besides, YOCO BERT is also more effective, e.g.,the training complexity is O(1)for N different devices. Code is availablehttps github.com MAC AutoML YOCO BERT.


Challenges and Solutions to Build a Data Pipeline to Identify Anomalies in Enterprise System Performance. We discuss how VMware is solving the following challenges to harness data to operate our ML based anomaly detection system to detect performance issues in our Software Defined Data Center (SDDC) enterprise deployments (i) label scarcity and label bias due to heavy dependency on unscalable human annotators, and (ii) data drifts due to ever changing workload patterns, software stack and underlying hardware. Our anomaly detection system has been deployed in production for many years and has successfully detected numerous major performance issues. We demonstrate that by addressing these data challenges, we not only improve the accuracy of our performance anomaly detection model by 30 , but also ensure that the model performance to never degrade over time.


Improved Rates for Derivative Free Gradient Play in Strongly Monotone Games. The influential work of Bravo et al. 2018 shows that derivative free play in strongly monotone games has complexity O(d 2 varepsilon 3) , where varepsilon is the target accuracy on the expected squared distance to the solution. This note shows that the efficiency estimate is actually O(d 2 varepsilon 2) , which reduces to the known efficiency guarantee for the method in unconstrained optimization. The argument we present simple interprets the method as stochastic gradient play on a slightly perturbed strongly monotone game.


Scattered Image Reconstruction at Near infrared Based on Spatial Modulation Instability. We present a method of near infrared image reconstruction based on spatial modulation instability in a photorefractive strontium barium niobate crystal. The conditions that lead to the formation of modulation instability at near infrared are discussed depending on the theory of modulation instability gain. Experimental results of scattered image reconstruction at the 1064 nm wavelength show the maximum cross correlation coefficient and cross correlation gain are 0.57 and 2.09 respectively. This method is expected to be an aid for near infrared imaging technologies.


Volume preserving parametric finite element methods for axisymmetric geometric evolution equations. We propose and analyze volume preserving parametric finite element methods for surface diffusion, conserved mean curvature flow and an intermediate evolution law in an axisymmetric setting. The weak formulations are presented in terms of the generating curves of the axisymmetric surfaces. The proposed numerical methods are based on piecewise linear parametric finite elements. The constructed fully practical schemes satisfy the conservation of the enclosed volume. In addition, we prove the unconditional stability and consider the distribution of vertices for the discretized schemes. The introduced methods are implicit and the resulting nonlinear systems of equations can be solved very efficiently and accurately via the Newton's iterative method. Numerical results are presented to show the accuracy and efficiency of the introduced schemes for computing the considered axisymmetric geometric flows.


CondNet Conditional Classifier for Scene Segmentation. The fully convolutional network (FCN) has achieved tremendous success in dense visual recognition tasks, such as scene segmentation. The last layer of FCN is typically a global classifier (1x1 convolution) to recognize each pixel to a semantic label. We empirically show that this global classifier, ignoring the intra class distinction, may lead to sub optimal results. In this work, we present a conditional classifier to replace the traditional global classifier, where the kernels of the classifier are generated dynamically conditioned on the input. The main advantages of the new classifier consist of (i) it attends on the intra class distinction, leading to stronger dense recognition capability (ii) the conditional classifier is simple and flexible to be integrated into almost arbitrary FCN architectures to improve the prediction. Extensive experiments demonstrate that the proposed classifier performs favourably against the traditional classifier on the FCN architecture. The framework equipped with the conditional classifier (called CondNet) achieves new state of the art performances on two datasets. The code and models are available at https git.io CondNet.


A Method for Predicting VaR by Aggregating Generalized Distributions Driven by the Dynamic Conditional Score. Constructing a more effective value at risk (VaR) prediction model has long been a goal in financial risk management. In this paper, we propose a novel parametric approach and provide a standard paradigm to demonstrate the modeling. We establish a dynamic conditional score (DCS) model based on high frequency data and a generalized distribution (GD), namely, the GD DCS model, to improve the forecasts of daily VaR. The model assumes that intraday returns at different moments are independent of each other and obey the same kind of GD, whose dynamic parameters are driven by DCS. By predicting the motion law of the time varying parameters, the conditional distribution of intraday returns is determined then, the bootstrap method is used to simulate daily returns. An empirical analysis using data from the Chinese stock market shows that Weibull Pareto DCS model incorporating high frequency data is superior to traditional benchmark models, such as RGARCH, in the prediction of VaR at high risk levels, which proves that this approach contributes to the improvement of risk measurement tools.


Dimensionality Reduction of Longitudinal 'Omics Data using Modern Tensor Factorization. Precision medicine is a clinical approach for disease prevention, detection and treatment, which considers each individual's genetic background, environment and lifestyle. The development of this tailored avenue has been driven by the increased availability of omics methods, large cohorts of temporal samples, and their integration with clinical data. Despite the immense progression, existing computational methods for data analysis fail to provide appropriate solutions for this complex, high dimensional and longitudinal data. In this work we have developed a new method termed TCAM, a dimensionality reduction technique for multi way data, that overcomes major limitations when doing trajectory analysis of longitudinal omics data. Using real world data, we show that TCAM outperforms traditional methods, as well as state of the art tensor based approaches for longitudinal microbiome data analysis. Moreover, we demonstrate the versatility of TCAM by applying it to several different omics datasets, and the applicability of it as a drop in replacement within straightforward ML tasks.


Error driven Pruning of Language Models for Virtual Assistants. Language models (LMs) for virtual assistants (VAs) are typically trained on large amounts of data, resulting in prohibitively large models which require excessive memory and or cannot be used to serve user requests in real time. Entropy pruning results in smaller models but with significant degradation of effectiveness in the tail of the user request distribution. We customize entropy pruning by allowing for a keep list of infrequent n grams that require a more relaxed pruning threshold, and propose three methods to construct the keep list. Each method has its own advantages and disadvantages with respect to LM size, ASR accuracy and cost of constructing the keep list. Our best LM gives 8 average Word Error Rate (WER) reduction on a targeted test set, but is 3 times larger than the baseline. We also propose discriminative methods to reduce the size of the LM while retaining the majority of the WER gains achieved by the largest LM.


What Does The User Want? Information Gain for Hierarchical Dialogue Policy Optimisation. The dialogue management component of a task oriented dialogue system is typically optimised via reinforcement learning (RL). Optimisation via RL is highly susceptible to sample inefficiency and instability. The hierarchical approach called Feudal Dialogue Management takes a step towards more efficient learning by decomposing the action space. However, it still suffers from instability due to the reward only being provided at the end of the dialogue. We propose the usage of an intrinsic reward based on information gain to address this issue. Our proposed reward favours actions that resolve uncertainty or query the user whenever necessary. It enables the policy to learn how to retrieve the users' needs efficiently, which is an integral aspect in every task oriented conversation. Our algorithm, which we call FeudalGain, achieves state of the art results in most environments of the PyDial framework, outperforming much more complex approaches. We confirm the sample efficiency and stability of our algorithm through experiments in simulation and a human trial.


Tackling Inter Class Similarity and Intra Class Variance for Microscopic Image based Classification. Automatic classification of aquatic microorganisms is based on the morphological features extracted from individual images. The current works on their classification do not consider the inter class similarity and intra class variance that causes misclassification. We are particularly interested in the case where variance within a class occurs due to discrete visual changes in microscopic images. In this paper, we propose to account for it by partitioning the classes with high variance based on the visual features. Our algorithm automatically decides the optimal number of sub classes to be created and consider each of them as a separate class for training. This way, the network learns finer grained visual features. Our experiments on two databases of freshwater benthic diatoms and marine plankton show that our method can outperform the state of the art approaches for classification of these aquatic microorganisms.


Radioactive nuclei for beta gamma PET and theranostics selected candidates. PET is an established medical diagnostic imaging method. Continuous improvements are aimed at refining image reconstruction, reducing the amount of radioactive tracer and combining with targeted therapy. TOF PET provides the localization of the tracer through improved time resolution, nuclear physics may contribute to this goal via selection of radioactive nuclei emitting additional gamma rays. This additional radiation, when properly detected, localizes the decay of the tracer at the line of response determined by two detected 511 keV quanta. Selected candidates are presented. Some are particularly interesting, as they are strong candidates for theranostic applications.


Going Grayscale The Road to Understanding and Improving Unlearnable Examples. Recent work has shown that imperceptible perturbations can be applied to craft unlearnable examples (ULEs), i.e. images whose content cannot be used to improve a classifier during training. In this paper, we reveal the road that researchers should follow for understanding ULEs and improving ULEs as they were originally formulated (ULEOs). The paper makes four contributions. First, we show that ULEOs exploit color and, consequently, their effects can be mitigated by simple grayscale pre filtering, without resorting to adversarial training. Second, we propose an extension to ULEOs, which is called ULEO GrayAugs, that forces the generated ULEs away from channel wise color perturbations by making use of grayscale knowledge and data augmentations during optimization. Third, we show that ULEOs generated using Multi Layer Perceptrons (MLPs) are effective in the case of complex Convolutional Neural Network (CNN) classifiers, suggesting that CNNs suffer specific vulnerability to ULEs. Fourth, we demonstrate that when a classifier is trained on ULEOs, adversarial training will prevent a drop in accuracy measured both on clean images and on adversarial images. Taken together, our contributions represent a substantial advance in the state of art of unlearnable examples, but also reveal important characteristics of their behavior that must be better understood in order to achieve further improvements.


Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximation. We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with the speed of a NN. For a BM, making predictions with the lowest expected loss requires integrating over the posterior distribution. When exact inference of the posterior predictive distribution is intractable, approximation methods are typically applied, e.g. Monte Carlo (MC) simulation. For MC, the variance of the estimator decreases with the number of samples but at the expense of increased computational cost. Our approach removes the need for iterative MC simulation on the CPU at prediction time. In brief, it works by fitting a NN to synthetic data generated using the BM. In a single feed forward pass, the NN gives a set of point wise approximations to the BM's posterior predictive distribution for a given observation. We achieve risk minimized predictions significantly faster than standard methods with a negligible loss on the test dataset. We combine this approach with Active Learning to minimize the amount of data required for fitting the NN. This is done by iteratively labeling more data in regions with high predictive uncertainty of the NN.


On the regularity of very weak solutions for an elliptic coupled system of liquid crystal flows. We consider here an elliptic coupled system describing the dynamics of liquid crystals flows. This system is posed on the whole n dimensional space. We introduce first the notion of very weak solutions for this system. Then, within the fairly general framework of the Morrey spaces, we derive some sufficient conditions on the very weak solutions which improve their regularity. As a bi product, we also prove a new regularity criterium for the time independing Navier Stokes equations.


Stimuli Sensitive Hawkes Processes for Personalized Student Procrastination Modeling. Student procrastination and cramming for deadlines are major challenges in online learning environments, with negative educational and well being side effects. Modeling student activities in continuous time and predicting their next study time are important problems that can help in creating personalized timely interventions to mitigate these challenges. However, previous attempts on dynamic modeling of student procrastination suffer from major issues they are unable to predict the next activity times, cannot deal with missing activity history, are not personalized, and disregard important course properties, such as assignment deadlines, that are essential in explaining the cramming behavior. To resolve these problems, we introduce a new personalized stimuli sensitive Hawkes process model (SSHP), by jointly modeling all student assignment pairs and utilizing their similarities, to predict students' next activity times even when there are no historical observations. Unlike regular point processes that assume a constant external triggering effect from the environment, we model three dynamic types of external stimuli, according to assignment availabilities, assignment deadlines, and each student's time management habits. Our experiments on two synthetic datasets and two real world datasets show a superior performance of future activity prediction, comparing with state of the art models. Moreover, we show that our model achieves a flexible and accurate parameterization of activity intensities in students.


Federated Multi Target Domain Adaptation. Federated learning methods enable us to train machine learning models on distributed user data while preserving its privacy. However, it is not always feasible to obtain high quality supervisory signals from users, especially for vision tasks. Unlike typical federated settings with labeled client data, we consider a more practical scenario where the distributed client data is unlabeled, and a centralized labeled dataset is available on the server. We further take the server client and inter client domain shifts into account and pose a domain adaptation problem with one source (centralized server data) and multiple targets (distributed client data). Within this new Federated Multi Target Domain Adaptation (FMTDA) task, we analyze the model performance of exiting domain adaptation methods and propose an effective DualAdapt method to address the new challenges. Extensive experimental results on image classification and semantic segmentation tasks demonstrate that our method achieves high accuracy, incurs minimal communication cost, and requires low computational resources on client devices.


Navigating by Touch Haptic Monte Carlo Localization via Geometric Sensing and Terrain Classification. Legged robot navigation in extreme environments can hinder the use of cameras and laser scanners due to darkness, air obfuscation or sensor damage. In these conditions, proprioceptive sensing will continue to work reliably. In this paper, we propose a purely proprioceptive localization algorithm which fuses information from both geometry and terrain class, to localize a legged robot within a prior map. First, a terrain classifier computes the probability that a foot has stepped on a particular terrain class from sensed foot forces. Then, a Monte Carlo based estimator fuses this terrain class probability with the geometric information of the foot contact points. Results are demonstrated showing this approach operating online and onboard a ANYmal B300 quadruped robot traversing a series of terrain courses with different geometries and terrain types over more than 1.2km. The method keeps the localization error below 20cm using only the information coming from the feet, IMU, and joints of the quadruped.


Eighty Years of the Finite Element Method Birth, Evolution, and Future. This year marks the eightieth anniversary of the invention of the finite element method (FEM). FEM has become the computational workhorse for engineering design analysis and scientific modeling of a wide range of physical processes, including material and structural mechanics, fluid flow and heat conduction, various biological processes for medical diagnosis and surgery planning, electromagnetics and semi conductor circuit and chip design and analysis, additive manufacturing, i.e. virtually every conceivable problem that can be described by partial differential equations (PDEs). FEM has fundamentally revolutionized the way we do scientific modeling and engineering design, ranging from automobiles, aircraft, marine structures, bridges, highways, and high rise buildings. Associated with the development of finite element methods has been the concurrent development of an engineering science discipline called computational mechanics, or computational science and engineering. In this paper, we present a historical perspective on the developments of finite element methods mainly focusing on its applications and related developments in solid and structural mechanics, with limited discussions to other fields in which it has made significant impact, such as fluid mechanics, heat transfer, and fluid structure interaction. To have a complete storyline, we divide the development of the finite element method into four time periods I. (1941 1965) Early years of FEM II. (1966 1991) Golden age of FEM III. (1992 2017) Large scale, industrial applications of FEM and development of material modeling, and IV (2018 ) the state of the art FEM technology for the current and future eras of FEM research. Note that this paper may not strictly follow the chronological order of FEM developments, because often time these developments were interwoven across different time periods.


Local to Global Self Attention in Vision Transformers. Transformers have demonstrated great potential in computer vision tasks. To avoid dense computations of self attentions in high resolution visual data, some recent Transformer models adopt a hierarchical design, where self attentions are only computed within local windows. This design significantly improves the efficiency but lacks global feature reasoning in early stages. In this work, we design a multi path structure of the Transformer, which enables local to global reasoning at multiple granularities in each stage. The proposed framework is computationally efficient and highly effective. With a marginal increasement in computational overhead, our model achieves notable improvements in both image classification and semantic segmentation. Code is available at https github.com ljpadam LG Transformer


Text to Text Multi view Learning for Passage Re ranking. Recently, much progress in natural language processing has been driven by deep contextualized representations pretrained on large corpora. Typically, the fine tuning on these pretrained models for a specific downstream task is based on single view learning, which is however inadequate as a sentence can be interpreted differently from different perspectives. Therefore, in this work, we propose a text to text multi view learning framework by incorporating an additional view the text generation view into a typical single view passage ranking model. Empirically, the proposed approach is of help to the ranking performance compared to its single view counterpart. Ablation studies are also reported in the paper.


Placement and Allocation of Communications Resources in Slicing aware Flying Networks. Network slicing emerged in 5G networks as a key component to enable the use of multiple services with different performance requirements on top of a shared physical network infrastructure. A major challenge lies on ensuring wireless coverage and enough communications resources to meet the target Quality of Service (QoS) levels demanded by these services, including throughput and delay guarantees. The challenge is exacerbated in temporary events, such as disaster management scenarios and outdoor festivities, where the existing wireless infrastructures may collapse, fail to provide sufficient wireless coverage, or lack the required communications resources. Flying networks, composed of Unmanned Aerial Vehicles (UAVs), emerged as a solution to provide on demand wireless coverage and communications resources anywhere, anytime. However, existing solutions mostly rely on best effort networks. The main contribution of this paper is SLICER, an algorithm enabling the placement and allocation of communications resources in slicing aware flying networks. The evaluation carried out by means of ns 3 simulations shows SLICER can meet the targeted QoS levels, while using the minimum amount of communications resources.


Discontinuous Transitions Towards Vortex Condensates in Buoyancy Driven Rotating Turbulence. Using direct numerical simulations of rotating Rayleigh B 'enard convection, we explore the transitions between turbulent states from a 3D flow state towards a quasi 2D condensate known as the large scale vortex (LSV). We vary the Rayleigh number Ra as control parameter and study the system response (strength of the LSV) in terms of order parameters assessing the energetic content in the flow and the upscale energy flux. By sensitively probing the boundaries of the region of existence of the LSV in parameter space, we find discontinuous transitions and we identify the presence of a hysteresis loop as well as memoryless abrupt growth dynamics. We show furthermore that the creation of the condensate state coincides with a discontinuous transition of the energy transport into the largest mode of the system.


Brauer Configuration Algebras and Matrix Problems to Categorify Integer Sequences. Bijections between invariants associated to indecomposable projective modules over some suitable Brauer configuration algebras and invariants associated to solutions of the Kronecker problem and the four subspace problem are used to categorify integer sequences in the sense of Ringel and Fahr. Dimensions of the Brauer configuration algebras and their corresponding centers involved in the different processes are given as well.


Diffraction Tomography, Fourier Reconstruction, and Full Waveform Inversion. In this paper, we study the mathematical imaging problem of diffraction tomography (DT), which is an inverse scattering technique used to find material properties of an object by illuminating it with probing waves and recording the scattered waves. Conventional DT relies on the Fourier diffraction theorem, which is applicable under the condition of weak scattering. However, if the object has high contrasts or is too large compared to the wavelength, it tends to produce multiple scattering, which complicates the reconstruction. We give a survey on diffraction tomography and compare the reconstruction of low and high contrast objects. We also implement and compare the reconstruction using the full waveform inversion method which, contrary to the Born and Rytov approximations, works with the total field and is more robust to multiple scattering.


Optimizing piano practice with a utility based scaffold. A typical part of learning to play the piano is the progression through a series of practice units that focus on individual dimensions of the skill, such as hand coordination, correct posture, or correct timing. Ideally, a focus on a particular practice method should be made in a way to maximize the learner's progress in learning to play the piano. Because we each learn differently, and because there are many choices for possible piano practice tasks and methods, the set of practice tasks should be dynamically adapted to the human learner. However, having a human teacher guide individual practice is not always feasible since it is time consuming, expensive, and not always available. Instead, we suggest to optimize in the space of practice methods, the so called practice modes. The proposed optimization process takes into account the skills of the individual learner and their history of learning. In this work we present a modeling framework to guide the human learner through the learning process by choosing practice modes that have the highest expected utility (i.e., improvement in piano playing skill). To this end, we propose a human learner utility model based on a Gaussian process, and exemplify the model training and its application for practice scaffolding on an example of simulated human learners.


A Short and Elementary Proof of the Central Limit Theorem by Individual Swapping. We present a short proof of the central limit theorem which is elementary in the sense that no knowledge of characteristic functions, linear operators, or other advanced results are needed. Our proof is based on Lindeberg's trick of swapping a term for a normal random variable in turn. The modifications needed to prove the stronger Lindeberg Feller central limit theorem are addressed at the end.


Task Fingerprinting for Meta Learning in Biomedical Image Analysis. Shortage of annotated data is one of the greatest bottlenecks in biomedical image analysis. Meta learning studies how learning systems can increase in efficiency through experience and could thus evolve as an important concept to overcome data sparsity. However, the core capability of meta learning based approaches is the identification of similar previous tasks given a new task a challenge largely unexplored in the biomedical imaging domain. In this paper, we address the problem of quantifying task similarity with a concept that we refer to as task fingerprinting. The concept involves converting a given task, represented by imaging data and corresponding labels, to a fixed length vector representation. In fingerprint space, different tasks can be directly compared irrespective of their data set sizes, types of labels or specific resolutions. An initial feasibility study in the field of surgical data science (SDS) with 26 classification tasks from various medical and non medical domains suggests that task fingerprinting could be leveraged for both (1) selecting appropriate data sets for pretraining and (2) selecting appropriate architectures for a new task. Task fingerprinting could thus become an important tool for meta learning in SDS and other fields of biomedical image analysis.


Finding Regions of Heterogeneity in Decision Making via Expected Conditional Covariance. Individuals often make different decisions when faced with the same context, due to personal preferences and background. For instance, judges may vary in their leniency towards certain drug related offenses, and doctors may vary in their preference for how to start treatment for certain types of patients. With these examples in mind, we present an algorithm for identifying types of contexts (e.g., types of cases or patients) with high inter decision maker disagreement. We formalize this as a causal inference problem, seeking a region where the assignment of decision maker has a large causal effect on the decision. Our algorithm finds such a region by maximizing an empirical objective, and we give a generalization bound for its performance. In a semi synthetic experiment, we show that our algorithm recovers the correct region of heterogeneity accurately compared to baselines. Finally, we apply our algorithm to real world healthcare datasets, recovering variation that aligns with existing clinical knowledge.


Computing the Characteristic Polynomial of Generic Toeplitz like and Hankel like Matrices. New algorithms are presented for computing annihilating polynomials of Toeplitz, Hankel, and more generally Toeplitz Hankel like matrices over a field. Our approach follows works on Coppersmith's block Wiedemann method with structured projections, which have been recently successfully applied for computing the bivariate resultant. A first baby step giant step approach directly derived using known techniques on structured matrices gives a randomized Monte Carlo algorithm for the minimal polynomial of an n times n Toeplitz or Hankel like matrix of displacement rank alpha using tilde O(n omega c( omega) alpha c( omega) ) arithmetic operations, where omega is the exponent of matrix multiplication and c(2.373) approx 0.523 for the best known value of omega . For generic Toeplitz Hankel like matrices a second algorithm computes the characteristic polynomial in tilde O(n 2 1 omega ) operations when the displacement rank is considered constant. Previous algorithms required O(n 2) operations while the exponents presented here are respectively less than 1.86 and 1.58 with the best known estimate for omega .


Molecular Vibration Explorer an online database and toolbox for surface enhanced frequency conversion, infrared and Raman spectroscopy. We present Molecular Vibration Explorer, a freely accessible online database and interactive tool for exploring vibrational spectra and tensorial light vibration coupling strengths of a large collection of thiolated molecules. The Gold' version of the database gathers the results from density functional theory calculations on 2'800 commercially available thiol compounds linked to a gold atom, with the main motivation to screen the best molecules for THz and mid infrared to visible upconversion. Additionally, the Thiol' version of the database contains results for 1'900 unbound thiolated compounds. They both provide access to a comprehensive set of computed spectroscopic parameters for all vibrational modes of all molecules in the database. The user can simultaneously investigate infrared absorption, Raman scattering and vibrational sum and difference frequency generation cross sections. Molecules can be screened for various parameters in custom frequency ranges, such as large Raman cross section under specific molecular orientation, or large orientation averaged sum frequency generation (SFG) efficiency. The user can select polarization vectors for the electromagnetic fields, set the orientation of the molecule and customize parameters for plotting the corresponding IR, Raman and sum frequency spectra. We illustrate the capabilities of this tool with selected applications in the field of surface enhanced spectroscopy.


On the coefficients of the distinct monomials in the expansion of x 1(x 1 x 2) cdots(x 1 x 2 cdots x n) . We initiate the study of the coefficients of the distinct monomials in the expansion of the multivariate polynomials x 1(x 1 x 2) cdots(x 1 x 2 cdots x n), n in N . In particular we obtain several results regarding their maximal coefficients.


The Highs and Lows of Simple Lexical Domain Adaptation Approaches for Neural Machine Translation. Machine translation systems are vulnerable to domain mismatch, especially in a low resource scenario. Out of domain translations are often of poor quality and prone to hallucinations, due to exposure bias and the decoder acting as a language model. We adopt two approaches to alleviate this problem lexical shortlisting restricted by IBM statistical alignments, and hypothesis re ranking based on similarity. The methods are computationally cheap, widely known, but not extensively experimented on domain adaptation. We demonstrate success on low resource out of domain test sets, however, the methods are ineffective when there is sufficient data or too great domain mismatch. This is due to both the IBM model losing its advantage over the implicitly learned neural alignment, and issues with subword segmentation of out of domain words.


Achieving Transparency Report Privacy in Linear Time. An accountable algorithmic transparency report (ATR) should ideally investigate the (a) transparency of the underlying algorithm, and (b) fairness of the algorithmic decisions, and at the same time preserve data subjects' privacy. However, a provably formal study of the impact to data subjects' privacy caused by the utility of releasing an ATR (that investigates transparency and fairness), is yet to be addressed in the literature. The far fetched benefit of such a study lies in the methodical characterization of privacy utility trade offs for release of ATRs in public, and their consequential application specific impact on the dimensions of society, politics, and economics. In this paper, we first investigate and demonstrate potential privacy hazards brought on by the deployment of transparency and fairness measures in released ATRs. To preserve data subjects' privacy, we then propose a linear time optimal privacy scheme, built upon standard linear fractional programming (LFP) theory, for announcing ATRs, subject to constraints controlling the tolerance of privacy perturbation on the utility of transparency schemes. Subsequently, we quantify the privacy utility trade offs induced by our scheme, and analyze the impact of privacy perturbation on fairness measures in ATRs. To the best of our knowledge, this is the first analytical work that simultaneously addresses trade offs between the triad of privacy, utility, and fairness, applicable to algorithmic transparency reports.


PAIR Leveraging Passage Centric Similarity Relation for Improving Dense Passage Retrieval. Recently, dense passage retrieval has become a mainstream approach to finding relevant information in various natural language processing tasks. A number of studies have been devoted to improving the widely adopted dual encoder architecture. However, most of the previous studies only consider query centric similarity relation when learning the dual encoder retriever. In order to capture more comprehensive similarity relations, we propose a novel approach that leverages both query centric and PAssage centric sImilarity Relations (called PAIR) for dense passage retrieval. To implement our approach, we make three major technical contributions by introducing formal formulations of the two kinds of similarity relations, generating high quality pseudo labeled data via knowledge distillation, and designing an effective two stage training procedure that incorporates passage centric similarity relation constraint. Extensive experiments show that our approach significantly outperforms previous state of the art models on both MSMARCO and Natural Questions datasets.


Goal Oriented Gaze Estimation for Zero Shot Learning. Zero shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are highly local, strong prior for localization of object attribute is beneficial for visual semantic embedding. Interestingly, when recognizing unseen images, human would also automatically gaze at regions with certain semantic clue. Therefore, we introduce a novel goal oriented gaze estimation module (GEM) to improve the discriminative attribute localization based on the class level attributes for ZSL. We aim to predict the actual human gaze location to get the visual attention regions for recognizing a novel object guided by attribute description. Specifically, the task dependent attention is learned with the goal oriented GEM, and the global image features are simultaneously optimized with the regression of local attribute features. Experiments on three ZSL benchmarks, i.e., CUB, SUN and AWA2, show the superiority or competitiveness of our proposed method against the state of the art ZSL methods. The ablation analysis on real gaze data CUB VWSW also validates the benefits and accuracy of our gaze estimation module. This work implies the promising benefits of collecting human gaze dataset and automatic gaze estimation algorithms on high level computer vision tasks. The code is available at https github.com osierboy GEM ZSL.


An open source MATLAB package to perform basic statistical analysis of turbulence data and other complex systems along with its application to Fokker Planck equation and Integral fluctuation theorem. We present a user friendly open source proglang MATLAB textsuperscript textregistered package developed by the research group Turbulence, Wind energy and Stochastics (TWiSt) at the Carl von Ossietzky University of Oldenburg. This package enables to perform a standard analysis of given turbulent data and extracts the stochastic equations describing the scale dependent cascade process in turbulent flows through Fokker Planck equations. As a precondition, Markovian properties of the process in scale are tested. Such a stochastic scale dependent cascade process allows a comprehensive statistical description in terms of the complexity of the data. Cascade trajectories can be defined as single events, for each of which a total entropy production can be determined. For such entropy fluctuations a rigorous law of non equilibrium stochastic thermodynamics, namely the integral fluctuation theorem, will be verified. As the analysis of the scale dependent cascade process through a hierarchy of spatial and temporal scales in turbulent flows is an integral part of turbulence theory, this interdisciplinary treatment of the turbulent cascade process has the potential for a new way to link the statistical description of turbulence (via common two point increment statistics), non equilibrium stochastic thermodynamics and local turbulent flow structures. The presented package can be used also for the analysis of other data with turbulent like complexity.


Instrument Space Selection for Kernel Maximum Moment Restriction. Kernel maximum moment restriction (KMMR) recently emerges as a popular framework for instrumental variable (IV) based conditional moment restriction (CMR) models with important applications in conditional moment (CM) testing and parameter estimation for IV regression and proximal causal learning. The effectiveness of this framework, however, depends critically on the choice of a reproducing kernel Hilbert space (RKHS) chosen as a space of instruments. In this work, we presents a systematic way to select the instrument space for parameter estimation based on a principle of the least identifiable instrument space (LIIS) that identifies model parameters with the least space complexity. Our selection criterion combines two distinct objectives to determine such an optimal space (i) a test criterion to check identifiability (ii) an information criterion based on the effective dimension of RKHSs as a complexity measure. We analyze the consistency of our method in determining the LIIS, and demonstrate its effectiveness for parameter estimation via simulations.


Game and Simulation Design for Studying Pedestrian Automated Vehicle Interactions. The present cross disciplinary research explores pedestrian autonomous vehicle interactions in a safe, virtual environment. We first present contemporary tools in the field and then propose the design and development of a new application that facilitates pedestrian point of view research. We conduct a three step user experience experiment where participants answer questions before and after using the application in various scenarios. Behavioral results in virtuality, especially when there were consequences, tend to simulate real life sufficiently well to make design choices, and we received valuable insights into human vehicle interaction. Our tool seemed to start raising participant awareness of autonomous vehicles and their capabilities and limitations, which is an important step in overcoming public distrust of AVs. Further, studying how users respect or take advantage of AVs may help inform future operating mode indicator design as well as algorithm biases that might support socially optimal AV operation.


Geometric properties of some generalized Mathieu power series inside the unit disk. We consider two parametric families of special functions One is defined by a power series generalizing the classical Mathieu series, and the other one is a generalized Mathieu type power series involving factorials in its coefficients. Using criteria due to Fejer and Ozaki, we provide sufficient conditions for these functions to be close to convex or starlike inside the unit disk, and thus univalent.


Secure Hypersphere Range Query on Encrypted Data. Spatial queries like range queries, nearest neighbor, circular range queries etc. are the most widely used queries in the location based applications. Building secure and efficient solutions for these queries in the cloud computing framework is critical and has been an area of active research. This paper focuses on the problem of Secure Circular Range Queries (SCRQ), where client submits an encrypted query (consisting of a center point and radius of the circle) and the cloud (storing encrypted data points) has to return the points lying inside the circle. The existing solutions for this problem suffer from various disadvantages such as high processing time which is proportional to square of the query radius, query generation phase which is directly proportional to the number of points covered by the query etc. This paper presents solution for the above problem which is much more efficient than the existing solutions. Three protocols are proposed with varying characteristics. It is shown that all the three protocols are secure. The proposed protocols can be extended to multiple dimensions and thus are able to handle Secure Hypersphere Range Queries (SHRQ) as well. Internally the proposed protocols use pairing based cryptography and a concept of lookup table. To enable the efficient use of limited size lookup table, a new storage scheme is presented. The proposed storage scheme enables the protocols to handle query with much larger radius values. Using the SHRQ protocols, we also propose a mechanism to answer the Secure range Queries. Extensive performance evaluation has been done to evaluate the efficiency of the proposed protocols


A new class of differential quasivariational inequalities with an application to a quasistatic viscoelastic frictional contact problem. The overarching goal of this paper is to introduce and investigate a new nonlinear system driven by a nonlinear differential equation, a history dependent quasivariational inequality, and a parabolic variational inequality in Banach spaces. Such a system can be used to model quasistatic frictional contact problems for viscoelastic materials with long memory, damage and wear. By using the Banach fixed point theorem, we prove an existence and uniqueness theorem of solution for such a system under some mild conditions. As a novel application, we obtain a unique solvability of a quasistatic viscoelastic frictional contact problem with long memory, damage and wear.


A Stochastic Model of Chemorepulsion with Additive Noise and Nonlinear Sensitivity. We consider a stochastic partial differential equation (SPDE) model for chemorepulsion, with non linear sensitivity on the one dimensional torus. We show that for any suitable initial data there exists a pathwise unique, global solution to the SPDE. Furthermore we show that the associated semi group is Markov and possesses a unique invariant measure, supported on a H "older Besov space of positive regularity, which the solution law converges to exponentially fast. We also establish tail bounds on the invariant measure that are heavier than Gaussian when measured using any L p norm.


On Exact and Approximate Policies for Linear Tape Scheduling in Data Centers. This paper investigates scheduling policies for file retrieval in linear storage devices, such as magnetic tapes. Tapes are the technology of choice for long term storage in data centers due to their low cost per capacity, reliability, and data security. While scheduling problems associated with data retrieval in tapes are classical, existing works focus on more straightforward heuristic approaches due to limited computational times imposed by standard tape specifications. Our first contribution is a theoretical investigation of three standard policies, presenting their worst case performance and special cases of practical relevance for which they are optimal. Next, we show that the problem is polynomially solvable via two interleaved recursive models, albeit with high computational complexity. We leverage our previous results to develop two new scheduling policies with constant ratio performance and low computational cost. Finally, we investigate properties associated with the online variant of the problem, presenting a new constant factor competitive algorithm. Our numerical analysis on synthetic and real world tapes from an industry partner provides insights into dataset configurations where each policy is more effective, which is of relevance to data center managers. In particular, our new best performing policy is practical for large datasets and significantly improves upon standard algorithms in the area.


Rigidity of Beltrami fields with a non constant proportionality factor. We prove that bounded Beltrami fields must be symmetric if a proportionality factor depends on 2 variables in the cylindrical coordinate and admits a regular level set diffeomorphic to a cylinder or a torus.


Scaling Federated Learning for Fine tuning of Large Language Models. Federated learning (FL) is a promising approach to distributed compute, as well as distributed data, and provides a level of privacy and compliance to legal frameworks. This makes FL attractive for both consumer and healthcare applications. While the area is actively being explored, few studies have examined FL in the context of larger language models and there is a lack of comprehensive reviews of robustness across tasks, architectures, numbers of clients, and other relevant factors. In this paper, we explore the fine tuning of Transformer based language models in a federated learning setting. We evaluate three popular BERT variants of different sizes (BERT, ALBERT, and DistilBERT) on a number of text classification tasks such as sentiment analysis and author identification. We perform an extensive sweep over the number of clients, ranging up to 32, to evaluate the impact of distributed compute on task performance in the federated averaging setting. While our findings suggest that the large sizes of the evaluated models are not generally prohibitive to federated training, we found that the different models handle federated averaging to a varying degree. Most notably, DistilBERT converges significantly slower with larger numbers of clients, and under some circumstances, even collapses to chance level performance. Investigating this issue presents an interesting perspective for future research.


HJB RBF based approach for the control of PDEs. Semi lagrangian schemes for discretization of the dynamic programming principle are based on a time discretization projected on a state space grid. The use of a structured grid makes this approach not feasible for high dimensional problems due to the curse of dimensionality. Here, we present a new approach for infinite horizon optimal control problems where the value function is computed using Radial Basis Functions (RBF) by the Shepard's moving least squares approximation method on scattered grids. We propose a new method to generate a scattered mesh driven by the dynamics and the selection of the shape parameter in the RBF using an optimization routine. This mesh will help to localize the problem and approximate the dynamic programming principle in high dimension. Error estimates for the value function are also provided. Numerical tests for high dimensional problems will show the effectiveness of the proposed method.


Enhancing Self Disclosure In Neural Dialog Models By Candidate Re ranking. Neural language modelling has progressed the state of the art in different downstream Natural Language Processing (NLP) tasks. One such area is of open domain dialog modelling, neural dialog models based on GPT 2 such as DialoGPT have shown promising performance in single turn conversation. However, such (neural) dialog models have been criticized for generating responses which although may have relevance to the previous human response, tend to quickly dissipate human interest and descend into trivial conversation. One reason for such performance is the lack of explicit conversation strategy being employed in human machine conversation. Humans employ a range of conversation strategies while engaging in a conversation, one such key social strategies is Self disclosure(SD). A phenomenon of revealing information about one self to others. Social penetration theory (SPT) proposes that communication between two people moves from shallow to deeper levels as the relationship progresses primarily through self disclosure. Disclosure helps in creating rapport among the participants engaged in a conversation. In this paper, Self disclosure enhancement architecture (SDEA) is introduced utilizing Self disclosure Topic Model (SDTM) during inference stage of a neural dialog model to re rank response candidates to enhance self disclosure in single turn responses from from the model.


Polychrony as Chinampas. We study the flow of signals through paths with the following condition a node emits a signal if two incoming signals from other nodes arrive coincidentally or if it receives an external stimuli. We apply our study to count and describe families of polychrony groups on a line, and we introduce triangular sequences.


Block Activated Algorithms for Multicomponent Fully Nonsmooth Minimization. Under consideration are multicomponent minimization problems involving a separable nonsmooth convex function penalizing the components individually, and nonsmooth convex coupling terms penalizing linear mixtures of the components. We investigate block activated proximal algorithms for solving such problems, i.e., algorithms which, at each iteration, need to use only a block of the underlying functions, as opposed to all of them as in standard methods. For smooth coupling functions, several block activated algorithms exist and they are well understood. By contrast, in the fully nonsmooth case, few block activated methods are available and little effort has been devoted to assessing them. Our goal is to shed more light on the implementation, the features, and the behavior of these algorithms, compare their merits, and provide machine learning and image recovery experiments illustrating their performance.


Graph Exploration by Energy Sharing Mobile Agents. We consider the problem of collective exploration of a known n node edge weighted graph by k mobile agents that have limited energy but are capable of energy transfers. The agents are initially placed at an arbitrary subset of nodes in the graph, and each agent has an initial, possibly different, amount of energy. The goal of the exploration problem is for every edge in the graph to be traversed by at least one agent. The amount of energy used by an agent to travel distance x is proportional to x . In our model, the agents can em share energy when co located when two agents meet, one can transfer part of its energy to the other. For an n node path, we give an O(n k) time algorithm that either finds an exploration strategy, or reports that one does not exist. For an n node tree with ell leaves, we give an O(n ell k 2) algorithm that finds an exploration strategy if one exists. Finally, for the general graph case, we show that the problem of deciding if exploration is possible by energy sharing agents is NP hard, even for 3 regular graphs. In addition, we show that it is always possible to find an exploration strategy if the total energy of the agents is at least twice the total weight of the edges moreover, this is asymptotically optimal.


Isabelle's Metalogic Formalization and Proof Checker. Isabelle is a generic theorem prover with a fragment of higher order logic as a metalogic for defining object logics. Isabelle also provides proof terms. We formalize this metalogic and the language of proof terms in Isabelle HOL, define an executable (but inefficient) proof term checker and prove its correctness w.r.t. the metalogic. We integrate the proof checker with Isabelle and run it on a range of logics and theories to check the correctness of all the proofs in those theories.


Defensive Alliances in Graphs. A set S of vertices of a graph is a defensive alliance if, for each element of S , the majority of its neighbours are in S . We study the parameterized complexity of the Defensive Alliance problem, where the aim is to find a minimum size defensive alliance. Our main results are the following (1) The Defensive Alliance problem has been studied extensively during the last twenty years, but the question whether it is FPT when parameterized by feedback vertex set has still remained open. We prove that the problem is W 1 hard parameterized by a wide range of fairly restrictive structural parameters such as the feedback vertex set number, treewidth, pathwidth, and treedepth of the input graph (2) the problem parameterized by the vertex cover number of the input graph does not admit a polynomial compression unless coNP subseteq NP poly, (3) it does not admit 2 o(n) algorithm under ETH, and (4) the Defensive Alliance problem on circle graphs is NP complete.


Saturated feedback stabilizability to trajectories for the Schl " o gl parabolic equation. It is shown that there exist a finite number of indicator functions, which allow us to track an arbitrary given trajectory of the Schl "ogl model, by means of an explicit saturated feedback control input whose magnitude is bounded by a constant independent of the given targeted trajectory. Simulations are presented showing the stabilizing performance of the explicit feedback constrained control. Further, such performance is compared to that of a receding horizon constrained control minimizing the classical energy cost functional.


Fixed Points in Cyber Space Rethinking Optimal Evasion Attacks in the Age of AI NIDS. Cyber attacks are increasing in volume, frequency, and complexity. In response, the security community is looking toward fully automating cyber defense systems using machine learning. However, so far the resultant effects on the coevolutionary dynamics of attackers and defenders have not been examined. In this whitepaper, we hypothesise that increased automation on both sides will accelerate the coevolutionary cycle, thus begging the question of whether there are any resultant fixed points, and how they are characterised. Working within the threat model of Locked Shields, Europe's largest cyberdefense exercise, we study blackbox adversarial attacks on network classifiers. Given already existing attack capabilities, we question the utility of optimal evasion attack frameworks based on minimal evasion distances. Instead, we suggest a novel reinforcement learning setting that can be used to efficiently generate arbitrary adversarial perturbations. We then argue that attacker defender fixed points are themselves general sum games with complex phase transitions, and introduce a temporally extended multi agent reinforcement learning framework in which the resultant dynamics can be studied. We hypothesise that one plausible fixed point of AI NIDS may be a scenario where the defense strategy relies heavily on whitelisted feature flow subspaces. Finally, we demonstrate that a continual learning approach is required to study attacker defender dynamics in temporally extended general sum games.


Projections onto hyperbolas or bilinear constraint sets in Hilbert spaces. Sets of bilinear constraints are important in various machine learning models. Mathematically, they are hyperbolas in a product space. In this paper, we give a complete formula for projections onto sets of bilinear constraints or hyperbolas in a general Hilbert space.


Synaptic metaplasticity in binarized neural networks. Unlike the brain, artificial neural networks, including state of the art deep neural networks for computer vision, are subject to "catastrophic forgetting" they rapidly forget the previous task when trained on a new one. Neuroscience suggests that biological synapses avoid this issue through the process of synaptic consolidation and metaplasticity the plasticity itself changes upon repeated synaptic events. In this work, we show that this concept of metaplasticity can be transferred to a particular type of deep neural networks, binarized neural networks, to reduce catastrophic forgetting.


Conditional Teaching Size. Recent research in machine teaching has explored the instruction of any concept expressed in a universal language. In this compositional context, new experimental results have shown that there exist data teaching sets surprisingly shorter than the concept description itself. However, there exists a bound for those remarkable experimental findings through teaching size and concept complexity that we further explore here. As concepts are rarely taught in isolation we investigate the best configuration of concepts to teach a given set of concepts, where those that have been acquired first can be reused for the description of new ones. This new notion of conditional teaching size uncovers new insights, such as the interposition phenomenon certain prior knowledge generates simpler compatible concepts that increase the teaching size of the concept that we want to teach. This does not happen for conditional Kolmogorov complexity. Furthermore, we provide an algorithm that constructs optimal curricula based on interposition avoidance. This paper presents a series of theoretical results, including their proofs, and some directions for future work. New research possibilities in curriculum teaching in compositional scenarios are now wide open to exploration.


Detecting Important Patterns Using Conceptual Relevance Interestingness Measure. Discovering meaningful conceptual structures is a substantial task in data mining and knowledge discovery applications. While off the shelf interestingness indices defined in Formal Concept Analysis may provide an effective relevance evaluation in several situations, they frequently give inadequate results when faced with massive formal contexts (and concept lattices), and in the presence of irrelevant concepts. In this paper, we introduce the Conceptual Relevance (CR) score, a new scalable interestingness measurement for the identification of actionable concepts. From a conceptual perspective, the minimal generators provide key information about their associated concept intent. Furthermore, the relevant attributes of a concept are those that maintain the satisfaction of its closure condition. Thus, the guiding idea of CR exploits the fact that minimal generators and relevant attributes can be efficiently used to assess concept relevance. As such, the CR index quantifies both the amount of conceptually relevant attributes and the number of the minimal generators per concept intent. Our experiments on synthetic and real world datasets show the efficiency of this measure over the well known stability index.


Link Analysis meets Ontologies Are Embeddings the Answer?. The increasing amounts of semantic resources offer valuable storage of human knowledge however, the probability of wrong entries increases with the increased size. The development of approaches that identify potentially spurious parts of a given knowledge base is thus becoming an increasingly important area of interest. In this work, we present a systematic evaluation of whether structure only link analysis methods can already offer a scalable means to detecting possible anomalies, as well as potentially interesting novel relation candidates. Evaluating thirteen methods on eight different semantic resources, including Gene Ontology, Food Ontology, Marine Ontology and similar, we demonstrated that structure only link analysis could offer scalable anomaly detection for a subset of the data sets. Further, we demonstrated that by considering symbolic node embedding, explanations of the predictions (links) could be obtained, making this branch of methods potentially more valuable than the black box only ones. To our knowledge, this is currently one of the most extensive systematic studies of the applicability of different types of link analysis methods across semantic resources from different domains.


Implicit Surface Reconstruction with a Curl free Radial Basis Function Partition of Unity Method. Surface reconstruction from a set of scattered points, or a point cloud, has many applications ranging from computer graphics to remote sensing. We present a new method for this task that produces an implicit surface (zero level set) approximation for an oriented point cloud using only information about (approximate) normals to the surface. The technique exploits the fundamental result from vector calculus that the normals to an implicit surface are curl free. By using a curl free radial basis function (RBF) interpolation of the normals, we can extract a potential for the vector field whose zero level surface approximates the point cloud. We use curl free RBFs based on polyharmonic splines for this task, since they are free of any shape or support parameters. Furthermore, to make this technique efficient and able to better represent local sharp features, we combine it with a partition of unity (PU) method. The result is the curl free partition of unity (CFPU) method. We show how CFPU can be adapted to enforce exact interpolation of a point cloud and can be regularized to handle noise in both the normal vectors and the point positions. Numerical results are presented that demonstrate how the method converges for a known surface as the sampling density increases, how regularization handles noisy data, and how the method performs on various problems found in the literature.


On spectral Petrov Galerkin method for solving fractional initial value problems in weighted Sobolev space. In this paper, we investigate a spectral Petrov Galerkin method for fractional initial value problems. Singularities of the solution at the origin inherited from the weakly singular kernel of the fractional derivative are considered, and the regularity is constructed for the solution in weighted Sobolev space. We present an optimal error estimate of the spectral Petrov Galerkin method, and prove that the convergence order of the method in the weighted L 2 norm is 3 alpha 1 for smooth source term, where alpha is the order of the fractional derivative. An iteration algorithm with a quasi linear complexity is considered to solve the produced linear system. Numerical experiments verify the theoretical findings and show the efficiency of the proposed algorithm, and exhibit that the presented numerical method works well for some time fractional diffusion equations after suitable temporal semi discrete.


On the area rate of perturbed Siegel disks. In the famous work by Buff and Ch 'eritat constructing quadratic Julia sets with positive area, the control of the shape of perturbed Siegel disks is a key technique. To do it, Buff and Ch 'eritat added a restrictive condition on rotation numbers. In this paper, we show that this restrictive condition can be deleted. As a byproduct, we can get more quadratic Julia sets with positive area than their original result.


A characterization of centrally symmetric convex bodies in terms of visual cones. In this work we prove the following result Let K be a strictly convex body in the Euclidean space mathbb R n, n geq 3 , and let L be a hypersurface, which is the image of an embedding of the sphere mathbb S n 1 , such that K is contained in the interior of L . Suppose that, for every x in L , there exists y in L such that the support double cones of K with apexes at x and y , differ by a translation. Then K and L are centrally symmetric and concentric.


Non linear self driven spectral tuning of Extreme Ultraviolet Femtosecond Pulses in monoatomic materials. Self action nonlinearity is a key aspect either as a foundational element or a detrimental factor of several optical spectroscopies and photonic devices. Supercontinuum generation, wavelength converters and chirped pulse amplification are just a few examples. The recent advent of Free Electron Lasers (FEL) fostered building on nonlinearity to propose new concepts and extend optical wavelengths paradigms for extreme ultraviolet (EUV) and X ray regimes. No evidence for intrapulse dynamics, however, has been reported at such short wavelengths, where the light matter interactions are ruled by the sharp absorption edges of core electrons. Here, we provide experimental evidence for self phase modulation of femtosecond FEL pulses, which we exploit for fine self driven spectral tunability by interaction with sub micrometric foils of selected monoatomic materials. Moving the pulse wavelength across the absorption edge, the spectral profile changes from a non linear spectral blue shift to a red shifted broadening. These findings are rationalized accounting for ultrafast ionization and delayed thermal response of highly excited electrons above and below threshold, respectively.


snpQT flexible, reproducible, and comprehensive quality control and imputation of genomic data. Motivation Quality control of genomic data is an essential but complicated multi step procedure, often requiring separate installation and expert familiarity with a combination of disparate bioinformatics tools. Results To provide an automated solution that retains comprehensive quality checks and flexible workflow architecture, we have developed snpQT, a scalable, stand alone software pipeline, offering some 36 discrete quality filters or correction steps, with plots before and after user modifiable thresholding. This includes build conversion, population stratification against 1,000 Genomes data, population outlier removal, and built in imputation with its own pre and post quality controls. Common input formats are used and users need not be superusers nor have any prior coding experience. A comprehensive online tutorial and installation guide is provided through to GWAS (https snpqt.readthedocs.io en latest ), introducing snpQT using a synthetic demonstration dataset and a real world Amyotrophic Lateral Sclerosis SNP array dataset. Availability snpQT is open source and freely available at https github.com nebfield snpQT Contact Vasilopoulou C ulster.ac.uk, w.duddy ulster.ac.uk


Sturmian subshifts and their C algebras. This paper investigates the structure of C algebras built from one sided Sturmian subshifts. They are parametrised by irrationals in the unit interval and built from a local homeomorphism associated to the subshift. We provide an explicit construction and description of this local homeomorphism. The C algebras are isomorphic exactly when the systems are conjugate, and they are Morita equivalent exactly when the defining irrationals are equivalent (this happens precisely when the systems are flow equivalent). Using only elementary dynamical tools, we compute the dynamic asymptotic dimension of the (groupoid of the) local homeomorphism to be one, and by a result of Guentner, Willett, and Yu, it follows that the nuclear dimension of the C algebras is one.


A Knowledge Compilation Map for Conditional Preference Statements based Languages. Conditional preference statements have been used to compactly represent preferences over combinatorial domains. They are at the core of CP nets and their generalizations, and lexicographic preference trees. Several works have addressed the complexity of some queries (optimization, dominance in particular). We extend in this paper some of these results, and study other queries which have not been addressed so far, like equivalence, thereby contributing to a knowledge compilation map for languages based on conditional preference statements. We also introduce a new parameterised family of languages, which enables to balance expressiveness against the complexity of some queries.


DRILL Dynamic Representations for Imbalanced Lifelong Learning. Continual or lifelong learning has been a long standing challenge in machine learning to date, especially in natural language processing (NLP). Although state of the art language models such as BERT have ushered in a new era in this field due to their outstanding performance in multitask learning scenarios, they suffer from forgetting when being exposed to a continuous stream of data with shifting data distributions. In this paper, we introduce DRILL, a novel continual learning architecture for open domain text classification. DRILL leverages a biologically inspired self organizing neural architecture to selectively gate latent language representations from BERT in a task incremental manner. We demonstrate in our experiments that DRILL outperforms current methods in a realistic scenario of imbalanced, non stationary data without prior knowledge about task boundaries. To the best of our knowledge, DRILL is the first of its kind to use a self organizing neural architecture for open domain lifelong learning in NLP.


Wisdom of the Contexts Active Ensemble Learning for Contextual Anomaly Detection. In contextual anomaly detection, an object is only considered anomalous within a specific context. Most existing methods for CAD use a single context based on a set of user specified contextual features. However, identifying the right context can be very challenging in practice, especially in datasets, with a large number of attributes. Furthermore, in real world systems, there might be multiple anomalies that occur in different contexts and, therefore, require a combination of several "useful" contexts to unveil them. In this work, we leverage active learning and ensembles to effectively detect complex contextual anomalies in situations where the true contextual and behavioral attributes are unknown. We propose a novel approach, called WisCon (Wisdom of the Contexts), that automatically creates contexts from the feature set. Our method constructs an ensemble of multiple contexts, with varying importance scores, based on the assumption that not all useful contexts are equally so. Experiments show that WisCon significantly outperforms existing baselines in different categories (i.e., active classifiers, unsupervised contextual and non contextual anomaly detectors, and supervised classifiers) on seven datasets. Furthermore, the results support our initial hypothesis that there is no single perfect context that successfully uncovers all kinds of contextual anomalies, and leveraging the "wisdom" of multiple contexts is necessary.


Re TACRED Addressing Shortcomings of the TACRED Dataset. TACRED is one of the largest and most widely used sentence level relation extraction datasets. Proposed models that are evaluated using this dataset consistently set new state of the art performance. However, they still exhibit large error rates despite leveraging external knowledge and unsupervised pretraining on large text corpora. A recent study suggested that this may be due to poor dataset quality. The study observed that over 50 of the most challenging sentences from the development and test sets are incorrectly labeled and account for an average drop of 8 f1 score in model performance. However, this study was limited to a small biased sample of 5k (out of a total of 106k) sentences, substantially restricting the generalizability and broader implications of its findings. In this paper, we address these shortcomings by (i) performing a comprehensive study over the whole TACRED dataset, (ii) proposing an improved crowdsourcing strategy and deploying it to re annotate the whole dataset, and (iii) performing a thorough analysis to understand how correcting the TACRED annotations affects previously published results. After verification, we observed that 23.9 of TACRED labels are incorrect. Moreover, evaluating several models on our revised dataset yields an average f1 score improvement of 14.3 and helps uncover significant relationships between the different models (rather than simply offsetting or scaling their scores by a constant factor). Finally, aside from our analysis we also release Re TACRED, a new completely re annotated version of the TACRED dataset that can be used to perform reliable evaluation of relation extraction models.


AI SARAH Adaptive and Implicit Stochastic Recursive Gradient Methods. We present AI SARAH, a practical variant of SARAH. As a variant of SARAH, this algorithm employs the stochastic recursive gradient yet adjusts step size based on local geometry. AI SARAH implicitly computes step size and efficiently estimates local Lipschitz smoothness of stochastic functions. It is fully adaptive, tune free, straightforward to implement, and computationally efficient. We provide technical insight and intuitive illustrations on its design and convergence. We conduct extensive empirical analysis and demonstrate its strong performance compared with its classical counterparts and other state of the art first order methods in solving convex machine learning problems.


Advanced Raman spectroscopy detection of oxidative damage in nucleic acid bases probing chemical changes and intermolecular interactions in guanosine at ultralow concentration. DNA RNA synthesis precursors are especially vulnerable to damage induced by reactive oxygen species occurring following oxidative stress. Guanosine triphosphates are the prevalent oxidized nucleosites, which can be misincorporated during replication, leading to mutations and cell death. Here, we present a novel method based on micro Raman spectroscopy, combined with ab initio calculations, for the identification, detection, and quantification of low concentrations of oxidized nucleotides. We also show that the Raman signature in the terahertz spectral range ( 100 cm 1 ) contains information on the intermolecular assembly of guanine in tetrads, which allows to further boost the oxidative damage detection limit. Eventually, we provide evidence that similar analyses can be carried out on samples in very small volumes at very low concentrations by exploiting the high sensitivity of Surface Enhanced Raman Scattering combined with properly designed superhydrophobic substrates. These results pave the way for employing such advanced spectroscopic methods for quantitatively sensing the oxidative damage of nucleotides in the cell.


Great circle Tree Thrackles. A thrackle is a graph drawing in which every pair of edges meets exactly once. The Thrackle Conjecture (established by John Conway) states that the number of edges of a thrackle cannot exceed the number of its vertices. Cairns, Koussas, and Nikolayevsky (2015) prove that the Thrackle Conjecture holds for great circle thrackles drawn on the sphere. They also posit that the Thrackle Conjecture can be restated to say that a graph can be drawn as a thrackle drawing in the plane if and only if it admits a great circle thrackle drawing. We demonstrate that the class of great circle thrackleable graphs excludes some trees. Thus the informal conjecture from Cairns, Koussas, and Nikolayevsky (2015) is not equivalent to the Thrackle Conjecture.


Player AI Interaction What Neural Network Games Reveal About AI as Play. The advent of artificial intelligence (AI) and machine learning (ML) bring human AI interaction to the forefront of HCI research. This paper argues that games are an ideal domain for studying and experimenting with how humans interact with AI. Through a systematic survey of neural network games (n 38), we identified the dominant interaction metaphors and AI interaction patterns in these games. In addition, we applied existing human AI interaction guidelines to further shed light on player AI interaction in the context of AI infused systems. Our core finding is that AI as play can expand current notions of human AI interaction, which are predominantly productivity based. In particular, our work suggests that game and UX designers should consider flow to structure the learning curve of human AI interaction, incorporate discovery based learning to play around with the AI and observe the consequences, and offer users an invitation to play to explore new forms of human AI interaction.