User generated pseudonyms through Merkle trees. A pseudonymisation technique based on Merkle trees is described in this paper. More precisely, by exploiting inherent properties of the Merkle trees as cryptographic accumulators, we illustrate how user generated pseudonyms can be constructed, without the need of a third party. Each such pseudonym, which depends on several user's identifiers, suffices to hide these original identifiers, whilst the unlinkability property between any two different pseudonyms for the same user is retained at the same time, this pseudonymisation scheme allows the pseudonym owner to easily prove that she owns a pseudonym within a specific context, without revealing information on her original identifiers. Compared to other user generated pseudonymisation techniques which utilize public key encryption algorithms, the new approach inherits the security properties of a Merkle tree, thus achieving post quantum security.


A Constant Factor Approximation for Generalized Malleable Scheduling under M natural Concave Processing Speeds. In generalized malleable scheduling, jobs can be allocated and processed simultaneously on multiple machines so as to reduce the overall makespan of the schedule. The required processing time for each job is determined by the joint processing speed of the allocated machines. We study the case that processing speeds are job dependent M natural concave functions and provide a constant factor approximation for this setting, significantly expanding the realm of functions for which such an approximation is possible. Further, we explore the connection between malleable scheduling and the problem of fairly allocating items to a set of agents with distinct utility functions, devising a black box reduction that allows to obtain resource augmented approximation algorithms for the latter.


CheXbreak Misclassification Identification for Deep Learning Models Interpreting Chest X rays. A major obstacle to the integration of deep learning models for chest x ray interpretation into clinical settings is the lack of understanding of their failure modes. In this work, we first investigate whether there are patient subgroups that chest x ray models are likely to misclassify. We find that patient age and the radiographic finding of lung lesion, pneumothorax or support devices are statistically relevant features for predicting misclassification for some chest x ray models. Second, we develop misclassification predictors on chest x ray models using their outputs and clinical features. We find that our best performing misclassification identifier achieves an AUROC close to 0.9 for most diseases. Third, employing our misclassification identifiers, we develop a corrective algorithm to selectively flip model predictions that have high likelihood of misclassification at inference time. We observe F1 improvement on the prediction of Consolidation (0.008 95 CI 0.005, 0.010 ) and Edema (0.003, 95 CI 0.001, 0.006 ). By carrying out our investigation on ten distinct and high performing chest x ray models, we are able to derive insights across model architectures and offer a generalizable framework applicable to other medical imaging tasks.


On a minimum set of equations for parameterisations in comprehensive ocean circulation models. The complexity of comprehensive ocean models poses an important question for parameterisations is there a minimum set of equations that should be parameterised, on the one hand, to reduce the development to a minimum, and, on the other hand, to ensure an accurate representation of large scale flow patterns? This work seeks to answer this to assist modern parameterisations be more selective in their targets. For this, we considered a North Atlantic configuration of the MIT general circulation model and studied contributions of different model equations to the accuracy of representation of the Gulf Stream at low resolution. Our results suggest that it is enough to parameterise only the tracer equations for temperature and salinity and leave the other equations in the hydrodynamic part, as well as the atmospheric model unmodified.


Complexity of optimizing over the integers. In the first part of this paper, we present a unified framework for analyzing the algorithmic complexity of any optimization problem, whether it be continuous or discrete in nature. This helps to formalize notions like "input", "size" and "complexity" in the context of general mathematical optimization, avoiding context dependent definitions which is one of the sources of difference in the treatment of complexity within continuous and discrete optimization. In the second part of the paper, we employ the language developed in the first part to study information theoretic and algorithmic complexity of em mixed integer convex optimization , which contains as a special case continuous convex optimization on the one hand and pure integer optimization on the other. We strive for the maximum possible generality in our exposition. We hope that this paper contains material that both continuous optimizers and discrete optimizers find new and interesting, even though almost all of the material presented is common knowledge in one or the other community. We see the main merit of this paper as bringing together all of this information under one unifying umbrella with the hope that this will act as yet another catalyst for more interaction across the continuous discrete divide. In fact, our motivation behind Part I of the paper is to provide a common language for both communities.


A classification of ideals in Steinberg and Leavitt path algebras over arbitrary rings. We give a one to one correspondence between ideals in the Steinberg algebra of a Hausdorff ample groupoid G , and certain families of ideals in the group algebras of isotropy groups in G . This generalises a known ideal correspondence theorem for Steinberg algebras of strongly effective groupoids. We use this to give a complete graph theoretic description of the ideal lattice of Leavitt path algebras over arbitrary commutative rings, generalising the classification of ideals in Leavitt path algebras over fields.


Perfect Forms over Imaginary Quadratic Fields. In this work, we compute the perfect forms for all imaginary quadratic fields of absolute discriminant up to 5000 and study the number and types of the polytopes that arise. We prove a bound on the combinatorial types of polytopes that can arise regardless of discriminant and give a volumetric argument for a lower bound on the number of perfect forms as well as a heuristic for a better lower bound for imaginary quadratic fields of sufficiently large absolute discriminant.


Hybrid Movie Recommender System based on Resource Allocation. Recommender Systems are inevitable to personalize user's experiences on the Internet. They are using different approaches to recommend the Top K items to users according to their preferences. Nowadays recommender systems have become one of the most important parts of largescale data mining techniques. In this paper, we propose a Hybrid Movie Recommender System (HMRS) based on Resource Allocation to improve the accuracy of recommendation and solve the cold start problem for a new movie. HMRS RA uses a self organizing mapping neural network to clustering the users into N clusters. The users' preferences are different according to their age and gender, therefore HMRS RA is a combination of a Content Based Method for solving the cold start problem for a new movie and a Collaborative Filtering model besides the demographic information of users. The experimental results based on the MovieLens dataset show that the HMRS RA increases the accuracy of recommendation compared to the state of art and similar works.


Consensual Collaborative Training And Knowledge Distillation Based Facial Expression Recognition Under Noisy Annotations. Presence of noise in the labels of large scale facial expression datasets has been a key challenge towards Facial Expression Recognition (FER) in the wild. During early learning stage, deep networks fit on clean data. Then, eventually, they start overfitting on noisy labels due to their memorization ability, which limits FER performance. This work proposes an effective training strategy in the presence of noisy labels, called as Consensual Collaborative Training (CCT) framework. CCT co trains three networks jointly using a convex combination of supervision loss and consistency loss, without making any assumption about the noise distribution. A dynamic transition mechanism is used to move from supervision loss in early learning to consistency loss for consensus of predictions among networks in the later stage. Inference is done using a single network based on a simple knowledge distillation scheme. Effectiveness of the proposed framework is demonstrated on synthetic as well as real noisy FER datasets. In addition, a large test subset of around 5K images is annotated from the FEC dataset using crowd wisdom of 16 different annotators and reliable labels are inferred. CCT is also validated on it. State of the art performance is reported on the benchmark FER datasets RAFDB (90.84 ) FERPlus (89.99 ) and AffectNet (66 ). Our codes are available at https github.com 1980x CCT.


Noether Fano Inequalities and Canonical Thresholds on Fano Varieties. We prove a more general and precise version of the Noether Fano inequalities for birational maps between Mori fiber spaces. This is applied to give descriptions of global canonical thresholds on Fano varieties of Picard number one.


MetaPose Fast 3D Pose from Multiple Views without 3D Supervision. In the era of deep learning, human pose estimation from multiple cameras with unknown calibration has received little attention to date. We show how to train a neural model to perform this task with high precision and minimal latency overhead. The proposed model takes into account joint location uncertainty due to occlusion from multiple views, and requires only 2D keypoint data for training. Our method outperforms both classical bundle adjustment and weakly supervised monocular 3D baselines on the well established Human3.6M dataset, as well as the more challenging in the wild Ski Pose PTZ dataset.


On the Upward Book Thickness Problem Combinatorial and Complexity Results. A long standing conjecture by Heath, Pemmaraju, and Trenk states that the upward book thickness of outerplanar DAGs is bounded above by a constant. In this paper, we show that the conjecture holds for subfamilies of upward outerplanar graphs, namely those whose underlying graph is an internally triangulated outerpath or a cactus, and those whose biconnected components are at outerplanar graphs. On the complexity side, it is known that deciding whether a graph has upward book thickness k is NP hard for any fixed k ge 3 . We show that the problem, for any k ge 5 , remains NP hard for graphs whose domination number is O(k) , but it is FPT in the vertex cover number.


Identifying influential subpopulations in metapopulation epidemic models using message passing theory. Identifying influential subpopulations in metapopulation epidemic models has far reaching potential implications for surveillance and intervention policies of a global pandemic. However, there is a lack of methods to determine influential nodes in metapopulation models based on a rigorous mathematical background. In this study, we derive the message passing theory for metapopulation modeling and propose a method to determine influential spreaders. Based on our analysis, we identify the most dangerous city as a potential seed of a pandemic when applied to real world data. Moreover, we particularly assess the relative importance of various sources of heterogeneity at the subpopulation level, e.g., the number of connections and mobility patterns, to determine properties of spreading processes. We validate our theory with extensive numerical simulations on empirical and synthetic networks considering various mobility and transmission probabilities. We confirm that our theory can accurately predict influential subpopulations in metapopulation models.


Assessment of Soot Formation Models in Lifted Ethylene Air Turbulent Diffusion Flame. In the present study, soot formation in the turbulent lifted diffusion flame, consisting of ethylene air is numerically investigated using three different soot modeling approaches and is comprehensively reported. For turbulence chemistry interaction, Flamelet generated manifold (FGM) model is used. A detailed kinetics is used which is represented through POLIMI mechanism (Ranzi et al. 2012). Soot formation is modeled using two different approaches, semi empirical two equation approach and Quadrature methods of moments approach, where both the approaches consider various sub processes such as nucleation, coagulation, surface growth and oxidation. The radiation heat transfer is taken into account considering four fictitious gasses in conjunction with the weighted sum of gray gas (WSSGM) approach for modeling absorption coefficient. The experimental and earlier published numerical data from K "ohler et al. (2012) and Blacha et al. (2011) are used for assessment of different soot modeling approaches. The discrepancies between numerical and experimental data are observed due to under prediction of OH radicals concentration and poor fuel air mixing ratios in the vicinity of the fuel jet region leading to early soot formation and the trends are unaffected after invoking radiation.


Does It Capture STEL? A Modular, Similarity based Linguistic Style Evaluation Framework. Style is an integral part of natural language. However, evaluation methods for style measures are rare, often task specific and usually do not control for content. We propose the modular, fine grained and content controlled similarity based STyle EvaLuation framework (STEL) to test the performance of any model that can compare two sentences on style. We illustrate STEL with two general dimensions of style (formal informal and simple complex) as well as two specific characteristics of style (contrac'tion and numb3r substitution). We find that BERT based methods outperform simple versions of commonly used style measures like 3 grams, punctuation frequency and LIWC based approaches. We invite the addition of further tasks and task instances to STEL and hope to facilitate the improvement of style sensitive measures.


Large deviations for Hamiltonian systems on intermediate time scales. We consider a two dimensional Hamiltonian system perturbed by a small diffusion term, whose coefficient is state dependent and non degenerate. As a result, the process consists of the fast motion along the level curves and slow motion across them. On finite time intervals, the large deviation principle applies, while on time scales that are inversely proportional to the size of the perturbation, the averaging principle holds, i.e., the projection of the process onto the Reeb graph converges to a Markov process. In our paper, we consider the intermediate time scales and prove the large deviation principle, with the action functional determined in terms of the averaged process on the graph.


On two approaches to the third order solution of surface gravity waves. Third order approximate solutions for surface gravity waves in the finite water depth are studied in the context of potential flow theory. This solution provides explicit expressions for the surface elevation, free surface velocity potential and velocity potential. The amplitude dispersion relation is also provided. Two approaches are used to derive the third order analytical solution, resulting in two types of approximate solutions the perturbation solution and the Hamiltonian solution. The perturbation solution is obtained by classical perturbation technique in which the time variable is expanded in multiscale to eliminate secular terms. The Hamiltonian solution is derived from the canonical transformation in the Hamiltonian theory of water waves. By comparing the two types of solutions, it is found that they are completely equivalent for the first to second order solutions and the nonlinear dispersion, but for the third order part only the sum sum terms are the same. Due to the canonical transformation that could completely separate the dynamic and bound harmonics, the Hamiltonian solutions break through the difficulty that the perturbation theory breaks down due to singularities in the transfer functions when quartet resonance criterion is satisfied. Furthermore, it is also found that some time averaged quantities based on the Hamiltonian solution, such as mean potential energy and mean kinetic energy, are equal to those in the initial state in which sea surface is assumed to be a Gaussian random process. This is because there are associated conserved quantities in the Hamiltonian form. All of these show that the Hamiltonian solution is more reasonable and accurate to describe the third order steady state wave field. Finally, based on the Hamiltonian solution, some statistics are given such as the volume flux, skewness, and excess kurtosis.


Adding Quaternion Representations to Attention Networks for Classification. This paper introduces a novel modification to axial attention networks to improve their image classification accuracy. The modification involves supplementing axial attention modules with quaternion input representations to improve image classification accuracy. We chose axial attention networks because they factor 2D attention operations into two consecutive 1D operations (similar to separable convolution) and are thus less resource intensive than non axial attention networks. We chose a quaternion encoder because of they share weights across four real valued input channels and the weight sharing has been shown to produce a more interlinked interwoven output representation. We hypothesize that an attention module can be more effective using these interlinked representations as input. Our experiments support this hypothesis as reflected in the improved classification accuracy compared to standard axial attention networks. We think this happens because the attention modules have better input representations to work with.


Recovering the Unbiased Scene Graphs from the Biased Ones. Given input images, scene graph generation (SGG) aims to produce comprehensive, graphical representations describing visual relationships among salient objects. Recently, more efforts have been paid to the long tail problem in SGG however, the imbalance in the fraction of missing labels of different classes, or reporting bias, exacerbating the long tail is rarely considered and cannot be solved by the existing debiasing methods. In this paper we show that, due to the missing labels, SGG can be viewed as a "Learning from Positive and Unlabeled data" (PU learning) problem, where the reporting bias can be removed by recovering the unbiased probabilities from the biased ones by utilizing label frequencies, i.e., the per class fraction of labeled, positive examples in all the positive examples. To obtain accurate label frequency estimates, we propose Dynamic Label Frequency Estimation (DLFE) to take advantage of training time data augmentation and average over multiple training iterations to introduce more valid examples. Extensive experiments show that DLFE is more effective in estimating label frequencies than a naive variant of the traditional estimate, and DLFE significantly alleviates the long tail and achieves state of the art debiasing performance on the VG dataset. We also show qualitatively that SGG models with DLFE produce prominently more balanced and unbiased scene graphs.


A Bayesian level set method for an inverse medium scattering problem in acoustics. In this work, we are interested in the determination of the shape of the scatterer for the two dimensional time harmonic inverse medium scattering problems in acoustics. The scatterer is assumed to be a piecewise constant function with a known value inside inhomogeneities, and its shape is represented by the level set functions for which we investigate the information using the Bayesian method. In the Bayesian framework, the solution of the geometric inverse problem is defined as a posterior probability distribution. The well posedness of the posterior distribution would be discussed, and the Markov chain Monte Carlo (MCMC) methods will be applied to generate samples from the arising posterior distribution. Numerical experiments will be presented to demonstrate the effectiveness of the proposed method.


Marangoni instability triggered by selective evaporation of a binary liquid inside a Hele Shaw cell. Interfacial stability is important for many processes involving heat and mass transfer across two immiscible phases. When this transfer takes place in the form of evaporation of a binary solution with one component being more volatile than the other, gradients in surface tension can arise. These gradients can ultimately destabilise the liquid gas interface. In the present work, we study the evaporation of an ethanol water solution, for which ethanol has a larger volatility. The solution is contained in a horizontal Hele Shaw cell which is open from one end to allow for evaporation into air. A Marangoni instability is then triggered at the liquid air interface. We study the temporal evolution of this instability by observing the effects that it has on the bulk of the liquid. More specifically, the growth of convective cells is visualized with confocal microscopy and the velocity field close to the interface is measured with micro particle image velocimetry. The results of numerical simulations based on quasi 2D equations satisfactorily compare with the experimental observations, even without consideration of evaporative cooling, although this cooling can play an extra role in experiments. Furthermore, a linear stability analysis applied to a simplified version of the quasi 2D equations showed reasonably good agreement with the results from simulations at early times, when the instability has just been triggered and no coarsening has taken place. In particular, we find a critical Marangoni number below which a regime of stability is predicted.


Picard groups for some blocks with TI defect groups. We calculate the Picard groups for principal blocks B with TI defect groups and cyclic inertial quotient. The methods used generalize results on self stable equivalences and take advantage of the existence of equivalences given by Green correspondence in this setting. In particular, we show that text Pic (B) mathcal E (B) , giving more evidence for a conjecture on basic auto Morita equivalences.


Solving p adic polynomial equations using Jarratt's Method. We implement an iterative numerical method to solve polynomial equations f(x) 0 in the p adic numbers, where f(x) in mathbb Z p x . This method is a simplified p adic analogue of Jarratt's method for finding roots of functions over the real numbers. We establish that our method has a higher order of convergence than J.F.T. Rabago's p adic version of Olver's method from 2016. Moreover, we weaken the initial conditions in Rabago's method, which allows us to start the iteration with a multiple root of the congruence f(x) equiv 0 bmod p .


On diagonalizable quantum weighted Hankel matrices. A semi infinite weighted Hankel matrix with entries defined in terms of basic hypergeometric series is explicitly diagonalized as an operator on ell 2 ( mathbb N 0 ) . The approach uses the fact that the operator commutes with a diagonalizable Jacobi operator corresponding to Al Salam Chihara orthogonal polynomials. Yet another weighted Hankel matrix, which commutes with a Jacobi operator associated with the continuous q Laguerre polynomials, is diagonalized. As an application, several new integral formulas for selected quantum orthogonal polynomials are deduced. In addition, an open research problem concerning a quantum Hilbert matrix is also mentioned.


A height gap in GL d( overline mathbb Q ) and almost laws. E. Breuillard showed that finite subsets F of matrices in GL d( overline mathbb Q ) generating non virtually solvable groups have normalized height widehat h (F) ge epsilon d , for some positive epsilon d 0 . The normalized height widehat h (F) is a measure of the arithmetic size of F and this result can be thought of as a non abelian analog of Lehmer's Mahler measure problem. We give a new shorter proof of this result. Our key idea relies on the existence of particular word maps in compact Lie groups (known as almost laws) whose image lies close to the identity element.


QAHOI Query Based Anchors for Human Object Interaction Detection. Human object interaction (HOI) detection as a downstream of object detection tasks requires localizing pairs of humans and objects and extracting the semantic relationships between humans and objects from an image. Recently, one stage approaches have become a new trend for this task due to their high efficiency. However, these approaches focus on detecting possible interaction points or filtering human object pairs, ignoring the variability in the location and size of different objects at spatial scales. To address this problem, we propose a transformer based method, QAHOI (Query Based Anchors for Human Object Interaction detection), which leverages a multi scale architecture to extract features from different spatial scales and uses query based anchors to predict all the elements of an HOI instance. We further investigate that a powerful backbone significantly increases accuracy for QAHOI, and QAHOI with a transformer based backbone outperforms recent state of the art methods by large margins on the HICO DET benchmark. The source code is available at href https github.com cjw2021 QAHOI text this https URL .


MSMatch Semi Supervised Multispectral Scene Classification with Few Labels. Supervised learning techniques are at the center of many tasks in remote sensing. Unfortunately, these methods, especially recent deep learning methods, often require large amounts of labeled data for training. Even though satellites acquire large amounts of data, labeling the data is often tedious, expensive and requires expert knowledge. Hence, improved methods that require fewer labeled samples are needed. We present MSMatch, the first semi supervised learning approach competitive with supervised methods on scene classification on the EuroSAT and UC Merced Land Use benchmark datasets. We test both RGB and multispectral images of EuroSAT and perform various ablation studies to identify the critical parts of the model. The trained neural network achieves state of the art results on EuroSAT with an accuracy that is up to 19.76 better than previous methods depending on the number of labeled training examples. With just five labeled examples per class, we reach 94.53 and 95.86 accuracy on the EuroSAT RGB and multispectral datasets, respectively. On the UC Merced Land Use dataset, we outperform previous works by up to 5.59 and reach 90.71 with five labeled examples. Our results show that MSMatch is capable of greatly reducing the requirements for labeled data. It translates well to multispectral data and should enable various applications that are currently infeasible due to a lack of labeled data. We provide the source code of MSMatch online to enable easy reproduction and quick adoption.


BSTC A Large Scale Chinese English Speech Translation Dataset. This paper presents BSTC (Baidu Speech Translation Corpus), a large scale Chinese English speech translation dataset. This dataset is constructed based on a collection of licensed videos of talks or lectures, including about 68 hours of Mandarin data, their manual transcripts and translations into English, as well as automated transcripts by an automatic speech recognition (ASR) model. We have further asked three experienced interpreters to simultaneously interpret the testing talks in a mock conference setting. This corpus is expected to promote the research of automatic simultaneous translation as well as the development of practical systems. We have organized simultaneous translation tasks and used this corpus to evaluate automatic simultaneous translation systems.


Reflection of a dust acoustic solitary wave in a dusty plasma. We report the first experimental observations of the reflection of a dust acoustic solitary wave from a potential barrier in a dusty plasma medium. The experiments have been carried out in an inverted Pi shaped Dusty Plasma Experimental (DPEx) device in a DC glow discharge plasma environment. The dust acoustic solitary wave is excited by modulating the plasma with a short negative Gaussian pulse that is superimposed over the discharge voltage. The solitary wave structure is seen to move towards a potential barrier, created by the sheath around a biased wire, and turn back after reflecting off the barrier. The amplitude, width, and velocity of the soliton are recorded as a function of time. The experiment is repeated for different strengths of the potential barrier and for different initial amplitudes of the solitary wave. It is found that the distance of the closest approach of the solitary wave to the centre of the barrier increases with the increase of the strength of the potential barrier and with the decrease of the initial wave amplitude. An emissive probe is used to measure the sheath potential and its thickness by measuring the plasma potential profile in the axial direction over a range of resistances connected to the biased wire. A modified Korteweg de Vries equation is derived and numerically solved to qualitatively understand the experimental findings.


Cellular traffic offloading via Opportunistic Networking with Reinforcement Learning. The widespread diffusion of mobile phones is triggering an exponential growth of mobile data traffic that is likely to cause, in the near future, considerable traffic overload issues even in last generation cellular networks. Offloading part of the traffic to other networks is considered a very promising approach and, in particular, in this paper, we consider offloading through opportunistic networks of users' devices. However, the performance of this solution strongly depends on the pattern of encounters between mobile nodes, which should therefore be taken into account when designing offloading control algorithms. In this paper, we propose an adaptive offloading solution based on the Reinforcement Learning framework and we evaluate and compare the performance of two well known learning algorithms Actor Critic and Q Learning. More precisely, in our solution the controller of the dissemination process, once trained, is able to select a proper number of content replicas to be injected into the opportunistic network to guarantee the timely delivery of contents to all interested users. We show that our system based on Reinforcement Learning is able to automatically learn a very efficient strategy to reduce the traffic on the cellular network, without relying on any additional context information about the opportunistic network. Our solution achieves a higher level of offloading with respect to other state of the art approaches, in a range of different mobility settings. Moreover, we show that a more refined learning solution, based on the Actor Critic algorithm, is significantly more efficient than a simpler solution based on Q learning.


VoiceMoji A Novel On Device Pipeline for Seamless Emoji Insertion in Dictation. Most of the speech recognition systems recover only words in the speech and fail to capture emotions. Users have to manually add emoji(s) in text for adding tone and making communication fun. Though there is much work done on punctuation addition on transcribed speech, the area of emotion addition is untouched. In this paper, we propose a novel on device pipeline to enrich the voice input experience. It involves, given a blob of transcribed text, intelligently processing and identifying structure where emoji insertion makes sense. Moreover, it includes semantic text analysis to predict emoji for each of the sub parts for which we propose a novel architecture Attention based Char Aware (ACA) LSTM which handles Out Of Vocabulary (OOV) words as well. All these tasks are executed completely on device and hence can aid on device dictation systems. To the best of our knowledge, this is the first work that shows how to add emoji(s) in the transcribed text. We demonstrate that our components achieve comparable results to previous neural approaches for punctuation addition and emoji prediction with 80 fewer parameters. Overall, our proposed model has a very small memory footprint of a mere 4MB to suit on device deployment.


The Topology of Randomized Symmetry Breaking Distributed Computing. Studying distributed computing through the lens of algebraic topology has been the source of many significant breakthroughs during the last two decades, especially in the design of lower bounds or impossibility results for deterministic algorithms. This paper aims at studying randomized synchronous distributed computing through the lens of algebraic topology. We do so by studying the wide class of (input free) symmetry breaking tasks, e.g., leader election, in synchronous fault free anonymous systems. We show that it is possible to redefine solvability of a task "locally", i.e., for each simplex of the protocol complex individually, without requiring any global consistency. However, this approach has a drawback it eliminates the topological aspect of the computation, since a single facet has a trivial topological structure. To overcome this issue, we introduce a "projection" pi of both protocol and output complexes, where every simplex sigma is mapped to a complex pi( sigma) the later has a rich structure that replaces the structure we lost by considering one single facet at a time. To show the significance and applicability of our topological approach, we derive necessary and sufficient conditions for solving leader election in synchronous fault free anonymous shared memory and message passing models. In both models, we consider scenarios in which there might be correlations between the random values provided to the nodes. In particular, different parties might have access to the same randomness source so their randomness is not independent but equal. Interestingly, we find that solvability of leader election relates to the number of parties that possess correlated randomness, either directly or via their greatest common divisor, depending on the specific communication model.


Imbalanced Adversarial Training with Reweighting. Adversarial training has been empirically proven to be one of the most effective and reliable defense methods against adversarial attacks. However, almost all existing studies about adversarial training are focused on balanced datasets, where each class has an equal amount of training examples. Research on adversarial training with imbalanced training datasets is rather limited. As the initial effort to investigate this problem, we reveal the facts that adversarially trained models present two distinguished behaviors from naturally trained models in imbalanced datasets (1) Compared to natural training, adversarially trained models can suffer much worse performance on under represented classes, when the training dataset is extremely imbalanced. (2) Traditional reweighting strategies may lose efficacy to deal with the imbalance issue for adversarial training. For example, upweighting the under represented classes will drastically hurt the model's performance on well represented classes, and as a result, finding an optimal reweighting value can be tremendously challenging. In this paper, to further understand our observations, we theoretically show that the poor data separability is one key reason causing this strong tension between under represented and well represented classes. Motivated by this finding, we propose Separable Reweighted Adversarial Training (SRAT) to facilitate adversarial training under imbalanced scenarios, by learning more separable features for different classes. Extensive experiments on various datasets verify the effectiveness of the proposed framework.


Remote Attestation A Literature Review. With the rising number of IoT devices, the security of such devices becomes increasingly important. Remote attestation (RA) is a distinct security service that allows a remote verifer to reason about the state of an untrusted remote prover (device). Paradigms of remote attestation span from exclusively software, in software based attestation, to exclusively hardware based. In between the extremes are hybrid attestation that utilize the enhanced security of secure hardware components in combination with the lower cost of purely software based implementations. Traditional remote attestation protocols are concerned with reasoning about the state of a prover. However, extensions to remote attestation also exist, such as code updates, device resets, erasure and attestation of the device's run time state. Furthermore, as interconnected IoT devices are becoming increasingly more popular, so is the need for attestation of device swarms. We will describe and evaluate the state of the art for remote attestation, which covers singular attestation of devices as well as newer research in the area of formally verified RA protocols, swarm attestation and control flow attestation.


Implicit Methods with Reduced Memory for Thermal Radiative Transfer. This paper presents approximation methods for time dependent thermal radiative transfer problems in high energy density physics. It is based on the multilevel quasidiffusion method defined by the high order radiative transfer equation (RTE) and the low order quasidiffusion (aka VEF) equations for the moments of the specific intensity. A large part of data storage in TRT problems between time steps is determined by the dimensionality of grid functions of the radiation intensity. The approximate implicit methods with reduced memory for the time dependent Boltzmann equation are applied to the high order RTE, discretized in time with the backward Euler (BE) scheme. The high dimensional intensity from the previous time level in the BE scheme is approximated by means of the low rank proper orthogonal decomposition (POD). Another version of the presented method applies the POD to the remainder term of P2 expansion of the intensity. The accuracy of the solution of the approximate implicit methods depends of the rank of the POD. The proposed methods enable one to reduce storage requirements in time dependent problems. Numerical results of a Fleck Cummings TRT test problem are presented.


Supersonic Ramjet Engine Inlet for Jovian Flight. This paper discusses the analysis performed on a supersonic ramjet engine inlet for flight in the atmosphere of Jupiter. Since the Jovian atmosphere lacks oxygen, the thrust will be generated by nuclear fission heating in the heat chamber. The first task to solve in the design in a ramjet engine is to design the supersonic inlet. The developed design methodology utilizes theoretical calculations and Computational Fluid Dynamics (CFD) simulations. The analytical model used to calculate the gas parameters in front of the heat chamber, and the CFD analysis, used to define the inlet geometry, are discussed. The results from the analytical model and CFD are compared and used for validation of the design approach. The calculated pressure losses and the mass flow allow the determination of important parameters required for the design of the aircraft, such as the reactor power, the thrust, the maximum mass, and the overall external dimensions.


3D Shapes Local Geometry Codes Learning with SDF. A signed distance function (SDF) as the 3D shape description is one of the most effective approaches to represent 3D geometry for rendering and reconstruction. Our work is inspired by the state of the art method DeepSDF that learns and analyzes the 3D shape as the iso surface of its shell and this method has shown promising results especially in the 3D shape reconstruction and compression domain. In this paper, we consider the degeneration problem of reconstruction coming from the capacity decrease of the DeepSDF model, which approximates the SDF with a neural network and a single latent code. We propose Local Geometry Code Learning (LGCL), a model that improves the original DeepSDF results by learning from a local shape geometry of the full 3D shape. We add an extra graph neural network to split the single transmittable latent code into a set of local latent codes distributed on the 3D shape. Mentioned latent codes are used to approximate the SDF in their local regions, which will alleviate the complexity of the approximation compared to the original DeepSDF. Furthermore, we introduce a new geometric loss function to facilitate the training of these local latent codes. Note that other local shape adjusting methods use the 3D voxel representation, which in turn is a problem highly difficult to solve or even is insolvable. In contrast, our architecture is based on graph processing implicitly and performs the learning regression process directly in the latent code space, thus make the proposed architecture more flexible and also simple for realization. Our experiments on 3D shape reconstruction demonstrate that our LGCL method can keep more details with a significantly smaller size of the SDF decoder and outperforms considerably the original DeepSDF method under the most important quantitative metrics.


Quantitative Performance Comparison of Various Traffic Shapers in Time Sensitive Networking. Owning to the sub standards being developed by IEEE Time Sensitive Networking (TSN) Task Group, the traditional IEEE 802.1 Ethernet is enhanced to support real time dependable communications for future time and safety critical applications. Several sub standards have been recently proposed that introduce various traffic shapers (e.g., Time Aware Shaper (TAS), Asynchronous Traffic Shaper (ATS), Credit Based Shaper (CBS), Strict Priority (SP)) for flow control mechanisms of queuing and scheduling, targeting different application requirements. These shapers can be used in isolation or in combination and there is limited work that analyzes, evaluates and compares their performance, which makes it challenging for end users to choose the right combination for their applications. This paper aims at (i) quantitatively comparing various traffic shapers and their combinations, (ii) summarizing, classifying and extending the architectures of individual and combined traffic shapers and their Network calculus (NC) based performance analysis methods and (iii) filling the gap in the timing analysis research on handling two novel hybrid architectures of combined traffic shapers, i.e., TAS ATS SP and TAS ATS CBS. A large number of experiments, using both synthetic and realistic test cases, are carried out for quantitative performance comparisons of various individual and combined traffic shapers, from the perspective of upper bounds of delay, backlog and jitter. To the best of our knowledge, we are the first to quantitatively compare the performance of the main traffic shapers in TSN. The paper aims at supporting the researchers and practitioners in the selection of suitable TSN sub protocols for their use cases.


Symmetry for positive critical points of Caffarelli Kohn Nirenberg inequalities. We consider positive critical points of Caffarelli Kohn Nirenberg inequalities and prove a Liouville type result which allows us to give a complete classification of the solutions in a certain range of parameters, providing a symmetry result for positive solutions. The governing operator is a weighted p Laplace operator, which we consider for a general p in (1,d) . For p 2 , the symmetry breaking region for extremals of Caffarelli Kohn Nirenberg inequalities was completely characterized in J. Dolbeault, M. Esteban, M. Loss, Invent. Math. 44 (2016) . Our results extend this result to a general p and are optimal in some cases.


Development of a Conceptual Framework for Knowledge Integration in Learning Newton's Third Law. Newton's third law is one of the most important concepts learned early in introductory mechanics courses however, ample studies have documented a wide range of students' misconceptions and fragmented understandings of this concept that are difficult to change through traditional instruction. This research develops a conceptual framework model to investigate students' understanding of Newton's third law through the knowledge integration perspective. The conceptual framework is established with a central idea emphasizing forces as the outcomes of an interaction instead of using the common action reaction language. Additional studies to apply this conceptual framework in assessment and instruction will follow.


Prepared MR Elastography. By decoupling motion and spatial encoding, magnitude contrast MR Elastography could be performed for the first time at ultrashort echo times (12 mu s). On the basis of a motion sensitizing magnetization preparation, the available total magnetic moment is sensitized to the motion induced in the tissues so the information can be efficiently carried over by the MR signal magnitude when the selected imaging pulse sequence is applied. The new paradigm allows also for shorter total acquisition times as demonstrated here in a set of homogeneous and heterogeneous phantoms with up to 5 fold acceleration factors. Summary of Main Findings Short Synopsis Magnitude contrast MR Elastography was developed on the basis of a motionsensitizing magnetization preparation to subsequently make use of any type of imaging sequence, like UTE or ZTE, to mechanically characterize tissues, otherwise inaccessible with standard MRE.


Bilinear embedding in Orlicz spaces for divergence form operators with complex coefficients. We prove a bi sublinear embedding for semigroups generated by non smooth complex coefficient elliptic operators in divergence form and for certain mutually dual pairs of Orlicz space norms. This generalizes a result by Carbonaro and Dragi v c evi ' c from power functions to more general Young functions that still behave like powers. To achieve this, we generalize a Bellman function constructed by Nazarov and Treil.


Predicting Post Concussion Syndrome Outcomes with Machine Learning. In this paper, machine learning models are used to predict outcomes for patients with persistent post concussion syndrome (PCS). Patients had sustained a concussion at an average of two to three months before the study. By utilizing assessed data, the machine learning models aimed to predict whether or not a patient would continue to have PCS after four to five months. The random forest classifier achieved the highest performance with an 85 accuracy and an area under the receiver operating characteristic curve (AUC) of 0.94. Factors found to be predictive of PCS outcome were Post Traumatic Stress Disorder (PTSD), perceived injustice, self rated prognosis, and symptom severity post injury. The results of this study demonstrate that machine learning models can predict PCS outcomes with high accuracy. With further research, machine learning models may be implemented in healthcare settings to help patients with persistent PCS.


An improved planar graph product structure theorem. Dujmovi 'c, Joret, Micek, Morin, Ueckerdt and Wood J. ACM 2020 proved that for every planar graph G there is a graph H with treewidth at most 8 and a path P such that G subseteq H boxtimes P . We improve this result by replacing "treewidth at most 8" by "simple treewidth at most 6".


GERNERMED An Open German Medical NER Model. The current state of adoption of well structured electronic health records and integration of digital methods for storing medical patient data in structured formats can often considered as inferior compared to the use of traditional, unstructured text based patient data documentation. Data mining in the field of medical data analysis often needs to rely solely on processing of unstructured data to retrieve relevant data. In natural language processing (NLP), statistical models have been shown successful in various tasks like part of speech tagging, relation extraction (RE) and named entity recognition (NER). In this work, we present GERNERMED, the first open, neural NLP model for NER tasks dedicated to detect medical entity types in German text data. Here, we avoid the conflicting goals of protection of sensitive patient data from training data extraction and the publication of the statistical model weights by training our model on a custom dataset that was translated from publicly available datasets in foreign language by a pretrained neural machine translation model. The sample code and the statistical model is available at https github.com frankkramer lab GERNERMED


Leaving Goals on the Pitch Evaluating Decision Making in Soccer. Analysis of the popular expected goals (xG) metric in soccer has determined that a (slightly) smaller number of high quality attempts will likely yield more goals than a slew of low quality ones. This observation has driven a change in shooting behavior. Teams are passing up on shots from outside the penalty box, in the hopes of generating a better shot closer to goal later on. This paper evaluates whether this decrease in long distance shots is warranted. Therefore, we propose a novel generic framework to reason about decision making in soccer by combining techniques from machine learning and artificial intelligence (AI). First, we model how a team has behaved offensively over the course of two seasons by learning a Markov Decision Process (MDP) from event stream data. Second, we use reasoning techniques arising from the AI literature on verification to each team's MDP. This allows us to reason about the efficacy of certain potential decisions by posing counterfactual questions to the MDP. Our key conclusion is that teams would score more goals if they shot more often from outside the penalty box in a small number of team specific locations. The proposed framework can easily be extended and applied to analyze other aspects of the game.


Highly charged Nd 9 Ion A potential candidate of upmu Hz linewidth optical clocks for probing fundamental physics. An active optical clock based on highly charged Nd 9 ion is proposed for the first time. The clock can offer ultra narrow linewidth at the upmu Hz level which is more than two order of magnitude below the currently recorded laser linewidth. Operating at 605(90) nm superradiation lasing transition between the 5p 2 4f ground state and one of the long lived 5p 4f 2 excited state, the proposed active clock is inherently immune against the cavity noise which provides high stability. The clock serves as a sensitive probe with high sensitivity to variation of the fine structure constant with accuracies below 10 19 level. Sophisticated relativistic many body methods are employed to predict related atomic properties that have corroborated the above findings.


Laminar and Turbulent Plasmoid Ejection in a Laboratory Parker Spiral Current Sheet. Quasi periodic plasmoid formation at the tip of magnetic streamer structures is observed to occur in experiments on the Big Red Ball as well as in simulations of these experiments performed with the extended MHD code, NIMROD. This plasmoid formation is found to occur on a characteristic timescale dependent on pressure gradients and magnetic curvature in both experiment and simulation. Single mode, or laminar, plasmoids exist when the pressure gradient is modest, but give way to turbulent plasmoid ejection when the system drive is higher, producing plasmoids of many sizes. However, a critical pressure gradient is also observed, below which plasmoids are never formed. A simple heuristic model of this plasmoid formation process is presented and suggested to be a consequence of a dynamic loss of equilibrium in the high beta region of the helmet streamer. This model is capable of explaining the periodicity of plasmoids observed in the experiment and simulations and produces plasmoid periods of 90 minutes when applied to 2D models of solar streamers with a height of 3R odot . This is consistent with the location and frequency at which periodic plasma blobs have been observed to form by LASCO and SECCHI instruments.


A Function Field Approach Toward Good Polynomials for Further Results on Optimal LRC Codes. Because of the recent applications to distributed storage systems, researchers have introduced a new class of block codes, i.e., locally recoverable (LRC) codes. LRC codes can recover information from erasure(s) by accessing a small number of erasure free code symbols and increasing the efficiency of repair processes in large scale distributed storage systems. In this context, Tamo and Barg first gave a breakthrough by cleverly introducing a good polynomial notion. Constructing good polynomials for locally recoverable codes achieving Singleton type bound (called optimal codes) is challenging and has attracted significant attention in recent years. This article aims to increase our knowledge of good polynomials for optimal LRC codes. Using tools from algebraic function fields and Galois theory, we continue investigating those polynomials and studying them by developing the Galois theoretical approach initiated by Micheli in 2019. Specifically, we push further the study of a crucial parameter mathcal G(f) (of a given polynomial f ), which measures how much a polynomial is "good" in the sense of LRC codes. We provide some characterizations of polynomials with minimal Galois groups and prove some properties of finite fields where polynomials exist with a specific size of Galois groups. We also present some explicit shapes of polynomials with small Galois groups. For some particular polynomials f , we give the exact formula of mathcal G(f) .


Faster Multi Goal Simulation Based Testing Using DoLesS (Domination with Least Square Approximation). For cyber physical systems, finding a set of test cases with the least cost by exploring multiple goals is a complex task. For example, Arrieta et al. reported that state of the art optimizers struggle to find minimal test suites for this task. To better manage this task, we propose DoLesS (Domination with Least Squares Approximation) which uses a domination predicate to sort the space of possible goals to a small number of representative examples. Multi objective domination then divides these examples into a "best" set and the remaining "rest" set. After that, DoLesS applies an inverted least squares approximation approach to learn a minimal set of tests that can distinguish best from rest in the reduced example space. DoLesS has been tested on four cyber physical models a tank flow model a model of electric car windows a safety feature of an AC engine and a continuous PID controller combined with a discrete state machine. Comparing to the recent state of the art paper attempted the same task, DoLesS performs as well or even better as state of the art, while running 80 360 times faster on average (seconds instead of hours). Hence, we recommend DoLesSas a fast method to find minimal test suites for multi goal cyber physical systems. For replication purposes, all our code is on line https github.com hellonull123 Test Selection 2021.


Efficient formulation of a two noded curved beam element under finite rotations. The paper extends the formulation of a 2D geometrically exact beam element proposed in our previous paper 1 to curved elastic beams. This formulation is based on equilibrium equations in their integrated form, combined with the kinematic relations and sectional equations that link the internal forces to sectional deformation variables. The resulting first order differential equations are approximated by the finite difference scheme and the boundary value problem is converted to an initial value problem using the shooting method. The paper develops the theoretical framework based on the Navier Bernoulli hypothesis but the approach could be extended to shear flexible beams. The initial shape of the beam is captured with high accuracy, for certain shapes including the circular one even exactly. Numerical procedures for the evaluation of equivalent nodal forces and of the element tangent stiffness are presented in detail. Unlike standard finite element formulations, the present approach can increase accuracy by refining the integration scheme on the element level while the number of global degrees of freedom is kept constant. The efficiency and accuracy of the developed scheme are documented by five examples that cover circular and parabolic arches and a spiral shaped beam. It is also shown that, for initially curved beams, a cross effect in the relations between internal forces and deformation variables arises, i.e., the bending moment affects axial stretching and the normal force affects the curvature.


A reliable Turing machine. We consider computations of a Turing machine subjected to noise. In every step, the action (the new state and the new content of the observed cell, the direction of the head movement) can differ from that prescribed by the transition function with a small probability (independently of previous such events). We construct a universal 1 tape Turing machine that for a low enough (constant) noise probability performs arbitrarily large computations. For this unavoidably, the input needs to be encoded by a simple code depending on its size. The work uses a technique familiar from reliable cellular automata, complemented by some new ones.


Remark on the local nature of metric mean dimension. Metric mean dimension is a metric invariant of dynamical systems. It is a dynamical analogue of Minkowski dimension of metric spaces. We explain that old ideas of Bowen (1972) can be used for clarifying the local nature of metric mean dimension. We also explain the generalization to mathbb R D actions and an illustrating example.


Red blue k center clustering with distance constraints. We consider a variant of the k center clustering problem in Re d , where the centers can be divided into two subsets, one, the red centers of size p , and the other, the blue centers of size q , where p q k , and such that each red center and each blue center must be apart a distance of at least some given alpha geq 0 , with the aim of minimizing the covering radius. We provide a bi criteria approximation algorithm for the problem and a polynomial time algorithm for the constrained problem where all centers must lie on a given line ell .


An Exploratory Study on Long Dialogue Summarization What Works and What's Next. Dialogue summarization helps readers capture salient information from long conversations in meetings, interviews, and TV series. However, real world dialogues pose a great challenge to current summarization models, as the dialogue length typically exceeds the input limits imposed by recent transformer based pre trained models, and the interactive nature of dialogues makes relevant information more context dependent and sparsely distributed than news articles. In this work, we perform a comprehensive study on long dialogue summarization by investigating three strategies to deal with the lengthy input problem and locate relevant information (1) extended transformer models such as Longformer, (2) retrieve then summarize pipeline models with several dialogue utterance retrieval methods, and (3) hierarchical dialogue encoding models such as HMNet. Our experimental results on three long dialogue datasets (QMSum, MediaSum, SummScreen) show that the retrieve then summarize pipeline models yield the best performance. We also demonstrate that the summary quality can be further improved with a stronger retrieval model and pretraining on proper external summarization datasets.


Meta Solver for Neural Ordinary Differential Equations. A conventional approach to train neural ordinary differential equations (ODEs) is to fix an ODE solver and then learn the neural network's weights to optimize a target loss function. However, such an approach is tailored for a specific discretization method and its properties, which may not be optimal for the selected application and yield the overfitting to the given solver. In our paper, we investigate how the variability in solvers' space can improve neural ODEs performance. We consider a family of Runge Kutta methods that are parameterized by no more than two scalar variables. Based on the solvers' properties, we propose an approach to decrease neural ODEs overfitting to the pre defined solver, along with a criterion to evaluate such behaviour. Moreover, we show that the right choice of solver parameterization can significantly affect neural ODEs models in terms of robustness to adversarial attacks. Recently it was shown that neural ODEs demonstrate superiority over conventional CNNs in terms of robustness. Our work demonstrates that the model robustness can be further improved by optimizing solver choice for a given task. The source code to reproduce our experiments is available at https github.com juliagusak neural ode metasolver.


Dynamics in direct two photon transition by frequency combs. Two photon resonance transition technology has been proven to have a wide range of applications,it's limited by the available wavelength of commercial lasers.The application of optical comb technology with direct two photon transition (DTPT) will not be restricted by cw lasers.This article will further theoretically analyze the dynamics effects of the DTPT process driven by optical frequency combs. In a three level atomic system, the population of particles and the amount of momentum transfer on atoms are increased compared to that of the DTPT free process. The 17 of population increasement in 6 level system of cesium atoms has verified that DTPT process has a robust enhancement on the effect of momentum transfer. It can be used to excite the DTPTs of rubidium and cesium simultaneously with the same mode locked laser. And this technology has potential applications in cooling different atoms to obtain polar cold molecules, as well as high precision spectroscopy measurement.


CAP GAN Towards Adversarial Robustness with Cycle consistent Attentional Purification. Adversarial attack is aimed at fooling the target classifier with imperceptible perturbation. Adversarial examples, which are carefully crafted with a malicious purpose, can lead to erroneous predictions, resulting in catastrophic accidents. To mitigate the effects of adversarial attacks, we propose a novel purification model called CAP GAN. CAP GAN takes account of the idea of pixel level and feature level consistency to achieve reasonable purification under cycle consistent learning. Specifically, we utilize the guided attention module and knowledge distillation to convey meaningful information to the purification model. Once a model is fully trained, inputs would be projected into the purification model and transformed into clean like images. We vary the capacity of the adversary to argue the robustness against various types of attack strategies. On the CIFAR 10 dataset, CAP GAN outperforms other pre processing based defenses under both black box and white box settings.


Knowledge Enhanced Fine Tuning for Better Handling Unseen Entities in Dialogue Generation. Although pre training models have achieved great success in dialogue generation, their performance drops dramatically when the input contains an entity that does not appear in pre training and fine tuning datasets (unseen entity). To address this issue, existing methods leverage an external knowledge base to generate appropriate responses. In real world scenario, the entity may not be included by the knowledge base or suffer from the precision of knowledge retrieval. To deal with this problem, instead of introducing knowledge base as the input, we force the model to learn a better semantic representation by predicting the information in the knowledge base, only based on the input context. Specifically, with the help of a knowledge base, we introduce two auxiliary training objectives 1) Interpret Masked Word, which conjectures the meaning of the masked entity given the context 2) Hypernym Generation, which predicts the hypernym of the entity based on the context. Experiment results on two dialogue corpus verify the effectiveness of our methods under both knowledge available and unavailable settings.


AdderNet and its Minimalist Hardware Design for Energy Efficient Artificial Intelligence. Convolutional neural networks (CNN) have been widely used for boosting the performance of many machine intelligence tasks. However, the CNN models are usually computationally intensive and energy consuming, since they are often designed with numerous multiply operations and considerable parameters for the accuracy reason. Thus, it is difficult to directly apply them in the resource constrained environments such as 'Internet of Things' (IoT) devices and smart phones. To reduce the computational complexity and energy burden, here we present a novel minimalist hardware architecture using adder convolutional neural network (AdderNet), in which the original convolution is replaced by adder kernel using only additions. To maximally excavate the potential energy consumption, we explore the low bit quantization algorithm for AdderNet with shared scaling factor method, and we design both specific and general purpose hardware accelerators for AdderNet. Experimental results show that the adder kernel with int8 int16 quantization also exhibits high performance, meanwhile consuming much less resources (theoretically 81 off). In addition, we deploy the quantized AdderNet on FPGA (Field Programmable Gate Array) platform. The whole AdderNet can practically achieve 16 enhancement in speed, 67.6 71.4 decrease in logic resource utilization and 47.85 77.9 decrease in power consumption compared to CNN under the same circuit architecture. With a comprehensive comparison on the performance, power consumption, hardware resource consumption and network generalization capability, we conclude the AdderNet is able to surpass all the other competitors including the classical CNN, novel memristor network, XNOR Net and the shift kernel based network, indicating its great potential in future high performance and energy efficient artificial intelligence applications.


Some remarks on oscillation inequalities. In this paper we establish uniform oscillation estimates on L p(X) with p in(1, infty) for the polynomial ergodic averages. This result contributes to a certain problem about uniform oscillation bounds for ergodic averages formulated by Rosenblatt and Wierdl in the early 1990's. We also give a slightly different proof of the uniform oscillation inequality of Jones, Kaufman, Rosenblatt and Wierdl for bounded martingales. Finally, we show that oscillations, in contrast to jump inequalities, cannot be seen as an endpoint for r variation inequalities.


Guaranteed Fixed Confidence Best Arm Identification in Multi Armed Bandits Simple Sequential Elimination Algorithms. We consider the problem of finding, through adaptive sampling, which of n options (arms) has the largest mean. Our objective is to determine a rule which identifies the best arm with a fixed minimum confidence using as few observations as possible, i.e. this is a fixed confidence (FC) best arm identification (BAI) in multi armed bandits. We study such problems under the Bayesian setting with both Bernoulli and Gaussian arms. We propose to use the classical "vector at a time" (VT) rule, which samples each remaining arm once in each round. We show how VT can be implemented and analyzed in our Bayesian setting and be improved by early elimination. Our analysis show that these algorithms guarantee an optimal strategy under the prior. We also propose and analyze a variant of the classical "play the winner" (PW) algorithm. Numerical results show that these rules compare favorably with state of art algorithms.


BERT Family Eat Word Salad Experiments with Text Understanding. In this paper, we study the response of large models from the BERT family to incoherent inputs that should confuse any model that claims to understand natural language. We define simple heuristics to construct such examples. Our experiments show that state of the art models consistently fail to recognize them as ill formed, and instead produce high confidence predictions on them. As a consequence of this phenomenon, models trained on sentences with randomly permuted word order perform close to state of the art models. To alleviate these issues, we show that if models are explicitly trained to recognize invalid inputs, they can be robust to such attacks without a drop in performance.


Helly systems and certificates in optimization. Inspired by branch and bound and cutting plane proofs in mixed integer optimization and proof complexity, we develop a general approach via Hoffman's Helly systems. This helps to distill the main ideas behind optimality and infeasibility certificates in optimization. The first part of the paper formalizes the notion of a certificate and its size in this general setting. The second part of the paper establishes lower and upper bounds on the sizes of these certificates in various different settings. We show that some important techniques existing in the literature are purely combinatorial in nature and do not depend on any underlying geometric notions.


Between welcome culture and border fence. A dataset on the European refugee crisis in German newspaper reports. Newspaper reports provide a rich source of information on the unfolding of public debate on specific policy fields that can serve as basis for inquiry in political science. Such debates are often triggered by critical events, which attract public attention and incite the reactions of political actors crisis sparks the debate. However, due to the challenges of reliable annotation and modeling, few large scale datasets with high quality annotation are available. This paper introduces DebateNet2.0, which traces the political discourse on the European refugee crisis in the German quality newspaper taz during the year 2015. The core units of our annotation are political claims (requests for specific actions to be taken within the policy field) and the actors who make them (politicians, parties, etc.). The contribution of this paper is twofold. First, we document and release DebateNet2.0 along with its companion R package, mardyR, guiding the reader through the practical and conceptual issues related to the annotation of policy debates in newspapers. Second, we outline and apply a Discourse Network Analysis (DNA) to DebateNet2.0, comparing two crucial moments of the policy debate on the 'refugee crisis' the migration flux through the Mediterranean in April May and the one along the Balkan route in September October. Besides the released resources and the case study, our contribution is also methodological we talk the reader through the steps from a newspaper article to a discourse network, demonstrating that there is not just one discourse network for the German migration debate, but multiple ones, depending on the topic of interest (political actors, policy fields, time spans).


Open Set Recognition a Good Closed Set Classifier is All You Need?. The ability to identify whether or not a test sample belongs to one of the semantic classes in a classifier's training set is critical to practical deployment of the model. This task is termed open set recognition (OSR) and has received significant attention in recent years. In this paper, we first demonstrate that the ability of a classifier to make the 'none of above' decision is highly correlated with its accuracy on the closed set classes. We find that this relationship holds across loss objectives and architectures, and further demonstrate the trend both on the standard OSR benchmarks as well as on a large scale ImageNet evaluation. Second, we use this correlation to boost the performance of a maximum logit score OSR 'baseline' by improving its closed set accuracy, and with this strong baseline achieve state of the art on a number of OSR benchmarks. Similarly, we boost the performance of the existing state of the art method by improving its closed set accuracy, but the resulting discrepancy with the strong baseline is marginal. Our third contribution is to present the 'Semantic Shift Benchmark' (SSB), which better respects the task of detecting semantic novelty, in contrast to other forms of distribution shift also considered in related sub fields, such as out of distribution detection. On this new evaluation, we again demonstrate that there is negligible difference between the strong baseline and the existing state of the art. Project Page https www.robots.ox.ac.uk vgg research osr


Graph Convolutional Networks with Dual Message Passing for Subgraph Isomorphism Counting and Matching. Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as subgraph isomorphism counting and matching. However, existing message passing mechanisms are not designed well in theory. In this paper, we start from a particular edge to vertex transform and exploit the isomorphism property in the edge to vertex dual graphs. We prove that searching isomorphisms on the original graph is equivalent to searching on its dual graph. Based on this observation, we propose dual message passing neural networks (DMPNNs) to enhance the substructure representation learning in an asynchronous way for subgraph isomorphism counting and matching as well as unsupervised node classification. Extensive experiments demonstrate the robust performance of DMPNNs by combining both node and edge representation learning in synthetic and real heterogeneous graphs. Code is available at https github.com HKUST KnowComp DualMessagePassing.


On shared and multiple information. We address three outstanding problems in information theory. Problem one is the definition of a non negative decomposition of the information conveyed by two or more sources about a target variable into the specific contribution of each possible combination of the sources. Problem two is the definition of a measure of information shared by several sources about the target variable. Problem three is the definition of a measure of multiple mutual information, that is, the extension of mutual information to more than two variables.


Constrained Consensus Sequence Algorithm for DNA Archiving. The paper describes an algorithm to compute a consensus sequence from a set of DNA sequences of approximatively identical length generated by 3rd sequencing generation technologies. Its purpose targets DNA storage and is guided by specific features that cannot be exhibited from biological data such as the exact length of the consensus sequences, the precise location of known patterns, the kmer composition, etc.


Uncertainty aware Mean Teacher for Source free Unsupervised Domain Adaptive 3D Object Detection. Pseudo label based self training approaches are a popular method for source free unsupervised domain adaptation. However, their efficacy depends on the quality of the labels generated by the source trained model. These labels may be incorrect with high confidence, rendering thresholding methods ineffective. In order to avoid reinforcing errors caused by label noise, we propose an uncertainty aware mean teacher framework which implicitly filters incorrect pseudo labels during training. Leveraging model uncertainty allows the mean teacher network to perform implicit filtering by down weighing losses corresponding uncertain pseudo labels. Effectively, we perform automatic soft sampling of pseudo labeled data while aligning predictions from the student and teacher networks. We demonstrate our method on several domain adaptation scenarios, from cross dataset to cross weather conditions, and achieve state of the art performance in these cases, on the KITTI lidar target dataset.


The modularity of elliptic curves over all but finitely many totally real fields of degree 5. We study the finiteness of low degree points on certain modular curves and their Atkin Lehner quotients, and, as an application, prove the modularity of elliptic curves over all but finitely many totally real fields of degree 5 . On the way, we prove a criterion for the finiteness of rational points of degree 5 on a curve of large genus over a number field using the results of Abramovich Harris and Faltings on subvarieties of Jacobians.


A weighted invariant trace formula. This paper begins a new approach to the r trace formula, without removing the nontempered contribution to the spectral side. We first establish an invariant trace formula whose discrete spectral terms are weighted by automorphic L functions. This involves extending the results of Finis, Lapid, and M "uller on the continuity of the coarse expansion of Arthur's noninvariant trace formula to the refined expansion, and then to the invariant trace formula, while incorporating the use of basic functions at unramified places.


Convex integration with avoidance and hyperbolic (4,6) distributions. This paper tackles the classification, up to homotopy, of tangent distributions satisfying various non involutivity conditions. All of our results build on Gromov's convex integration. For completeness, we first prove that that the full h principle holds for step 2 bracket generating distributions. This follows from classic convex integration, no refinements of the theory are needed. The classification of (3,5) and (3,6) distributions follows as a particular case. We then move on to our main example A complete h principle for hyperbolic (4,6) distributions. Even though the associated differential relation fails to be ample along some principal subspaces, we implement an "avoidance trick" to ensure that these are avoided during convex integration. Using this trick we provide the first example of a differential relation that is ample in coordinate directions but not in all directions, answering a question of Eliashberg and Mishachev. This so called "avoidance trick" is part of a general avoidance framework, which is the main contribution of this article. Given any differential relation, the framework attempts to produce an associated object called an "avoidance template". If this process is successful, we say that the relation is "ample up to avoidance" and we prove that convex integration applies. The example of hyperbolic (4,6) distributions shows that our framework is capable of addressing differential relations beyond the applicability of classic convex integration.


( alpha , beta ) Modules in Graphs. Modular Decomposition focuses on repeatedly identifying a module M (a collection of vertices that shares exactly the same neighbourhood outside of M) and collapsing it into a single vertex. This notion of exactitude of neighbourhood is very strict, especially when dealing with real world graphs. We study new ways to relax this exactitude condition. However, generalizing modular decomposition is far from obvious. Most of the previous proposals lose algebraic properties of modules and thus most of the nice algorithmic consequences. We introduce the notion of an ( alpha , beta ) module, a relaxation that allows a bounded number of errors in each node and maintains some of the algebraic structure. It leads to a new combinatorial decomposition with interesting properties. Among the main results in this work, we show that minimal ( alpha , beta ) modules can be computed in polynomial time, and that every graph admits an ( alpha , beta ) modular decomposition tree, thus generalizing Gallai's Theorem (which corresponds to the case for alpha beta 0). Unfortunately we give evidence that computing such a decomposition tree can be difficult.


Importance sampling for option pricing with feedforward neural networks. We study the problem of reducing the variance of Monte Carlo estimators through performing suitable changes of the sampling measure which are induced by feedforward neural networks. To this end, building on the concept of vector stochastic integration, we characterize the Cameron Martin spaces of a large class of Gaussian measures which are induced by vector valued continuous local martingales with deterministic covariation. We prove that feedforward neural networks enjoy, up to an isometry, the universal approximation property in these topological spaces. We then prove that sampling measures which are generated by feedforward neural networks can approximate the optimal sampling measure arbitrarily well. We conclude with a numerical study pricing path dependent European basket and barrier options in the case of Black Scholes and several stochastic volatility models for the underlying multivariate asset.


On the approximation ratio of LZ End to LZ77. A family of Lempel Ziv factorizations is a well studied string structure. The LZ End factorization is a member of the family that achieved faster extraction of any substrings (Kreft Navarro, TCS 2013). One of the interests for LZ End factorizations is the possible difference between the size of LZ End and LZ77 factorizations. They also showed families of strings where the approximation ratio of the number of LZ End phrases to the number of LZ77 phrases asymptotically approaches 2. However, the alphabet size of these strings is unbounded. In this paper, we analyze the LZ End factorization of the period doubling sequence. We also show that the approximation ratio for the period doubling sequence asymptotically approaches 2 for the binary alphabet.


Feedback Linearization of Car Dynamics for Racing via Reinforcement Learning. Through the method of Learning Feedback Linearization, we seek to learn a linearizing controller to simplify the process of controlling a car to race autonomously. A soft actor critic approach is used to learn a decoupling matrix and drift vector that effectively correct for errors in a hand designed linearizing controller. The result is an exactly linearizing controller that can be used to enable the well developed theory of linear systems to design path planning and tracking schemes that are easy to implement and significantly less computationally demanding. To demonstrate the method of feedback linearization, it is first used to learn a simulated model whose exact structure is known, but varied from the initial controller, so as to introduce error. We further seek to apply this method to a system that introduces even more error in the form of a gym environment specifically designed for modeling the dynamics of car racing. To do so, we posit an extension to the method of learning feedback linearization a neural network that is trained using supervised learning to convert the output of our linearizing controller to the required input for the racing environment. Our progress towards these goals is reported and the next steps in their accomplishment are discussed.


Identification of time Varying frequency of noiseless sinusoidal signal. A new algorithm for estimating the time varying frequency of a noiseless sinusoidal signal is considered. It is assumed that the amplitude and frequency of the sinusoidal signal are unknown functions of time, but are solutions of linear stationary differential equations with known parameters. The problem is solved using gradient tuning algorithms based on a linear regression equation obtained by parameterizing the original nonlinear sinusoidal signal. The example presented in the article and the results of computer modeling illustrate the efficiency of the proposed algorithm, as well as explain the procedure for its synthesis.


Matrix valued orthogonal polynomials related to hexagon tilings. In this paper, we study a class of matrix valued orthogonal polynomials (MVOPs) that are related to 2 periodic lozenge tilings of a hexagon. The general model depends on many parameters. In the cases of constant and 2 periodic parameter values we show that the MVOP can be expressed in terms of scalar polynomials with non Hermitian orthogonality on a closed contour in the complex plane. The 2 periodic hexagon tiling model with a constant parameter has a phase transition in the large size limit. This is reflected in the asymptotic behavior of the MVOP as the degree tends to infinity. The connection with the scalar orthogonal polynomials allows us to find the limiting behavior of the zeros of the determinant of the MVOP. The zeros tend to a curve widetilde Sigma 0 in the complex plane that has a self intersection. The zeros of the individual entries of the MVOP show a different behavior and we find the limiting zero distribution of the upper right entry under a geometric condition on the curve widetilde Sigma 0 that we were unable to prove, but that is convincingly supported by numerical evidence.


Operations on Metric Thickenings. Many simplicial complexes arising in practice have an associated metric space structure on the vertex set but not on the complex, e.g. the Vietoris Rips complex in applied topology. We formalize a remedy by introducing a category of simplicial metric thickenings whose objects have a natural realization as metric spaces. The properties of this category allow us to prove that, for a large class of thickenings including Vietoris Rips and Cech thickenings, the product of metric thickenings is homotopy equivalent to the metric thickenings of product spaces, and similarly for wedge sums.


Optimal Targeted Advertising Strategy For Secure Wireless Edge Metaverse. Recently, Metaverse has attracted increasing attention from both industry and academia, because of the significant potential to integrate real and digital worlds ever more seamlessly. By combining advanced wireless communications, edge computing and virtual reality (VR) technologies into Metaverse, a multidimensional, intelligent and powerful wireless edge Metaverse is created for future human society. In this paper, we design a privacy preserving targeted advertising strategy for the wireless edge Metaverse. Specifically, a Metaverse service provider (MSP) allocates bandwidth to the VR users so that the users can access Metaverse from edge access points. To protect users' privacy, the covert communication technique is used in the downlink. Then, the MSP can offer high quality access services to earn more profits. Motivated by the concept of "covert", targeted advertising is used to promote the sale of bandwidth and ensure that the advertising strategy cannot be detected by competitors who may make counter offer and by attackers who want to disrupt the services. We derive the best advertising strategy in terms of budget input, with the help of the Vidale Wolfe model and Hamiltonian function. Furthermore, we propose a novel metric named Meta Immersion to represent the user's experience feelings. The performance evaluation shows that the MSP can boost its revenue with an optimal targeted advertising strategy, especially compared with that without the advertising.


On the existence of canonical multi phase Brakke flows. This paper establishes the global in time existence of a multi phase mean curvature flow, evolving from an arbitrary closed rectifiable initial datum, which is a Brakke flow and a BV solution at the same time. In particular, we prove the validity of an explicit identity concerning the change of volume of the evolving grains, showing that their boundaries move according to the generalized mean curvature vector of the Brakke flow. As a consequence of the results recently established by Fischer et al. in arXiv 2003.05478, under suitable assumptions on the initial datum, such additional property resolves the non uniqueness issue of Brakke flows.


On the nu zeros of the modified Bessel function K i nu (x) of positive argument. The modified Bessel function of the second kind K i nu (x) of imaginary order for fixed x 0 possesses a countably infinite sequence of real zeros. Recently it has been shown that the n th zero behaves like nu n sim pi n log ,n as n to infty . In this note we determine a more precise estimate for the bahaviour of these zeros for large n by making use of the known asymptotic expansion of K i nu (x) for large nu . Numerical results are presented to illustrate the accuracy of the expansion obtained.


Solvability of Infinite horizon McKean Vlasov FBSDEs in Mean Field Control Problems and Games. In this paper, we show existence and uniqueness of solutions of the infinite horizon McKean Vlasov FBSDEs using two different methods, which lead to two different sets of assumptions. We use these results to solve the infinite horizon mean field type control problems and mean field games.


Competence Aware Path Planning via Introspective Perception. Robots deployed in the real world over extended periods of time need to reason about unexpected failures, learn to predict them, and to proactively take actions to avoid future failures. Existing approaches for competence aware planning are either model based, requiring explicit enumeration of known failure modes, or purely statistical, using state and location specific failure statistics to infer competence. We instead propose a structured model free approach to competence aware planning by reasoning about plan execution failures due to errors in perception, without requiring a priori enumeration of failure sources or requiring location specific failure statistics. We introduce competence aware path planning via introspective perception (CPIP), a Bayesian framework to iteratively learn and exploit task level competence in novel deployment environments. CPIP factorizes the competence aware planning problem into two components. First, perception errors are learned in a model free and location agnostic setting via introspective perception prior to deployment in novel environments. Second, during actual deployments, the prediction of task level failures is learned in a context aware setting. Experiments in a simulation show that the proposed CPIP approach outperforms the frequentist baseline in multiple mobile robot tasks, and is further validated via real robot experiments in an environment with perceptually challenging obstacles and terrain.


Characterizing Idioms Conventionality and Contingency. Idioms are unlike other phrases in two important ways. First, the words in an idiom have unconventional meanings. Second, the unconventional meaning of words in an idiom are contingent on the presence of the other words in the idiom. Linguistic theories disagree about whether these two properties depend on one another, as well as whether special theoretical machinery is needed to accommodate idioms. We define two measures that correspond to these two properties, and we show that idioms fall at the expected intersection of the two dimensions, but that the dimensions themselves are not correlated. Our results suggest that idioms are no more anomalous than other types of phrases, and that introducing special machinery to handle idioms may not be warranted.


Responsible AI Gender bias assessment in emotion recognition. Rapid development of artificial intelligence (AI) systems amplify many concerns in society. These AI algorithms inherit different biases from humans due to mysterious operational flow and because of that it is becoming adverse in usage. As a result, researchers have started to address the issue by investigating deeper in the direction towards Responsible and Explainable AI. Among variety of applications of AI, facial expression recognition might not be the most important one, yet is considered as a valuable part of human AI interaction. Evolution of facial expression recognition from the feature based methods to deep learning drastically improve quality of such algorithms. This research work aims to study a gender bias in deep learning methods for facial expression recognition by investigating six distinct neural networks, training them, and further analysed on the presence of bias, according to the three definition of fairness. The main outcomes show which models are gender biased, which are not and how gender of subject affects its emotion recognition. More biased neural networks show bigger accuracy gap in emotion recognition between male and female test sets. Furthermore, this trend keeps for true positive and false positive rates. In addition, due to the nature of the research, we can observe which types of emotions are better classified for men and which for women. Since the topic of biases in facial expression recognition is not well studied, a spectrum of continuation of this research is truly extensive, and may comprise detail analysis of state of the art methods, as well as targeting other biases.


Representatives for unipotent classes and nilpotent orbits. Let G be a simple algebraic group over an algebraically closed field k of characteristic p . The classification of the conjugacy classes of unipotent elements of G(k) and nilpotent orbits of G on operatorname Lie (G) is well established. One knows there are representatives of every unipotent class as a product of root group elements and every nilpotent orbit as a sum of root elements. We give explicit representatives in terms of a Chevalley basis for the eminent classes. A unipotent (resp. nilpotent) element is said to be eminent if it is not contained in any subsystem subgroup (resp. subalgebra), or a natural generalisation if G is of type D n . From these representatives, it is straightforward to generate representatives for any given class. Along the way we also prove recognition theorems for identifying both the unipotent classes and nilpotent orbits of exceptional algebraic groups.


On fractional smoothness of modulus of functions. We consider the Nemytskii operators u to u and u to u pm in a bounded domain Omega with C 2 boundary. We give elementary proofs of the boundedness in H s( Omega) with 0 le s 3 2 .


Representations of low copolarity. We classify irreducible representations of compact connected Lie groups whose orbit space is isometric to the orbit space of a representation of a compact Lie group of dimension 7 , 8 or 9 . They turn out to be closely related to symmetric spaces, with one exception only.


Joint Characterization of Spatiotemporal Data Manifolds. Spatiotemporal (ST) image data are increasingly common and often high dimensional (high D). Modeling ST data can be a challenge due to the plethora of independent and interacting processes which may or may not contribute to the measurements. Characterization can be considered the complement to modeling by helping guide assumptions about generative processes and their representation in the data. Dimensionality reduction (DR) is a frequently implemented type of characterization designed to mitigate the "curse of dimensionality" on high D signals. For decades, Principal Component (PC) and Empirical Orthogonal Function (EOF) analysis has been used as a linear, invertible approach to DR and ST analysis. Recent years have seen the additional development of a suite of nonlinear DR algorithms, frequently categorized as "manifold learning". Here, we explore the idea of joint characterization of ST data manifolds using PCs EOFs alongside two nonlinear DR approaches Laplacian Eigenmaps (LE) and t distributed stochastic neighbor embedding (t SNE). Starting with a synthetic example and progressing to global, regional, and field scale ST datasets spanning roughly 5 orders of magnitude in space and 2 in time, we show these three DR approaches can yield complementary information about ST manifold topology. Compared to the relatively diffuse TFS produced by PCs EOFs, the nonlinear approaches yield more compact manifolds with decreased ambiguity in temporal endmembers (LE) and or in spatiotemporal clustering (t SNE). These properties are compensated by the greater interpretability, significantly lower computational demand and diminished sensitivity to spatial aliasing for PCs EOFs than LE or t SNE. Taken together, we find joint characterization using the three complementary DR approaches capable of greater insight into generative ST processes than possible using any single approach alone.


Jointly Improving Language Understanding and Generation with Quality Weighted Weak Supervision of Automatic Labeling. Neural natural language generation (NLG) and understanding (NLU) models are data hungry and require massive amounts of annotated data to be competitive. Recent frameworks address this bottleneck with generative models that synthesize weak labels at scale, where a small amount of training labels are expert curated and the rest of the data is automatically annotated. We follow that approach, by automatically constructing a large scale weakly labeled data with a fine tuned GPT 2, and employ a semi supervised framework to jointly train the NLG and NLU models. The proposed framework adapts the parameter updates to the models according to the estimated label quality. On both the E2E and Weather benchmarks, we show that this weakly supervised training paradigm is an effective approach under low resource scenarios and outperforming benchmark systems on both datasets when 100 of training data is used.


Parametric Resonance of a charged pendulum with suspension point oscillating between two vertical charged lines. In this work, we study a mathematical planar pendulum whose support point is positioned equidistant between two vertical and uniformly electrically charged wires. Its bob carries an electric charge and, its support point oscillates vertically, following a harmonic law of motion. We study the dynamics of such phenomenon and the parametric resonances of the equilibria. Moreover, we obtain the surface in the parameter space (since such system presents three parameters) which separates the region of stability from the region of instability. On the particular case of zero charge, we obtain the boundary curves of the stability instability of Matheiu equation.