Sinking microplastics in the water column simulations in the Mediterranean Sea. We study the vertical dispersion and distribution of negatively buoyant rigid microplastics within a realistic circulation model of the Mediterranean sea. We first propose an equation describing their idealized dynamics. In that framework, we evaluate the importance of some relevant physical effects inertia, Coriolis force, small scale turbulence and variable seawater density, and bound the relative error of simplifying the dynamics to a constant sinking velocity added to a large scale velocity field. We then calculate the amount and vertical distribution of microplastic particles on the water column of the open ocean if their release from the sea surface is continuous at rates compatible with observations in the Mediterranean. The vertical distribution is found to be almost uniform with depth for the majority of our parameter range. Transient distributions from flash releases reveal a non Gaussian character of the dispersion and various diffusion laws, both normal and anomalous. The origin of these behaviors is explored in terms of horizontal and vertical flow organization.


Multi line lasing in the broadly tunable ammonia quantum cascade laser pumped molecular laser. Gaseous ammonia has previously been demonstrated as a compelling gain medium for a quantum cascade laser pumped molecular laser (QPML), exhibiting good power efficiency but limited tunability. Here we explore the potential of the ammonia QPML to produce powerful, broadly tunable terahertz frequency lasing on rotational and pure inversion transitions. After theoretically predicting possible laser frequencies, pump thresholds, and efficiencies, we experimentally demonstrate unprecedented tunability from 0.762 to more than 4.5 THz by pumping Q and R branch infrared transitions with widely tunable quantum cascade lasers. We additionally demonstrate two types of multi line lasing simultaneous pure inversion and rotation inversion transitions from the same pumped rotational state, and cascaded lasing involving transitions below the pumped rotational state. We report single frequency power levels as great as 0.33 mW from a low volume laser cavity.


The homotopy types of free racks and quandles. We initiate the homotopical study of racks and quandles, two algebraic structures that govern knot theory and related braided structures in algebra and geometry. We prove analogs of Milnor's theorem on free groups for these theories and their pointed variants, identifying the homotopy types of the free racks and free quandles on spaces of generators. These results allow us to complete the stable classification of racks and quandles by identifying the ring spectra that model their stable homotopy theories. As an application, we show that the stable homotopy of a knot quandle is, in general, more complicated than what any Wirtinger presentation coming from a diagram predicts.


SMURF Self Teaching Multi Frame Unsupervised RAFT with Full Image Warping. We present SMURF, a method for unsupervised learning of optical flow that improves state of the art on all benchmarks by 36 to 40 (over the prior best method UFlow) and even outperforms several supervised approaches such as PWC Net and FlowNet2. Our method integrates architecture improvements from supervised optical flow, i.e. the RAFT model, with new ideas for unsupervised learning that include a sequence aware self supervision loss, a technique for handling out of frame motion, and an approach for learning effectively from multi frame video data while still only requiring two frames for inference.


Mixture Based Correction for Position and Trust Bias in Counterfactual Learning to Rank. In counterfactual learning to rank (CLTR) user interactions are used as a source of supervision. Since user interactions come with bias, an important focus of research in this field lies in developing methods to correct for the bias of interactions. Inverse propensity scoring (IPS) is a popular method suitable for correcting position bias. Affine correction (AC) is a generalization of IPS that corrects for position bias and trust bias. IPS and AC provably remove bias, conditioned on an accurate estimation of the bias parameters. Estimating the bias parameters, in turn, requires an accurate estimation of the relevance probabilities. This cyclic dependency introduces practical limitations in terms of sensitivity, convergence and efficiency. We propose a new correction method for position and trust bias in CLTR in which, unlike the existing methods, the correction does not rely on relevance estimation. Our proposed method, mixture based correction (MBC), is based on the assumption that the distribution of the CTRs over the items being ranked is a mixture of two distributions the distribution of CTRs for relevant items and the distribution of CTRs for non relevant items. We prove that our method is unbiased. The validity of our proof is not conditioned on accurate bias parameter estimation. Our experiments show that MBC, when used in different bias settings and accompanied by different LTR algorithms, outperforms AC, the state of the art method for correcting position and trust bias, in some settings, while performing on par in other settings. Furthermore, MBC is orders of magnitude more efficient than AC in terms of the training time.


Dense Uncertainty Estimation. Deep neural networks can be roughly divided into deterministic neural networks and stochastic neural networks.The former is usually trained to achieve a mapping from input space to output space via maximum likelihood estimation for the weights, which leads to deterministic predictions during testing. In this way, a specific weights set is estimated while ignoring any uncertainty that may occur in the proper weight space. The latter introduces randomness into the framework, either by assuming a prior distribution over model parameters (i.e. Bayesian Neural Networks) or including latent variables (i.e. generative models) to explore the contribution of latent variables for model predictions, leading to stochastic predictions during testing. Different from the former that achieves point estimation, the latter aims to estimate the prediction distribution, making it possible to estimate uncertainty, representing model ignorance about its predictions. We claim that conventional deterministic neural network based dense prediction tasks are prone to overfitting, leading to over confident predictions, which is undesirable for decision making. In this paper, we investigate stochastic neural networks and uncertainty estimation techniques to achieve both accurate deterministic prediction and reliable uncertainty estimation. Specifically, we work on two types of uncertainty estimations solutions, namely ensemble based methods and generative model based methods, and explain their pros and cons while using them in fully semi weakly supervised framework. Due to the close connection between uncertainty estimation and model calibration, we also introduce how uncertainty estimation can be used for deep model calibration to achieve well calibrated models, namely dense model calibration. Code and data are available at https github.com JingZhang617 UncertaintyEstimation.


Non convex geometry of numbers and continued fractions. In recent work, the first two authors constructed a generalized continued fraction called the p continued fraction, characterized by the property that its convergents (a subsequence of the regular convergents) are best approximations with respect to the L p norm, where p geq 1 . We extend this construction to the region 0 p 1 , where now the L p quasinorm is non convex. We prove that the approximation coefficients of the p continued fraction are bounded above by 1 sqrt 5 varepsilon p , where varepsilon p to 0 as p to 0 . In light of Hurwitz's theorem, this upper bound is sharp, in the limit. We also measure the maximum number of consecutive regular convergents that are skipped by the p continued fraction.


Stripping Mechanisms and Remediation for H Beams. Negative hydrogen ions are often used for injecting protons from linacs to storage rings via charge exchange injection. In this process, the two electrons are stripped by a foil or laser to produce protons which can be merged with an existing beam without significantly affecting its dynamics, allowing high intensities of protons to be accumulated. However, this capability comes with the drawback that the outer electron of an H ion has a low binding energy and can easily be stripped away prior to injection. This paper addresses the following stripping mechanisms interactions with residual gas in the beam pipe, blackbody radiation from accelerator components, and electromagnetic fields from accelerator optics (Lorentz force stripping) and particles within the bunch itself (intrabeam stripping) with a discussion on how to avoid excessive activation from stripped H 0 particles and protons. We also demonstrate that the proportion of stripped H 0 colliding with a nearby beam pipe or machine element walls presents only roughly 10 of those lost in stripping the remaining stripped particles traverse to the end of a linac or local straight section, which may relax the limits for allowable stripping based beam loss in H accelerators.


A Search Based Testing Framework for Deep Neural Networks of Source Code Embedding. Over the past few years, deep neural networks (DNNs) have been continuously expanding their real world applications for source code processing tasks across the software engineering domain, e.g., clone detection, code search, comment generation. Although quite a few recent works have been performed on testing of DNNs in the context of image and speech processing, limited progress has been achieved so far on DNN testing in the context of source code processing, that exhibits rather unique characteristics and challenges. In this paper, we propose a search based testing framework for DNNs of source code embedding and its downstream processing tasks like Code Search. To generate new test inputs, we adopt popular source code refactoring tools to generate the semantically equivalent variants. For more effective testing, we leverage the DNN mutation testing to guide the testing direction. To demonstrate the usefulness of our technique, we perform a large scale evaluation on popular DNNs of source code processing based on multiple state of the art code embedding methods (i.e., Code2vec, Code2seq and CodeBERT). The testing results show that our generated adversarial samples can on average reduce the performance of these DNNs from 5.41 to 9.58 . Through retraining the DNNs with our generated adversarial samples, the robustness of DNN can improve by 23.05 on average. The evaluation results also show that our adversarial test generation strategy has the least negative impact (median of 3.56 ), on the performance of the DNNs for regular test data, compared to the other methods.


Lizard A Large Scale Dataset for Colonic Nuclear Instance Segmentation and Classification. The development of deep segmentation models for computational pathology (CPath) can help foster the investigation of interpretable morphological biomarkers. Yet, there is a major bottleneck in the success of such approaches because supervised deep learning models require an abundance of accurately labelled data. This issue is exacerbated in the field of CPath because the generation of detailed annotations usually demands the input of a pathologist to be able to distinguish between different tissue constructs and nuclei. Manually labelling nuclei may not be a feasible approach for collecting large scale annotated datasets, especially when a single image region can contain thousands of different cells. However, solely relying on automatic generation of annotations will limit the accuracy and reliability of ground truth. Therefore, to help overcome the above challenges, we propose a multi stage annotation pipeline to enable the collection of large scale datasets for histology image analysis, with pathologist in the loop refinement steps. Using this pipeline, we generate the largest known nuclear instance segmentation and classification dataset, containing nearly half a million labelled nuclei in H E stained colon tissue. We have released the dataset and encourage the research community to utilise it to drive forward the development of downstream cell based models in CPath.


Minimal log discrepancies of regularity one. In this article, we use the cone of nef curves to study minimal log discrepancies. The first result is an improvement of the nef cone theorem in the case of log Calabi Yau dlt pairs. Then, we prove that the ascending chain condition for n dimensional minimal log discrepancies of regularity one holds around zero. Furthermore, we show that there exists an upper bound for the minimal log discrepancy of any n dimensional klt singularity of regularity one.


Cauchy Problem of Stochastic Kinetic Equations. In this paper we establish the optimal regularity estimates for the Cauchy problem of stochastic kinetic equations with random coefficients in anisotropic Besov spaces. As applications, we study the nonlinear filtering problem for a degenerate diffusion process, and obtain the existence and regularity of conditional probability densities under few assumptions. Moreover, we also show the well posedness for a class of super linear growth stochastic kinetic equations driven by velocity time white noises, as well as a kinetic version of Parabolic Anderson Model with measure as initial values.


What is the appropriate speed for an autonomous vehicle? Designing a Pedestrian Aware Contextual Speed Controller. Social acceptance is a major hurdle for autonomous vehicle technology, central to which is ensuring both passengers and nearby pedestrians feel safe. This idea of feeling safe' and perceived safety is highly subjective and rooted in human intuition. As such, traditional analytical approaches to autonomous navigation often fail to cater for the social expectations of individuals. Therefore, this paper proposes an approach to capture the complexity of social expectations and integrate this complexity into a 3 layered Contextual Speed Controller. The layers were the legal road speed limit, the socially acceptable speed given the number of nearby pedestrians, and the socially acceptable speed based on proximity to nearby pedestrians. An implementation of this layered approach was tested in areas of both low and high vehicle pedestrian interactions. From the experiments conducted, the lower two layers were seen working in tandem to modulate the vehicle speed to appropriate levels that mimicked conservative human driver behaviour. In summary, this work quantified the relationship between pedestrian context and socially acceptable vehicle speeds, allowing for more perceivably safe autonomous driving. Furthermore, the need for different driving schemes for navigating different road environments was identified.


New data structure for univariate polynomial approximation and applications to root isolation, numerical multipoint evaluation, and other problems. We present a new data structure to approximate accurately and efficiently a polynomial f of degree d given as a list of coefficients. Its properties allow us to improve the state of the art bounds on the bit complexity for the problems of root isolation and approximate multipoint evaluation. This data structure also leads to a new geometric criterion to detect ill conditioned polynomials, implying notably that the standard condition number of the zeros of a polynomial is at least exponential in the number of roots of modulus less than 1 2 or greater than 2 .Given a polynomial f of degree d with f 1 leq 2 tau for tau geq 1 , isolating all its complex roots or evaluating it at d points can be done with a quasi linear number of arithmetic operations. However, considering the bit complexity, the state of the art algorithms require at least d 3 2 bit operations even for well conditioned polynomials and when the accuracy required is low. Given a positive integer m , we can compute our new data structure and evaluate f at d points in the unit disk with an absolute error less than 2 m in widetilde O(d( tau m)) bit operations, where widetilde O( cdot) means that we omit logarithmic factors. We also show that if kappa is the absolute condition number of the zeros of f , then we can isolate all the roots of f in widetilde O(d( tau log kappa)) bit operations. Moreover, our algorithms are simple to implement. For approximating the complex roots of a polynomial, we implemented a small prototype in verb Python NumPy that is an order of magnitude faster than the state of the art solver verb MPSolve for high degree polynomials with random coefficients.


This Person (Probably) Exists. Identity Membership Attacks Against GAN Generated Faces. Recently, generative adversarial networks (GANs) have achieved stunning realism, fooling even human observers. Indeed, the popular tongue in cheek website small url http thispersondoesnotexist.com , taunts users with GAN generated images that seem too real to believe. On the other hand, GANs do leak information about their training data, as evidenced by membership attacks recently demonstrated in the literature. In this work, we challenge the assumption that GAN faces really are novel creations, by constructing a successful membership attack of a new kind. Unlike previous works, our attack can accurately discern samples sharing the same identity as training samples without being the same samples. We demonstrate the interest of our attack across several popular face datasets and GAN training procedures. Notably, we show that even in the presence of significant dataset diversity, an over represented person can pose a privacy concern.


Big Data Science Over the Past Web. Web archives preserve unique and historically valuable information. They hold a record of past events and memories published by all kinds of people, such as journalists, politicians and ordinary people who have shared their testimony and opinion on multiple subjects. As a result, researchers such as historians and sociologists have used web archives as a source of information to understand the recent past since the early days of the World Wide Web. The typical way to extract knowledge from a web archive is by using its search functionalities to find and analyse historical content. This can be a slow and superficial process when analysing complex topics, due to the huge amount of data that web archives have been preserving over time. Big data science tools can cope with this order of magnitude, enabling researchers to automatically extract meaningful knowledge from the archived data. This knowledge helps not only to explain the past but also to predict the future through the computational modelling of events and behaviours. Currently, there is an immense landscape of big data tools, machine learning frameworks and deep learning algorithms that significantly increase the scalability and performance of several computational tasks, especially over text, image and audio. Web archives have been taking advantage of this panoply of technologies to provide their users with more powerful tools to explore and exploit historical data. This chapter presents several examples of these tools and gives an overview of their application to support longitudinal studies over web archive collections.


Adaptive Contrast for Image Regression in Computer Aided Disease Assessment. Image regression tasks for medical applications, such as bone mineral density (BMD) estimation and left ventricular ejection fraction (LVEF) prediction, play an important role in computer aided disease assessment. Most deep regression methods train the neural network with a single regression loss function like MSE or L1 loss. In this paper, we propose the first contrastive learning framework for deep image regression, namely AdaCon, which consists of a feature learning branch via a novel adaptive margin contrastive loss and a regression prediction branch. Our method incorporates label distance relationships as part of the learned feature representations, which allows for better performance in downstream regression tasks. Moreover, it can be used as a plug and play module to improve performance of existing regression methods. We demonstrate the effectiveness of AdaCon on two medical image regression tasks, ie, bone mineral density estimation from X ray images and left ventricular ejection fraction prediction from echocardiogram videos. AdaCon leads to relative improvements of 3.3 and 5.9 in MAE over state of the art BMD estimation and LVEF prediction methods, respectively.


A Conversational Agent System for Dietary Supplements Use. Dietary supplements (DS) have been widely used by consumers, but the information around the efficacy and safety of DS is disparate or incomplete, thus creating barriers for consumers to find information effectively. Conversational agent (CA) systems have been applied to the healthcare domain, but there is no such a system to answer consumers regarding DS use, although widespread use of DS. In this study, we develop the first CA system for DS use


Hardware efficient Residual Networks for FPGAs. Residual networks (ResNets) employ skip connections in their networks reusing activations from previous layers to improve training convergence, but these skip connections create challenges for hardware implementations of ResNets. The hardware must either wait for skip connections to be processed before processing more incoming data or buffer them elsewhere. Without skip connections, ResNets would be more hardware efficient. Thus, we present the teacher student learning method to gradually prune away all of a ResNet's skip connections, constructing a network we call NonResNet. We show that when implemented for FPGAs, NonResNet decreases ResNet's BRAM utilization by 9 and LUT utilization by 3 and increases throughput by 5 .


Approximation order of Kolmogorov diameters via L q spectra and applications to polyharmonic operators. We establish a connection between the L q spectrum of a Borel measure nu and the approximation order of Kolmogorov diameters in L nu p in higher dimensions by extending ideas for the one dimensional case as developed by the authors. This leads to improvements of the classical result of Borzov and Birman Solomjak for a broad class of singular measures. As an application, we consider polyharmonic operators and obtain improved upper bounds of the decay rate of their eigenvalues and show connections to the one dimensional Krein Feller operator.


Some model theory of operatorname Th ( mathbb N , cdot) . 'Skolem arithmetic' is the complete theory T of the multiplicative monoid ( mathbb N , cdot) . We give a full characterization of the varnothing definable stably embedded sets of T , showing in particular that, up to the relation of having the same definable closure, there is only one non trivial one the set of squarefree elements. We then prove that T has weak elimination of imaginaries but not elimination of finite imaginaries.


Subgraph Games in the Semi Random Graph Process and Its Generalization to Hypergraphs. The semi random graph process is a single player game that begins with an empty graph on n vertices. In each round, a vertex u is presented to the player independently and uniformly at random. The player then adaptively selects a vertex v and adds the edge uv to the graph. For a fixed monotone graph property, the objective of the player is to force the graph to satisfy this property with high probability in as few rounds as possible. We focus on the problem of constructing a subgraph isomorphic to an arbitrary, fixed graph G . Let omega omega(n) be any function tending to infinity as n to infty . In (Omri Ben Eliezer et al. "Semi random graph process". In Random Structures Algorithms 56.3 (2020), pp. 648 675) it was proved that asymptotically almost surely one can construct G in less than n (d 1) d omega rounds where d ge 2 is the degeneracy of G . It was also proved that the result is sharp for G K d 1 , that is, asymptotically almost surely it takes at least n (d 1) d omega rounds to create K d 1 . Moreover, the authors conjectured that their general upper bound is sharp for all graphs G . We prove this conjecture here. We also consider a natural generalization of the process to s uniform hypergraphs, the semi random hypergraph process in which r ge 1 vertices are presented at random, and the player then selects s r ge 1 vertices to form an edge of size s . Our results for graphs easily generalize to hypergraphs when r 1 the threshold for constructing a fixed s uniform hypergraph G is, again, determined by the degeneracy of G . However, new challenges are mounting when r ge 2 thresholds are not even known for complete hypergraphs. We provide bounds for this family and determine thresholds for some sparser hypergraphs.


Simulations of positive streamers in air in different electric fields steady motion of solitary streamer heads and the stability field. We simulate and characterize positive streamers in ambient air in homogeneous background electric fields from 4.5 to 26 kV cm in a 4 cm gap. They can accelerate or decelerate depending on the background electric field. Many experiments have shown that a streamer keeps propagating in a stable manner in the so called stability field of 4.5 to 5 kV cm. Our fluid streamer simulations in STP air show that (1) In a homogeneous field larger than 4.675 kV cm, a single streamer accelerates, and in a lower field, it decelerates and eventually stagnates with a small radius and very high field enhancement. (2) In a field of 4.675 kV cm, the streamer head propagates with an approximately constant velocity of 6.7 x 10 4 m s and an optical radius of 55 mu m over distances of several centimeters as a stable coherent structure. These values for the radius and velocity agree well with measurements of so called minimal streamers. (3) Behind the uniformly translating streamer head, the channel conductivity decreases due to electron attachment and recombination, and the electric field returns to its background value about 1 cm behind the head. The propagation behavior of the solitary streamer agrees with the original definition of the stability field, which is the homogeneous field in which a streamer can propagate with a constant speed and shape.


Stabilizing Error Correction Codes for Control over Erasure Channels. We propose (k,k') stabilizing codes, which is a type of delayless error correction codes that are useful for control over networks with erasures. For each input symbol, k output symbols are generated by the stabilizing code. Receiving at least k' of these outputs guarantees stability. Thus, both the system to be stabilized and the channel is taken into account in the design of the erasure codes. Receiving more than k' outputs further improves the performance of the system. In the case of i.i.d. erasures, we further demonstrate that the erasure code can be constructed such that stability is achieved if on average at least k' output symbols are received. Our focus is on LTI systems, and we construct codes based on independent encodings and multiple descriptions. Stability is assessed via Markov jump linear system theory. The theoretical efficiency and performance of the codes are assessed, and their practical performances are demonstrated in a simulation study. There is a significant gain over other delayless codes such as repetition codes.


Nonlinear Thomson scattering with ponderomotive control. In nonlinear Thomson scattering, a relativistic electron reflects and re radiates the photons of a laser pulse, converting optical light to x rays or beyond. While this extreme frequency conversion offers a promising source for probing high energy density materials and driving uncharted regimes of nonlinear quantum electrodynamics, conventional nonlinear Thomson scattering has inherent tradeoffs in its scaling with laser intensity. Here we discover that the ponderomotive control afforded by spatiotemporal pulse shaping enables novel regimes of nonlinear Thomson scattering that substantially enhance the scaling of the radiated power, emission angle, and frequency with laser intensity. By appropriately setting the velocity of the intensity peak, a spatiotemporally shaped pulse can increase the power radiated by orders of magnitude. The enhanced scaling with laser intensity allows for operation at significantly lower electron energies and can eliminate the need for a high energy electron accelerator.


Active learning with MaskAL reduces annotation effort for training Mask R CNN. The generalisation performance of a convolutional neural network (CNN) is influenced by the quantity, quality, and variety of the training images. Training images must be annotated, and this is time consuming and expensive. The goal of our work was to reduce the number of annotated images needed to train a CNN while maintaining its performance. We hypothesised that the performance of a CNN can be improved faster by ensuring that the set of training images contains a large fraction of hard to classify images. The objective of our study was to test this hypothesis with an active learning method that can automatically select the hard to classify images. We developed an active learning method for Mask Region based CNN (Mask R CNN) and named this method MaskAL. MaskAL involved the iterative training of Mask R CNN, after which the trained model was used to select a set of unlabelled images about which the model was most uncertain. The selected images were then annotated and used to retrain Mask R CNN, and this was repeated for a number of sampling iterations. In our study, MaskAL was compared to a random sampling method on a broccoli dataset with five visually similar classes. MaskAL performed significantly better than the random sampling. In addition, MaskAL had the same performance after sampling 900 images as the random sampling had after 2300 images. Compared to a Mask R CNN model that was trained on the entire training set (14,000 images), MaskAL achieved 93.9 of that model's performance with 17.9 of its training data. The random sampling achieved 81.9 of that model's performance with 16.4 of its training data. We conclude that by using MaskAL, the annotation effort can be reduced for training Mask R CNN on a broccoli dataset with visually similar classes. Our software is available on https github.com pieterblok maskal.


Streaming VR Games to the Broad Audience A Comparison of the First Person and Third Person Perspectives. The spectatorship experience for virtual reality (VR) games differs strongly from its non VR precursor. When watching non VR games on platforms such as Twitch, spectators just see what the player sees, as the physical interaction is mostly unimportant for the overall impression. In VR, the immersive full body interaction is a crucial part of the player experience. Hence, content creators, such as streamers, often rely on green screens or similar solutions to offer a mixed reality third person view to disclose their full body actions. Our work compares the most popular realizations of the first person and the third person perspective in an online survey (N 217) with three different VR games. Contrary to the current trend to stream in third person, our key result is that most viewers prefer the first person version, which they attribute mostly to the better focus on in game actions and higher involvement. Based on the study insights, we provide design recommendations for both perspectives.


Greedy GQ with Variance Reduction Finite time Analysis and Improved Complexity. Greedy GQ is a value based reinforcement learning (RL) algorithm for optimal control. Recently, the finite time analysis of Greedy GQ has been developed under linear function approximation and Markovian sampling, and the algorithm is shown to achieve an epsilon stationary point with a sample complexity in the order of mathcal O ( epsilon 3 ) . Such a high sample complexity is due to the large variance induced by the Markovian samples. In this paper, we propose a variance reduced Greedy GQ (VR Greedy GQ) algorithm for off policy optimal control. In particular, the algorithm applies the SVRG based variance reduction scheme to reduce the stochastic variance of the two time scale updates. We study the finite time convergence of VR Greedy GQ under linear function approximation and Markovian sampling and show that the algorithm achieves a much smaller bias and variance error than the original Greedy GQ. In particular, we prove that VR Greedy GQ achieves an improved sample complexity that is in the order of mathcal O ( epsilon 2 ) . We further compare the performance of VR Greedy GQ with that of Greedy GQ in various RL experiments to corroborate our theoretical findings.


Kato's irreducibility criterion for Kac Moody groups over local fields. In 2014, Braverman, Kazhdan, Patnaik and Bardy Panse, Gaussent and Rousseau associated Iwahori Hecke algebras to Kac Moody groups over non Archimedean local fields. In a previous paper, we defined and studied their principal series representations. In 1982, Kato provided an irreducibility criterion for these representations, in the reductive case. We had obtained partially this criterion in the Kac Moody case. In this paper, we prove this criterion in the Kac Moody case.


MetaTune Meta Learning Based Cost Model for Fast and Efficient Auto tuning Frameworks. Deep learning compiler frameworks are gaining ground as a more portable back end for deep learning applications on increasingly diverse hardware. However, they face the daunting challenge of matching performance offered by hand tuned target specific libraries. While auto tuning frameworks with statistical cost models can provide dynamic and efficient code optimization, they suffer from large space exploration and cost model training overheads. This paper proposes MetaTune, a meta learning based cost model that more quickly and accurately predicts the performance of optimized codes with pre trained model parameters. MetaTune encodes convolution kernel codes as structurally similar graphs to facilitate meta learning, meta trains a GNN model with a very small input data set, and then predicts optimization parameters for unseen convolution operations with varying sizes and structures during compilation. The resulting framework with MetaTune provides 8 to 13 better inference time on average for four CNN models with comparable or lower optimization time while outperforming transfer learning by 10 in cross platform cases.


Learning to Act and Observe in Partially Observable Domains. We consider a learning agent in a partially observable environment, with which the agent has never interacted before, and about which it learns both what it can observe and how its actions affect the environment. The agent can learn about this domain from experience gathered by taking actions in the domain and observing their results. We present learning algorithms capable of learning as much as possible (in a well defined sense) both about what is directly observable and about what actions do in the domain, given the learner's observational constraints. We differentiate the level of domain knowledge attained by each algorithm, and characterize the type of observations required to reach it. The algorithms use dynamic epistemic logic (DEL) to represent the learned domain information symbolically. Our work continues that of Bolander and Gierasimczuk (2015), which developed DEL based learning algorithms based to learn domain information in fully observable domains.


Low Complexity Probing via Finding Subnetworks. The dominant approach in probing neural networks for linguistic properties is to train a new shallow multi layer perceptron (MLP) on top of the model's internal representations. This approach can detect properties encoded in the model, but at the cost of adding new parameters that may learn the task directly. We instead propose a subtractive pruning based probe, where we find an existing subnetwork that performs the linguistic task of interest. Compared to an MLP, the subnetwork probe achieves both higher accuracy on pre trained models and lower accuracy on random models, so it is both better at finding properties of interest and worse at learning on its own. Next, by varying the complexity of each probe, we show that subnetwork probing Pareto dominates MLP probing in that it achieves higher accuracy given any budget of probe complexity. Finally, we analyze the resulting subnetworks across various tasks to locate where each task is encoded, and we find that lower level tasks are captured in lower layers, reproducing similar findings in past work.


Ranking Scientific Papers Using Preference Learning. Peer review is the main quality control mechanism in academia. Quality of scientific work has many dimensions coupled with the subjective nature of the reviewing task, this makes final decision making based on the reviews and scores therein very difficult and time consuming. To assist with this important task, we cast it as a paper ranking problem based on peer review texts and reviewer scores. We introduce a novel, multi faceted generic evaluation framework for making final decisions based on peer reviews that takes into account effectiveness, efficiency and fairness of the evaluated system. We propose a novel approach to paper ranking based on Gaussian Process Preference Learning (GPPL) and evaluate it on peer review data from the ACL 2018 conference. Our experiments demonstrate the superiority of our GPPL based approach over prior work, while highlighting the importance of using both texts and review scores for paper ranking during peer review aggregation.


A generalized inf sup stable variational formulation for the wave equation. In this paper, we consider a variational formulation for the Dirichlet problem of the wave equation with zero boundary and initial conditions, where we use integration by parts in space and time. To prove unique solvability in a subspace of H 1(Q ) with Q being the space time domain, the classical assumption is to consider the right hand side f in L 2(Q) . Here, we analyze a generalized setting of this variational formulation, which allows us to prove unique solvability also for f being in the dual space of the test space, i.e., the solution operator is an isomorphism between the ansatz space and the dual of the test space. This new approach is based on a suitable extension of the ansatz space to include the information of the differential operator of the wave equation at the initial time t 0 . These results are of utmost importance for the formulation and numerical analysis of unconditionally stable space time finite element methods, and for the numerical analysis of boundary element methods to overcome the well known norm gap in the analysis of boundary integral operators.


A counterexample to a Gr "obner approach for noetherianity of the twisted commutative algebra rm Sym ( rm Sym 2( mathbf C infty)) . We resolve an open question posed by the authors of arXiv 1501.06925v2 in 2015 concerning a Gr "obner theoretic approach for the noetherianity of the twisted commutative algebra rm Sym ( rm Sym 2( mathbf C infty)) . We provide a negative answer to their question by producing an explicit antichain. In doing so, we establish a connection to well studied posets of graphs under the subgraph and induced subgraph relation. We then analyze this connection to suggest future paths of investigation, for example a deeper study of initial ideals in twisted commutative algebras.


A corrected strategy for proving no finite variable axiomatisation exists for RRA. We show that if for all finite c there is a pair of non isomorphic finite digraphs satisfying some additional conditions, one of which is that they cannot be distinguished in a certain c colour node colouring game, then there can be no axiomatisation of the class of representable relation algebras in any first order theory of arbitrary quantifier depth using only finitely many variables. This corrects the proposed strategy of Hirsch and Hodkinson, emph Relation algebras by games , North Holland (2002), Problem 1. However, even for c 2 , no pair of non isomorphic graphs indistinguishable in the game is currently known.


Tailoring Instantaneous Time Mirrors for Time Reversal Focusing in Absorbing Media. The time reversal symmetry of the wave equation allows wave refocusing back at the source. However, this symmetry does not hold in lossy media. We present a new strategy to compensate wave amplitude losses due to attenuation. The strategy leverages the instantaneous time mirror (ITM) which generates reversed waves by a sudden disruption of the medium properties. We create a heterogeneous ITM whose disruption is unequal throughout the space to create waves of different amplitude. The time reversed waves can then cope with different attenuation paths as typically seen in heterogeneous and lossy environments. We consider an environment with biological tissues and apply the strategy to a two dimensional digital human phantom from the abdomen. A stronger disruption is introduced where forward waves suffer a history of higher attenuation, with a weaker disruption elsewhere. Computer simulations show heterogeneous ITM is a promising technique to improve time reversal refocusing in heterogeneous, lossy, and dispersive spaces.


Semi Supervised Action Recognition with Temporal Contrastive Learning. Learning to recognize actions from only a handful of labeled videos is a challenging problem due to the scarcity of tediously collected activity labels. We approach this problem by learning a two pathway temporal contrastive model using unlabeled videos at two different speeds leveraging the fact that changing video speed does not change an action. Specifically, we propose to maximize the similarity between encoded representations of the same video at two different speeds as well as minimize the similarity between different videos played at different speeds. This way we use the rich supervisory information in terms of time' that is present in otherwise unsupervised pool of videos. With this simple yet effective strategy of manipulating video playback rates, we considerably outperform video extensions of sophisticated state of the art semi supervised image recognition methods across multiple diverse benchmark datasets and network architectures. Interestingly, our proposed approach benefits from out of domain unlabeled videos showing generalization and robustness. We also perform rigorous ablations and analysis to validate our approach. Project page https cvir.github.io TCL .


The stable trace formula for Shimura varieties of abelian type. We express the Frobenius Hecke traces on the compactly supported cohomology of a Shimura variety of abelian type in terms of elliptic parts of stable Arthur Selberg trace formulas for the endoscopic groups. This confirms predictions of Langlands and Kottwitz at primes where the level is hyperspecial.


XBNet An Extremely Boosted Neural Network. Neural networks have proved to be very robust at processing unstructured data like images, text, videos, and audio. However, it has been observed that their performance is not up to the mark in tabular data hence tree based models are preferred in such scenarios. A popular model for tabular data is boosted trees, a highly efficacious and extensively used machine learning method, and it also provides good interpretability compared to neural networks. In this paper, we describe a novel architecture XBNet, which tries to combine tree based models with that of neural networks to create a robust architecture trained by using a novel optimization technique, Boosted Gradient Descent for Tabular Data which increases its interpretability and performance.


L function for text Sp (4) times text GL (2) via a non unique model. We prove a conjecture of Ginzburg and Soudry on an integral representation for the tensor product partial L function for text Sp 4 times text GL 2 , which is derived from the twisted doubling method of Cai, Friedberg, Ginzburg, and Kaplan. We show that the integral unfolds to a non unique model and analyze it using the New Way method of Piatetski Shapiro and Rallis. We also prove certain result on the archimedean generalized Kirillov model for text GL n( mathbb R ) and text GL n( mathbb C ) .


COVID 19 Vaccine Hesitancy on Social Media Building a Public Twitter Dataset of Anti vaccine Content, Vaccine Misinformation and Conspiracies. False claims about COVID 19 vaccines can undermine public trust in ongoing vaccination campaigns, thus posing a threat to global public health. Misinformation originating from various sources has been spreading online since the beginning of the COVID 19 pandemic. In this paper, we present a dataset of Twitter posts that exhibit a strong anti vaccine stance. The dataset consists of two parts a) a streaming keyword centered data collection with more than 1.8 million tweets, and b) a historical account level collection with more than 135 million tweets. The former leverages the Twitter streaming API to follow a set of specific vaccine related keywords starting from mid October 2020. The latter consists of all historical tweets of 70K accounts that were engaged in the active spreading of anti vaccine narratives. We present descriptive analyses showing the volume of activity over time, geographical distributions, topics, news sources, and inferred account political leaning. This dataset can be used in studying anti vaccine misinformation on social media and enable a better understanding of vaccine hesitancy. In compliance with Twitter's Terms of Service, our anonymized dataset is publicly available at https github.com gmuric avax tweets dataset


Adaptive Large Neighborhood Search for Vehicle Routing Problems with Transshipment Facilities Arising in City Logistics. In this paper, we investigate vehicle routing problems with third party transshipment facilities that arise in the context of city logistics. Contrary to classical vehicle routing problems, where each customer request is delivered directly to its destination, the problems considered in this paper feature the alternative possibility of delivering customer requests to third party transshipment facilities, such as urban consolidation centers, for a fee. We present an adaptive large neighborhood search with an embedded random variable neighborhood descent as a local search component and a set partitioning problem for the recombination of routes to solve various versions of the problem. Thereby, we consider location dependent time windows as well as heterogeneous fleets and propose several new procedures that consider transshipment facilities within the components of our adaptive large neighborhood search. The proposed method is tested on benchmark instances from the literature as well as newly created benchmark instances. It shows promising results, leading to multiple improvements over existing algorithms from the literature. Moreover, a real world study is presented to gain managerial insights on the impact of transshipment fees, order size, and heterogeneous fleets on the transshipment decisions.


Shape of filling systole subspace in surface moduli space and critical points of systole function. This paper studies the space X g subset mathcal M g consisting of surfaces with filling systoles and its subset, critical points of the systole function. In the first part, we obtain a surface with Teichm "uller distance frac 1 5 log log g to X g and in the second and third part, prove that most points in mathcal M g have Teichm "uller distance frac 1 5 log log g to X g and Weil Petersson distance 0.6521( sqrt log g sqrt 7 log log g ) respectively.Therefore we prove that the radius r neighborhood of X g is not able to cover the thick part of mathcal M g for any fixed r 0 . In last two parts, we get critical points with small and large (comparable to diameter of thick part of mathcal M g ) distance respectively.


Forecasting of COVID 19 Cases, Using an Evolutionary Neural Architecture Search Approach. In late 2019, COVID 19, a severe respiratory disease, emerged, and since then, the world has been facing a deadly pandemic caused by it. This ongoing pandemic has had a significant effect on different aspects of societies. The uncertainty around the number of daily cases made it difficult for decision makers to control the outbreak. Deep Learning models have proved that they can come in handy in many real world problems such as healthcare ones. However, they require a lot of data to learn the features properly and output an acceptable solution. Since COVID 19 has been a lately emerged disease, there was not much data available, especially in the first stage of the pandemic, and this shortage of data makes it challenging to design an optimized model. To overcome these problems, we first introduce a new dataset with augmented features and then forecast COVID 19 cases with a new approach, using an evolutionary neural architecture search with Binary Bat Algorithm (BBA) to generate an optimized deep recurrent network. Finally, to show our approach's effectiveness, we conducted a comparative study on Iran's COVID 19 daily cases. The results prove our approach's capability to generate an accurate deep architecture to forecast the pandemic cases, even in the early stages with limited data.


Trav SHACL Efficiently Validating Networks of SHACL Constraints. Knowledge graphs have emerged as expressive data structures for Web data. Knowledge graph potential and the demand for ecosystems to facilitate their creation, curation, and understanding, is testified in diverse domains, e.g., biomedicine. The Shapes Constraint Language (SHACL) is the W3C recommendation language for integrity constraints over RDF knowledge graphs. Enabling quality assements of knowledge graphs, SHACL is rapidly gaining attention in real world scenarios. SHACL models integrity constraints as a network of shapes, where a shape contains the constraints to be fullfiled by the same entities. The validation of a SHACL shape schema can face the issue of tractability during validation. To facilitate full adoption, efficient computational methods are required. We present Trav SHACL, a SHACL engine capable of planning the traversal and execution of a shape schema in a way that invalid entities are detected early and needless validations are minimized. Trav SHACL reorders the shapes in a shape schema for efficient validation and rewrites target and constraint queries for the fast detection of invalid entities. Trav SHACL is empirically evaluated on 27 testbeds executed against knowledge graphs of up to 34M triples. Our experimental results suggest that Trav SHACL exhibits high performance gradually and reduces validation time by a factor of up to 28.93 compared to the state of the art.


Automatic Construction of Enterprise Knowledge Base. In this paper, we present an automatic knowledge base construction system from large scale enterprise documents with minimal efforts of human intervention. In the design and deployment of such a knowledge mining system for enterprise, we faced several challenges including data distributional shift, performance evaluation, compliance requirements and other practical issues. We leveraged state of the art deep learning models to extract information (named entities and definitions) at per document level, then further applied classical machine learning techniques to process global statistical information to improve the knowledge base. Experimental results are reported on actual enterprise documents. This system is currently serving as part of a Microsoft 365 service.


HR RCNN Hierarchical Relational Reasoning for Object Detection. Incorporating relational reasoning in neural networks for object recognition remains an open problem. Although many attempts have been made for relational reasoning, they generally only consider a single type of relationship. For example, pixel relations through self attention (e.g., non local networks), scale relations through feature fusion (e.g., feature pyramid networks), or object relations through graph convolutions (e.g., reasoning RCNN). Little attention has been given to more generalized frameworks that can reason across these relationships. In this paper, we propose a hierarchical relational reasoning framework (HR RCNN) for object detection, which utilizes a novel graph attention module (GAM). This GAM is a concise module that enables reasoning across heterogeneous nodes by operating on the graph edges directly. Leveraging heterogeneous relationships, our HR RCNN shows great improvement on COCO dataset, for both object detection and instance segmentation.


Reinforcement learning based control of confined cylinder wakes with stability analyses. This work studies the application of a reinforcement learning based (RL) flow control strategy to the flow past a cylinder confined between two walls in order to suppress vortex shedding. The control action is blowing and suction of two synthetic jets on the cylinder. The theme of this study is to investigate how to use and embed physical information of the flow in the RL based control. First, global linear stability and sensitivity analyses based on the time mean flow and the steady flow (which is a solution to the Navier Stokes equations) are conducted in a range of blockage ratios and Reynolds numbers. It is found that the most sensitive region in the wake extends itself when either parameter increases in the parameter range we investigated here. Then, we utilise these physical results to help design RL based control policies. We find that the controlled wake converges to the unstable steady base flow, where the vortex shedding can be successfully suppressed. A persistent oscillating control seems necessary to maintain this unstable state. The RL algorithm is able to outperform a gradient based optimisation method (optimised in a certain period of time) in the long run. Furthermore, when the flow stability information is embedded in the reward function to penalise the instability, the controlled flow may become more stable. Finally, according to the sensitivity analyses, the control is most efficient when the probes are placed in the most sensitive region. The control can be successful even when few probes are properly placed in this manner.


Generating and Blending Game Levels via Quality Diversity in the Latent Space of a Variational Autoencoder. Several works have demonstrated the use of variational autoencoders (VAEs) for generating levels in the style of existing games and blending levels across different games. Further, quality diversity (QD) algorithms have also become popular for generating varied game content by using evolution to explore a search space while focusing on both variety and quality. To reap the benefits of both these approaches, we present a level generation and game blending approach that combines the use of VAEs and QD algorithms. Specifically, we train VAEs on game levels and run the MAP Elites QD algorithm using the learned latent space of the VAE as the search space. The latent space captures the properties of the games whose levels we want to generate and blend, while MAP Elites searches this latent space to find a diverse set of levels optimizing a given objective such as playability. We test our method using models for 5 different platformer games as well as a blended domain spanning 3 of these games. We refer to using MAP Elites for blending as Blend Elites. Our results show that MAP Elites in conjunction with VAEs enables the generation of a diverse set of playable levels not just for each individual game but also for the blended domain while illuminating game specific regions of the blended latent space.


Stochastic Gradient Descent on Nonconvex Functions with General Noise Models. Stochastic Gradient Descent (SGD) is a widely deployed optimization procedure throughout data driven and simulation driven disciplines, which has drawn a substantial interest in understanding its global behavior across a broad class of nonconvex problems and noise models. Recent analyses of SGD have made noteworthy progress in this direction, and these analyses have innovated important and insightful new strategies for understanding SGD. However, these analyses often have imposed certain restrictions (e.g., convexity, global Lipschitz continuity, uniform Holder continuity, expected smoothness, etc.) that leave room for innovation. In this work, we address this gap by proving that, for a rather general class of nonconvex functions and noise models, SGD's iterates either diverge to infinity or converge to a stationary point with probability one. By further restricting to globally Holder continuous functions and the expected smoothness noise model, we prove that regardless of whether the iterates diverge or remain finite the norm of the gradient function evaluated at SGD's iterates converges to zero with probability one and in expectation. As a result of our work, we broaden the scope of nonconvex problems and noise models to which SGD can be applied with rigorous guarantees of its global behavior.


Topology optimized ultra compact all optical logic devices on silicon photonic platforms. The realization of all optical integration and optical computing has always been our goal. One of the most significant challenges is to make integrated all optical logic devices as small as possible. Here, we report the implementation of ultra compact all optical logic devices and integrated chips on silicon photonic platforms by topology optimization. The footprint for the fabricated all optical logic gates with XOR and OR functions is only 1.3 1.3 mu m2 ( 0.84 lambda 0.84 lambda ), that are the smallest all optical dielectric logic devices ever verified in experiments in the optical communication range. The ultra low loss of the optical signal is also demonstrated experimentally ( 0.96dB). Furthermore, an integrated chip containing seven major logic gates (AND, OR, NOT, NAND, NOR, XOR, and XNOR) and a half adder is fabricated, where the associated footprint is only 1.3 4.5 mu m2. Our work opens up a new path towards practical all optical integration and optical computing.


The Effect of Social Media on Shaping Individuals Opinion Formation. In this paper, the influence of the social media on the opinion formation process is modeled during an election campaign. In the proposed model, peer to peer interactions and targeted online propaganda messages are assumed to be the driving forces of the opinion formation dynamics. The conviction power of the targeted messages is based on the collected and processed private information. In this work, the model is based on an artificial society, initially evenly divided between two parties. The bounded confidence model governs peer to peer interactions with a value of confidence parameter which leads to consensus. The targeted messages which was modeled as an external interacting source of information convert some weakly committed individuals to break this evenness. Both parties use the same methods for propaganda. It is shown that a very small external influence break the evenness of the opinion distribution which play significant role in the election results. Obtained opinion fluctuation time series have close resemblance with the actual election poll results.


A representation formula for the probability density in stochastic dynamical systems with memory. Marcus stochastic delay differential equations (SDDEs) are often used to model stochastic dynamical systems with memory in science and engineering. Since no infinitesimal generators exist for Marcus SDDEs due to the non Markovian property, conventional Fokker Planck equations, which govern the evolution behavior of density, are not available for Marcus SDDEs. In this paper, we identify the Marcus SDDE with some Marcus stochastic differential equation (SDE) without delays but subject to extra constraints. This provides an efficient way to establish existence and uniqueness for the solution, and obtain a representation formula for probability density of the Marcus SDDE. In the formula, the probability density for Marcus SDDE is expressed in terms of that for Marcus SDE without delay.


Construction and bounds for subspace codes. Subspace codes are the q analog of binary block codes in the Hamming metric. Here the codewords are vector spaces over a finite field. They have e.g. applications in random linear network coding, distributed storage, and cryptography. In this chapter we survey known constructions and upper bounds for subspace codes.


Run time Norms Synthesis in Multi Objective Multi Agent Systems. Norms represent behavioural aspects that are encouraged by a social group of agents or the majority of agents in a system. Normative systems enable coordinating synthesised norms of heterogeneous agents in complex multi agent systems autonomously. In real applications, agents have multiple objectives that may contradict each other or contradict the synthesised norms. Therefore, agents need a mechanism to understand the impact of a suggested norm on their objectives and decide whether or not to adopt it. To address these challenges, a utility based norm synthesis (UNS) model is proposed which allows the agents to coordinate their behaviour while achieving their conflicting objectives. UNS proposes a utility based case based reasoning technique, using case based reasoning for run time norm synthesising in a centralised approach, and a utility function derived from the objectives of the system and its operating agents to decide whether or not to adopt a norm. The model is evaluated using a two intersecting roads scenario and the results show its efficacy to optimise multiple objectives while adopting synthesised norms.


Variation of Canonical Height on mathbb P 1 for Fatou points. Let f mathbb P 1 to mathbb P 1 be a map of degree 1 defined over a function field k K(X) , where K is a number field and X is a projective curve over K . For each point a in mathbb P 1(k) satisfying a dynamical stability condition, we prove that the Call Silverman canonical height for specialization f t at point a t , for t in X( overline mathbb Q ) outside a finite set, induces a Weil height on the curve X i.e., we prove the existence of a mathbb Q divisor D D f,a on X so that the function t mapsto hat h f t (a t) h D(t) is bounded on X( overline mathbb Q ) for any choice of Weil height associated to D . We also prove a local version, that the local canonical heights t mapsto hat lambda f t, v (a t) differ from a Weil function for D by a continuous function on X( mathbb C v) , at each place v of the number field K . These results were known for polynomial maps f and all points a in mathbb P 1(k) without the stability hypothesis, and for maps f that are quotients of endomorphisms of elliptic curves E over k . Finally, we characterize our stability condition in terms of the geometry of the induced map tilde f X times mathbb P 1 dashrightarrow X times mathbb P 1 over K and we prove the existence of relative N 'eron models for the pair (f,a) , when a is a Fatou point at a place gamma of k , where the local canonical height hat lambda f, gamma (a) can be computed as an intersection number.


How zealots affect the energy cost for controlling complex social networks. The controllability of complex networks may be applicable for understanding how to control a complex social network, where members share their opinions and influence one another. Previous works in this area have focused on controllability, energy cost, or optimization under the assumption that all nodes are compliant, passing on information neutrally without any preferences. However, the assumption on nodal neutrality should be reassessed, given that in networked social systems, some people may hold fast to their personal beliefs. By introducing some stubborn agents, or zealots, who hold steadfast to their beliefs and seek to influence others, the energy cost needed to control such a network, with neutral and non neutral nodes are calculated and compared against those where there were no zealots. It was found that the presence of zealots alters the energy cost at a quadratic rate with respect to their own fixed beliefs. However, whether or not the zealots' presence increases or decreases the energy cost is affected by the interplay between different parameters such as the zealots' beliefs, number of drivers, final control time regimes, network effects, network dynamics, number and configurations of neutral nodes influenced by the zealots. For example, when a network dynamics is linear but does not have conformity behavior, it could be possible for a contrarian zealot to assist in reducing control energy. With conformity behavior, a contrarian zealot always negatively affects network control by increasing energy cost. The results of this paper suggest caution when modelling real networked social systems with the controllability of networked linear dynamics, since the system dynamical behavior is sensitive to parameter change.


Machine Learning aided Crop Yield Optimization. We present a crop simulation environment with an OpenAI Gym interface, and apply modern deep reinforcement learning (DRL) algorithms to optimize yield. We empirically show that DRL algorithms may be useful in discovering new policies and approaches to help optimize crop yield, while simultaneously minimizing constraining factors such as water and fertilizer usage. We propose that this hybrid plant modeling and data driven approach for discovering new strategies to optimize crop yield may help address upcoming global food demands due to population expansion and climate change.


Solutions of the Loewner equation with combined driving functions. The paper is devoted to the multiple chordal Loewner differential equation with different driving functions on two time intervals. We obtain exact implicit or explicit solutions to the Loewner equations with piecewise constant driving functions and with combined constant and square root driving functions. In both cases, there is an analytical and geometrical description of generated traces.


UTNet A Hybrid Transformer Architecture for Medical Image Segmentation. Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid Transformer architecture that integrates self attention into a convolutional neural network for enhancing medical image segmentation. UTNet applies self attention modules in both encoder and decoder for capturing long range dependency at different scales with minimal overhead. To this end, we propose an efficient self attention mechanism along with relative position encoding that reduces the complexity of self attention operation significantly from O(n 2) to approximate O(n) . A new self attention decoder is also proposed to recover fine grained details from the skipped connections in the encoder. Our approach addresses the dilemma that Transformer requires huge amounts of data to learn vision inductive bias. Our hybrid layer design allows the initialization of Transformer into convolutional networks without a need of pre training. We have evaluated UTNet on the multi label, multi vendor cardiac magnetic resonance imaging cohort. UTNet demonstrates superior segmentation performance and robustness against the state of the art approaches, holding the promise to generalize well on other medical image segmentations.


On the Effects of Data Distortion on Model Analysis and Training. Data modification can introduce artificial information. It is often assumed that the resulting artefacts are detrimental to training, whilst being negligible when analysing models. We investigate these assumptions and conclude that in some cases they are unfounded and lead to incorrect results. Specifically, we show current shape bias identification methods and occlusion robustness measures are biased and propose a fairer alternative for the latter. Subsequently, through a series of experiments we seek to correct and strengthen the community's perception of how distorting data affects learning. Based on our empirical results we argue that the impact of the artefacts must be understood and exploited rather than eliminated.


Cohomogeneity one solitons in Laplacian flow local, smoothly closing and steady solitons. We initiate a systematic study of cohomogeneity one solitons in Bryant's Laplacian flow of closed G 2 structures on a 7 manifold, motivated by the problem of understanding finite time singularities of that flow. Here we focus on solitons with symmetry groups Sp(2) and SU(3) in both cases we prove the existence of continuous families of local cohomogeneity one gradient Laplacian solitons and characterise which of these local solutions extend smoothly over their unique singular orbits. The main questions are then to determine which of these smoothly closing solutions extend to complete solitons and furthermore to understand the asymptotic geometry of these complete solitons. We provide complete answers to both questions in the case of steady solitons. Up to the actions of scaling and discrete symmetries, we show that the set of all smoothly closing SU(3) invariant steady Laplacian solitons defined on a neighbourhood of the zero section of the anti self dual bundle of CP 2 is parametrised by the set of nonnegative reals. An open interval I (0,c) corresponds to complete nontrivial gradient solitons that are asymptotic to the unique SU(3) invariant torsion free G 2 cone. The boundary point 0 of I corresponds to the well known Bryant Salamon asymptotically conical G 2 manifold, while the other boundary point c corresponds to an explicit complete gradient steady soliton with exponential volume growth and novel asymptotic geometry. The open interval (c, oo) consists entirely of incomplete solutions. In addition, we find an explicit complete gradient shrinking soliton on the anti self dual bundle of S 4 and CP 2. Both these shrinkers are asymptotic to closed but non torsion free G 2 cones. Like the nontrivial AC gradient steady solitons on the anti self dual bundle of CP 2, these shrinkers appear to be potential singularity models for finite time singularities of Laplacian flow.


Cluster guided Image Synthesis with Unconditional Models. Generative Adversarial Networks (GANs) are the driving force behind the state of the art in image generation. Despite their ability to synthesize high resolution photo realistic images, generating content with on demand conditioning of different granularity remains a challenge. This challenge is usually tackled by annotating massive datasets with the attributes of interest, a laborious task that is not always a viable option. Therefore, it is vital to introduce control into the generation process of unsupervised generative models. In this work, we focus on controllable image generation by leveraging GANs that are well trained in an unsupervised fashion. To this end, we discover that the representation space of intermediate layers of the generator forms a number of clusters that separate the data according to semantically meaningful attributes (e.g., hair color and pose). By conditioning on the cluster assignments, the proposed method is able to control the semantic class of the generated image. Our approach enables sampling from each cluster by Implicit Maximum Likelihood Estimation (IMLE). We showcase the efficacy of our approach on faces (CelebA HQ and FFHQ), animals (Imagenet) and objects (LSUN) using different pre trained generative models. The results highlight the ability of our approach to condition image generation on attributes like gender, pose and hair style on faces, as well as a variety of features on different object classes.


Lin Lu Yau curvature and diameter of amply regular graphs. By Hall's marriage theorem, we study lower bounds of the Lin Lu Yau curvature of amply regular graphs with girth 3 or 4 under different parameter restrictions. As a consequence, we show that each conference graph has positive Lin Lu Yau curvature. Our approach also provides a geometric proof of a classical diameter estimate for amply regular graphs in the case of girth 4 and some special cases of girth 3 .


RefactorInsight Enhancing IDE Representation of Changes in Git with Refactorings Information. Inspection of code changes is a time consuming task that constitutes a big part of everyday work of software engineers. Existing IDEs provide little information about the semantics of code changes within the file editor view. Therefore developers have to track changes across multiple files, which is a hard task with large codebases. In this paper, we present RefactorInsight, a plugin for IntelliJ IDEA that introduces a smart diff for code changes in Java and Kotlin where refactorings are auto folded and provided with their description, thus allowing users to focus on changes that modify the code behavior like bug fixes and new features. RefactorInsight supports three usage scenarios viewing smart diffs with auto folded refactorings and hints, inspecting refactorings in pull requests and in any specific commit in the project change history, and exploring the refactoring history of methods and classes. The evaluation shows that commit processing time is acceptable on median it is less than 0.2 seconds, which delay does not disrupt developers' IDE workflows. RefactorInsight is available at https github.com JetBrains Research RefactorInsight. The demonstration video is available at https youtu.be 6L2AKQ66nA.


Existence of solutions to reaction cross diffusion systems. Reaction cross diffusion systems are a two species generalization of the porous media equation. These systems play an important role in the mechanical modeling of living tissues and tumor growth. Due to their mixed parabolic hyperbolic structure, even proving the existence of solutions to these equations is challenging. In this paper, we exploit the parabolic structure of the system to prove the strong compactness of the pressure gradient in L2. The key ingredient is the energy dissipation relation, which along with some compensated compactness arguments, allows us to upgrade weak convergence to strong convergence. As a consequence of the pressure compactness, we are able to prove the existence of solutions in a very general setting and pass to the Hele Shaw incompressible limit in any dimension.


Verification of Size Invariance in DNN Activations using Concept Embeddings. The benefits of deep neural networks (DNNs) have become of interest for safety critical applications like medical ones or automated driving. Here, however, quantitative insights into the DNN inner representations are mandatory. One approach to this is concept analysis, which aims to establish a mapping between the internal representation of a DNN and intuitive semantic concepts. Such can be sub objects like human body parts that are valuable for validation of pedestrian detection. To our knowledge, concept analysis has not yet been applied to large object detectors, specifically not for sub parts. Therefore, this work first suggests a substantially improved version of the Net2Vec approach (arXiv 1801.03454) for post hoc segmentation of sub objects. Its practical applicability is then demonstrated on a new concept dataset by two exemplary assessments of three standard networks, including the larger Mask R CNN model (arXiv 1703.06870) (1) the consistency of body part similarity, and (2) the invariance of internal representations of body parts with respect to the size in pixels of the depicted person. The findings show that the representation of body parts is mostly size invariant, which may suggest an early intelligent fusion of information in different size categories.


A note on almost Cohen Macaulay monomial ideals. Let R k x 1, ldots, x n be the polynomial ring in n variables over a field k and let I be a monomial ideal of R . In this paper, we study almost Cohen Macaulay simplicial complex. Moreover, we characterize the almost Cohen Macaulay polymatroidal Veronese type and transversal polymatroidal ideals and furthermore we give some examples.


Circuit Lower Bounds for the p Spin Optimization Problem. We consider the problem of finding a near ground state of a p spin model with Rademacher couplings by means of a low depth circuit. As a direct extension of the authors' recent work Gamarnik, Jagannath, Wein 2020 , we establish that any poly size n output circuit that produces a spin assignment with objective value within a certain constant factor of optimality, must have depth at least log n (2 log log n) as n grows. This is stronger than the known state of the art bounds of the form Omega( log n (k(n) log log n)) for similar combinatorial optimization problems, where k(n) depends on the optimality value. For example, for the largest clique problem k(n) corresponds to the square of the size of the clique Rossman 2010 . At the same time our results are not quite comparable since in our case the circuits are required to produce a solution itself rather than solving the associated decision problem. As in our earlier work, the approach is based on the overlap gap property (OGP) exhibited by random p spin models, but the derivation of the circuit lower bound relies further on standard facts from Fourier analysis on the Boolean cube, in particular the Linial Mansour Nisan Theorem. To the best of our knowledge, this is the first instance when methods from spin glass theory have ramifications for circuit complexity.


Inverse Optimization on Hierarchical Networks An Application to Breast Cancer Clinical Pathways. Clinical pathways are standardized processes that outline the steps required for managing a specific disease. However, patient pathways often deviate from clinical pathways. Measuring the concordance of patient pathways to clinical pathways is important for health system monitoring and informing quality improvement initiatives. In this paper, we develop an inverse optimization based approach to measuring pathway concordance in breast cancer, a complex disease. We capture this complexity in a hierarchical network that models the patient's journey through the health system. A novel inverse shortest path model is formulated and solved on this hierarchical network to estimate arc costs, which are used to form a concordance metric to measure the distance between patient pathways and shortest paths (i.e., clinical pathways). Using real breast cancer patient data from Ontario, Canada, we demonstrate that our concordance metric has a statistically significant association with survival for all breast cancer patient subgroups. We also use it to quantify the extent of patient pathway discordances across all subgroups, finding that patients undertaking additional clinical activities constitute the primary driver of discordance in the population.


MSP Refine Boundary Segmentation via Multiscale Superpixel. In this paper, we propose a simple but effective message passing method to improve the boundary quality for the semantic segmentation result. Inspired by the generated sharp edges of superpixel blocks, we employ superpixel to guide the information passing within feature map. Simultaneously, the sharp boundaries of the blocks also restrict the message passing scope. Specifically, we average features that the superpixel block covers within feature map, and add the result back to each feature vector. Further, to obtain sharper edges and farther spatial dependence, we develop a multiscale superpixel module (MSP) by a cascade of different scales superpixel blocks. Our method can be served as a plug and play module and easily inserted into any segmentation network without introducing new parameters. Extensive experiments are conducted on three strong baselines, namely PSPNet, DeeplabV3, and DeepLabV3 , and four challenging scene parsing datasets including ADE20K, Cityscapes, PASCAL VOC, and PASCAL Context. The experimental results verify its effectiveness and generalizability.


The Pareto Optimal Temporal Aggregation of Energy System Models. The growing share of intermittent renewable energy sources, storage technologies, and the increasing degree of so called sector coupling necessitates optimization based energy system models with high temporal and spatial resolutions, which significantly increases their runtimes and limits their maximum sizes. In order to maintain the computational viability of these models for large scale application cases, temporal aggregation has emerged as a technique for reducing the number of considered time steps by reducing the original time horizon down to fewer, more representative ones. This study presents advanced but generally applicable clustering techniques that allow for ad hoc improvements of state of the art approaches without requiring profound knowledge of the individual energy system model. These improvements comprise the optimal tradeoff between the number of typical days and inner daily temporal resolutions, as well as constituting a representation method that can reproduce the value distribution of the original time series. We prove the superiority of these approaches by applying them to two fundamentally different model types, namely a single node building energy system and a European carbon neutral energy scenario, and benchmark these against state of the art approaches. This is performed for a variety of temporal resolutions, which leads to many hundreds of model runs. The results show that the proposed improvements on current methods strictly dominate the status quo with respect to Pareto optimality in terms of runtime and accuracy. Although a speeding up factor of one magnitude could be achieved using traditional aggregation methods within a cost deviation range of two percent, the algorithms proposed herein achieve this accuracy with a runtime speedup by a factor of two orders of magnitude.


Two lives Compositions of unimodular rows. The paper lays the foundation for the study of unimodular rows using Spin groups. We show that elementary orbits of unimodular rows (of any length n geq 3 ) are equivalent to elementary Spin orbits on the unit sphere. (This bijection is true over all commutative rings). In the special case n 3 , we get an interpretation of the Vaserstein symbol using Spin groups. In addition, we introduce a new composition law that operates on certain subspaces of the underlying quadratic space (using the multiplication in composition algebras). In particular, the special case of split quaternions leads to the composition of unimodular rows (discovered by L. Vaserstein and later generalized by W. van der Kallen). Strikingly, with this approach, we now see the possibility of new orbit structures not only for unimodular rows (using octonion multiplication) but also for more general quadratic spaces.


Magnification independent Histopathological Image Classification with Similarity based Multi scale Embeddings. The classification of histopathological images is of great value in both cancer diagnosis and pathological studies. However, multiple reasons, such as variations caused by magnification factors and class imbalance, make it a challenging task where conventional methods that learn from image label datasets perform unsatisfactorily in many cases. We observe that tumours of the same class often share common morphological patterns. To exploit this fact, we propose an approach that learns similarity based multi scale embeddings (SMSE) for magnification independent histopathological image classification. In particular, a pair loss and a triplet loss are leveraged to learn similarity based embeddings from image pairs or image triplets. The learned embeddings provide accurate measurements of similarities between images, which are regarded as a more effective form of representation for histopathological morphology than normal image features. Furthermore, in order to ensure the generated models are magnification independent, images acquired at different magnification factors are simultaneously fed to networks during training for learning multi scale embeddings. In addition to the SMSE, to eliminate the impact of class imbalance, instead of using the hard sample mining strategy that intuitively discards some easy samples, we introduce a new reinforced focal loss to simultaneously punish hard misclassified samples while suppressing easy well classified samples. Experimental results show that the SMSE improves the performance for histopathological image classification tasks for both breast and liver cancers by a large margin compared to previous methods. In particular, the SMSE achieves the best performance on the BreakHis benchmark with an improvement ranging from 5 to 18 compared to previous methods using traditional features.


Admissible perturbations of a generalized Langford system. Admissible perturbations (i.e., perturbations that do not change the Mironenko reflecting function of the system) are obtained for an autonomous three dimensional quadratic generalized Langford system with five parameters. The obtained non autonomous perturbed systems retain many of the qualitative properties of solutions of the original system. In particular, the instability (in the sense of Lyapunov) of the equilibrium point, the presence of a periodic solution and its asymptotic stability (instability) are proved for perturbed systems. The presence of similar chaotic attractors in the original and perturbed systems is shown by numerical simulation.


Liquid Democracy with Ranked Delegations. Liquid democracy is a novel paradigm for collective decision making that gives agents the choice between casting a direct vote or delegating their vote to another agent. We consider a generalization of the standard liquid democracy setting by allowing agents to specify multiple potential delegates, together with a preference ranking among them. This generalization increases the number of possible delegation paths and enables higher participation rates because fewer votes are lost due to delegation cycles or abstaining agents. In order to implement this generalization of liquid democracy, we need to find a principled way of choosing between multiple delegation paths. In this paper, we provide a thorough axiomatic analysis of the space of delegation rules, i.e., functions assigning a feasible delegation path to each delegating agent. In particular, we prove axiomatic characterizations as well as an impossibility result for delegation rules. We also analyze requirements on delegation rules that have been suggested by practitioners, and introduce novel rules with attractive properties. By performing an extensive experimental analysis on synthetic as well as real world data, we compare delegation rules with respect to several quantitative criteria relating to the chosen paths and the resulting distribution of voting power. Our experiments reveal that delegation rules can be aligned on a spectrum reflecting an inherent trade off between competing objectives.


Hyperparameter tuning of optical neural network classifiers for high order gaussian beams. High order Gaussian beams with multiple propagation modes have been studied for free space optical communications. Fast classification of beams using a diffractive deep neural network, D2NN, has been proposed. D2NN optimization is important because it has numerous hyperparameters, such as interlayer distances and mode combinations. In this study, we classify Hermite Gaussian beams, which are high order Gaussian beams, using a D2NN, and automatically tune one of its hyperparameters known as the interlayer distance. We used the tree structured Parzen estimator, a hyperparameter auto tuning algorithm, to search for the best model. Results indicated that classification accuracy obtained by auto tuning hyperparameters was higher than that obtained by manually setting interlayer distances at equal intervals. In addition, we confirmed that accuracy by auto tuning improves as the number of classification modes increases.


Oscillations and Bifurcation Structure of Reaction Diffusion Model for Cell Polarity Formation. We investigate the oscillatory dynamics and bifurcation structure of a reaction diffusion system with bistable nonlinearity and mass conservation, which was proposed by Otsuji et al, PLoS Comp. Biol. 3 (2007), e108 . The system is a useful model for understanding cell polarity formation. We show that this model exhibits four different spatiotemporal patterns including two types of oscillatory patterns, which can be regarded as cell polarity oscillations with the reversal and non reversal of polarity, respectively. The trigger causing these patterns is a diffusion driven (Turing like) instability. Moreover, we investigate the effects of extracellular signals on the cell polarity oscillations.


RoSmEEry Robotic Simulated Environment for Evaluation and Benchmarking of Semantic Mapping Algorithms. Human robot interaction requires a common understanding of the operational environment, which can be provided by a representation that blends geometric and symbolic knowledge a semantic map. Through a semantic map the robot can interpret user commands by grounding them to its sensory observations. Semantic mapping is the process that builds such a representation. Despite being fundamental to enable cognition and high level reasoning in robotics, semantic mapping is a challenging task due to generalization to different scenarios and sensory data types. In fact, it is difficult to obtain a rich and accurate semantic map of the environment and of the objects therein. Moreover, to date, there are no frameworks that allow for a comparison of the performance in building semantic maps for a given environment. To tackle these issues we design RoSmEEry, a novel framework based on the Gazebo simulator, where we introduce an accessible and ready to use methodology for a systematic evaluation of semantic mapping algorithms. We release our framework, as an open source package, with multiple simulation environments with the aim to provide a general set up to quantitatively measure the performances in acquiring semantic knowledge about the environment.


Rethinking Pseudo Labels for Semi Supervised Object Detection. Recent advances in semi supervised object detection (SSOD) are largely driven by consistency based pseudo labeling methods for image classification tasks, producing pseudo labels as supervisory signals. However, when using pseudo labels, there is a lack of consideration in localization precision and amplified class imbalance, both of which are critical for detection tasks. In this paper, we introduce certainty aware pseudo labels tailored for object detection, which can effectively estimate the classification and localization quality of derived pseudo labels. This is achieved by converting conventional localization as a classification task followed by refinement. Conditioned on classification and localization quality scores, we dynamically adjust the thresholds used to generate pseudo labels and reweight loss functions for each category to alleviate the class imbalance problem. Extensive experiments demonstrate that our method improves state of the art SSOD performance by 1 2 AP on COCO and PASCAL VOC while being orthogonal and complementary to most existing methods. In the limited annotation regime, our approach improves supervised baselines by up to 10 AP using only 1 10 labeled data from COCO.


A Finsler Geodesic Flow on T 2 With Positive Metric Entropy. We use a theorem of P. Berger and D. Turaev to construct an example of a Finsler geodesic flow on the 2 torus with a transverse section, such that its Poincar 'e return map has positive metric entropy. The Finsler metric generating the flow can be chosen to be arbitrarily C infty close to a flat metric.


Fast imaging of single photons in quantum assisted optical interferometers. We describe a new technique of quantum astrometry, which potentially can improve the resolution of optical interferometers by orders of magnitude. The approach requires fast imaging of single photons with sub nanosecond resolution, greatly benefiting from recent advances in photodetection technologies. We also describe results of first proof of principle measurements and lay out future plans.


Coprime automorphisms of finite groups. Let G be a finite group admitting a coprime automorphism alpha of order e . Denote by I G( alpha) the set of commutators g 1 g alpha , where g in G , and by G, alpha the subgroup generated by I G( alpha) . We study the impact of I G( alpha) on the structure of G, alpha . Suppose that each subgroup generated by a subset of I G( alpha) can be generated by at most r elements. We show that the rank of G, alpha is (e,r) bounded. Along the way, we establish several results of independent interest. In particular, we prove that if every element of I G( alpha) has odd order, then G, alpha has odd order too. Further, if every pair of elements from I G( alpha) generates a soluble, or nilpotent, subgroup, then G, alpha is soluble, or respectively nilpotent.


Acoustic resonators symmetry classification and multipolar content of the eigenmodes. Acoustics recently became a versatile platform for discovering novel physical effects and concepts at a relatively simple technological level. On this way, single resonators and the structure of their resonant modes play a central role and define the properties of complex acoustic systems such as acoustic metamaterials, phononic crystals, and topological structures. In this paper, we present a powerful method allowing a qualitative analysis of eigenmodes of resonators in the linear monochromatic acoustic domain based on multipole classification of eigenmodes. Using the apparatus of group theory, we explain and predict the structure of the scattered field knowing only the symmetry group of the resonator by connecting the multipolar content of incident and scattered fields. Such an approach can be utilized for developing resonators with predesigned properties avoiding time consuming simulations. We have performed full multipole symmetry classification for a number of resonators geometries, and tightened it with scattering spectra profiles.


The Sharpe predictor for fairness in machine learning. In machine learning (ML) applications, unfair predictions may discriminate against a minority group. Most existing approaches for fair machine learning (FML) treat fairness as a constraint or a penalization term in the optimization of a ML model, which does not lead to the discovery of the complete landscape of the trade offs among learning accuracy and fairness metrics, and does not integrate fairness in a meaningful way. Recently, we have introduced a new paradigm for FML based on Stochastic Multi Objective Optimization (SMOO), where accuracy and fairness metrics stand as conflicting objectives to be optimized simultaneously. The entire trade offs range is defined as the Pareto front of the SMOO problem, which can then be efficiently computed using stochastic gradient type algorithms. SMOO also allows defining and computing new meaningful predictors for FML, a novel one being the Sharpe predictor that we introduce and explore in this paper, and which gives the highest ratio of accuracy to unfairness. Inspired from SMOO in finance, the Sharpe predictor for FML provides the highest prediction return (accuracy) per unit of prediction risk (unfairness).


PipeTransformer Automated Elastic Pipelining for Distributed Training of Transformers. The size of Transformer models is growing at an unprecedented pace. It has only taken less than one year to reach trillion level parameters after the release of GPT 3 (175B). Training such models requires both substantial engineering efforts and enormous computing resources, which are luxuries most research teams cannot afford. In this paper, we propose PipeTransformer, which leverages automated and elastic pipelining and data parallelism for efficient distributed training of Transformer models. PipeTransformer automatically adjusts the pipelining and data parallelism by identifying and freezing some layers during the training, and instead allocates resources for training of the remaining active layers. More specifically, PipeTransformer dynamically excludes converged layers from the pipeline, packs active layers into fewer GPUs, and forks more replicas to increase data parallel width. We evaluate PipeTransformer using Vision Transformer (ViT) on ImageNet and BERT on GLUE and SQuAD datasets. Our results show that PipeTransformer attains a 2.4 fold speedup compared to the state of the art baseline. We also provide various performance analyses for a more comprehensive understanding of our algorithmic and system wise design. We also develop open sourced flexible APIs for PipeTransformer, which offer a clean separation among the freeze algorithm, model definitions, and training accelerations, hence allowing it to be applied to other algorithms that require similar freezing strategies.


Achieving Model Fairness in Vertical Federated Learning. Vertical federated learning (VFL), which enables multiple enterprises possessing non overlapped features to strengthen their machine learning models without disclosing their private data and model parameters, has received increasing attention lately. Similar to other machine learning algorithms, VFL suffers from fairness issues, i.e., the learned model may be unfairly discriminatory over the group with sensitive attributes. To tackle this problem, we propose a fair VFL framework in this work. First, we systematically formulate the problem of training fair models in VFL, where the learning task is modeled as a constrained optimization problem. To solve it in a federated manner, we consider its equivalent dual form and develop an asynchronous gradient coordinate descent ascent algorithm, where each data party performs multiple parallelized local updates per communication round to effectively reduce the number of communication rounds. We prove that the algorithm finds a delta stationary point of the dual objective in mathcal O ( delta 4 ) communication rounds under mild conditions. Finally, extensive experiments on three benchmark datasets demonstrate the superior performance of our method in training fair models.