On the Complexity of Fair House Allocation. We study fairness in house allocation, where m houses are to be allocated among n agents so that every agent receives one house. We show that maximizing the number of envy free agents is hard to approximate to within a factor of n 1 gamma for any constant gamma 0 , and that the exact version is NP hard even for binary utilities. Moreover, we prove that deciding whether a proportional allocation exists is computationally hard, whereas the corresponding problem for equitability can be solved efficiently.


Neural network relief a pruning algorithm based on neural activity. Current deep neural networks (DNNs) are overparameterized and use most of their neuronal connections during inference for each task. The human brain, however, developed specialized regions for different tasks and performs inference with a small fraction of its neuronal connections. We propose an iterative pruning strategy introducing a simple importance score metric that deactivates unimportant connections, tackling overparameterization in DNNs and modulating the firing patterns. The aim is to find the smallest number of connections that is still capable of solving a given task with comparable accuracy, i.e. a simpler subnetwork. We achieve comparable performance for LeNet architectures on MNIST, and significantly higher parameter compression than state of the art algorithms for VGG and ResNet architectures on CIFAR 10 100 and Tiny ImageNet. Our approach also performs well for the two different optimizers considered Adam and SGD. The algorithm is not designed to minimize FLOPs when considering current hardware and software implementations, although it performs reasonably when compared to the state of the art.


Surface production of negative ions from pulse biased nitrogen doped diamond within a low pressure deuterium plasma. The production of negative ions is of significant interest for applications including mass spectrometry, materials surface processing, and neutral beam injection for magnetic confined fusion. Neutral beam injection sources maximise negative ion production through the use of surface production processes and low work function metals, which introduce complex engineering. Investigating materials and techniques to avoid the use of low work function metals is of interest to broaden the application of negative ion sources and simplify future devices. In this study, we use pulsed sample biasing to investigate the surface production of negative ions from nitrogen doped diamond. The use of a pulsed bias allows for the study of insulating samples in a preserved surface state at temperatures between 150 circ C and 700 circ C in a 2 Pa, 130 W, (n e sim 10 9 cm 3 , T e sim 0.6 eV) inductively coupled deuterium plasma. The negative ion yield during the application of a pulsed negative bias is measured using a mass spectrometer and found to be approximately 20 higher for nitrogen doped diamond compared to non doped diamond. It is also shown that the pulsed sample bias has a lower peak negative ion yield compared to a continuous sample bias, which suggests that the formation of an optimum ratio of defects on its surface can be favourable for negative ion production.


Relational Gating for "What If" Reasoning. This paper addresses the challenge of learning to do procedural reasoning over text to answer "What if..." questions. We propose a novel relational gating network that learns to filter the key entities and relationships and learns contextual and cross representations of both procedure and question for finding the answer. Our relational gating network contains an entity gating module, relation gating module, and contextual interaction module. These modules help in solving the "What if..." reasoning problem. We show that modeling pairwise relationships helps to capture higher order relations and find the line of reasoning for causes and effects in the procedural descriptions. Our proposed approach achieves the state of the art results on the WIQA dataset.


Numerical Comparison of Neighbourhood Topologies in Particle Swarm Optimization. Particle Swarm Optimization is a global optimizer in the sense that it has the ability to escape poor local optima. However, if the spread of information within the population is not adequately performed, premature convergence may occur. The convergence speed and hence the reluctance of the algorithm to getting trapped in suboptimal solutions are controlled by the settings of the coefficients in the velocity update equation as well as by the neighbourhood topology. The coefficients settings govern the trajectories of the particles towards the good locations identified, whereas the neighbourhood topology controls the form and speed of spread of information within the population (i.e. the update of the social attractor). Numerous neighbourhood topologies have been proposed and implemented in the literature. This paper offers a numerical comparison of the performances exhibited by five different neighbourhood topologies combined with four different coefficients' settings when optimizing a set of benchmark unconstrained problems. Despite the optimum topology being problem dependent, it appears that dynamic neighbourhoods with the number of interconnections increasing as the search progresses should be preferred for a non problem specific optimizer.


Hamiltonicity of graphs perturbed by a random regular graph. We study Hamiltonicity and pancyclicity in the graph obtained as the union of a deterministic n vertex graph H with delta(H) geq alpha n and a random d regular graph G , for d in 1,2 . When G is a random 2 regular graph, we prove that a.a.s. H cup G is pancyclic for all alpha in(0,1 , and also extend our result to a range of sublinear degrees. When G is a random 1 regular graph, we prove that a.a.s. H cup G is pancyclic for all alpha in( sqrt 2 1,1 , and this result is best possible. Furthermore, we show that this bound on delta(H) is only needed when H is far' from containing a perfect matching, as otherwise we can show results analogous to those of random 2 regular graphs. Our proofs provide polynomial time algorithms to find cycles of any length.


Time Series Regeneration with Convolutional Recurrent Generative Adversarial Network for Remaining Useful Life Estimation. For health prognostic task, ever increasing efforts have been focused on machine learning based methods, which are capable of yielding accurate remaining useful life (RUL) estimation for industrial equipment or components without exploring the degradation mechanism. A prerequisite ensuring the success of these methods depends on a wealth of run to failure data, however, run to failure data may be insufficient in practice. That is, conducting a substantial amount of destructive experiments not only is high costs, but also may cause catastrophic consequences. Out of this consideration, an enhanced RUL framework focusing on data self generation is put forward for both non cyclic and cyclic degradation patterns for the first time. It is designed to enrich data from a data driven way, generating realistic like time series to enhance current RUL methods. First, high quality data generation is ensured through the proposed convolutional recurrent generative adversarial network (CR GAN), which adopts a two channel fusion convolutional recurrent neural network. Next, a hierarchical framework is proposed to combine generated data into current RUL estimation methods. Finally, the efficacy of the proposed method is verified through both non cyclic and cyclic degradation systems. With the enhanced RUL framework, an aero engine system following non cyclic degradation has been tested using three typical RUL models. State of art RUL estimation results are achieved by enhancing capsule network with generated time series. Specifically, estimation errors evaluated by the index score function have been reduced by 21.77 , and 32.67 for the two employed operating conditions, respectively. Besides, the estimation error is reduced to zero for the Lithium ion battery system, which presents cyclic degradation.


Prototype Learning for Interpretable Respiratory Sound Analysis. Remote screening of respiratory diseases has been widely studied as a non invasive and early instrument for diagnosis purposes, especially in the pandemic. The respiratory sound classification task has been realized with numerous deep neural network (DNN) models due to their superior performance. However, in the high stake medical domain where decisions can have significant consequences, it is desirable to develop interpretable models thus, providing understandable reasons for physicians and patients. To address the issue, we propose a prototype learning framework, that jointly generates exemplar samples for explanation and integrates these samples into a layer of DNNs. The experimental results indicate that our method outperforms the state of the art approaches on the largest public respiratory sound database.


Uncertainty Quantification of Bifurcations in Random Ordinary Differential Equations. We are concerned with random ordinary differential equations (RODEs). Our main question of interest is how uncertainties in system parameters propagate through the possibly highly nonlinear dynamical system and affect the system's bifurcation behavior. We come up with a methodology to determine the probability of the occurrence of different types of bifurcations (sub vs super critical) along a given bifurcation curve based on the probability distribution of the input parameters. In a first step, we reduce the system's behavior to the dynamics on its center manifold. We thereby still capture the major qualitative behavior of the RODEs. In a second step, we analyze the reduced RODEs and quantify the probability of the occurrence of different types of bifurcations based on the (nonlinear) functional appearance of uncertain parameters. To realize this major step, we present three approaches an analytical one, where the probability can be calculated explicitly based on Mellin transformation and inversion, a semi analytical one consisting of a combination of the analytical approach with a moment based numerical estimation procedure, and a particular sampling based approach using unscented transformation. We complement our new methodology with various numerical examples.


DeepParticle learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method. We introduce the so called DeepParticle method to learn and generate invariant measures of stochastic dynamical systems with physical parameters based on data computed from an interacting particle method (IPM). We utilize the expressiveness of deep neural networks (DNNs) to represent the transform of samples from a given input (source) distribution to an arbitrary target distribution, neither assuming distribution functions in closed form nor a finite state space for the samples. In training, we update the network weights to minimize a discrete Wasserstein distance between the input and target samples. To reduce computational cost, we propose an iterative divide and conquer (a mini batch interior point) algorithm, to find the optimal transition matrix in the Wasserstein distance. We present numerical results to demonstrate the performance of our method for accelerating IPM computation of invariant measures of stochastic dynamical systems arising in computing reaction diffusion front speeds through chaotic flows. The physical parameter is a large Pecl 'et number reflecting the advection dominated regime of our interest.


Time is Money The Equilibrium Trading Horizon and Optimal Arrival Price. Executing even moderately large derivatives orders can be expensive and risky it's hard to balance the uncertainty of working an order over time versus paying a liquidity premium for immediate execution. Here, we introduce the Time Is Money model, which calculates the Equilibrium Trading Horizon over which to execute an order within the adversarial forces of variance risk and liquidity premium. We construct a hypothetical at the money option within Arithmetic Brownian Motion and invert the Bachelier model to compute an inflection point between implied variance and liquidity cost as governed by a central limit order book, each in real time as they evolve. As a result, we demonstrate a novel, continuous time Arrival Price framework. Further, we argue that traders should be indifferent to choosing between variance risk and liquidity cost, unless they have a predetermined bias or an exogenous position with a convex payoff. We, therefore, introduce half life factor asymptotics to the model based on a convexity factor and compare results to existing models. We also describe a specialization of the model for trading a basket of correlated instruments, as exemplified by a futures calendar spread. Finally, we establish groundwork for microstructure optimizations as well as explore short term drift and conditional expected slippage within the Equilibrium Horizon framework.


Transitional Learning Exploring the Transition States of Degradation for Blind Super resolution. Being extremely dependent on iterative estimation of the degradation prior or optimization of the model from scratch, the existing blind super resolution (SR) methods are generally time consuming and less effective, as the estimation of degradation proceeds from a blind initialization and lacks interpretable degradation priors. To address it, this paper proposes a transitional learning method for blind SR using an end to end network without any additional iterations in inference, and explores an effective representation for unknown degradation. To begin with, we analyze and demonstrate the transitionality of degradations as interpretable prior information to indirectly infer the unknown degradation model, including the widely used additive and convolutive degradations. We then propose a novel Transitional Learning method for blind Super Resolution (TLSR), by adaptively inferring a transitional transformation function to solve the unknown degradations without any iterative operations in inference. Specifically, the end to end TLSR network consists of a degree of transitionality (DoT) estimation network, a homogeneous feature extraction network, and a transitional learning module. Quantitative and qualitative evaluations on blind SR tasks demonstrate that the proposed TLSR achieves superior performances and costs fewer complexities against the state of the art blind SR methods. The code is available at github.com YuanfeiHuang TLSR.


Fairness Deconstructed A Sociotechnical View of 'Fair' Algorithms in Criminal Justice. Early studies of risk assessment algorithms used in criminal justice revealed widespread racial biases. In response, machine learning researchers have developed methods for fairness, many of which rely on equalizing empirical metrics across protected attributes. Here, I recall sociotechnical perspectives to delineate the significant gap between fairness in theory and practice, focusing on criminal justice. I (1) illustrate how social context can undermine analyses that are restricted to an AI system's outputs, and (2) argue that much of the fair ML literature fails to account for epistemological issues with underlying crime data. Instead of building AI that reifies power imbalances, like risk assessment algorithms, I ask whether data science can be used to understand the root causes of structural marginalization.


A Conditional Lower Bound for Episode Matching. Given two strings S and P , the Episode Matching problem is to compute the length of the shortest substring of S that contains P as a subsequence. The best known upper bound for this problem is tilde O(nm) by Das et al. (1997), where n,m are the lengths of S and P , respectively. Although the problem is well studied and has many applications in data mining, this bound has never been improved. In this paper we show why this is the case by proving that an O((nm) 1 epsilon ) algorithm (even for binary strings) would refute the popular Strong Exponential Time Hypothesis (SETH). The proof is based on a simple reduction from Orthogonal Vectors.


Fast X ray spectrum and image acquisition method for the XFEL facility. X ray free electron laser (XFEL) can provide X ray light with about four order of magnitude higher flux than synchrotron radiation. Pulse light from XFEL interacts with the target and the resulting photons are collected by detectors. The strong intensity of XFEL will make multiple photons hit on one detector pixel and affect the photon energy measurement. Although increasing the distance between the target and detector could reduce the photons pile up, it causes a waste of photons. So the traditional photon counting spectrum acquisition method is not advantageous in the XFEL case. To meet the requirements on both spectrum acquisition and imaging, we propose a new detection method in this paper.


On uniqueness and nonuniqueness of ancient ovals. In this paper, we prove that any nontrivial mathrm SO (k ) times mathrm SO (n 1 k) symmetric ancient compact noncollapsed solution of the mean curvature flow agrees up to scaling and rigid motion with the mathrm O (k) times mathrm O (n 1 k) symmetric ancient ovals constructed by Hershkovits and the second author. This confirms a conjecture by Angenent Daskalopoulos Sesum. On the other hand, for every k geq 2 we also construct a (k 1) parameter family of uniformly (k 1) convex ancient ovals that are only mathbb Z k 2 times mathrm O (n 1 k) symmetric. This gives counterexamples to a conjecture of Daskalopoulos.


On the Transferability of Neural Models of Morphological Analogies. Analogical proportions are statements expressed in the form "A is to B as C is to D" and are used for several reasoning and classification tasks in artificial intelligence and natural language processing (NLP). In this paper, we focus on morphological tasks and we propose a deep learning approach to detect morphological analogies. We present an empirical study to see how our framework transfers across languages, and that highlights interesting similarities and differences between these languages. In view of these results, we also discuss the possibility of building a multilingual morphological model.


Prioritization of COVID 19 related literature via unsupervised keyphrase extraction and document representation learning. The COVID 19 pandemic triggered a wave of novel scientific literature that is impossible to inspect and study in a reasonable time frame manually. Current machine learning methods offer to project such body of literature into the vector space, where similar documents are located close to each other, offering an insightful exploration of scientific papers and other knowledge sources associated with COVID 19. However, to start searching, such texts need to be appropriately annotated, which is seldom the case due to the lack of human resources. In our system, the current body of COVID 19 related literature is annotated using unsupervised keyphrase extraction, facilitating the initial queries to the latent space containing the learned document embeddings (low dimensional representations). The solution is accessible through a web server capable of interactive search, term ranking, and exploration of potentially interesting literature. We demonstrate the usefulness of the approach via case studies from the medicinal chemistry domain.


IoT Enabled Social Relationships Meet Artificial Social Intelligence. With the recent advances of the Internet of Things, and the increasing accessibility of ubiquitous computing resources and mobile devices, the prevalence of rich media contents, and the ensuing social, economic, and cultural changes, computing technology and applications have evolved quickly over the past decade. They now go beyond personal computing, facilitating collaboration and social interactions in general, causing a quick proliferation of social relationships among IoT entities. The increasing number of these relationships and their heterogeneous social features have led to computing and communication bottlenecks that prevent the IoT network from taking advantage of these relationships to improve the offered services and customize the delivered content, known as relationship explosion. On the other hand, the quick advances in artificial intelligence applications in social computing have led to the emerging of a promising research field known as Artificial Social Intelligence (ASI) that has the potential to tackle the social relationship explosion problem. This paper discusses the role of IoT in social relationships detection and management, the problem of social relationships explosion in IoT and reviews the proposed solutions using ASI, including social oriented machine learning and deep learning techniques.


Fast mesh denoising with data driven normal filtering using deep variational autoencoders. Recent advances in 3D scanning technology have enabled the deployment of 3D models in various industrial applications like digital twins, remote inspection and reverse engineering. Despite their evolving performance, 3D scanners, still introduce noise and artifacts in the acquired dense models. In this work, we propose a fast and robust denoising method for dense 3D scanned industrial models. The proposed approach employs conditional variational autoencoders to effectively filter face normals. Training and inference are performed in a sliding patch setup reducing the size of the required training data and execution times. We conducted extensive evaluation studies using 3D scanned and CAD models. The results verify plausible denoising outcomes, demonstrating similar or higher reconstruction accuracy, compared to other state of the art approaches. Specifically, for 3D models with more than 1e4 faces, the presented pipeline is twice as fast as methods with equivalent reconstruction error.


Robust Devaney chaos in the two dimensional border collision normal form. The collection of all non degenerate, continuous, two piece, piecewise linear maps on mathbb R 2 can be reduced to a four parameter family known as the two dimensional border collision normal form. We prove that throughout an open region of parameter space this family has an attractor satisfying Devaney's definition of chaos. This strengthens existing results on the robustness of chaos in piecewise linear maps. We further show that the stable manifold of a saddle fixed point, despite being a one dimensional object, densely fills an open region containing the attractor. Finally we identify a heteroclinic bifurcation, not described previously, at which the attractor undergoes a crisis and may be destroyed.


Addition deletion results for the minimal degree of a Jacobian syzygy of a union of two curves. Let C f 0 be a reduced curve in the complex projective plane. The minimal degree mdr(f) of a Jacobian syzygy for f , which is the same as the minimal degree of a derivation killing f , is an important invariant of the curve C , for instance it can be used to determined whether C is free or nearly free. In this note we study the relations of this invariant mdr(f) with a decomposition of C as a union of two curves C 1 and C 2 , without common irreducible components. When all the singularities that occur are quasihomogeneous, a result by Schenck, Terao and Yoshinaga yields finer information on this invariant in this setting. Using this, we give some geometrical criteria, the first ones of this type in the existing literature as far as we know, for a line to be a jumping line for the rank 2 vector bundle of logarithmic vector fields along a reduced curve C .


Extremal potentials and equilibrium measures associated to collections of K "ahler classes. Given a collection of K "ahler forms and a continuous weight on a compact complex manifold we show that it is possible to define natural new notions of extremal potentials and equilibrium measures which coincide with classical notions when the collection is a singleton. We prove two regularity results and set up a variational framework. Applications to Fekete points are treated elsewhere.


Towards Just Enough Documentation for Agile Effort Estimation What Information Should Be Documented?. Effort estimation is an integral part of activities planning in Agile iterative development. An Agile team estimates the effort of a task based on the available information which is usually conveyed through documentation. However, as documentation has a lower priority in Agile, little is known about how documentation effort can be optimized while achieving accurate estimation. Hence, to help practitioners achieve just enough documentation for effort estimation, we investigated the different types of documented information that practitioners considered useful for effort estimation. We conducted a survey study with 121 Agile practitioners across 25 countries. Our survey results showed that (1) despite the lower priority of documentation in Agile practices, 98 of the respondents considered documented information moderately to extremely important when estimating effort, (2) 73 of them reported that they would re estimate a task when the documented information was changed, and (3) functional requirements, user stories, definition of done, UI wireframes, acceptance criteria, and task dependencies were ranked as the most useful types of documented information for effort estimation. Nevertheless, many respondents reported that these useful types of documented information were occasionally changing or missing. Based on our study results, we provide recommendations for agile practitioners on how effort estimation can be improved by focusing on just enough documentation.


Automatic Guide Generation for Stan via NumPyro. Stan is a very popular probabilistic language with a state of the art HMC sampler but it only offers a limited choice of algorithms for black box variational inference. In this paper, we show that using our recently proposed compiler from Stan to Pyro, Stan users can easily try the set of algorithms implemented in Pyro for black box variational inference. We evaluate our approach on PosteriorDB, a database of Stan models with corresponding data and reference posterior samples. Results show that the eight algorithms available in Pyro offer a range of possible compromises between complexity and accuracy. This paper illustrates that compiling Stan to another probabilistic language can be used to leverage new features for Stan users, and give access to a large set of examples for language developers who implement these new features.


Deep Equal Risk Pricing of Financial Derivatives with Multiple Hedging Instruments. This paper studies the equal risk pricing (ERP) framework for the valuation of European financial derivatives. This option pricing approach is consistent with global trading strategies by setting the premium as the value such that the residual hedging risk of the long and short positions in the option are equal under optimal hedging. The ERP setup of Marzban et al. (2020) is considered where residual hedging risk is quantified with convex risk measures. The main objective of this paper is to assess through extensive numerical experiments the impact of including options as hedging instruments within the ERP framework. The reinforcement learning procedure developed in Carbonneau and Godin (2020), which relies on the deep hedging algorithm of Buehler et al. (2019b), is applied to numerically solve the global hedging problems by representing trading policies with neural networks. Among other findings, numerical results indicate that in the presence of jump risk, hedging long term puts with shorter term options entails a significant decrease of both equal risk prices and market incompleteness as compared to trading only the stock. Monte Carlo experiments demonstrate the potential of ERP as a fair valuation approach providing prices consistent with observable market prices. Analyses exhibit the ability of ERP to span a large interval of prices through the choice of convex risk measures which is close to encompass the variance optimal premium.


Deep Learning based Online Alternative Product Recommendations at Scale. Alternative recommender systems are critical for ecommerce companies. They guide customers to explore a massive product catalog and assist customers to find the right products among an overwhelming number of options. However, it is a non trivial task to recommend alternative products that fit customer needs. In this paper, we use both textual product information (e.g. product titles and descriptions) and customer behavior data to recommend alternative products. Our results show that the coverage of alternative products is significantly improved in offline evaluations as well as recall and precision. The final A B test shows that our algorithm increases the conversion rate by 12 percent in a statistically significant way. In order to better capture the semantic meaning of product information, we build a Siamese Network with Bidirectional LSTM to learn product embeddings. In order to learn a similarity space that better matches the preference of real customers, we use co compared data from historical customer behavior as labels to train the network. In addition, we use NMSLIB to accelerate the computationally expensive kNN computation for millions of products so that the alternative recommendation is able to scale across the entire catalog of a major ecommerce site.


The 4th International Workshop on Smart Simulation and Modelling for Complex Systems. Computer based modelling and simulation have become useful tools to facilitate humans to understand systems in different domains, such as physics, astrophysics, chemistry, biology, economics, engineering and social science. A complex system is featured with a large number of interacting components (agents, processes, etc.), whose aggregate activities are nonlinear and self organized. Complex systems are hard to be simulated or modelled by using traditional computational approaches due to complex relationships among system components, distributed features of resources, and dynamics of environments. Meanwhile, smart systems such as multi agent systems have demonstrated advantages and great potentials in modelling and simulating complex systems.


Learning to Discover Reflection Symmetry via Polar Matching Convolution. The task of reflection symmetry detection remains challenging due to significant variations and ambiguities of symmetry patterns in the wild. Furthermore, since the local regions are required to match in reflection for detecting a symmetry pattern, it is hard for standard convolutional networks, which are not equivariant to rotation and reflection, to learn the task. To address the issue, we introduce a new convolutional technique, dubbed the polar matching convolution, which leverages a polar feature pooling, a self similarity encoding, and a systematic kernel design for axes of different angles. The proposed high dimensional kernel convolution network effectively learns to discover symmetry patterns from real world images, overcoming the limitations of standard convolution. In addition, we present a new dataset and introduce a self supervised learning strategy by augmenting the dataset with synthesizing images. Experiments demonstrate that our method outperforms state of the art methods in terms of accuracy and robustness.


Multi Level Attentive Convoluntional Neural Network for Crowd Counting. Recently the crowd counting has received more and more attention. Especially the technology of high density environment has become an important research content, and the relevant methods for the existence of extremely dense crowd are not optimal. In this paper, we propose a multi level attentive Convolutional Neural Network (MLAttnCNN) for crowd counting. We extract high level contextual information with multiple different scales applied in pooling, and use multi level attention modules to enrich the characteristics at different layers to achieve more efficient multi scale feature fusion, which is able to be used to generate a more accurate density map with dilated convolutions and a 1 times 1 convolution. The extensive experiments on three available public datasets show that our proposed network achieves outperformance to the state of the art approaches.


Machine Learning Enhanced Blockchain Consensus with Transaction Prioritization for Smart Cities. In the given technology driven era, smart cities are the next frontier of technology, aiming at improving the quality of people's lives. Many research works focus on future smart cities with a holistic approach towards smart city development. In this paper, we introduce such future smart cities that leverage blockchain technology in areas like data security, energy and waste management, governance, transport, supply chain, including emergency events, and environmental monitoring. Blockchain, being a decentralized immutable ledger, has the potential to promote the development of smart cities by guaranteeing transparency, data security, interoperability, and privacy. Particularly, using blockchain in emergency events will provide interoperability between many parties involved in the response, will increase timeliness of services, and establish transparency. In that case, if a current fee based or first come first serve based processing is used, emergency events may get delayed in being processed due to competition, and thus, threatening people's lives. Thus, there is a need for transaction prioritization based on the priority of information and quick creation of blocks (variable interval block creation mechanism). Also, since the leaders ensure transaction prioritization while generating blocks, leader rotation and proper election procedure become important for the transaction prioritization process to take place honestly and efficiently. In our consensus protocol, we deploy a machine learning (ML) algorithm to achieve efficient leader election and design a novel dynamic block creation algorithm. Also, to ensure honest assessment from the followers on the blocks generated by the leaders, a peer prediction based verification mechanism is proposed. Both security analysis and simulation experiments are carried out to demonstrate the robustness and accuracy of our proposed scheme.


Language Scaling for Universal Suggested Replies Model. We consider the problem of scaling automated suggested replies for Outlook email system to multiple languages. Faced with increased compute requirements and low resources for language expansion, we build a single universal model for improving the quality and reducing run time costs of our production system. However, restricted data movement across regional centers prevents joint training across languages. To this end, we propose a multi task continual learning framework, with auxiliary tasks and language adapters to learn universal language representation across regions. The experimental results show positive cross lingual transfer across languages while reducing catastrophic forgetting across regions. Our online results on real user traffic show significant gains in CTR and characters saved, as well as 65 training cost reduction compared with per language models. As a consequence, we have scaled the feature in multiple languages including low resource markets.


The self supervised spectral spatial attention based transformer network for automated, accurate prediction of crop nitrogen status from UAV imagery. Nitrogen (N) fertilizer is routinely applied by farmers to increase crop yields. At present, farmers often over apply N fertilizer in some locations or at certain times because they do not have high resolution crop N status data. N use efficiency can be low, with the remaining N lost to the environment, resulting in higher production costs and environmental pollution. Accurate and timely estimation of N status in crops is crucial to improving cropping systems' economic and environmental sustainability. Destructive approaches based on plant tissue analysis are time consuming and impractical over large fields. Recent advances in remote sensing and deep learning have shown promise in addressing the aforementioned challenges in a non destructive way. In this work, we propose a novel deep learning framework a self supervised spectral spatial attention based vision transformer (SSVT). The proposed SSVT introduces a Spectral Attention Block (SAB) and a Spatial Interaction Block (SIB), which allows for simultaneous learning of both spatial and spectral features from UAV digital aerial imagery, for accurate N status prediction in wheat fields. Moreover, the proposed framework introduces local to global self supervised learning to help train the model from unlabelled data. The proposed SSVT has been compared with five state of the art models including ResNet, RegNet, EfficientNet, EfficientNetV2 and the original vision transformer on both testing and independent datasets. The proposed approach achieved high accuracy (0.96) with good generalizability and reproducibility for wheat N status estimation.


ppsim A software package for efficiently simulating and visualizing population protocols. We introduce ppsim, a software package for efficiently simulating population protocols, a widely studied subclass of chemical reaction networks (CRNs) in which all reactions have two reactants and two products. Each step in the dynamics involves picking a uniform random pair from a population of n molecules to collide and have a (potentially null) reaction. In a recent breakthrough, Berenbrink, Hammer, Kaaser, Meyer, Penschuck, and Tran ESA 2020 discovered a population protocol simulation algorithm quadratically faster than the naive algorithm, simulating Theta( sqrt n ) reactions in constant time (independently of n , though the time scales with the number of species), while preserving the exact stochastic dynamics. ppsim implements this algorithm, with a tightly optimized Cython implementation that can exactly simulate hundreds of billions of reactions in seconds. It dynamically switches to the CRN Gillespie algorithm for efficiency gains when the number of applicable reactions in a configuration becomes small. As a Python library, ppsim also includes many useful tools for data visualization in Jupyter notebooks, allowing robust visualization of time dynamics such as histogram plots at time snapshots and averaging repeated trials. Finally, we give a framework that takes any CRN with only bimolecular (2 reactant, 2 product) or unimolecular (1 reactant, 1 product) reactions, with arbitrary rate constants, and compiles it into a continuous time population protocol. This lets ppsim exactly sample from the chemical master equation (unlike approximate heuristics such as tau leaping or LNA), while achieving asymptotic gains in running time. In linked Jupyter notebooks, we demonstrate the efficacy of the tool on some protocols of interest in molecular programming, including the approximate majority CRN and CRN models of DNA strand displacement reactions.


Infrared spectra of both isomers of CO 2 CO in the CO 2 nu 3 region. Extensive infrared spectra of the weakly bound CO 2 CO dimer are observed in the carbon dioxide nu 3 asymmetric stretch region ( 2350 cm 1) using a tunable infrared OPO laser source to probe a pulsed slit jet supersonic expansion. Both C bonded and O bonded isomers are analyzed for the normal isotopologue as well as for 13CO 2 CO and 16 O 13 C 18 O CO, the latter being the first observation of an asymmetrically substituted form for which all values of Ka are allowed. Combination bands involving the lowest in plane intermolecular bending modes are also studied for both isomers. Weak bands near 2337 cm 1 are assigned to CO 2 hot band transitions (v1, v2l2, v3) (0111) (0110), yielding the splitting of the degenerate CO 2 nu 2 bend into in plane and out of plane components due to the presence of the CO. This splitting has rather different values for the C and O bonded isomers, 4.56 and 1.59 cm 1, respectively, with the out of plane mode higher in energy than the in plane for both cases.


Automated Dynamic Mechanism Design. We study Bayesian automated mechanism design in unstructured dynamic environments, where a principal repeatedly interacts with an agent, and takes actions based on the strategic agent's report of the current state of the world. Both the principal and the agent can have arbitrary and potentially different valuations for the actions taken, possibly also depending on the actual state of the world. Moreover, at any time, the state of the world may evolve arbitrarily depending on the action taken by the principal. The goal is to compute an optimal mechanism which maximizes the principal's utility in the face of the self interested strategic agent. We give an efficient algorithm for computing optimal mechanisms, with or without payments, under different individual rationality constraints, when the time horizon is constant. Our algorithm is based on a sophisticated linear program formulation, which can be customized in various ways to accommodate richer constraints. For environments with large time horizons, we show that the principal's optimal utility is hard to approximate within a certain constant factor, complementing our algorithmic result. We further consider a special case of the problem where the agent is myopic, and give a refined efficient algorithm whose time complexity scales linearly in the time horizon. Moreover, we show that memoryless mechanisms do not provide a good solution for our problem, in terms of both optimality and computational tractability. These results paint a relatively complete picture for automated dynamic mechanism design in unstructured environments. Finally, we present experimental results where our algorithms are applied to synthetic dynamic environments with different characteristics, which not only serve as a proof of concept for our algorithms, but also exhibit intriguing phenomena in dynamic mechanism design.


Table in Gradshteyn and Ryzhik Derivation of definite integrals of a Hyperbolic Function. We present a method using contour integration to derive definite integrals and their associated infinite sums which can be expressed as a special function. We give a proof of the basic equation and some examples of the method. The advantage of using special functions is their analytic continuation which widens the range of the parameters of the definite integral over which the formula is valid. We give as examples definite integrals of logarithmic functions times a trigonometric function. In various cases these generalizations evaluate to known mathematical constants such as Catalan's constant and pi .


Towards Scheduling Federated Deep Learning using Meta Gradients for Inter Hospital Learning. Given the abundance and ease of access of personal data today, individual privacy has become of paramount importance, particularly in the healthcare domain. In this work, we aim to utilise patient data extracted from multiple hospital data centres to train a machine learning model without sacrificing patient privacy. We develop a scheduling algorithm in conjunction with a student teacher algorithm that is deployed in a federated manner. This allows a central model to learn from batches of data at each federal node. The teacher acts between data centres to update the main task (student) algorithm using the data that is stored in the various data centres. We show that the scheduler, trained using meta gradients, can effectively organise training and as a result train a machine learning model on a diverse dataset without needing explicit access to the patient data. We achieve state of the art performance and show how our method overcomes some of the problems faced in the federated learning such as node poisoning. We further show how the scheduler can be used as a mechanism for transfer learning, allowing different teachers to work together in training a student for state of the art performance.


Anomaly Detection in Scratch Assignments. For teachers, automated tool support for debugging and assessing their students' programming assignments is a great help in their everyday business. For block based programming languages which are commonly used to introduce younger learners to programming, testing frameworks and other software analysis tools exist, but require manual work such as writing test suites or formal specifications. However, most of the teachers using languages like Scratch are not trained for or experienced in this kind of task. Linters do not require manual work but are limited to generic bugs and therefore miss potential task specific bugs in student solutions. In prior work, we proposed the use of anomaly detection to find project specific bugs in sets of student programming assignments automatically, without any additional manual labour required from the teachers' side. Evaluation on student solutions for typical programming assignments showed that anomaly detection is a reliable way to locate bugs in a data set of student programs. In this paper, we enhance our initial approach by lowering the abstraction level. The results suggest that the lower abstraction level can focus anomaly detection on the relevant parts of the programs.


A Critical Study on the Recent Deep Learning Based Semi Supervised Video Anomaly Detection Methods. Video anomaly detection is one of the hot research topics in computer vision nowadays, as abnormal events contain a high amount of information. Anomalies are one of the main detection targets in surveillance systems, usually needing real time actions. Regarding the availability of labeled data for training (i.e., there is not enough labeled data for abnormalities), semi supervised anomaly detection approaches have gained interest recently. This paper introduces the researchers of the field to a new perspective and reviews the recent deep learning based semi supervised video anomaly detection approaches, based on a common strategy they use for anomaly detection. Our goal is to help researchers develop more effective video anomaly detection methods. As the selection of a right Deep Neural Network plays an important role for several parts of this task, a quick comparative review on DNNs is prepared first. Unlike previous surveys, DNNs are reviewed from a spatiotemporal feature extraction viewpoint, customized for video anomaly detection. This part of the review can help researchers in this field select suitable networks for different parts of their methods. Moreover, some of the state of the art anomaly detection methods, based on their detection strategy, are critically surveyed. The review provides a novel and deep look at existing methods and results in stating the shortcomings of these approaches, which can be a hint for future works.


The mouse set conjecture for sets of reals. Recall that the Mouse Set Conjecture says that under AD V L(P(R)), a real is ordinal definable if and only if it belongs to an iterable mouse. The Mouse Set Conjecture for sets of reals says that under the same theory, a set of reals is ordinal definable from a real if and only if it belongs to a mouse over the reals. We prove that the Mouse Set Conjecture implies the Mouse Set Conjecture for sets of reals.


Quantifying agent impacts on contact sequences in social interactions. Human social behavior plays a crucial role in how pathogens like SARS CoV 2 or fake news spread in a population. Social interactions determine the contact network among individuals, while spreading, requiring individual to individual transmission, takes place on top of the network. Studying the topological aspects of a contact network, therefore, not only has the potential of leading to valuable insights into how the behavior of individuals impacts spreading phenomena, but it may also open up possibilities for devising effective behavioral interventions. Because of the temporal nature of interactions since the topology of the network, containing who is in contact with whom, when, for how long, and in which precise sequence, varies (rapidly) in time analyzing them requires developing network methods and metrics that respect temporal variability, in contrast to those developed for static (i.e., time invariant) networks. Here, by means of event mapping, we propose a method to quantify how quickly agents mingle by transforming temporal network data of agent contacts. We define a novel measure called 'contact sequence centrality', which quantifies the impact of an individual on the contact sequences, reflecting the individual's behavioral potential for spreading. Comparing contact sequence centrality across agents allows for ranking the impact of agents and identifying potential 'behavioral super spreaders'. The method is applied to social interaction data collected at an art fair in Amsterdam. We relate the measure to the existing network metrics, both temporal and static, and find that (mostly at longer time scales) traditional metrics lose their resemblance to contact sequence centrality. Our work highlights the importance of accounting for the sequential nature of contacts when analyzing social interactions.


Hamiltonian Operator Inference Physics preserving Learning of Reduced order Models for Canonical Hamiltonian Systems. This work presents a nonintrusive physics preserving method to learn reduced order models (ROMs) of canonical Hamiltonian systems. Traditional intrusive projection based model reduction approaches utilize symplectic Galerkin projection to construct Hamiltonian ROMs by projecting Hamilton's equations of the full model onto a symplectic subspace. This symplectic projection requires complete knowledge about the full model operators and full access to manipulate the computer code. In contrast, the proposed Hamiltonian operator inference approach embeds the physics into the operator inference framework to develop a data driven model reduction method that preserves the underlying symplectic structure. Our method exploits knowledge of the Hamiltonian functional to define and parametrize a Hamiltonian ROM form which can then be learned from data projected via symplectic projectors. The proposed method is gray box in that it utilizes knowledge of the Hamiltonian structure at the partial differential equation level, as well as knowledge of spatially local components in the system. However, it does not require access to computer code, only data to learn the models. Our numerical results demonstrate Hamiltonian operator inference on a linear wave equation, the cubic nonlinear Schr " o dinger equation, and a nonpolynomial sine Gordon equation. Accurate long time predictions far outside the training time interval for nonlinear examples illustrate the generalizability of our learned models.


MoSen Activity Modelling in Multiple Occupancy Smart Homes. Smart home solutions increasingly rely on a variety of sensors for behavioral analytics and activity recognition to provide context aware applications and personalized care. Optimizing the sensor network is one of the most important approaches to ensure classification accuracy and the system's efficiency. However, the trade off between the cost and performance is often a challenge in real deployments, particularly for multiple occupancy smart homes or care homes. In this paper, using real indoor activity and mobility traces, floor plans, and synthetic multi occupancy behavior models, we evaluate several multi occupancy household scenarios with 2 5 residents. We explore and quantify the trade offs between the cost of sensor deployments and expected labeling accuracy in different scenarios. Our evaluation across different scenarios show that the performance of the desired context aware task is affected by different localization resolutions, the number of residents, the number of sensors, and varying sensor deployments. To aid in accelerating the adoption of practical sensor based activity recognition technology, we design MoSen, a framework to simulate the interaction dynamics between sensor based environments and multiple residents. By evaluating the factors that affect the performance of the desired sensor network, we provide a sensor selection strategy and design metrics for sensor layout in real environments. Using our selection strategy in a 5 person scenario case study, we demonstrate that MoSen can significantly improve overall system performance without increasing the deployment costs.


On bases of quantum affine algebras. Let textbf U be the positive part of the quantum group textbf U associated with a generalized Cartan matrix. In the case of finite type, Lusztig constructed the canonical basis textbf B of textbf U via two approaches. The first one is an elementary algebraic construction via Ringel Hall algebra realization of textbf U and the second one is a geometric construction. The geometric construction of canonical basis can be generalized to the cases of all types. The generalization of the elementary algebraic construction to affine type is an important problem. We give several main results of algebraic constructions to the affine canonical basis in this ariticle. These results are given by Beck Nakajima, Lin Xiao Zhang, Xiao Xu Zhao, respectively.


Embeddings of anisotropic Besov spaces into Sobolev spaces. We study the embeddings of (homogeneous and inhomogeneous) anisotropic Besov spaces associated to an expansive matrix A into Sobolev spaces, with focus on the influence of A on the embedding behaviour. For a large range of parameters, we derive sharp characterizations of embeddings.


Urban Tree Species Classification Using Aerial Imagery. Urban trees help regulate temperature, reduce energy consumption, improve urban air quality, reduce wind speeds, and mitigating the urban heat island effect. Urban trees also play a key role in climate change mitigation and global warming by capturing and storing atmospheric carbon dioxide which is the largest contributor to greenhouse gases. Automated tree detection and species classification using aerial imagery can be a powerful tool for sustainable forest and urban tree management. Hence, This study first offers a pipeline for generating labelled dataset of urban trees using Google Map's aerial images and then investigates how state of the art deep Convolutional Neural Network models such as VGG and ResNet handle the classification problem of urban tree aerial images under different parameters. Experimental results show our best model achieves an average accuracy of 60 over 6 tree species.


Soliton self compression and resonant dispersive wave emission in higher order modes of a hollow capillary fibre. We investigate soliton self compression and ultraviolet resonant dispersive wave emission in the higher order modes of a gas filled hollow capillary fibre. Our simple analytical scaling rules predict shorter required waveguides and different energy scales when moving from the fundamental to higher order modes. Experimentally, we demonstrate soliton self compression and ultraviolet dispersive wave emission in the double lobe LP 11 mode of an argon filled hollow capillary fibre, which we excite by coupling into the fibre at oblique incidence. We observe the generation of ultraviolet dispersive waves which are frequency shifted and more narrowband as compared to fundamental mode generation due to the stronger modal dispersion, and a suppression of the supercontinuum between the dispersive wave and the pump pulse. With numerical simulations, we confirm the predictions of our scaling rules and find that the use of higher order modes can suppress photoionisation and plasma effects even while allowing for much higher pulse energy to be used in the self compression process. Our results add another degree of freedom for the design of hollow waveguide systems to generate sub cycle field transients and tuneable ultrashort laser pulses.


A 3D Numerical Investigation into the Effect of Rounded Corner Radii on the Wind Loading of a Square Cylinder Subjected to Supercritical Flow. Tall buildings are often subjected to steady and unsteady forces due to external wind flows. Measurement and mitigation of these forces becomes critical to structural design in engineering applications. Over the last few decades, many approaches such as modification of the external geometry of structures have been investigated to mitigate wind induced load. One such proven geometric modification involved rounding of sharp corners. In this work, we systematically analyze the effects of rounded corner radii on the flow induced loading for a square cylinder. We perform 3 Dimensional (3D) simulations at a high Reynolds number of Re 1 times 10 5 which is more likely to be encountered in practical applications. An Improved Delayed Detached Eddy Simulation (IDDES) formulation is used with the k omega Shear Stress Transport (SST) model for near wall modelling. IDDES is capable of capturing flow accurately at high Reynolds numbers and prevents grid induced separation near the boundary layer. The effects of these corner modifications are analyzed in terms of the resulting mean and fluctuating components of the lift and drag forces compared to a sharp corner case. Plots of the angular distribution of the mean and fluctuating pressure coefficient along the square cylinder's surface illustrate the effects of corner modifications on the different parts of the cylinder. The windward corner's separation angle was observed to decrease with an increase in radius, resulting in a narrower and longer recirculation region. Furthermore, with an increase in radius, a reduction in the fluctuating lift, mean drag, and fluctuating drag coefficients has been observed.


Channel Knowledge Map for Environment Aware Communications EM Algorithm for Map Construction. Channel knowledge map (CKM) is an emerging technique to enable environment aware wireless communications, in which databases with location specific channel knowledge are used to facilitate or even obviate real time channel state information acquisition. One fundamental problem for CKM enabled communication is how to efficiently construct the CKM based on finite measurement data points at limited user locations. Towards this end, this paper proposes a novel map construction method based on the emph expectation maximization (EM) algorithm, by utilizing the available measurement data, jointly with the expert knowledge of well established statistic channel models. The key idea is to partition the available data points into different groups, where each group shares the same modelling parameter values to be determined. We show that determining the modelling parameter values can be formulated as a maximum likelihood estimation problem with latent variables, which is then efficiently solved by the classic EM algorithm. Compared to the pure data driven methods such as the nearest neighbor based interpolation, the proposed method is more efficient since only a small number of modelling parameters need to be determined and stored. Furthermore, the proposed method is extended for constructing a specific type of CKM, namely, the channel gain map (CGM), where closed form expressions are derived for the E step and M step of the EM algorithm. Numerical results are provided to show the effectiveness of the proposed map construction method as compared to the benchmark curve fitting method with one single model.


Meta brain Models biologically inspired cognitive agents. Artificial Intelligence (AI) systems based solely on neural networks or symbolic computation present a representational complexity challenge. While minimal representations can produce behavioral outputs like locomotion or simple decision making, more elaborate internal representations might offer a richer variety of behaviors. We propose that these issues can be addressed with a computational approach we call meta brain models. Meta brain models are embodied hybrid models that include layered components featuring varying degrees of representational complexity. We will propose combinations of layers composed using specialized types of models. Rather than using a generic black box approach to unify each component, this relationship mimics systems like the neocortical thalamic system relationship of the mammalian brain, which utilizes both feedforward and feedback connectivity to facilitate functional communication. Importantly, the relationship between layers can be made anatomically explicit. This allows for structural specificity that can be incorporated into the model's function in interesting ways. We will propose several types of layers that might be functionally integrated into agents that perform unique types of tasks, from agents that simultaneously perform morphogenesis and perception, to agents that undergo morphogenesis and the acquisition of conceptual representations simultaneously. Our approach to meta brain models involves creating models with different degrees of representational complexity, creating a layered meta architecture that mimics the structural and functional heterogeneity of biological brains, and an input output methodology flexible enough to accommodate cognitive functions, social interactions, and adaptive behaviors more generally. We will conclude by proposing next steps in the development of this flexible and open source approach.


Hyponormal dual Toeplitz operators on the orthogonal complement of the Harmonic Bergman space. In this paper, we mainly study the hyponormality of dual Toeplitz operators on the orthogonal complement of the harmonic Bergman space. First we show that the dual Toeplitz operator with bounded symbol is hyponormal if and only if it is normal. Then we obtain a necessary and sufficient condition for the dual Toeplitz operator S varphi with the symbol varphi(z) az n 1 overline z m 1 bz n 2 overline z m 2 , (n 1,n 2,m 1,m 2 in mathbb N and a,b in mathbb C ) to be hyponormal. Finally, we show that the rank of the commutator of two dual Toeplitz operators must be an even number if the commutator has a finite rank.


Sharp reverse isoperimetric inequalities in nonpositively curved cones. We prove a pair of sharp reverse isoperimetric inequalities for domains in nonpositively curved surfaces (1) metric disks centered at the vertex of a Euclidean cone of angle at least 2 pi have minimal area among all nonpositively curved disks of the same perimeter and the same total curvature (2) geodesic triangles in a Euclidean (resp. hyperbolic) cone of angle at least 2 pi have minimal area among all nonpositively curved geodesic triangles (resp. all geodesic triangles of curvature at most 1 ) with the same side lengths and angles.


Proof Artifact Co training for Theorem Proving with Language Models. Labeled data for imitation learning of theorem proving in large libraries of formalized mathematics is scarce as such libraries require years of concentrated effort by human specialists to be built. This is particularly challenging when applying large Transformer language models to tactic prediction, because the scaling of performance with respect to model size is quickly disrupted in the data scarce, easily overfitted regime. We propose PACT ( bf P roof bf A rtifact bf C o bf T raining), a general methodology for extracting abundant self supervised data from kernel level proof terms for co training alongside the usual tactic prediction objective. We apply this methodology to Lean, an interactive proof assistant which hosts some of the most sophisticated formalized mathematics to date. We instrument Lean with a neural theorem prover driven by a Transformer language model and show that PACT improves theorem proving success rate on a held out suite of test theorems from 32 to 48 .


Software Supported Audits of Decision Making Systems Testing Google and Facebook's Political Advertising Policies. How can society understand and hold accountable complex human and algorithmic decision making systems whose systematic errors are opaque to the public? These systems routinely make decisions on individual rights and well being, and on protecting society and the democratic process. Practical and statistical constraints on external audits such as dimensional complexity can lead researchers and regulators to miss important sources of error in these complex decision making systems. In this paper, we design and implement a software supported approach to audit studies that auto generates audit materials and coordinates volunteer activity. We implemented this software in the case of political advertising policies enacted by Facebook and Google during the 2018 U.S. election. Guided by this software, a team of volunteers posted 477 auto generated ads and analyzed the companies' actions, finding systematic errors in how companies enforced policies. We find that software can overcome some common constraints of audit studies, within limitations related to sample size and volunteer capacity.


Semiring Provenance for B "uchi Games Strategy Analysis with Absorptive Polynomials. This paper presents a case study for the application of semiring semantics for fixed point formulae to the analysis of strategies in B "uchi games. Semiring semantics generalizes the classical Boolean semantics by permitting multiple truth values from certain semirings. Evaluating the fixed point formula that defines the winning region in a given game in an appropriate semiring of polynomials provides not only the Boolean information on who wins, but also tells us how they win and which strategies they might use. This is well understood for reachability games, where the winning region is definable as a least fixed point. The case of B "chi games is of special interest, not only due to their practical importance, but also because it is the simplest case where the fixed point definition involves a genuine alternation of a greatest and a least fixed point. We show that, in a precise sense, semiring semantics provide information about all absorption dominant strategies strategies that win with minimal effort, and we discuss how these relate to positional and the more general persistent strategies. This information enables applications such as game synthesis or determining minimal modifications to the game needed to change its outcome.


Modelling the Utility of Group Testing for Public Health Surveillance. In epidemic or pandemic situations, resources for testing the infection status of individuals may be scarce. Although group testing can help to significantly increase testing capabilities, the (repeated) testing of entire populations can exceed the resources of any country. We thus propose an extension of the theory of group testing that takes into account the fact that definitely specifying the infection status of each individual is impossible. Our theory builds on assigning to each individual an infection status (healthy infected), as well as an associated cost function for erroneous assignments. This cost function is versatile, e.g., it could take into account that false negative assignments are worse than false positive assignments and that false assignments in critical areas, such as health care workers, are more severe than in the general population. Based on this model, we study the optimal use of a limited number of tests to minimize the expected cost. More specifically, we utilize information theoretic methods to give a lower bound on the expected cost and describe simple strategies that can significantly reduce the expected cost over currently known strategies. A detailed example is provided to illustrate our theory.


Formalizing the Generalization Forgetting Trade off in Continual Learning. We formulate the continual learning (CL) problem via dynamic programming and model the trade off between catastrophic forgetting and generalization as a two player sequential game. In this approach, player 1 maximizes the cost due to lack of generalization whereas player 2 minimizes the cost due to catastrophic forgetting. We show theoretically that a balance point between the two players exists for each task and that this point is stable (once the balance is achieved, the two players stay at the balance point). Next, we introduce balanced continual learning (BCL), which is designed to attain balance between generalization and forgetting and empirically demonstrate that BCL is comparable to or better than the state of the art.


Incremental Meta Learning via Episodic Replay Distillation for Few Shot Image Recognition. Most meta learning approaches assume the existence of a very large set of labeled data available for episodic meta learning of base knowledge. This contrasts with the more realistic continual learning paradigm in which data arrives incrementally in the form of tasks containing disjoint classes. In this paper we consider this problem of Incremental Meta Learning (IML) in which classes are presented incrementally in discrete tasks. We propose an approach to IML, which we call Episodic Replay Distillation (ERD), that mixes classes from the current task with class exemplars from previous tasks when sampling episodes for meta learning. These episodes are then used for knowledge distillation to minimize catastrophic forgetting. Experiments on four datasets demonstrate that ERD surpasses the state of the art. In particular, on the more challenging one shot, long task sequence incremental meta learning scenarios, we reduce the gap between IML and the joint training upper bound from 3.5 10.1 13.4 with the current state of the art to 2.6 2.9 5.0 with our method on Tiered ImageNet Mini ImageNet CIFAR100, respectively.


Primary Decomposition with Differential Operators. We introduce differential primary decompositions for ideals in a commutative ring. Ideal membership is characterized by differential conditions. The minimal number of conditions needed is the arithmetic multiplicity. Minimal differential primary decompositions are unique up to change of bases. Our results generalize the construction of Noetherian operators for primary ideals in the analytic theory of Ehrenpreis Palamodov, and they offer a concise method for representing affine schemes. The case of modules is also addressed. We implemented an algorithm in Macaulay2 that computes the minimal decomposition for an ideal in a polynomial ring.


The role of antigen competitive dynamics in regulating the immune response. The clonal expansion of T cells during an infection is tightly regulated to ensure an appropriate immune response against invading pathogens. Although experiments have mapped the trajectory from expansion to contraction, the interplay between mechanisms that control this response are not fully understood. Based on experimental data, we propose a model in which the dynamics of CD4 T cell expansion is controlled through the interactions between T cells and antigen presenting cells, where T cell stimulation is proportional to antigen availability and antigen availability is regulated through downregulation of antigen by T cells. This antigen dependent feedback mechanism operates alongside an intrinsic reduction in cell proliferation rate that may also be responsible for slowing expansion. Our model can successfully predict T cell recruitment rates into division, expansion and clonal burst size per cell when initial precursors are varied or when T cells are introduced late into an ongoing immune response. Importantly, the findings demonstrate that a feedback mechanism between T cells and antigen presenting cells, along with a reduction in cell proliferation rate, can explain the ability of the immune system to adapt its response to variations in initial conditions or changes that occur later in the response, ensuring a robust yet controlled line of defence against pathogens.


A General Theory for the Evolution of Application Models Full version. In this article we focus on evolving information systems. First a delimitation of the concept of evolution is provided, resulting in a first attempt to a general theory for such evolutions. The theory makes a distinction between the underlying information structure at the conceptual level, its evolution on the one hand, and the description and semantics of operations on the information structure and its population on the other hand. Main issues within this theory are object typing, type relatedness and identification of objects. In terms of these concepts, we propose some axioms on the well formedness of evolution. In this general theory, the underlying data model is a parameter, making the theory applicable for a wide range of modelling techniques, including object role modelling and object oriented techniques.


An arbitrary order and pointwise divergence free finite element scheme for the incompressible 3D Navier Stokes equations. In this paper we introduce a new discretization of the incompressible Navier Stokes equations. We use the Lamb identity for the advection term (u cdot nabla)u and the general idea allows a lot of freedom in the treatment of the non linear term. The main advantage of this scheme is that the divergence of the fluid velocity is pointwise zero at the discrete level. This exactness allows for exactly conserved quantities and pressure robustness. Discrete spaces consist of piecewise polynomials, they may be taken of arbitrary order and are already implemented in most libraries. Although the nonlinear term may be implemented as is, most proofs here are done for the linearized equation. The whole problem is expressed in the finite element exterior calculus framework. We also present numerical simulations, our codes are written with the FEniCS computing platform, version 2019.1.0.


Fuzzy Algebraic Theories. In this work we propose a formal system for fuzzy algebraic reasoning. The sequent calculus we define is based on two kinds of propositions, capturing equality and existence of terms as members of a fuzzy set. We provide a sound semantics for this calculus and show that there is a notion of free model for any theory in this system, allowing us (with some restrictions) to recover models as Eilenberg Moore algebras for some monad. We will also prove a completeness result a formula is derivable from a given theory if and only if it is satisfied by all models of the theory. Finally, leveraging results by Milius and Urbat, we give HSP like characterizations of subcategories of algebras which are categories of models of particular kinds of theories.


SVMax A Feature Embedding Regularizer. A neural network regularizer (e.g., weight decay) boosts performance by explicitly penalizing the complexity of a network. In this paper, we penalize inferior network activations feature embeddings which in turn regularize the network's weights implicitly. We propose singular value maximization (SVMax) to learn a more uniform feature embedding. The SVMax regularizer supports both supervised and unsupervised learning. Our formulation mitigates model collapse and enables larger learning rates. We evaluate the SVMax regularizer using both retrieval and generative adversarial networks. We leverage a synthetic mixture of Gaussians dataset to evaluate SVMax in an unsupervised setting. For retrieval networks, SVMax achieves significant improvement margins across various ranking losses. Code available at https bit.ly 3jNkgDt


The "Bayesian" brain, with a bit less Bayes. The idea that the brain is a probabilistic (Bayesian) inference machine, continuously trying to figure out the hidden causes of its inputs, has become very influential in cognitive (neuro)science over recent decades. Here I present a relatively straightforward generalization of this idea the primary computational task that the brain is faced with is to track the probabilistic structure of observations themselves, without recourse to hidden states. Taking this starting point seriously turns out to have considerable explanatory power, and several key ideas are developed from it (1) past experience, encoded in prior expectations, has an influence over the future that is analogous to regularization as known from machine learning (2) action generation (interpreted as constraint satisfaction) is a special case of such regularization (3) the concept of attractors in dynamical systems provides a useful lens through which prior expectations, regularization, and action induction can be viewed these thus appear as different perspectives on the same phenomenon (4) the phylogenetically ancient imperative of acting to ensure and thereby observe conditions beneficial for survival is likely the same as that which underlies perceptual inference. The Bayesian brain hypothesis has been touted as promising to deliver a "unified science of mind and action". In this paper, I sketch an informal step towards fulfilling that promise, while avoiding some pitfalls that other such attempts have fallen prey to.


Camouflaged Object Segmentation with Distraction Mining. Camouflaged object segmentation (COS) aims to identify objects that are "perfectly" assimilate into their surroundings, which has a wide range of valuable applications. The key challenge of COS is that there exist high intrinsic similarities between the candidate objects and noise background. In this paper, we strive to embrace challenges towards effective and efficient COS. To this end, we develop a bio inspired framework, termed Positioning and Focus Network (PFNet), which mimics the process of predation in nature. Specifically, our PFNet contains two key modules, i.e., the positioning module (PM) and the focus module (FM). The PM is designed to mimic the detection process in predation for positioning the potential target objects from a global perspective and the FM is then used to perform the identification process in predation for progressively refining the coarse prediction via focusing on the ambiguous regions. Notably, in the FM, we develop a novel distraction mining strategy for distraction discovery and removal, to benefit the performance of estimation. Extensive experiments demonstrate that our PFNet runs in real time (72 FPS) and significantly outperforms 18 cutting edge models on three challenging datasets under four standard metrics.


Lightweight Robust Size Aware Cache Management. Modern key value stores, object stores, Internet proxy caches, as well as Content Delivery Networks (CDN) often manage objects of diverse sizes, e.g., blobs, video files of different lengths, images with varying resolution, and small documents. In such workloads, size aware cache policies outperform size oblivious algorithms. Unfortunately, existing size aware algorithms tend to be overly complicated and computationally expensive. Our work follows a more approachable pattern we extend the prevalent (size oblivious) TinyLFU cache admission policy to handle variable sized items. Implementing our approach inside two popular caching libraries only requires minor changes. We show that our algorithms yield competitive or better hit ratios and byte hit ratios compared to the state of the art size aware algorithms such as AdaptSize, LHD, LRB, and GDSF. Further, a runtime comparison indicates that our implementation is faster by up to x3 compared to the best alternative, i.e., it imposes much lower CPU overhead.


Homotopy patterns in group theory. This is a survey. The main subject of this survey is the homotopical or homological nature of certain structures which appear in classical problems about groups, Lie rings and group rings. It is well known that the (generalized) dimension subgroups have complicated combinatorial theories. In this paper we show that, in certain cases, the complexity of these theories is based on homotopy theory. The derived functors of non additive functors, homotopy groups of spheres, group homology etc appear naturally in problems formulated in purely group theoretical terms. The variety of structures appearing in the considered context is very rich. In order to illustrate it, we present this survey as a trip passing through examples having a similar nature.


AttWalk Attentive Cross Walks for Deep Mesh Analysis. Mesh representation by random walks has been shown to benefit deep learning. Randomness is indeed a powerful concept. However, it comes with a price some walks might wander around non characteristic regions of the mesh, which might be harmful to shape analysis, especially when only a few walks are utilized. We propose a novel walk attention mechanism that leverages the fact that multiple walks are used. The key idea is that the walks may provide each other with information regarding the meaningful (attentive) features of the mesh. We utilize this mutual information to extract a single descriptor of the mesh. This differs from common attention mechanisms that use attention to improve the representation of each individual descriptor. Our approach achieves SOTA results for two basic 3D shape analysis tasks classification and retrieval. Even a handful of walks along a mesh suffice for learning.


Linear cover time is exponentially unlikely. Proving a 2009 conjecture of Itai Benjamini, we show For any C there is an varepsilon 0 such that for any simple graph G on V of size n , and X 0, ldots an ordinary random walk on G , P( X 0, dots, X Cn V) e varepsilon n . A first ingredient in the proof of this is a similar statement for Markov chains in which all transition probabilities are sufficiently small relative to C .


Number of regions created by random chords in the circle. In this paper we discuss the number of regions in a unit circle after drawing n i.i.d. random chords in the circle according to a particular family of distribution. We find that as n goes to infinity, the distribution of the number of regions, properly shifted and scaled, converges to the standard normal distribution and the error can be bounded by Stein's method for proving Central Limit Theorem.


physics.ao-ph physics.app-ph physics.ins-det physics.space-ph

Revisting the limits of atmospheric temperature retrieval from cosmic ray measurements. A priori, cosmic ray measurements offer a unique capability to determine the vertical profile of atmospheric temperatures directly from ground. However, despite the increased understanding of the impact of the atmosphere on cosmic ray rates, attempts to explore the technological potential of the latter for atmospheric physics remain very limited. In this paper we examine the intrinsic limits of the process of cosmic ray data inversion for atmospheric temperature retrieval, by combining a detection station at ground with another one placed at an optimal depth, and making full use of the angular information. With that aim, the temperature induced variations in c. r. rates have been simulated resorting to the theoretical temperature coefficients W T(h, theta, E th ) and the temperature profiles obtained from the ERA5 atmospheric reanalysis. Muon absorption and Poisson statistics have been included to increase realism. The resulting c.r. sample has been used as input for the inverse problem and the obtained temperatures compared to the input temperature data. Relative to early simulation works, performed without using angular information and relying on underground temperature coefficients from a sub optimal depth, our analysis shows a strong improvement in temperature predictability for all atmospheric layers up to 50 hPa, nearing a factor 2 error reduction. Furthermore, the temperature predictability on 6 h intervals stays well within the range 0.8 2.2 K. Most remarkably, we show that it can be achieved with small area m 2 scale muon hodoscopes, amenable nowadays to a large variety of technologies. For mid latitude locations, the optimal depth of the underground station is around 20 m.


Persistence in randomly switched Lotka Volterra food chains. We consider a dynamical system obtained by the random switching between N Lotka Volterra food chains. Our key assumption will be that at least two vector fields only differ on the resources allocated to the growth rate of the first species. We will show that the existence of a positive equilibrium of the average vector field is equivalent to the persistence of all species. Under this condition, the semi group converges exponentially quickly to a unique invariant probability measure on the positive orthant. On the other hand, if this condition fails to hold, a group of species will become extinct exponentially quickly while the distribution of the remaining species will converge to another invariant probability measure. We will also analyse the sensibility of this model.


Robust Conic Satisficing. In practical optimization, we typically model uncertainty as a random variable though its true probability distribution is unobservable to the decision maker. Historical data provides some information of this distribution that we can use to approximately quantify the risk of an evaluation function that depends on both decision and uncertainty. This empirical optimization is vulnerable to the issues of overfitting, which could be overcome by several data driven robust optimization techniques. To tackle overfitting, Long et al. (2022) propose a robust satisficing model, which is specified by a performance target and a penalty function that measures the deviation of the uncertainty from its nominal value, and yields solutions with superior out of sample performance. We generalize the robust satisficing framework to conic optimization problems with recourse, which has broader applications in predictive and prescriptive analytics including risk management and statistical supervised learning. We derive an exact semidefinite optimization formulation for biconvex quadratic evaluation function, with quadratic penalty and ellipsoidal support set. More importantly, under complete and bounded recourse, and reasonably chosen polyhedral support set and penalty function, we propose safe approximations that do not lead to infeasible problems for any reasonably chosen target. We demonstrate that the assumption of complete and bounded recourse is however not unimpeachable, and then introduce a novel perspective casting technique to derive an equivalent conic optimization problem that satisfies the stated assumptions. Finally, through a computational study on data driven portfolio optimization (that maximizes the expected exponential utility of the portfolio returns), we show that the robust satisficing solutions significantly improve over the celebrated Markowitz model, which is prone to overfitting.


Analysis and Evaluation of Kinect based Action Recognition Algorithms. Human action recognition still exists many challenging problems such as different viewpoints, occlusion, lighting conditions, human body size and the speed of action execution, although it has been widely used in different areas. To tackle these challenges, the Kinect depth sensor has been developed to record real time depth sequences, which are insensitive to the color of human clothes and illumination conditions. Many methods on recognizing human action have been reported in the literature such as HON4D, HOPC, RBD and HDG, which use the 4D surface normals, pointclouds, skeleton based model and depth gradients respectively to capture discriminative information from depth videos or skeleton data. In this research project, the performance of four aforementioned algorithms will be analyzed and evaluated using five benchmark datasets, which cover challenging issues such as noise, change of viewpoints, background clutters and occlusions. We also implemented and improved the HDG algorithm, and applied it in cross view action recognition using the UWA3D Multiview Activity dataset. Moreover, we used different combinations of individual feature vectors in HDG for performance evaluation. The experimental results show that our improvement of HDG outperforms other three state of the art algorithms for cross view action recognition.


ANDREAS Artificial intelligence traiNing scheDuler foR accElerAted resource clusterS. Artificial Intelligence (AI) and Deep Learning (DL) algorithms are currently applied to a wide range of products and solutions. DL training jobs are highly resource demanding and they experience great benefits when exploiting AI accelerators (e.g., GPUs). However, the effective management of GPU powered clusters comes with great challenges. Among these, efficient scheduling and resource allocation solutions are crucial to maximize performance and minimize Data Centers operational costs. In this paper we propose ANDREAS, an advanced scheduling solution that tackles these problems jointly, aiming at optimizing DL training runtime workloads and their energy consumption in accelerated clusters. Experiments based on simulation demostrate that we can achieve a cost reduction between 30 and 62 on average with respect to first principle methods while the validation on a real cluster shows a worst case deviation below 13 between actual and predicted costs, proving the effectiveness of ANDREAS solution in practical scenarios.


How to Approximate Ontology Mediated Queries. We introduce and study several notions of approximation for ontology mediated queries based on the description logics ALC and ALCI. Our approximations are of two kinds we may (1) replace the ontology with one formulated in a tractable ontology language such as ELI or certain TGDs and (2) replace the database with one from a tractable class such as the class of databases whose treewidth is bounded by a constant. We determine the computational complexity and the relative completeness of the resulting approximations. (Almost) all of them reduce the data complexity from coNP complete to PTime, in some cases even to fixed parameter tractable and to linear time. While approximations of kind (1) also reduce the combined complexity, this tends to not be the case for approximations of kind (2). In some cases, the combined complexity even increases.


Overcoming the curse of dimensionality in the numerical approximation of backward stochastic differential equations. Backward stochastic differential equations (BSDEs) belong nowadays to the most frequently studied equations in stochastic analysis and computational stochastics. BSDEs in applications are often nonlinear and high dimensional. In nearly all cases such nonlinear high dimensional BSDEs cannot be solved explicitly and it has been and still is a very active topic of research to design and analyze numerical approximation methods to approximatively solve nonlinear high dimensional BSDEs. Although there are a large number of research articles in the scientific literature which analyze numerical approximation methods for nonlinear BSDEs, until today there has been no numerical approximation method in the scientific literature which has been proven to overcome the curse of dimensionality in the numerical approximation of nonlinear BSDEs in the sense that the number of computational operations of the numerical approximation method to approximatively compute one sample path of the BSDE solution grows at most polynomially in both the reciprocal 1 varepsilon of the prescribed approximation accuracy varepsilon in (0, infty) and the dimension d in mathbb N 1,2,3, ldots of the BSDE. It is the key contribution of this article to overcome this obstacle by introducing a new Monte Carlo type numerical approximation method for high dimensional BSDEs and by proving that this Monte Carlo type numerical approximation method does indeed overcome the curse of dimensionality in the approximative computation of solution paths of BSDEs.


VerLoc Verifiable Localization in Decentralized Systems. We tackle the challenge of reliably determining the geo location of nodes in decentralized networks, considering adversarial settings and without depending on any trusted landmarks. In particular, we consider active adversaries that control a subset of nodes, announce false locations and strategically manipulate measurements. To address this problem we propose, implement and evaluate VerLoc, a system that allows verifying the claimed geo locations of network nodes in a fully decentralized manner. VerLoc securely schedules roundtrip time (RTT) measurements between randomly chosen pairs of nodes. Trilateration is then applied to the set of measurements to verify claimed geo locations. We evaluate VerLoc both with simulations and in the wild using a prototype implementation integrated in the Nym network (currently run by thousands of nodes). We find that VerLoc can localize nodes in the wild with a median error of 60 km, and that in attack simulations it is capable of detecting and filtering out adversarial timing manipulations for network setups with up to 20 malicious nodes.


Automated Quality Control of Vacuum Insulated Glazing by Convolutional Neural Network Image Classification. Vacuum Insulated Glazing (VIG) is a highly thermally insulating window technology, which boasts an extremely thin profile and lower weight as compared to gas filled insulated glazing units of equivalent performance. The VIG is a double pane configuration with a submillimeter vacuum gap between the panes and therefore under constant atmospheric pressure over their service life. Small pillars are positioned between the panes to maintain the gap, which can damage the glass reducing the lifetime of the VIG unit. To efficiently assess any surface damage on the glass, an automated damage detection system is highly desirable. For the purpose of classifying the damage, we have developed, trained, and tested a deep learning computer vision system using convolutional neural networks. The classification model flawlessly classified the test dataset with an area under the curve (AUC) for the receiver operating characteristic (ROC) of 100 . We have automatically cropped the images down to their relevant information by using Faster RCNN to locate the position of the pillars. We employ the state of the art methods Grad CAM and Score CAM of explainable Artificial Intelligence (XAI) to provide an understanding of the internal mechanisms and were able to show that our classifier outperforms ResNet50V2 for identification of crack locations and geometry. The proposed methods can therefore be used to detect systematic defects even without large amounts of training data. Further analyses of our model's predictive capabilities demonstrates its superiority over state of the art models (ResNet50V2, ResNet101V2 and ResNet152V2) in terms of convergence speed, accuracy, precision at 100 recall and AUC for ROC.


DiscASP A Graph based ASP System for Finding Relevant Consistent Concepts with Applications to Conversational Socialbots. We consider the problem of finding relevant consistent concepts in a conversational AI system, particularly, for realizing a conversational socialbot. Commonsense knowledge about various topics can be represented as an answer set program. However, to advance the conversation, we need to solve the problem of finding relevant consistent concepts, i.e., find consistent knowledge in the "neighborhood" of the current topic being discussed that can be used to advance the conversation. Traditional ASP solvers will generate the whole answer set which is stripped of all the associations between the various atoms (concepts) and thus cannot be used to find relevant consistent concepts. Similarly, goal directed implementations of ASP will only find concepts directly relevant to a query. We present the DiscASP system that will find the partial consistent model that is relevant to a given topic in a manner similar to how a human will find it. DiscASP is based on a novel graph based algorithm for finding stable models of an answer set program. We present the DiscASP algorithm, its implementation, and its application to developing a conversational socialbot.


Error estimates for the Smagorinsky turbulence model enhanced stability through scale separation and numerical stabilization. In the present work we show some results on the effect of the Smagorinsky model on the stability of the associated perturbation equation. We show that in the presence of a spectral gap, such that the flow can be decomposed in a large scale with moderate gradient and a small amplitude fine scale with arbitratry gradient, the Smagorinsky model admits stability estimates for perturbations, with exponential growth depending only on the large scale gradient. We then show in the context of stabilized finite element methods that the same result carries over to the approximation and that in this context, for suitably chosen finite element spaces the Smagorinsky model acts as a stabilizer yielding close to optimal error estimates in the L 2 norm for smooth flows in the pre asymptotic high Reynolds number regime.


Semantics for Variational Quantum Programming. We consider a programming language that can manipulate both classical and quantum information. Our language is type safe and designed for variational quantum programming, which is a hybrid classical quantum computational paradigm. The classical subsystem of the language is the Probabilistic FixPoint Calculus (PFPC), which is a lambda calculus with mixed variance recursive types, term recursion and probabilistic choice. The quantum subsystem is a first order linear type system that can manipulate quantum information. The two subsystems are related by mixed classical quantum terms that specify how classical probabilistic effects are induced by quantum measurements, and conversely, how classical (probabilistic) programs can influence the quantum dynamics. We also describe a sound and computationally adequate denotational semantics for the language. Classical probabilistic effects are interpreted using a recently described commutative probabilistic monad on DCPO. Quantum effects and resources are interpreted in a category of von Neumann algebras that we show is enriched over (continuous) domains. This strong sense of enrichment allows us to develop novel semantic methods that we use to interpret the relationship between the quantum and classical probabilistic effects. By doing so we provide the first denotational analysis that relates models of classical probabilistic programming to models of quantum programming.