A Step Towards Efficient Evaluation of Complex Perception Tasks in Simulation. There has been increasing interest in characterising the error behaviour of systems which contain deep learning models before deploying them into any safety critical scenario. However, characterising such behaviour usually requires large scale testing of the model that can be extremely computationally expensive for complex real world tasks. For example, tasks involving compute intensive object detectors as one of their components. In this work, we propose an approach that enables efficient large scale testing using simplified low fidelity simulators and without the computational cost of executing expensive deep learning models. Our approach relies on designing an efficient surrogate model corresponding to the compute intensive components of the task under test. We demonstrate the efficacy of our methodology by evaluating the performance of an autonomous driving task in the Carla simulator with reduced computational expense by training efficient surrogate models for PIXOR and CenterPoint LiDAR detectors, whilst demonstrating that the accuracy of the simulation is maintained.


Enhanced Speaker aware Multi party Multi turn Dialogue Comprehension. Multi party multi turn dialogue comprehension brings unprecedented challenges on handling the complicated scenarios from multiple speakers and criss crossed discourse relationship among speaker aware utterances. Most existing methods deal with dialogue contexts as plain texts and pay insufficient attention to the crucial speaker aware clues. In this work, we propose an enhanced speaker aware model with masking attention and heterogeneous graph networks to comprehensively capture discourse clues from both sides of speaker property and speaker aware relationships. With such comprehensive speaker aware modeling, experimental results show that our speaker aware model helps achieves state of the art performance on the benchmark dataset Molweni. Case analysis shows that our model enhances the connections between utterances and their own speakers and captures the speaker aware discourse relations, which are critical for dialogue modeling.


A superposition theorem of Kolmogorov type for bounded continuous functions. Let C( mathbb R n) denote the set of real valued continuous functions defined on mathbb R n . We prove that for every n ge 2 there are positive numbers lambda 1 , ldots , lambda n and continuous functions phi 1 , ldots , phi m in C( mathbb R ) with the following property for every bounded and continuous f in C( mathbb R n ) there is a continuous function g in C( mathbb R ) such that f(x) sum q 1 m g left( sum p 1 n lambda p phi q (x p ) right) for every x (x 1 , ldots , x n ) in mathbb R n . Consequently, every f in C( mathbb R n) can be obtained from continuous functions of one variable using compositions and additions.


Configurations of rectangles in a set in mathbb F q 2 . Let mathbb F q be a finite field of order q . In this paper, we study the distribution of rectangles in a given set in mathbb F q 2 . More precisely, for any 0 delta le 1 , we prove that there exists an integer q 0 q 0( delta) with the following property if q ge q 0 and A is a multiplicative subgroup of mathbb F q with A ge q 2 3 , then any set S subset mathbb F q 2 with S ge delta q 2 contains at least gg frac S 4 A 2 q 5 rectangles with side lengths in A . We also consider the case of rectangles with one fixed side length and the other in a multiplicative subgroup A .


Deep Learning Based Steel Pipe Weld Defect Detection. Steel pipes are widely used in high risk and high pressure scenarios such as oil, chemical, natural gas, shale gas, etc. If there is some defect in steel pipes, it will lead to serious adverse consequences. Applying object detection in the field of deep learning to pipe weld defect detection and identification can effectively improve inspection efficiency and promote the development of industrial automation. Most predecessors used traditional computer vision methods applied to detect defects of steel pipe weld seams. However, traditional computer vision methods rely on prior knowledge and can only detect defects with a single feature, so it is difficult to complete the task of multi defect classification, while deep learning is end to end. In this paper, the state of the art single stage object detection algorithm YOLOv5 is proposed to be applied to the field of steel pipe weld defect detection, and compared with the two stage representative object detection algorithm Faster R CNN. The experimental results show that applying YOLOv5 to steel pipe weld defect detection can greatly improve the accuracy, complete the multi classification task, and meet the criteria of real time detection.


Robust Hybrid High Order method on polytopal meshes with small faces. We design a Hybrid High Order (HHO) scheme for the Poisson problem that is fully robust on polytopal meshes in the presence of small edges faces. We state general assumptions on the stabilisation terms involved in the scheme, under which optimal error estimates (in discrete and continuous energy norms, as well as L 2 norm) are established with multiplicative constants that do not depend on the maximum number of faces in each element, or the relative size between an element and its faces. We illustrate the error estimates through numerical simulations in 2D and 3D on meshes designed by agglomeration techniques (such meshes naturally have elements with a very large numbers of faces, and very small faces).


Positive solutions for singular double phase problems. We study the existence of positive solutions for a class of double phase Dirichlet equations which have the combined effects of a singular term and of a parametric superlinear term. The differential operator of the equation is the sum of a p Laplacian and of a weighted q Laplacian ( q p ) with discontinuous weight. Using the Nehari method, we show that for all small values of the parameter lambda 0 , the equation has at least two positive solutions.


Symmetry of Narayana numbers and rowvacuation of root posets. For a Weyl group W of rank r , the W Catalan number is the number of antichains of the poset of positive roots, and the W Narayana numbers refine the W Catalan number by keeping track of the cardinalities of these antichains. The W Narayana numbers are symmetric, i.e., the number of antichains of cardinality k is the same as the number of cardinality r k . However, this symmetry is far from obvious. Panyushev posed the problem of defining an involution on root poset antichains that exhibits the symmetry of the W Narayana numbers. Rowmotion and rowvacuation are two related operators, defined as compositions of "toggles," that give a dihedral action on the set of antichains of any ranked poset. Rowmotion acting on root posets has been the subject of a significant amount of research in the recent past. We prove that for the root posets of classical types, rowvacuation is Panyushev's desired involution.


text M , text B and text Co 1 are recognisable by their prime graphs. The prime graph, or Gruenberg Kegel graph, of a finite group G is the graph Gamma(G) whose vertices are the prime divisors of G , and whose edges are the pairs p,q for which G contains an element of order pq . A finite group G is recognisable by its prime graph if every finite group H with Gamma(H) Gamma(G) is isomorphic to G . By a result of Cameron and Maslova, every such group must be almost simple, so one natural case to investigate is that in which G is one of the 26 sporadic simple groups. Existing work of various authors answers the question of recognisability by prime graph for all but three of these groups, namely the Monster, text M , the Baby Monster, text B , and the first Conway group, text Co 1 . We prove that these three groups are recognisable by their prime graphs.


Measurement of the muon transfer rate from muonic hydrogen to oxygen in the range 70 336 K. The first measurement of the temperature dependence of the muon transfer rate from muonic hydrogen to oxygen was performed by the FAMU collaboration in 2016. The results provide evidence that the transfer rate rises with the temperature in the range 104 300 K. This paper presents the results of the experiment done in 2018 to extend the measurements towards lower (70 K) and higher (336 K) temperatures. The 2018 results confirm the temperature dependence of the muon transfer rate observed in 2016 and sets firm ground for comparison with the theoretical predictions.


Exercise with Social Robots Companion or Coach?. In this paper, we investigate the roles that social robots can take in physical exercise with human partners. In related work, robots or virtual intelligent agents take the role of a coach or instructor whereas in other approaches they are used as motivational aids. These are two "paradigms", so to speak, within the small but growing area of robots for social exercise. We designed an online questionnaire to test whether the preferred role in which people want to see robots would be the companion or the coach. The questionnaire asks people to imagine working out with a robot with the help of three utilized questionnaires (1) CART Q which is used for judging coach athlete relationships, (2) the mind perception questionnaire and (3) the System Usability Scale (SUS). We present the methodology, some preliminary results as well as our intended future work on personal robots for coaching.


Beam delivery systems for linac based proton therapy. This report presents a design of a gantry for proton therapy based on the concept of adiabatic transition. The use of fixed field alternating gradient magnets allows a large momentum acceptance and supports fast energy modulation. The optical performance of the gantry has been analysed using a beam tracking code. Several optimisations of the lattice and transition sections have been investigated to reduce size and ensure applicability to pencil beam scanning. Matching of the full energy range results in an increase in the size of the gantry, but reduces the weight and cost significantly compared to those that pertain to facilities in operation.


FRL Federated Rank Learning. Federated learning (FL) allows mutually untrusted clients to collaboratively train a common machine learning model without sharing their private proprietary training data among each other. FL is unfortunately susceptible to poisoning by malicious clients who aim to hamper the accuracy of the commonly trained model through sending malicious model updates during FL's training process. We argue that the key factor to the success of poisoning attacks against existing FL systems is the large space of model updates available to the clients, allowing malicious clients to search for the most poisonous model updates, e.g., by solving an optimization problem. To address this, we propose Federated Rank Learning (FRL). FRL reduces the space of client updates from model parameter updates (a continuous space of float numbers) in standard FL to the space of parameter rankings (a discrete space of integer values). To be able to train the global model using parameter ranks (instead of parameter weights), FRL leverage ideas from recent supermasks training mechanisms. Specifically, FRL clients rank the parameters of a randomly initialized neural network (provided by the server) based on their local training data. The FRL server uses a voting mechanism to aggregate the parameter rankings submitted by clients in each training epoch to generate the global ranking of the next training epoch. Intuitively, our voting based aggregation mechanism prevents poisoning clients from making significant adversarial modifications to the global model, as each client will have a single vote! We demonstrate the robustness of FRL to poisoning through analytical proofs and experimentation. We also show FRL's high communication efficiency. Our experiments demonstrate the superiority of FRL in real world FL settings.


Superrigidity for dense subgroups of Lie groups and their actions on homogeneous spaces. An essentially free group action of Gamma on (X, mu) is called W superrigid if the crossed product von Neumann algebra L infty(X) rtimes Gamma completely remembers the group Gamma and its action on (X, mu) . We prove W superrigidity for a class of infinite measure preserving actions, in particular for natural dense subgroups of isometries of the hyperbolic plane. The main tool is a new cocycle superrigidity theorem for dense subgroups of Lie groups acting by translation. We also provide numerous countable type II 1 equivalence relations that cannot be implemented by an essentially free action of a group, both of geometric nature and through a wreath product construction.


On the moduli spaces of framed logarithmic connections on a Riemann surface. We describe some results on moduli space of logarithmic connections equipped with framings on a n pointed compact Riemann surface.


Sequential n connectedness and infinite factorization in higher homotopy groups. A space X is "sequentially n connected" at x in X if for every 0 leq k leq n and sequence of maps f 1,f 2,f 3, dots S k to X that converges toward a point x in X , the maps f m contract by a sequence of null homotopies that converge toward x . We use this property, in conjunction with the Whitney Covering Lemma, as a foundation for developing new methods for characterizing higher homotopy groups of finite dimensional Peano continua. Among many new computations, a culminating result of this paper is if Y is a space obtained by attaching an infinite shrinking sequence A 1,A 2,A 3, dots of (n 1) connected CW complexes to a one dimensional Peano continuum X along a sequence of points in X , then there is an injection Phi pi n(Y) to prod j 1 infty bigoplus pi 1(X) pi n(A j) that is canonical after a certain choice of paths in X is made. Moreover, we characterize the image of Phi using generalized covering space theory. As a case of particular interest, this provides a characterization of pi n( mathbb H 1 vee mathbb H n) where mathbb H n denotes the n dimensional Hawaiian earring.


Analysis of bank leverage via dynamical systems and deep neural networks. We consider a model of a simple financial system consisting of a leveraged investor that invests in a risky asset and manages risk by using Value at Risk (VaR). The VaR is estimated by using past data via an adaptive expectation scheme. We show that the leverage dynamics can be described by a dynamical system of slow fast type associated with a unimodal map on 0,1 with an additive heteroscedastic noise whose variance is related to the portfolio rebalancing frequency to target leverage. In absence of noise the model is purely deterministic and the parameter space splits in two regions (i) a region with a globally attracting fixed point or a 2 cycle (ii) a dynamical core region, where the map could exhibit chaotic behavior. Whenever the model is randomly perturbed, we prove the existence of a unique stationary density with bounded variation, the stochastic stability of the process and the almost certain existence and continuity of the Lyapunov exponent for the stationary measure. We then use deep neural networks to estimate map parameters from a short time series. Using this method, we estimate the model in a large dataset of US commercial banks over the period 2001 2014. We find that the parameters of a substantial fraction of banks lie in the dynamical core, and their leverage time series are consistent with a chaotic behavior. We also present evidence that the time series of the leverage of large banks tend to exhibit chaoticity more frequently than those of small banks.


Computability, Complexity, Consistency and Controllability A Four C's Framework for cross disciplinary Ethical Algorithm Research. The ethical consequences of, constraints upon and regulation of algorithms arguably represent the defining challenges of our age, asking us to reckon with the rise of computational technologies whose potential to radically transforming social and individual orders and identity in unforeseen ways is already being realised. Yet despite the multidisciplinary impact of this algorithmic turn, there remains some way to go in motivating the crossdisciplinary collaboration that is crucial to advancing feasible proposals for the ethical design, implementation and regulation of algorithmic and automated systems. In this work, we provide a framework to assist cross disciplinary collaboration by presenting a Four C's Framework covering key computational considerations researchers across such diverse fields should consider when approaching these questions (i) computability, (ii) complexity, (iii) consistency and (iv) controllability. In addition, we provide examples of how insights from ethics, philosophy and population ethics are relevant to and translatable within sciences concerned with the study and design of algorithms. Our aim is to set out a framework which we believe is useful for fostering cross disciplinary understanding of pertinent issues in ethical algorithmic literature which is relevant considering the feasibility of ethical algorithmic governance, especially the impact of computational constraints upon algorithmic governance.


Learning Transferable Visual Models From Natural Language Supervision. State of the art computer vision systems are trained to predict a fixed set of predetermined object categories. This restricted form of supervision limits their generality and usability since additional labeled data is needed to specify any other visual concept. Learning directly from raw text about images is a promising alternative which leverages a much broader source of supervision. We demonstrate that the simple pre training task of predicting which caption goes with which image is an efficient and scalable way to learn SOTA image representations from scratch on a dataset of 400 million (image, text) pairs collected from the internet. After pre training, natural language is used to reference learned visual concepts (or describe new ones) enabling zero shot transfer of the model to downstream tasks. We study the performance of this approach by benchmarking on over 30 different existing computer vision datasets, spanning tasks such as OCR, action recognition in videos, geo localization, and many types of fine grained object classification. The model transfers non trivially to most tasks and is often competitive with a fully supervised baseline without the need for any dataset specific training. For instance, we match the accuracy of the original ResNet 50 on ImageNet zero shot without needing to use any of the 1.28 million training examples it was trained on. We release our code and pre trained model weights at https github.com OpenAI CLIP.


A Derivative based Parser Generator for Visibly Pushdown Grammars. In this paper, we present a derivative based, functional recognizer and parser generator for visibly pushdown grammars. The generated parser accepts ambiguous grammars and produces a parse forest containing all valid parse trees for an input string in linear time. Each parse tree in the forest can then be extracted also in linear time. Besides the parser generator, to allow more flexible forms of the visibly pushdown grammars, we also present a translator that converts a tagged CFG to a visibly pushdown grammar in a sound way, and the parse trees of the tagged CFG are further produced by running the semantic actions embedded in the parse trees of the translated visibly pushdown grammar. The performance of the parser is compared with a popular parsing tool ANTLR and other popular hand crafted parsers. The correctness of the core parsing algorithm is formally verified in the proof assistant Coq.


Nondegeneracy of heteroclinic orbits for a class of potentials on the plane. In the scalar case, the nondegeneracy of heteroclinic orbits is a well known property, commonly used in problems involving nonlinear elliptic, parabolic or hyperbolic P.D.E. On the other hand, Schatzman proved that in the vector case this assumption is generic, in the sense that for any potential W mathbb R m to mathbb R , m geq 2 , there exists an arbitrary small perturbation of W , such that for the new potential minimal heteroclinic orbits are nondegenerate. However, to the best of our knowledge, nontrivial explicit examples of such potentials are not available. In this paper, we prove the nondegeneracy of heteroclinic orbits for potentials W mathbb R 2 to 0, infty) that can be written as W(z) f(z) 2 , with f mathbb C to mathbb C a holomorphic function.


Translation functors for locally analytic representations. Let G be a p adic Lie group with reductive Lie algebra mathfrak g . In analogy to the translation functors introduced by Bernstein and Gelfand on categories of U( mathfrak g ) modules we consider similarly defined functors on the category of coadmissible modules over the locally analytic distribution algebra D(G) on which the center of U( mathfrak g ) acts locally finite. These functors induce equivalences between certain subcategories of the latter category. Furthermore, these translation functors are naturally related to those on category mathcal O via the functors from category mathcal O to the category of coadmissible modules. We also investigate the effect of the translation functors on locally analytic representations Pi(V) rm la associated by the p adic Langlands correspondence for rm GL 2( mathbb Q p) to 2 dimensional Galois representations V .


A Survey on Physarum Polycephalum Intelligent Foraging Behaviour and Bio Inspired Applications. In recent years, research on Physarum polycephalum has become more popular after Nakagaki et al. (2000) performed their famous experiment showing that Physarum was able to find the shortest route through a maze. Subsequent researches have confirmed the ability of Physarum inspired algorithms to solve a wide range of NP hard problems. In contrast to previous reviews that either focus on biological aspects or bio inspired applications, here we present a comprehensive review that highlights recent Physarum polycephalum biological aspects, mathematical models, and Physarum bio inspired algorithms and their applications. The novelty of this review stems from our exploration of Physarum intelligent behaviour in competition settings. Further, we have presented our new model to simulate Physarum in competition, where multiple Physarum interact with each other and with their environments. The bio inspired Physarum in competition algorithms proved to have great potentials for future research.


Safe Control in the Presence of Stochastic Uncertainties. Accurate quantification of safety is essential for the design of autonomous systems. In this paper, we present a methodology to characterize the exact probabilities associated with invariance and recovery in safe control. We consider a stochastic control system where control barrier functions, gradient based methods, and barrier certificates are used to constrain control actions and validate safety. We derive the probability distributions of the minimum and maximum barrier function values during any time interval and the first entry and exit times to and from any super level sets of the barrier function. These distributions are characterized by deterministic convection diffusion equations, and the approach used is generalizable to other safe control methods based on barrier functions. These distributions can be used to characterize various quantities associated with invariance and recovery, such as the safety margin, the probability of entering and recovering from safe and unsafe regions, and the mean and tail distributions of failure and recovery times.


McKean Vlasov type stochastic differential equations arising from the random vortex method. We study a class of McKean Vlasov type stochastic differential equations (SDEs) which arise from the random vortex dynamics and other physics models. By introducing a new approach we resolve the existence and uniqueness of both the weak and strong solutions for the McKean Vlasov stochastic differential equations whose coefficients are defined in terms of singular integral kernels such as the Biot Savart kernel. These SDEs which involve the distributions of solutions are in general not Lipschitz continuous with respect to the usual distances on the space of distributions such as the Wasserstein distance. Therefore there is an obstacle in adapting the ordinary SDE method for the study of this class of SDEs, and the conventional methods seem not appropriate for dealing with such distributional SDEs which appear in applications such as fluid mechanics.


Surveying the Research on Fake News in Social Media a Tale of Networks and Language. The history of journalism and news diffusion is tightly coupled with the effort to dispel hoaxes, misinformation, propaganda, unverified rumours, poor reporting, and messages containing hate and divisions. With the explosive growth of online social media and billions of individuals engaged with consuming, creating, and sharing news, this ancient problem has surfaced with a renewed intensity threatening our democracies, public health, and news outlets credibility. This has triggered many researchers to develop new methods for studying, understanding, detecting, and preventing fake news diffusion as a consequence, thousands of scientific papers have been published in a relatively short period, making researchers of different disciplines to struggle in search of open problems and most relevant trends. The aim of this survey is threefold first, we want to provide the researchers interested in this multidisciplinary and challenging area with a network based analysis of the existing literature to assist them with a visual exploration of papers that can be of interest second, we present a selection of the main results achieved so far adopting the network as an unifying framework to represent and make sense of data, to model diffusion processes, and to evaluate different debunking strategies. Finally, we present an outline of the most relevant research trends focusing on the moving target of fake news, bots, and trolls identification by means of data mining and text technologies despite scholars working on computational linguistics and networks traditionally belong to different scientific communities, we expect that forthcoming computational approaches to prevent fake news from polluting the social media must be developed using hybrid and up to date methodologies.


Implementing a foveal pit inspired filter in a Spiking Convolutional Neural Network a preliminary study. We have presented a Spiking Convolutional Neural Network (SCNN) that incorporates retinal foveal pit inspired Difference of Gaussian filters and rank order encoding. The model is trained using a variant of the backpropagation algorithm adapted to work with spiking neurons, as implemented in the Nengo library. We have evaluated the performance of our model on two publicly available datasets one for digit recognition task, and the other for vehicle recognition task. The network has achieved up to 90 accuracy, where loss is calculated using the cross entropy function. This is an improvement over around 57 accuracy obtained with the alternate approach of performing the classification without any kind of neural filtering. Overall, our proof of concept study indicates that introducing biologically plausible filtering in existing SCNN architecture will work well with noisy input images such as those in our vehicle recognition task. Based on our results, we plan to enhance our SCNN by integrating lateral inhibition based redundancy reduction prior to rank ordering, which will further improve the classification accuracy by the network.


Modelling the non local thermodynamic equilibrium spectra of silylene (SiH2). This paper sets out a robust methodology for modelling spectra of polyatomic molecules produced in reactive or dissociative environments, with vibrational populations outside local thermal equilibrium (LTE). The methodology is based on accurate, extensive ro vibrational line lists containing transitions with high vibrational excitations and relies on the detailed ro vibrational assignments. The developed methodology is applied to model non LTE IR and visible spectra of silylene (SiH 2 ) produced in a decomposition of disilane (Si 2 H 6 ), a reaction of technological importance. Two approaches for non LTE vibrational populations of the product SiH 2 are introduced a simplistic 1D approach based on the Harmonic approximation and a full 3D model incorporating accurate vibrational wavefunctions of SiH 2 computed variationally with the TROVE (Theoretical ROVibrational Energy) program. We show how their non LTE spectral signatures can be used to trace different reaction channels of molecular dissociations.


COVID 19 sentiment analysis via deep learning during the rise of novel cases. Social scientists and psychologists take interest in understanding how people express emotions and sentiments when dealing with catastrophic events such as natural disasters, political unrest, and terrorism. The COVID 19 pandemic is a catastrophic event that has raised a number of psychological issues such as depression given abrupt social changes and lack of employment. Advancements of deep learning based language models have been promising for sentiment analysis with data from social networks such as Twitter. Given the situation with COVID 19 pandemic, different countries had different peaks where the rise and fall of new cases affected lock downs which directly affected the economy and employment. During the rise of COVID 19 cases with stricter lock downs, people have been expressing their sentiments in social media. This can provide a deep understanding of human psychology during catastrophic events. In this paper, we present a framework that employs deep learning based language models via long short term memory (LSTM) recurrent neural networks for sentiment analysis during the rise of novel COVID 19 cases in India. The framework features LSTM language model with a global vector embedding and state of art BERT language model. We review the sentiments expressed for selective months in 2020 which covers the first major peak of novel cases in India. Our framework utilises multi label sentiment classification where more than one sentiment can be expressed at once. Our results indicate that the majority of the tweets have been positive with high levels of optimism during the rise of the novel COVID 19 cases and the number of tweets significantly lowered towards the peak. The predictions generally indicate that although the majority have been optimistic, a significant group of population has been annoyed towards the way the pandemic was handled by the authorities.


Variational embedding of protein folding simulations using gaussian mixture variational autoencoders. Conformational sampling of biomolecules using molecular dynamics simulations often produces large amount of high dimensional data that makes it difficult to interpret using conventional analysis techniques. Dimensionality reduction methods are thus required to extract useful and relevant information. Here we devise a machine learning method, Gaussian mixture variational autoencoder (GMVAE) that can simultaneously perform dimensionality reduction and clustering of biomolecular conformations in an unsupervised way. We show that GMVAE can learn a reduced representation of the free energy landscape of protein folding with highly separated clusters that correspond to the metastable states during folding. Since GMVAE uses a mixture of Gaussians as the prior, it can directly acknowledge the multi basin nature of protein folding free energy landscape. To make the model end to end differentialble, we use a Gumbel softmax distribution. We test the model on three long timescale protein folding trajectories and show that GMVAE embedding resembles the folding funnel with folded states down the funnel and unfolded states outer in the funnel path. Additionally, we show that the latent space of GMVAE can be used for kinetic analysis and Markov state models built on this embedding produce folding and unfolding timescales that are in close agreement with other rigorous dynamical embeddings such as time independent component analysis (TICA).


Boost then Convolve Gradient Boosting Meets Graph Neural Networks. Graph neural networks (GNNs) are powerful models that have been successful in various graph representation learning tasks. Whereas gradient boosted decision trees (GBDT) often outperform other machine learning methods when faced with heterogeneous tabular data. But what approach should be used for graphs with tabular node features? Previous GNN models have mostly focused on networks with homogeneous sparse features and, as we show, are suboptimal in the heterogeneous setting. In this work, we propose a novel architecture that trains GBDT and GNN jointly to get the best of both worlds the GBDT model deals with heterogeneous features, while GNN accounts for the graph structure. Our model benefits from end to end optimization by allowing new trees to fit the gradient updates of GNN. With an extensive experimental comparison to the leading GBDT and GNN models, we demonstrate a significant increase in performance on a variety of graphs with tabular features. The code is available https github.com nd7141 bgnn.


A note on the Compactness of Poincare Einstein manifolds. For a conformally compact Poincar ' e Einstein manifold (X,g ) , we consider two types of compactifications for it. One is bar g rho 2g , where rho is a fixed smooth defining function the other is the adapted (including Fefferman Graham) compactification bar g s rho 2 sg with a continuous parameter s frac n 2 . In this paper, we mainly prove that for a set of conformally compact Poincar ' e Einstein manifolds (X, g (i) ) with conformal infinity of positive Yamabe type, bar g (i) is compact in C k, alpha ( overline X ) topology if and only if bar g s (i) is compact in some C l, beta ( overline X ) topology, provided that bar g (i) TM bar g s (i) TM hat g (i) and hat g (i) has positive scalar curvature for each i . See Theorem 1.1 and Corollary 1.1 for the exact relation of (k, alpha) and (l, beta) .


Split and Bridge Adaptable Class Incremental Learning within a Single Neural Network. Continual learning has been a major problem in the deep learning community, where the main challenge is how to effectively learn a series of newly arriving tasks without forgetting the knowledge of previous tasks. Initiated by Learning without Forgetting (LwF), many of the existing works report that knowledge distillation is effective to preserve the previous knowledge, and hence they commonly use a soft label for the old task, namely a knowledge distillation (KD) loss, together with a class label for the new task, namely a cross entropy (CE) loss, to form a composite loss for a single neural network. However, this approach suffers from learning the knowledge by a CE loss as a KD loss often more strongly influences the objective function when they are in a competitive situation within a single network. This could be a critical problem particularly in a class incremental scenario, where the knowledge across tasks as well as within the new task, both of which can only be acquired by a CE loss, is essentially learned due to the existence of a unified classifier. In this paper, we propose a novel continual learning method, called Split and Bridge, which can successfully address the above problem by partially splitting a neural network into two partitions for training the new task separated from the old task and re connecting them for learning the knowledge across tasks. In our thorough experimental analysis, our Split and Bridge method outperforms the state of the art competitors in KD based continual learning.


A Gillet Waldhausen Theorem for chain complexes of sets. The (A)CGW categories of Campbell and Zakharevich show how finite sets and varieties behave like the objects of an exact category for the purpose of algebraic K theory. We further develop that program by defining chain complexes and quasi isomorphisms for any category with suitably nice coproducts. In particular, chain complexes of finite sets satisfy an analogue of the Gillet Waldhausen Theorem their K theory agrees with the classical K theory of finite sets. Along the way, we define new double categorical structures that modify those of Campbell and Zakharevich to include the data of weak equivalences. These ECGW categories produce K theory spectra which satisfy analogues of the Additivity and Fibration Theorems. The weak equivalences are determined by a subcategory of acyclic objects satisfying minimal conditions, resulting in a Localization Theorem that generalizes previous versions in the literature.


Finite quotients, arithmetic invariants, and hyperbolic volume. For any pair of orientable closed hyperbolic 3 manifolds, this paper shows that any isomorphism between the profinite completions of their fundamental groups witnesses a bijective correspondence between the Zariski dense mathrm PSL (2, mathbb Q mathtt ac ) representations of their fundamental groups, up to conjugacy moreover, corresponding pairs of representations have identical invariant trace fields and isomorphic invariant quaternion algebras. (Here, mathbb Q mathtt ac denotes an algebraic closure of mathbb Q .) Next, assuming the p adic Borel regulator injectivity conjecture for number fields, this paper shows that uniform lattices in mathrm PSL (2, mathbb C ) with isomorphic profinite completions have identical invariant trace fields, isomorphic invariant quaternion algebras, identical covolume, and identical arithmeticity.


On square free and radical factorizations and existence of some divisors. We discuss various square free and radical factorizations and existence of some divisors in monoids in the context of atomicity, ascending chain condition for principal ideals, a pre Schreier property, a greatest common divisor property and a greatest common divisor for sets property.


Deployment Optimization for Shared e Mobility Systems with Multi agent Deep Neural Search. Shared e mobility services have been widely tested and piloted in cities across the globe, and already woven into the fabric of modern urban planning. This paper studies a practical yet important problem in those systems how to deploy and manage their infrastructure across space and time, so that the services are ubiquitous to the users while sustainable in profitability. However, in real world systems evaluating the performance of different deployment strategies and then finding the optimal plan is prohibitively expensive, as it is often infeasible to conduct many iterations of trial and error. We tackle this by designing a high fidelity simulation environment, which abstracts the key operation details of the shared e mobility systems at fine granularity, and is calibrated using data collected from the real world. This allows us to try out arbitrary deployment plans to learn the optimal given specific context, before actually implementing any in the real world systems. In particular, we propose a novel multi agent neural search approach, in which we design a hierarchical controller to produce tentative deployment plans. The generated deployment plans are then tested using a multi simulation paradigm, i.e., evaluated in parallel, where the results are used to train the controller with deep reinforcement learning. With this closed loop, the controller can be steered to have higher probability of generating better deployment plans in future iterations. The proposed approach has been evaluated extensively in our simulation environment, and experimental results show that it outperforms baselines e.g., human knowledge, and state of the art heuristic based optimization approaches in both service coverage and net revenue.


DataWords Getting Contrarian with Text, Structured Data and Explanations. Our goal is to build classification models using a combination of free text and structured data. To do this, we represent structured data by text sentences, DataWords, so that similar data items are mapped into the same sentence. This permits modeling a mixture of text and structured data by using only text modeling algorithms. Several examples illustrate that it is possible to improve text classification performance by first running extraction tools (named entity recognition), then converting the output to DataWords, and adding the DataWords to the original text before model building and classification. This approach also allows us to produce explanations for inferences in terms of both free text and structured data.


Some existence and uniqueness results for logistic Choquard equation. We consider the following doubly nonlocal nonlinear logistic problem driven by the fractional p Laplacian begin equation pl u f(x,u) cq text in O, u 0 text in Rn setminus O. end equation Here O subset Rn (N geq2) is a bounded domain with C 1,1 boundary partial O , s in (0,1) , p in (1, infty) are such that ps N . Also p s, a leq r infty , where p s, a (2N a) 2N . Under suitable and general assumptions on the nonlinearity f , we study the existence, nonexistence, uniqueness, and regularity of weak solutions. As for applications, we treat cases of subdiffusive type logistic Choquard problem. We also consider in the superdiffusive case the Brezis Nirenberg type problem with logistic Choquard and show the existence of a nontrivial solution for a suitable choice of l . Finally for a particular choice of f viz. f(x,t) l t q 1 with 1 p 2r q , we show the existence of at least one energy nodal solution.


Recurrently Predicting Hypergraphs. This work considers predicting the relational structure of a hypergraph for a given set of vertices, as common for applications in particle physics, biological systems and other complex combinatorial problems. A problem arises from the number of possible multi way relationships, or hyperedges, scaling in mathcal O (2 n) for a set of n elements. Simply storing an indicator tensor for all relationships is already intractable for moderately sized n , prompting previous approaches to restrict the number of vertices a hyperedge connects. Instead, we propose a recurrent hypergraph neural network that predicts the incidence matrix by iteratively refining an initial guess of the solution. We leverage the property that most hypergraphs of interest are sparsely connected and reduce the memory requirement to mathcal O (nk) , where k is the maximum number of positive edges, i.e., edges that actually exist. In order to counteract the linearly growing memory cost from training a lengthening sequence of refinement steps, we further propose an algorithm that applies backpropagation through time on randomly sampled subsequences. We empirically show that our method can match an increase in the intrinsic complexity without a performance decrease and demonstrate superior performance compared to state of the art models.


Federated Learning Opportunities and Challenges. Federated Learning (FL) is a concept first introduced by Google in 2016, in which multiple devices collaboratively learn a machine learning model without sharing their private data under the supervision of a central server. This offers ample opportunities in critical domains such as healthcare, finance etc, where it is risky to share private user information to other organisations or devices. While FL appears to be a promising Machine Learning (ML) technique to keep the local data private, it is also vulnerable to attacks like other ML models. Given the growing interest in the FL domain, this report discusses the opportunities and challenges in federated learning.


Impedance eigenvalues in linear elasticity. This paper is devoted to studying impedance eigenvalues (that is, eigenvalues of a particular Dirichlet to Neumann map) for the time harmonic linear elastic wave problem, and their potential use as target signatures for fluid solid interaction problems. We first consider several possible families of eigenvalues of the elasticity problem, focusing on certain impedance eigenvalues that are an analogue of Steklov eigenvalues. We show that one of these families arises naturally in inverse scattering. We also analyse their approximation from far field measurements of the scattered pressure field in the fluid, and illustrate several alternative methods of approximation in the case of an isotropic elastic disk.


Linking Health News to Research Literature. Accurately linking news articles to scientific research works is a critical component in a number of applications, such as measuring the social impact of a research work and detecting inaccuracies or distortions in science news. Although the lack of links between news and literature has been a challenge in these applications, it is a relatively unexplored research problem. In this paper we designed and evaluated a new approach that consists of (1) augmenting latest named entity recognition techniques to extract various metadata, and (2) designing a new elastic search engine that can facilitate the use of enriched metadata queries. To evaluate our approach, we constructed two datasets of paired news articles and research papers one is used for training models to extract metadata, and the other for evaluation. Our experiments showed that the new approach performed significantly better than a baseline approach used by altmetric.com (0.89 vs 0.32 in terms of top 1 accuracy). To further demonstrate the effectiveness of the approach, we also conducted a study on 37,600 health related press releases published on EurekAlert!, which showed that our approach was able to identify the corresponding research papers with a top 1 accuracy of at least 0.97.


WOLF A modular estimation framework for robotics based on factor graphs. This paper introduces WOLF, a C estimation framework based on factor graphs and targeted at mobile robotics. WOLF can be used beyond SLAM to handle self calibration, model identification, or the observation of dynamic quantities other than localization. The architecture of WOLF allows for a modular yet tightly coupled estimator. Modularity is enhanced via reusable plugins that are loaded at runtime depending on application setup. This setup is achieved conveniently through YAML files, allowing users to configure a wide range of applications without the need of writing or compiling code. Most procedures are coded as abstract algorithms in base classes with varying levels of specialization. Overall, all these assets allow for coherent processing and favor code re usability and scalability. WOLF can be used with ROS, and is made publicly available and open to collaboration.


A priori sparsification of Galerkin based reduced order models. A methodology to generate sparse Galerkin models of chaotic unsteady fluid flows containing a minimal number of active triadic interactions is proposed. The key idea is to find an appropriate set of basis functions for the projection representing elementary flow structures that interact minimally one with the other and thus result in a triadic interaction coefficient tensor with sparse structure. Interpretable and computationally efficient Galerkin models can be thus obtained, since a reduced number of triadic interactions needs to be computed to evaluate the right hand side of the model. To find the basis functions, a subspace rotation technique is used, whereby a set of Proper Orthogonal Decomposition (POD) modes is rotated into a POD subspace of larger dimension using coordinates associated to low energy dissipative scales to alter energy paths and the structure of the triadic interaction coefficient tensor. This rotation is obtained as the solution of a non convex optimisation problem that maximises the energy captured by the new basis, promotes sparsity and ensures long term temporal stability of the sparse Galerkin system. We demonstrate the approach on two dimensional lid driven cavity flow at Re 2 times 10 4 where the motion is chaotic. We show that the procedure generates Galerkin models with a reduced set of active triadic interactions, distributed in modal space according to established knowledge of scale interactions in two dimensional flows. This property, however, is only observed if long term temporal stability is explicitly included in the formulation, indicating that a dynamical constraint is necessary to obtain a physically consistent sparsification.


Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks. Systematic compositionality is an essential mechanism in human language, allowing the recombination of known parts to create novel expressions. However, existing neural models have been shown to lack this basic ability in learning symbolic structures. Motivated by the failure of a Transformer model on the SCAN compositionality challenge (Lake and Baroni, 2018), which requires parsing a command into actions, we propose two auxiliary sequence prediction tasks that track the progress of function and argument semantics, as additional training supervision. These automatically generated sequences are more representative of the underlying compositional symbolic structures of the input data. During inference, the model jointly predicts the next action and the next tokens in the auxiliary sequences at each step. Experiments on the SCAN dataset show that our method encourages the Transformer to understand compositional structures of the command, improving its accuracy on multiple challenging splits from 10 to 100 . With only 418 (5 ) training instances, our approach still achieves 97.8 accuracy on the MCD1 split. Therefore, we argue that compositionality can be induced in Transformers given minimal but proper guidance. We also show that a better result is achieved using less contextualized vectors as the attention's query, providing insights into architecture choices in achieving systematic compositionality. Finally, we show positive generalization results on the groundedSCAN task (Ruis et al., 2020). Our code is publicly available at https github.com jiangycTarheel compositional auxseq


On graph norms for complex valued functions. For any given graph H , one may define a natural corresponding functional . H for real valued functions by using homomorphism density. One may also extend this to complex valued functions, once H is paired with a 2 edge colouring alpha to assign conjugates. We say that H is real norming (resp. complex norming) if . H (resp. . H, alpha for some alpha ) is a norm on the vector space of real valued (resp. complex valued) functions. These generalise the Gowers octahedral norms, a widely used tool in extremal combinatorics to quantify quasirandomness. We unify these two seemingly different notions of graph norms in real and complex valued settings. Namely, we prove that H is complex norming if and only if it is real norming and simply call the property norming. Our proof does not explicitly construct a suitable 2 edge colouring alpha but obtains its existence and uniqueness, which may be of independent interest. As an application, we give various example graphs that are not norming. In particular, we show that hypercubes are not norming, which resolves the last outstanding problem posed in Hatami's pioneering work on graph norms.


Model theoretic properties of dynamics on the Cantor set. We examine topological dynamical systems on the Cantor set from the point of view of the continuous model theory of commutative C algebras. After some general remarks we focus our attention on the generic homeomorphism of the Cantor set, as constructed by Akin, Glasner, and Weiss. We show that this homeomorphism is the prime model of its theory. We also show that the notion of "generic" used by Akin, Glasner, and Weiss is distinct from the notion of "generic" encountered in Fraisse theory.


Sparse Depth Completion with Semantic Mesh Deformation Optimization. Sparse depth measurements are widely available in many applications such as augmented reality, visual inertial odometry and robots equipped with low cost depth sensors. Although such sparse depth samples work well for certain applications like motion tracking, a complete depth map is usually preferred for broader applications, such as 3D object recognition, 3D reconstruction and autonomous driving. Despite the recent advancements in depth prediction from single RGB images with deeper neural networks, the existing approaches do not yield reliable results for practical use. In this work, we propose a neural network with post optimization, which takes an RGB image and sparse depth samples as input and predicts the complete depth map. We make three major contributions to advance the state of the art an improved backbone network architecture named EDNet, a semantic edge weighted loss function and a semantic mesh deformation optimization method. Our evaluation results outperform the existing work consistently on both indoor and outdoor datasets, and it significantly reduces the mean average error by up to 19.5 under the same settings of 200 sparse samples on NYU Depth V2 dataset.


A decoupling and linearizing discretization for weakly coupled poroelasticity with nonlinear permeability. We analyze a semi explicit time discretization scheme of first order for poro elasticity with nonlinear permeability provided that the elasticity model and the flow equation are only weakly coupled. The approach leads to a decoupling of the equations and, at the same time, linearizes the nonlinearity without the need of further inner iteration steps. Hence, the computational speed up is twofold without a loss in the convergence rate. We prove optimal first order error estimates by considering a related delay system and investigate the method numerically for different examples with various types of nonlinear displacement permeability relations.


Turan problems for k geodetic digraphs. A digraph G is emph k geodetic if for any pair of (not necessarily distinct) vertices u,v in V(G) there is at most one walk of length leq k from u to v in G . In this paper we determine the largest possible size of a k geodetic digraph with given order. We then consider the more difficult problem of the largest size of a strongly connected k geodetic digraph with given order, solving this problem for k 2 and giving a construction which we conjecture to be extremal for larger k . We close with some results on generalised Tur ' a n problems for the number of directed cycles and paths in k geodetic digraphs.


On Coordinate Decoding for Keypoint Estimation Tasks. A series of 2D (and 3D) keypoint estimation tasks are built upon heatmap coordinate representation, i.e. a probability map that allows for learnable and spatially aware encoding and decoding of keypoint coordinates on grids, even allowing for sub pixel coordinate accuracy. In this report, we aim to reproduce the findings of DARK that investigated the 2D heatmap representation by highlighting the importance of the encoding of the ground truth heatmap and the decoding of the predicted heatmap to keypoint coordinates. The authors claim that a) a more principled distribution aware coordinate decoding method overcomes the limitations of the standard techniques widely used in the literature, and b), that the reconstruction of heatmaps from ground truth coordinates by generating accurate and continuous heatmap distributions lead to unbiased model training, contrary to the standard coordinate encoding process that quantizes the keypoint coordinates on the resolution of the input image grid.


Invertible Surrogate Models Joint surrogate modelling and reconstruction of Laser Wakefield Acceleration by invertible neural networks. Invertible neural networks are a recent technique in machine learning promising neural network architectures that can be run in forward and reverse mode. In this paper, we will be introducing invertible surrogate models that approximate complex forward simulation of the physics involved in laser plasma accelerators iLWFA. The bijective design of the surrogate model also provides all means for reconstruction of experimentally acquired diagnostics. The quality of our invertible laser wakefield acceleration network will be verified on a large set of numerical LWFA simulations.


Siegel modular forms of degree two and level five. We construct a ring of meromorphic Siegel modular forms of degree 2 and level 5, with singularities supported on an arrangement of Humbert surfaces, which is generated by four singular theta lifts of weights 1, 1, 2, 2 and their Jacobian. We use this to prove that the ring of holomorphic Siegel modular forms of degree 2 and level Gamma 0(5) is minimally generated by eighteen modular forms of weights 2, 4, 4, 4, 4, 4, 6, 6, 6, 6, 10, 11, 11, 11, 13, 13, 13, 15.


Tabulation of knots up to five triple crossings and moves between oriented diagrams. We enumerate and show tables of minimal diagrams for all prime knots up to the triple crossing number equal to five. We derive a minimal generating set of oriented moves connecting triple crossing diagrams of the same oriented knot. We also present a conjecture about a strict lower bound of the triple crossing number of a knot related to the breadth of its Alexander polynomial.


Full state approximation by Galerkin projection reduced order models for stochastic and bilinear systems. In this paper, the problem of full state approximation by model reduction is studied for stochastic and bilinear systems. Our proposed approach relies on identifying the dominant subspaces based on the reachability Gramian of a system. Once the desired subspace is computed, the reduced order model is then obtained by a Galerkin projection. We prove that, in the stochastic case, this approach either preserves mean square asymptotic stability or leads to reduced models whose minimal realization is mean square asymptotically stable. This stability preservation guarantees the existence of the reduced system reachability Gramian which is the basis for the full state error bounds that we derive. This error bound depends on the neglected eigenvalues of the reachability Gramian and hence shows that these values are a good indicator for the expected error in the dimension reduction procedure. Subsequently, we establish the stability preservation result and the error bound for a full state approximation to bilinear systems in a similar manner. These latter results are based on a recently proved link between stochastic and bilinear systems. We conclude the paper by numerical experiments using a benchmark problem. We compare this approach with balanced truncation and show that it performs well in reproducing the full state of the system. end abstract


Blowup solutions for the shadow limit model of singular Gierer Meinhardt system with critical parameters. We consider a nonlocal parabolic PDE, which may be regarded as the standard semilinear heat equation with power nonlinearity, where the nonlinear term is divided by some Sobolev norm of the solution. In this paper, we are interested in constructing blowup solutions under some critical regimes. We had a complete new phenomenon of the blowup speed with a log correction term.


Efficient Belief Propagation List Ordered Statistics Decoding of Polar Codes. New algorithms for efficient decoding of polar codes (which may be CRC augmented), transmitted over either a binary erasure channel (BEC) or an additive white Gaussian noise channel (AWGNC), are presented. We start by presenting a new efficient exact maximum likelihood decoding algorithm for the BEC based on inactivation decoding and analyze its computational complexity. This algorithm applies a matrix triangulation process on a sparse polar code parity check matrix, followed by solving a small size linear system over GF(2). We then consider efficient decoding of polar codes, transmitted over the AWGNC. The algorithm applies CRC aided belief propagation list (CBPL) decoding, followed by ordered statistics decoding (OSD) of low order. Even when the reprocessing order of the OSD is as low as one, the new decoder is shown to significantly improve on plain CBPL. To implement the OSD efficiently, we adapt the matrix triangulation algorithm from the BEC case. We also indicate how the decoding algorithms can be implemented in parallel for low latency decoding. Numerical simulations are used to evaluate the performance and computational complexity of the new algorithms.


WiseR An end to end structure learning and deployment framework for causal graphical models. Structure learning offers an expressive, versatile and explainable approach to causal and mechanistic modeling of complex biological data. We present wiseR, an open source application for learning, evaluating and deploying robust causal graphical models using graph neural networks and Bayesian networks. We demonstrate the utility of this application through application on for biomarker discovery in a COVID 19 clinical dataset.


Riemann Roch inequality for smooth tropical toric surfaces. For a divisor D on a tropical variety X , we define two amounts in order to estimate the value of h 0 (X,D) , which are described by terms of global sections and computed more easily than h 0 (X,D) . As an application of its estimation, we show that a Riemann Roch inequality holds for smooth tropical toric surfaces.


Fully symmetric controllable integrated three resonator photonic molecule. Photonic molecules can be used to realize complex optical energy states and modes, analogous to those found in molecules, with properties useful for applications like spectral engineering and quantum optics. It is desirable to implement photonic molecules using high quality factor photonic integrated ring resonators due to their narrow atom like spectral resonance, tunability, and the ability to scale the number of resonators on a photonic circuit. However, to take full advantage of molecule spectral complexity and tuning degree of freedom, resonator structures should have full symmetry in terms of inter resonator coupling and resonator waveguide coupling as well as independent resonance tuning, and low power dissipation operation, in a scalable integration platform. To date, photonic molecule symmetry has been limited to dual and triple cavity geometries coupled to single or dual busses, and resonance tuning limited to dual resonator molecules. In this paper, we demonstrate a three resonator photonic molecule, consisting of symmetrically coupled 8.11 million intrinsic Q silicon nitride rings, where each ring is coupled to the other two rings. The resonance of each ring, and that of the collective molecule, is controlled using low power dissipation, monolithically integrated thin film lead zirconate titanate (PZT) actuators that are integrated with the ultra low loss silicon nitride resonators. This performance is achieved without undercut waveguides, yielding the highest Q to date for a PZT controlled resonator. This advance leads to full control of complex photonic molecule resonance spectra and splitting in a wafer scale integration platform. The resulting six tunable supermodes can be fully controlled, including degeneracy, location and splitting as well as designed by a model that can accurately predict the energy modes and transmission spectrum and tunable resonance splitting.


Constructions of tight sets of the Hermitian polar space mc H (2r 1,q 2) . In this paper, we construct two infinite families of tight sets with parameters (q 2r 2 1) and (q 2r 1 q 2r 2 ) , respectively, in the Hermitian polar space mathcal H (2r 1,q 2) for any r ge 2 and any prime power q . Both families admit (q 1). PGL(r,q 2).2.2e as the full automorphism group, where q p e , p is a prime, and e a positive integer.


RSK in last passage percolation a unified approach. We present a version of the RSK correspondence based on the Pitman transform and geometric considerations. This version unifies ordinary RSK, dual RSK and continuous RSK. We show that this version is both a bijection and an isometry, two crucial properties for taking limits of last passage percolation models. We use the bijective property to give a non computational proof that dual RSK maps Bernoulli walks to nonintersecting Bernoulli walks.


Optimising the selection of samples for robust lidar camera calibration. We propose a robust calibration pipeline that optimises the selection of calibration samples for the estimation of calibration parameters that fit the entire scene. We minimise user error by automating the data selection process according to a metric, called Variability of Quality (VOQ) that gives a score to each calibration set of samples. We show that this VOQ score is correlated with the estimated calibration parameter's ability to generalise well to the entire scene, thereby overcoming the overfitting problems of existing calibration algorithms. Our approach has the benefits of simplifying the calibration process for practitioners of any calibration expertise level and providing an objective measure of the quality for our calibration pipeline's input and output data. We additionally use a novel method of assessing the accuracy of the calibration parameters. It involves computing reprojection errors for the entire scene to ensure that the parameters are well fitted to all features in the scene. Our proposed calibration pipeline takes 90s, and obtains an average reprojection error of 1 1.2cm, with standard deviation of 0.4 0.5cm over 46 poses evenly distributed in a scene. This process has been validated by experimentation on a high resolution, software definable lidar, Baraja Spectrum Scan and a low, fixed resolution lidar, Velodyne VLP 16. We have shown that despite the vast differences in lidar technologies, our proposed approach manages to estimate robust calibration parameters for both. Our code and data set used for this paper are made available as open source.


Split Learning Meets Koopman Theory for Wireless Remote Monitoring and Prediction. Remote state monitoring over wireless is envisaged to play a pivotal role in enabling beyond 5G applications ranging from remote drone control to remote surgery. One key challenge is to identify the system dynamics that is non linear with a large dimensional state. To obviate this issue, in this article we propose to train an autoencoder whose encoder and decoder are split and stored at a state sensor and its remote observer, respectively. This autoencoder not only decreases the remote monitoring payload size by reducing the state representation dimension, but also learns the system dynamics by lifting it via a Koopman operator, thereby allowing the observer to locally predict future states after training convergence. Numerical results under a non linear cart pole environment demonstrate that the proposed split learning of a Koopman autoencoder can locally predict future states, and the prediction accuracy increases with the representation dimension and transmission power.


Fluid flow in the sarcomere. A highly organized and densely packed lattice of molecular machinery within the sarcomeres of muscle cells powers contraction. Although many of the proteins that drive contraction have been studied extensively, the mechanical impact of fluid shearing within the lattice of molecular machinery has received minimal attention. It was recently proposed that fluid flow augments substrate transport in the sarcomere, however, this analysis used analytical models of fluid flow in the molecular machinery that could not capture its full complexity. By building a finite element model of the sarcomere, we estimate the explicit flow field, and contrast it with analytical models. Our results demonstrate that viscous drag forces on sliding filaments are surprisingly small in contrast to the forces generated by single myosin molecular motors. This model also indicates that the energetic cost of fluid flow through viscous shearing with lattice proteins is likely minimal. The model also highlights a steep velocity gradient between sliding filaments and demonstrates that the maximal radial fluid velocity occurs near the tips of the filaments. To our knowledge, this is the first computational analysis of fluid flow within the highly structured sarcomere.


Crowd sensing Enhanced Parking Patrol using Trajectories of Sharing Bikes. Illegal vehicle parking is a common urban problem faced by major cities in the world, as it incurs traffic jams, which lead to air pollution and traffic accidents. The government highly relies on active human efforts to detect illegal parking events. However, such an approach is extremely ineffective to cover a large city since the police have to patrol over the entire city roads. The massive and high quality sharing bike trajectories from Mobike offer us a unique opportunity to design a ubiquitous illegal parking detection approach, as most of the illegal parking events happen at curbsides and have significant impact on the bike users. The detection result can guide the patrol schedule, i.e. send the patrol policemen to the region with higher illegal parking risks, and further improve the patrol efficiency. Inspired by this idea, three main components are employed in the proposed framework 1) em trajectory pre processing , which filters outlier GPS points, performs map matching, and builds trajectory indexes 2) em illegal parking detection , which models the normal trajectories, extracts features from the evaluation trajectories, and utilizes a distribution test based method to discover the illegal parking events and 3) em patrol scheduling , which leverages the detection result as reference context, and models the scheduling task as a multi agent reinforcement learning problem to guide the patrol police. Finally, extensive experiments are presented to validate the effectiveness of illegal parking detection, as well as the improvement of patrol efficiency.


ComSum Commit Messages Summarization and Meaning Preservation. We present ComSum, a data set of 7 million commit messages for text summarization. When documenting commits, software code changes, both a message and its summary are posted. We gather and filter those to curate developers' work summarization data set. Along with its growing size, practicality and challenging language domain, the data set benefits from the living field of empirical software engineering. As commits follow a typology, we propose to not only evaluate outputs by Rouge, but by their meaning preservation.


How Good is a Video Summary? A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarization. Automatic video summarization is still an unsolved problem due to several challenges. The currently available datasets either have very short videos or have few long videos of only a particular type. We introduce a new benchmarking video dataset called VISIOCITY (VIdeo SummarIzatiOn based on Continuity, Intent and DiversiTY) which comprises of longer videos across six different categories with dense concept annotations capable of supporting different flavors of video summarization and other vision problems. For long videos, human reference summaries necessary for supervised video summarization techniques are difficult to obtain. We explore strategies to automatically generate multiple reference summaries from indirect ground truth present in VISIOCITY. We show that these summaries are at par with human summaries. We also present a study of different desired characteristics of a good summary and demonstrate how it is normal to have two good summaries with different characteristics. Thus we argue that evaluating a summary against one or more human summaries and using a single measure has its shortcomings. We propose an evaluation framework for better quantitative assessment of summary quality which is closer to human judgment. Lastly, we present insights into how a model can be enhanced to yield better summaries. Sepcifically, when multiple diverse ground truth summaries can exist, learning from them individually and using a combination of loss functions measuring different characteristics is better than learning from a single combined (oracle) ground truth summary using a single loss function. We demonstrate the effectiveness of doing so as compared to some of the representative state of the art techniques tested on VISIOCITY. We release VISIOCITY as a benchmarking dataset and invite researchers to test the effectiveness of their video summarization algorithms on VISIOCITY.


Algorithmic Reconstruction of the Fiber of Persistent Homology on Cell Complexes. Let K be a finite simplicial, cubical, delta or CW complex. The persistence map mathrm PH takes a filter f K rightarrow mathbb R as input and returns the barcodes mathrm PH (f) of the associated sublevel set persistent homology modules. We address the inverse problem given a target barcode D , computing the fiber mathrm PH 1 (D) . For this, we use the fact that mathrm PH 1 (D) decomposes as complex of polyhedra when K is a simplicial complex, and we generalise this result to arbitrary based chain complexes. We then design and implement a depth first search algorithm that recovers the polyhedra forming the fiber mathrm PH 1 (D) . As an application, we solve a corpus of 120 sample problems, providing a first insight into the statistical structure of these fibers, for general CW complexes.


Assessing Fairness in Classification Parity of Machine Learning Models in Healthcare. Fairness in AI and machine learning systems has become a fundamental problem in the accountability of AI systems. While the need for accountability of AI models is near ubiquitous, healthcare in particular is a challenging field where accountability of such systems takes upon additional importance, as decisions in healthcare can have life altering consequences. In this paper we present preliminary results on fairness in the context of classification parity in healthcare. We also present some exploratory methods to improve fairness and choosing appropriate classification algorithms in the context of healthcare.


The Gradient Convergence Bound of Federated Multi Agent Reinforcement Learning with Efficient Communication. The paper considers a distributed version of deep reinforcement learning (DRL) for multi agent decision making process in the paradigm of federated learning. Since the deep neural network models in federated learning are trained locally and aggregated iteratively through a central server, frequent information exchange incurs a large amount of communication overheads. Besides, due to the heterogeneity of agents, Markov state transition trajectories from different agents are usually unsynchronized within the same time interval, which will further influence the convergence bound of the aggregated deep neural network models. Therefore, it is of vital importance to reasonably evaluate the effectiveness of different optimization methods. Accordingly, this paper proposes a utility function to consider the balance between reducing communication overheads and improving convergence performance. Meanwhile, this paper develops two new optimization methods on top of variation aware periodic averaging methods 1) the decay based method which gradually decreases the weight of the model's local gradients within the progress of local updating, and 2) the consensus based method which introduces the consensus algorithm into federated learning for the exchange of the model's local gradients. This paper also provides novel convergence guarantees for both developed methods and demonstrates their effectiveness and efficiency through theoretical analysis and numerical simulation results.


Robust Attack Detection Approach for IIoT Using Ensemble Classifier. Generally, the risks associated with malicious threats are increasing for the IIoT and its related applications due to dependency on the Internet and the minimal resource availability of IoT devices. Thus, anomaly based intrusion detection models for IoT networks are vital. Distinct detection methodologies need to be developed for the IIoT network as threat detection is a significant expectation of stakeholders. Machine learning approaches are considered to be evolving techniques that learn with experience, and such approaches have resulted in superior performance in various applications, such as pattern recognition, outlier analysis, and speech recognition. Traditional techniques and tools are not adequate to secure IIoT networks due to the use of various protocols in industrial systems and restricted possibilities of upgradation. In this paper, the objective is to develop a two phase anomaly detection model to enhance the reliability of an IIoT network. In the first phase, SVM and Naive Bayes are integrated using an ensemble blending technique. K fold cross validation is performed while training the data with different training and testing ratios to obtain optimized training and test sets. Ensemble blending uses a random forest technique to predict class labels. An Artificial Neural Network (ANN) classifier that uses the Adam optimizer to achieve better accuracy is also used for prediction. In the second phase, both the ANN and random forest results are fed to the model's classification unit, and the highest accuracy value is considered the final result. The proposed model is tested on standard IoT attack datasets, such as WUSTL IIOT 2018, N BaIoT, and Bot IoT. The highest accuracy obtained is 99 . The results also demonstrate that the proposed model outperforms traditional techniques and thus improves the reliability of an IIoT network.


The Old and the New Can Physics Informed Deep Learning Replace Traditional Linear Solvers?. Physics Informed Neural Networks (PINN) are neural networks encoding the problem governing equations, such as Partial Differential Equations (PDE), as a part of the neural network. PINNs have emerged as a new essential tool to solve various challenging problems, including computing linear systems arising from PDEs, a task for which several traditional methods exist. In this work, we focus first on evaluating the potential of PINNs as linear solvers in the case of the Poisson equation, an omnipresent equation in scientific computing. We characterize PINN linear solvers in terms of accuracy and performance under different network configurations (depth, activation functions, input data set distribution). We highlight the critical role of transfer learning. Our results show that low frequency components of the solution converge quickly as an effect of the F principle. In contrast, an accurate solution of the high frequencies requires an exceedingly long time. To address this limitation, we propose integrating PINNs into traditional linear solvers. We show that this integration leads to the development of new solvers whose performance is on par with other high performance solvers, such as PETSc conjugate gradient linear solvers, in terms of performance and accuracy. Overall, while the accuracy and computational performance are still a limiting factor for the direct use of PINN linear solvers, hybrid strategies combining old traditional linear solver approaches with new emerging deep learning techniques are among the most promising methods for developing a new class of linear solvers.


Window Detection In Facade Imagery A Deep Learning Approach Using Mask R CNN. The parsing of windows in building facades is a long desired but challenging task in computer vision. It is crucial to urban analysis, semantic reconstruction, lifecycle analysis, digital twins, and scene parsing amongst other building related tasks that require high quality semantic data. This article investigates the usage of the mask R CNN framework to be used for window detection of facade imagery input. We utilize transfer learning to train our proposed method on COCO weights with our own collected dataset of street view images of facades to produce instance segmentations of our new window class. Experimental results show that our suggested approach with a relatively small dataset trains the network only with transfer learning and augmentation achieves results on par with prior state of the art window detection approaches, even without post optimization techniques.


Efficient Classification of Very Large Images with Tiny Objects. An increasing number of applications in computer vision, specially, in medical imaging and remote sensing, become challenging when the goal is to classify very large images with tiny informative objects. Specifically, these classification tasks face two key challenges i ) the size of the input image is usually in the order of mega or giga pixels, however, existing deep architectures do not easily operate on such big images due to memory constraints, consequently, we seek a memory efficient method to process these images and ii ) only a very small fraction of the input images are informative of the label of interest, resulting in low region of interest (ROI) to image ratio. However, most of the current convolutional neural networks (CNNs) are designed for image classification datasets that have relatively large ROIs and small image sizes (sub megapixel). Existing approaches have addressed these two challenges in isolation. We present an end to end CNN model termed Zoom In network that leverages hierarchical attention sampling for classification of large images with tiny objects using a single GPU. We evaluate our method on four large image histopathology, road scene and satellite imaging datasets, and one gigapixel pathology dataset. Experimental results show that our model achieves higher accuracy than existing methods while requiring less memory resources.


Data Expansion using Back Translation and Paraphrasing for Hate Speech Detection. With proliferation of user generated contents in social media platforms, establishing mechanisms to automatically identify toxic and abusive content becomes a prime concern for regulators, researchers, and society. Keeping the balance between freedom of speech and respecting each other dignity is a major concern of social media platform regulators. Although, automatic detection of offensive content using deep learning approaches seems to provide encouraging results, training deep learning based models requires large amounts of high quality labeled data, which is often missing. In this regard, we present in this paper a new deep learning based method that fuses a Back Translation method, and a Paraphrasing technique for data augmentation. Our pipeline investigates different word embedding based architectures for classification of hate speech. The back translation technique relies on an encoder decoder architecture pre trained on a large corpus and mostly used for machine translation. In addition, paraphrasing exploits the transformer model and the mixture of experts to generate diverse paraphrases. Finally, LSTM, and CNN are compared to seek enhanced classification results. We evaluate our proposal on five publicly available datasets namely, AskFm corpus, Formspring dataset, Warner and Waseem dataset, Olid, and Wikipedia toxic comments dataset. The performance of the proposal together with comparison to some related state of art results demonstrate the effectiveness and soundness of our proposal.


Sketches image analysis Web image search engine usingLSH index and DNN InceptionV3. The adoption of an appropriate approximate similarity search method is an essential prereq uisite for developing a fast and efficient CBIR system, especially when dealing with large amount ofdata. In this study we implement a web image search engine on top of a Locality Sensitive Hashing(LSH) Index to allow fast similarity search on deep features. Specifically, we exploit transfer learningfor deep features extraction from images. Firstly, we adopt InceptionV3 pretrained on ImageNet asfeatures extractor, secondly, we try out several CNNs built on top of InceptionV3 as convolutionalbase fine tuned on our dataset. In both of the previous cases we index the features extracted within ourLSH index implementation so as to compare the retrieval performances with and without fine tuning.In our approach we try out two different LSH implementations the first one working with real numberfeature vectors and the second one with the binary transposed version of those vectors. Interestingly,we obtain the best performances when using the binary LSH, reaching almost the same result, in termsof mean average precision, obtained by performing sequential scan of the features, thus avoiding thebias introduced by the LSH index. Lastly, we carry out a performance analysis class by class in terms ofrecall againstmAPhighlighting, as expected, a strong positive correlation between the two.


FWB Net Front White Balance Network for Color Shift Correction in Single Image Dehazing via Atmospheric Light Estimation. In recent years, single image dehazing deep models based on Atmospheric Scattering Model (ASM) have achieved remarkable results. But the dehazing outputs of those models suffer from color shift. Analyzing the ASM model shows that the atmospheric light factor (ALF) is set as a scalar which indicates ALF is constant for whole image. However, for images taken in real world, the illumination is not uniformly distributed over whole image which brings model mismatch and possibly results in color shift of the deep models using ASM. Bearing this in mind, in this study, first, a new non homogeneous atmospheric scattering model (NH ASM) is proposed for improving image modeling of hazy images taken under complex illumination conditions. Second, a new U Net based front white balance module (FWB Module) is dedicatedly designed to correct color shift before generating dehazing result via atmospheric light estimation. Third, a new FWB loss is innovatively developed for training FWB Module, which imposes penalty on color shift. In the end, based on NH ASM and front white balance technology, an end to end CNN based color shift restraining dehazing network is developed, termed as FWB Net. Experimental results demonstrate the effectiveness and superiority of our proposed FWB Net for dehazing on both synthetic and real world images.


Multi Agent MDP Homomorphic Networks. This paper introduces Multi Agent MDP Homomorphic Networks, a class of networks that allows distributed execution using only local information, yet is able to share experience between global symmetries in the joint state action space of cooperative multi agent systems. In cooperative multi agent systems, complex symmetries arise between different configurations of the agents and their local observations. For example, consider a group of agents navigating rotating the state globally results in a permutation of the optimal joint policy. Existing work on symmetries in single agent reinforcement learning can only be generalized to the fully centralized setting, because such approaches rely on the global symmetry in the full state action spaces, and these can result in correspondences across agents. To encode such symmetries while still allowing distributed execution we propose a factorization that decomposes global symmetries into local transformations. Our proposed factorization allows for distributing the computation that enforces global symmetries over local agents and local interactions. We introduce a multi agent equivariant policy network based on this factorization. We show empirically on symmetric multi agent problems that globally symmetric distributable policies improve data efficiency compared to non equivariant baselines.


LQResNet A Deep Neural Network Architecture for Learning Dynamic Processes. Mathematical modeling is an essential step, for example, to analyze the transient behavior of a dynamical process and to perform engineering studies such as optimization and control. With the help of first principles and expert knowledge, a dynamic model can be built, but for complex dynamic processes, appearing, e.g., in biology, chemical plants, neuroscience, financial markets, this often remains an onerous task. Hence, data driven modeling of the dynamics process becomes an attractive choice and is supported by the rapid advancement in sensor and measurement technology. A data driven approach, namely operator inference framework, models a dynamic process, where a particular structure of the nonlinear term is assumed. In this work, we suggest combining the operator inference with certain deep neural network approaches to infer the unknown nonlinear dynamics of the system. The approach uses recent advancements in deep learning and possible prior knowledge of the process if possible. We also briefly discuss several extensions and advantages of the proposed methodology. We demonstrate that the proposed methodology accomplishes the desired tasks for dynamics processes encountered in neural dynamics and the glycolytic oscillator.


Recursive constructions of amoebas. Global amoebas are a wide and rich family of graphs that emerged from the study of certain Ramsey Tur 'an problems in 2 colorings of the edges of the complete graph K n that deal with the appearance of unavoidable patterns once a certain amount of edges in each color is guaranteed. Indeed, it turns out that, as soon as such coloring constraints are satisfied and if n is sufficiently large, then every global amoeba can be found embedded in K n such that it has half its edges in each color. Even more surprising, every bipartite global amoeba G is unavoidable in every tonal variation, meaning that, for any pair of integers r, b such that r b is the number of edges of G , there is a subgraph of K n isomorphic to G with r edges in the first color and b edges in the second. The feature that makes global amoebas work are one by one edge replacements that leave the structure of the graph invariant. By means of a group theoretical approach, the dynamics of this feature can be modeled. As a counterpart to the global amoebas that "live" inside a possibly large complete graph K n , we also consider local amoebas which are spanning subgraphs of K n with the same feature. In an effort to highlight their richness and versatility, we present here three different recursive constructions of amoebas, two of them yielding interesting families per se and one of them offering a wide range of possibilities.


Preferential attachment hypergraph with high modularity. Numerous works have been proposed to generate random graphs preserving the same properties as real life large scale networks. However, many real networks are better represented by hypergraphs. Few models for generating random hypergraphs exist and no general model allows to both preserve a power law degree distribution and a high modularity indicating the presence of communities. We present a dynamic preferential attachment hypergraph model which features partition into communities. We prove that its degree distribution follows a power law and we give theoretical lower bounds for its modularity. We compare its characteristics with a real life co authorship network and show that our model achieves good performances. We believe that our hypergraph model will be an interesting tool that may be used in many research domains in order to reflect better real life phenomena.


Combinatorial games on multi type Galton Watson trees. When normal and mis e re games are played on bi type binary Galton Watson trees (with vertices coloured blue or red and each having either no child or precisely 2 children), with one player allowed to move along monochromatic edges and the other along non monochromatic edges, the draw probabilities equal 0 unless every vertex gives birth to one blue and one red child. On bi type Poisson trees where each vertex gives birth to Poisson ( lambda) offspring in total, the draw probabilities approach 1 as lambda rightarrow infty . We study such emph novel versions of normal, mis e re and escape games on rooted multi type Galton Watson trees, with the "permissible" edges for one player being disjoint from those of her opponent. The probabilities of the games' outcomes are analyzed, compared with each other, and their behaviours as functions of the underlying law explored.


Ultrafast Spin to Orbit and Orbit to Local Spin Conversions of Tightly Focused Hybridly Polarized Light Pulses. Spin orbit interaction (SOI) have provided a new viable roadmap for the development of spin based photonics devices. However, existing strategies to control the SOI focus commonly on tailoring the spatial dimension of light fields yet neglecting the inherent temporal one. Herein, we first present ultrafast temporal effects on both spin to orbit and orbit to local spin conversions based on the time assistant vectorial diffractive theory and the fast Fourier transformation. Such interconversions depend upon whether the incident hybridly vectorial light pulse carries vortex phase or not in a single high numerical aperture geometry. For the case of the absence of vortex phase, we find that it enables orbit angular momentum carrying transverse component fields, and the resultant orbit angular momentum embedded within focused light fields remains constantly revolving as time elapses, which indicates that the controllable spin to orbit conversion occurs. By contrast, it is revealed that hybridly polarized vectorial vortex light pulses allow access to the locally excited circular polarization at the focus, and this induced local circular polarization is independent of ultrafast varying time, whereas the resulting spin angular momentum density components experience the alternation between the appearance and annihilation over time, thus giving rise to the tunable orbit to local spin conversion. These exotic ultrafast interconversions not only breathe a new life into the area of ultrafast photonics, but refresh our understanding on the paradigm of photonic SOI.


The network epidemiology of an Ebola epidemic. Connecting the different scales of epidemic dynamics, from individuals to communities to nations, remains one of the main challenges of disease modeling. Here, we revisit one of the largest public health efforts deployed against a localized epidemic the 2014 2016 Ebola Virus Disease (EVD) epidemic in Sierra Leone. We leverage the data collected by the surveillance and contact tracing protocols of the Sierra Leone Ministry of Health and Sanitation, the US Centers for Disease Control and Prevention, and other responding partners to validate a network epidemiology framework connecting the population (incidence), community (local forecasts), and individual (secondary infections) scales of disease transmission. In doing so, we gain a better understanding of what brought the EVD epidemic to an end Reduction of introduction in new clusters (primary cases), and not reduction in local transmission patterns (secondary infections). We also find that the first 90 days of the epidemic contained enough information to produce probabilistic forecasts of EVD cases forecasts which we show are confirmed independently by both disease surveillance and contact tracing. Altogether, using data available two months before the start of the international support to the local response, network epidemiology could have inferred heterogeneity in local transmissions, the risk for superspreading events, and probabilistic forecasts of eventual cases per community. We expect that our framework will help connect large data collection efforts with individual behavior, and help reduce uncertainty during health emergencies and emerging epidemics.


Universal coupler for bulk whispering gallery mode resonators based on silicon subwavelength grating waveguides. Optical microresonators are of paramount importance in photonic circuits requiring fine spectral filtering or resonant light recirculation. Key performance metrics improve with increasing resonance quality factor (Q) across all applications. The performance of silicon photonic circuits is often hampered by the low quality factor of planar silicon microresonators, typically of Q 10 4 10 5. On the other hand, bulk whispering gallery mode resonators provide a wide range of materials with intriguing optical properties and exceptionally high resonant quality factors Q 10 7. However, the efficient coupling between bulk resonators and planar Si photonic waveguides is considered challenging, if not impossible, due to remarkably large mismatch in size and refractive index. Here, we show an efficient method to couple bulk resonators and Si waveguides based on subwavelength metamaterial engineering of silicon. Based on this approach, we experimentally demonstrate coupling between 220 nm thick Si waveguides and bulk microresonators made of silica, lithium niobate and calcium fluoride with diameters in the 0.3 3.5 mm range, achieving high coupling efficiency of 75 99 and exceptional Q of 10 6 10 7. These results open a new route for the heterogeneous integration of bulk resonators and silicon photonic circuits, with great potential for applications in sensing, microwave photonics, and quantum photonics, to name a few.


Near Optimal Dispersion on Arbitrary Anonymous Graphs. Given an undirected, anonymous, port labeled graph of n memory less nodes, m edges, and degree Delta , we consider the problem of dispersing k leq n robots (or tokens) positioned initially arbitrarily on one or more nodes of the graph to exactly k different nodes of the graph, one on each node. The objective is to simultaneously minimize time to achieve dispersion and memory requirement at each robot. If all k robots are positioned initially on a single node, depth first search (DFS) traversal solves this problem in O( min m,k Delta ) time with Theta( log(k Delta)) bits at each robot. However, if robots are positioned initially on multiple nodes, the best previously known algorithm solves this problem in O( min m,k Delta cdot log ell) time storing Theta( log(k Delta)) bits at each robot, where ell leq k 2 is the number of multiplicity nodes in the initial configuration. In this paper, we present a novel multi source DFS traversal algorithm solving this problem in O( min m,k Delta ) time with Theta( log(k Delta)) bits at each robot, improving the time bound of the best previously known algorithm by O( log ell) and matching asymptotically the single source DFS traversal bounds. This is the first algorithm for dispersion that is optimal in both time and memory in arbitrary anonymous graphs of constant degree, Delta O(1) . Furthermore, the result holds in both synchronous and asynchronous settings.