Visualizing femtosecond dynamics with ultrafast electron probes through terahertz compression and time stamping. Visualizing ultrafast dynamics at the atomic scale requires time resolved pump probe characterization with femtosecond temporal resolution. For single shot ultrafast electron diffraction (UED) with fully relativistic electron bunch probes, existing techniques are limited by the achievable electron probe bunch length, charge, and timing jitter. We present the first experimental demonstration of pump probe UED with THz driven compression and time stamping that enable UED probes with unprecedented temporal resolution. This technique utilizes two counter propagating quasi single cycle THz pulses generated from two OH 1 organic crystals coupled into an optimized THz compressor structure. Ultrafast dynamics of photoexcited bismuth films show an improved temporal resolution from 178 fs down to 85 fs when the THz compressed UED probes are used with no time stamping correction. Furthermore, we use a novel time stamping technique to reveal transient oscillations in the dynamical response of THz excited single crystal gold films previously inaccessible by standard UED, achieving a time stamped temporal resolution down to 5 fs.


Chain flaring and L 2 torsion of free by cyclic groups. We introduce a condition on the monodromy of a free by cyclic group, G phi , called the chain flare condition, that implies that the L 2 torsion, rho (2) (G phi) , is non zero. We conjecture that this condition holds whenever the monodromy is exponentially growing.


Scale free tree network with an ultra large diameter. Scale free networks are prevalently observed in a great variety of complex systems, which triggers various researches relevant to networked models of such type. In this work, we propose a family of growth tree networks mathcal T t , which turn out to be scale free, in an iterative manner. As opposed to most of published tree models with scale free feature, our tree networks have the power law exponent gamma 1 ln5 ln2 that is obviously larger than 3 . At the same time, "small world" property can not be found particularly because models mathcal T t have an ultra large diameter D t , i.e., D t sim mathcal T t ln3 ln5 where mathcal T t represents vertex number. In addition, we also study random walks on tree networks mathcal T t and derive exact solution to mean hitting time langle mathcal H t rangle . The results suggest that analytic formula for quantity langle mathcal H t rangle as a function of vertex number mathcal T t has a power law form, i.e., langle mathcal H t rangle sim mathcal T t 1 ln3 ln5 , a characteristic that is rarely encountered in the realm of scale free tree networks. Lastly, we execute extensive experimental simulations, and find that empirical analysis is in strong agreement with theoretical results.


Conceptual similarity and communicative need shape colexification an experimental study. Colexification refers to the phenomenon of multiple meanings sharing one word in a language. Cross linguistic lexification patterns have been shown to be largely predictable, as similar concepts are often colexified. We test a recent claim that, beyond this general tendency, communicative needs play an important role in shaping colexification patterns. We approach this question by means of a series of human experiments, using an artificial language communication game paradigm. Our results across four experiments match the previous cross linguistic findings all other things being equal, speakers do prefer to colexify similar concepts. However, we also find evidence supporting the communicative need hypothesis when faced with a frequent need to distinguish similar pairs of meanings, speakers adjust their colexification preferences to maintain communicative efficiency, and avoid colexifying those similar meanings which need to be distinguished in communication. This research provides further evidence to support the argument that languages are shaped by the needs and preferences of their speakers.


Aggregation of network traffic and anisotropic scaling of random fields. We discuss joint spatial temporal scaling limits of sums A lambda, gamma (indexed by (x,y) in R 2 ) of large number O( lambda gamma ) of independent copies of integrated input process X X(t), t ge 0 at time scale lambda , for any given gamma 0 . We consider two classes of inputs X (I) Poisson shot noise with (random) pulse process, and (II) regenerative process with random pulse process and regeneration times following a heavy tailed stationary renewal process. The above classes include several queueing and network traffic models for which joint spatial temporal limits were previously discussed in the literature. In both cases (I) and (II) we find simple conditions on the input process in order that normalized random fields A lambda, gamma tend to an alpha stable L 'e vy sheet (1 alpha 2) if gamma gamma 0 , and to a fractional Brownian sheet if gamma gamma 0 , for some gamma 0 0 . We also prove an intermediate' limit for gamma gamma 0 .


Rota Baxter operators on groups. Theory of Rota Baxter operators on rings and algebras has been developed since 1960. Recently, L. Guo, H. Lang, Y. Sheng arXiv 2009.03492 have defined the notion of Rota Baxter operator on a group. We provide some general constructions of Rota Baxter operators on a group. Given a map on a group, we study its extensions to a Rota Baxter operator. We state the connection between Rota Baxter operators on a group and Rota Baxter operators on an associated Lie ring. We describe Rota Baxter operators on sporadic simple groups.


Spillover Algorithm A Decentralized Coordination Approach for Multi Robot Production Planning in Open Shared Factories. Open and shared manufacturing factories typically dispose of a limited number of robots that should be properly allocated to tasks in time and space for an effective and efficient system performance. In particular, we deal with the dynamic capacitated production planning problem with sequence independent setup costs where quantities of products to manufacture and location of robots need to be determined at consecutive periods within a given time horizon and products can be anticipated or backordered related to the demand period. We consider a decentralized multi agent variant of this problem in an open factory setting with multiple owners of robots as well as different owners of the items to be produced, both considered self interested and individually rational. Existing solution approaches to the classic constrained lot sizing problem are centralized exact methods that require sharing of global knowledge of all the participants' private and sensitive information and are not applicable in the described multi agent context. Therefore, we propose a computationally efficient decentralized approach based on the spillover effect that solves this NP hard problem by distributing decisions in an intrinsically decentralized multi agent system environment while protecting private and sensitive information. To the best of our knowledge, this is the first decentralized algorithm for the solution of the studied problem in intrinsically decentralized environments where production resources and or products are owned by multiple stakeholders with possibly conflicting objectives. To show its efficiency, the performance of the Spillover Algorithm is benchmarked against state of the art commercial solver CPLEX 12.8.


Inversion of adjunction for quotient singularities II Non linear actions. We prove the precise inversion of adjunction formula for quotient singularities. As an application, we prove the semi continuity of minimal log discrepancies for hyperquotient singularities. This paper is a continuation of arXiv 2011.07300, and we generalize the previous results to non linear group actions.


HANet Hierarchical Alignment Networks for Video Text Retrieval. Video text retrieval is an important yet challenging task in vision language understanding, which aims to learn a joint embedding space where related video and text instances are close to each other. Most current works simply measure the video text similarity based on video level and text level embeddings. However, the neglect of more fine grained or local information causes the problem of insufficient representation. Some works exploit the local details by disentangling sentences, but overlook the corresponding videos, causing the asymmetry of video text representation. To address the above limitations, we propose a Hierarchical Alignment Network (HANet) to align different level representations for video text matching. Specifically, we first decompose video and text into three semantic levels, namely event (video and text), action (motion and verb), and entity (appearance and noun). Based on these, we naturally construct hierarchical representations in the individual local global manner, where the individual level focuses on the alignment between frame and word, local level focuses on the alignment between video clip and textual context, and global level focuses on the alignment between the whole video and text. Different level alignments capture fine to coarse correlations between video and text, as well as take the advantage of the complementary information among three semantic levels. Besides, our HANet is also richly interpretable by explicitly learning key semantic concepts. Extensive experiments on two public datasets, namely MSR VTT and VATEX, show the proposed HANet outperforms other state of the art methods, which demonstrates the effectiveness of hierarchical representation and alignment. Our code is publicly available.


Panoramic Encoder A Fast and Accurate Response Selection Paradigm for Generation Based Dialogue Systems. Response selector is an essential component of generation based dialogue systems and it aims to pick out an optimal response in a candidate pool to continue the dialogue. The current state of the art methods are mainly based on the encoding paradigm called Cross Encoder, which separately encodes each context response pair and ranks the responses according to their fitness scores. However, Cross Encoder repeatedly encodes the same lengthy context for each response, resulting in high computational costs. Moreover, without considering the relationship among the candidates, it is difficult to figure out which candidate is the best response purely based on the fitness score per candidate. We aim to address these problems through a new paradigm called Panoramic Encoder. The proposed method encodes all candidates and the context at once and realizes the mutual interaction using a tailored candidate attention mechanism (CAM). It also enables the integration of some effective training techniques, such as the in batch negative training, which cannot be used in Cross Encoders. Extensive experiments across four benchmark datasets show that our new method significantly outperforms the current state of the art with lower computational complexity.


Analysis of Work Stealing and Parallel Cache Complexity. Parallelism has become extremely popular over the past decade, and there have been a lot of new parallel algorithms and software. The randomized work stealing (RWS) scheduler plays a crucial role in this ecosystem. In this paper, we study two important topics related to the randomized work stealing scheduler. Our first contribution is a simplified, classroom ready version of analysis for the RWS scheduler. The theoretical efficiency of the RWS scheduler has been analyzed for a variety of settings, but most of them are quite complicated. In this paper, we show a new analysis, which we believe is easy to understand, and can be especially useful in education. We avoid using the potential function in the analysis, and we assume a highly asynchronous setting, which is more realistic for today's parallel machines. Our second and main contribution is some new parallel cache complexity for algorithms using the RWS scheduler. Although the sequential I O model has been well studied over the past decades, so far very few results have extended it to the parallel setting. The parallel cache bounds of many existing algorithms are affected by a polynomial of the span, which causes a significant overhead for high span algorithms. Our new analysis decouples the span from the analysis of the parallel cache complexity. This allows us to show new parallel cache bounds for a list of classic algorithms. Our results are only a polylogarithmic factor off the lower bounds, and significantly improve previous results.


An Integrated Dynamic Method for Allocating Roles and Planning Tasks for Mixed Human Robot Teams. This paper proposes a novel integrated dynamic method based on Behavior Trees for planning and allocating tasks in mixed human robot teams, suitable for manufacturing environments. The Behavior Tree formulation allows encoding a single job as a compound of different tasks with temporal and logic constraints. In this way, instead of the well studied offline centralized optimization problem, the role allocation problem is solved with multiple simplified online optimization sub problem, without complex and cross schedule task dependencies. These sub problems are defined as Mixed Integer Linear Programs, that, according to the worker actions related costs and the workers' availability, allocate the yet to execute tasks among the available workers. To characterize the behavior of the developed method, we opted to perform different simulation experiments in which the results of the action worker allocation and computational complexity are evaluated. The obtained results, due to the nature of the algorithm and to the possibility of simulating the agents' behavior, should describe well also how the algorithm performs in real experiments.


physics.flu-dyn cs.CE cs.LG cs.NA math.NA

Real time simulation of parameter dependent fluid flows through deep learning based reduced order models. Simulating fluid flows in different virtual scenarios is of key importance in engineering applications. However, high fidelity, full order models relying, e.g., on the finite element method, are unaffordable whenever fluid flows must be simulated in almost real time. Reduced order models (ROMs) relying, e.g., on proper orthogonal decomposition (POD) provide reliable approximations to parameter dependent fluid dynamics problems in rapid times. However, they might require expensive hyper reduction strategies for handling parameterized nonlinear terms, and enriched reduced spaces (or Petrov Galerkin projections) if a mixed velocity pressure formulation is considered, possibly hampering the evaluation of reliable solutions in real time. Dealing with fluid structure interactions entails even higher difficulties. The proposed deep learning (DL) based ROMs overcome all these limitations by learning in a non intrusive way both the nonlinear trial manifold and the reduced dynamics. To do so, they rely on deep neural networks, after performing a former dimensionality reduction through POD enhancing their training times substantially. The resulting POD DL ROMs are shown to provide accurate results in almost real time for the flow around a cylinder benchmark, the fluid structure interaction between an elastic beam attached to a fixed, rigid block and a laminar incompressible flow, and the blood flow in a cerebral aneurysm.


Representations and characters of finite groups. This text is an extended version of the lecture notes for a course on representation theory of finite groups that was given by the authors during several years for graduate and postgraduate students of Novosibirsk State University and Sobolev Institute of Mathematics.


Maximum Entropy Dueling Network Architecture in Atari Domain. In recent years, there have been many deep structures for Reinforcement Learning, mainly for value function estimation and representations. These methods achieved great success in Atari 2600 domain. In this paper, we propose an improved architecture based upon Dueling Networks, in this architecture, there are two separate estimators, one approximate the state value function and the other, state advantage function. This improvement based on Maximum Entropy, shows better policy evaluation compared to the original network and other value based architectures in Atari domain.


Semi toric degenerations of Richardson varieties arising from cluster structures on flag varieties. A toric degeneration of an irreducible variety is a flat degeneration to an irreducible toric variety. In the case of a flag variety, its toric degeneration with desirable properties induces degenerations of Richardson varieties to unions of irreducible closed toric subvarieties, called semi toric degenerations. For instance, Morier Genoud proved that Caldero's toric degenerations arising from string polytopes have this property. Semi toric degenerations are closely related to Schubert calculus. Indeed, Kogan Miller constructed semi toric degenerations of Schubert varieties from Knutson Miller's semi toric degenerations of matrix Schubert varieties which give a geometric proof of the pipe dream formula of Schubert polynomials. In this paper, we focus on a toric degeneration of a flag variety arising from a cluster structure, and prove that it induces semi toric degenerations of Richardson varieties. Our semi toric degeneration can be regarded as a generalization of Morier Genoud's and Kogan Miller's semi toric degenerations.


Exactness of Bousfield localizations of simplicial presheaves and local lifting. We show that weak equivalences in a (cofibrantly generated) left Bousfield localization of the projective model category of simplicial presheaves can be characterized by a local lifting property if and only if the localization is exact.


An Unconditionally Stable Conformal LOD FDTD Method For Curved PEC Objects and Its Application to EMC Problems. The traditional finite difference time domain (FDTD) method is constrained by the Courant Friedrich Levy (CFL) condition and suffers from the notorious staircase error in electromagnetic simulations. This paper proposes a three dimensional conformal locally one dimensional FDTD (CLOD FDTD) method to address the two issues for modeling perfectly electrical conducting (PEC) objects. By considering the partially filled cells, the proposed CLOD FDTD method can significantly improve the accuracy compared with the traditional LOD FDTD method and the FDTD method. At the same time, the proposed method preserves unconditional stability, which is analyzed and numerically validated using the Von Neuman method. Significant gains in Central Processing Unit (CPU) time are achieved by using large time steps without sacrificing accuracy. Two numerical examples include a PEC cylinder and a missile are used to verify its accuracy and efficiency with different meshes and time steps. It can be found from these examples, the CLOD FDTD method show better accuracy and can improve the efficiency compared with those of the traditional FDTD method and the traditional LOD FDTD method.


Palindromic linearization and numerical solution of nonsymmetric algebraic T Riccati equations. We identify a relationship between the solutions of a nonsymmetric algebraic T Riccati equation (T NARE) and the deflating subspaces of a palindromic matrix pencil, obtained by arranging the coefficients of the T NARE. The interplay between T NARE and palindromic pencils allows one to derive both theoretical properties of the solutions of the equation, and new methods for its numerical solution. In particular, we propose methods based on the (palindromic) QZ algorithm and the doubling algorithm, whose effectiveness is demonstrated by several numerical tests


Practical Fully Dynamic Minimum Cut Algorithms. We present a practically efficient algorithm for maintaining a global minimum cut in large dynamic graphs under both edge insertions and deletions. While there has been theoretical work on this problem, our algorithm is the first implementation of a fully dynamic algorithm. The algorithm uses the theoretical foundation and combines it with efficient and finely tuned implementations to give an algorithm that can maintain the global minimum cut of a graph with rapid update times. We show that our algorithm gives up to multiple orders of magnitude speedup compared to static approaches both on edge insertions and deletions.


Uso de GSO cooperativos com decaimentos de pesos para otimizacao de redes neurais. Training of Artificial Neural Networks is a complex task of great importance in supervised learning problems. Evolutionary Algorithms are widely used as global optimization techniques and these approaches have been used for Artificial Neural Networks to perform various tasks. An optimization algorithm, called Group Search Optimizer (GSO), was proposed and inspired by the search behaviour of animals. In this article we present two new hybrid approaches CGSO Hk WD and CGSO Sk WD. Cooperative GSOs are based on the divide and conquer paradigm, employing cooperative behaviour between GSO groups to improve the performance of the standard GSO. We also apply the weight decay strategy (WD, acronym for Weight Decay) to increase the generalizability of the networks. The results show that cooperative GSOs are able to achieve better performance than traditional GSO for classification problems in benchmark datasets such as Cancer, Diabetes, Ecoli and Glass datasets.


Multimodal Representation for Neural Code Search. Semantic code search is about finding semantically relevant code snippets for a given natural language query. In the state of the art approaches, the semantic similarity between code and query is quantified as the distance of their representation in the shared vector space. In this paper, to improve the vector space, we introduce tree serialization methods on a simplified form of AST and build the multimodal representation for the code data. We conduct extensive experiments using a single corpus that is large scale and multi language CodeSearchNet. Our results show that both our tree serialized representations and multimodal learning model improve the performance of code search. Last, we define intuitive quantification metrics oriented to the completeness of semantic and syntactic information of the code data, to help understand the experimental findings.


On M 'etivier's Lax Mizohata theorem and extensions to weak defects of hyperbolicity. Part two. We continue our study of initial value problems for fully nonlinear systems exhibiting strong or weak defects of hyperbolicity. We prove that, regardless of the initial Sobolev regularity, the initial value problem has no local H s solutions, for s s 0 d 2, if the principal symbol has a strong, or even weak, defect of hyperbolicity, and the purely imaginary eigenvalues of the principal symbol are semi simple and have constant multiplicity. The index s 0 0 depends on the severity of the defect of hyperbolicity. These results recover and extend previous work from G. M 'etivier it Remarks on the well posedness of the nonlinear Cauchy problem, 2005 , N.Lerner, Y. Morimoto, C. J. Xu it Instability of the Cauchy Kovalevskaya solution for a class of non linear systems , 2010 and N. Lerner, T. Nguyen, B. Texier, it The onset of instability in first order systems , 2018


Pl "ucker Coordinates of the best fit Stiefel Tropical Linear Space to a Mixture of Gaussian Distributions. In this research, we investigate a tropical principal component analysis (PCA) as a best fit Stiefel tropical linear space to a given sample over the tropical projective torus for its dimensionality reduction and visualization. Especially, we characterize the best fit Stiefel tropical linear space to a sample generated from a mixture of Gaussian distributions as the variances of the Gaussians go to zero. For a single Gaussian distribution, we show that the sum of residuals in terms of the tropical metric with the max plus algebra over a given sample to a fitted Stiefel tropical linear space converges to zero by giving an upper bound for its convergence rate. Meanwhile, for a mixtures of Gaussian distribution, we show that the best fit tropical linear space can be determined uniquely when we send variances to zero. We briefly consider the best fit topical polynomial as an extension for the mixture of more than two Gaussians over the tropical projective space of dimension three. We show some geometric properties of these tropical linear spaces and polynomials.


Ascent Similarity Caching with Approximate Indexes. Similarity search is a key operation in multimedia retrieval systems and recommender systems, and it will play an important role also for future machine learning and augmented reality applications. When these systems need to serve large objects with tight delay constraints, edge servers close to the end user can operate as similarity caches to speed up the retrieval. In this paper we present A c C AI, a new similarity caching policy which improves on the state of the art by using (i) an (approximate) index for the whole catalog to decide which objects to serve locally and which to retrieve from the remote server, and (ii) a mirror ascent algorithm to update the set of local objects with strong guarantees even when the request process does not exhibit any statistical regularity.


Join operation and mathcal A finite map germs. In this work we define some map germs, called elementary joins, for the purpose of producing new mathcal A finite map germs from them. In particular, we describe a general form of an mathcal A finite monomial map from ( mathbb C n,0) to ( mathbb C p ,0) for p geq 2n of any corank in terms of elementary join maps. Our main tools are the delta invariant and some invariants of curves.


Reduced form framework for multiple default times under model uncertainty. In this paper we introduce a sublinear conditional operator with respect to a family of possibly nondominated probability measures in presence of multiple ordered default times. In this way we generalize the results of 5 , where a reduced form framework under model uncertainty for a single default time is developed. Moreover, we use this operator for the valuation of credit portfolio derivatives under model uncertainty.


Impact of h index on authors ranking A comparative analysis of Scopus and WoS. In academia, the research performance of the faculty members is either evaluated by the number of publications or the number of citations. Most of the time h index is widely used during the hiring process or the faculty performance evaluation. The calculation of the h index is shown in various databases however, there is no recent or systematic evidence about the differences between them. In this study, we compare the difference in the h index compiled with Scopus and Web of Science (WoS) with the aim of analyzing the ranking of the authors within a university. We analyze the publication records of 350 authors from Monash University (Australia). We also investigate the discipline wise variation in the authors ranking. 31 of the author's profiles show no variation in the two datasets whereas 55 of the author's profiles show a higher count in Scopus and 9 in WoS. The maximum difference in h index count among Scopus and WoS is 3. On average 12.4 of publications per author are unique in Scopus and 4.1 in WoS. 53.5 of publications are common in both Scopus and WoS. Despite larger unique publications in Scopus, there is no difference shown in the Spearman correlation coefficient between WoS and Scopus citation counts and h index.


Using Cyber Terrain in Reinforcement Learning for Penetration Testing. Reinforcement learning (RL) has been applied to attack graphs for penetration testing, however, trained agents do not reflect reality because the attack graphs lack operational nuances typically captured within the intelligence preparation of the battlefield (IPB) that include notions of (cyber) terrain. In particular, current practice constructs attack graphs exclusively using the Common Vulnerability Scoring System (CVSS) and its components. We present methods for constructing attack graphs using notions from IPB on cyber terrain analysis of obstacles, avenues of approach, key terrain, observation and fields of fire, and cover and concealment. We demonstrate our methods on an example where firewalls are treated as obstacles and represented in (1) the reward space and (2) the state dynamics. We show that terrain analysis can be used to bring realism to attack graphs for RL.


Fano manifolds with big tangent bundle a characterisation of V 5 . Let X be a Fano manifold with Picard number one such that the tangent bundle T X is big. If X admits a rational curve with trivial normal bundle, we show that X is isomorphic to the del Pezzo threefold of degree five.


Towards Faster and Stabilized GAN Training for High fidelity Few shot Image Synthesis. Training Generative Adversarial Networks (GAN) on high fidelity images usually requires large scale GPU clusters and a vast number of training images. In this paper, we study the few shot image synthesis task for GAN with minimum computing cost. We propose a light weight GAN structure that gains superior quality on 1024 1024 resolution. Notably, the model converges from scratch with just a few hours of training on a single RTX 2080 GPU, and has a consistent performance, even with less than 100 training samples. Two technique designs constitute our work, a skip layer channel wise excitation module and a self supervised discriminator trained as a feature encoder. With thirteen datasets covering a wide variety of image domains (The datasets and code are available at https github.com odegeasslbc FastGAN pytorch), we show our model's superior performance compared to the state of the art StyleGAN2, when data and computing budget are limited.


On the existence of isoperimetric regions in manifolds with nonnegative Ricci curvature and Euclidean volume growth. In this paper we provide new existence results for isoperimetric sets of large volume in Riemannian manifolds with nonnegative Ricci curvature and Euclidean volume growth. We find sufficient conditions for their existence in terms of the geometry at infinity of the manifold. As a byproduct we show that isoperimetric sets of big volume always exist on manifolds with nonnegative sectional curvature and Euclidean volume growth. Our method combines an asymptotic mass decomposition result for minimizing sequences, a sharp isoperimetric inequality on nonsmooth spaces, and the concavity property of the isoperimetric profile. The latter is new in the generality of noncollapsed manifolds with Ricci curvature bounded below.


Context Specific Representation Abstraction for Deep Option Learning. Hierarchical reinforcement learning has focused on discovering temporally extended actions, such as options, that can provide benefits in problems requiring extensive exploration. One promising approach that learns these options end to end is the option critic (OC) framework. We examine and show in this paper that OC does not decompose a problem into simpler sub problems, but instead increases the size of the search over policy space with each option considering the entire state space during learning. This issue can result in practical limitations of this method, including sample inefficient learning. To address this problem, we introduce Context Specific Representation Abstraction for Deep Option Learning (CRADOL), a new framework that considers both temporal abstraction and context specific representation abstraction to effectively reduce the size of the search over policy space. Specifically, our method learns a factored belief state representation that enables each option to learn a policy over only a subsection of the state space. We test our method against hierarchical, non hierarchical, and modular recurrent neural network baselines, demonstrating significant sample efficiency improvements in challenging partially observable environments.


Understanding the Distributions of Aggregation Layers in Deep Neural Networks. The process of aggregation is ubiquitous in almost all deep nets models. It functions as an important mechanism for consolidating deep features into a more compact representation, whilst increasing robustness to overfitting and providing spatial invariance in deep nets. In particular, the proximity of global aggregation layers to the output layers of DNNs mean that aggregated features have a direct influence on the performance of a deep net. A better understanding of this relationship can be obtained using information theoretic methods. However, this requires the knowledge of the distributions of the activations of aggregation layers. To achieve this, we propose a novel mathematical formulation for analytically modelling the probability distributions of output values of layers involved with deep feature aggregation. An important outcome is our ability to analytically predict the KL divergence of output nodes in a DNN. We also experimentally verify our theoretical predictions against empirical observations across a range of different classification tasks and datasets.


Grand Lebesgue Spaces norm estimates for eigen functions for Laplace Beltrami operator defined on the closed compact smooth Riemannian manifolds. We derive a sharp Grand Lebesgue Space norm estimations for normalized eigen functions for the Laplace Beltrami operator defined on the compact smooth Riemann manifold. These estimates allow us to deduce in particular the exponential decreasing tail of distribution for these eigen functions.


The p adic Duffin Schaeffer conjecture. We prove Haynes' version of the Duffin Schaeffer conjecture for the p adic numbers. In addition, we prove several results about an associated related but false conjecture, related to p adic approximation in the spirit of Jarn 'ik and Lutz.


Discrepancy and Sparsity. We study the connections between the notions of combinatorial discrepancy and graph degeneracy. In particular, we prove that the maximum discrepancy over all subgraphs H of a graph G of the neighborhood set system of H is sandwiched between Omega( log mathrm deg (G)) and mathcal O ( mathrm deg (G)) , where mathrm deg (G) denotes the degeneracy of G . We extend this result to inequalities relating weak coloring numbers and discrepancy of graph powers and deduce a new characterization of bounded expansion classes. Then, we switch to a model theoretical point of view, introduce pointer structures, and study their relations to graph classes with bounded expansion. We deduce that a monotone class of graphs has bounded expansion if and only if all the set systems definable in this class have bounded hereditary discrepancy. Using known bounds on the VC density of set systems definable in nowhere dense classes we also give a characterization of nowhere dense classes in terms of discrepancy. As consequences of our results, we obtain a corollary on the discrepancy of neighborhood set systems of edge colored graphs, a polynomial time algorithm to compute varepsilon approximations of size mathcal O (1 varepsilon) for set systems definable in bounded expansion classes, an application to clique coloring, and even the non existence of a quantifier elimination scheme for nowhere dense classes.


A New Approach for Semantic Web Matching. In this work we propose a new approach for semantic web matching to improve the performance of Web Service replacement. Because in automatic systems we should ensure the self healing, self configuration, self optimization and self management, all services should be always available and if one of them crashes, it should be replaced with the most similar one. Candidate services are advertised in Universal Description, Discovery and Integration (UDDI) all in Web Ontology Language (OWL). By the help of bipartite graph, we did the matching between the crashed service and a Candidate one. Then we chose the best service, which had the maximum rate of matching. In fact we compare two services functionalities and capabilities to see how much they match. We found that the best way for matching two web services, is comparing the functionalities of them.


Two Photon Excited Fluorescence Dynamics in Enzyme Bound NADH the Heterogeneity of Fluorescence Decay Times and Anisotropic Relaxation. The dynamics of polarized fluorescence in reduced nicotinamide adenine dinucleotide (NADH) at 436 nm under two photon excitation at 720 nm by femtosecond laser pulses in alcohol dehydrogenase (ADH) containing buffer solution has been studied experimentally and theoretically. A global fit procedure was used for determination of the fluorescence parameters from experimental data. The interpretation of the experimental results obtained was supported by emph ab initio calculations of NADH structure in solutions. A theoretical model was developed for description of the polarized fluorescence decay in enzyme NADH binary complexes that considered several possible interaction scenarios. We suggest that the origin of a significant enhancement of the nanosecond decay time value in the ADH bounded NADH compare with the free NADH can be attributed to the significant decrease of non radiative relaxation probabilities due to decrease of charges separations in the nicotinamide ring in the conditions of an apolar ADH NADH binding site environment. The existence of a single decay time in the ADH NADH complex in the nanosecond time domain in comparison with two decay times observed in free NADH can be attributed to a single NADH unfolded emph trans like conformation bounded within the ADH site. Comparison of the experimental data obtained and the theory developed suggested the existence of an anisotropic relaxation time of about 1 ns related most likely with interactions between excited NADH and the ADH binding site that resulted in the rearrangement of nuclear distribution and rotation of fluorescence transition dipole moment.


Transformations for Piola mapped elements. The Arnold Winther element successfully discretizes the Hellinger Reissner variational formulation of linear elasticity its development was one of the key early breakthroughs of the finite element exterior calculus. Despite its great utility, it is not available in standard finite element software, because its degrees of freedom are not preserved under the standard Piola push forward. In this work we apply the novel transformation theory recently developed by Kirby SMAI JCM, 4 197 224, 2018 to devise the correct map for transforming the basis on a reference cell to a generic physical triangle. This enables the use of the Arnold Winther elements, both conforming and nonconforming, in the widely used Firedrake finite element software, composing with its advanced symbolic code generation and geometric multigrid functionality. Similar results also enable the correct transformation of the Mardal Tai Winther element for incompressible fluid flow. We present numerical results for both elements, verifying the correctness of our theory.


Quantum Identity Based Encryption from the Learning with Errors Problem. In order to prevent eavesdropping and tampering, the network security protocols use a handshake with an asymmetric cipher to establish a session specific shared key with which further communication is encrypted using a symmetric cipher. The commonly used asymmetric algorithms include public key encryption, key exchange and identity based encryption(IBE). However, the network security protocols based on classic identity based encryption do not have perfect forward security. To solve the problem, we construct the first quantum IBE (QIBE) scheme based on the learning with errors problem, and prove that our scheme is fully secure under the random oracle. Moreover, we construct the quantum circuit of our QIBE scheme and give an estimate of the quantum resource of our circuit including the numbers of Hadamard gate, phase gate, T gate, CNOT gate and the total qubits used in the circuit, and conclude that the quantum resources required by our scheme increase linearly with the number of bits of the encrypted quantum plaintext. Our scheme exhibits the following advantages (i) The classic key generation center (KGC) system still can be used for our QIBE scheme to generate and distribute the secret identity keys so that the cost can be reduced when the scheme is implemented. The reason why the classic KGC can be used is that the public and private keys are in the form of classic bits. (ii) The network security protocols using a handshake with our QIBE scheme can provide perfect forward security. In our scheme, the ciphertext is transmitted in the form of a quantum state that is unknown to the adversary and therefore cannot be copied and stored. Thus, in the network security protocols based on our QIBE construction, the adversary cannot decrypt the previous quantum ciphertext to threat the previous session keys even if the identity secret key is threatened.


Optimizing robotic swarm based construction tasks. Social insects in nature such as ants, termites and bees construct their colonies collaboratively in a very efficient process. In these swarms, each insect contributes to the construction task individually showing redundant and parallel behavior of individual entities. But the robotics adaptations of these swarm's behaviors haven't yet made it to the real world at a large enough scale of commonly being used due to the limitations in the existing approaches to the swarm robotics construction. This paper presents an approach that combines the existing swarm construction approaches which results in a swarm robotic system, capable of constructing a given 2 dimensional shape in an optimized manner.


SRLF A Stance aware Reinforcement Learning Framework for Content based Rumor Detection on Social Media. The rapid development of social media changes the lifestyle of people and simultaneously provides an ideal place for publishing and disseminating rumors, which severely exacerbates social panic and triggers a crisis of social trust. Early content based methods focused on finding clues from the text and user profiles for rumor detection. Recent studies combine the stances of users' comments with news content to capture the difference between true and false rumors. Although the user's stance is effective for rumor detection, the manual labeling process is time consuming and labor intensive, which limits the application of utilizing it to facilitate rumor detection. In this paper, we first finetune a pre trained BERT model on a small labeled dataset and leverage this model to annotate weak stance labels for users' comment data to overcome the problem mentioned above. Then, we propose a novel Stance aware Reinforcement Learning Framework (SRLF) to select high quality labeled stance data for model training and rumor detection. Both the stance selection and rumor detection tasks are optimized simultaneously to promote both tasks mutually. We conduct experiments on two commonly used real world datasets. The experimental results demonstrate that our framework outperforms the state of the art models significantly, which confirms the effectiveness of the proposed framework.


TextCNN with Attention for Text Classification. The vast majority of textual content is unstructured, making automated classification an important task for many applications. The goal of text classification is to automatically classify text documents into one or more predefined categories. Recently proposed simple architectures for text classification such as Convolutional Neural Networks for Sentence Classification by Kim, Yoon showed promising results. In this paper, we propose incorporating an attention mechanism into the network to boost its performance, we also propose WordRank for vocabulary selection to reduce the network embedding parameters and speed up training with minimum accuracy loss. By adopting the proposed ideas TextCNN accuracy on 20News increased from 94.79 to 96.88, moreover, the number of parameters for the embedding layer can be reduced substantially with little accuracy loss by using WordRank. By using WordRank for vocabulary selection we can reduce the number of parameters by more than 5x from 7.9M to 1.5M, and the accuracy will only decrease by 1.2 .


On Some Properties of K type Block Matrices in the context of Complementarity Problem. In this article we introduce K type block matrices which include two new classes of block matrices namely block triangular K matrices and hidden block triangular K matrices. We show that the solution of linear complementarity problem with K type block matrices can be obtained by solving a linear programming problem. We show that block triangular K matrices satisfy least element property. We prove that hidden block triangular K matrices are Q 0 and processable by Lemke's algorithm. The purpose of this article is to study properties of K type block matrices in the context of the solution of linear complementarity problem.


Adaptive machine learning for protein engineering. Machine learning models that learn from data to predict how protein sequence encodes function are emerging as a useful protein engineering tool. However, when using these models to suggest new protein designs, one must deal with the vast combinatorial complexity of protein sequences. Here, we review how to use a sequence to function machine learning surrogate model to select sequences for experimental measurement. First, we discuss how to select sequences through a single round of machine learning optimization. Then, we discuss sequential optimization, where the goal is to discover optimized sequences and improve the model across multiple rounds of training, optimization, and experimental measurement.


Critical Assemblies Dragon Burst Assembly and Solution Assemblies. This work reviewed the historical literature associated with the Dragon experiment and Water Boiler reactors operated at Los Alamos during the Manhattan Project. Frisch's invited talk given at the Fast Burst Reactor Conference held the University of New Mexico in Albuquerque, NM in 1969 is quoted. From the literature review, basic models for the Dragon experiment and for a Water Boiler type assembly (aqueous homogeneous reactor) were created that can be used for conducting multi physics simulations for criticality excursion studies. This methodology utilizes the coupled neutronic hydrodynamic method to perform a time dependent dynamic simulation of a criticality excursion. MCNP was utilized to calculate important nuclear kinetic parameters that were incorporated into the models. Simulation results compared reasonably well with historic data.


Trajectory Distribution Control for Model Predictive Path Integral Control using Covariance Steering. This paper presents a novel control approach for autonomous systems operating under uncertainty. We combine Model Predictive Path Integral (MPPI) control with Covariance Steering (CS) theory to obtain a robust controller for general nonlinear systems. The proposed Covariance Controlled Model Predictive Path Integral (CC MPPI) controller addresses the performance degradation observed in some MPPI implementations owing to unexpected disturbances and uncertainties. Namely, in cases where the environment changes too fast or the simulated dynamics during the MPPI rollouts do not capture the noise and uncertainty in the actual dynamics, the baseline MPPI implementation may lead to divergence. The proposed CC MPPI controller avoids divergence by controlling the dispersion of the rollout trajectories at the end of the prediction horizon. Furthermore, the CC MPPI has adjustable trajectory sampling distributions that can be changed according to the environment to achieve efficient sampling. Numerical examples using a ground vehicle navigating in challenging environments demonstrate the proposed approach.


A Novel Provably Secure Key Agreement Protocol Based On Binary Matrices. In this paper, a new key agreement protocol is presented. The protocol uses exponentiation of matrices over GF(2) to establish the key agreement. Security analysis of the protocol shows that the shared secret key is indistinguishable from the random under Decisional Diffie Hellman (DDH) assumption for subgroup of matrices over GF(2) with prime order, and furthermore, the analysis shows that, unlike many other exponentiation based protocols, security of the protocol goes beyond the level of security provided by (DDH) assumption and intractability of Discrete Logarithm Problem (DLP). Actually, security of the protocol completely transcends the reliance on the DLP in the sense that breaking the DLP does not mean breaking the protocol. Complexity of brute force attack on the protocol is equivalent to exhaustive search for the secret key.


Cross Modal Retrieval with Querybank Normalisation. Profiting from large scale training datasets, advances in neural architecture design and efficient inference, joint embeddings have become the dominant approach for tackling cross modal retrieval. In this work we first show that, despite their effectiveness, state of the art joint embeddings suffer significantly from the longstanding "hubness problem" in which a small number of gallery embeddings form the nearest neighbours of many queries. Drawing inspiration from the NLP literature, we formulate a simple but effective framework called Querybank Normalisation (QB Norm) that re normalises query similarities to account for hubs in the embedding space. QB Norm improves retrieval performance without requiring retraining. Differently from prior work, we show that QB Norm works effectively without concurrent access to any test set queries. Within the QB Norm framework, we also propose a novel similarity normalisation method, the Dynamic Inverted Softmax, that is significantly more robust than existing approaches. We showcase QB Norm across a range of cross modal retrieval models and benchmarks where it consistently enhances strong baselines beyond the state of the art. Code is available at https vladbogo.github.io QB Norm .


Enumeration of self reciprocal irreducible monic polynomials with prescribed leading coefficients over a finite field. A polynomial is called self reciprocal (or palindromic) if the sequence of its coefficients is palindromic. In this paper we enumerate self reciprocal irreducible monic polynomials over a finite field with prescribed leading coefficients. Asymptotic expression with explicit error bound is derived, which is used to show that such polynomials with degree 2n always exist provided that the number of prescribed leading coefficients is slightly less than n 4 . Exact expressions are also obtained for fields with two or three elements and up to two prescribed leading coefficients.


Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models. We use a dataset of U.S. first names with labels based on predominant gender and racial group to examine the effect of training corpus frequency on tokenization, contextualization, similarity to initial representation, and bias in BERT, GPT 2, T5, and XLNet. We show that predominantly female and non white names are less frequent in the training corpora of these four language models. We find that infrequent names are more self similar across contexts, with Spearman's r between frequency and self similarity as low as .763. Infrequent names are also less similar to initial representation, with Spearman's r between frequency and linear centered kernel alignment (CKA) similarity to initial representation as high as .702. Moreover, we find Spearman's r between racial bias and name frequency in BERT of .492, indicating that lower frequency minority group names are more associated with unpleasantness. Representations of infrequent names undergo more processing, but are more self similar, indicating that models rely on less context informed representations of uncommon and minority names which are overfit to a lower number of observed contexts.


"Forget" the Forget Gate Estimating Anomalies in Videos using Self contained Long Short Term Memory Networks. Abnormal event detection is a challenging task that requires effectively handling intricate features of appearance and motion. In this paper, we present an approach of detecting anomalies in videos by learning a novel LSTM based self contained network on normal dense optical flow. Due to their sigmoid implementations, standard LSTM's forget gate is susceptible to overlooking and dismissing relevant content in long sequence tasks like abnormality detection. The forget gate mitigates participation of previous hidden state for computation of cell state prioritizing current input. In addition, the hyperbolic tangent activation of standard LSTMs sacrifices performance when a network gets deeper. To tackle these two limitations, we introduce a bi gated, light LSTM cell by discarding the forget gate and introducing sigmoid activation. Specifically, the LSTM architecture we come up with fully sustains content from previous hidden state thereby enabling the trained model to be robust and make context independent decision during evaluation. Removing the forget gate results in a simplified and undemanding LSTM cell with improved performance effectiveness and computational efficiency. Empirical evaluations show that the proposed bi gated LSTM based network outperforms various LSTM based models verifying its effectiveness for abnormality detection and generalization tasks on CUHK Avenue and UCSD datasets.


TrNews Heterogeneous User Interest Transfer Learning for News Recommendation. We investigate how to solve the cross corpus news recommendation for unseen users in the future. This is a problem where traditional content based recommendation techniques often fail. Luckily, in real world recommendation services, some publisher (e.g., Daily news) may have accumulated a large corpus with lots of consumers which can be used for a newly deployed publisher (e.g., Political news). To take advantage of the existing corpus, we propose a transfer learning model (dubbed as TrNews) for news recommendation to transfer the knowledge from a source corpus to a target corpus. To tackle the heterogeneity of different user interests and of different word distributions across corpora, we design a translator based transfer learning strategy to learn a representation mapping between source and target corpora. The learned translator can be used to generate representations for unseen users in the future. We show through experiments on real world datasets that TrNews is better than various baselines in terms of four metrics. We also show that our translator is effective among existing transfer strategies.


Efficient algorithms for computing rank revealing factorizations on a GPU. Standard rank revealing factorizations such as the singular value decomposition and column pivoted QR factorization are challenging to implement efficiently on a GPU. A major difficulty in this regard is the inability of standard algorithms to cast most operations in terms of the Level 3 BLAS. This paper presents two alternative algorithms for computing a rank revealing factorization of the form A U T V , where U and V are orthogonal and T is triangular. Both algorithms use randomized projection techniques to cast most of the flops in terms of matrix matrix multiplication, which is exceptionally efficient on the GPU. Numerical experiments illustrate that these algorithms achieve an order of magnitude acceleration over finely tuned GPU implementations of the SVD while providing low rank approximation errors close to that of the SVD.


Solving classification problems using Traceless Genetic Programming. Traceless Genetic Programming (TGP) is a new Genetic Programming (GP) that may be used for solving difficult real world problems. The main difference between TGP and other GP techniques is that TGP does not explicitly store the evolved computer programs. In this paper, TGP is used for solving real world classification problems taken from PROBEN1. Numerical experiments show that TGP performs similar and sometimes even better than other GP techniques for the considered test problems.


Subgroups of free proalgebraic groups and Matzat's conjecture for function fields. We show that a closed finite index subgroup of a free proalgebraic group is itself a free proalgebraic group. Our main motivation for this result is an application in differential Galois theory The absolute differential Galois group of a one variable function field is a free proalgebraic group.


EG Booster Explanation Guided Booster of ML Evasion Attacks. The widespread usage of machine learning (ML) in a myriad of domains has raised questions about its trustworthiness in security critical environments. Part of the quest for trustworthy ML is robustness evaluation of ML models to test time adversarial examples. Inline with the trustworthy ML goal, a useful input to potentially aid robustness evaluation is feature based explanations of model predictions. In this paper, we present a novel approach called EG Booster that leverages techniques from explainable ML to guide adversarial example crafting for improved robustness evaluation of ML models before deploying them in security critical settings. The key insight in EG Booster is the use of feature based explanations of model predictions to guide adversarial example crafting by adding consequential perturbations likely to result in model evasion and avoiding non consequential ones unlikely to contribute to evasion. EG Booster is agnostic to model architecture, threat model, and supports diverse distance metrics used previously in the literature. We evaluate EG Booster using image classification benchmark datasets, MNIST and CIFAR10. Our findings suggest that EG Booster significantly improves evasion rate of state of the art attacks while performing less number of perturbations. Through extensive experiments that covers four white box and three black box attacks, we demonstrate the effectiveness of EG Booster against two undefended neural networks trained on MNIST and CIFAR10, and another adversarially trained ResNet model trained on CIFAR10. Furthermore, we introduce a stability assessment metric and evaluate the reliability of our explanation based approach by observing the similarity between the model's classification outputs across multiple runs of EG Booster.


KIND an Italian Multi Domain Dataset for Named Entity Recognition. In this paper we present KIND, an Italian dataset for Named Entity Recognition. It contains more than one million tokens with the annotation covering three classes persons, locations, and organizations. Most of the dataset (around 600K tokens) contains manual gold annotations in three different domains news, literature, and political discourses. Texts and annotations are downloadable for free from the Github repository.


Universal Decision Models. Humans are universal decision makers we reason causally to understand the world we act competitively to gain advantage in commerce, games, and war and we are able to learn to make better decisions through trial and error. In this paper, we propose Universal Decision Model (UDM), a mathematical formalism based on category theory. Decision objects in a UDM correspond to instances of decision tasks, ranging from causal models and dynamical systems such as Markov decision processes and predictive state representations, to network multiplayer games and Witsenhausen's intrinsic models, which generalizes all these previous formalisms. A UDM is a category of objects, which include decision objects, observation objects, and solution objects. Bisimulation morphisms map between decision objects that capture structure preserving abstractions. We formulate universal properties of UDMs, including information integration, decision solvability, and hierarchical abstraction. We describe universal functorial representations of UDMs, and propose an algorithm for computing the minimal object in a UDM using algebraic topology. We sketch out an application of UDMs to causal inference in network economics, using a complex multiplayer producer consumer two sided marketplace.


On the extendability of projective varieties a survey. We give a survey of the incredibly beautiful amount of geometry involved with the problem of realizing a projective variety as hyperplane section of another variety.


Low Memory Implementations of Ridge Solutions for Broad Learning System with Incremental Learning. The existing low memory BLS implementation proposed recently avoids the need for storing and inverting large matrices, to achieve efficient usage of memories. However, the existing low memory BLS implementation sacrifices the testing accuracy as a price for efficient usage of memories, since it can no longer obtain the generalized inverse or ridge solution for the output weights during incremental learning, and it cannot work under the very small ridge parameter that is utilized in the original BLS. Accordingly, it is required to develop the low memory BLS implementations, which can work under very small ridge parameters and compute the generalized inverse or ridge solution for the output weights in the process of incremental learning. In this paper, firstly we propose the low memory implementations for the recently proposed recursive and square root BLS algorithms on added inputs and the recently proposed squareroot BLS algorithm on added nodes, by simply processing a batch of inputs or nodes in each recursion. Since the recursive BLS implementation includes the recursive updates of the inverse matrix that may introduce numerical instabilities after a large number of iterations, and needs the extra computational load to decompose the inverse matrix into the Cholesky factor when cooperating with the proposed low memory implementation of the square root BLS algorithm on added nodes, we only improve the low memory implementations of the square root BLS algorithms on added inputs and nodes, to propose the full lowmemory implementation of the square root BLS algorithm. All the proposed low memory BLS implementations compute the ridge solution for the output weights in the process of incremental learning, and most of them can work under very small ridge parameters.


Animal inspired Application of a Variant of Mel Spectrogram for Seismic Data Processing. Predicting disaster events from seismic data is of paramount importance and can save thousands of lives, especially in earthquake prone areas and habitations around volcanic craters. The drastic rise in the number of seismic monitoring stations in recent years has allowed the collection of a huge quantity of data, outpacing the capacity of seismologists. Due to the complex nature of the seismological data, it is often difficult for seismologists to detect subtle patterns with major implications. Machine learning algorithms have been demonstrated to be effective in classification and prediction tasks for seismic data. It has been widely known that some animals can sense disasters like earthquakes from seismic signals well before the disaster strikes. Mel spectrogram has been widely used for speech recognition as it scales the actual frequencies according to human hearing. In this paper, we propose a variant of the Mel spectrogram to scale the raw frequencies of seismic data to the hearing of such animals that can sense disasters from seismic signals. We are using a Computer vision algorithm along with clustering that allows for the classification of unlabelled seismic data.


New Candidates for Furin Inhibition as Probable Treat for COVID 19 Docking Output. Furin is a serine protease that takes part in the processing and activation of the host cell pre proteins. The enzyme also plays an important role in the activation of several viruses like the newly emerging SARS CoV 2 virus that causes COVID 19 disease with a high rate of virulence and mortality. Unlike viral enzymes, furin owns a constant sequence and active site characteristics and seems to be a better target for drug design for COVID 19 treatment. Considering furin active site as receptor and some approved drugs from different classes including antiviral, antibiotics, and anti protozoa anti parasites with suspected beneficial effects on COVID 19, as ligands we have carried out docking experiments in HEX software to pickup those capable to bind furin active site with high affinity and suggest them as probable candidates for clinical trials assessments. Our docking experiments show that saquinavir, nelfinavir, and atazanavir with cumulative inhibitory effects of 2.52, 2.16, and 2.13 respectively seem to be the best candidates for furin inhibition even in severe cases of COVID 19 as adjuvant therapy, while clarithromycin, niclosamide, and erythromycin with cumulative inhibitory indices of 1.97, 1.90, and 1.84 respectively with lower side effects than antiviral drugs could be suggested as prophylaxes for the first stage of COVID 19 as a promising treat.


Sharp solvability for singular SDEs. The attracting inverse square drift provides a prototypical counterexample to solvability of singular SDEs if the coefficient of the drift is larger than a certain critical value, then no weak solution exists. We prove a positive result on solvability of singular SDEs where this critical value is attained from below (up to strict inequality) for the entire class of form bounded drifts. This class contains e.g. the inverse square drift, the critical Ladyzhenskaya Prodi Serrin class. The proof is based on a L p variant of De Giorgi's method.


Exploring Explainable AI in the Financial Sector Perspectives of Banks and Supervisory Authorities. Explainable artificial intelligence (xAI) is seen as a solution to making AI systems less of a black box. It is essential to ensure transparency, fairness, and accountability, which are especially paramount in the financial sector. The aim of this study was a preliminary investigation of the perspectives of supervisory authorities and regulated entities regarding the application of xAI in the fi nancial sector. Three use cases (consumer credit, credit risk, and anti money laundering) were examined using semi structured interviews at three banks and two supervisory authorities in the Netherlands. We found that for the investigated use cases a disparity exists between supervisory authorities and banks regarding the desired scope of explainability of AI systems. We argue that the financial sector could benefit from clear differentiation between technical AI (model) ex plainability requirements and explainability requirements of the broader AI system in relation to applicable laws and regulations.


Data driven insight into the puzzle based cybersecurity training. Puzzle based training is a common type of hands on activity accompanying formal and informal cybersecurity education, much like programming or other IT skills. However, there is a lack of tools to help the educators with the post training data analysis. Through a visualization design study, we designed the Training Analysis Tool that supports learning analysis of a single hands on session. It allows an in depth trainee comparison and enables the identification of flaws in puzzle assignments. We also performed a qualitative evaluation with cybersecurity experts and students. The participants apprised the positive influence of the tool on their workflows. Our insights and recommendations could aid the design of future tools supporting educators, even beyond cyber security.


Scalable Deep Graph Clustering with Random walk based Self supervised Learning. Web based interactions can be frequently represented by an attributed graph, and node clustering in such graphs has received much attention lately. Multiple efforts have successfully applied Graph Convolutional Networks (GCN), though with some limits on accuracy as GCNs have been shown to suffer from over smoothing issues. Though other methods (particularly those based on Laplacian Smoothing) have reported better accuracy, a fundamental limitation of all the work is a lack of scalability. This paper addresses this open problem by relating the Laplacian smoothing to the Generalized PageRank and applying a random walk based algorithm as a scalable graph filter. This forms the basis for our scalable deep clustering algorithm, RwSL, where through a self supervised mini batch training mechanism, we simultaneously optimize a deep neural network for sample cluster assignment distribution and an autoencoder for a clustering oriented embedding. Using 6 real world datasets and 6 clustering metrics, we show that RwSL achieved improved results over several recent baselines. Most notably, we show that RwSL, unlike all other deep clustering frameworks, can continue to scale beyond graphs with more than one million nodes, i.e., handle web scale. We also demonstrate how RwSL could perform node clustering on a graph with 1.8 billion edges using only a single GPU.


Neural Network Compatible Off Policy Natural Actor Critic Algorithm. Learning optimal behavior from existing data is one of the most important problems in Reinforcement Learning (RL). This is known as "off policy control" in RL where an agent's objective is to compute an optimal policy based on the data obtained from the given policy (known as the behavior policy). As the optimal policy can be very different from the behavior policy, learning optimal behavior is very hard in the "off policy" setting compared to the "on policy" setting where new data from the policy updates will be utilized in learning. This work proposes an off policy natural actor critic algorithm that utilizes state action distribution correction for handling the off policy behavior and the natural policy gradient for sample efficiency. The existing natural gradient based actor critic algorithms with convergence guarantees require fixed features for approximating both policy and value functions. This often leads to sub optimal learning in many RL applications. On the other hand, our proposed algorithm utilizes compatible features that enable one to use arbitrary neural networks to approximate the policy and the value function and guarantee convergence to a locally optimal policy. We illustrate the benefit of the proposed off policy natural gradient algorithm by comparing it with the vanilla gradient actor critic algorithm on benchmark RL tasks.


Progressive Domain Expansion Network for Single Domain Generalization. Single domain generalization is a challenging case of model generalization, where the models are trained on a single domain and tested on other unseen domains. A promising solution is to learn cross domain invariant representations by expanding the coverage of the training domain. These methods have limited generalization performance gains in practical applications due to the lack of appropriate safety and effectiveness constraints. In this paper, we propose a novel learning framework called progressive domain expansion network (PDEN) for single domain generalization. The domain expansion subnetwork and representation learning subnetwork in PDEN mutually benefit from each other by joint learning. For the domain expansion subnetwork, multiple domains are progressively generated in order to simulate various photometric and geometric transforms in unseen domains. A series of strategies are introduced to guarantee the safety and effectiveness of the expanded domains. For the domain invariant representation learning subnetwork, contrastive learning is introduced to learn the domain invariant representation in which each class is well clustered so that a better decision boundary can be learned to improve it's generalization. Extensive experiments on classification and segmentation have shown that PDEN can achieve up to 15.28 improvement compared with the state of the art single domain generalization methods.


Lookup or Exploratory What is Your Search Intent?. Search query specificity is broadly divided into two categories Exploratory or Lookup. If a query specificity can be identified at the run time, it can be used to significantly improve the search results as well as quality of suggestions to alter the query. However, with millions of queries coming every day on a commercial search engine, it is non trivial to develop a horizontal technique to determine query specificity at run time. Existing techniques suffer either from lack of enough training data or are dependent on information such as query length or session information. In this paper, we show that such methodologies are inadequate or at times misleading. We propose a novel methodology, to overcome these limitations. First, we demonstrate a heuristic based method to identify Exploratory or Lookup intent queries at scale, classifying millions of queries into the two classes with a high accuracy, as shown in our experiments. Our methodology is not dependent on session data or on query length. Next, we train a transformer based deep neural network to classify the queries into one of the two classes at run time. Our method uses a bidirectional GRU initialized with pretrained BERT base uncased embeddings and an augmented triplet loss to classify the intent of queries without using any session data. We also introduce a novel Semi Greedy Iterative Training approach to fine tune our model. Our model is deployable for real time query specificity identification with response time of less than one millisecond. Our technique is generic, and the results have valuable implications for improving the quality of search results and suggestions.


Moduli spaces of quasitrivial sheaves on the three dimensional projective space. A torsion free sheaf E on mathbb P d is called emph quasitrivial if E vee vee mathcal O mathbb P 3 oplus r and dim(E vee vee E) 0 . While such sheaves are always mu semistable, they may not be semistable. We study the Gieseker Maruyama moduli space mathcal N (r,n) of rank r semistable quasitrivial sheaves on mathbb P 3 with h 0(E vee vee E) n via the Quot scheme of points Quot( mathcal O mathbb P 3 oplus r ,n) . We show that mathcal N (r,n) is empty when r n , while mathcal N (n,n) has no stable points and is isomorphic to the symmetric product Sym n( mathbb P 3) . Our main result is the construction of an irreducible component of mathcal N (r,n) of dimension 2n rn r 2 1 when r n . Furthermore, this is the only irreducible component when n le10 .


Improved Rate Energy Trade off For SWIPT Using Chordal Distance Decomposition In Interference Alignment Networks. This paper investigates the simultaneous wireless information and power transfer (SWIPT) precoding scheme for K user multiple input multiple output (MIMO) interference channels (IC), for which interference alignment (IA) schemes provide optimal precoders to achieve full degrees of freedom (DoF) gain. However, harvesting RF energy simultaneously reduces the achievable DoFs. To study a trade off between harvested energy and sum rate, the transceiver design problem is suboptimally formulated in literature via convex relaxations, which is still computationally intensive, especially for battery limited nodes running on harvested energy. In this paper, we propose a systematic method using chordal distance (CD) decomposition to obtain the balanced precoding, which improves the trade off. Analysis shows that given the nonnegative value of CD, the achieved harvested energy for the proposed precoder is higher than that for perfect IA precoder. Moreover, energy constraints can be achieved, while maintaining a constant rate loss without losing DoFs via tuning the CD value and splitting factor. Simulation results verify the analysis and add that the IA schemes based on max SINR or mean squared error are better suited for SWIPT maximization than subspace or leakage minimization methods.


A biomathematical model of tumor response to radioimmunotherapy with alpha PDL1 and alpha CTLA4. There is evidence of synergy between radiotherapy and immunotherapy. Radiotherapy can increase liberation of tumor antigens, causing activation of antitumor T cells. This effect can be boosted with immunotherapy. Radioimmunotherapy has potential to increase tumor control rates. Biomathematical models of response to radioimmunotherapy may help on the understanding of the mechanisms affecting response, and assist clinicians on the design of optimal treatment strategies. In this work we present a biomathematical model of tumor response to radioimmunotherapy. The model uses the linear quadratic response of tumor cells to radiation (or variation of it), and builds on previous developments to include the radiation induced immune effect. We have focused this study on the combined effect of radiotherapy and alpha PDL1 alpha CTLA4 therapies. The model fits recent preclinical data of volume dynamics and control obtained with different dose fractionations and alpha PDL1 alpha CTLA4. A biomathematical study of optimal combination strategies suggests that a good understanding of the biological delays associated to radoimmunotherapy, the biokinetics of the immunotherapy drug, and the interplay between them, may be of paramount importance to design optimal radioimmunotherapy schedules. Biomathematical models like the one we present can help to interpret experimental data on the synergy between radiotherapy and immunotherapy, and to assist in the design of more effective treatments.


LAVT Language Aware Vision Transformer for Referring Image Segmentation. Referring image segmentation is a fundamental vision language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring expression for highlighting relevant positions in the image. A paradigm for tackling this problem is to leverage a powerful vision language ("cross modal") decoder to fuse features independently extracted from a vision encoder and a language encoder. Recent methods have made remarkable advancements in this paradigm by exploiting Transformers as cross modal decoders, concurrent to the Transformer's overwhelming success in many other vision language tasks. Adopting a different approach in this work, we show that significantly better cross modal alignments can be achieved through the early fusion of linguistic and visual features in intermediate layers of a vision Transformer encoder network. By conducting cross modal feature fusion in the visual feature encoding stage, we can leverage the well proven correlation modeling power of a Transformer encoder for excavating helpful multi modal context. This way, accurate segmentation results are readily harvested with a light weight mask predictor. Without bells and whistles, our method surpasses the previous state of the art methods on RefCOCO, RefCOCO , and G Ref by large margins.


Weak regularization by degenerate L 'evy noise and its applications. After a general introduction about the regularization by noise phenomenon in the degenerate setting, the first part of this PhD thesis focuses at establishing the Schauder estimates, a useful analytical tool to prove also the well posedness of stochastic differential equations (SDEs), for two different classes of Kolmogorov equations under a weak H "ormander like condition, whose coefficients lie in suitable anisotropic H "older spaces with multi indices of regularity. The first class considers a nonlinear system controlled by a symmetric stable operator acting only on some components. Our method of proof relies on a perturbative approach based on forward parametrix expansions through Duhamel type formulas. Due to the low regularizing properties given by the degenerate setting, we also exploit some controls on Besov norms, in order to deal with the non linear perturbation. As an extension of the first one, we also present Schauder estimates associated with a degenerate Ornstein Uhlenbeck operator driven by a larger class of stable like operators, like the relativistic or the Lamperti stable one. Exploiting a backward parametrix approach, the second part of this work aims at establishing the weak well posedness for a degenerate chain of SDEs driven by the same class of stable like processes, under the assumptions of the minimal H "older regularity on the coefficients. As a by product of our method, we also present Krylov type estimates of independent interest for the associated canonical process. Finally, we show through suitable counter examples the existence of an (almost) sharp threshold on the regularity exponents ensuring the weak well posedness for the SDE. In connection with some possible applications to kinetic dynamics with friction, we conclude by investigating the stability of second order perturbations for degenerate Kolmogorov operators in Lp and H "older norms.


Few Shots Are All You Need A Progressive Few Shot Learning Approach for Low Resource Handwriting Recognition. Handwritten text recognition in low resource scenarios, such as manuscripts with rare alphabets, is a challenging problem. The main difficulty comes from the very few annotated data and the limited linguistic information (e.g. dictionaries and language models). Thus, we propose a few shot learning based handwriting recognition approach that significantly reduces the human labor annotation process, requiring only few images of each alphabet symbol. The method consists in detecting all the symbols of a given alphabet in a textline image and decoding the obtained similarity scores to the final sequence of transcribed symbols. Our model is first pretrained on synthetic line images generated from any alphabet, even though different from the target domain. A second training step is then applied to diminish the gap between the source and target data. Since this retraining would require annotation of thousands of handwritten symbols together with their bounding boxes, we propose to avoid such human effort through an unsupervised progressive learning approach that automatically assigns pseudo labels to the non annotated data. The evaluation on different manuscript datasets show that our model can lead to competitive results with a significant reduction in human effort. The code will be publicly available in this repository url https github.com dali92002 HTRbyMatching


On the reductions of certain two dimensional crystalline representations, III. A conjecture of Breuil, Buzzard, and Emerton says that the slopes of certain reducible p adic Galois representations must be integers. In previous work we showed this conjecture for representations that lie over certain non subtle components of weight space. This article is a continuation of that work in which we also show the conjecture for the subtle components for slopes less than frac p 1 2 .


Domain Impression A Source Data Free Domain Adaptation Method. Unsupervised Domain adaptation methods solve the adaptation problem for an unlabeled target set, assuming that the source dataset is available with all labels. However, the availability of actual source samples is not always possible in practical cases. It could be due to memory constraints, privacy concerns, and challenges in sharing data. This practical scenario creates a bottleneck in the domain adaptation problem. This paper addresses this challenging scenario by proposing a domain adaptation technique that does not need any source data. Instead of the source data, we are only provided with a classifier that is trained on the source data. Our proposed approach is based on a generative framework, where the trained classifier is used for generating samples from the source classes. We learn the joint distribution of data by using the energy based modeling of the trained classifier. At the same time, a new classifier is also adapted for the target domain. We perform various ablation analysis under different experimental setups and demonstrate that the proposed approach achieves better results than the baseline models in this extremely novel scenario.


Balanced Viscosity solutions to infinite dimensional multi rate systems. We consider generalized gradient systems with rate independent and rate dependent dissipation potentials. We provide a general framework for performing a vanishing viscosity limit leading to the notion of parametrized and true Balanced Viscosity solutions that include a precise description of the jump behavior developing in this limit. Distinguishing an elastic variable u having a viscous damping with relaxation time varepsilon alpha and an internal variable z with relaxation time varepsilon we obtain different limits for the three cases alpha in (0,1) , alpha 1 and alpha 1 . An application to a delamination problem shows that the theory is general enough to treat nontrivial models in continuum mechanics.


Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping. Catastrophic forgetting in neural networks is a significant problem for continual learning. A majority of the current methods replay previous data during training, which violates the constraints of an ideal continual learning system. Additionally, current approaches that deal with forgetting ignore the problem of catastrophic remembering, i.e. the worsening ability to discriminate between data from different tasks. In our work, we introduce Relevance Mapping Networks (RMNs) which are inspired by the Optimal Overlap Hypothesis. The mappings reflects the relevance of the weights for the task at hand by assigning large weights to essential parameters. We show that RMNs learn an optimized representational overlap that overcomes the twin problem of catastrophic forgetting and remembering. Our approach achieves state of the art performance across all common continual learning datasets, even significantly outperforming data replay methods while not violating the constraints for an ideal continual learning system. Moreover, RMNs retain the ability to detect data from new tasks in an unsupervised manner, thus proving their resilience against catastrophic remembering.


On optimal convergence rates for discrete minimizers of the Gross Pitaevskii energy in LOD spaces. In this paper we revisit a two level discretization based on the Localized Orthogonal Decomposition (LOD). It was originally proposed in P.Henning, A.M aa lqvist, D.Peterseim. SIAM J. Numer. Anal.52 4 1525 1550, 2014 to compute ground states of Bose Einstein condensates by finding discrete minimizers of the Gross Pitaevskii energy functional. The established convergence rates for the method appeared however suboptimal compared to numerical observations and a proof of optimal rates in this setting remained open. In this paper we shall close this gap by proving optimal order error estimates for the L 2 and H 1 error between the exact ground state and discrete minimizers, as well as error estimates for the ground state energy and the ground state eigenvalue. In particular, the achieved convergence rates for the energy and the eigenvalue are of 6 th order with respect to the mesh size on which the discrete LOD space is based, without making any additional regularity assumptions. These high rates justify the use of very coarse meshes, which significantly reduces the computational effort for finding accurate approximations of ground states. In addition, we include numerical experiments that confirm the optimality of the new theoretical convergence rates, both for smooth and discontinuous potentials.


Motif Identification using CNN based Pairwise Subsequence Alignment Score Prediction. A common problem in bioinformatics is related to identifying gene regulatory regions marked by relatively high frequencies of motifs, or deoxyribonucleic acid sequences that often code for transcription and enhancer proteins. Predicting alignment scores between subsequence k mers and a given motif enables the identification of candidate regulatory regions in a gene, which correspond to the transcription of these proteins. We propose a one dimensional (1 D) Convolution Neural Network trained on k mer formatted sequences interspaced with the given motif pattern to predict pairwise alignment scores between the consensus motif and subsequence k mers. Our model consists of fifteen layers with three rounds of a one dimensional convolution layer, a batch normalization layer, a dense layer, and a 1 D maximum pooling layer. We train the model using mean squared error loss on four different data sets each with a different motif pattern randomly inserted in DNA sequences the first three data sets have zero, one, and two mutations applied on each inserted motif, and the fourth data set represents the inserted motif as a position specific probability matrix. We use a novel proposed metric in order to evaluate the model's performance, S alpha , which is based on the Jaccard Index. We use 10 fold cross validation to evaluate out model. Using S alpha , we measure the accuracy of the model by identifying the 15 highest scoring 15 mer indices of the predicted scores that agree with that of the actual scores within a selected alpha region. For the best performing data set, our results indicate on average 99.3 of the top 15 motifs were identified correctly within a one base pair stride ( alpha 1 ) in the out of sample data. To the best of our knowledge, this is a novel approach that illustrates how data formatted in an intelligent way can be extrapolated using machine learning.


NMRPy a novel NMR scripting system to implement artificial intelligence and advanced applications. Background Software is an important windows to offer a variety of complex instrument control and data processing for nuclear magnetic resonance (NMR) spectrometer. NMR software should allow researchers to flexibly implement various functionality according to the requirement of applications. Scripting system can offer an open environment for NMR users to write custom programs with basic libraries. Emerging technologies, especially multivariate statistical analysis and artificial intelligence, have been successfully applied to NMR applications such as metabolomics and biomacromolecules. Scripting system should support more complex NMR libraries, which will enable the emerging technologies to be easily implemented in the scripting environment. Result Here, a novel NMR scripting system named "NMRPy" is introduced. In the scripting system, both Java based NMR methods and original CPython based libraries are supported. A module was built as a bridge to integrate the runtime environment of Java and CPython. It works as an extension in CPython environment, as well as interacts with Java part by Java Native Interface. Leveraging the bridge, Java based instrument control and data processing methods can be called as a CPython style. Compared with traditional scripting system, NMRPy is easier for NMR researchers to develop complex functionality with fast numerical computation, multivariate statistical analysis, deep learning etc. Non uniform sampling and protein structure prediction methods based on deep learning can be conveniently integrated into NMRPy. Conclusion NMRPy offers a user friendly environment to implement custom functionality leveraging its powerful basic NMR and rich CPython libraries. NMR applications with emerging technologies can be easily integrated. The scripting system is free of charge and can be downloaded by visiting http www.spinstudioj.net nmrpy.


Pruning of Deep Spiking Neural Networks through Gradient Rewiring. Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy efficiency on neuromorphic chips. As these chips are usually resource constrained, the compression of SNNs is thus crucial along the road of practical use of SNNs. Most existing methods directly apply pruning approaches in artificial neural networks (ANNs) to SNNs, which ignore the difference between ANNs and SNNs, thus limiting the performance of the pruned SNNs. Besides, these methods are only suitable for shallow SNNs. In this paper, inspired by synaptogenesis and synapse elimination in the neural system, we propose gradient rewiring (Grad R), a joint learning algorithm of connectivity and weight for SNNs, that enables us to seamlessly optimize network structure without retraining. Our key innovation is to redefine the gradient to a new synaptic parameter, allowing better exploration of network structures by taking full advantage of the competition between pruning and regrowth of connections. The experimental results show that the proposed method achieves minimal loss of SNNs' performance on MNIST and CIFAR 10 dataset so far. Moreover, it reaches a sim 3.5 accuracy loss under unprecedented 0.73 connectivity, which reveals remarkable structure refining capability in SNNs. Our work suggests that there exists extremely high redundancy in deep SNNs. Our codes are available at https github.com Yanqi Chen Gradient Rewiring.


Analysis of the Delay Distribution in Cellular Networks by Using Stochastic Geometry. In this paper, with the aid of the mathematical tool of stochastic geometry, we introduce analytical and computational frameworks for the distribution of three different definitions of delay, i.e., the time that it takes for a user to successfully receive a data packet, in large scale cellular networks. We also provide an asymptotic analysis of one of the delay distributions, which can be regarded as the packet loss probability of a given network. To mitigate the inherent computational difficulties of the obtained analytical formulations in some cases, we propose efficient numerical approximations based on the numerical inversion method, the Riemann sum, and the Beta distribution. Finally, we demonstrate the accuracy of the obtained analytical formulations and the corresponding approximations against Monte Carlo simulation results, and unveil insights on the delay performance with respect to several design parameters, such as the decoding threshold, the transmit power, and the deployment density of the base stations. The proposed methods can facilitate the analysis and optimization of cellular networks subject to reliability constraints on the network packet delay that are not restricted to the local (average) delay, e.g., in the context of delay sensitive applications.


Integer circulant determinants of order 15. We consider the values taken by n times n circulant determinants with integer entries when n is the product of two distinct odd primes p,q . These correspond to the integer group determinants for mathbb Z pq , the cyclic group of order pq . We show that p 2 and q 2 are not determinants (more generally we show that the classic necessary divisibility conditions are never sufficient when n contains at least two odd primes). We obtain a complete description of the integer group determinants for mathbb Z 15 (the smallest unresolved group) and partial results for general n 3p.


On Medical Device Software CE Compliance and Conformity Assessment. Manufacturing of medical devices is strictly controlled by authorities, and manufacturers must conform to the regulatory requirements of the region in which a medical device is being marketed for use. In general, these requirements make no difference between the physical device, embedded software running inside a physical device, or software that constitutes the device in itself. As a result, standalone software with intended medical use is considered to be a medical device. Consequently, its development must meet the same requirements as the physical medical device manufacturing. This practice creates a unique challenge for organizations developing medical software. In this paper, we pinpoint a number of regulatory requirement mismatches between physical medical devices and standalone medical device software. The view is based on experiences from industry, from the development of all software medical devices as well as from defining the manufacturing process so that it meets the regulatory requirements.


Monte Carlo Simulation of SDEs using GANs. Generative adversarial networks (GANs) have shown promising results when applied on partial differential equations and financial time series generation. We investigate if GANs can also be used to approximate one dimensional Ito stochastic differential equations (SDEs). We propose a scheme that approximates the path wise conditional distribution of SDEs for large time steps. Standard GANs are only able to approximate processes in distribution, yielding a weak approximation to the SDE. A conditional GAN architecture is proposed that enables strong approximation. We inform the discriminator of this GAN with the map between the prior input to the generator and the corresponding output samples, i.e. we introduce a supervised GAN'. We compare the input output map obtained with the standard GAN and supervised GAN and show experimentally that the standard GAN may fail to provide a path wise approximation. The GAN is trained on a dataset obtained with exact simulation. The architecture was tested on geometric Brownian motion (GBM) and the Cox Ingersoll Ross (CIR) process. The supervised GAN outperformed the Euler and Milstein schemes in strong error on a discretisation with large time steps. It also outperformed the standard conditional GAN when approximating the conditional distribution. We also demonstrate how standard GANs may give rise to non parsimonious input output maps that are sensitive to perturbations, which motivates the need for constraints and regularisation on GAN generators.


Plan Better Amid Conservatism Offline Multi Agent Reinforcement Learning with Actor Rectification. Conservatism has led to significant progress in offline reinforcement learning (RL) where an agent learns from pre collected datasets. However, as many real world scenarios involve interaction among multiple agents, it is important to resolve offline RL in the multi agent setting. Given the recent success of transferring online RL algorithms to the multi agent setting, one may expect that offline RL algorithms will also transfer to multi agent settings directly. Surprisingly, we empirically observe that conservative offline RL algorithms do not work well in the multi agent setting the performance degrades significantly with an increasing number of agents. Towards mitigating the degradation, we identify a key issue that non concavity of the value function makes the policy gradient improvements prone to local optima. Multiple agents exacerbate the problem severely, since the suboptimal policy by any agent can lead to uncoordinated global failure. Following this intuition, we propose a simple yet effective method, Offline Multi Agent RL with Actor Rectification (OMAR), which combines the first order policy gradients and zeroth order optimization methods to better optimize the conservative value functions over the actor parameters. Despite the simplicity, OMAR achieves state of the art results in a variety of multi agent control tasks.