GC MS Profile of Diodella sarmentosa (SW) Bacigalupo El Cabral ex Borhidi Ethanol Leaf Extract and its Total Dehydrogenase Inhibitory Potential. Phytochemical composition of ethanol leaf extract of Diodella sarmentosa was profiled with GC MS and the inhibitory property of the extract against total microbial dehydrogenases were assessed. The major constituents of the extract were squalene (29.50 ), Phytol (24.68 ), phenol, 3 pentadecyl (18.58 ), 1 Butanol, 3 methyl (9.09 ) and n Hexadecanoic acid (7.78 ). The minimum inhibitory concentration (MIC) of the extract against broad spectrum of microbial population was assessed. Bacillus subtilis, Candidas spp, and Penicillium spp were more sensitive to the treatment and thus were further investigated using Dehydrogenase activity assay method. Total dehydrogenase activities of Bacillus subtilis, Candidas spp, and Penicillium spp at the extract concentration range of 0 to 2000mg ml were progressively inhibited at increasing extract concentrations. The threshold inhibitory concentrations (IC50) of the extracts against Candidas spp, Penicillium spp and Bacillus subtilis were 275micro. g ml, 322 micro. g ml and 411 micro. g ml respectively. Our findings suggested the extract as a useful source of antimicrobial phytochemicals for pharmaceutical use.


Accelerated Simulations of Molecular Systems through Learning of their Effective Dynamics. Simulations are vital for understanding and predicting the evolution of complex molecular systems. However, despite advances in algorithms and special purpose hardware, accessing the timescales necessary to capture the structural evolution of bio molecules remains a daunting task. In this work we present a novel framework to advance simulation timescales by up to three orders of magnitude, by learning the effective dynamics (LED) of molecular systems. LED augments the equation free methodology by employing a probabilistic mapping between coarse and fine scales using mixture density network (MDN) autoencoders and evolves the non Markovian latent dynamics using long short term memory MDNs. We demonstrate the effectiveness of LED in the M "ueller Brown potential, the Trp Cage protein, and the alanine dipeptide. LED identifies explainable reduced order representations and can generate, at any instant, the respective all atom molecular trajectories. We believe that the proposed framework provides a dramatic increase to simulation capabilities and opens new horizons for the effective modeling of complex molecular systems.


Persistence of periodic and homoclinic orbits, first integrals and commutative vector fields in dynamical systems. We study persistence of periodic and homoclinic orbits, first integrals and commutative vector fields in dynamical systems depending on a small parameter varepsilon 0 and give several necessary conditions for their persistence. Here we treat homoclinic orbits not only to equilibria but also to periodic orbits. We also discuss some relationships of these results with the standard subharmonic and homoclinic Melnikov methods for time periodic perturbations of single degree of freedom Hamiltonian systems, and with another version of the homoclinic Melnikov method for autonomous perturbations of multi degree of freedom Hamiltonian systems. In particular, we show that a first integral which converges to the Hamiltonian or another first integral as the perturbation tends to zero does not exist near the unperturbed periodic or homoclinic orbits in the perturbed systems if the subharmonic or homoclinic Melnikov functions are not identically zero on connected open sets. We illustrate our theory for four examples The periodically forced Duffing oscillator, two identical pendula coupled with a harmonic oscillator, a periodically forced rigid body and a three mode truncation of a buckled beam.


Crossing tribes of tangles in a thickened surface. Crossings of knot diagrams can be divided into classes (tribes) compatible with Reidemeister moves. Tribes can be considered as localization of the notion of weak chord index introduced by M. Xu. In the article we describe tribes of crossings for tangles in a fixed surface and show that crossings are differentiated by their component, order and homotopy types. As a consequence, we conclude that there are no nontrivial indices on diagrams of classical knots.


Conflict free coloring on open neighborhoods of claw free graphs. The Conflict Free Open (Closed) Neighborhood coloring', abbreviated CFON (CFCN) coloring, of a graph G using r colors is a coloring of the vertices of G such that every vertex sees some color exactly once in its open (closed) neighborhood. The minimum r such that G has a CFON (CFCN) coloring using r colors is called the CFON chromatic number' ( CFCN chromatic number') of G . This is denoted by chi CF ON (G) ( chi CF CN (G) ). D k ebski and Przyby l o in J. Graph Theory, 2021 showed that if G is a line graph with maximum degree Delta , then chi CF CN (G) O( ln Delta) . As an open question, they asked if the result could be extended to claw free ( K 1,3 free) graphs, which are a superclass of line graphs. For k geq 3 , we show that if G is K 1,k free, then chi CF ON (G) O(k 2 ln Delta) . Since it is known that the CFCN chromatic number of a graph is at most twice its CFON chromatic number, this answers the question posed by D k e bski and Przyby l o.


Realizing Forward Defense in the Cyber Domain. With the recognition of cyberspace as an operating domain, concerted effort is now being placed on addressing it in the whole of domain manner found in land, sea, undersea, air, and space domains. Among the first steps in this effort is applying the standard supporting concepts of security, defense, and deterrence to the cyber domain. This paper presents an architecture that helps realize forward defense in cyberspace, wherein adversarial actions are repulsed as close to the origin as possible. However, substantial work remains in making the architecture an operational reality including furthering fundamental research cyber science, conducting design trade off analysis, and developing appropriate public policy frameworks.


Finite groups which have maximal covers. Let lambda(G) be the maximum number of subgroups in an irredundant covering of a finite group G . We prove that the finite groups with lambda(G) G t , where t leq 5 , are solvable, and classify such groups.


Electromagnetic Scattering by Networks of High Permittivity Thin Wires. The electromagnetic scattering from interconnections of high permittivity dielectric thin wires with sizes smaller than (or almost equal to) the operating wavelength is investigated. A simple lumped element model for the polarization current intensities induced in the wires is proposed. The circuit elements are capacitances and inductances between the wires. An analytical expression for the induced polarization currents in terms of the magneto quasistatic current modes is obtained. The connection between the spectral properties of the loop inductance matrix and the network's resonances is established. The number of the allowed current modes and resonances is deduced from the topology of the circuit's digraph. The coupling to radiation is also included, and the radiative frequency shifts and the quality factors are derived. The introduced concept and methods may find applications both at the microwaves and in nanophotonics.


Generalized Few Shot Semantic Segmentation All You Need is Fine Tuning. Generalized few shot semantic segmentation was introduced to move beyond only evaluating few shot segmentation models on novel classes to include testing their ability to remember base classes. While the current state of the art approach is based on meta learning, it performs poorly and saturates in learning after observing only a few shots. We propose the first fine tuning solution, and demonstrate that it addresses the saturation problem while achieving state of the art results on two datasets, PASCAL 5i and COCO 20i. We also show that it outperforms existing methods, whether fine tuning multiple final layers or only the final layer. Finally, we present a triplet loss regularization that shows how to redistribute the balance of performance between novel and base categories so that there is a smaller gap between them.


Approximately counting independent sets of a given size in bounded degree graphs. We determine the computational complexity of approximately counting and sampling independent sets of a given size in bounded degree graphs. That is, we identify a critical density alpha c( Delta) and provide (i) for alpha alpha c( Delta) randomized polynomial time algorithms for approximately sampling and counting independent sets of given size at most alpha n in n vertex graphs of maximum degree Delta and (ii) a proof that unless NP RP, no such algorithms exist for alpha alpha c( Delta) . The critical density is the occupancy fraction of the hard core model on the clique K Delta 1 at the uniqueness threshold on the infinite Delta regular tree, giving alpha c( Delta) sim frac e 1 e frac 1 Delta as Delta to infty . Our methods apply more generally to anti ferromagnetic 2 spin systems and motivate new questions in extremal combinatorics.


Weighted error estimates for transient transport problems discretized using continuous finite elements with interior penalty stabilization on the gradient jumps. In this paper we consider the semi discretization in space of a first order scalar transport equation. For the space discretization we use standard continuous finite elements. To obtain stability we add a penalty on the jump of the gradient over element faces. We recall some global error estimates for smooth and rough solutions and then prove a new local error estimate for the transient linear transport equation. In particular we show that in the stabilized method the effect of non smooth features in the solution decay exponentially from the space time zone where the solution is rough so that smooth features will be transported unperturbed. Locally the L 2 norm error converges with the expected order O(h k frac12 ) . We then illustrate the results numerically. In particular we show the good local accuracy in the smooth zone of the stabilized method and that the standard Galerkin fails to approximate a solution that is smooth at the final time if discontinuities have been present in the solution at some time during the evolution.


Plug and Play gradient based denoisers applied to CT image enhancement. Blur and noise corrupting Computed Tomography (CT) images can hide or distort small but important details, negatively affecting the diagnosis. In this paper, we present a novel gradient based Plug and Play algorithm, constructed on the Half Quadratic Splitting scheme, and we apply it to restore CT images. In particular, we consider different schemes encompassing external and internal denoisers as priors, defined on the image gradient domain. The internal prior is based on the Total Variation functional. The external denoiser is implemented by a deep Convolutional Neural Network (CNN) trained on the gradient domain (and not on the image one, as in state of the art works). We also prove a general fixed point convergence theorem under weak assumptions on both internal and external denoisers. The experiments confirm the effectiveness of the proposed framework in restoring blurred noisy CT images, both in simulated and real medical settings. The achieved enhancements in the restored images are really remarkable, if compared to the results of many state of the art methods.


A geometric approach to elliptic curves with torsion groups mathbb Z 10 mathbb Z , mathbb Z 12 mathbb Z , mathbb Z 14 mathbb Z , and mathbb Z 16 mathbb Z . We give new parametrisations of elliptic curves in Weierstrass normal form y 2 x 3 ax 2 bx with torsion groups mathbb Z 10 mathbb Z and mathbb Z 12 mathbb Z over mathbb Q , and with mathbb Z 14 mathbb Z and mathbb Z 16 mathbb Z over quadratic fields. Even though the parametrisations are equivalent to those given by Kubert and Rabarison, respectively, with the new parametrisations we found three infinite families of elliptic curves with torsion group mathbb Z 12 mathbb Z and positive rank. Furthermore, we found elliptic curves with torsion group mathbb Z 14 mathbb Z and rank 3 , which is a new record for such curves, as well as some new elliptic curves with torsion group mathbb Z 16 mathbb Z and rank 3 .


Integral closures, Primary Hyperideals and Hypervaluation Hyperideals of Kranser Hyperrings. In this paper, the notions of integral closure of hyperrings and hyperideals in a Krasner hyperring (R, , cdot) are defined and some basics properties of them are studied. We define also the notion of hypervaluation hyperideals and then a relations between hypervaluations, integral closure of hyperideals and primary hyperideals are studied. In fact it is shown that the integral closure of a hyperideal is determined by the hypervaluation Krasner hyperrings.


Deep learning for sentence clustering in essay grading support. Essays as a form of assessment test student knowledge on a deeper level than short answer and multiple choice questions. However, the manual evaluation of essays is time and labor consuming. Automatic clustering of essays, or their fragments, prior to manual evaluation presents a possible solution to reducing the effort required in the evaluation process. Such clustering presents numerous challenges due to the variability and ambiguity of natural language. In this paper, we introduce two datasets of undergraduate student essays in Finnish, manually annotated for salient arguments on the sentence level. Using these datasets, we evaluate several deep learning embedding methods for their suitability to sentence clustering in support of essay grading. We find that the choice of the most suitable method depends on the nature of the exam question and the answers, with deep learning methods being capable of, but not guaranteeing better performance over simpler methods based on lexical overlap.


Continuity and topological structural stability for nonautonomous random attractors. In this work, we study continuity and topological structural stability of attractors for nonautonomous random differential equations obtained by small bounded random perturbations of autonomous semilinear problems. First, we study existence and permanence of unstable sets of hyperbolic solutions. Then, we use this to establish lower semicontinuity of nonautonomous random attractors and to show that the gradient structure persists under nonautonomous random perturbations. Finally, we apply the abstract results in a stochastic differential equation and in a damped wave equation with a perturbation on the damping.


Variable Muckenhoupt weights with applications in approximation. Variable Muckenhoupt weights are considered in variable exponent Lebesgue spaces. Applications are given for polynomial approximation in these spaces. Boundedness of averaging operator is proved to gain a transference result. Almost all weighted norm inequalities are obtained using this transference result. Potential type approximate identities are considered. Translations of Steklov operator are proved to be bounded in these spaces. K functional is a good apparatus for measuring smoothness properties of functions given in these function classes. Main inequalities of approximation are derived.


A high fidelity numerical study on the propulsive performance of pitching flexible plates. In this paper, we numerically investigate the propulsive performance of three dimensional pitching flexible plates with varying flexibility and trailing edge shapes. To eliminate the effect of other geometric parameters, only the trailing edge angle is varied from 45 deg (concave), 90 deg (rectangular) to 135 deg (convex) while maintaining the constant area of the flexible plate. We examine the impact of the frequency ratio f defined as the ratio of the natural frequency of the flexible plate to the actuated pitching frequency. Through our numerical simulations, we find that the global maximum mean thrust occurs near f 1 corresponding to the resonance condition. However, the optimal propulsive efficiency is achieved around f 1.54 instead of the resonance condition. While the convex plate with low and high bending stiffness values shows the best performance, the rectangular plate with moderate bending stiffness is the most efficient propulsion configuration. Through dynamic mode decomposition, we find that the passive deformation can help in redistributing the pressure gradient thus improving the efficiency and thrust production. A momentum based thrust evaluation approach is adopted to link the instantaneous vortical structures with the time dependent thrust. When the vortices detach from the trailing edge, the instantaneous thrust shows the largest values due to the strong momentum change and convection process. Moderate flexibility and convex shape help transfer momentum to the fluid, thereby improving thrust generation and promoting the transition from drag to thrust. The increase of the trailing edge angle can broaden the range of flexibility that produces positive mean thrust.


How to Quantify Polarization in Models of Opinion Dynamics. It is widely believed that society is becoming increasingly polarized around important issues, a dynamic that does not align with common mathematical models of opinion formation in social networks. In particular, measures of polarization based on opinion variance are known to decrease over time in frameworks such as the popular DeGroot model. Complementing recent work that seeks to resolve this apparent inconsistency by modifying opinion models, we instead resolve the inconsistency by proposing changes to how polarization is quantified. We present a natural class of group based polarization measures that capture the extent to which opinions are clustered into distinct groups. Using theoretical arguments and empirical evidence, we show that these group based measures display interesting, non monotonic dynamics, even in the simple DeGroot model. In particular, for many natural social networks, group based metrics can increase over time, and thereby correctly capture perceptions of increasing polarization. Our results build on work by DeMarzo et al., who introduced a group based polarization metric based on ideological alignment. We show that a central tool from that work, a limit analysis of individual opinions under the DeGroot model, can be extended to the dynamics of other group based polarization measures, including established statistical measures like bimodality. We also consider local measures of polarization that operationalize how polarization is perceived in a network setting. In conjunction with evidence from prior work that group based measures better align with real world perceptions of polarization, our work provides formal support for the use of these measures in place of variance based polarization in future studies of opinion dynamics.


Mapless Navigation Learning UAVs Motion forExploration of Unknown Environments. This study presents a new methodology for learning based motion planning for autonomous exploration using aerial robots. Through the reinforcement learning method of learning through trial and error, the action policy is derived that can guide autonomous exploration of underground and tunnel environments. A new Markov decision process state is designed to learn the robot's action policy by using simulation only, and the results are applied to the real world environment without further learning. Reduce the need for the precision map in grid based path planner and achieve map less navigation. The proposed method can have a path with less computing cost than the grid based planner but has similar performance. The trained action policy is broadly evaluated in both simulation and field trials related to autonomous exploration of underground mines or indoor spaces.


The spectral norm of Gaussian matrices with correlated entries. We give a non asymptotic bound on the spectral norm of a d times d matrix X with centered jointly Gaussian entries in terms of the covariance matrix of the entries. In some cases, this estimate is sharp and removes the sqrt log d factor in the noncommutative Khintchine inequality.


Local Problems on Trees from the Perspectives of Distributed Algorithms, Finitary Factors, and Descriptive Combinatorics. We study connections between distributed local algorithms, finitary factors of iid processes, and descriptive combinatorics in the context of regular trees. We extend the Borel determinacy technique of Marks coming from descriptive combinatorics and adapt it to the area of distributed computing. Using this technique, we prove deterministic distributed Omega( log n) round lower bounds for problems from a natural class of homomorphism problems. Interestingly, these lower bounds seem beyond the current reach of the powerful round elimination technique responsible for all substantial locality lower bounds of the last years. Our key technical ingredient is a novel ID graph technique that we expect to be of independent interest. We prove that a local problem admits a Baire measurable coloring if and only if it admits a local algorithm with local complexity O( log n) , extending the classification of Baire measurable colorings of Bernshteyn. A key ingredient of the proof is a new and simple characterization of local problems that can be solved in O( log n) rounds. We complement this result by showing separations between complexity classes from distributed computing, finitary factors, and descriptive combinatorics. Most notably, the class of problems that allow a distributed algorithm with sublogarithmic randomized local complexity is incomparable with the class of problems with a Borel solution. We hope that our treatment will help to view all three perspectives as part of a common theory of locality, in which we follow the insightful paper of Bernshteyn arXiv 2004.04905 .


End to End Task Oriented Dialog Modeling with Semi Structured Knowledge Management. Current task oriented dialog (TOD) systems mostly manage structured knowledge (e.g. databases and tables) to guide the goal oriented conversations. However, they fall short of handling dialogs which also involve unstructured knowledge (e.g. reviews and documents). In this paper, we formulate a task of modeling TOD grounded on a fusion of structured and unstructured knowledge. To address this task, we propose a TOD system with semi structured knowledge management, SeKnow, which extends the belief state to manage knowledge with both structured and unstructured contents. Furthermore, we introduce two implementations of SeKnow based on a non pretrained sequence to sequence model and a pretrained language model, respectively. Both implementations use the end to end manner to jointly optimize dialog modeling grounded on structured and unstructured knowledge. We conduct experiments on a modified version of MultiWOZ 2.1 dataset, Mod MultiWOZ 2.1, where dialogs are processed to involve semi structured knowledge. Experimental results show that SeKnow has strong performances in both end to end dialog and intermediate knowledge management, compared to existing TOD systems and their extensions with pipeline knowledge management schemes.


Convolutional Neural Networks with Gated Recurrent Connections. The convolutional neural network (CNN) has become a basic model for solving many computer vision problems. In recent years, a new class of CNNs, recurrent convolution neural network (RCNN), inspired by abundant recurrent connections in the visual systems of animals, was proposed. The critical element of RCNN is the recurrent convolutional layer (RCL), which incorporates recurrent connections between neurons in the standard convolutional layer. With increasing number of recurrent computations, the receptive fields (RFs) of neurons in RCL expand unboundedly, which is inconsistent with biological facts. We propose to modulate the RFs of neurons by introducing gates to the recurrent connections. The gates control the amount of context information inputting to the neurons and the neurons' RFs therefore become adaptive. The resulting layer is called gated recurrent convolution layer (GRCL). Multiple GRCLs constitute a deep model called gated RCNN (GRCNN). The GRCNN was evaluated on several computer vision tasks including object recognition, scene text recognition and object detection, and obtained much better results than the RCNN. In addition, when combined with other adaptive RF techniques, the GRCNN demonstrated competitive performance to the state of the art models on benchmark datasets for these tasks. The codes are released at href https github.com Jianf Wang GRCNN https github.com Jianf Wang GRCNN .


Spalling induced liftoff and transfer of electronic films using a van der Waals release layer. Heterogeneous integration strategies are increasingly being employed to achieve more compact and capable electronics systems for multiple applications including space, electric vehicles, and wearable and medical devices. To enable new integration strategies, the growth and transfer of thin electronic films and devices, including III nitrides, metal oxides, and two dimensional (2D) materials, using 2D boron nitride (BN) on sapphire templates is demonstrated. The van der Waals BN layer, in this case, acts as a preferred mechanical release layer for precise separation at the substrate film interface and leaves a smooth surface suitable for van der Waals bonding. A tensilely stressed Ni layer sputtered on top of the film induces controlled spalling fracture which propagates at the BN sapphire interface. By incorporating controlled spalling, the process yield and sensitivity is greatly improved, owed to the greater fracture energy provided by the stressed metal layer relative to a soft tape or rubber stamp. With stress playing a critical role in this process, the influence of residual stress on detrimental cracking and bowing is investigated. Additionally, a selected area lift off technique is developed which allows for isolation and transfer of individual devices while maximizing wafer area use and minimizing extra alignment steps in the integration process.


MoDeRNN Towards Fine grained Motion Details for Spatiotemporal Predictive Learning. Spatiotemporal predictive learning (ST PL) aims at predicting the subsequent frames via limited observed sequences, and it has broad applications in the real world. However, learning representative spatiotemporal features for prediction is challenging. Moreover, chaotic uncertainty among consecutive frames exacerbates the difficulty in long term prediction. This paper concentrates on improving prediction quality by enhancing the correspondence between the previous context and the current state. We carefully design Detail Context Block (DCB) to extract fine grained details and improve the isolated correlation between upper context state and current input state. We integrate DCB with standard ConvLSTM and introduce Motion Details RNN (MoDeRNN) to capture fine grained spatiotemporal features and improve the expression of latent states of RNNs to achieve significant quality. Experiments on Moving MNIST and Typhoon datasets demonstrate the effectiveness of the proposed method. MoDeRNN outperforms existing state of the art techniques qualitatively and quantitatively with lower computation loads.


Graph to 3D End to End Generation and Manipulation of 3D Scenes Using Scene Graphs. Controllable scene synthesis consists of generating 3D information that satisfy underlying specifications. Thereby, these specifications should be abstract, i.e. allowing easy user interaction, whilst providing enough interface for detailed control. Scene graphs are representations of a scene, composed of objects (nodes) and inter object relationships (edges), proven to be particularly suited for this task, as they allow for semantic control on the generated content. Previous works tackling this task often rely on synthetic data, and retrieve object meshes, which naturally limits the generation capabilities. To circumvent this issue, we instead propose the first work that directly generates shapes from a scene graph in an end to end manner. In addition, we show that the same model supports scene modification, using the respective scene graph as interface. Leveraging Graph Convolutional Networks (GCN) we train a variational Auto Encoder on top of the object and edge categories, as well as 3D shapes and scene layouts, allowing latter sampling of new scenes and shapes.


On the Feller Dynkin and the Martingale Property of One Dimensional Diffusions. We show that a one dimensional regular continuous Markov process ( X ) with scale function (s ) is a Feller Dynkin process precisely if the space transformed process (s (X) ) is a martingale when stopped at the boundaries of its state space. As a consequence, the Feller Dynkin and the martingale property are equivalent for regular diffusions on natural scale with open state space. By means of a counterexample, we also show that this equivalence fails for multi dimensional diffusions. Moreover, for It o diffusions we discuss relations to Cauchy problems.


Investigating Transfer Learning in Multilingual Pre trained Language Models through Chinese Natural Language Inference. Multilingual transformers (XLM, mT5) have been shown to have remarkable transfer skills in zero shot settings. Most transfer studies, however, rely on automatically translated resources (XNLI, XQuAD), making it hard to discern the particular linguistic knowledge that is being transferred, and the role of expert annotated monolingual datasets when developing task specific models. We investigate the cross lingual transfer abilities of XLM R for Chinese and English natural language inference (NLI), with a focus on the recent large scale Chinese dataset OCNLI. To better understand linguistic transfer, we created 4 categories of challenge and adversarial tasks (totaling 17 new datasets) for Chinese that build on several well known resources for English (e.g., HANS, NLI stress tests). We find that cross lingual models trained on English NLI do transfer well across our Chinese tasks (e.g., in 3 4 of our challenge categories, they perform as well better than the best monolingual models, even on 3 5 uniquely Chinese linguistic phenomena such as idioms, pro drop). These results, however, come with important caveats cross lingual models often perform best when trained on a mixture of English and high quality monolingual NLI data (OCNLI), and are often hindered by automatically translated resources (XNLI zh). For many phenomena, all models continue to struggle, highlighting the need for our new diagnostics to help benchmark Chinese and cross lingual models. All new datasets code are released at https github.com huhailinguist ChineseNLIProbing.


Kernel Continual Learning. This paper introduces kernel continual learning, a simple but effective variant of continual learning that leverages the non parametric nature of kernel methods to tackle catastrophic forgetting. We deploy an episodic memory unit that stores a subset of samples for each task to learn task specific classifiers based on kernel ridge regression. This does not require memory replay and systematically avoids task interference in the classifiers. We further introduce variational random features to learn a data driven kernel for each task. To do so, we formulate kernel continual learning as a variational inference problem, where a random Fourier basis is incorporated as the latent variable. The variational posterior distribution over the random Fourier basis is inferred from the coreset of each task. In this way, we are able to generate more informative kernels specific to each task, and, more importantly, the coreset size can be reduced to achieve more compact memory, resulting in more efficient continual learning based on episodic memory. Extensive evaluation on four benchmarks demonstrates the effectiveness and promise of kernels for continual learning.


Elliptic curves with a point of order 13 defined over cyclic cubic fields. We show that there is essentially a unique elliptic curve E defined over a cubic Galois extension K of mathbb Q with a K rational point of order 13 and such that E is not defined over mathbb Q .


Total Coloring and Total Matching Polyhedra and Facets. A total coloring of a graph G (V, E) is an assignment of colors to vertices and edges such that neither two adjacent vertices nor two incident edges get the same color, and, for each edge, the end points and the edge itself receive different colors. Any valid total coloring induces a partition of the elements of G into total matchings, which are defined as subsets of vertices and edges that can take the same color. In this paper, we propose Integer Linear Programming models for both the Total Coloring and the Total Matching problems, and we study the strength of the corresponding Linear Programming relaxations. The total coloring is formulated as the problem of finding the minimum number of total matchings that cover all the graph elements. This covering formulation can be solved by a Column Generation algorithm, where the pricing subproblem corresponds to the Weighted Total Matching Problem. Hence, we study the Total Matching Polytope. We introduce three families of nontrivial valid inequalities vertex clique inequalities based on standard clique inequalities of the Stable Set Polytope, congruent 2k3 cycle inequalities based on the parity of the vertex set induced by the cycle, and even clique inequalities induced by complete subgraphs of even order. We prove that congruent 2k3 cycle inequalities are facet defining only when k 4 , while the vertex clique and even cliques are always facet defining. Finally, we present preliminary computational results of a Column Generation algorithm for the Total Coloring Problem and a Cutting Plane algorithm for the Total Matching Problem.


Lost circulation diagnostics using derivative based type curves for non Newtonian mud leakage into fractured formation. Drilling is a requisite operation for many industries to reach a targeted subsurface zone. Loss of circulation is a common problem that often causes interruptions to the drilling process and a reduction in efficiency. In this work, a semi analytical solution and mud type curves (MTC) are proposed to offer a quick and accurate diagnostic model to assess the lost circulation of Herschel Bulkley fluids in fractured media. Based on the observed transient pressure and mud loss trends, the model can estimate the effective fracture conductivity, the time dependent cumulative mud loss volume, and the leakage period. The behavior of lost circulation into fractured formation can be quickly evaluated, at the drilling site, to perform useful diagnostics, such as the rate of fluid leakage, and the associated effective fracture hydraulic properties. Further, novel derivative based mud type curves (DMTC) are developed to quantify the leakage of drilling fluid flow into fractures. The developed model is applied for non Newtonian fluids exhibiting yield power law, including shear thickening and thinning, and Bingham plastic fluids. Proposing new dimensionless groups generates the dual type curves, MTC and DMTC, which offer superior predictivity compared to traditional methods. Both type curve sets are used in a dual trend matching, which significantly reduces the non uniqueness issue that is typically encountered in type curves. Data for lost circulation from several field cases are presented to demonstrate the applicability of the proposed method. The semi analytical solver, combined with Monte Carlo simulations, is then applied to assess the sensitivity and uncertainty of various fluid and subsurface parameters. The proposed can serve as a quick diagnostic tool to evaluate lost circulation in drilling operations.


Influence of risk tolerance on long term investments A Malliavin calculus approach. This study investigates the influence of risk tolerance on the expected utility in the long run. We estimate the extent to which the expected utility of optimal portfolios is affected by small changes in the risk tolerance. For this purpose, we adopt the Malliavin calculus method and the Hansen Scheinkman decomposition, through which the expected utility is expressed in terms of the eigenvalues and eigenfunctions of an operator. We conclude that the influence of risk aversion on the expected utility is determined by these eigenvalues and eigenfunctions in the long run.


Bipedal Humanoid Hardware Design A Technology Review. Purpose of Review As new technological advancements are made, humanoid robots that utilise them are being designed and manufactured. For optimal design choices, a broad overview with insight on the advantages and disadvantages of available technologies is necessary. This article intends to provide an analysis on the established approaches and contrast them with emerging ones. Recent Findings A clear shift in the recent design features of humanoid robots is developing, which is supported by literature. As humanoid robots are meant to leave laboratories and traverse the world, compliance and more efficient locomotion is necessary. The limitations of highly rigid actuation are being tackled by different research groups in unique ways. Some focus on modifying the kinematic structure, while others change the actuation scheme. With new manufacturing capabilities, previously impossible designs are becoming feasible. Summary A comprehensive review on the technologies crucial for bipedal humanoid robots was performed. Different mechanical concepts have been discussed, along with the advancements in actuation, sensing and manufacturing. The paper is supplemented with a list of the recently developed platforms along with a selection of their specifications.


Evaluating Spatial Accelerator Architectures with Tiled Matrix Matrix Multiplication. There is a growing interest in custom spatial accelerators for machine learning applications. These accelerators employ a spatial array of processing elements (PEs) interacting via custom buffer hierarchies and networks on chip. The efficiency of these accelerators comes from employing optimized dataflow (i.e., spatial temporal partitioning of data across the PEs and fine grained scheduling) strategies to optimize data reuse. The focus of this work is to evaluate these accelerator architectures using a tiled general matrix matrix multiplication (GEMM) kernel. To do so, we develop a framework that finds optimized mappings (dataflow and tile sizes) for a tiled GEMM for a given spatial accelerator and workload combination, leveraging an analytical cost model for runtime and energy. Our evaluations over five spatial accelerators demonstrate that the tiled GEMM mappings systematically generated by our framework achieve high performance on various GEMM workloads and accelerators.


Recurrent Vision Transformer for Solving Visual Reasoning Problems. Although convolutional neural networks (CNNs) showed remarkable results in many vision tasks, they are still strained by simple yet challenging visual reasoning problems. Inspired by the recent success of the Transformer network in computer vision, in this paper, we introduce the Recurrent Vision Transformer (RViT) model. Thanks to the impact of recurrent connections and spatial attention in reasoning tasks, this network achieves competitive results on the same different visual reasoning problems from the SVRT dataset. The weight sharing both in spatial and depth dimensions regularizes the model, allowing it to learn using far fewer free parameters, using only 28k training samples. A comprehensive ablation study confirms the importance of a hybrid CNN Transformer architecture and the role of the feedback connections, which iteratively refine the internal representation until a stable prediction is obtained. In the end, this study can lay the basis for a deeper understanding of the role of attention and recurrent connections for solving visual abstract reasoning tasks.


Core Challenges of Social Robot Navigation A Survey. Robot navigation in crowded public spaces is a complex task that requires addressing a variety of engineering and human factors challenges. These challenges have motivated a great amount of research resulting in important developments for the fields of robotics and human robot interaction over the past three decades. Despite the significant progress and the massive recent interest, we observe a number of significant remaining challenges that prohibit the seamless deployment of autonomous robots in public pedestrian environments. In this survey article, we organize existing challenges into a set of categories related to broader open problems in motion planning, behavior design, and evaluation methodologies. Within these categories, we review past work, and offer directions for future research. Our work builds upon and extends earlier survey efforts by a) taking a critical perspective and diagnosing fundamental limitations of adopted practices in the field and b) offering constructive feedback and ideas that we aspire will drive research in the field over the coming decade.


Neural String Edit Distance. We propose the neural string edit distance model for string pair matching and string transduction based on learnable string edit distance. We modify the original expectation maximization learned edit distance algorithm into a differentiable loss function, allowing us to integrate it into a neural network providing a contextual representation of the input. We evaluate on cognate detection, transliteration, and grapheme to phoneme conversion, and show that we can trade off between performance and interpretability in a single framework. Using contextual representations, which are difficult to interpret, we match the performance of state of the art string pair matching models. Using static embeddings and a slightly different loss function, we force interpretability, at the expense of an accuracy drop.


Simultaneous space time finite element methods for parabolic optimal control problems. This work presents, analyzes and tests stabilized space time finite element methods on fully unstructured simplicial space time meshes for the numerical solution of space time tracking parabolic optimal control problems with the standard L 2 regularization.


Complex nilmanifolds with constant holomorphic sectional curvature. A well known conjecture in complex geometry states that a compact Hermitian manifold with constant holomorphic sectional curvature must be K "ahler if the constant is non zero and must be Chern flat if the constant is zero. The conjecture is confirmed in complex dimension 2 , by the work of Balas Gauduchon in 1985 (when the constant is zero or negative) and by Apostolov Davidov Muskarov in 1996 (when the constant is positive). For higher dimensions, the conjecture is still largely unknown. In this article, we restrict ourselves to the class of complex nilmanifolds and confirm the conjecture in that case.


How diverse is the ACII community? Analysing gender, geographical and business diversity of Affective Computing research. ACII is the premier international forum for presenting the latest research on affective computing. In this work, we monitor, quantify and reflect on the diversity in ACII conference across time by computing a set of indexes. We measure diversity in terms of gender, geographic location and academia vs research centres vs industry, and consider three different actors authors, keynote speakers and organizers. Results raise awareness on the limited diversity in the field, in all studied facets, and compared to other AI conferences. While gender diversity is relatively high, equality is far from being reached. The community is dominated by European, Asian and North American researchers, leading the rest of continents under represented. There is also a strong absence of companies and research centres focusing on applied research and products. This study fosters discussion in the community on the need for diversity and related challenges in terms of minimizing potential biases of the developed systems to the represented groups. We intend our paper to contribute with a first analysis to consider as a monitoring tool when implementing diversity initiatives. The data collected for this study are publicly released through the European divinAI initiative.


DP SGD vs PATE Which Has Less Disparate Impact on Model Accuracy?. Recent advances in differentially private deep learning have demonstrated that application of differential privacy, specifically the DP SGD algorithm, has a disparate impact on different sub groups in the population, which leads to a significantly high drop in model utility for sub populations that are under represented (minorities), compared to well represented ones. In this work, we aim to compare PATE, another mechanism for training deep learning models using differential privacy, with DP SGD in terms of fairness. We show that PATE does have a disparate impact too, however, it is much less severe than DP SGD. We draw insights from this observation on what might be promising directions in achieving better fairness privacy trade offs.


Improving a neural network model by explanation guided training for glioma classification based on MRI data. In recent years, artificial intelligence (AI) systems have come to the forefront. These systems, mostly based on Deep learning (DL), achieve excellent results in areas such as image processing, natural language processing, or speech recognition. Despite the statistically high accuracy of deep learning models, their output is often a decision of "black box". Thus, Interpretability methods have become a popular way to gain insight into the decision making process of deep learning models. Explanation of a deep learning model is desirable in the medical domain since the experts have to justify their judgments to the patient. In this work, we proposed a method for explanation guided training that uses a Layer wise relevance propagation (LRP) technique to force the model to focus only on the relevant part of the image. We experimentally verified our method on a convolutional neural network (CNN) model for low grade and high grade glioma classification problems. Our experiments show promising results in a way to use interpretation techniques in the model training process.


Fine grained prediction of food insecurity using news streams. Anticipating the outbreak of a food crisis is crucial to efficiently allocate emergency relief and reduce human suffering. However, existing food insecurity early warning systems rely on risk measures that are often delayed, outdated, or incomplete. Here, we leverage recent advances in deep learning to extract high frequency precursors to food crises from the text of a large corpus of news articles about fragile states published between 1980 and 2020. Our text features are causally grounded, interpretable, validated by existing data, and allow us to predict 32 more food crises than existing models up to three months ahead of time at the district level across 15 fragile states. These results could have profound implications on how humanitarian aid gets allocated and open new avenues for machine learning to improve decision making in data scarce environments.


KiNet A Deep Neural Network Representation of Chemical Kinetics. Deep learning is a potential approach to automatically develop kinetic models from experimental data. We propose a deep neural network model of KiNet to represent chemical kinetics. KiNet takes the current composition states and predicts the evolution of the states after a fixed time step. The long period evolution of the states and their gradients to model parameters can be efficiently obtained by recursively applying the KiNet model multiple times. To address the challenges of the high dimensional composition space and error accumulation in long period prediction, the architecture of KiNet incorporates the residual network model (ResNet), and the training employs backpropagation through time (BPTT) approach to minimize multi step prediction error. In addition, an approach for efficiently computing the gradient of the ignition delay time (IDT) to KiNet model parameters is proposed to train the KiNet against the rich database of IDT from literature, which could address the scarcity of time resolved species measurements. The KiNet is first trained and compared with the simulated species profiles during the auto ignition of H2 air mixtures. The obtained KiNet model can accurately predict the auto ignition processes for various initial conditions that cover a wide range of pressures, temperatures, and equivalence ratios. Then, we show that the gradient of IDT to KiNet model parameters is parallel to the gradient of the temperature at the ignition point. This correlation enables efficient computation of the gradient of IDT via backpropagation and is demonstrated as a feasible approach for fine tuning the KiNet against IDT. These demonstrations shall open up the possibility of building data driven kinetic models autonomously. Finally, the trained KiNet could be potentially applied to kinetic model reduction and chemistry acceleration in turbulent combustion simulations.


Numerical approximations of one point large deviations rate functions of stochastic differential equations with small noise. In this paper, we study the numerical approximation of the one point large deviations rate functions of nonlinear stochastic differential equations (SDEs) with small noise. We show that the stochastic theta method satisfies the one point large deviations principle with a discrete rate function for sufficiently small step size, and present a uniform error estimate between the discrete rate function and the continuous one on bounded sets in terms of step size. It is proved that the convergence orders in the cases of multiplicative noises and additive noises are 1 2 and 1 respectively. Based on the above results, we obtain an effective approach to numerically approximating the large deviations rate functions of nonlinear SDEs with small time. To the best of our knowledge, this is the first result on the convergence rate of discrete rate functions for approximating the one point large deviations rate functions associated with nonlinear SDEs with small noise.


Multi layered planar firefighting. Consider a model of fire spreading through a graph initially some vertices are burning, and at every given time step fire spreads from burning vertices to their neighbours. The firefighter problem is a solitaire game in which a player is allowed, at every time step, to protect some non burning vertices (by effectively deleting them) in order to contain the fire growth. How many vertices per turn, on average, must be protected in order to stop the fire from spreading infinitely? Here we consider the problem on mathbb Z 2 times h for both nearest neighbour adjacency and strong adjacency. We determine the critical protection rates for these graphs to be 1.5h and 3h , respectively. This establishes the fact that using an optimal two dimensional strategy for all layers in parallel is asymptotically optimal.


Three dimensional stochastic cubic nonlinear wave equation with almost space time white noise. We study the stochastic cubic nonlinear wave equation (SNLW) with an additive noise on the three dimensional torus mathbb T 3 . In particular, we prove local well posedness of the (renormalized) SNLW when the noise is almost a space time white noise. In recent years, the paracontrolled calculus has played a crucial role in the well posedness study of singular SNLW on mathbb T 3 by Gubinelli, Koch, and the first author (2018), Okamoto, Tolomeo, and the first author (2020), and Bringmann (2020). Our approach, however, does not rely on the paracontrolled calculus. We instead proceed with the second order expansion and study the resulting equation for the residual term, using multilinear dispersive smoothing.


Dual Cross Central Difference Network for Face Anti Spoofing. Face anti spoofing (FAS) plays a vital role in securing face recognition systems. Recently, central difference convolution (CDC) has shown its excellent representation capacity for the FAS task via leveraging local gradient features. However, aggregating central difference clues from all neighbors directions simultaneously makes the CDC redundant and sub optimized in the training phase. In this paper, we propose two Cross Central Difference Convolutions (C CDC), which exploit the difference of the center and surround sparse local features from the horizontal vertical and diagonal directions, respectively. It is interesting to find that, with only five ninth parameters and less computational cost, C CDC even outperforms the full directional CDC. Based on these two decoupled C CDC, a powerful Dual Cross Central Difference Network (DC CDN) is established with Cross Feature Interaction Modules (CFIM) for mutual relation mining and local detailed representation enhancement. Furthermore, a novel Patch Exchange (PE) augmentation strategy for FAS is proposed via simply exchanging the face patches as well as their dense labels from random samples. Thus, the augmented samples contain richer live spoof patterns and diverse domain distributions, which benefits the intrinsic and robust feature learning. Comprehensive experiments are performed on four benchmark datasets with three testing protocols to demonstrate our state of the art performance.


A Generative Approach for Mitigating Structural Biases in Natural Language Inference. Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to make a classification decision by only using the hypothesis, without learning the true relationship between it and the premise. These structural biases lead discriminative models to learn unintended superficial features and to generalize poorly out of the training distribution. In this work, we reformulate the NLI task as a generative task, where a model is conditioned on the biased subset of the input and the label and generates the remaining subset of the input. We show that by imposing a uniform prior, we obtain a provably unbiased model. Through synthetic experiments, we find that this approach is highly robust to large amounts of bias. We then demonstrate empirically on two types of natural bias that this approach leads to fully unbiased models in practice. However, we find that generative models are difficult to train and they generally perform worse than discriminative baselines. We highlight the difficulty of the generative modeling task in the context of NLI as a cause for this worse performance. Finally, by fine tuning the generative model with a discriminative objective, we reduce the performance gap between the generative model and the discriminative baseline, while allowing for a small amount of bias.


A high order differential equation based wall distance solver. A computationally efficient high order solver is developed to compute the wall distances, which are typically used for turbulence modelling, peripheral flow simulations, Computer Aided Design (CAD) etc. The wall distances are computed by solving the differential equations namely Eikonal, Hamilton Jacobi (H J) and Poisson. The computational benefit of using high order schemes (explicit compact schemes) for wall distance solvers, both in terms of accuracy and computational time, has been demonstrated. A new H J formulation based on the localized artificial diffusivity (LAD) approach has been proposed, which has produced results with an accuracy comparable to that of the Eikonal formulation. When compared to the baseline H J solver using upwind schemes, the solution accuracy has improved by an order of magnitude and the calculations are approx 5 times faster using the modified H J formulation. A modified curvature correction has also been implemented into the H J solver to account for the near wall errors due to concave convex wall curvatures. The performance of the solver using different schemes has been tested both on the steady canonical test cases and the unsteady test cases like piston cylinder arrangement', bouncing cube' and burning of a star grain propellant' where the wall distance evolves with time.


The IVP for a certain dispersion generalized ZK equation in bi periodic spaces. We establish well posedness conclusions for the Cauchy problem associated to the dispersion generalized Zakharov Kutnesov equation in bi periodic Sobolev spaces H s left( mathbb T 2 right) , s ( frac 3 2 frac 1 2 alpha 2 )( frac 3 2 frac beta 4 ) .


Inequalities for rational functions with prescribed poles. For rational functions, we use simple but elegant techniques to strengthen generalizations of certain results which extend some widely known polynomial inequalities of Erd "os Lax and Tur 'an to rational functions R. In return these reinforced results, in the limiting case, lead to the corresponding refinements of the said polynomial inequalities. As an illustration and as an application of our results, we obtain some new improvements of the Erd 'os Lax and Tur 'an type inequalities for polynomials. These improved results take into account the size of the constant term and the leading coefficient of the given polynomial. As a further factor of consideration, during the course of this paper we shall demonstrate how some recently obtained results due to S. L. Wali and W. M. Shah, Some applications of Dubinin's lemma to rational functions with prescribed poles, J. Math.Anal.Appl.450 (2017) 769 779 , could have been proved without invoking the results


BORAY An Axisymmetric Ray Tracing Code Supports Both Closed and Open Field Lines Plasmas. Ray tracing codes are useful to study the electromagnetic wave propagation and absorption in the geometrical optics approximation. In magnetized fusion plasma community, most ray tracing codes assume the plasma density and temperature be functions of the magnetic flux and study waves only inside the last closed flux surface, which are sufficient for the present day tokamak. However, they are difficult to be used for configurations with open magnetic field line plasmas, such as mirror machine and field reversed configuration (FRC). We develop a ray tracing code in cylindrical coordinates (r, phi,z) to support arbitrary axisymmetric configurations with both closed and open field lines plasmas. For wave propagation, the cold plasma dispersion relation is usually sufficient, and we require the magnetic field bf B (r,z) and species densities n s0 (r,z) profiles as input. For wave absorption, we require a further temperature T s0 (r,z) profile to solve a hot kinetic plasma dispersion relation. In difference to other ray tracing codes which calculate the imaginary part of wave vector bf k perp,i for wave absorption, we calculate the imaginary part of wave frequency omega i , which is shown to be equivalent with the former technique under weak damping approximation. The code can use either numerical or analytical equilibrium. Examples and benchmarks with electron cyclotron wave, lower hybrid wave and ion cyclotron wave for tokamak, spherical tokamak (ST), FRC and mirror machine are shown.


Technical Report for A Service Fair UAV NOMA System for Large scale IoT scenarios. Integrating unmanned aerial vehicles (UAVs) and non orthogonal multiple access (NOMA) technology can perform better in 5 G communication systems. To guarantee the fairness of communication services for the sensor nodes deployed in large scale scenarios, we adopt the graph theory and the smallest enclosing algorithm to design a user scheduling strategy to select the communication sensor nodes before communication processes.


On the minimal degree condition of graphs implying some properties of subgraphs. Erd H o s posed the problem of finding conditions on a graph G that imply the largest number of edges in a triangle free subgraph is equal to the largest number of edges in a bipartite subgraph. We generalize this problem to general cases. Let delta r be the least number so that any graph G on n vertices with minimum degree delta rn has the property P r 1 (G) K rf(G), where P r 1 (G) is the largest number of edges in an (r 1) partite subgraph and K rf(G) is the largest number of edges in a K r free subgraph. We show that frac 3r 4 3r 1 delta r le frac 4(3r 7)(r 1) 1 4(r 2)(3r 4) when r ge4. In particular, delta 4 le 0.9415.


Dynamic Stabilization of Water Bottles. The motion of water filled bottles is studied when it is thrown into the air and falls back to the floor, including the possibilities of an upright landing or rolling down before it finally reaches static state. When dealing with the process after throwing a water bottle, the free falling (bottle falls without initial angular velocity) and flipping (bottle falls with initial angular velocity) are considered. In theory, the physical principles behind the motion are analyzed. In addition, the impacts of initial angle, linear velocity, angular velocity and the water amount on the uprightness of the bottle are discussed. In experiment of throwing bottle, we changed the water amount, angular velocity, and releasing height, and examined the impacts of these factors. The results suggest that a certain amount of water and spinning result in higher possibility of upright landing. When dealing with rolling bottle, theoretically we build the bottle and bead model to describe the coupled motion of water and the bottle. Analytical solutions are obtained for small amplitude and the numerical solution can be done in a general situation. In the experiment of rolling bottle, we firstly verified the theoretical model, and then addressed the impact of initial conditions and water amount on the motion patterns of the bottle.


Fine Grained Data Selection for Improved Energy Efficiency of Federated Edge Learning. In Federated edge learning (FEEL), energy constrained devices at the network edge consume significant energy when training and uploading their local machine learning models, leading to a decrease in their lifetime. This work proposes novel solutions for energy efficient FEEL by jointly considering local training data, available computation, and communications resources, and deadline constraints of FEEL rounds to reduce energy consumption. This paper considers a system model where the edge server is equipped with multiple antennas employing beamforming techniques to communicate with the local users through orthogonal channels. Specifically, we consider a problem that aims to find the optimal user's resources, including the fine grained selection of relevant training samples, bandwidth, transmission power, beamforming weights, and processing speed with the goal of minimizing the total energy consumption given a deadline constraint on the communication rounds of FEEL. Then, we devise tractable solutions by first proposing a novel fine grained training algorithm that excludes less relevant training samples and effectively chooses only the samples that improve the model's performance. After that, we derive closed form solutions, followed by a Golden Section based iterative algorithm to find the optimal computation and communication resources that minimize energy consumption. Experiments using MNIST and CIFAR 10 datasets demonstrate that our proposed algorithms considerably outperform the state of the art solutions as energy consumption decreases by 79 for MNIST and 73 for CIFAR 10 datasets.


Spatiotemporal slope stability analytics for failure estimation (SSSAFE) linking radar data to the fundamental dynamics of granular failure. Impending catastrophic failure of granular earth slopes manifests distinct kinematic patterns in space and time. While risk assessments of slope failure hazards have routinely relied on the monitoring of ground motion, such precursory failure patterns remain poorly understood. A key challenge is the multiplicity of spatiotemporal scales and dynamical regimes. In particular, there exist a precursory failure regime where two mesoscale mechanisms coevolve, namely, the preferred transmission paths for force and damage. Despite extensive studies, a formulation which can address their coevolution not just in laboratory tests but also in large, uncontrolled field environments has proved elusive. Here we address this problem by developing a slope stability analytics framework which uses network flow theory and mesoscience to model this coevolution and predict emergent kinematic clusters solely from surface ground motion data. We test this framework on four data sets one at the laboratory scale using individual grain displacement data three at the field scale using line of sight displacement of a slope surface, from ground based radar in two mines and from space borne radar for the 2017 Xinmo landslide. The dynamics of the kinematic clusters deliver an early prediction of the geometry, location and time of failure.


Automated Allocation of Detention Rooms Based on Inverse Graph Partitioning. Room allocation is a challenging task in detention centers since lots of related people need to be held separately with limited rooms. It is extremely difficult and risky to allocate rooms manually, especially for organized crime groups with close connections. To tackle this problem, we develop an intelligent room allocation system for detention centers to provide optimized room allocation schemes automatically. We first formalize the detention room allocation problem as inverse graph partitioning, which can measure the quality of room allocation schemes. Then, we propose two heuristic algorithms to achieve the global optimization and local optimization of detention room allocation. Experiment results on real world datasets show that the proposed algorithms significantly outperform manual allocation and suggest that the system is of great practical application value.


The moduli stack of principal rho sheaves and Gieseker Harder Narasimhan filtrations. Given a smooth projective variety X and a connected reductive group G defined over a field of characteristic 0, we define a moduli stack of principal rho sheaves that compactifies the stack of G bundles on X. We apply the theory developed by Alper, Halpern Leistner and Heinloth to construct a moduli space of Gieseker semistable principal rho sheaves. This provides an intrinsic stack theoretic construction of the moduli space of semistable singular principal bundles as constructed by Schmitt and G 'omez Langer Schmitt Sols. Our second main result is the definition of a schematic Gieseker Harder Narasimhan filtration for rho sheaves, which induces a stratification of the stack by locally closed substacks. This filtration for a general reductive group G is a refinement of the canonical slope parabolic reductions previously considered at the level of points by Anchouche Azad Biswas and as a stratification of the stack by Gurjar Nitsure. In an appendix, we apply the same techniques to define Gieseker Harder Narasimhan filtrations in arbitrary characteristic and show that they induce a stratification of the stack by radicial morphisms.


Motion Representations for Articulated Animation. We propose novel motion representations for animating articulated objects consisting of distinct parts. In a completely unsupervised manner, our method identifies object parts, tracks them in a driving video, and infers their motions by considering their principal axes. In contrast to the previous keypoint based works, our method extracts meaningful and consistent regions, describing locations, shape, and pose. The regions correspond to semantically relevant and distinct object parts, that are more easily detected in frames of the driving video. To force decoupling of foreground from background, we model non object related global motion with an additional affine transformation. To facilitate animation and prevent the leakage of the shape of the driving object, we disentangle shape and pose of objects in the region space. Our model can animate a variety of objects, surpassing previous methods by a large margin on existing benchmarks. We present a challenging new benchmark with high resolution videos and show that the improvement is particularly pronounced when articulated objects are considered, reaching 96.6 user preference vs. the state of the art.


Computing the egalitarian allocation with network flows. In a combinatorial exchange setting, players place sell (resp. buy) bids on combinations of traded goods. Besides the question of finding an optimal selection of winning bids, the question of how to share the obtained profit is of high importance. The egalitarian allocation is a well known solution concept of profit sharing games which tries to distribute profit among players in a most equal way while respecting individual contributions to the obtained profit. Given a set of winning bids, we construct a special network graph and show that every flow in said graph corresponds to a core payment. Furthermore, we show that the egalitarian allocation can be characterized as an almost equal maximum flow which is a maximum flow with the additional property that the difference of flow value on given edge sets is bounded by a constant. With this, we are able to compute the egalitarian allocation in polynomial time.


Differentially Private Sparse Vectors with Low Error, Optimal Space, and Fast Access. Representing a sparse histogram, or more generally a sparse vector, is a fundamental task in differential privacy. An ideal solution would use space close to information theoretical lower bounds, have an error distribution that depends optimally on the desired privacy level, and allow fast random access to entries in the vector. However, existing approaches have only achieved two of these three goals. In this paper we introduce the Approximate Laplace Projection (ALP) mechanism for approximating k sparse vectors. This mechanism is shown to simultaneously have information theoretically optimal space (up to constant factors), fast access to vector entries, and error of the same magnitude as the Laplace mechanism applied to dense vectors. A key new technique is a unary representation of small integers, which we show to be robust against randomized response'' noise. This representation is combined with hashing, in the spirit of Bloom filters, to obtain a space efficient, differentially private representation. Our theoretical performance bounds are complemented by simulations which show that the constant factors on the main performance parameters are quite small, suggesting practicality of the technique.


Analysis of the Evolution of Parametric Drivers of High End Sea Level Hazards. Climate models are critical tools for developing strategies to manage the risks posed by sea level rise to coastal communities. While these models are necessary for understanding climate risks, there is a level of uncertainty inherent in each parameter in the models. This model parametric uncertainty leads to uncertainty in future climate risks. Consequently, there is a need to understand how those parameter uncertainties impact our assessment of future climate risks and the efficacy of strategies to manage them. Here, we use random forests to examine the parametric drivers of future climate risk and how the relative importances of those drivers change over time. We find that the equilibrium climate sensitivity and a factor that scales the effect of aerosols on radiative forcing are consistently the most important climate model parametric uncertainties throughout the 2020 to 2150 interval for both low and high radiative forcing scenarios. The near term hazards of high end sea level rise are driven primarily by thermal expansion, while the longer term hazards are associated with mass loss from the Antarctic and Greenland ice sheets. Our results highlight the practical importance of considering time evolving parametric uncertainties when developing strategies to manage future climate risks.


Tracial oscillation zero and Z stability. Let A be a (not necessarily unital) separable non elementary simple amenable C algebra whose tracial basis may not have finite covering dimension and may not be compact but satisfies certain condition (C). We show that A is cal Z stable if and only if A has strict comparison for positive elements. Extremal boundaries of simplexes which satisfy condition (C) may contain countable disjoint unions of n dimensional cubes ( n in N ) as a subset.


When Face Recognition Meets Occlusion A New Benchmark. The existing face recognition datasets usually lack occlusion samples, which hinders the development of face recognition. Especially during the COVID 19 coronavirus epidemic, wearing a mask has become an effective means of preventing the virus spread. Traditional CNN based face recognition models trained on existing datasets are almost ineffective for heavy occlusion. To this end, we pioneer a simulated occlusion face recognition dataset. In particular, we first collect a variety of glasses and masks as occlusion, and randomly combine the occlusion attributes (occlusion objects, textures,and colors) to achieve a large number of more realistic occlusion types. We then cover them in the proper position of the face image with the normal occlusion habit. Furthermore, we reasonably combine original normal face images and occluded face images to form our final dataset, termed as Webface OCC. It covers 804,704 face images of 10,575 subjects, with diverse occlusion types to ensure its diversity and stability. Extensive experiments on public datasets show that the ArcFace retrained by our dataset significantly outperforms the state of the arts. Webface OCC is available at https github.com Baojin Huang Webface OCC.


HMS OS Improving the Human Mental Search Optimisation Algorithm by Grouping in both Search and Objective Space. The human mental search (HMS) algorithm is a relatively recent population based metaheuristic algorithm, which has shown competitive performance in solving complex optimisation problems. It is based on three main operators mental search, grouping, and movement. In the original HMS algorithm, a clustering algorithm is used to group the current population in order to identify a promising region in search space, while candidate solutions then move towards the best candidate solution in the promising region. In this paper, we propose a novel HMS algorithm, HMS OS, which is based on clustering in both objective and search space, where clustering in objective space finds a set of best candidate solutions whose centroid is then also used in updating the population. For further improvement, HMSOS benefits from an adaptive selection of the number of mental processes in the mental search operator. Experimental results on CEC 2017 benchmark functions with dimensionalities of 50 and 100, and in comparison to other optimisation algorithms, indicate that HMS OS yields excellent performance, superior to those of other methods.


Intrinsic Pulsed Magnetic Gradiometer in Earth's Field. We describe a novel pulsed magnetic gradiometer based on the optical interference of sidebands generated using two spatially separated alkali vapor cells. The sidebands are produced with high efficiency using parametric frequency conversion of a probe beam interacting with 87 Rb atoms in a coherent superposition of magnetically sensitive hyperfine ground states. Interference between the sidebands generates a low frequency beat note whose frequency is determined by the magnetic field gradient between the two vapor cells. In contrast to traditional magnetic gradiometers, our approach provides a direct readout of the gradient field without the intermediate step of subtracting the outputs of two spacially separated magnetometers. The technique is expected to provide effective common mode magnetic field cancellation at frequencies far greater than the bandwidth of the gradiometer. Using this technique, we developed a compact magnetic gradiometer sensor head with integrated optics with a sensitivity of 25 fT cm sqrt Hz with a 4.4 cm baseline, while operating in a noisy laboratory environment unshielded from Earth's field. We also outline a theoretical framework that accurately models sideband generation using a density matrix formalism.


A Privacy Preserving Approach to Extraction of Personal Information through Automatic Annotation and Federated Learning. We curated WikiPII, an automatically labeled dataset composed of Wikipedia biography pages, annotated for personal information extraction. Although automatic annotation can lead to a high degree of label noise, it is an inexpensive process and can generate large volumes of annotated documents. We trained a BERT based NER model with WikiPII and showed that with an adequately large training dataset, the model can significantly decrease the cost of manual information extraction, despite the high level of label noise. In a similar approach, organizations can leverage text mining techniques to create customized annotated datasets from their historical data without sharing the raw data for human annotation. Also, we explore collaborative training of NER models through federated learning when the annotation is noisy. Our results suggest that depending on the level of trust to the ML operator and the volume of the available data, distributed training can be an effective way of training a personal information identifier in a privacy preserved manner. Research material is available at https github.com ratmcu wikipiifed.


Learning to Time Decode in Spiking Neural Networks Through the Information Bottleneck. One of the key challenges in training Spiking Neural Networks (SNNs) is that target outputs typically come in the form of natural signals, such as labels for classification or images for generative models, and need to be encoded into spikes. This is done by handcrafting target spiking signals, which in turn implicitly fixes the mechanisms used to decode spikes into natural signals, e.g., rate decoding. The arbitrary choice of target signals and decoding rule generally impairs the capacity of the SNN to encode and process information in the timing of spikes. To address this problem, this work introduces a hybrid variational autoencoder architecture, consisting of an encoding SNN and a decoding Artificial Neural Network (ANN). The role of the decoding ANN is to learn how to best convert the spiking signals output by the SNN into the target natural signal. A novel end to end learning rule is introduced that optimizes a directed information bottleneck training criterion via surrogate gradients. We demonstrate the applicability of the technique in an experimental settings on various tasks, including real life datasets.


Isometry groups of three dimensional Lie groups. We compute the full isometry group of any left invariant metric on a simply connected, non unimodular Lie group of dimension three. As an application, we determine the index of symmetry of such metrics and prove that the singularities of the moduli space of left invariant metrics, up to isometric automorphism, is contained in the subspace of classes of metrics with maximal index of symmetry.


Self Paced Uncertainty Estimation for One shot Person Re Identification. The one shot Person Re ID scenario faces two kinds of uncertainties when constructing the prediction model from X to Y . The first is model uncertainty, which captures the noise of the parameters in DNNs due to a lack of training data. The second is data uncertainty, which can be divided into two sub types one is image noise, where severe occlusion and the complex background contain irrelevant information about the identity the other is label noise, where mislabeled affects visual appearance learning. In this paper, to tackle these issues, we propose a novel Self Paced Uncertainty Estimation Network (SPUE Net) for one shot Person Re ID. By introducing a self paced sampling strategy, our method can estimate the pseudo labels of unlabeled samples iteratively to expand the labeled samples gradually and remove model uncertainty without extra supervision. We divide the pseudo label samples into two subsets to make the use of training samples more reasonable and effective. In addition, we apply a Co operative learning method of local uncertainty estimation combined with determinacy estimation to achieve better hidden space feature mining and to improve the precision of selected pseudo labeled samples, which reduces data uncertainty. Extensive comparative evaluation experiments on video based and image based datasets show that SPUE Net has significant advantages over the state of the art methods.


Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets. Despite the success of recent Neural Architecture Search (NAS) methods on various tasks which have shown to output networks that largely outperform human designed networks, conventional NAS methods have mostly tackled the optimization of searching for the network architecture for a single task (dataset), which does not generalize well across multiple tasks (datasets). Moreover, since such task specific methods search for a neural architecture from scratch for every given task, they incur a large computational cost, which is problematic when the time and monetary budget are limited. In this paper, we propose an efficient NAS framework that is trained once on a database consisting of datasets and pretrained networks and can rapidly search for a neural architecture for a novel dataset. The proposed MetaD2A (Meta Dataset to Architecture) model can stochastically generate graphs (architectures) from a given set (dataset) via a cross modal latent space learned with amortized meta learning. Moreover, we also propose a meta performance predictor to estimate and select the best architecture without direct training on target datasets. The experimental results demonstrate that our model meta learned on subsets of ImageNet 1K and architectures from NAS Bench 201 search space successfully generalizes to multiple unseen datasets including CIFAR 10 and CIFAR 100, with an average search time of 33 GPU seconds. Even under MobileNetV3 search space, MetaD2A is 5.5K times faster than NSGANetV2, a transferable NAS method, with comparable performance. We believe that the MetaD2A proposes a new research direction for rapid NAS as well as ways to utilize the knowledge from rich databases of datasets and architectures accumulated over the past years. Code is available at https github.com HayeonLee MetaD2A.


COMBO a new module for EUD parsing. We introduce the COMBO based approach for EUD parsing and its implementation, which took part in the IWPT 2021 EUD shared task. The goal of this task is to parse raw texts in 17 languages into Enhanced Universal Dependencies (EUD). The proposed approach uses COMBO to predict UD trees and EUD graphs. These structures are then merged into the final EUD graphs. Some EUD edge labels are extended with case information using a single language independent expansion rule. In the official evaluation, the solution ranked fourth, achieving an average ELAS of 83.79 . The source code is available at https gitlab.clarin pl.eu syntactic tools combo.


Automatically generating models of IT systems. Information technology system (ITS), informally, consists of hardware and software infrastructure (e.g., workstations, servers, laptops, installed software packages, databases, LANs, firewalls, etc.), along with physical and logical connections and inter dependencies between various items. Nowadays, every company owns and operates an ITS, but detailed information about the system is rarely publicly available. However, there are many situations where the availability of such data would be beneficial. For example, cyber ranges need descriptions of complex realistic IT systems in order to provide an effective training and education platform. Furthermore, various algorithms in cybersecurity, in particular attack tree generation, need to be validated on realistic models of IT systems. In this paper, we describe a system we call the Generator that, based on the high level requirements such as the number of employees and the business area the target company belongs to, generates a model of an ITS that satisfies the given requirements. We put special emphasis on the following two criteria the generated ITS models a large amount of details, and ideally resembles a real system. Our survey of related literature found no sufficiently similar prior works, so we believe that this is the first attempt of building something like this. We created a proof of concept implementation of the Generator, validated it by generating ITS models for a simplified fictional financial institution, and analyzed the Generators performance with respect to the problem size. The research was done in an iterative manner, with coauthors continuously providing feedback on intermediate results. (...) We intend to extend this prototype to allow probabilistic generation of IT systems when only a subset of parameters is explicitly defined, and further develop and validate our approach with the help of domain experts.


Bandwidth based Step Sizes for Non Convex Stochastic Optimization. Many popular learning rate schedules for deep neural networks combine a decaying trend with local perturbations that attempt to escape saddle points and bad local minima. We derive convergence guarantees for bandwidth based step sizes, a general class of learning rates that are allowed to vary in a banded region. This framework includes many popular cyclic and non monotonic step sizes for which no theoretical guarantees were previously known. We provide worst case guarantees for SGD on smooth non convex problems under several bandwidth based step sizes, including stagewise 1 sqrt t and the popular step decay (constant and then drop by a constant), which is also shown to be optimal. Moreover, we show that its momentum variant converges as fast as SGD with the bandwidth based step decay step size. Finally, we propose novel step size schemes in the bandwidth based family and verify their efficiency on several deep neural network training tasks.


Instability and disintegration of vortex rings during head on collisions and wall interactions. The head on collision of two vortex rings can produce diverse phenomena a tiara of secondary rings, vortex sheets which flatten and interact iteratively, or the violent disintegration of the rings into a turbulent cloud. The outcome of the interaction is determined by the nature of the instability affecting two impinging vortex rings. Here, we carry out a systematic study to determine the dominant instability as a function of the parameters of the problem. To this end, we numerically simulate the head on collision of vortex rings with circulation Reynolds numbers between 1000 and 3500 and varying slenderness ratios Lambda a R ranging from Lambda 0.1 to 0.35 , with a the core radius and R the ring radius. By studying the temporal evolution of the energy and viscous dissipation, we elucidate the role azimuthal instabilities play in determining what the outcomes of the collision are. We then compare these collisions to the head on impact of a vortex ring on a free slip and a no slip wall. The free slip wall imposes a mirror symmetry, which impedes certain instabilities and at sufficiently large Reynolds numbers leads to the formation of a half tiara of vortices. Impact against a no slip wall results in the process where a secondary vortex ring is formed after the ejection of the resulting boundary layer. When the Reynolds number is above a certain threshold, which increases with Lambda , the vortices disintegrate through azimuthal instabilities, resulting in a turbulent cloud.


InfinityGAN Towards Infinite Pixel Image Synthesis. We present a novel framework, InfinityGAN, for arbitrary sized image generation. The task is associated with several key challenges. First, scaling existing models to an arbitrarily large image size is resource constrained, in terms of both computation and availability of large field of view training data. InfinityGAN trains and infers in a seamless patch by patch manner with low computational resources. Second, large images should be locally and globally consistent, avoid repetitive patterns, and look realistic. To address these, InfinityGAN disentangles global appearances, local structures, and textures. With this formulation, we can generate images with spatial size and level of details not attainable before. Experimental evaluation validates that InfinityGAN generates images with superior realism compared to baselines and features parallelizable inference. Finally, we show several applications unlocked by our approach, such as spatial style fusion, multi modal outpainting, and image inbetweening. All applications can be operated with arbitrary input and output sizes. Please find the full version of the paper at https openreview.net forum?id ufGMqIM0a4b .


Length Scale Control in Topology Optimization using Fourier Enhanced Neural Networks. Length scale control is imposed in topology optimization (TO) to make designs amenable to manufacturing and other functional requirements. Broadly, there are two types of length scale control in TO emph exact and emph approximate . While the former is desirable, its implementation can be difficult, and is computationally expensive. Approximate length scale control is therefore preferred, and is often sufficient for early stages of design. In this paper we propose an approximate length scale control strategy for TO, by extending a recently proposed density based TO formulation using neural networks (TOuNN). Specifically, we enhance TOuNN with a Fourier space projection, to control the minimum and or maximum length scales. The proposed method does not involve additional constraints, and the sensitivity computations are automated by expressing the computations in an end end differentiable fashion using the neural net's library. The proposed method is illustrated through several numerical experiments for single and multi material designs.


Community detection by resistance distance automation and benchmark testing. Heterogeneity characterises real world networks, where nodes show a broad range of different topological features. However, nodes also tend to organise into communities subsets of nodes that are sparsely inter connected but are densely intra connected (more than the network's average connectivity). This means that nodes belonging to the same community are close to each other by some distance measure, such as the resistance distance, which is the effective distance between any pair of nodes considering all possible paths. In this work, we present automation (i.e., unsupervised) and missing accuracy tests for a recently proposed semi supervised community detection algorithm based on the resistance distance. The accuracy testing involves quantifying our algorithm's performance in terms of recovering known synthetic communities from benchmark networks, where we present results for Girvan Newman and Lancichinetti Fortunato Radicchi networks. Our findings show that our algorithm falls into the class of accurate performers.


Toward Minimal Misalignment at Minimal Cost in One Stage and Anchor Free Object Detection. Common object detection models consist of classification and regression branches, due to different task drivers, these two branches have different sensibility to the features from the same scale level and the same spatial location. The point based prediction method, which is based on the assumption that the high classification confidence point has the high regression quality, leads to the misalignment problem. Our analysis shows, the problem is further composed of scale misalignment and spatial misalignment specifically. We aim to resolve the phenomenon at minimal cost a minor adjustment of the head network and a new label assignment method replacing the rigid one. Our experiments show that, compared to the baseline FCOS, a one stage and anchor free object detection model, our model consistently get around 3 AP improvement with different backbones, demonstrating both simplicity and efficiency of our method.


Sample Efficient Generation of Novel Photo acid Generator Molecules using a Deep Generative Model. Photo acid generators (PAGs) are compounds that release acids ( H ions) when exposed to light. These compounds are critical components of the photolithography processes that are used in the manufacture of semiconductor logic and memory chips. The exponential increase in the demand for semiconductors has highlighted the need for discovering novel photo acid generators. While de novo molecule design using deep generative models has been widely employed for drug discovery and material design, its application to the creation of novel photo acid generators poses several unique challenges, such as lack of property labels. In this paper, we highlight these challenges and propose a generative modeling approach that utilizes conditional generation from a pre trained deep autoencoder and expert in the loop techniques. The validity of the proposed approach was evaluated with the help of subject matter experts, indicating the promise of such an approach for applications beyond the creation of novel photo acid generators.


Science Mapping to study academic knowledge circulation. The application of mathematics and statistical methods to scholarly communication scientometrics, has facilitated the systematic analysis of the modern digital tide of literature. This chapter reviews three of such applications coauthorship, bibliographic coupling, and coword networks. It also presents an exploratory case of study for the knowledge circulation literature. It was found a diverse geographical production, mainly in the Global North and Asian institutions with significant intermediation of universities from USA, Colombia, and Japan. The research fronts identified were related to science and medicine's history and philosophy education, health, policy studies and a set of interdisciplinary topics. Finally, the knowledge pillars were comprised of urban planning policy, economic geography, and historical and theoretical perspectives in the Netherlands and Central Europe globalization and science, technology, and innovation and historical and institutional frameworks in the UK and cultural and learning studies in the XXI century.


The Integrated Probabilistic Data Association Filter Adapted to Lie Groups. The Integrated Probabilistic Data Association Filter (IPDAF) is a target tracking algorithm based on the Probabilistic Data Association Filter that calculates a statistical measure that indicates if an estimated representation of the target properly represents the target or is generated from non target originated measurements. The main contribution of this paper is to adapt the IPDAF to target models that evolve on connected, unimodular Lie groups, and where the measurements are also defined on a Lie group. We present a detailed example where the methods developed in the paper are applied to the problem of tracking a ground vehicle on the special Euclidean group SE(2).


On polynomial grammars extended with substitution. We investigate decidability of equivalence of register transducers, also called copyful Streaming String Transducers in case of string input, extended with an operation of substituting a register for all occurrences of a given letter in another register. We reduce to zeroness of polynomial grammars (over ring of polynomials) extended with analogous substitution operation by encoding strings into polynomials a similar method was used successfully by Seidl et al. in 2018. We give two restrictions under which register transducers with substitution have decidable equivalence. They seem to be very restrictive but on the other hand, they seem to be on the edge of the scope of this "polynomial" method, as in the third result we give a rather restricted model of polynomial grammars with substitution that has undecidable equivalence.


On the convergence of Broyden's method and some accelerated schemes for singular problems. We consider Broyden's method and some accelerated schemes for nonlinear equations having a strongly regular singularity of first order with a one dimensional nullspace. Our two main results are as follows. First, we show that the use of a preceding Newton like step ensures convergence for starting points in a starlike domain with density 1. This extends the domain of convergence of these methods significantly. Second, we establish that the matrix updates of Broyden's method converge q linearly with the same asymptotic factor as the iterates. This contributes to the long standing question whether the Broyden matrices converge by showing that this is indeed the case for the setting at hand. Furthermore, we prove that the Broyden directions violate uniform linear independence, which implies that existing results for convergence of the Broyden matrices cannot be applied. Numerical experiments of high precision confirm the enlarged domain of convergence, the q linear convergence of the matrix updates, and the lack of uniform linear independence. In addition, they suggest that these results can be extended to singularities of higher order and that Broyden's method can converge r linearly without converging q linearly. The underlying code is freely available.