Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization. In order to solve the minimization of a nonsmooth convex function, we design an inertial second order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic behavior of the dynamic algorithm, we prove that each trajectory of it weakly converges to an optimal solution under some appropriate conditions on the smoothing parameters, and the convergence rate of the objective function values is o(t 2). We also show that the algorithm is stable, that is, this dynamic algorithm with a perturbation term owns the same convergence properties when the perturbation term satisfies certain conditions. Finally, we verify the theoretical results by some numerical experiments.


Knowledge Aware Graph Enhanced GPT 2 for Dialogue State Tracking. Dialogue State Tracking is central to multi domain task oriented dialogue systems, responsible for extracting information from user utterances. We present a novel hybrid architecture that augments GPT 2 with representations derived from Graph Attention Networks in such a way to allow causal, sequential prediction of slot values. The model architecture captures inter slot relationships and dependencies across domains that otherwise can be lost in sequential prediction. We report improvements in state tracking performance in MultiWOZ 2.0 against a strong GPT 2 baseline and investigate a simplified sparse training scenario in which DST models are trained only on session level annotations but evaluated at the turn level. We further report detailed analyses to demonstrate the effectiveness of graph models in DST by showing that the proposed graph modules capture inter slot dependencies and improve the predictions of values that are common to multiple domains.


Task oriented Dialogue Systems performance vs. quality optima, a review. Task oriented dialogue systems (TODS) are continuing to rise in popularity as various industries find ways to effectively harness their capabilities, saving both time and money. However, even state of the art TODS are not yet reaching their full potential. TODS typically have a primary design focus on completing the task at hand, so the metric of task resolution should take priority. Other conversational quality attributes that may point to the success, or otherwise, of the dialogue, may be ignored. This can cause interactions between human and dialogue system that leave the user dissatisfied or frustrated. This paper explores the literature on evaluative frameworks of dialogue systems and the role of conversational quality attributes in dialogue systems, looking at if, how, and where they are utilised, and examining their correlation with the performance of the dialogue system.


On the Brauer groups of fibrations II. Let K be a number field and mathcal X be a regular proper flat scheme over mathcal O K with a generic fiber X geometrically connected over K . We proved that there is an exact sequence up to finite groups 0 rightarrow Sha(Pic X K 0) rightarrow Br( mathcal X ) rightarrow Br(X bar K ) G K rightarrow 0 , generalizing a theorem of Artin and Grothendieck for arithmetic surfaces to arbitrary dimensions. As a result, we reduce Artin's question about the finiteness of Br( mathcal X ) for regular proper flat schemes mathcal X over mathbb Z to 3 dimensional arithmetic schemes.


Strategically Efficient Exploration in Competitive Multi agent Reinforcement Learning. High sample complexity remains a barrier to the application of reinforcement learning (RL), particularly in multi agent systems. A large body of work has demonstrated that exploration mechanisms based on the principle of optimism under uncertainty can significantly improve the sample efficiency of RL in single agent tasks. This work seeks to understand the role of optimistic exploration in non cooperative multi agent settings. We will show that, in zero sum games, optimistic exploration can cause the learner to waste time sampling parts of the state space that are irrelevant to strategic play, as they can only be reached through cooperation between both players. To address this issue, we introduce a formal notion of strategically efficient exploration in Markov games, and use this to develop two strategically efficient learning algorithms for finite Markov games. We demonstrate that these methods can be significantly more sample efficient than their optimistic counterparts.


Learning Parallel Dense Correspondence from Spatio Temporal Descriptors for Efficient and Robust 4D Reconstruction. This paper focuses on the task of 4D shape reconstruction from a sequence of point clouds. Despite the recent success achieved by extending deep implicit representations into 4D space, it is still a great challenge in two respects, i.e. how to design a flexible framework for learning robust spatio temporal shape representations from 4D point clouds, and develop an efficient mechanism for capturing shape dynamics. In this work, we present a novel pipeline to learn a temporal evolution of the 3D human shape through spatially continuous transformation functions among cross frame occupancy fields. The key idea is to parallelly establish the dense correspondence between predicted occupancy fields at different time steps via explicitly learning continuous displacement vector fields from robust spatio temporal shape representations. Extensive comparisons against previous state of the arts show the superior accuracy of our approach for 4D human reconstruction in the problems of 4D shape auto encoding and completion, and a much faster network inference with about 8 times speedup demonstrates the significant efficiency of our approach. The trained models and implementation code are available at https github.com tangjiapeng LPDC Net.


Local conditional regularity for the Landau equation with Coulomb potential. This paper studies the regularity of Villani solutions of the space homogeneous Landau equation with Coulomb interaction in dimension 3. Specifically, we prove that any such solution belonging to the Lebesgue space L t infty L v q with q 3 in an open cylinder (0,S) times B, where B is an open ball of mathbb R 3 , must have Holder continuous second order derivatives in the velocity variables, and first order derivative in the time variable locally in any compact subset of that cylinder.


Quality change norm or exception? Measurement, Analysis and Detection of Quality Change in Wikipedia. Wikipedia has been turned into an immensely popular crowd sourced encyclopedia for information dissemination on numerous versatile topics in the form of subscription free content. It allows anyone to contribute so that the articles remain comprehensive and updated. For enrichment of content without compromising standards, the Wikipedia community enumerates a detailed set of guidelines, which should be followed. Based on these, articles are categorized into several quality classes by the Wikipedia editors with increasing adherence to guidelines. This quality assessment task by editors is laborious as well as demands platform expertise. As a first objective, in this paper, we study evolution of a Wikipedia article with respect to such quality scales. Our results show novel non intuitive patterns emerging from this exploration. As a second objective we attempt to develop an automated data driven approach for the detection of the early signals influencing the quality change of articles. We posit this as a change point detection problem whereby we represent an article as a time series of consecutive revisions and encode every revision by a set of intuitive features. Finally, various change point detection algorithms are used to efficiently and accurately detect the future change points. We also perform various ablation studies to understand which group of features are most effective in identifying the change points. To the best of our knowledge, this is the first work that rigorously explores English Wikipedia article quality life cycle from the perspective of quality indicators and provides a novel unsupervised page level approach to detect quality switch, which can help in automatic content monitoring in Wikipedia thus contributing significantly to the CSCW community.


de Finetti Style Theorems With Applications to Network Analysis. A classic and fundamental result about the decomposition of random sequences into a mixture of simpler ones is de Finetti's Theorem. In its original form it applies to infinite 0 1 valued exchangeable sequences. Later it was extended and generalized in numerous directions. After reviewing this line of development, we present our new decomposition theorem, covering cases that have not been previously considered. We also introduce a novel way of applying these types of results in the analysis of random networks. For self containment, we provide the introductory exposition in more details than usual, with the intent of making it also accessible to readers who may not be closely familiar with the subject.


Hydrophobic interaction determines docking affinity of SARS CoV 2 variants with antibodies. Preliminary epidemiologic, phylogenetic and clinical findings suggest that several novel severe acute respiratory syndrome coronavirus 2 (SARS CoV 2) variants have increased transmissibility and decreased efficacy of several existing vaccines. Four mutations in the receptor binding domain (RBD) of the spike protein that are reported to contribute to increased transmission. Understanding physical mechanism responsible for the affinity enhancement between the SARS CoV 2 variants and ACE2 is the "urgent challenge" for developing blockers, vaccines and therapeutic antibodies against the coronavirus disease 2019 (COVID 19) pandemic. Based on a hydrophobic interaction based protein docking mechanism, this study reveals that the mutation N501Y obviously increased the hydrophobic attraction and decrease hydrophilic repulsion between the RBD and ACE2 that most likely caused the transmissibility increment of the variants. By analyzing the mutation induced hydrophobic surface changes in the attraction and repulsion at the binding site of the complexes of the SARS CoV 2 variants and antibodies, we found out that all the mutations of N501Y, E484K, K417N and L452R can selectively decrease or increase their binding affinity with some antibodies.


Processing of optical signals by "surgical" methods for the Gelfand Levitan Marchenko equation. We propose a new method for solving the Gelfand Levitan Marchenko equation (GLME) based on the block version of the Toeplitz Inner Bordering (TIB) with an arbitrary point to start the calculation. This makes it possible to find solutions of the GLME at an arbitrary point with a cutoff of the matrix coefficient, which allows to avoid the occurrence of numerical instability and to perform calculations for soliton solutions spaced apart in the time domain. Using an example of two solitons, we demonstrate our method and its range of applicability. An example of eight solitons shows how the method can be applied to a more complex signal configuration.


Randomized Classifiers vs Human Decision Makers Trustworthy AI May Have to Act Randomly and Society Seems to Accept This. As emph artificial intelligence (AI) systems are increasingly involved in decisions affecting our lives, ensuring that automated decision making is fair and ethical has become a top priority. Intuitively, we feel that akin to human decisions, judgments of artificial agents should necessarily be grounded in some moral principles. Yet a decision maker (whether human or artificial) can only make truly ethical (based on any ethical theory) and fair (according to any notion of fairness) decisions if full information on all the relevant factors on which the decision is based are available at the time of decision making. This raises two problems (1) In settings, where we rely on AI systems that are using classifiers obtained with supervised learning, some induction generalization is present and some relevant attributes may not be present even during learning. (2) Modeling such decisions as games reveals that any however ethical pure strategy is inevitably susceptible to exploitation. Moreover, in many games, a Nash Equilibrium can only be obtained by using mixed strategies, i.e., to achieve mathematically optimal outcomes, decisions must be randomized. In this paper, we argue that in supervised learning settings, there exist random classifiers that perform at least as well as deterministic classifiers, and may hence be the optimal choice in many circumstances. We support our theoretical results with an empirical study indicating a positive societal attitude towards randomized artificial decision makers, and discuss some policy and implementation issues related to the use of random classifiers that relate to and are relevant for current AI policy and standardization initiatives.


Contextualizing Multiple Tasks via Learning to Decompose. One single instance could possess multiple portraits and reveal diverse relationships with others according to different contexts. Those ambiguities increase the difficulty of learning a generalizable model when there exists one concept or mixed concepts in a task. We propose a general approach Learning to Decompose Network (LeadNet) for both two cases, which contextualizes a model through meta learning multiple maps for concepts discovery the representations of instances are decomposed and adapted conditioned on the contexts. Through taking a holistic view over multiple latent components over instances in a sampled pseudo task, LeadNet learns to automatically select the right concept via incorporating those rich semantics inside and between objects. LeadNet demonstrates its superiority in various applications, including exploring multiple views of confusing tasks, out of distribution recognition, and few shot image classification.


UniFuse Unidirectional Fusion for 360 circ Panorama Depth Estimation. Learning depth from spherical panoramas is becoming a popular research topic because a panorama has a full field of view of the environment and provides a relatively complete description of a scene. However, applying well studied CNNs for perspective images to the standard representation of spherical panoramas, i.e., the equirectangular projection, is suboptimal, as it becomes distorted towards the poles. Another representation is the cubemap projection, which is distortion free but discontinued on edges and limited in the field of view. This paper introduces a new framework to fuse features from the two projections, unidirectionally feeding the cubemap features to the equirectangular features only at the decoding stage. Unlike the recent bidirectional fusion approach operating at both the encoding and decoding stages, our fusion scheme is much more efficient. Besides, we also designed a more effective fusion module for our fusion scheme. Experiments verify the effectiveness of our proposed fusion strategy and module, and our model achieves state of the art performance on four popular datasets. Additional experiments show that our model also has the advantages of model complexity and generalization capability.The code is available at https github.com alibaba UniFuse Unidirectional Fusion.


Numerical Investigation of Supersonic Turbulent Flow Over Open Cavities. The study of cavity flow is one of the most important research topics of unsteady aerodynamics. Supersonic turbulent flows over a cavity are mostly encountered in missiles, turbomachinery, and high speed aircraft. The turbulence inside the cavity gives rise to excess drag, acoustic waves, pressure fluctuations, and vibrations which may lead to numerous problems like excess fuel consumption, failure of missile trajectory or mechanical parts, and aerodynamic heating. We conduct numerical simulations to investigate the flow and compare our results to existing experimental data to show quantitative validation. We then investigate the effect of the Mach number of the turbulent supersonic flow on the pressure contours and the vortical structures inside the cavity and the subsequent effect on other flow parameters like acoustic waves. Thereafter, we propose two modifications of the cavity geometry, a) slanted edges and b) smoothened corners with slanted edges, to improve the aerodynamic performance. ANSYS ICEM tool has been used for the fine mesh generation of our cavity geometry and all the simulation was run on ANSYS fluent software. The K omega SST turbulence model was used for the simulation as it can capture the near wall property with reasonable accuracy and a grid independence study was carried out to find the correct solution of the Navier Stokes equation was proceeding by the solver. The parameters like pressure contours, streamline pattern, coefficient of pressure distribution and sound pressure level (SPL) has been found and compared for both modified and unmodified open cavity at different Mach number. The modifications suggested show a significant improvement over the open cavity designs in the mean pressure distribution and sound pressure level distributions.


Some Results of Experimental Check of The Model of the Object Innovativeness Quantitative Evaluation. The paper presents the results of the experiments that were conducted to confirm the main ideas of the proposed approach to determining the objects innovativeness. This approach assumed that the product life cycle of whose descriptions are placed in different data warehouses is adequate. The proposed formal model allows us to calculate the quantitative value of the additive evaluation criterion of objects innovativeness. The obtained experimental data make it possible to evaluate the adopted approach correctness.


Callable convertible bonds under liquidity constraints. This paper provides a complete solution to the callable convertible bond studied in Liang and Sun, Dynkin games with Poisson random intervention times, SIAM Journal on Control and Optimization, 57(4), 2962 2991, 2019 , and corrects an error in Proposition 6.2 of that paper. The callable convertible bond is an example of a Dynkin game, but falls outside the standard paradigm since the payoffs do not depend in an ordered way upon which agent stops the game. We show how to deal with this non ordered situation by introducing a new technique which may of interest in its own right, and then apply it to the bond problem.


Disentangled Representations from Non Disentangled Models. Constructing disentangled representations is known to be a difficult task, especially in the unsupervised scenario. The dominating paradigm of unsupervised disentanglement is currently to train a generative model that separates different factors of variation in its latent space. This separation is typically enforced by training with specific regularization terms in the model's objective function. These terms, however, introduce additional hyperparameters responsible for the trade off between disentanglement and generation quality. While tuning these hyperparameters is crucial for proper disentanglement, it is often unclear how to tune them without external supervision. This paper investigates an alternative route to disentangled representations. Namely, we propose to extract such representations from the state of the art generative models trained without disentangling terms in their objectives. This paradigm of post hoc disentanglement employs little or no hyperparameters when learning representations while achieving results on par with existing state of the art, as shown by comparison in terms of established disentanglement metrics, fairness, and the abstract reasoning task. All our code and models are publicly available.


Claim Detection in Biomedical Twitter Posts. Social media contains unfiltered and unique information, which is potentially of great value, but, in the case of misinformation, can also do great harm. With regards to biomedical topics, false information can be particularly dangerous. Methods of automatic fact checking and fake news detection address this problem, but have not been applied to the biomedical domain in social media yet. We aim to fill this research gap and annotate a corpus of 1200 tweets for implicit and explicit biomedical claims (the latter also with span annotations for the claim phrase). With this corpus, which we sample to be related to COVID 19, measles, cystic fibrosis, and depression, we develop baseline models which detect tweets that contain a claim automatically. Our analyses reveal that biomedical tweets are densely populated with claims (45 in a corpus sampled to contain 1200 tweets focused on the domains mentioned above). Baseline classification experiments with embedding based classifiers and BERT based transfer learning demonstrate that the detection is challenging, however, shows acceptable performance for the identification of explicit expressions of claims. Implicit claim tweets are more challenging to detect.


An eXtended Finite Element Method Implementation in COMSOL Multiphysics Thermo Hydro Mechanical Modeling of Fluid Flow in Discontinuous Porous Media. This paper presents the implementation of the eXtended Finite Element Method (XFEM) in the general purpose commercial software package COMSOL Multiphysics for multi field thermo hydro mechanical problems in discontinuous porous media. To this end, an exclusive enrichment strategy is proposed in compliance with the COMSOL modeling structure. COMSOL modules and physics interfaces are adopted to take account of the relevant physical processes involved in thermo hydro mechanical coupling analysis, namely the mechanical deformation, fluid flow in porous media and heat transfer. Essential changes are made to the internal variables of the physics interfaces to ensure consistency in the evaluation of enriched solution fields. The model preprocessing, level set updates, coupling of the relevant physics and postprocessing procedures are performed adopting a coherent utilization of the COMSOL built in features along with the COMSOL LiveLink for MATLAB functions. The implementation process, remedies for the treatment of the enriched zones, XFEM framework setup, multiphysics coupling, numerical integration and numerical solution strategy are described in detail. The capabilities and performance of the proposed approach are investigated by examining several multi field thermo hydro mechanical simulations involving single multiple discontinuities in 2D 3D porous rock settings.


PIT Position Invariant Transform for Cross FoV Domain Adaptation. Cross domain object detection and semantic segmentation have witnessed impressive progress recently. Existing approaches mainly consider the domain shift resulting from external environments including the changes of background, illumination or weather, while distinct camera intrinsic parameters appear commonly in different domains, and their influence for domain adaptation has been very rarely explored. In this paper, we observe that the Field of View (FoV) gap induces noticeable instance appearance differences between the source and target domains. We further discover that the FoV gap between two domains impairs domain adaptation performance under both the FoV increasing (source FoV target FoV) and FoV decreasing cases. Motivated by the observations, we propose the textbf Position Invariant Transform (PIT) to better align images in different domains. We also introduce a reverse PIT for mapping the transformed aligned images back to the original image space and design a loss re weighting strategy to accelerate the training process. Our method can be easily plugged into existing cross domain detection segmentation frameworks while bringing about negligible computational overhead. Extensive experiments demonstrate that our method can soundly boost the performance on both cross domain object detection and segmentation for state of the art techniques. Our code is available at https github.com sheepooo PIT Position Invariant Transform.


A mean value criterion for plurisubharmonic functions. In this paper we prove a criterion for plurisubharmonic functions in terms of integral mean by complex ellipsoids. Moreover, by using the criterion we prove an analogue of Blaschke Privalov theorem for plurisubharmonic functions.


Representations by ordered Bell and degenerate ordered Bell polynomials. In this paper, we consider the problem of representing any polynomial in terms of the ordered Bell and degenerate ordered Bell polynomials, and more generally of the higher order ordered Bell and higher order degenerate ordered Bell polynomials. We derive explicit formulas with the help of umbral calculus and illustrate our results with some examples.


System Performance Insights into Design of RIS assisted Smart Radio Environments for 6G. In state of the art wireless networks, the radio environment is beyond the control of the operators which leads to several issues. For example, signal attenuation limits radio connectivity, multi path propagation results in fading phenomena and reflections refractions from large objects are the main sources of uncontrollable interference. To overcome these issues, a new technology referred to as reconfigurable intelligent surfaces (RISs) has been brought to light. RISs, whose interactions with the electromagnetic waves are reconfigurable, are at the heart of the smart radio environments for beyond 5G (or 6G) wireless systems. Research on design of smart radio environments is still in infancy. To this end, this paper provides performance insights for design of RIS assisted smart radio environments. By extending a recent system level simulator and through extensive simulations, it investigates the impact of positioning placement of RISs, the number of reflecting elements and the tilt rotation of RISs in both single and multi RIS environments. Results reveal that these aspects are crucial to achieving capacity and reliability enhancements in smart radio environments.


Non self adjoint correct restrictions and extensions with real spectrum. The work is devoted to the study of the similarity of a correct restriction to some self adjoint operator in the case when the minimal operator is symmetric. The resulting theorem was applied to the Sturm Liouville operator and the Laplace operator. It is shown that the spectrum of a non self adjoint singularly perturbed operator is real and the corresponding system of eigenvectors forms a Riesz basis.


Quasiconformal almost parametrizations of metric surfaces. We look for minimal conditions on a two dimensional metric surface X of locally finite Hausdorff 2 measure under which X admits an (almost) parametrization with good geometric and analytic properties. Only assuming that X is locally geodesic, we show that Jordan domains in X of finite boundary length admit a quasiconformal almost parametrization. If X satisfies some further conditions then such an almost parametrization can be upgraded to a geometrically quasiconformal homeomorphism or a quasisymmetric homeomorphism. In particular, we recover Rajala's recent quasiconformal uniformization theorem in the special case that X is locally geodesic as well as Bonk Kleiner's quasisymmetric uniformization theorem. On the way we establish the existence of Sobolev discs spanning a given Jordan curve in X under nearly minimal assumptions on X and prove the continuity of energy minimizers.


Well posedness and robust stability of a nonlinear ODE PDE system. This work studies stability and robustness of a nonlinear system given as an interconnection of an ODE and a parabolic PDE subjected to external disturbances entering through the boundary conditions of the parabolic equation. To this end we develop an approach for a construction of a suitable coercive Lyapunov function as one of the main results. Based on this Lyapunov function we establish the well posedness of the considered system and establish conditions that guarantee the ISS property. ISS estimates are derived explicitly for the particular case of globally Lipschitz nonlinearities.


Scalable Vision Transformers with Hierarchical Pooling. The recently proposed Visual image Transformers (ViT) with pure attention have achieved promising performance on image recognition tasks, such as image classification. However, the routine of the current ViT model is to maintain a full length patch sequence during inference, which is redundant and lacks hierarchical representation. To this end, we propose a Hierarchical Visual Transformer (HVT) which progressively pools visual tokens to shrink the sequence length and hence reduces the computational cost, analogous to the feature maps downsampling in Convolutional Neural Networks (CNNs). It brings a great benefit that we can increase the model capacity by scaling dimensions of depth width resolution patch size without introducing extra computational complexity due to the reduced sequence length. Moreover, we empirically find that the average pooled visual tokens contain more discriminative information than the single class token. To demonstrate the improved scalability of our HVT, we conduct extensive experiments on the image classification task. With comparable FLOPs, our HVT outperforms the competitive baselines on ImageNet and CIFAR 100 datasets. Code is available at https github.com MonashAI HVT


Validating Fewest Switches Surface Hopping in the Presence of Laser Fields. The capability of fewest switches surface hopping (FSSH) to describe non adiabatic dynamics of small and medium sized molecules under explicit excitation with external fields is evaluated. Different parameters in FSSH and combinations thereof are benchmarked against multi configurational time dependent Hartree (MCTDH) reference calculations using SO 2 and 2 thiocytosine as model, yet realistic, molecular systems. Qualitatively, we find that FSSH is able to reproduce the trends in the MCTDH dynamics with (and without) an explicit external field however, no set of FSSH parameters is ideal. An adequate treatment of the overcoherence in FSSH is identified as the driving factor to improve the description of the excitation process with respect to the MCTDH reference. Here two corrections were tested, the augmented FSSH (AFSSH) and the energy based decoherence correction. A dependence on the employed basis is detected for the AFSSH algorithm, performing better when spin orbit and external laser field couplings are treated as off diagonal elements instead of projecting them onto the diagonal of the Hamilton operator. In the presence of an electric field, the excited state dynamics was found to depend strongly on the vector used to rescale the kinetic energy along after a transition between surfaces. For SO 2 , recurrence of the excited wave packet throughout the duration of the applied laser pulse is observed for long laser pulses ( 100 fs), resulting in additional interferences not captured by FSSH and only visible in variational multi configurational Gaussian when utilizing a large amount of gaussian basis functions. This feature essentially vanishes when going towards larger molecules, such as 2 thiocytosine, where this effect is barely visible in a laser pulse with a full width at half maximum of 200 fs.


On Trace Theorems and Poincare inequality for one dimensional Sobolev spaces. In these notes, we present versions of trace theorems for Sobolev spaces over an interval in the real line, and also a one dimensional version of the well known Poincare inequality.


Sampling error correction in ensemble Kalman inversion. Ensemble Kalman inversion is a parallelizable derivative free method to solve inverse problems. The method uses an ensemble that follows the Kalman update formula iteratively to solve an optimization problem. The ensemble size is crucial to capture the correct statistical information in estimating the unknown variable of interest. Still, the ensemble is limited to a size smaller than the unknown variable's dimension for computational efficiency. This study proposes a strategy to correct the sampling error due to a small ensemble size, which improves the performance of the ensemble Kalman inversion. This study validates the efficiency and robustness of the proposed strategy through a suite of numerical tests, including compressive sensing, image deblurring, parameter estimation of a nonlinear dynamical system, and a PDE constrained inverse problem.


A Deep Insight into Measuring Face Image Utility with General and Face specific Image Quality Metrics. Quality scores provide a measure to evaluate the utility of biometric samples for biometric recognition. Biometric recognition systems require high quality samples to achieve optimal performance. This paper focuses on face images and the measurement of face image utility with general and face specific image quality metrics. While face specific metrics rely on features of aligned face images, general image quality metrics can be used on the global image and relate to human perceptions. In this paper, we analyze the gap between the general image quality metrics and the face image quality metrics. Our contribution lies in a thorough examination of how different the image quality assessment algorithms relate to the utility for the face recognition task. The results of image quality assessment algorithms are further compared with those of dedicated face image quality assessment algorithms. In total, 25 different quality metrics are evaluated on three face image databases, BioSecure, LFW, and VGGFace2 using three open source face recognition solutions, SphereFace, ArcFace, and FaceNet. Our results reveal a clear correlation between learned image metrics to face image utility even without being specifically trained as a face utility measure. Individual handcrafted features lack general stability and perform significantly worse than general face specific quality metrics. We additionally provide a visual insight into the image areas contributing to the quality score of a selected set of quality assessment methods.


An Empirical Comparison of Off policy Prediction Learning Algorithms on the Collision Task. Off policy prediction learning the value function for one policy from data generated while following another policy is one of the most challenging subproblems in reinforcement learning. This paper presents empirical results with eleven prominent off policy learning algorithms that use linear function approximation five Gradient TD methods, two Emphatic TD methods, Off policy TD( lambda ), Vtrace, and versions of Tree Backup and ABQ modified to apply to a prediction setting. Our experiments used the Collision task, a small idealized off policy problem analogous to that of an autonomous car trying to predict whether it will collide with an obstacle. We assessed the performance of the algorithms according to their learning rate, asymptotic error level, and sensitivity to step size and bootstrapping parameters. By these measures, the eleven algorithms can be partially ordered on the Collision task. In the top tier, the two Emphatic TD algorithms learned the fastest, reached the lowest errors, and were robust to parameter settings. In the middle tier, the five Gradient TD algorithms and Off policy TD( lambda ) were more sensitive to the bootstrapping parameter. The bottom tier comprised Vtrace, Tree Backup, and ABQ these algorithms were no faster and had higher asymptotic error than the others. Our results are definitive for this task, though of course experiments with more tasks are needed before an overall assessment of the algorithms' merits can be made.


Democratizing information visualization. A study to map the value of graphic design to easier knowledge transfer of scientific research. Visual representations are becoming important in science communication and education. This explorative study investigates the perception of STEM researchers, without any specific visual design background, and the value of visual representations as tools to support the communication of technical and scientific knowledge among academics and a wider non technical community. Early findings show that visual representations can positively support scientists to share research outcomes in a more compelling, visually clear, and impactful manner, reaching a wider audience across different disciplines.


Optimizing the Whole life Cost in End to end CNN Acceleration. The acceleration of CNNs has gained increasing atten tion since their success in computer vision. With the heterogeneous functional layers that cannot be pro cessed by the accelerators proposed for convolution layers only, modern end to end CNN acceleration so lutions either transform the diverse computation into matrix vector arithmetic, which loses data reuse op portunities in convolution, or introduce dedicated functional unit to each kind of layer, which results in underutilization and high update expense. To enhance the whole life cost efficiency, we need an acceleration solution that is efficient in processing CNN layers and has the generality to apply to all kinds of existing and emerging layers. To this end, we pro pose GCONV Chain, a method to convert the entire CNN computation into a chain of standard general convolutions (GCONV) that can be efficiently pro cessed by the existing CNN accelerators. This paper comprehensively analyzes the GCONV Chain model and proposes a full stack implementation to support GCONV Chain. On one hand, the results on seven var ious CNNs demonstrate that GCONV Chain improves the performance and energy efficiency of existing CNN accelerators by an average of 3.4x and 3.2x re spectively. On the other hand, we show that GCONV Chain provides low whole life costs for CNN accelera tion, including both developer efforts and total cost of ownership for the users.


A controllability method for Maxwell's equations. We propose a controllability method for the numerical solution of time harmonic Maxwell's equations in their first order formulation. By minimizing a quadratic cost functional, which measures the deviation from periodicity, the controllability method determines iteratively a periodic solution in the time domain. At each conjugate gradient iteration, the gradient of the cost functional is simply computed by running any time dependent simulation code forward and backward for one period, thus leading to a non intrusive implementation easily integrated into existing software. Moreover, the proposed algorithm automatically inherits the parallelism, scalability, and low memory footprint of the underlying time domain solver. Since the time periodic solution obtained by minimization is not necessarily unique, we apply a cheap post processing filtering procedure which recovers the time harmonic solution from any minimizer. Finally, we present a series of numerical examples which show that our algorithm greatly speeds up the convergence towards the desired time harmonic solution when compared to simply running the time marching code until the time harmonic regime is eventually reached.


Knot Embeddings in Improper Foldings. Simple closed curves in the plane can be mapped to nontrivial knots under the action of origami foldings that allow the paper to self intersect. We show all tame knot types may be produced in this manner, motivating the development of a new knot invariant, the fold number, defined as the minimum number of creases required to obtain an equivalent knot. We study this invariant, presenting a bound on the fold number by the diagram stick number as well as a class of torus knots with constant fold number. We also pursue a characterization of those foldings which admit nontrivial knots, giving a proof that no "physically realizable", or proper, foldings can admit nontrivial knots. A number of questions are posed for further study.


Commuting partial normal subgroups and regular localities. In this paper, important concepts from finite group theory are translated to localities, in particular to linking localities. Here localities are group like structures associated to fusion systems which were introduced by Chermak. Linking localities (by Chermak also called proper localities) are special kinds of localities which correspond to linking systems. Thus they contain the algebraic information that is needed to study p completed classifying spaces of fusion systems as generalizations of p completed classifying spaces of finite groups. Because of the group like nature of localities, there is a natural notion of partial normal subgroups. Given a locality mathcal L and a partial normal subgroup mathcal N of mathcal L , we show that there is a largest partial normal subgroup mathcal N perp of mathcal L which, in a certain sense, commutes elementwise with mathcal N and thus morally plays the role of a "centralizer" of mathcal N in mathcal L . This leads to a nice notion of the generalized Fitting subgroup F ( mathcal L ) of a linking locality mathcal L . Building on these results we define and study special kinds of linking localities called regular localities. It turns out that there is a theory of components of regular localities akin to the theory of components of finite groups. The main concepts we introduce and work with in the present paper (in particular mathcal N perp in the special case of linking localities, F ( mathcal L ) , regular localities and components of regular localities) were already introduced and studied in a preprint by Chermak. However, we give a different and self contained approach to the subject where we reprove Chermak's theorems and also show several new results.


Analyzing a Carceral Algorithm used by the Pennsylvania Department of Corrections. Scholars have focused on algorithms used during sentencing, bail, and parole, but little work explores what we call carceral algorithms that are used during incarceration. This paper is focused on the Pennsylvania Additive Classification Tool (PACT) used to classify prisoners' custody levels while they are incarcerated. Algorithms that are used during incarceration warrant deeper attention by scholars because they have the power to enact the lived reality of the prisoner. The algorithm in this case determines the likelihood a person would endure additional disciplinary actions, can complete required programming, and gain experiences that, among other things, are distilled into variables feeding into the parole algorithm. Given such power, examining algorithms used on people currently incarcerated offers a unique analytic view to think about the dialectic relationship between data and algorithms. Our examination of the PACT is two fold and complementary. First, our qualitative overview of the historical context surrounding PACT reveals that it is designed to prioritize incapacitation and control over rehabilitation. While it closely informs prisoner rehabilitation plans and parole considerations, it is rooted in population management for prison securitization. Second, on analyzing data for 146,793 incarcerated people in PA, along with associated metadata related to the PACT, we find it is replete with racial bias as well as errors, omissions, and inaccuracies. Our findings to date further caution against data driven criminal justice reforms that rely on pre existing data infrastructures and expansive, uncritical, data collection routines.


SparkXD A Framework for Resilient and Energy Efficient Spiking Neural Network Inference using Approximate DRAM. Spiking Neural Networks (SNNs) have the potential for achieving low energy consumption due to their biologically sparse computation. Several studies have shown that the off chip memory (DRAM) accesses are the most energy consuming operations in SNN processing. However, state of the art in SNN systems do not optimize the DRAM energy per access, thereby hindering achieving high energy efficiency. To substantially minimize the DRAM energy per access, a key knob is to reduce the DRAM supply voltage but this may lead to DRAM errors (i.e., the so called approximate DRAM). Towards this, we propose SparkXD, a novel framework that provides a comprehensive conjoint solution for resilient and energy efficient SNN inference using low power DRAMs subjected to voltage induced errors. The key mechanisms of SparkXD are (1) improving the SNN error tolerance through fault aware training that considers bit errors from approximate DRAM, (2) analyzing the error tolerance of the improved SNN model to find the maximum tolerable bit error rate (BER) that meets the targeted accuracy constraint, and (3) energy efficient DRAM data mapping for the resilient SNN model that maps the weights in the appropriate DRAM location to minimize the DRAM access energy. Through these mechanisms, SparkXD mitigates the negative impact of DRAM (approximation) errors, and provides the required accuracy. The experimental results show that, for a target accuracy within 1 of the baseline design (i.e., SNN without DRAM errors), SparkXD reduces the DRAM energy by ca. 40 on average across different network sizes.


The effectiveness of feature attribution methods and its correlation with automatic evaluation scores. Explaining the decisions of an Artificial Intelligence (AI) model is increasingly critical in many real world, high stake applications. Hundreds of papers have either proposed new feature attribution methods, discussed or harnessed these tools in their work. However, despite humans being the target end users, most attribution methods were only evaluated on proxy automatic evaluation metrics (Zhang et al. 2018 Zhou et al. 2016 Petsiuk et al. 2018). In this paper, we conduct the first user study to measure attribution map effectiveness in assisting humans in ImageNet classification and Stanford Dogs fine grained classification, and when an image is natural or adversarial (i.e., contains adversarial perturbations). Overall, feature attribution is surprisingly not more effective than showing humans nearest training set examples. On a harder task of fine grained dog categorization, presenting attribution maps to humans does not help, but instead hurts the performance of human AI teams compared to AI alone. Importantly, we found automatic attribution map evaluation measures to correlate poorly with the actual human AI team performance. Our findings encourage the community to rigorously test their methods on the downstream human in the loop applications and to rethink the existing evaluation metrics.


On the facet pivot simplex method for linear programming I algorithms and numerical test. The Hirsch Conjecture stated that any d dimensional polytope with n facets has a diameter at most equal to n d. This conjecture was disproven by Santos (A counterexample to the Hirsch Conjecture, Annals of Mathematics, 172(1) 383 412, 2012). The implication of Santos' work is that all vertex pivot algorithms cannot solve the linear programming problem in the worst case in n d vertex pivot iterations. In this paper, the first part in this series of papers, we propose a facet pivot method and perform some numerical tests to demonstrate its superiority to the existing vertex pivot method. In the second part of this series, we show that the proposed facet pivot method can solve the canonical linear programming problem in the worst case in at most n d facet pivot iterations. This series of the papers was inspired by Smale's Problem 9 (Mathematical problems for the next century, In Arnold, V. I. Atiyah, M. Lax, P. Mazur, B. Mathematics frontiers and perspectives, American Mathematical Society, 271 294, 1999).


The Speed Robustness Trade Off for First Order Methods with Additive Gradient Noise. We study the trade off between convergence rate and sensitivity to stochastic additive gradient noise for first order optimization methods. Ordinary Gradient Descent (GD) can be made fast and sensitive or slow and robust by increasing or decreasing the stepsize, respectively. However, it is not clear how such a trade off can be navigated when working with accelerated methods such as Polyak's Heavy Ball (HB) or Nesterov's Fast Gradient (FG) methods, or whether any of these methods can achieve an optimal trade off. We consider three classes of functions (1) strongly convex quadratics, (2) smooth strongly convex functions, and (3) nonconvex functions that satisfy a weak notion of strong convexity. For each function class, we present a tractable way to compute convergence rate and sensitivity to additive gradient noise for a broad family of first order methods, and we present near Pareto optimal algorithm designs. Each design consists of a simple analytic update rule with two states of memory, similar to HB and FG. Moreover, each design has a scalar tuning parameter that explicitly trades off convergence rate and sensitivity to additive gradient noise. When tuned as aggressively as possible, our proposed algorithms recover the algorithms with fastest known convergence rates for each function class. When tuned to be more robust, our algorithms are novel and provide a practical way to control noise sensitivity while maintaining the fastest possible convergence rate. We validate the performance and near optimality of our designs through numerous numerical simulations.


C 1 conforming variational discretization of the biharmonic wave equation. Biharmonic wave equations are of importance to various applications including thin plate analyses. In this work, the numerical approximation of their solutions by a C 1 conforming in space and time finite element approach is proposed and analyzed. Therein, the smoothness properties of solutions to the continuous evolution problem is embodied. High potential of the presented approach for more sophisticated multi physics and multi scale systems is expected. Time discretization is based on a combined Galerkin and collocation technique. For space discretization the Bogner Fox Schmit element is applied. Optimal order error estimates are proven. The convergence and performance properties are illustrated with numerical experiments.


Cell density controls signal propagation waves in a multicellular synthetic gene circuit. During organismal development, biochemical reaction networks sense and respond to mechanical forces to coordinate embryonic patterning with embryo morphogenesis. Factors such as cortical tension, cell density, and matrix mechanical properties influence differentiation and cell fate decisions by modulating gene regulatory signaling networks. A major goal in synthetic development is to construct gene regulatory circuits that program the patterning and morphogenesis of synthetic multicellular structures. However, in the synthetic context, little is known regarding how the physical properties of the growth environment impact the behavior of synthetic gene circuits. Here, we exploit physical chemical coupling observed in a synthetic patterning circuit in order to control the size and spatial distribution of patterned synthetic cell sheets. We show that cell density attenuates the propagation of signal between neighboring cells in a multicellular sheet containing a contact dependent patterning circuit based on the synNotch signaling system. Density dependent attenuation leads to a signal propagation wave that exhibits distinct qualitative phases of persistent propagation, transient propagation, and no propagation. Through computational modeling, we demonstrate that cell growth parameters determine the phase of propagation observed within a growing cell sheet. Using growth modulating drugs and spatial density gradients, we control the size of synNotch activated cell populations and generate tissue scale activation gradients and kinematic waves. Our study reveals that density dependent synNotch activity can be exploited to control a synthetic multicellular patterning circuit. More broadly, we show that synthetic gene circuits can be critically impacted by their physical context, providing an alternate means for programming circuit behavior.


Anchor Constrained Viterbi for Set Supervised Action Segmentation. This paper is about action segmentation under weak supervision in training, where the ground truth provides only a set of actions present, but neither their temporal ordering nor when they occur in a training video. We use a Hidden Markov Model (HMM) grounded on a multilayer perceptron (MLP) to label video frames, and thus generate a pseudo ground truth for the subsequent pseudo supervised training. In testing, a Monte Carlo sampling of action sets seen in training is used to generate candidate temporal sequences of actions, and select the maximum posterior sequence. Our key contribution is a new anchor constrained Viterbi algorithm (ACV) for generating the pseudo ground truth, where anchors are salient action parts estimated for each action from a given ground truth set. Our evaluation on the tasks of action segmentation and alignment on the benchmark Breakfast, MPII Cooking2, Hollywood Extended datasets demonstrates our superior performance relative to that of prior work.


Quadratic type checking for objective type theory. We introduce a modification of standard Martin Lof type theory in which we eliminate definitional equality and replace all computation rules by propositional equalities. We show that type checking for such a system can be done in quadratic time and that it has a natural homotopy theoretic semantics.


Flexible FOND Planning with Explicit Fairness Assumptions. We consider the problem of reaching a propositional goal condition in fully observable non deterministic (FOND) planning under a general class of fairness assumptions that are given explicitly. The fairness assumptions are of the form A B and say that state trajectories that contain infinite occurrences of an action a from A in a state s and finite occurrence of actions from B, must also contain infinite occurrences of action a in s followed by each one of its possible outcomes. The infinite trajectories that violate this condition are deemed as unfair, and the solutions are policies for which all the fair trajectories reach a goal state. We show that strong and strong cyclic FOND planning, as well as QNP planning, a planning model introduced recently for generalized planning, are all special cases of FOND planning with fairness assumptions of this form which can also be combined. FOND planning, as this form of planning is called, combines the syntax of FOND planning with some of the versatility of LTL for expressing fairness constraints. A new planner is implemented by reducing FOND planning to answer set programs, and the performance of the planner is evaluated in comparison with FOND and QNP planners, and LTL synthesis tools.


Self Supervised Classification Network. We present Self Classifier a novel self supervised end to end classification learning approach. Self Classifier learns labels and representations simultaneously in a single stage end to end manner by optimizing for same class prediction of two augmented views of the same sample. To guarantee non degenerate solutions (i.e., solutions where all labels are assigned to the same class) we propose a mathematically motivated variant of the cross entropy loss that has a uniform prior asserted on the predicted labels. In our theoretical analysis we prove that degenerate solutions are not in the set of optimal solutions of our approach. Self Classifier is simple to implement and scalable. Unlike other popular unsupervised classification and contrastive representation learning approaches, it does not require any form of pre training, expectation maximization, pseudo labelling, external clustering, a second network, stop gradient operation or negative pairs. Despite its simplicity, our approach sets a new state of the art for unsupervised classification of ImageNet and even achieves comparable to state of the art results for unsupervised representation learning. Code https github.com elad amrani self classifier


Four dimensional quadratic forms over mathbb C( !(t) !)(X) . For quadratic forms in 4 variables defined over the rational function field in one variable over mathbb C( !(t) !) , the validity of the local global principle for isotropy with respect to different sets of discrete valuations is examined.


Predicting the outcome of team movements Player time series analysis using fuzzy and deep methods for representation learning. We extract and use player position time series data, tagged along with the action types, to build a competent model for representing team tactics behavioral patterns and use this representation to predict the outcome of arbitrary movements. We provide a framework for the useful encoding of short tactics and space occupations in a more extended sequence of movements or tactical plans. We investigate game segments during a match in which the team in possession of the ball regularly attempts to reach a position where they can take a shot at goal for a single game. A carefully designed and efficient kernel is employed using a triangular fuzzy membership function to create multiple time series for players' potential of presence at different court regions. Unsupervised learning is then used for time series using triplet loss and deep neural networks with exponentially dilated causal convolutions for the derived multivariate time series. This works key contribution lies in its approach to model how short scenes contribute to other longer ones and how players occupies and creates new spaces in game court. We discuss the effectiveness of the proposed approach for prediction and recognition tasks on the professional basketball SportVU dataset for the 2015 16 half season. The proposed system demonstrates descent functionality even with relatively small data.


Hedging under rough volatility. In this chapter we first briefly review the existing approaches to hedging in rough volatility models. Next, we present a simple but general result which shows that in a one factor rough stochastic volatility model, any option may be perfectly hedged with a dynamic portfolio containing the underlying and one other asset such as a variance swap. In the final section we report the results of a back test experiment using real data, where VIX options are hedged with a forward variance swap. In this experiment, using a rough volatility model allows to almost completely remove the bias and reduce the overall hedging error by a factor of 27 compared to traditional diffusion based models.


A General Cardinality Estimation Framework for Subgraph Matching in Property Graphs. Many techniques have been developed for the cardinality estimation problem in data management systems. In this document, we introduce a framework for cardinality estimation of query patterns over property graph databases, which makes it possible to analyze, compare and combine different cardinality estimation approaches. This framework consists of three phases obtaining a set of estimates for some subqueries, extending this set and finally combining the set into a single cardinality estimate for the query. We show that (parts of) many of the existing cardinality estimation approaches can be used as techniques in one of the phases from our framework. The three phases are loosely coupled, this makes it possible to combine (parts of) current cardinality estimation approaches. We create a graph version of the Join Order Benchmark to perform experiments with different combinations of techniques. The results show that query patterns without property constraints can be accurately estimated using synopses for small patterns. Accurate estimation of query patterns with property constraints require new estimation techniques to be developed that capture correlations between the property constraints and the topology in graph databases.


Game of Life on Graphs. We consider a specific graph dynamical system inspired by the famous Conway's Game of Life in this work. We study the properties of the dynamical system on different graphs and introduce a new efficient heuristic for graph isomorphism testing. We use the evolution of our system to extract features from a graph in a deterministic way and observe that the extracted features are unique and the distance induced by that features satisfy triangle inequality for all connected graphs with up to ten vertices.


Self supervised Video Transformer. In this paper, we propose self supervised training for video transformers using unlabeled video data. From a given video, we create local and global spatiotemporal views with varying spatial sizes and frame rates. Our self supervised objective seeks to match the features of these different views representing the same video, to be invariant to spatiotemporal variations in actions. To the best of our knowledge, the proposed approach is the first to alleviate the dependency on negative samples or dedicated memory banks in Self supervised Video Transformer (SVT). Further, owing to the flexibility of Transformer models, SVT supports slow fast video processing within a single architecture using dynamically adjusted positional encoding and supports long term relationship modeling along spatiotemporal dimensions. Our approach performs well on four action recognition benchmarks (Kinetics 400, UCF 101, HMDB 51, and SSv2) and converges faster with small batch sizes. Code https git.io J1juJ


physics.comp-ph physics.app-ph physics.data-an physics.ins-det

Monte Carlo calculations for simulating electron scattering in gas phase. Here we present the derivation, description and results of a Monte Carlo based algorithm for simulating inelastic scattering of photo electrons when passing through some scattering medium, such as a gas atmosphere or a solid material. The code used to run these simulations was written in python and is freely available online (https github.com surfaceanalytics montecarlo electron scattering).


Fine grained Geolocation Prediction of Tweets with Human Machine Collaboration. Twitter is a useful resource to analyze peoples' opinions on various topics. Often these topics are correlated or associated with locations from where these Tweet posts are made. For example, restaurant owners may need to know where their target customers eat with respect to the sentiment of the posts made related to food, policy planners may need to analyze citizens' opinion on relevant issues such as crime, safety, congestion, etc. with respect to specific parts of the city, or county or state. As promising as this is, less than 1 of the crawled Tweet posts come with geolocation tags. That makes accurate prediction of Tweet posts for the non geo tagged tweets very critical to analyze data in various domains. In this research, we utilized millions of Twitter posts and end users domain expertise to build a set of deep neural network models using natural language processing (NLP) techniques, that predicts the geolocation of non geo tagged Tweet posts at various level of granularities such as neighborhood, zipcode, and longitude with latitudes. With multiple neural architecture experiments, and a collaborative human machine workflow design, our ongoing work on geolocation detection shows promising results that empower end users to correlate relationship between variables of choice with the location information.


Creating a Virtuous Cycle in Performance Testing at MongoDB. It is important to detect changes in software performance during development in order to avoid performance decreasing release to release or dealing with costly delays at release time. Performance testing is part of the development process at MongoDB, and integrated into our continuous integration system. We describe a set of changes to that performance testing environment designed to improve testing effectiveness. These changes help improve coverage, provide faster and more accurate signaling for performance changes, and help us better understand the state of performance. In addition to each component performing better, we believe that we have created and exploited a virtuous cycle performance test improvements drive impact, which drives more use, which drives further impact and investment in improvements. Overall, MongoDB is getting faster and we avoid shipping major performance regressions to our customers because of this infrastructure.


Higher regularity and asymptotic behavior of 2D magnetic Prandtl model in the Prandtl Hartmann regime. In this paper, we investigate the higher regularity and asymptotic behavior for the 2 D magnetic Prandtl model in the Prandtl Hartmann regime. Due to the degeneracy of horizontal velocity near boundary, the higher regularity of solution is a tricky problem. By constructing suitable approximated system and establishing closed energy estimate for a good quantity(called "quotient" in cite Guo Iyer 2021 ), our first result is to solve this higher regularity problem. Furthermore, we show the global well posedness and global in x asymptotic behavior when the initial data are small perturbation of the classical Hartmann layer in Sobolev space. By using the energy method to establish closed estimate for the quotient, we overcome the difficulty arising from the degeneracy of horizontal velocity near boundary. Due to the damping effect, we also point out that this global solution will converge to the equilibrium state(called Hartmann layer) with exponent decay rate.


TDGIA Effective Injection Attacks on Graph Neural Networks. Graph Neural Networks (GNNs) have achieved promising performance in various real world applications. However, recent studies have shown that GNNs are vulnerable to adversarial attacks. In this paper, we study a recently introduced realistic attack scenario on graphs graph injection attack (GIA). In the GIA scenario, the adversary is not able to modify the existing link structure and node attributes of the input graph, instead the attack is performed by injecting adversarial nodes into it. We present an analysis on the topological vulnerability of GNNs under GIA setting, based on which we propose the Topological Defective Graph Injection Attack (TDGIA) for effective injection attacks. TDGIA first introduces the topological defective edge selection strategy to choose the original nodes for connecting with the injected ones. It then designs the smooth feature optimization objective to generate the features for the injected nodes. Extensive experiments on large scale datasets show that TDGIA can consistently and significantly outperform various attack baselines in attacking dozens of defense GNN models. Notably, the performance drop on target GNNs resultant from TDGIA is more than double the damage brought by the best attack solution among hundreds of submissions on KDD CUP 2020.


A fast Chebyshev method for the Bingham closure with application to active nematic suspensions. Continuum kinetic theories provide an important tool for the analysis and simulation of particle suspensions. When those particles are anisotropic, the addition of a particle orientation vector to the kinetic description yields a 2d 1 dimensional theory which becomes intractable to simulate, especially in three dimensions or near states where the particles are highly aligned. Coarse grained theories that track only moments of the particle distribution functions provide a more efficient simulation framework, but require closure assumptions. For the particular case where the particles are apolar, the Bingham closure has been found to agree well with the underlying kinetic theory yet the closure is non trivial to compute, requiring the solution of an often nearly singular nonlinear equation at every spatial discretization point at every timestep. In this paper, we present a robust, accurate, and efficient numerical scheme for evaluating the Bingham closure, with a controllable error efficiency tradeoff. To demonstrate the utility of the method, we carry out high resolution simulations of a coarse grained continuum model for a suspension of active particles in parameter regimes inaccessible to kinetic theories. Analysis of these simulations reveals that inaccurately computing the closure can act to effectively limit spatial resolution in the coarse grained fields. Pushing these simulations to the high spatial resolutions enabled by our method reveals a coupling between vorticity and topological defects in the suspension director field, as well as signatures of energy transfer between scales in this active fluid model.


The UniNAS framework combining modules in arbitrarily complex configurations with argument trees. Designing code to be simplistic yet to offer choice is a tightrope walk. Additional modules such as optimizers and data sets make a framework useful to a broader audience, but the added complexity quickly becomes a problem. Framework parameters may apply only to some modules but not others, be mutually exclusive or depend on each other, often in unclear ways. Even so, many frameworks are limited to a few specific use cases. This paper presents the underlying concept of UniNAS, a framework designed to incorporate a variety of Neural Architecture Search approaches. Since they differ in the number of optimizers and networks, hyper parameter optimization, network designs, candidate operations, and more, a traditional approach can not solve the task. Instead, every module defines its own hyper parameters and a local tree structure of module requirements. A configuration file specifies which modules are used, their used parameters, and which other modules they use in turn This concept of argument trees enables combining and reusing modules in complex configurations while avoiding many problems mentioned above. Argument trees can also be configured from a graphical user interface so that designing and changing experiments becomes possible without writing a single line of code. UniNAS is publicly available at https github.com cogsys tuebingen uninas


Modelling of a miniature microwave driven nitrogen plasma jet and comparison to measurements. The MMWICP (Miniature MicroWave ICP) is a new plasma source using the induction principle. Recently Klute et al. presented a mathematical model for the electromagnetic fields and power balance of the new device. In this work the electromagnetic model is coupled with a global chemistry model for nitrogen, based on the chemical reaction set of Thorsteinsson and Gudmundsson and customized for the geometry of the MMWICP. The combined model delivers a quantitative description for a non thermal plasma at a pressure of p 1000 , mathrm Pa and a gas temperature of T mathrm g 650 mbox 1600 , mathrm K . Comparison with published experimental data shows a good agreement for the volume averaged plasma parameters at high power, for the spatial distribution of the discharge and for the microwave measurements. Furthermore, the balance of capacitive and inductive linebreak coupling in the absorbed power is analyzed. This leads to the interpretation of the discharge regime at a electron density of n mathrm e approx 6.4 ! times !10 18 , mathrm m 3 as E H hybridmode with an capacitive and inductive component.


Selecting Optimal Trace Clustering Pipelines with AutoML. Trace clustering has been extensively used to preprocess event logs. By grouping similar behavior, these techniques guide the identification of sub logs, producing more understandable models and conformance analytics. Nevertheless, little attention has been posed to the relationship between event log properties and clustering quality. In this work, we propose an Automatic Machine Learning (AutoML) framework to recommend the most suitable pipeline for trace clustering given an event log, which encompasses the encoding method, clustering algorithm, and its hyperparameters. Our experiments were conducted using a thousand event logs, four encoding techniques, and three clustering methods. Results indicate that our framework sheds light on the trace clustering problem and can assist users in choosing the best pipeline considering their scenario.


Sensing and Mapping for Better Roads Initial Plan for Using Federated Learning and Implementing a Digital Twin to Identify the Road Conditions in a Developing Country Sri Lanka. We propose how a developing country like Sri Lanka can benefit from privacy enabled machine learning techniques such as Federated Learning to detect road conditions using crowd sourced data collection and proposed the idea of implementing a Digital Twin for the national road system in Sri Lanka. Developing countries such as Sri Lanka are far behind in implementing smart road systems and smart cities compared to the developed countries. The proposed work discussed in this paper matches the UN Sustainable Development Goal (SDG) 9 "Build Resilient Infrastructure, Promote Inclusive and Sustainable Industrialization and Foster Innovation". Our proposed work discusses how the government and private sector vehicles that conduct routine trips to collect crowd sourced data using smartphone devices to identify the road conditions and detect where the potholes, surface unevenness (roughness), and other major distresses are located on the roads. We explore Mobile Edge Computing (MEC) techniques that can bring machine learning intelligence closer to the edge devices where produced data is stored and show how the applications of Federated Learning can be made to detect and improve road conditions. During the second phase of this study, we plan to implement a Digital Twin for the road system in Sri Lanka. We intend to use data provided by both Dedicated and Non Dedicated systems in the proposed Digital Twin for the road system. As of writing this paper, and best to our knowledge, there is no Digital Twin system implemented for roads and other infrastructure systems in Sri Lanka. The proposed Digital Twin will be one of the first implementations of such systems in Sri Lanka. Lessons learned from this pilot project will benefit other developing countries who wish to follow the same path and make data driven decisions.


IntraLoss Further Margin via Gradient Enhancing Term for Deep Face Recognition. Existing classification based face recognition methods have achieved remarkable progress, introducing large margin into hypersphere manifold to learn discriminative facial representations. However, the feature distribution is ignored. Poor feature distribution will wipe out the performance improvement brought about by margin scheme. Recent studies focus on the unbalanced inter class distribution and form a equidistributed feature representations by penalizing the angle between identity and its nearest neighbor. But the problem is more than that, we also found the anisotropy of intra class distribution. In this paper, we propose the gradient enhancing term' that concentrates on the distribution characteristics within the class. This method, named IntraLoss, explicitly performs gradient enhancement in the anisotropic region so that the intra class distribution continues to shrink, resulting in isotropic and more compact intra class distribution and further margin between identities. The experimental results on LFW, YTF and CFP FP show that our outperforms state of the art methods by gradient enhancement, demonstrating the superiority of our method. In addition, our method has intuitive geometric interpretation and can be easily combined with existing methods to solve the previously ignored problems.


A Simple but Effective Bidirectional Framework for Relational Triple Extraction. Tagging based relational triple extraction methods are attracting growing research attention recently. However, most of these methods take a unidirectional extraction framework that first extracts all subjects and then extracts objects and relations simultaneously based on the subjects extracted. This framework has an obvious deficiency that it is too sensitive to the extraction results of subjects. To overcome this deficiency, we propose a bidirectional extraction framework based method that extracts triples based on the entity pairs extracted from two complementary directions. Concretely, we first extract all possible subject object pairs from two paralleled directions. These two extraction directions are connected by a shared encoder component, thus the extraction features from one direction can flow to another direction and vice versa. By this way, the extractions of two directions can boost and complement each other. Next, we assign all possible relations for each entity pair by a biaffine model. During training, we observe that the share structure will lead to a convergence rate inconsistency issue which is harmful to performance. So we propose a share aware learning mechanism to address it. We evaluate the proposed model on multiple benchmark datasets. Extensive experimental results show that the proposed model is very effective and it achieves state of the art results on all of these datasets. Moreover, experiments show that both the proposed bidirectional extraction framework and the share aware learning mechanism have good adaptability and can be used to improve the performance of other tagging based methods. The source code of our work is available at https github.com neukg BiRTE.


Surrogate data enriched Physics Aware Neural Networks. Neural networks can be used as surrogates for PDE models. They can be made physics aware by penalizing underlying equations or the conservation of physical properties in the loss function during training. Current approaches allow to additionally respect data from numerical simulations or experiments in the training process. However, this data is frequently expensive to obtain and thus only scarcely available for complex models. In this work, we investigate how physics aware models can be enriched with computationally cheaper, but inexact, data from other surrogate models like Reduced Order Models (ROMs). In order to avoid trusting too low fidelity surrogate solutions, we develop an approach that is sensitive to the error in inexact data. As a proof of concept, we consider the one dimensional wave equation and show that the training accuracy is increased by two orders of magnitude when inexact data from ROMs is incorporated.


Evolving Transferable Pruning Functions. Channel pruning has made major headway in the design of efficient deep learning models. Conventional approaches adopt human made pruning functions to score channels' importance for channel pruning, which requires domain knowledge and could be sub optimal. In this work, we propose an end to end framework to automatically discover strong pruning metrics. Specifically, we craft a novel design space for expressing pruning functions and leverage an evolution strategy, genetic programming, to evolve high quality and transferable pruning functions. Unlike prior methods, our approach can not only provide compact pruned networks for efficient inference, but also novel closed form pruning metrics that are mathematically explainable and thus generalizable to different pruning tasks. The evolution is conducted on small datasets while the learned functions are transferable to larger datasets without any manual modification. Compared to direct evolution on a large dataset, our strategy shows better cost effectiveness. When applied to more challenging datasets, different from those used in the evolution process, e.g., ILSVRC 2012, an evolved function achieves state of the art pruning results.


Inversions for the Hua Radon and the polarized Hua Radon transform. The Hua Radon and polarized Hua Radon transform are two orthogonal projections defined on holomorphic functions in the Lie sphere. Both transformations can be written as integral transforms with respect to a suitable reproducing kernel. Integrating both kernels over a Stiefel manifold yields a linear combination of zonal spherical monogenics. Using an Almansi type decomposition of holomorphic functions and reproducing properties of the zonal monogenics, we obtain an inversion formula for both the Hua Radon and the polarized Hua Radon transform.


One Shot Generative Domain Adaptation. This work aims at transferring a Generative Adversarial Network (GAN) pre trained on one image domain to a new domain referring to as few as just one target image. The main challenge is that, under limited supervision, it is extremely difficult to synthesize photo realistic and highly diverse images, while acquiring representative characters of the target. Different from existing approaches that adopt the vanilla fine tuning strategy, we import two lightweight modules to the generator and the discriminator respectively. Concretely, we introduce an attribute adaptor into the generator yet freeze its original parameters, through which it can reuse the prior knowledge to the most extent and hence maintain the synthesis quality and diversity. We then equip the well learned discriminator backbone with an attribute classifier to ensure that the generator captures the appropriate characters from the reference. Furthermore, considering the poor diversity of the training data (i.e., as few as only one image), we propose to also constrain the diversity of the generative domain in the training process, alleviating the optimization difficulty. Our approach brings appealing results under various settings, substantially surpassing state of the art alternatives, especially in terms of synthesis diversity. Noticeably, our method works well even with large domain gaps, and robustly converges within a few minutes for each experiment.


Lower bounds on beta( alpha) and other properties of alpha ITRMs. For an ordinal alpha , an alpha ITRM is a machine model of transfinite computability that operates on finitely many registers, each of which can contain an ordinal rho alpha they were introduced by Koepke in cite KM . In cite alpha itrms , it was shown that the alpha ITRM computable subsets of alpha are exactly those in a level L beta( alpha) of the constructible hierarchy. It was conjectured in cite alpha itrms that beta( alpha) is the first limit of admissible ordinals above alpha . Here, we show that this is false in particular, even the computational strength of omega omega ITRMs goes far beyond omega omega text CK .


A flux reconstruction kinetic scheme for the Boltzmann equation. It is challenging to solve the Boltzmann equation accurately due to the extremely high dimensionality and nonlinearity. This paper addresses the idea and implementation of the first flux reconstruction method for high order Boltzmann solutions. Based on the Lagrange interpolation and reconstruction, the kinetic upwind flux functions are solved simultaneously within physical and particle velocity space. The fast spectral method is incorporated to solve the full Boltzmann collision integral with a general collision kernel. The explicit singly diagonally implicit Runge Kutta (ESDIRK) method is employed as time integrator and the stiffness of the collision term is smoothly overcome. Besides, we ensure the shock capturing property by introducing a self adaptive artificial dissipation, which is derived naturally from the effective cell Knudsen number at the kinetic scale. As a result, the current flux reconstruction kinetic scheme can be universally applied in all flow regimes. Numerical experiments including wave propagation, normal shock structure, one dimensional Riemann problem, Couette flow and lid driven cavity will be presented to validate the scheme. The order of convergence of the current scheme is clearly identified. The capability for simulating cross scale and non equilibrium flow dynamics is demonstrated.


Full Poincar 'e mapping for ultra sensitive polarimetry. While polarisation sensing is vital in many areas of research, with applications spanning from microscopy to aerospace, traditional approaches are limited by method related error amplification or accumulation, placing fundamental limitations on precision and accuracy in single shot polarimetry. Here, we put forward a new measurement paradigm to circumvent this, introducing the notion of a universal full Poincar 'e generator to map all polarisation analyser states into a single vectorially structured light field, allowing all vector components to be analysed in a single shot with theoretically user defined precision. To demonstrate the advantage of our approach, we use a common GRIN optic as our mapping device and show mean errors of 1 for each vector component, enhancing the sensitivity by around three times, allowing us to sense weak polarisation aberrations not measurable by traditional single shot techniques. Our work paves the way for next generation polarimetry, impacting a wide variety of applications relying on weak vector measurement.


Automatic Code Generation using Pre Trained Language Models. Recent advancements in natural language processing cite gpt2 cite BERT have led to near human performance in multiple natural language tasks. In this paper, we seek to understand whether similar techniques can be applied to a highly structured environment with strict syntax rules. Specifically, we propose an end to end machine learning model for code generation in the Python language built on top of pre trained language models. We demonstrate that a fine tuned model can perform well in code generation tasks, achieving a BLEU score of 0.22, an improvement of 46 over a reasonable sequence to sequence baseline. All results and related code used for training and data processing are available on GitHub.


Viola A Topic Agnostic Generate and Rank Dialogue System. We present Viola, an open domain dialogue system for spoken conversation that uses a topic agnostic dialogue manager based on a simple generate and rank approach. Leveraging recent advances of generative dialogue systems powered by large language models, Viola fetches a batch of response candidates from various neural dialogue models trained with different datasets and knowledge grounding inputs. Additional responses originating from template based generators are also considered, depending on the user's input and detected entities. The hand crafted generators build on a dynamic knowledge graph injected with rich content that is crawled from the web and automatically processed on a daily basis. Viola's response ranker is a fine tuned polyencoder that chooses the best response given the dialogue history. While dedicated annotations for the polyencoder alone can indirectly steer it away from choosing problematic responses, we add rule based safety nets to detect neural degeneration and a dedicated classifier to filter out offensive content. We analyze conversations that Viola took part in for the Alexa Prize Socialbot Grand Challenge 4 and discuss the strengths and weaknesses of our approach. Lastly, we suggest future work with a focus on curating conversation data specifcially for socialbots that will contribute towards a more robust data driven socialbot.


On the all India rainfall index and sub India rainfall heterogeneity. We revisit long standing controversies regarding relationships among the all India rainfall index (AIRI), sub India summer rainfall variations, El Ni no Southern Oscillation (ENSO), and the Indian Ocean Dipole (IOD) using 120 year sea surface temperature and high resolution rainfall datasets. AIRI closely tracks with the spatial extent of wet anomalies and with the average across gridpoints in rainy day count. The leading rainfall variability mode is a monopole associated primarily with rainy day count and ENSO. The second mode is a tripole with same signed loadings in the high rainfall Western Ghats and Central Monsoon Zone regions and opposite signed loadings in Southeastern India between. The IOD projects onto this tripole and, as such, is weakly correlated with AIRI. However, when the linear influence of ENSO is removed, the IOD rainfall regressions become quasi homogeneously more positive, making the ENSO residual IOD and AIRI timeseries significantly correlated.


Perturbed Gaussian generating functions for universal knot invariants. We introduce a new approach to universal quantum knot invariants that emphasizes generating functions instead of generators and relations. All the relevant generating functions are shown to be perturbed Gaussians of the form Pe G , where G is quadratic and P is a suitably restricted "perturbation". After developing a calculus for such Gaussians in general we focus on the rank one invariant mathbf Z mathbb D in detail. We discuss how it dominates the mathfrak sl 2 colored Jones polynomials and relates to knot genus and Whitehead doubling. In addition to being a strong knot invariant that behaves well under natural operations on tangles mathbf Z mathbb D is also computable in polynomial time in the crossing number of the knot. We provide a full implementation of the invariant and provide a table in an appendix.


Towards continual task learning in artificial neural networks current approaches and insights from neuroscience. The innate capacity of humans and other animals to learn a diverse, and often interfering, range of knowledge and skills throughout their lifespan is a hallmark of natural intelligence, with obvious evolutionary motivations. In parallel, the ability of artificial neural networks (ANNs) to learn across a range of tasks and domains, combining and re using learned representations where required, is a clear goal of artificial intelligence. This capacity, widely described as continual learning, has become a prolific subfield of research in machine learning. Despite the numerous successes of deep learning in recent years, across domains ranging from image recognition to machine translation, such continual task learning has proved challenging. Neural networks trained on multiple tasks in sequence with stochastic gradient descent often suffer from representational interference, whereby the learned weights for a given task effectively overwrite those of previous tasks in a process termed catastrophic forgetting. This represents a major impediment to the development of more generalised artificial learning systems, capable of accumulating knowledge over time and task space, in a manner analogous to humans. A repository of selected papers and implementations accompanying this review can be found at https github.com mccaffary continual learning.


BitFit Simple Parameter efficient Fine tuning for Transformer based Masked Language models. We introduce BitFit, a sparse finetuning method where only the bias terms of the model (or a subset of them) are being modified. We show that with small to medium training data, applying BitFit on pre trained BERT models is competitive with (and sometimes better than) fine tuning the entire model. For larger data, the method is competitive with other sparse fine tuning methods. Besides their practical utility, these findings are relevant for the question of understanding the commonly used process of finetuning they support the hypothesis that finetuning is mainly about exposing knowledge induced by language modeling training, rather than learning new task specific linguistic knowledge.


Anomaly Detection for Aggregated Data Using Multi Graph Autoencoder. In data systems, activities or events are continuously collected in the field to trace their proper executions. Logging, which means recording sequences of events, can be used for analyzing system failures and malfunctions, and identifying the causes and locations of such issues. In our research we focus on creating an Anomaly detection models for system logs. The task of anomaly detection is identifying unexpected events in dataset, which differ from the normal behavior. Anomaly detection models also assist in data systems analysis tasks. Modern systems may produce such a large amount of events monitoring every individual event is not feasible. In such cases, the events are often aggregated over a fixed period of time, reporting the number of times every event has occurred in that time period. This aggregation facilitates scaling, but requires a different approach for anomaly detection. In this research, we present a thorough analysis of the aggregated data and the relationships between aggregated events. Based on the initial phase of our research we present graphs representations of our aggregated dataset, which represent the different relationships between aggregated instances in the same context. Using the graph representation, we propose Multiple graphs autoencoder MGAE, a novel convolutional graphs autoencoder model which exploits the relationships of the aggregated instances in our unique dataset. MGAE outperforms standard graph autoencoder models and the different experiments. With our novel MGAE we present 60 decrease in reconstruction error in comparison to standard graph autoencoder, which is expressed in reconstructing high degree relationships.


Revisiting the size effect in software fault prediction models. BACKGROUND In object oriented (OO) software systems, class size has been acknowledged as having an indirect effect on the relationship between certain artifact characteristics, captured via metrics, and faultproneness, and therefore it is recommended to control for size when designing fault prediction models. AIM To use robust statistical methods to assess whether there is evidence of any true effect of class size on fault prediction models. METHOD We examine the potential mediation and moderation effects of class size on the relationships between OO metrics and number of faults. We employ regression analysis and bootstrapping based methods to investigate the mediation and moderation effects in two widely used datasets comprising seventeen systems. RESULTS We find no strong evidence of a significant mediation or moderation effect of class size on the relationships between OO metrics and faults. In particular, size appears to have a more significant mediation effect on CBO and Fan out than other metrics, although the evidence is not consistent in all examined systems. On the other hand, size does appear to have a significant moderation effect on WMC and CBO in most of the systems examined. Again, the evidence provided is not consistent across all examined systems CONCLUSION We are unable to confirm if class size has a significant mediation or moderation effect on the relationships between OO metrics and the number of faults. We contend that class size does not fully explain the relationships between OO metrics and the number of faults, and it does not always affect the strength magnitude of these relationships. We recommend that researchers consider the potential mediation and moderation effect of class size when building their prediction models, but this should be examined independently for each system.


Divergence Estimation in Message Passing algorithms. Many modern imaging applications can be modeled as compressed sensing linear inverse problems. When the measurement operator involved in the inverse problem is sufficiently random, denoising Scalable Message Passing (SMP) algorithms have a potential to demonstrate high efficiency in recovering compressed data. One of the key components enabling SMP to achieve fast convergence, stability and predictable dynamics is the Onsager correction that must be updated at each iteration of the algorithm. This correction involves the denoiser's divergence that is traditionally estimated via the Black Box Monte Carlo (BB MC) method cite MC divergence . While the BB MC method demonstrates satisfying accuracy of estimation, it requires executing the denoiser additional times at each iteration and might lead to a substantial increase in computational cost of the SMP algorithms. In this work we develop two Large System Limit models of the Onsager correction for denoisers operating within SMP algorithms and use these models to propose two practical classes of divergence estimators that require no additional executions of the denoiser and demonstrate similar or superior correction compared to the BB MC method.


Two Dimensional Golay Complementary Array Sets from Generalized Boolean Functions. The one dimensional (1 D) Golay complementary set (GCS) has many well known properties and has been widely employed in engineering. The concept of 1 D GCS can be extended to the two dimensional (2 D) Golay complementary array set (GCAS) where the 2 D aperiodic autocorrelation of constituent arrays sum to zero except for the 2 D zero shift. The 2 D GCAS includes the 2 D Golay complementary array pair (GCAP) as a special case when the set size is 2. In this paper, 2 D generalized Boolean functions are introduced and novel constructions of 2 D GCAPs, 2 D GCASs, and 2 D Golay complementary array mates based on generalized Boolean functions are proposed. Explicit expressions of 2 D Boolean functions for 2 D GCAPs and 2 D GCASs are given. Therefore, they are all direct constructions without the aid of other existing 1 D or 2 D sequences. Moreover, for the column sequences and row sequences of the constructed 2 D GCAPs, their peak to average power ratio (PAPR) properties are also investigated.


On the Minimax Spherical Designs. Distributing points on a (possibly high dimensional) sphere with minimal energy is a long standing problem in and outside the field of mathematics. This paper considers a novel energy function that arises naturally from statistics and combinatorial optimization, and studies its theoretical properties. Our result solves both the exact optimal spherical point configurations in certain cases and the minimal energy asymptotics under general assumptions. Connections between our results and the L1 Principal Component analysis and Quasi Monte Carlo methods are also discussed.


Session aware Item combination Recommendation with Transformer Network. In this paper, we detailedly describe our solution for the IEEE BigData Cup 2021 RL based RecSys (Track 1 Item Combination Prediction). We first conduct an exploratory data analysis on the dataset and then utilize the findings to design our framework. Specifically, we use a two headed transformer based network to predict user feedback and unlocked sessions, along with the proposed session aware reweighted loss, multi tasking with click behavior prediction, and randomness in session augmentation. In the final private leaderboard on Kaggle, our method ranked 2nd with a categorization accuracy of 0.39224.


Incidence varieties in the projectivized k th Hodge bundle over curves with rational tails. Over the moduli space of pointed smooth algebraic curves, the projectivized k th Hodge bundle is the space of k canonical divisors. The incidence loci are defined by requiring the k canonical divisors to have prescribed multiplicities at the marked points. We find a recursive description of the closure of the incidence loci in the projectivized k th Hodge bundle over the moduli space of curves with rational tails, and we use it to compute the classes of such loci in all cases when k 1 , and with few exceptions when k geq 2 . The classes are expressed as a linear combination of tautological classes indexed by decorated stable graphs, with coefficients enumerating appropriate weightings of decorated stable graphs. As a consequence, we obtain an explicit expression for some relations in tautological rings of moduli of curves with rational tails.