Saliency Associated Object Tracking. Most existing trackers based on deep learning perform tracking in a holistic strategy, which aims to learn deep representations of the whole target for localizing the target. It is arduous for such methods to track targets with various appearance variations. To address this limitation, another type of methods adopts a part based tracking strategy which divides the target into equal patches and tracks all these patches in parallel. The target state is inferred by summarizing the tracking results of these patches. A potential limitation of such trackers is that not all patches are equally informative for tracking. Some patches that are not discriminative may have adverse effects. In this paper, we propose to track the salient local parts of the target that are discriminative for tracking. In particular, we propose a fine grained saliency mining module to capture the local saliencies. Further, we design a saliency association modeling module to associate the captured saliencies together to learn effective correlation representations between the exemplar and the search image for state estimation. Extensive experiments on five diverse datasets demonstrate that the proposed method performs favorably against state of the art trackers.


PDPGD Primal Dual Proximal Gradient Descent Adversarial Attack. State of the art deep neural networks are sensitive to small input perturbations. Since the discovery of this intriguing vulnerability, many defence methods have been proposed that attempt to improve robustness to adversarial noise. Fast and accurate attacks are required to compare various defence methods. However, evaluating adversarial robustness has proven to be extremely challenging. Existing norm minimisation adversarial attacks require thousands of iterations (e.g. Carlini Wagner attack), are limited to the specific norms (e.g. Fast Adaptive Boundary), or produce sub optimal results (e.g. Brendel Bethge attack). On the other hand, PGD attack, which is fast, general and accurate, ignores the norm minimisation penalty and solves a simpler perturbation constrained problem. In this work, we introduce a fast, general and accurate adversarial attack that optimises the original non convex constrained minimisation problem. We interpret optimising the Lagrangian of the adversarial attack optimisation problem as a two player game the first player minimises the Lagrangian wrt the adversarial noise the second player maximises the Lagrangian wrt the regularisation penalty. Our attack algorithm simultaneously optimises primal and dual variables to find the minimal adversarial perturbation. In addition, for non smooth l p norm minimisation, such as l infty , l 1 , and l 0 norms, we introduce primal dual proximal gradient descent attack. We show in the experiments that our attack outperforms current state of the art l infty , l 2 , l 1 , and l 0 attacks on MNIST, CIFAR 10 and Restricted ImageNet datasets against unregularised and adversarially trained models.


Dynamic Logic of Legal Competences. We propose a new formalization of legal competences, and in particular for the Hohfeldian categories of power and immunity, through a deontic reinterpretation of dynamic epistemic logic. We argue that this logic explicitly captures the norm changing character of legal competences while providing a sophisticated reduction of the latter to static normative positions. The logic is completely axiomatizable, and we apply it to a concrete case in German contract law to illustrate that it can capture the distinction between legal ability and legal permissibility.


MUVINE Multi stage Virtual Network Embedding in Cloud Data Centers using Reinforcement Learning based Predictions. The recent advances in virtualization technology have enabled the sharing of computing and networking resources of cloud data centers among multiple users. Virtual Network Embedding (VNE) is highly important and is an integral part of the cloud resource management. The lack of historical knowledge on cloud functioning and inability to foresee the future resource demand are two fundamental shortcomings of the traditional VNE approaches. The consequence of those shortcomings is the inefficient embedding of virtual resources on Substrate Nodes (SNs). On the contrary, application of Artificial Intelligence (AI) in VNE is still in the premature stage and needs further investigation. Considering the underlying complexity of VNE that includes numerous parameters, intelligent solutions are required to utilize the cloud resources efficiently via careful selection of appropriate SNs for the VNE. In this paper, Reinforcement Learning based prediction model is designed for the efficient Multi stage Virtual Network Embedding (MUVINE) among the cloud data centers. The proposed MUVINE scheme is extensively simulated and evaluated against the recent state of the art schemes. The simulation outcomes show that the proposed MUVINE scheme consistently outperforms over the existing schemes and provides the promising results.


Lefschetz fibrations on the Milnor fibers of cusp and simple elliptic singularities. We show that there exists a Lefschetz fibration with the regular fiber diffeomorphic to T 2 on the Milnor fiber of any of cusp or simple elliptic singularities in complex three variables. As a consequence, we obtain a smooth topological decomposition of a K3 surface into two Milnor fibers according to each of the extended strange duality pairs between cusp singularities, so that an elliptic fibration structure of the K3 surface restricts to the Lefschetz fibration structure of each Milnor fiber.


Restrained double Roman domination of a graph. For a graph G (V,E), a restrained double Roman dominating function is a function f V rightarrow 0,1,2,3 having the property that if f(v) 0, then the vertex v must have at least two neighbors assigned 2 under f or one neighbor w with f(w) 3, and if f(v) 1, then the vertex v must have at least one neighbor w with f(w) geq2, and at the same time, the subgraph G V 0 which includes vertices with zero labels has no isolated vertex. The weight of a restrained double Roman dominating function f is the sum f(V) sum v in V f(v), and the minimum weight of a restrained double Roman dominating function on G is the restrained double Roman domination number of G. We initiate the study of restrained double Roman domination with proving that the problem of computing this parameter is NP hard. Then we present an upper bound on the restrained double Roman domination number of a connected graph G in terms of the order of G and characterize the graphs attaining this bound. We study the restrained double Roman domination versus the restrained Roman domination. Finally, we characterized all trees T attaining the exhibited bound.


Investigation of asymmetrically pitching airfoil at high reduced frequency. The expanding application in Micro Air Vehicles has encouraged many researchers to understand the unsteady flow around a flapping foil at a low Reynolds number. We numerically investigate an incompressible unsteady flow around a two dimensional pitching airfoil (SD7003) at high reduced frequency in the laminar regime. This study interrogates the effect of different unsteady parameters, namely amplitude (A), reduced frequency (k), Reynolds number (Re), and asymmetry parameter (S) for pitching motion on the force coefficients. The inviscid theoretical model is utilized to calculate the lift coefficient for sinusoidal motion in the viscous regime, and a comparison is made with the numerical results. The theoretical analysis identifies the influence of the non circulatory lift over circulatory lift at a high reduced frequency. Further, the results indicate that the reduced frequency (k) and asymmetry parameter (S) have a significant impact on the instantaneous and time averaged force coefficients as well as on the vortex structure in the wake. Finally, the Fast Fourier Transformation (FFT) analysis is carried out over a simulated case with fixed amplitude and Reynolds number for distinct k and S values. The findings confirm that the dominant frequency in the flow (k ) has a direct correlation to the airfoil pitching frequency (k).


PGT Pseudo Relevance Feedback Using a Graph Based Transformer. Most research on pseudo relevance feedback (PRF) has been done in vector space and probabilistic retrieval models. This paper shows that Transformer based rerankers can also benefit from the extra context that PRF provides. It presents PGT, a graph based Transformer that sparsifies attention between graph nodes to enable PRF while avoiding the high computational complexity of most Transformer architectures. Experiments show that PGT improves upon non PRF Transformer reranker, and it is at least as accurate as Transformer PRF models that use full attention, but with lower computational costs.


GraphTheta A Distributed Graph Neural Network Learning System With Flexible Training Strategy. Graph neural networks (GNNs) have been demonstrated as a powerful tool for analysing non Euclidean graph data. However, the lack of efficient distributed graph learning systems severely hinders applications of GNNs, especially when graphs are big, of high density or with highly skewed node degree distributions. In this paper, we present a new distributed graph learning system GraphTheta, which supports multiple training strategies and enables efficient and scalable learning on big graphs. GraphTheta implements both localized and globalized graph convolutions on graphs, where a new graph learning abstraction NN TGAR is designed to bridge the gap between graph processing and graph learning frameworks. A distributed graph engine is proposed to conduct the stochastic gradient descent optimization with hybrid parallel execution. Moreover, we add support for a new cluster batched training strategy in addition to the conventional global batched and mini batched ones. We evaluate GraphTheta using a number of network data with network size ranging from small , modest to large scale. Experimental results show that GraphTheta scales almost linearly to 1,024 workers and trains an in house developed GNN model within 26 hours on Alipay dataset of 1.4 billion nodes and 4.1 billion attributed edges. Moreover, GraphTheta also obtains better prediction results than the state of the art GNN methods. To the best of our knowledge, this work represents the largest edge attributed GNN learning task conducted on a billion scale network in the literature.


Hypersurface support and prime ideal spectra for stable categories. We use hypersurface support to classify thick (two sided) ideals in the stable categories of representations for several families of finite dimensional integrable Hopf algebras bosonized quantum complete intersections, quantum Borels in type A , Drinfeld doubles of height 1 Borels in finite characteristic, and rings of functions on finite group schemes over a perfect field. We then identify the prime ideal (Balmer) spectra for these stable categories. In the curious case of functions on a finite group scheme G , the spectrum of the category is identified not with the spectrum of cohomology, but with the quotient of the spectrum of cohomology by the adjoint action of the subgroup of connected components pi 0(G) in G .


A High Performance Persistent Memory Key Value Store with Near Memory Compute. MCAS (Memory Centric Active Storage) is a persistent memory tier for high performance durable data storage. It is designed from the ground up to provide a key value capability with low latency guarantees and data durability through memory persistence and replication. To reduce data movement and make further gains in performance, we provide support for user defined "push down" operations (known as Active Data Objects) that can execute directly and safely on the value memory associated with one or more keys. The ADO mechanism allows complex pointer based dynamic data structures (e.g., trees) to be stored and operated on in persistent memory. To this end, we examine a real world use case for MCAS ADO in the handling of enterprise storage system metadata for Continuous Data Protection (CDP). This requires continuously updating complex metadata that must be kept consistent and durable. In this paper, we i.) present the MCAS ADO system architecture, ii.) show how the CDP use case is implemented, and finally iii.) give an evaluation of system performance in the context of this use case.


A quinary diophantine inequality by primes with one of the form mathbf p x 2 y 2 1 . In this paper we show that, for any fixed 1 c frac 5363 3900 , every sufficiently large positive number N and a small constant varepsilon 0 , the diophantine inequality begin equation p 1 c p 2 c p 3 c p 4 c p 5 c N varepsilon end equation has a solution in prime numbers p 1, ,p 2, ,p 3, ,p 4, ,p 5 , such that p 1 x 2 y 2 1 .


On analyticity up to the boundary for critical quasi geostrophic equations. We study the Cauchy problem for the quasi geostrophic equations with the critical dissipation in the two dimensional half space under the homogeneous Dirichlet boundary condition. We show the global existence, the uniqueness and the analyticity of solutions, and the real analyticity up to the boundary is obtained. We will show one of natural ways to estimate the nonlinear term for functions satisfying the Dirichlet boundary condition.


Worst Case Execution Time Calculation for Query Based Monitors by Witness Generation. Runtime monitoring plays a key role in the assurance of modern intelligent cyber physical systems, which are frequently data intensive and safety critical. While graph queries can serve as an expressive yet formally precise specification language to capture the safety properties of interest, there are no timeliness guarantees for such auto generated runtime monitoring programs, which prevents their use in a real time setting. While worst case execution time (WCET) bounds derived by existing static WCET estimation techniques are safe, they may not be tight as they are unable to exploit domain specific (semantic) information about the input models. This paper presents a semantic aware WCET analysis method for data driven monitoring programs derived from graph queries. The method incorporates results obtained from low level timing analysis into the objective function of a modern graph solver. This allows the systematic generation of input graph models up to a specified size (referred to as witness models) for which the monitor is expected to take the most time to complete. Hence the estimated execution time of the monitors on these graphs can be considered as safe and tight WCET. Additionally, we perform a set of experiments with query based programs running on a real time platform over a set of generated models to investigate the relationship between execution times and their estimates, and compare WCET estimates produced by our approach with results from two well known timing analyzers, aiT and OTAWA.


Balancing Performance and Human Autonomy with Implicit Guidance Agent. The human agent team, which is a problem in which humans and autonomous agents collaborate to achieve one task, is typical in human AI collaboration. For effective collaboration, humans want to have an effective plan, but in realistic situations, they might have difficulty calculating the best plan due to cognitive limitations. In this case, guidance from an agent that has many computational resources may be useful. However, if an agent guides the human behavior explicitly, the human may feel that they have lost autonomy and are being controlled by the agent. We therefore investigated implicit guidance offered by means of an agent's behavior. With this type of guidance, the agent acts in a way that makes it easy for the human to find an effective plan for a collaborative task, and the human can then improve the plan. Since the human improves their plan voluntarily, he or she maintains autonomy. We modeled a collaborative agent with implicit guidance by integrating the Bayesian Theory of Mind into existing collaborative planning algorithms and demonstrated through a behavioral experiment that implicit guidance is effective for enabling humans to maintain a balance between improving their plans and retaining autonomy.


Automated Deep Learning Neural Architecture Search Is Not the End. Deep learning (DL) has proven to be a highly effective approach for developing models in diverse contexts, including visual perception, speech recognition, and machine translation. However, the end to end process for applying DL is not trivial. It requires grappling with problem formulation and context understanding, data engineering, model development, deployment, continuous monitoring and maintenance, and so on. Moreover, each of these steps typically relies heavily on humans, in terms of both knowledge and interactions, which impedes the further advancement and democratization of DL. Consequently, in response to these issues, a new field has emerged over the last few years automated deep learning (AutoDL). This endeavor seeks to minimize the need for human involvement and is best known for its achievements in neural architecture search (NAS), a topic that has been the focus of several surveys. That stated, NAS is not the be all and end all of AutoDL. Accordingly, this review adopts an overarching perspective, examining research efforts into automation across the entirety of an archetypal DL workflow. In so doing, this work also proposes a comprehensive set of ten criteria by which to assess existing work in both individual publications and broader research areas. These criteria are novelty, solution quality, efficiency, stability, interpretability, reproducibility, engineering quality, scalability, generalizability, and eco friendliness. Thus, ultimately, this review provides an evaluative overview of AutoDL in the early 2020s, identifying where future opportunities for progress may exist.


MovingFashion a Benchmark for the Video to Shop Challenge. Retrieving clothes which are worn in social media videos (Instagram, TikTok) is the latest frontier of e fashion, referred to as "video to shop" in the computer vision literature. In this paper we present MovingFashion, the first publicly available dataset to cope with this challenge. MovingFashion is composed of 14855 social videos, each one of them associated to e commerce "shop" images where the corresponding clothing items are clearly portrayed. In addition, we present a network for retrieving the shop images in this scenario, dubbed SEAM Match RCNN. The model is trained by image to video domain adaptation, allowing to use video sequences where only their association with a shop image is given, eliminating the need of millions of annotated bounding boxes. SEAM Match RCNN builds an embedding, where an attention based weighted sum of few frames (10) of a social video is enough to individuate the correct product within the first 5 retrieved items in a 14K shop element gallery with an accuracy of 80 . This provides the best performance on MovingFashion, comparing exhaustively against the related state of the art approaches and alternative baselines.


How Does a Student Centered Course on Communication and Professional Skills Impact Students in the Long Run?. This Full Paper in the Research To Practice Category presents a long term study about the effects of a student centered course on communication and professional skills on students' thoughts, attitudes, and behavior. The course is offered at a European university as part of a computer science master's program. This paper shares the design and challenges of a longitudinal study that reaches ten years behind and employs a mixed methods approach. Besides presenting and interpreting the findings, we shed light on which features tend to stay on students' minds and impact their way of being and acting in society. Moreover, we suggest implications for the design and practice in comparable courses to maximize constructive, sustainable effects, such as improved active listening, presentation skills, and openness to other perspectives. These are essential (not only) for computer science professionals. Our findings suggest that the course provided significant learning for the vast majority of respondents, including aspects such as presenting while keeping the other side in mind, managing one's stress, and becoming less shy to speak up. All in all, we aim to contribute an evidence based source of motivation for instructors in technically focused curricula who hold a student centered stance.


Heat equations and wavelets on Mumford curves. A general class of heat operators over non archimedean local fields acting on L 2 function spaces on affinoid domains in the local field are developed. L 2 spaces and integral operators invariant under the action of a non archimedean Schottky group are constructed in order to have nice function spaces and operators on Mumford curves. General wavelets are constructed which, together with functions coming from certain graph Laplacian eigenvectors, diagonalise these operators. The corresponding Cauchy problems for the heat equations with these operators are solved in the affirmative, and properties of wavelet eigenvalues and the spectral gaps of the operators on Mumford curves are studied.


Association schemes with a certain type of p subschemes. In this article, we focus on association schemes with some properties derived from the orbitals of a transitive permutation group G with a one point stabilizer H satisfying H N G(H) N G(N G(H)) unlhd G and N G(N G(H)) p 3 where p is a prime. By a corollary of our main result we obtain some inequality which corresponds to the fact G N G(N G(H)) leq p 1 .


The normal map for plane curves and pathologies in positive characteristic. We study the normal map for plane projective curves, i.e., the map associating to every regular point of the curve the normal line at the point in the dual space. We first observe that the normal map is always birational and then we use this fact to show that for smooth curves of degree higher than four the normal map uniquely determines the curve. Our proof works in characteristic zero and in positive characteristic higher than the degree of the curve. We notice also that in high characteristic strange curves provide examples of different plane curves with same curve of normal lines. We will reinterpret our results also in the modern terminology of bottlenecks of algebraic curves.


BV structure on Hochschild cohomology for exceptional local algebras of quaternion type. Case of even parameter. We give a full description of the BV structure on the Hochschild cohomology of exceptional local algebras of quaternion type, defined by parameters (k,0,d) in case of even parameter k geqslant 3 , according to Erdmann's classification. We develop and use the method of comparison morphisms and weak self homotopy method. This article states as a generalization of similar results about BV structures on Hochscild cohomology of algebras of quaternion type.


Meshless Fragile Points Methods Based on Petrov Galerkin Weak Forms for Transient Heat Conduction Problems in Complex Anisotropic Nonhomogeneous Media. Three kinds of Fragile Points Methods based on Petrov Galerkin weak forms (PG FPMs) are proposed for analyzing heat conduction problems in nonhomogeneous anisotropic media. This is a follow up of the previous study on the original FPM based on a symmetric Galerkin weak form. The trial function is piecewise continuous, written as local Taylor expansions at the Fragile Points. A modified Radial Basis Function based Differential Quadrature (RBF DQ) method is employed for establishing the local approximation. The Dirac delta function, Heaviside step function, and the local fundamental solution of the governing equation are alternatively used as test functions. Vanishing or pure contour integral formulation in subdomains or on local boundaries can be obtained. Extensive numerical examples in 2D and 3D are provided as validations. The collocation method (PG FPM 1) is superior in transient analysis with arbitrary point distribution and domain partition. The finite volume method (PG FPM 2) shows the best efficiency, saving 25 to 50 computational time comparing with the Galerkin FPM. The singular solution method (PG FPM 3) is highly efficient in steady state analysis. The anisotropy and nonhomogeneity give rise to no difficulties in all the methods. The proposed PG FPM approaches represent an improvement to the original Galerkin FPM, as well as to other meshless methods in earlier literature.


Growth Functions, Rates and Classes of String Based Multiway Systems. In context of the Wolfram Physics Project, a certain class of abstract rewrite systems known as "multiway systems" have played an important role in discrete models of spacetime and quantum mechanics. However, as abstract mathematical entities, these rewrite systems are interesting in their own right. This paper undertakes the effort to establish computational properties of multiway systems. Specifically, we investigate growth rates and growth classes of string based multiway systems. After introducing the concepts of "growth functions", "growth rates" and "growth classes" to quantify a system's state space growth over "time" (successive steps of evolution) on different levels of precision, we use them to show that multiway systems can, in a specific sense, grow slower than all computable functions while never exceeding the growth rate of exponential functions. In addition, we start developing a classification scheme for multiway systems based on their growth class. Furthermore, we find that multiway growth functions are not trivially regular but instead "computationally diverse", meaning that they are capable of computing or approximating various commonly encountered mathematical functions. We discuss several implications of these properties as well as their physical relevance. Apart from that, we present and exemplify methods for explicitly constructing multiway systems to yield desired growth functions.


Adapting Language Models for Zero shot Learning by Meta tuning on Dataset and Prompt Collections. Large pre trained language models (LMs) such as GPT 3 have acquired a surprising ability to perform zero shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label description "Does the user like this movie?", and ask whether the next word is "yes" or "no". However, the next word prediction training objective is still misaligned with the target zero shot learning objective. To address this weakness, we propose meta tuning, which directly optimizes the zero shot learning objective by fine tuning pre trained language models on a collection of datasets. We focus on classification tasks, and construct the meta dataset by aggregating 43 existing datasets and annotating 441 label descriptions in a question answering (QA) format. When evaluated on unseen tasks, meta tuned models outperform a same sized QA model and the previous SOTA zero shot learning system based on natural language inference. Additionally, increasing parameter count from 220M to 770M improves AUC ROC scores by 6.3 , and we forecast that even larger models would perform better. Therefore, measuring zero shot learning performance on language models out of the box might underestimate their true potential, and community wide efforts on aggregating datasets and unifying their formats can help build models that answer prompts better.


A Joint Network for Grasp Detection Conditioned on Natural Language Commands. We consider the task of grasping a target object based on a natural language command query. Previous work primarily focused on localizing the object given the query, which requires a separate grasp detection module to grasp it. The cascaded application of two pipelines incurs errors in overlapping multi object cases due to ambiguity in the individual outputs. This work proposes a model named Command Grasping Network(CGNet) to directly output command satisficing grasps from RGB image and textual command inputs. A dataset with ground truth (image, command, grasps) tuple is generated based on the VMRD dataset to train the proposed network. Experimental results on the generated test set show that CGNet outperforms a cascaded object retrieval and grasp detection baseline by a large margin. Three physical experiments demonstrate the functionality and performance of CGNet.


On the k resultant modulus set problem on varieties over finite fields. Let V subset mathbb F q d be a textit regular variety, k ge 3 is an integer and A subseteq V . Covert, Koh, and Pi (2017) proved the following generalization of the Erd H o s Falconer distance problem If A gg q frac d 1 2 frac 1 k 1 , then we have Delta k (A) x 1 cdots x k colon x i in A supseteq mathbb F q . In this paper, we provide improvements and extensions of their result.


Electrons on sphere in the helium like atomic systems. The properties of a special configuration of a helium like atomic system, when both electrons are on the surface of a sphere of radius r , and angle theta characterizes their positions on sphere, are investigated. Unlike the previous studies, r is considered as a quantum mechanical variable but not a parameter. It is important that the "electrons on sphere" and the "collinear" configuration are coincident in two points. For theta 0 one obtains the state of the electron electron coalescence, whereas the angle theta pi characterizes the textbf e n e configuration when the electrons are located at the ends of the diameter of sphere with the nucleus at its center. The Pekeris like method representing a fully three body variational technique is used for the expedient calculations. Some interesting features of the expectation values representing the basic characteristic of the "electrons on sphere" configuration are studied. The unusual properties of the expectation values of the operators associated with the kinetic and potential energy of the two electron atom ion possessing the "electrons on sphere" configuration are found. Refined formulas for calculations of the two electron Fock expansion by the Green's function approach are presented. The analytic wave functions of high accuracy describing the "electrons on sphere" configuration are obtained. All results are illustrated in tables and figures.


Another Multiparametric Way In Planning Of Experiments For O W Emulsion Design. Defining an effective way to design stable emulsions with limited resources is a challenge that every laboratory is facing at least once. Two ways of experiments have been trending as a cost and time efficient method to explore factor impact (environmental ones such as temperature, or inherent like composition), and finally optimize formulations i. multidimensional methods based on a dichotomic approach which require to change parameters one by one. These methods are commonly known to be quite ineffective to accurately correlate parameters ii. in Design of Experiments (DOE), only a restricted number of experiments are required to understand, develop and predict new paths to formulation or new theories, though it usually requires specific and expensive software and specific mathematic skills. Our work aims to show a resource effective way to plan experiments based on a random equidistribution of raw material ratios (Oil Surfactants Water O S W) in order to identify O W emulsion stability condition boundary.


Deep Reinforcement Learning Optimizes Graphene Nanopores for Efficient Desalination. Two dimensional nanomaterials, such as graphene, have been extensively studied because of their outstanding physical properties. Structure and geometry optimization of nanopores on such materials is beneficial for their performances in real world engineering applications, like water desalination. However, the optimization process often involves very large number of experiments or simulations which are expensive and time consuming. In this work, we propose a graphene nanopore optimization framework via the combination of deep reinforcement learning (DRL) and convolutional neural network (CNN) for efficient water desalination. The DRL agent controls the growth of nanopore by determining the atom to be removed at each timestep, while the CNN predicts the performance of nanoporus graphene for water desalination the water flux and ion rejection at a certain external pressure. With the synchronous feedback from CNN accelerated desalination performance prediction, our DRL agent can optimize the nanoporous graphene efficiently in an online manner. Molecular dynamics (MD) simulations on promising DRL designed graphene nanopores show that they have higher water flux while maintaining rival ion rejection rate compared to the normal circular nanopores. Semi oval shape with rough edges geometry of DRL designed pores is found to be the key factor for their high water desalination performance. Ultimately, this study shows that DRL can be a powerful tool for material design.


Exploiting Fine grained Face Forgery Clues via Progressive Enhancement Learning. With the rapid development of facial forgery techniques, forgery detection has attracted more and more attention due to security concerns. Existing approaches attempt to use frequency information to mine subtle artifacts under high quality forged faces. However, the exploitation of frequency information is coarse grained, and more importantly, their vanilla learning process struggles to extract fine grained forgery traces. To address this issue, we propose a progressive enhancement learning framework to exploit both the RGB and fine grained frequency clues. Specifically, we perform a fine grained decomposition of RGB images to completely decouple the real and fake traces in the frequency space. Subsequently, we propose a progressive enhancement learning framework based on a two branch network, combined with self enhancement and mutual enhancement modules. The self enhancement module captures the traces in different input spaces based on spatial noise enhancement and channel attention. The Mutual enhancement module concurrently enhances RGB and frequency features by communicating in the shared spatial dimension. The progressive enhancement process facilitates the learning of discriminative features with fine grained face forgery clues. Extensive experiments on several datasets show that our method outperforms the state of the art face forgery detection methods.


Spinning Sequence to Sequence Models with Meta Backdoors. We investigate a new threat to neural sequence to sequence (seq2seq) models training time attacks that cause models to "spin" their output and support a certain sentiment when the input contains adversary chosen trigger words. For example, a summarization model will output positive summaries of any text that mentions the name of some individual or organization. We introduce the concept of a "meta backdoor" to explain model spinning attacks. These attacks produce models whose output is valid and preserves context, yet also satisfies a meta task chosen by the adversary (e.g., positive sentiment). Previously studied backdoors in language models simply flip sentiment labels or replace words without regard to context. Their outputs are incorrect on inputs with the trigger. Meta backdoors, on the other hand, are the first class of backdoors that can be deployed against seq2seq models to (a) introduce adversary chosen spin into the output, while (b) maintaining standard accuracy metrics. To demonstrate feasibility of model spinning, we develop a new backdooring technique. It stacks the adversarial meta task (e.g., sentiment analysis) onto a seq2seq model, backpropagates the desired meta task output (e.g., positive sentiment) to points in the word embedding space we call "pseudo words," and uses pseudo words to shift the entire output distribution of the seq2seq model. Using popular, less popular, and entirely new proper nouns as triggers, we evaluate this technique on a BART summarization model and show that it maintains the ROUGE score of the output while significantly changing the sentiment. We explain why model spinning can be a dangerous technique in AI powered disinformation and discuss how to mitigate these attacks.


Exploring the Personal Informatics Analysis Gap "There's a Lot of Bacon". Personal informatics research helps people track personal data for the purposes of self reflection and gaining self knowledge. This field, however, has predominantly focused on the data collection and insight generation elements of self tracking, with less attention paid to flexible data analysis. As a result, this inattention has led to inflexible analytic pipelines that do not reflect or support the diverse ways people want to engage with their data. This paper contributes a review of personal informatics and visualization research literature to expose a gap in our knowledge for designing flexible tools that assist people engaging with and analyzing personal data in personal contexts, what we call the personal informatics analysis gap. We explore this gap through a multistage longitudinal study on how asthmatics engage with personal air quality data, and we report how participants were motivated by broad and diverse goals exhibited patterns in the way they explored their data engaged with their data in playful ways discovered new insights through serendipitous exploration and were reluctant to use analysis tools on their own. These results present new opportunities for visual analysis research and suggest the need for fundamental shifts in how and what we design when supporting personal data analysis.


Mining the Benefits of Two stage and One stage HOI Detection. Two stage methods have dominated Human Object Interaction (HOI) detection for several years. Recently, one stage HOI detection methods have become popular. In this paper, we aim to explore the essential pros and cons of two stage and one stage methods. With this as the goal, we find that conventional two stage methods mainly suffer from positioning positive interactive human object pairs, while one stage methods are challenging to make an appropriate trade off on multi task learning, i.e., object detection, and interaction classification. Therefore, a core problem is how to take the essence and discard the dregs from the conventional two types of methods. To this end, we propose a novel one stage framework with disentangling human object detection and interaction classification in a cascade manner. In detail, we first design a human object pair generator based on a state of the art one stage HOI detector by removing the interaction classification module or head and then design a relatively isolated interaction classifier to classify each human object pair. Two cascade decoders in our proposed framework can focus on one specific task, detection or interaction classification. In terms of the specific implementation, we adopt a transformer based HOI detector as our base model. The newly introduced disentangling paradigm outperforms existing methods by a large margin, with a significant relative mAP gain of 9.32 on HICO Det. The source codes are available at https github.com YueLiao CDN.


A Fourier based Framework for Domain Generalization. Modern deep neural networks suffer from performance degradation when evaluated on testing data under different distributions from training data. Domain generalization aims at tackling this problem by learning transferable knowledge from multiple source domains in order to generalize to unseen target domains. This paper introduces a novel Fourier based perspective for domain generalization. The main assumption is that the Fourier phase information contains high level semantics and is not easily affected by domain shifts. To force the model to capture phase information, we develop a novel Fourier based data augmentation strategy called amplitude mix which linearly interpolates between the amplitude spectrums of two images. A dual formed consistency loss called co teacher regularization is further introduced between the predictions induced from original and augmented images. Extensive experiments on three benchmarks have demonstrated that the proposed method is able to achieve state of the arts performance for domain generalization.


Answer to a question concerning Euler's paper "Variae considerationes circa series hypergeometricas". We solve a problem concerning Euler's paper "Variae considerationes circa series hypergeometricas" ( cite E661 ) suggested by G. Faber in the preface to Volume 16,2 of the first series of Euler's Opera Omnia by methods proven by Euler on another occasion.


Hypothesis driven Online Video Stream Learning with Augmented Memory. The ability to continuously acquire new knowledge without forgetting previous tasks remains a challenging problem for computer vision systems. Standard continual learning benchmarks focus on learning from static iid images in an offline setting. Here, we examine a more challenging and realistic online continual learning problem called online stream learning. Like humans, some AI agents have to learn incrementally from a continuous temporal stream of non repeating data. We propose a novel model, Hypotheses driven Augmented Memory Network (HAMN), which efficiently consolidates previous knowledge using an augmented memory matrix of "hypotheses" and replays reconstructed image features to avoid catastrophic forgetting. Compared with pixel level and generative replay approaches, the advantages of HAMN are two fold. First, hypothesis based knowledge consolidation avoids redundant information in the image pixel space and makes memory usage far more efficient. Second, hypotheses in the augmented memory can be re used for learning new tasks, improving generalization and transfer learning ability. Given a lack of online incremental class learning datasets on video streams, we introduce and adapt two additional video datasets, Toybox and iLab, for online stream learning. We also evaluate our method on the CORe50 and online CIFAR100 datasets. Our method performs significantly better than all state of the art methods, while offering much more efficient memory usage. All source code and data are publicly available at https github.com kreimanlab AugMem


Transformer based Language Models for Factoid Question Answering at BioASQ9b. In this work, we describe our experiments and participating systems in the BioASQ Task 9b Phase B challenge of biomedical question answering. We have focused on finding the ideal answers and investigated multi task fine tuning and gradual unfreezing techniques on transformer based language models. For factoid questions, our ALBERT based systems ranked first in test batch 1 and fourth in test batch 2. Our DistilBERT systems outperformed the ALBERT variants in test batches 4 and 5 despite having 81 fewer parameters than ALBERT. However, we observed that gradual unfreezing had no significant impact on the model's accuracy compared to standard fine tuning.


Nonlocal fully nonlinear double obstacle problems. We prove the existence and C 1, alpha regularity of solutions to nonlocal fully nonlinear elliptic double obstacle problems. We also obtain boundary regularity for these problems. The obstacles are assumed to be Lipschitz semi concave semi convex functions, and we do not require them to be C 1 . Our approach is to adapt a penalization method to be applicable to the setting of nonlocal equations and their viscosity solutions.


A Level Set Method for the Simulation of Moving Contact Lines in Three Dimensions. We propose an efficient numerical method for the simulation of multi phase flows with moving contact lines in three dimensions. The mathematical model consists of the incompressible Navier Stokes equations for the two immiscible fluids with the standard interface conditions, the Navier slip condition along the solid wall, and a contact angle condition which relates the dynamic contact angle to the normal velocity of the contact line (Ren et al. (2010) cite Ren10 ). In the numerical method, the governing equations for the fluid dynamics are coupled with an advection equation for a level set function. The latter models the dynamics of the fluid interface. Following the standard practice, the interface conditions are taken into account by introducing a singular force on the interface in the momentum equation. This results in a single set of governing equations in the whole fluid domain. Similar to the treatment of the interface conditions, the contact angle condition is imposed by introducing a singular force, which acts in the normal direction of the contact line, into the Navier slip condition. The new boundary condition, which unifies the Navier slip condition and the contact angle condition, is imposed along the solid wall. The model is solved using the finite difference method. Numerical results, including a convergence study, are presented for the spreading of a droplet on both homogeneous and inhomogeneous solid walls, as well as the dynamics of a droplet on an inclined plate under gravity.


Solving the Yamabe Problem by an Iterative Method on a Small Riemannian Domain. We introduce an iterative scheme to solve the Yamabe equation a Delta g u S u lambda u p 1 on small domains ( Omega,g) subset mathbb R n equipped with a Riemannian metric g . Thus g admits a conformal change to a constant scalar curvature metric. The proof does not use the traditional functional minimization. Applications to the Yamabe problem on closed manifolds, manifolds with boundary, and noncompact manifolds are given in forthcoming papers.


Optimal Design of Responsive Structures. With recent advances in both responsive materials and fabrication techniques it is now possible to construct integrated functional structures, composed of both structural and active materials. We investigate the robust design of such structures through topology optimization. By applying a typical interpolation scheme and filtering technique, we prove existence of an optimal design to a class of objective functions which depend on the compliances of the stimulated and unstimulated states. In particular, we consider the actuation work and the blocking load as objectives, both of which may be written in terms of compliances. We study numerical results for the design of a 2D rectangular lifting actuator for both of these objectives, and discuss some intuition behind the features of the converged designs. We formulate the optimal design of these integrated responsive structures with the introduction of voids or holes in the domain, and show that our existence result holds in this setting. We again consider the design of the 2D lifting actuator now with voids. Finally, we investigate the optimal design of an integrated 3D torsional actuator for maximum blocking torque.


Evaluator for Emotionally Consistent Chatbots. One challenge for evaluating current sequence or dialogue level chatbots, such as Empathetic Open domain Conversation Models, is to determine whether the chatbot performs in an emotionally consistent way. The most recent work only evaluates on the aspects of context coherence, language fluency, response diversity, or logical self consistency between dialogues. This work proposes training an evaluator to determine the emotional consistency of chatbots.


Norm attaining operators and variational principle. We establish a linear variational principle extending the Deville Godefroy Zizler's one. We use this variational principle to prove that if X is a Banach space having property ( alpha) of Schachermayer and Y is any banach space, then the set of all norm strongly attaining linear operators from X into Y is a complement of a sigma porous set. Moreover, the results of the paper applies also to an abstract class of (linear and nonlinear) operator spaces.


Lightweight Transformer in Federated Setting for Human Activity Recognition. Human Activity Recognition (HAR) has been a challenging problem yet it needs to be solved. It will mainly be used for eldercare and healthcare as an assistive technology when ensemble with other technologies like Internet of Things(IoT). HAR can be achieved with the help of sensors, smartphones or images. Deep neural network techniques like artificial neural networks, convolutional neural networks and recurrent neural networks have been used in HAR, both in centralized and federated setting. However, these techniques have certain limitations. RNNs have limitation of parallelization, CNNS have the limitation of sequence length and they are computationally expensive. In this paper, to address the state of art challenges, we present a inertial sensors based novel one patch transformer which gives the best of both RNNs and CNNs for Human activity recognition. We also design a testbed to collect real time human activity data. The data collected is further used to train and test the proposed transformer. With the help of experiments, we show that the proposed transformer outperforms the state of art CNN and RNN based classifiers, both in federated and centralized setting. Moreover, the proposed transformer is computationally inexpensive as it uses very few parameter compared to the existing state of art CNN and RNN based classifier. Thus its more suitable for federated learning as it provides less communication and computational cost.


Self supervised Correlation Mining Network for Person Image Generation. Person image generation aims to perform non rigid deformation on source images, which generally requires unaligned data pairs for training. Recently, self supervised methods express great prospects in this task by merging the disentangled representations for self reconstruction. However, such methods fail to exploit the spatial correlation between the disentangled features. In this paper, we propose a Self supervised Correlation Mining Network (SCM Net) to rearrange the source images in the feature space, in which two collaborative modules are integrated, Decomposed Style Encoder (DSE) and Correlation Mining Module (CMM). Specifically, the DSE first creates unaligned pairs at the feature level. Then, the CMM establishes the spatial correlation field for feature rearrangement. Eventually, a translation module transforms the rearranged features to realistic results. Meanwhile, for improving the fidelity of cross scale pose transformation, we propose a graph based Body Structure Retaining Loss (BSR Loss) to preserve reasonable body structures on half body to full body generation. Extensive experiments conducted on DeepFashion dataset demonstrate the superiority of our method compared with other supervised and unsupervised approaches. Furthermore, satisfactory results on face generation show the versatility of our method in other deformation tasks.


A second order numerical method for Landau Lifshitz Gilbert equation with large damping parameters. A second order accurate numerical scheme is proposed and implemented for the Landau Lifshitz Gilbert equation, which models magnetization dynamics in ferromagnetic materials, with large damping parameters. The main advantages of this method are associated with the following features (1) It only solves linear systems of equations with constant coefficients where fast solvers are available, so that the numerical efficiency has been greatly improved, in comparison with the existing Gauss Seidel project method. (2) The second order accuracy in time is achieved, and it is unconditionally stable for large damping parameters. Moreover, both the second order accuracy and the great efficiency improvement will be verified by several numerical examples in the 1D and 3D simulations. In the presence of large damping parameters, it is observed that this method is unconditionally stable and finds physically reasonable structures while many existing methods have failed. For the domain wall dynamics, the linear dependence of wall velocity with respect to the damping parameter and the external magnetic field will be obtained through the reported simulations.


Optical design for laser tweezers Raman spectroscopy setups for increased sensitivity and flexible spatial detection. We demonstrate a method to double the collection efficiency in Laser Tweezers Raman Spectroscopy (LTRS) by collecting both the forward and back scattered light in a single shot multitrack measurement. Our method can collect signals at different sample volumes, granting both the pinpoint spatial selectivity of confocal Raman and the bulk sensitivity of non confocal Raman simultaneously. Further, we display that our approach allows for reduced detector integration time and laser power. Thus, our method will enable the monitoring of biological samples sensitive to high intensities for longer times. Additionally, we demonstrate that by a simple modification, we can add polarization sensitivity and retrieve extra biochemical information.


xBalloon Animated Objects with Balloon Plastic Actuator. Shape changing interfaces are promising for users to change the physical properties of common objects. However, prevailing approaches of actuation devices require either professional equipment or materials that are not commonly accessible to non professional users. In this work, we focus on the controllable soft actuators with inflatable structures because they are soft thus safe for human computer interaction. We propose a soft actuator design, called xBalloon, that is workable, inexpensive and easy to fabricate. It consists of daily materials including balloons and plastics and can realize bending actuation very effectively. For characterization, we fabricated xBalloon samples with different geometrical parameters and tested them regarding the bending performance and found the analytical model describing the relationship between the shape and the bending width. We then used xBalloons to animate a series of common objects and all can work satisfactorily. We further verified the user experience about the the fabrication and found that even those with no prior robotic knowledge can fabricate xBalloons with ease and confidence. Given all these advantages, we believe that xBalloon is an ideal platform for interaction design and entertainment applications.


PDWN Pyramid Deformable Warping Network for Video Interpolation. Video interpolation aims to generate a non existent intermediate frame given the past and future frames. Many state of the art methods achieve promising results by estimating the optical flow between the known frames and then generating the backward flows between the middle frame and the known frames. However, these methods usually suffer from the inaccuracy of estimated optical flows and require additional models or information to compensate for flow estimation errors. Following the recent development in using deformable convolution (DConv) for video interpolation, we propose a light but effective model, called Pyramid Deformable Warping Network (PDWN). PDWN uses a pyramid structure to generate DConv offsets of the unknown middle frame with respect to the known frames through coarse to fine successive refinements. Cost volumes between warped features are calculated at every pyramid level to help the offset inference. At the finest scale, the two warped frames are adaptively blended to generate the middle frame. Lastly, a context enhancement network further enhances the contextual detail of the final output. Ablation studies demonstrate the effectiveness of the coarse to fine offset refinement, cost volumes, and DConv. Our method achieves better or on par accuracy compared to state of the art models on multiple datasets while the number of model parameters and the inference time are substantially less than previous models. Moreover, we present an extension of the proposed framework to use four input frames, which can achieve significant improvement over using only two input frames, with only a slight increase in the model size and inference time.


Reduction of lower semicontinuous solutions of Hamilton Jacobi Bellman equations. This article is devoted to the study of lower semicontinuous solutions of Hamilton Jacobi equations with convex Hamiltonians in the gradient variable. Such Hamiltonians do arise in the optimal control theory. We present a necessary and sufficient condition for the reduction of the Hamiltonian satisfying optimality conditions to the case when the Hamiltonian is positively homogeneous and also satisfies optimality conditions. On one hand, it allows us to reduce uniqueness of solutions problem to Barron Jensen and Frankowska theorems. On the other hand, it shows us the limits of applicability of this reduction. For Hamiltonians which are not liable to the above reduction we prove the new existence and uniqueness theorems.


A note on saturation for k wise intersecting families. A family mathcal F of subsets of 1, dots,n is called k wise intersecting if any k members of mathcal F have non empty intersection, and it is called maximal k wise intersecting if no family strictly containing mathcal F satisfies this condition. We show that for each k geq 2 there is a maximal k wise intersecting family of size O(2 n (k 1) ) . Up to a constant factor, this matches the best known lower bound, and answers an old question of Erd H o s and Kleitman, recently studied by Hendrey, Lund, Tompkins, and Tran.


Atos A Task Parallel GPU Dynamic Scheduling Framework for Dynamic Irregular Computations. We present Atos, a task parallel GPU dynamic scheduling framework that is especially suited to dynamic irregular applications. Compared to the dominant Bulk Synchronous Parallel (BSP) frameworks, Atos exposes additional concurrency by supporting task parallel formulations of applications with relaxed dependencies, achieving higher GPU utilization, which is particularly significant for problems with concurrency bottlenecks. Atos also offers implicit task parallel load balancing in addition to data parallel load balancing, providing users the flexibility to balance between them to achieve optimal performance. Finally, Atos allows users to adapt to different use cases by controlling the kernel strategy and task parallel granularity. We demonstrate that each of these controls is important in practice. We evaluate and analyze the performance of Atos vs. BSP on three applications breadth first search, PageRank, and graph coloring. Atos implementations achieve geomean speedups of 3.44x, 2.1x, and 2.77x and peak speedups of 12.8x, 3.2x, and 9.08x across three case studies, compared to a state of the art BSP GPU implementation. Beyond simply quantifying the speedup, we extensively analyze the reasons behind each speedup. This deeper understanding allows us to derive general guidelines for how to select the optimal Atos configuration for different applications. Finally, our analysis provides insights for future dynamic scheduling framework designs.


A User Study Protocol for Evaluation of Formal Verification Results and their Explanation. Context The complexity of modern safety critical systems in industries keep on increasing due to the rising number of features and functionalities. This calls for formal methods in order to entrust confidence in such systems. Nevertheless, using formal methods in industry is demanding because of usability issues, e.g., the difficulty of understanding model checking results. Thus the hypothesis is, presenting the result of model checker results in a user friendly manner could promote formal methods usage in industries. Objective We aim to evaluate the acceptance of formal methods by engineers if the complexity of understanding verification results is made easy. Method We perform two different exploratory studies. First, we conduct an online survey to explore challenges in identifying inconsistent specifications and using formal methods from engineers. Second, we perform a one group pretest and posttest experiment to collect impressions from engineers using formal methods if understanding verification results is eased. Limitations The main limitation of this study is the generalization because the survey focuses on a particular target group and it uses a pre experimental design.


Dive into Deep Learning. This open source book represents our attempt to make deep learning approachable, teaching readers the concepts, the context, and the code. The entire book is drafted in Jupyter notebooks, seamlessly integrating exposition figures, math, and interactive examples with self contained code. Our goal is to offer a resource that could (i) be freely available for everyone (ii) offer sufficient technical depth to provide a starting point on the path to actually becoming an applied machine learning scientist (iii) include runnable code, showing readers how to solve problems in practice (iv) allow for rapid updates, both by us and also by the community at large (v) be complemented by a forum for interactive discussion of technical details and to answer questions.


Adaptive Newton Sketch Linear time Optimization with Quadratic Convergence and Effective Hessian Dimensionality. We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a random projection of the Hessian. Our first contribution is to show that, at each iteration, the embedding dimension (or sketch size) can be as small as the effective dimension of the Hessian matrix. Leveraging this novel fundamental result, we design an algorithm with a sketch size proportional to the effective dimension and which exhibits a quadratic rate of convergence. This result dramatically improves on the classical linear quadratic convergence rates of state of the art sub sampled Newton methods. However, in most practical cases, the effective dimension is not known beforehand, and this raises the question of how to pick a sketch size as small as the effective dimension while preserving a quadratic convergence rate. Our second and main contribution is thus to propose an adaptive sketch size algorithm with quadratic convergence rate and which does not require prior knowledge or estimation of the effective dimension at each iteration, it starts with a small sketch size, and increases it until quadratic progress is achieved. Importantly, we show that the embedding dimension remains proportional to the effective dimension throughout the entire path and that our method achieves state of the art computational complexity for solving convex optimization programs with a strongly convex component.


Breaching the 2 Approximation Barrier for the Forest Augmentation Problem. The basic goal of survivable network design is to build cheap networks that guarantee the connectivity of certain pairs of nodes despite the failure of a few edges or nodes. A celebrated result by Jain Combinatorica'01 provides a 2 approximation for a wide class of these problems. However nothing better is known even for very basic special cases, raising the natural question whether any improved approximation factor is possible at all. In this paper we address one of the most basic problems in this family for which 2 is still the best known approximation factor, the Forest Augmentation Problem (FAP) given an undirected unweighted graph (that w.l.o.g. is a forest) and a collection of extra edges (links), compute a minimum cardinality subset of links whose addition to the graph makes it 2 edge connected. Several better than 2 approximation algorithms are known for the special case where the input graph is a tree, a.k.a. the Tree Augmentation Problem (TAP). Recently this was achieved also for the weighted version of TAP, and for the k edge connectivity generalization of TAP. These results heavily exploit the fact that the input graph is connected, a condition that does not hold in FAP. In this paper we breach the 2 approximation barrier for FAP. Our result is based on two main ingredients. First, we describe a reduction to the Path Augmentation Problem (PAP), the special case of FAP where the input graph is a collection of disjoint paths. Our reduction is not approximation preserving, however it is sufficiently accurate to improve on a factor 2 approximation. Second, we present a better than 2 approximation algorithm for PAP, an open problem on its own. Here we exploit a novel notion of implicit credits which might turn out to be helpful in future related work.


Learning to Robustly Aggregate Labeling Functions for Semi supervised Data Programming. A critical bottleneck in supervised machine learning is the need for large amounts of labeled data which is expensive and time consuming to obtain. However, it has been shown that a small amount of labeled data, while insufficient to re train a model, can be effectively used to generate human interpretable labeling functions (LFs). These LFs, in turn, have been used to generate a large amount of additional noisy labeled data, in a paradigm that is now commonly referred to as data programming. However, previous approaches to automatically generate LFs make no attempt to further use the given labeled data for model training, thus giving up opportunities for improved performance. Moreover, since the LFs are generated from a relatively small labeled dataset, they are prone to being noisy, and naively aggregating these LFs can lead to very poor performance in practice. In this work, we propose an LF based reweighting framework ouralgo to solve these two critical limitations. Our algorithm learns a joint model on the (same) labeled dataset used for LF induction along with any unlabeled data in a semi supervised manner, and more critically, reweighs each LF according to its goodness, influencing its contribution to the semi supervised loss using a robust bi level optimization algorithm. We show that our algorithm significantly outperforms prior approaches on several text classification datasets.


Associated varieties for real reductive groups. We give an algorithm to compute the associated variety of a Harish Chandra module for a real reductive group G( mathbb R ) . The algorithm is implemented in the atlas software package.


Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systems. Hyperbolic space and hyperbolic embeddings are becoming a popular research field for recommender systems. However, it is not clear under what circumstances the hyperbolic space should be considered. To fill this gap, This paper provides theoretical analysis and empirical results on when and where to use hyperbolic space and hyperbolic embeddings in recommender systems. Specifically, we answer the questions that which type of models and datasets are more suited for hyperbolic space, as well as which latent size to choose. We evaluate our answers by comparing the performance of Euclidean space and hyperbolic space on different latent space models in both general item recommendation domain and social recommendation domain, with 6 widely used datasets and different latent sizes. Additionally, we propose a new metric learning based recommendation method called SCML and its hyperbolic version HSCML. We evaluate our conclusions regarding hyperbolic space on SCML and show the state of the art performance of hyperbolic space by comparing HSCML with other baseline methods.


Toward Personalized Medicine in Connectomic Deep Brain Stimulation. At the group level, deep brain stimulation leads to significant therapeutic benefit in a multitude of neurological and neuropsychiatric disorders. At the single patient level, however, symptoms may sometimes persist despite "optimal" electrode placement at established treatment coordinates. This may be partly explained by limitations of disease centric strategies that are unable to account for heterogeneous phenotypes and comorbidities observed in clinical practice. Instead, tailoring electrode placement and programming to individual patients' symptom profiles may increase the fraction of top responding patients. Here, we propose a three step, circuit based framework that aims to develop patient specific treatment targets that address the unique symptom constellation prevalent in each patient. First, we describe how a symptom network target library could be established by mapping beneficial or undesirable DBS effects to distinct circuits based on (retrospective) group level data. Second, we suggest ways of matching the resulting symptom networks to circuits defined in the individual patient (template matching). Third, we introduce network blending as a strategy to calculate optimal stimulation targets and parameters by selecting and weighting a set of symptom specific networks based on the symptom profile and subjective priorities of the individual patient. We integrate the approach with published literature and conclude by discussing limitations and future challenges.


YOLO5Face Why Reinventing a Face Detector. Tremendous progress has been made on face detection in recent years using convolutional neural networks. While many face detectors use designs designated for detecting faces, we treat face detection as a generic object detection task. We implement a face detector based on the YOLOv5 object detector and call it YOLO5Face. We make a few key modifications to the YOLOv5 and optimize it for face detection. These modifications include adding a five point landmark regression head, using a stem block at the input of the backbone, using smaller size kernels in the SPP, and adding a P6 output in the PAN block. We design detectors of different model sizes, from an extra large model to achieve the best performance to a super small model for real time detection on an embedded or mobile device. Experiment results on the WiderFace dataset show that on VGA images, our face detectors can achieve state of the art performance in almost all the Easy, Medium, and Hard subsets, exceeding the more complex designated face detectors. The code is available at url https github.com deepcam cn yolov5 face


How Robust are Limit Order Book Representations under Data Perturbation?. The success of machine learning models in the financial domain is highly reliant on the quality of the data representation. In this paper, we focus on the representation of limit order book data and discuss the opportunities and challenges for learning representations of such data. We also experimentally analyse the issues associated with existing representations and present a guideline for future research in this area.


DPVI A Dynamic Weight Particle Based Variational Inference Framework. The recently developed Particle based Variational Inference (ParVI) methods drive the empirical distribution of a set of emph fixed weight particles towards a given target distribution pi by iteratively updating particles' positions. However, the fixed weight restriction greatly confines the empirical distribution's approximation ability, especially when the particle number is limited. In this paper, we propose to dynamically adjust particles' weights according to a Fisher Rao reaction flow. We develop a general Dynamic weight Particle based Variational Inference (DPVI) framework according to a novel continuous composite flow, which evolves the positions and weights of particles simultaneously. We show that the mean field limit of our composite flow is actually a Wasserstein Fisher Rao gradient flow of certain dissimilarity functional mathcal F , which leads to a faster decrease of mathcal F than the Wasserstein gradient flow underlying existing fixed weight ParVIs. By using different finite particle approximations in our general framework, we derive several efficient DPVI algorithms. The empirical results demonstrate the superiority of our derived DPVI algorithms over their fixed weight counterparts.


A novel locking free virtual element method for linear elasticity problems. This paper devises a novel lowest order conforming virtual element method (VEM) for planar linear elasticity with the pure displacement traction boundary condition. The main trick is to view a generic polygon K as a new one widetilde K with additional vertices consisting of interior points on edges of K , so that the discrete admissible space is taken as the V 1 type virtual element space related to the partition widetilde K instead of K . The method is shown to be uniformly convergent with the optimal rates both in H 1 and L 2 norms with respect to the Lam ' e constant lambda . Numerical tests are presented to illustrate the good performance of the proposed VEM and confirm the theoretical results.


Structural formulas for matrix valued orthogonal polynomials related to 2 times 2 hypergeometric operators. We give some structural formulas for the family of matrix valued orthogonal polynomials of size 2 times 2 introduced by C. Calder 'on et al. in an earlier work, which are common eigenfunctions of a differential operator of hypergeometric type. Specifically, we give a Rodrigues formula that allows us to write this family of polynomials explicitly in terms of the classical Jacobi polynomials, and write, for the sequence of orthonormal polynomials, the three term recurrence relation and the Christoffel Darboux identity. We obtain a Pearson equation, which enables us to prove that the sequence of derivatives of the orthogonal polynomials is also orthogonal, and to compute a Rodrigues formula for these polynomials as well as a matrix valued differential operator having these polynomials as eigenfunctions. We also describe the second order differential operators of the algebra associated with the weight matrix.


Recent Advances in Monocular 2D and 3D Human Pose Estimation A Deep Learning Perspective. Estimation of the human pose from a monocular camera has been an emerging research topic in the computer vision community with many applications. Recently, benefited from the deep learning technologies, a significant amount of research efforts have greatly advanced the monocular human pose estimation both in 2D and 3D areas. Although there have been some works to summarize the different approaches, it still remains challenging for researchers to have an in depth view of how these approaches work. In this paper, we provide a comprehensive and holistic 2D to 3D perspective to tackle this problem. We categorize the mainstream and milestone approaches since the year 2014 under unified frameworks. By systematically summarizing the differences and connections between these approaches, we further analyze the solutions for challenging cases, such as the lack of data, the inherent ambiguity between 2D and 3D, and the complex multi person scenarios. We also summarize the pose representation styles, benchmarks, evaluation metrics, and the quantitative performance of popular approaches. Finally, we discuss the challenges and give deep thinking of promising directions for future research. We believe this survey will provide the readers with a deep and insightful understanding of monocular human pose estimation.


PC DAN Point Cloud based Deep Affinity Network for 3D Multi Object Tracking (Accepted as an extended abstract in JRDB ACT Workshop at CVPR21). In recent times, the scope of LIDAR (Light Detection and Ranging) sensor based technology has spread across numerous fields. It is popularly used to map terrain and navigation information into reliable 3D point cloud data, potentially revolutionizing the autonomous vehicles and assistive robotic industry. A point cloud is a dense compilation of spatial data in 3D coordinates. It plays a vital role in modeling complex real world scenes since it preserves structural information and avoids perspective distortion, unlike image data, which is the projection of a 3D structure on a 2D plane. In order to leverage the intrinsic capabilities of the LIDAR data, we propose a PointNet based approach for 3D Multi Object Tracking (MOT).


Multi resolution deep learning pipeline for dense large scale point clouds. Recent development of 3D sensors allows the acquisition of extremely dense 3D point clouds of large scale scenes. The main challenge of processing such large point clouds remains in the size of the data, which induce expensive computational and memory cost. In this context, the full resolution cloud is particularly hard to process, and details it brings are rarely exploited. Although fine grained details are important for detection of small objects, they can alter the local geometry of large structural parts and mislead deep learning networks. In this paper, we introduce a new generic deep learning pipeline to exploit the full precision of large scale point clouds, but only for objects that require details. The core idea of our approach is to split up the process into multiple sub networks which operate on different resolutions and with each their specific classes to retrieve. Thus, the pipeline allows each class to benefit either from noise and memory cost reduction of a sub sampling or from fine grained details.


Analyzing the Impact of Meteorological Parameters on Rainfall Prediction. Rainfall is a climatic factor that affects many human activities like agriculture, construction, and forestry. Rainfall is dependent on various meteorological features and its prediction is a very complex task due to the dynamic climatic nature. A detailed study of different climatic features associated with the occurrence of rainfall should be made in order to understand the influence of each parameter in the context of rainfall. In this paper, we propose a methodical approach to analyze the affect of various parameters on rainfall. Our study uses 5 years of meteorological data from a weather station located in the United States. The correlation and interdependence among the collected meteorological features were obtained. Additionally, we identified the most important meteorological features for rainfall prediction using a machine learning based feature selection technique.


Deep Visual Constraints Neural Implicit Models for Manipulation Planning from Visual Input. Manipulation planning is the problem of finding a sequence of robot configurations that involves interactions with objects in the scene, e.g., grasping and placing an object, or more general tool use. To achieve such interactions, traditional approaches require hand engineering of object representations and interaction constraints, which easily becomes tedious when complex objects interactions are considered. Inspired by recent advances in 3D modeling, e.g. NeRF, we propose a method to represent objects as neural implicit functions upon which constraint features are defined and jointly trained. In particular, the proposed pixel aligned representation is directly inferred from images with known camera geometry and naturally acts as a perception component in the whole manipulation pipeline, thereby enabling long horizon planning only from visual input. Video https youtu.be r mIGTu6Jg


Contrastive Unpaired Translation using Focal Loss for Patch Classification. Image to image translation models transfer images from input domain to output domain in an endeavor to retain the original content of the image. Contrastive Unpaired Translation is one of the existing methods for solving such problems. Significant advantage of this method, compared to competitors, is the ability to train and perform well in cases where both input and output domains are only a single image. Another key thing that differentiates this method from its predecessors is the usage of image patches rather than the whole images. It also turns out that sampling negatives (patches required to calculate the loss) from the same image achieves better results than a scenario where the negatives are sampled from other images in the dataset. This type of approach encourages mapping of corresponding patches to the same location in relation to other patches (negatives) while at the same time improves the output image quality and significantly decreases memory usage as well as the time required to train the model compared to CycleGAN method used as a baseline. Through a series of experiments we show that using focal loss in place of cross entropy loss within the PatchNCE loss can improve on the model's performance and even surpass the current state of the art model for image to image translation.


Bar and joint rigidity on the moment curve coincides with cofactor rigidity on a conic. We show that, for points along the moment curve, the bar and joint rigidity matroid and the hyperconnectivity matroid coincide, and that both coincide with the C d 2 d 1 cofactor rigidity of points along any (non degenerate) conic in the plane. We also show that, for hyperconnectivity in dimension two, having the points in the moment curve is no loss of generality.


Comparing the order and the minimal number of generators of a finite irreducible linear group. We prove that d(G) log G O(n 2 log q) for irreducible subgroups G of GL (n,q) , and estimate the associated constants. The result is motivated by attempts to bound the complexity of computing the automorphism groups of various classes of finite groups.


scenoRITA Generating Less Redundant, Safety Critical and Motion Sickness Inducing Scenarios for Autonomous Vehicles. There is tremendous global enthusiasm for research, development, and deployment of autonomous vehicles (AVs), e.g., self driving taxis and trucks from Waymo and Baidu. The current practice for testing AVs uses virtual tests where AVs are tested in software simulations since they offer a more efficient and safer alternative compared to field operational tests. Specifically, search based approaches are used to find particularly critical situations. These approaches provide an opportunity to automatically generate tests however, systematically creating valid and effective tests for AV software remains a major challenge. To address this challenge, we introduce scenoRITA, a test generation approach for AVs that uses evolutionary algorithms with (1) a novel gene representation that allows obstacles to be fully mutable, hence, resulting in more reported violations, (2) 5 test oracles to determine both safety and motion sickness inducing violations, and (3) a novel technique to identify and eliminate duplicate tests. Our extensive evaluation shows that scenoRITA can produce effective driving scenarios that expose an ego car to safety critical situations. scenoRITA generated tests that resulted in a total of 1,026 unique violations, increasing the number of reported violations by 23.47 and 24.21 compared to random test generation and state of the art partially mutable test generation, respectively.


Separator logic and star free expressions for graphs. We describe two formalisms for defining graph languages, and prove that they are equivalent 1. Separator logic. This is first order logic on graphs which is allowed to use the edge relation, and for every n in 0,1, ldots a relation of arity n 2 which says that "vertex s can be connected to vertex t by a path that avoids vertices v 1, ldots,v n ". 2. Star free graph expressions. These are expressions that describe graphs with distinguished vertices called ports, and which are built from finite languages via Boolean combinations and the operations on graphs with ports used to construct tree decompositions. Furthermore, we prove a variant of Sch "utzenberger's theorem (about star free languages being those recognized by a periodic monoids) for graphs of bounded pathwidth. A corollary is that, given k and a graph language represented by an mso formula, one can decide if the language can be defined in either of two equivalent formalisms on graphs of pathwidth at most k .


Word Embeddings via Causal Inference Gender Bias Reducing and Semantic Information Preserving. With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human generated corpora have strong gender biases that can produce discriminative results in downstream tasks. Previous debiasing methods focus mainly on modeling bias and only implicitly consider semantic information while completely overlooking the complex underlying causal structure among bias and semantic components. To address these issues, we propose a novel methodology that leverages a causal inference framework to effectively remove gender bias. The proposed method allows us to construct and analyze the complex causal mechanisms facilitating gender information flow while retaining oracle semantic information within word embeddings. Our comprehensive experiments show that the proposed method achieves state of the art results in gender debiasing tasks. In addition, our methods yield better performance in word similarity evaluation and various extrinsic downstream NLP tasks.


TSQA Tabular Scenario Based Question Answering. Scenario based question answering (SQA) has attracted an increasing research interest. Compared with the well studied machine reading comprehension (MRC), SQA is a more challenging task a scenario may contain not only a textual passage to read but also structured data like tables, i.e., tabular scenario based question answering (TSQA). AI applications of TSQA such as answering multiple choice questions in high school exams require synthesizing data in multiple cells and combining tables with texts and domain knowledge to infer answers. To support the study of this task, we construct GeoTSQA. This dataset contains 1k real questions contextualized by tabular scenarios in the geography domain. To solve the task, we extend state of the art MRC methods with TTGen, a novel table to text generator. It generates sentences from variously synthesized tabular data and feeds the downstream MRC method with the most useful sentences. Its sentence ranking model fuses the information in the scenario, question, and domain knowledge. Our approach outperforms a variety of strong baseline methods on GeoTSQA.


Applying Declarative Analysis to Software Product Line Models An Industrial Study. Software Product Lines (SPLs) are families of related software products developed from a common set of artifacts. Most existing analysis tools can be applied to a single product at a time, but not to an entire SPL. Some tools have been redesigned re implemented to support the kind of variability exhibited in SPLs, but this usually takes a lot of effort, and is error prone. Declarative analyses written in languages like Datalog have been collectively lifted to SPLs in prior work, which makes the process of applying an existing declarative analysis to a product line more straightforward. In this paper, we take an existing declarative analysis (behaviour alteration) written in the Grok declarative language, port it to Datalog, and apply it to a set of automotive software product lines from General Motors. We discuss the design of the analysis pipeline used in this process, present its scalability results, and provide a means to visualize the analysis results for a subset of products filtered by feature expression. We also reflect on some of the lessons learned throughout this project.


VLSI Implementation of Cryptographic Algorithms Techniques A Literature Review. Through the years, the flow of Data and its transmission have increased tremendously and so has the security issues to it. Cryptography in recent years with the advancement of VLSI has led to its implementation of Encryption and Decryption techniques, where the process of translating and converting plaintext into cypher text and vice versa is made possible. In this paper, the review of various aspects of VLSI's implementation of encryption and decryption are covered. To systemize the material, the information about topics such as Private Key Encryption, Index Technique, Blowfish Algorithm, DNA cryptography, and many more are reviewed. Ultimately, with this review, the basic understanding of different VLSI techniques of Encryption and Decryption can be studied and implemented.


Generic Neural Architecture Search via Regression. Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures, such as ResNet in computer vision and LSTM in natural language processing, are generally good at extracting patterns from the input data and perform well on different downstream tasks. In this paper, we attempt to answer two fundamental questions related to NAS. (1) Is it necessary to use the performance of specific downstream tasks to evaluate and search for good neural architectures? (2) Can we perform NAS effectively and efficiently while being agnostic to the downstream tasks? To answer these questions, we propose a novel and generic NAS framework, termed Generic NAS (GenNAS). GenNAS does not use task specific labels but instead adopts regression on a set of manually designed synthetic signal bases for architecture evaluation. Such a self supervised regression task can effectively evaluate the intrinsic power of an architecture to capture and transform the input signal patterns, and allow more sufficient usage of training samples. Extensive experiments across 13 CNN search spaces and one NLP space demonstrate the remarkable efficiency of GenNAS using regression, in terms of both evaluating the neural architectures (quantified by the ranking correlation Spearman's rho between the approximated performances and the downstream task performances) and the convergence speed for training (within a few seconds).


Which and Where to Focus A Simple yet Accurate Framework for Arbitrary Shaped Nearby Text Detection in Scene Images. Scene text detection has drawn the close attention of researchers. Though many methods have been proposed for horizontal and oriented texts, previous methods may not perform well when dealing with arbitrary shaped texts such as curved texts. In particular, confusion problem arises in the case of nearby text instances. In this paper, we propose a simple yet effective method for accurate arbitrary shaped nearby scene text detection. Firstly, a One to Many Training Scheme (OMTS) is designed to eliminate confusion and enable the proposals to learn more appropriate groundtruths in the case of nearby text instances. Secondly, we propose a Proposal Feature Attention Module (PFAM) to exploit more effective features for each proposal, which can better adapt to arbitrary shaped text instances. Finally, we propose a baseline that is based on Faster R CNN and outputs the curve representation directly. Equipped with PFAM and OMTS, the detector can achieve state of the art or competitive performance on several challenging benchmarks.


Broadly Applicable Targeted Data Sample Omission Attacks. We introduce a novel clean label targeted poisoning attack on learning mechanisms. While classical poisoning attacks typically corrupt data via addition, modification and omission, our attack focuses on data omission only. Our attack misclassifies a single, targeted test sample of choice, without manipulating that sample. We demonstrate the effectiveness of omission attacks against a large variety of learners including deep neural networks, SVM and decision trees, using several datasets including MNIST, IMDB and CIFAR. The focus of our attack on data omission only is beneficial as well, as it is simpler to implement and analyze. We show that, with a low attack budget, our attack's success rate is above 80 , and in some cases 100 , for white box learning. It is systematically above the reference benchmark for black box learning. For both white box and black box cases, changes in model accuracy are negligible, regardless of the specific learner and dataset. We also prove theoretically in a simplified agnostic PAC learning framework that, subject to dataset size and distribution, our omission attack succeeds with high probability against any successful simplified agnostic PAC learner.


Parametric Contrastive Learning. In this paper, we propose Parametric Contrastive Learning (PaCo) to tackle long tailed recognition. Based on theoretical analysis, we observe supervised contrastive loss tends to bias on high frequency classes and thus increases the difficulty of imbalanced learning. We introduce a set of parametric class wise learnable centers to rebalance from an optimization perspective. Further, we analyze our PaCo loss under a balanced setting. Our analysis demonstrates that PaCo can adaptively enhance the intensity of pushing samples of the same class close as more samples are pulled together with their corresponding centers and benefit hard example learning. Experiments on long tailed CIFAR, ImageNet, Places, and iNaturalist 2018 manifest the new state of the art for long tailed recognition. On full ImageNet, models trained with PaCo loss surpass supervised contrastive learning across various ResNet backbones, e.g., our ResNet 200 achieves 81.8 top 1 accuracy. Our code is available at https github.com dvlab research Parametric Contrastive Learning.


HPTQ Hardware Friendly Post Training Quantization. Neural network quantization enables the deployment of models on edge devices. An essential requirement for their hardware efficiency is that the quantizers are hardware friendly uniform, symmetric, and with power of two thresholds. To the best of our knowledge, current post training quantization methods do not support all of these constraints simultaneously. In this work, we introduce a hardware friendly post training quantization (HPTQ) framework, which addresses this problem by synergistically combining several known quantization methods. We perform a large scale study on four tasks classification, object detection, semantic segmentation and pose estimation over a wide variety of network architectures. Our extensive experiments show that competitive results can be obtained under hardware friendly constraints.


J Stability in non archimedean dynamics. Let C v be a complete, algebraically closed non archimedean field, and let f in C v(z) be a rational function of degree d geq 2 . If f satisfies a bounded contraction condition on its Julia set, we prove that small perturbations of f have dynamics conjugate to those of f on their Julia sets.


A Research Ecosystem for Secure Computing. Computing devices are vital to all areas of modern life and permeate every aspect of our society. The ubiquity of computing and our reliance on it has been accelerated and amplified by the COVID 19 pandemic. From education to work environments to healthcare to defense to entertainment it is hard to imagine a segment of modern life that is not touched by computing. The security of computers, systems, and applications has been an active area of research in computer science for decades. However, with the confluence of both the scale of interconnected systems and increased adoption of artificial intelligence, there are many research challenges the community must face so that our society can continue to benefit and risks are minimized, not multiplied. Those challenges range from security and trust of the information ecosystem to adversarial artificial intelligence and machine learning. Along with basic research challenges, more often than not, securing a system happens after the design or even deployment, meaning the security community is routinely playing catch up and attempting to patch vulnerabilities that could be exploited any minute. While security measures such as encryption and authentication have been widely adopted, questions of security tend to be secondary to application capability. There needs to be a sea change in the way we approach this critically important aspect of the problem new incentives and education are at the core of this change. Now is the time to refocus research community efforts on developing interconnected technologies with security "baked in by design" and creating an ecosystem that ensures adoption of promising research developments. To realize this vision, two additional elements of the ecosystem are necessary proper incentive structures for adoption and an educated citizenry that is well versed in vulnerabilities and risks.


Generative Spoken Language Modeling from Raw Audio. We introduce Generative Spoken Language Modeling, the task of learning the acoustic and linguistic characteristics of a language from raw audio (no text, no labels), and a set of metrics to automatically evaluate the learned representations at acoustic and linguistic levels for both encoding and generation. We set up baseline systems consisting of a discrete speech encoder (returning pseudo text units), a generative language model (trained on pseudo text), and a speech decoder (generating a waveform from pseudo text) all trained without supervision and validate the proposed metrics with human evaluation. Across 3 speech encoders (CPC, wav2vec 2.0, HuBERT), we find that the number of discrete units (50, 100, or 200) matters in a task dependent and encoder dependent way, and that some combinations approach text based systems.


Causal Order Identification to Address Confounding Binary Variables. This paper considers an extension of the linear non Gaussian acyclic model (LiNGAM) that determines the causal order among variables from a dataset when the variables are expressed by a set of linear equations, including noise. In particular, we assume that the variables are binary. The existing LiNGAM assumes that no confounding is present, which is restrictive in practice. Based on the concept of independent component analysis (ICA), this paper proposes an extended framework in which the mutual information among the noises is minimized. Another significant contribution is to reduce the realization of the shortest path problem. The distance between each pair of nodes expresses an associated mutual information value, and the path with the minimum sum (KL divergence) is sought. Although p! mutual information values should be compared, this paper dramatically reduces the computation when no confounding is present. The proposed algorithm finds the globally optimal solution, while the existing locally greedily seek the order based on hypothesis testing. We use the best estimator in the sense of Bayes MDL that correctly detects independence for mutual information estimation. Experiments using artificial and actual data show that the proposed version of LiNGAM achieves significantly better performance, particularly when confounding is present.


Long time behavior of stochastic NLS with a small multiplicative noise. We prove the global space time bound for the mass critical nonlinear Schr "odinger equation perturbed by a small multiplicative noise in dimension three. The associated scattering behavior are also obtained. We also prove a global Strichartz space time bound for the linear stochastic model, which is new itself and serves a prototype model for the nonlinear case. The proof combines techniques from cite fan2018global , cite fan2020long as well as local smoothing estimates for linear Schr "odinger operators.