Position based Dynamics Simulator of Brain Deformations for Path Planning and Intra Operative Control in Keyhole Neurosurgery. Many tasks in robot assisted surgery require planning and controlling manipulators' motions that interact with highly deformable objects. This study proposes a realistic, time bounded simulator based on Position based Dynamics (PBD) simulation that mocks brain deformations due to catheter insertion for pre operative path planning and intra operative guidance in keyhole surgical procedures. It maximizes the probability of success by accounting for uncertainty in deformation models, noisy sensing, and unpredictable actuation. The PBD deformation parameters were initialized on a parallelepiped shaped simulated phantom to obtain a reasonable starting guess for the brain white matter. They were calibrated by comparing the obtained displacements with deformation data for catheter insertion in a composite hydrogel phantom. Knowing the gray matter brain structures' different behaviors, the parameters were fine tuned to obtain a generalized human brain model. The brain structures' average displacement was compared with values in the literature. The simulator's numerical model uses a novel approach with respect to the literature, and it has proved to be a close match with real brain deformations through validation using recorded deformation data of in vivo animal trials with a mean mismatch of 4.73 pm 2.15 . The stability, accuracy, and real time performance make this model suitable for creating a dynamic environment for KN path planning, pre operative path planning, and intra operative guidance.


Relationship based Neural Baby Talk. Understanding interactions between objects in an image is an important element for generating captions. In this paper, we propose a relationship based neural baby talk (R NBT) model to comprehensively investigate several types of pairwise object interactions by encoding each image via three different relationship based graph attention networks (GATs). We study three main relationships textit spatial relationships to explore geometric interactions, textit semantic relationships to extract semantic interactions, and textit implicit relationships to capture hidden information that could not be modelled explicitly as above. We construct three relationship graphs with the objects in an image as nodes, and the mutual relationships of pairwise objects as edges. By exploring features of neighbouring regions individually via GATs, we integrate different types of relationships into visual features of each node. Experiments on COCO dataset show that our proposed R NBT model outperforms state of the art models trained on COCO dataset in three image caption generation tasks.


Building a Question Answering System for the Manufacturing Domain. The design or simulation analysis of special equipment products must follow the national standards, and hence it may be necessary to repeatedly consult the contents of the standards in the design process. However, it is difficult for the traditional question answering system based on keyword retrieval to give accurate answers to technical questions. Therefore, we use natural language processing techniques to design a question answering system for the decision making process in pressure vessel design. To solve the problem of insufficient training data for the technology question answering system, we propose a method to generate questions according to a declarative sentence from several different dimensions so that multiple question answer pairs can be obtained from a declarative sentence. In addition, we designed an interactive attention model based on a bidirectional long short term memory (BiLSTM) network to improve the performance of the similarity comparison of two question sentences. Finally, the performance of the question answering system was tested on public and technical domain datasets.


Scalable Planning in Multi Agent MDPs. Multi agent Markov Decision Processes (MMDPs) arise in a variety of applications including target tracking, control of multi robot swarms, and multiplayer games. A key challenge in MMDPs occurs when the state and action spaces grow exponentially in the number of agents, making computation of an optimal policy computationally intractable for medium to large scale problems. One property that has been exploited to mitigate this complexity is transition independence, in which each agent's transition probabilities are independent of the states and actions of other agents. Transition independence enables factorization of the MMDP and computation of local agent policies but does not hold for arbitrary MMDPs. In this paper, we propose an approximate transition dependence property, called delta transition dependence and develop a metric for quantifying how far an MMDP deviates from transition independence. Our definition of delta transition dependence recovers transition independence as a special case when delta is zero. We develop a polynomial time algorithm in the number of agents that achieves a provable bound on the global optimum when the reward functions are monotone increasing and submodular in the agent actions. We evaluate our approach on two case studies, namely, multi robot control and multi agent patrolling example.


Stackelberg Pareto Synthesis (Full Version). In this paper, we study the framework of two player Stackelberg games played on graphs in which Player 0 announces a strategy and Player 1 responds rationally with a strategy that is an optimal response. While it is usually assumed that Player 1 has a single objective, we consider here the new setting where he has several. In this context, after responding with his strategy, Player 1 gets a payoff in the form of a vector of Booleans corresponding to his satisfied objectives. Rationality of Player 1 is encoded by the fact that his response must produce a Pareto optimal payoff given the strategy of Player 0. We study the Stackelberg Pareto Synthesis problem which asks whether Player 0 can announce a strategy which satisfies his objective, whatever the rational response of Player 1. For games in which objectives are either all parity or all reachability objectives, we show that this problem is fixed parameter tractable and NEXPTIME complete. This problem is already NP complete in the simple case of reachability objectives and graphs that are trees.


Evaluating the Quality of Finite Element Meshes with Machine Learning. This paper addresses the problem of evaluating the quality of finite element meshes for the purpose of structural mechanic simulations. It proposes the application of a machine learning model trained on data collected from expert evaluations. The task is characterised as a classification problem, where quality of each individual element in a mesh is determined by its own properties and adjacency structures. A domain specific, yet simple representation is proposed such that off the shelf machine learning methods can be applied. Experimental data from industry practice demonstrates promising results.


Focusing on Shadows for Predicting Heightmaps from Single Remotely Sensed RGB Images with Deep Learning. Estimating the heightmaps of buildings and vegetation in single remotely sensed images is a challenging problem. Effective solutions to this problem can comprise the stepping stone for solving complex and demanding problems that require 3D information of aerial imagery in the remote sensing discipline, which might be expensive or not feasible to require. We propose a task focused Deep Learning (DL) model that takes advantage of the shadow map of a remotely sensed image to calculate its heightmap. The shadow is computed efficiently and does not add significant computation complexity. The model is trained with aerial images and their Lidar measurements, achieving superior performance on the task. We validate the model with a dataset covering a large area of Manchester, UK, as well as the 2018 IEEE GRSS Data Fusion Contest Lidar dataset. Our work suggests that the proposed DL architecture and the technique of injecting shadows information into the model are valuable for improving the heightmap estimation task for single remotely sensed imagery.


Temporal Latent Auto Encoder A Method for Probabilistic Multivariate Time Series Forecasting. Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distribution assumptions or abandons modeling cross series correlations. A promising line of work exploits scalable matrix factorization for latent space forecasting, but is limited to linear embeddings, unable to model distributions, and not trainable end to end when using deep learning forecasting. We introduce a novel temporal latent auto encoder method which enables nonlinear factorization of multivariate time series, learned end to end with a temporal deep learning latent space forecast model. By imposing a probabilistic latent space model, complex distributions of the input series are modeled via the decoder. Extensive experiments demonstrate that our model achieves state of the art performance on many popular multivariate datasets, with gains sometimes as high as 50 for several standard metrics.


Non quasiconvex subgroups of hyperbolic groups via Stallings like techniques. We provide a new method of constructing non quasiconvex subgroups of hyperbolic groups by utilizing techniques inspired by Stallings' foldings. The hyperbolic groups constructed are in the natural class of right angled Coxeter groups (RACGs for short) and can be chosen to be 2 dimensional. More specifically, given a non quasiconvex subgroup of a (possibly non hyperbolic) RACG, our construction gives a corresponding non quasiconvex subgroup of a hyperbolic RACG. We use this to construct explicit examples of non quasiconvex subgroups of hyperbolic RACGs including subgroups whose generators are as short as possible (length two words), finitely generated free subgroups, non finitely presentable subgroups, and subgroups of fundamental groups of square complexes of nonpositive sectional curvature.


Bayesian Optimization over Permutation Spaces. Optimizing expensive to evaluate black box functions over an input space consisting of all permutations of d objects is an important problem with many real world applications. For example, placement of functional blocks in hardware design to optimize performance via simulations. The overall goal is to minimize the number of function evaluations to find high performing permutations. The key challenge in solving this problem using the Bayesian optimization (BO) framework is to trade off the complexity of statistical model and tractability of acquisition function optimization. In this paper, we propose and evaluate two algorithms for BO over Permutation Spaces (BOPS). First, BOPS T employs Gaussian process (GP) surrogate model with Kendall kernels and a Tractable acquisition function optimization approach based on Thompson sampling to select the sequence of permutations for evaluation. Second, BOPS H employs GP surrogate model with Mallow kernels and a Heuristic search approach to optimize expected improvement acquisition function. We theoretically analyze the performance of BOPS T to show that their regret grows sub linearly. Our experiments on multiple synthetic and real world benchmarks show that both BOPS T and BOPS H perform better than the state of the art BO algorithm for combinatorial spaces. To drive future research on this important problem, we make new resources and real world benchmarks available to the community.


q-bio.QM math.OC physics.bio-ph physics.data-an

Symmetry driven network reconstruction through pseudobalanced coloring optimization. Symmetries found through automorphisms or graph fibrations provide important insights in network analysis. Symmetries identify clusters of robust synchronization in the network which improves the understanding of the functionality of complex biological systems. Network symmetries can be determined by finding a it balanced coloring of the graph, which is a node partition in which each cluster of nodes receives the same information (color) from the rest of the graph. In recent work we saw that biological networks such as gene regulatory networks, metabolic networks and neural networks in organisms ranging from bacteria to yeast and humans are rich in fibration symmetries related to the graph balanced coloring. Networks based on real systems, however, are built on experimental data which are inherently incomplete, due to missing links, collection errors, and natural variations within specimens of the same biological species. Therefore, it is fair to assume that some of the existing symmetries were not detected in our analysis. For that reason, a method to find pseudosymmetries and repair networks based on those symmetries is important when analyzing real world networks. In this paper we introduce the it pseudobalanced coloring eqref eq mainip problem, and provide an integer programming formulation which (a) calculates a pseudobalanced coloring of the graph taking into account the missing data, and (b) optimally repairs the graph with the minimal number of added removed edges to maximize the symmetry of the graph. We apply our formulation to the it C. elegans connectome to find pseudocoloring and the optimal graph repair. Our solution compares well with a manually curated ground truth it C. elegans graph as well as solutions generated by other methods of missing link prediction.


GQE PRF Generative Query Expansion with Pseudo Relevance Feedback. Query expansion with pseudo relevance feedback (PRF) is a powerful approach to enhance the effectiveness in information retrieval. Recently, with the rapid advance of deep learning techniques, neural text generation has achieved promising success in many natural language tasks. To leverage the strength of text generation for information retrieval, in this article, we propose a novel approach which effectively integrates text generation models into PRF based query expansion. In particular, our approach generates augmented query terms via neural text generation models conditioned on both the initial query and pseudo relevance feedback. Moreover, in order to train the generative model, we adopt the conditional generative adversarial nets (CGANs) and propose the PRF CGAN method in which both the generator and the discriminator are conditioned on the pseudo relevance feedback. We evaluate the performance of our approach on information retrieval tasks using two benchmark datasets. The experimental results show that our approach achieves comparable performance or outperforms traditional query expansion methods on both the retrieval and reranking tasks.


Metaphor Research in the 21st Century A Bibliographic Analysis. Metaphor is widely used in human communication. The cohort of scholars studying metaphor in various fields is continuously growing, but very few work has been done in bibliographical analysis of metaphor research. This paper examines the advancements in metaphor research from 2000 to 2017. Using data retrieved from Microsoft Academic Graph and Web of Science, this paper makes a macro analysis of metaphor research, and expounds the underlying patterns of its development. Taking into consideration sub fields of metaphor research, the internal analysis of metaphor research is carried out from a micro perspective to reveal the evolution of research topics and the inherent relationships among them. This paper provides novel insights into the current state of the art of metaphor research as well as future trends in this field, which may spark new research interests in metaphor from both linguistic and interdisciplinary perspectives.


Multi Perspective Anomaly Detection. Anomaly detection is a critical problem in the manufacturing industry. In many applications, images of objects to be analyzed are captured from multiple perspectives which can be exploited to improve the robustness of anomaly detection. In this work, we build upon the deep support vector data description algorithm and address multi perspective anomaly detection using three different fusion techniques, i.e., early fusion, late fusion, and late fusion with multiple decoders. We employ different augmentation techniques with a denoising process to deal with scarce one class data, which further improves the performance (ROC AUC 80 ). Furthermore, we introduce the dices dataset, which consists of over 2000 grayscale images of falling dices from multiple perspectives, with 5 of the images containing rare anomalies (e.g., drill holes, sawing, or scratches). We evaluate our approach on the new dices dataset using images from two different perspectives and also benchmark on the standard MNIST dataset. Extensive experiments demonstrate that our proposed multi perspective approach exceeds the state of the art single perspective anomaly detection on both the MNIST and dices datasets . To the best of our knowledge, this is the first work that focuses on addressing multi perspective anomaly detection in images by jointly using different perspectives together with one single objective function for anomaly detection.


Nanorobot queue Cooperative treatment of cancer based on team member communication and image processing. Although nanorobots have been used as clinical prescriptions for work such as gastroscopy, and even photoacoustic tomography technology has been proposed to control nanorobots to deliver drugs at designated delivery points in real time, and there are cases of eliminating "superbacteria" in blood through nanorobots, most technologies are immature, either with low efficiency or low accuracy, Either it can not be mass produced, so the most effective way to treat cancer diseases at this stage is through chemotherapy and radiotherapy. Patients are suffering and can not be cured. Therefore, this paper proposes an ideal model of a treatment method that can completely cure cancer, a cooperative treatment method based on nano robot queue through team member communication and computer vision image classification (target detection).


Analytic one dimensional maps and two dimensional ordinary differential equations can robustly simulate Turing machines. In this paper, we analyze the problem of finding the minimum dimension n such that a closed form analytic map ordinary differential equation can simulate a Turing machine over mathbb R n in a way that is robust to perturbations. We show that one dimensional closed form analytic maps are sufficient to robustly simulate Turing machines but the minimum dimension for the closed form analytic ordinary differential equations to robustly simulate Turing machines is two, under some reasonable assumptions. We also show that any Turing machine can be simulated by a two dimensional C infty ordinary differential equation on the compact sphere mathbb S 2 .


Damped (linear) response theory within the resolution of identity coupled cluster singles and approximate doubles (RI CC2) method. An implementation of a complex solver for the solution of the response equations required to compute the complex response functions of damped response theory is presented for the resolution of identity (RI) coupled cluster singles and approximate doubles CC2 method. The implementation uses a partitioned formulation that avoids the storage of double excitation amplitudes to make it applicable to large molecules. The solver is the keystone element for the development of the damped coupled cluster response formalism for linear and nonlinear effects in resonant frequency regions at the RI CC2 level of theory. Illustrative results are reported for the one photon absorption cross section of C60, the electronic circular dichroism of n helicenes ( n 5, 6, 7), and the C 6 dispersion coefficients of a set of selected organic molecules and fullerenes.


Numerical instability in B D models. When computing the expected value of time till extinction of a Birth and Death process, the usual textbook approach results in an extreme case of numerical ill conditioning, which prevents us from getting accurate answers beyond the first few low lying states in this brief note we present a potential solution, together with a novel derivation of related formulas.


Braid group symmetries on quasi split imath quantum groups via imath Hall algebras. We establish automorphisms with closed formulas on quasi split imath quantum groups of symmetric Kac Moody type associated to restricted Weyl groups. The proofs are carried out in the framework of imath Hall algebras and reflection functors, thanks to the imath Hall algebra realization of imath quantum groups in our previous work. Several quantum binomial identities arising along the way are established.


COVID 19 Smart Chatbot Prototype for Patient Monitoring. Many COVID 19 patients developed prolonged symptoms after the infection, including fatigue, delirium, and headache. The long term health impact of these conditions is still not clear. It is necessary to develop a way to follow up with these patients for monitoring their health status to support timely intervention and treatment. In the lack of sufficient human resources to follow up with patients, we propose a novel smart chatbot solution backed with machine learning to collect information (i.e., generating digital diary) in a personalized manner. In this article, we describe the design framework and components of our prototype.


Extended formulations for matroid polytopes through randomized protocols. Let P be a polytope. The hitting number of P is the smallest size of a hitting set of the facets of P , i.e., a subset of vertices of P such that every facet of P has a vertex in the subset. An extended formulation of P is the description of a polyhedron that linearly projects to P . We show that, if P is the base polytope of any matroid, then P admits an extended formulation whose size depends linearly on the hitting number of P . Our extended formulations generalize those of the spanning tree polytope given by Martin and Wong. Our proof is simple and short, and it goes through the deep connection between extended formulations and communication protocols.


Gender Typicality of Behavior Predicts Success on Creative Platforms. Collaboration platforms on the Internet have become crucial tools for independent creative workers, facilitating connections with collaborators, users, and buyers. Such platforms carried the promise of better opportunities for women and other underrepresented groups to access markets and collaborators, but the evidence is mounting that they rather perpetuate existing biases and inequalities. In previous work, we had found that the majority of women's disadvantage in success and survival on GitHub stems from what they do the gender typicality of their behavior in open source programming rather than from categorical discrimination of their gender. In this article, we replicate our findings on another platform with a markedly different focus Behance, a community for graphic artists. We also study attention as a new outcome on both platforms. We found that female typicality of behavior is a significant negative predictor of attention, success, and survival on creative platforms, while the impact of categorical gender varies by outcome and field. We found support for the visibility paradox of women in technical fields while female typicality of behaviors is negatively related to attention, being female predicts a higher level of attention. We quantified the indirect impact of gender homophily on success via gendered behavior that accounts for 37 percent of the disadvantage of women in success. Our findings suggest that the negative impact of the gender typicality of behavior is a more general phenomenon than our first study indicated, underlining the scope of the challenge of countering unconscious gender bias in the platform economy.


Lebesgue Constants For Cantor Sets. We evaluate the values of the Lebesgue constants in polynomial interpolation for three types of Cantor sets. In all cases, the sequences of Lebesgue constants are not bounded. This disproves the statement by Mergelyan.


Kernel based Dirichlet sequences. Let X (X 1,X 2, ldots) be a sequence of random variables with values in a standard space (S, mathcal B ) . Suppose begin gather X 1 sim nu quad text and quad P bigl(X n 1 in cdot mid X 1, ldots,X n bigr) frac theta nu( cdot) sum i 1 nK(X i)( cdot) n theta quad quad text a.s. end gather where theta 0 is a constant, nu a probability measure on mathcal B , and K a random probability measure on mathcal B . Then, X is exchangeable whenever K is a regular conditional distribution for nu given any sub sigma field of mathcal B . Under this assumption, X enjoys all the main properties of classical Dirichlet sequences, including Sethuraman's representation, conjugacy property, and convergence in total variation of predictive distributions. If mu is the weak limit of the empirical measures, conditions for mu to be a.s. discrete, or a.s. non atomic, or mu ll nu a.s., are provided. Two CLT's are proved as well. The first deals with stable convergence while the second concerns total variation distance.


A systematic route to subcritical dynamo branches. We demonstrate that the nonlinear optimisation of a finite amplitude disturbance over a freely evolving and possibly even turbulent flow, can successfully identify subcritical dynamo branches as well as the structure and amplitude of their critical perturbations. As this approach does not require prior knowledge of the magnetic field amplification mechanisms, it opens a new avenue for systematically probing subcritical dynamo flows.


Essential forward weak KAM solution for the convex Hamilton Jacobi equation. For a convex, coercive continuous Hamiltonian on a compact closed Riemannian manifold M , we construct a unique forward weak KAM solution of H(x, d x u) c(H) by a vanishing discount approach, where c(H) is the Ma n 'e critical value. We also discuss the dynamical significance of such a special solution.


Set characterizations and convex extensions for geometric convex hull proofs. In the present work, we consider Zuckerberg's method for geometric convex hull proofs introduced in Geometric proofs for convex hull defining formulations, Operations Research Letters 44(5), 625 629 (2016) . It has only been scarcely adopted in the literature so far, despite the great flexibility in designing algorithmic proofs for the completeness of polyhedral descriptions that it offers. We suspect that this is partly due to the rather heavy algebraic framework its original statement entails. This is why we present a much more lightweight and accessible approach to Zuckerberg's proof technique, building on ideas from Extended formulations for convex hulls of some bilinear functions, Discrete Optimization 36, 100569 (2020) . We introduce the concept of set characterizations to replace the set theoretic expressions needed in the original version and to facilitate the construction of algorithmic proof schemes. Along with this, we develop several different strategies to conduct Zuckerberg type convex hull proofs. Very importantly, we also show that our concept allows for a significant extension of Zuckerberg's proof technique. While the original method was only applicable to 0 1 polytopes, our extended framework allows to treat arbitrary polyhedra and even general convex sets. We demonstrate this increase in expressive power by characterizing the convex hull of Boolean and bilinear functions over polytopal domains. All results are illustrated with indicative examples to underline the practical usefulness and wide applicability of our framework.


On the Local Communication Complexity of Counting and Modular Arithmetic. In standard number in hand multi party communication complexity, performance is measured as the total number of bits transmitted globally in the network. In this paper, we study a variation called local communication complexity in which performance instead measures the maximum number of bits sent or received at any one player. We focus on a simple model where n players, each with one input bit, execute a protocol by exchanging messages to compute a function on the n input bits. We ask what can and cannot be solved with a small local communication complexity in this setting. We begin by establishing a non trivial lower bound on the local complexity for a specific function by proving that counting the number of 1 's among the first 17 input bits distributed among the participants requires a local complexity strictly greater than 1 . We further investigate whether harder counting problems of this type can yield stronger lower bounds, providing a largely negative answer by showing that constant local complexity is sufficient to count the number 1 bits over the entire input, and therefore compute any symmetric function. In addition to counting, we show that both sorting and searching can be computed in constant local complexity. We then use the counting solution as a subroutine to demonstrate that constant local complexity is also sufficient to compute many standard modular arithmetic operations on two operands, including comparisons, addition, subtraction, multiplication, division, and exponentiation. Finally we establish that function GCD(x,y) where x and y are in the range 1,n has local complexity of O(1) . Our work highlights both new techniques for proving lower bounds on this metric and the power of even a small amount of local communication.


Minimal asymptotic translation lengths on curve complexes and homology of mapping tori. We consider pseudo Anosov mapping classes on a closed orientable surface of genus g that fix a rank k subgroup of the first homology of the surface. We first show that there exists a uniform constant C 0 so that the minimal asymptotic translation length on the curve complex among such pseudo Anosovs is bounded below by C over g(2g k 1) . This interpolates between results of Gadre Tsai and of the first author and Shin, who treated the cases of the entire mapping class group ( k 0 ) and the Torelli subgroup ( k 2g ), respectively. We also discuss possible strategy to obtain an upper bound. Finally, we construct a pseudo Anosov on a genus g surface whose maximal invariant subspace is of rank 2g 1 and the asymptotic translation length is of asymp 1 g for all g . Such pseudo Anosovs are further shown to be unable to normally generate the whole mapping class groups. As Lanier Margalit proved that pseudo Anosovs with small translation lengths on the Teichm "uller spaces normally generate mapping class groups, our observation provides a restriction on how small the asymptotic translation lengths on curve complexes should be if the similar phenomenon holds for curve complexes.


Unsupervised Extractive Summarization by Human Memory Simulation. Summarization systems face the core challenge of identifying and selecting important information. In this paper, we tackle the problem of content selection in unsupervised extractive summarization of long, structured documents. We introduce a wide range of heuristics that leverage cognitive representations of content units and how these are retained or forgotten in human memory. We find that properties of these representations of human memory can be exploited to capture relevance of content units in scientific articles. Experiments show that our proposed heuristics are effective at leveraging cognitive structures and the organization of the document (i.e. sections of an article), and automatic and human evaluations provide strong evidence that these heuristics extract more summary worthy content units.


ILabel Interactive Neural Scene Labelling. Joint representation of geometry, colour and semantics using a 3D neural field enables accurate dense labelling from ultra sparse interactions as a user reconstructs a scene in real time using a handheld RGB D sensor. Our iLabel system requires no training data, yet can densely label scenes more accurately than standard methods trained on large, expensively labelled image datasets. Furthermore, it works in an 'open set' manner, with semantic classes defined on the fly by the user. ILabel's underlying model is a multilayer perceptron (MLP) trained from scratch in real time to learn a joint neural scene representation. The scene model is updated and visualised in real time, allowing the user to focus interactions to achieve efficient labelling. A room or similar scene can be accurately labelled into 10 semantic categories with only a few tens of clicks. Quantitative labelling accuracy scales powerfully with the number of clicks, and rapidly surpasses standard pre trained semantic segmentation methods. We also demonstrate a hierarchical labelling variant.


On normal numbers and self similar measures. Let lbrace f i(x) s i cdot x t i rbrace be a self similar IFS on mathbb R and let beta 1 be a Pisot number. We prove that if frac log s i log beta notin mathbb Q for some i then for every C 1 diffeomorphism g and every non atomic self similar measure mu , the measure g mu is supported on numbers that are normal in base beta .


Kinova Gen3 Lite manipulator inverse kinematics optimal polynomial solution. A polynomial solution to the inverse kinematic problem of the Kinova Gen3 Lite robot is proposed in this paper. This serial robot is based on a 6R kinematic chain and is not wrist partitioned. We first start from the forward kinematics equation providing the position and orientation of the end effector, finally, the univariate polynomial equation is given as a function of the first joint variable theta 1 . The remaining joint variables are computed by back substitution. Thus, an unique set of joint position is obtain for each root of the univariate equation. Numerical examples, simulated in ROS (Robot Operating System), are given to validate the results, which are compared to the coordinates obtained with MoveIt! and with the actual robot. A procedure to choose an optimum posture of the robot is also proposed.


Video Instance Segmentation by Instance Flow Assembly. Instance segmentation is a challenging task aiming at classifying and segmenting all object instances of specific classes. While two stage box based methods achieve top performances in the image domain, they cannot easily extend their superiority into the video domain. This is because they usually deal with features or images cropped from the detected bounding boxes without alignment, failing to capture pixel level temporal consistency. We embrace the observation that bottom up methods dealing with box free features could offer accurate spacial correlations across frames, which can be fully utilized for object and pixel level tracking. We first propose our bottom up framework equipped with a temporal context fusion module to better encode inter frame correlations. Intra frame cues for semantic segmentation and object localization are simultaneously extracted and reconstructed by corresponding decoders after a shared backbone. For efficient and robust tracking among instances, we introduce an instance level correspondence across adjacent frames, which is represented by a center to center flow, termed as instance flow, to assemble messy dense temporal correspondences. Experiments demonstrate that the proposed method outperforms the state of the art online methods (taking image level input) on the challenging Youtube VIS dataset.


uFLIM Unsupervised analysis of FLIM FRET microscopy data. Despite their widespread use in cell biology, fluorescence lifetime imaging microscopy (FLIM) data sets are challenging to analyse, because each spatial position can contain a superposition of multiple fluorescent components. Here, we present a data analysis method making the most out of the information in the available photon budget, while being fast and unbiased. The method, called uFLIM, determines spatial distributions and temporal dynamics of multiple fluorescent components with no prior knowledge. It goes significantly beyond current approaches which either assume the functional dependence of the dynamics, e.g. an exponential decay, or require dynamics to be known. Its efficient non negative matrix factorization algorithm allows for real time data processing. We show that uFLIM is capable to disentangle the spatial distribution and spectral properties of 5 fluorescing probes, from only two excitation and detection channels and a photon budget of 100 detected photons per pixel. By adapting the method to data exhibiting Forster resonant energy transfer (FRET), we retrieve the spatial and transfer rate distribution of the bound species, without constrains on donor and acceptor dynamics. This powerful unsupervised method allows to extract information previously inaccessible from FLIM FRET data.


RECIST Net Lesion detection via grouping keypoints on RECIST based annotation. Universal lesion detection in computed tomography (CT) images is an important yet challenging task due to the large variations in lesion type, size, shape, and appearance. Considering that data in clinical routine (such as the DeepLesion dataset) are usually annotated with a long and a short diameter according to the standard of Response Evaluation Criteria in Solid Tumors (RECIST) diameters, we propose RECIST Net, a new approach to lesion detection in which the four extreme points and center point of the RECIST diameters are detected. By detecting a lesion as keypoints, we provide a more conceptually straightforward formulation for detection, and overcome several drawbacks (e.g., requiring extensive effort in designing data appropriate anchors and losing shape information) of existing bounding box based methods while exploring a single task, one stage approach compared to other RECIST based approaches. Experiments show that RECIST Net achieves a sensitivity of 92.49 at four false positives per image, outperforming other recent methods including those using multi task learning.


Harmonic Analysis on GL(n) over Finite Fields. There are many formulas that express interesting properties of a finite group G in terms of sums over its characters. For estimating these sums, one of the most salient quantities to understand is the character ratio trace( pi(g)) dim( pi), for an irreducible representation pi of G and an element g of G. It turns out Gurevich Howe15, Gurevich Howe17 that for classical groups G over finite fields there are several (compatible) invariants of representations that provide strong information on the character ratios. We call these invariants collectively rank. Rank suggests a new way to organize the representations of classical groups over finite and local fields a way in which the building blocks are the "smallest" representations. This is in contrast to Harish Chandra's philosophy of cusp forms that is the main organizational principle since the 60s, and in it the building blocks are the cuspidal representations which are, in some sense, the "LARGEST". The philosophy of cusp forms is well adapted to establishing the Plancherel formula for reductive groups over local fields, and led to Lusztig's classification of the irreducible representations of such groups over finite fields. However, analysis of character ratios might benefit from a different approach. In this note we discuss further the notion of tensor rank for GL n over a finite field F q and demonstrate how to get information on representations of a given tensor rank using tools coming from the recently studied eta correspondence, as well as the well known philosophy of cusp forms, mentioned just above. A significant discovery so far is that although the dimensions of the irreducible representations of a given tensor rank vary by quite a lot (they can differ by large powers of q), for certain group elements of interest the character ratios of these irreps are nearly equal to each other.


Multi Objectivizing Software Configuration Tuning (for a single performance concern). Automatically tuning software configuration for optimizing a single performance attribute (e.g., minimizing latency) is not trivial, due to the nature of the configuration systems (e.g., complex landscape and expensive measurement). To deal with the problem, existing work has been focusing on developing various effective optimizers. However, a prominent issue that all these optimizers need to take care of is how to avoid the search being trapped in local optima a hard nut to crack for software configuration tuning due to its rugged and sparse landscape, and neighboring configurations tending to behave very differently. Overcoming such in an expensive measurement setting is even more challenging. In this paper, we take a different perspective to tackle this issue. Instead of focusing on improving the optimizer, we work on the level of optimization model. We do this by proposing a meta multi objectivization model (MMO) that considers an auxiliary performance objective (e.g., throughput in addition to latency). What makes this model unique is that we do not optimize the auxiliary performance objective, but rather use it to make similarly performing while different configurations less comparable (i.e. Pareto nondominated to each other), thus preventing the search from being trapped in local optima. Experiments on eight real world software systems environments with diverse performance attributes reveal that our MMO model is statistically more effective than state of the art single objective counterparts in overcoming local optima (up to 42 gain), while using as low as 24 of their measurements to achieve the same (or better) performance result.


User Inspired Posterior Network for Recommendation Reason Generation. Recommendation reason generation, aiming at showing the selling points of products for customers, plays a vital role in attracting customers' attention as well as improving user experience. A simple and effective way is to extract keywords directly from the knowledge base of products, i.e., attributes or title, as the recommendation reason. However, generating recommendation reason from product knowledge doesn't naturally respond to users' interests. Fortunately, on some E commerce websites, there exists more and more user generated content (user content for short), i.e., product question answering (QA) discussions, which reflect user cared aspects. Therefore, in this paper, we consider generating the recommendation reason by taking into account not only the product attributes but also the customer generated product QA discussions. In reality, adequate user content is only possible for the most popular commodities, whereas large sums of long tail products or new products cannot gather a sufficient number of user content. To tackle this problem, we propose a user inspired multi source posterior transformer (MSPT), which induces the model reflecting the users' interests with a posterior multiple QA discussions module, and generating recommendation reasons containing the product attributes as well as the user cared aspects. Experimental results show that our model is superior to traditional generative models. Additionally, the analysis also shows that our model can focus more on the user cared aspects than baselines.


EPICURE Ensemble Pretrained Models for Extracting Cancer Mutations from Literature. To interpret the genetic profile present in a patient sample, it is necessary to know which mutations have important roles in the development of the corresponding cancer type. Named entity recognition is a core step in the text mining pipeline which facilitates mining valuable cancer information from the scientific literature. However, due to the scarcity of related datasets, previous NER attempts in this domain either suffer from low performance when deep learning based models are deployed, or they apply feature based machine learning models or rule based models to tackle this problem, which requires intensive efforts from domain experts, and limit the model generalization capability. In this paper, we propose EPICURE, an ensemble pre trained model equipped with a conditional random field pattern layer and a span prediction pattern layer to extract cancer mutations from text. We also adopt a data augmentation strategy to expand our training set from multiple datasets. Experimental results on three benchmark datasets show competitive results compared to the baseline models.


FAST CAT Collaborative Data Entry and Curation for Semantic Interoperability in Digital Humanities. Descriptive and empirical sciences, such as History, are the sciences that collect, observe and describe phenomena in order to explain them and draw interpretative conclusions about influences, driving forces and impacts under given circumstances. Spreadsheet software and relational database management systems are still the dominant tools for quantitative analysis and overall data management in these these sciences, allowing researchers to directly analyse the gathered data and perform scholarly interpretation. However, this current practice has a set of limitations, including the high dependency of the collected data on the initial research hypothesis, usually useless for other research, the lack of representation of the details from which the registered relations are inferred, and the difficulty to revisit the original data sources for verification, corrections or improvements. To cope with these problems, in this paper we present FAST CAT, a collaborative system for assistive data entry and curation in Digital Humanities and similar forms of empirical research. We describe the related challenges, the overall methodology we follow for supporting semantic interoperability, and discuss the use of FAST CAT in the context of a European (ERC) project of Maritime History, called SeaLiT, which examines economic, social and demographic impacts of the introduction of steamboats in the Mediterranean area between the 1850s and the 1920s.


Reflecting (on) the modulo 9 Kanade Russell (conjectural) identities. We examine complexity and versatility of five modulo 9 Kanade Russell identities through their finite (aka polynomial) versions and images under the q mapsto1 q reflection.


Stable intersections of regular conformal Cantor sets with large Hausdorff dimensions. In this paper we prove that among pairs K, ,K' subset mathbb C of conformal dynamically defined Cantor sets with sum of Hausdorff dimensions HD(K) HD(K') 2 , there is an open and dense subset of such pairs verifying text int (K K') neq emptyset . This is motivated by the work cite MY , where Moreira and Yoccoz proved a similar statement for dynamically defined Cantor sets in the real line. Here we adapt their argument to the context of conformal Cantor sets in the complex plane, this requires the introduction of several new concepts and a more detailed analysis in some parts of the argument.


Probing Image Language Transformers for Verb Understanding. Multimodal image language transformers have achieved impressive results on a variety of tasks that rely on fine tuning (e.g., visual question answering and image retrieval). We are interested in shedding light on the quality of their pretrained representations in particular, if these models can distinguish different types of verbs or if they rely solely on nouns in a given sentence. To do so, we collect a dataset of image sentence pairs (in English) consisting of 421 verbs that are either visual or commonly found in the pretraining data (i.e., the Conceptual Captions dataset). We use this dataset to evaluate pretrained image language transformers and find that they fail more in situations that require verb understanding compared to other parts of speech. We also investigate what category of verbs are particularly challenging.


SanitAIs Unsupervised Data Augmentation to Sanitize Trojaned Neural Networks. The application of self supervised methods has resulted in broad improvements to neural network performance by leveraging large, untapped collections of unlabeled data to learn generalized underlying structure. In this work, we harness unsupervised data augmentation (UDA) to mitigate backdoor or Trojan attacks on deep neural networks. We show that UDA is more effective at removing the effects of a trigger than current state of the art methods for both feature space and point triggers. These results demonstrate that UDA is both an effective and practical approach to mitigating the effects of backdoors on neural networks.


Experimental verification of phase discontinuities induced scintillation enhancement under weak perturbations. We verify the existence of scintillation enhancement by measuring the scintillation index of a beam composed of two coherent Gaussian vortex beams with pm 1 topological charges propagating through thermally induced turbulence. Further experimental research based on the reference wave interferometric method demonstrates that this phenomenon is caused by the combined effect of a screw dislocation and an infinitely extended edge dislocation, namely the impact of an anisotropic dislocation. The experimental results indicate that the anisotropic dislocation is more sensitive to weak perturbations than an isotropic screw dislocation and an infinitely extended edge dislocation, which means the anisotropic dislocation has potential for weak perturbation measurement. This phenomenon is instructive in further phase discontinuity research.


TransFusion Cross view Fusion with Transformer for 3D Human Pose Estimation. Estimating the 2D human poses in each view is typically the first step in calibrated multi view 3D pose estimation. But the performance of 2D pose detectors suffers from challenging situations such as occlusions and oblique viewing angles. To address these challenges, previous works derive point to point correspondences between different views from epipolar geometry and utilize the correspondences to merge prediction heatmaps or feature representations. Instead of post prediction merge calibration, here we introduce a transformer framework for multi view 3D pose estimation, aiming at directly improving individual 2D predictors by integrating information from different views. Inspired by previous multi modal transformers, we design a unified transformer architecture, named TransFusion, to fuse cues from both current views and neighboring views. Moreover, we propose the concept of epipolar field to encode 3D positional information into the transformer model. The 3D position encoding guided by the epipolar field provides an efficient way of encoding correspondences between pixels of different views. Experiments on Human 3.6M and Ski Pose show that our method is more efficient and has consistent improvements compared to other fusion methods. Specifically, we achieve 25.8 mm MPJPE on Human 3.6M with only 5M parameters on 256 x 256 resolution.


Android Security using NLP Techniques A Review. Android is among the most targeted platform by attackers. While attackers are improving their techniques, traditional solutions based on static and dynamic analysis have been also evolving. In addition to the application code, Android applications have some metadata that could be useful for security analysis of applications. Unlike traditional application distribution mechanisms, Android applications are distributed centrally in mobile markets. Therefore, beside application packages, such markets contain app information provided by app developers and app users. The availability of such useful textual data together with the advancement in Natural Language Processing (NLP) that is used to process and understand textual data has encouraged researchers to investigate the use of NLP techniques in Android security. Especially, security solutions based on NLP have accelerated in the last 5 years and proven to be useful. This study reviews these proposals and aim to explore possible research directions for future studies by presenting state of the art in this domain. We mainly focus on NLP based solutions under four categories description to behaviour fidelity, description generation, privacy and malware detection.


Experimental check of model of object innovation evaluation. The article discusses the approach for evaluating the innovation index of the products and technologies. The evaluation results can be used to create a warehouse of the object descriptions with significant innovation potential. The model of innovation index computation is based on the concepts of novelty, relevance, and implementability of the object. Formal definitions of these indicators are given and a methodology for their calculation are described. The fuzzy methods to coprocess (incomplete) data from numerous sources and to obtain probabilistic innovation assessments are used. The experimental data of the model check including the calculations of local criteria and global additive evaluation criterion are presented. The cyclical nature of dynamic changes in indicators, their interdependence was established, some general features of the products promotion were found. The obtained experimental data are consistent with expert estimates of the products under study. The analysis of the local criteria used in the research gives grounds to assert the correct use of the additive n dimensional utility function. The adequacy of assumptions and formal expressions that are used in computational algorithms for selection information for data warehouse is confirmed.


On the Success Probability of Three Detectors for the Box Constrained Integer Linear Model. This paper is concerned with detecting an integer parameter vector inside a box from a linear model that is corrupted with a noise vector following the Gaussian distribution. One of the commonly used detectors is the maximum likelihood detector, which is obtained by solving a box constrained integer least squares problem, that is NP hard. Two other popular detectors are the box constrained rounding and Babai detectors due to their high efficiency of implementation. In this paper, we first present formulas for the success probabilities (the probabilities of correct detection) of these three detectors for two different situations the integer parameter vector is deterministic and is uniformly distributed over the constraint box. Then, we give two simple examples to respectively show that the success probability of the box constrained rounding detector can be larger than that of the box constrained Babai detector and the latter can be larger than the success probability of the maximum likelihood detector when the parameter vector is deterministic, and prove that the success probability of the box constrained rounding detector is always not larger than that of the box constrained Babai detector when the parameter vector is uniformly distributed over the constraint box. Some relations between the results for the box constrained and ordinary cases are presented, and two bounds on the success probability of the maximum likelihood detector, which can easily be computed, are developed. Finally, simulation results are provided to illustrate our main theoretical findings.


Algorithms for reachability problems on stochastic Markov reward models. Probabilistic model checking is a field which seeks to automate the formal analysis of probabilistic models such as Markov chains. In this thesis, we study and develop the stochastic Markov reward model (sMRM) which extends the Markov chain with rewards as random variables. The model recently being introduced, does not have much in the way of techniques and algorithms for their analysis. The purpose of this study is to derive such algorithms that are both scalable and accurate. Additionally, we derive the necessary theory for probabilistic model checking of sMRMs against existing temporal logics such as PRCTL. We present the equations for computing textit first passage reward densities , textit expected value problems , and other textit reachability problems . Our focus however is on finding strictly numerical solutions for textit first passage reward densities . We solve for these by firstly adapting known direct linear algebra algorithms such as Gaussian elimination, and iterative methods such as the power method, Jacobi and Gauss Seidel. We provide solutions for both discrete reward sMRMs, where all rewards discrete (lattice) random variables. And also for continuous reward sMRMs, where all rewards are strictly continuous random variables, but not necessarily having continuous probability density functions (pdfs). Our solutions involve the use of fast Fourier transform (FFT) for faster computation, and we adapted existing quadrature rules for convolution to gain more accurate solutions, rules such as the trapezoid rule, Simpson's rule or Romberg's method.


Crowdsourcing through Cognitive Opportunistic Networks. Untile recently crowdsourcing has been primarily conceived as an online activity to harness resources for problem solving. However the emergence of opportunistic networking (ON) has opened up crowdsourcing to the spatial domain. In this paper we bring the ON model for potential crowdsourcing in the smart city environment. We introduce cognitive features to the ON that allow users' mobile devices to become aware of the surrounding physical environment. Specifically, we exploit cognitive psychology studies on dynamic memory structures and cognitive heuristics, i.e. mental models that describe how the human brain handle decision making amongst complex and real time stimuli. Combined with ON, these cognitive features allow devices to act as proxies in the cyber world of their users and exchange knowledge to deliver awareness of places in an urban environment. This is done through tags associated with locations. They represent features that are perceived by humans about a place. We consider the extent to which this knowledge becomes available to participants, using interactions with locations and other nodes. This is assessed taking into account a wide range of cognitive parameters. Outcomes are important because this functionality could support a new type of recommendation system that is independent of the traditional forms of networking.


Rethinking of AlphaStar. We present a different view for AlphaStar (AS), the program achieving Grand Master level in the game StarCraft II. It is considered big progress for AI research. However, in this paper, we present problems with the AS, some of which are the defects of it, and some of which are important details that are neglected in its article. These problems arise two questions. One is that what can we get from the built of AS? The other is that does the battle between it with humans fair? After the discussion, we present the future research directions for these problems. Our study is based on a reproduction code of the AS, and the codes are available online.


Quantifying identifiability to choose and audit epsilon in differentially private deep learning. Differential privacy allows bounding the influence that training data records have on a machine learning model. To use differential privacy in machine learning, data scientists must choose privacy parameters ( epsilon, delta) . Choosing meaningful privacy parameters is key, since models trained with weak privacy parameters might result in excessive privacy leakage, while strong privacy parameters might overly degrade model utility. However, privacy parameter values are difficult to choose for two main reasons. First, the theoretical upper bound on privacy loss ( epsilon, delta) might be loose, depending on the chosen sensitivity and data distribution of practical datasets. Second, legal requirements and societal norms for anonymization often refer to individual identifiability, to which ( epsilon, delta) are only indirectly related. We transform ( epsilon, delta) to a bound on the Bayesian posterior belief of the adversary assumed by differential privacy concerning the presence of any record in the training dataset. The bound holds for multidimensional queries under composition, and we show that it can be tight in practice. Furthermore, we derive an identifiability bound, which relates the adversary assumed in differential privacy to previous work on membership inference adversaries. We formulate an implementation of this differential privacy adversary that allows data scientists to audit model training and compute empirical identifiability scores and empirical ( epsilon, delta) .


Optimal Quaternary (r,delta) Locally Repairable Codes Achieving the Singleton type Bound. Locally repairable codes enables fast repair of node failure in a distributed storage system. The code symbols in a codeword are stored in different storage nodes, such that a disk failure can be recovered by accessing a small fraction of the storage nodes. The number of storage nodes that are contacted during the repair of a failed node is a parameter called locality. We consider locally repairable codes that can be locally recovered in the presence of multiple node failures. The punctured code obtained by removing the code symbols in the complement of a repair group is called a local code. We aim at designing a code such that all local codes have a prescribed minimum distance, so that any node failure can be repaired locally, provided that the total number of node failures is less than the tolerance parameter. We consider linear locally repairable codes defined over a finite field of size four. This alphabet has characteristic 2, and hence is amenable to practical implementation. We classify all quaternary locally repairable codes that attain the Singleton type upper bound for minimum distance. For each combination of achievable code parameters, an explicit code construction is given.


Blockumulus A Scalable Framework for Smart Contracts on the Cloud. Public blockchains have spurred the growing popularity of decentralized transactions and smart contracts, but they exhibit limitations on the transaction throughput, storage, and computation. To avoid transaction gridlock, public blockchains impose large fees and per block resource limits, making it difficult to accommodate the ever growing transaction demand. Previous research endeavors to improve the scalability of blockchain through various technologies, such as side chaining, sharding, secured off chain computation, communication network optimizations, and efficient consensus protocols. However, these approaches have not attained a widespread adoption due to their inability in delivering a cloud like performance, in terms of the scalability in transaction throughput, storage, and compute capacity. In this work, we determine that the major obstacle to public blockchain scalability is their underlying unstructured P2P networks. We further show that a centralized network can support the deployment of decentralized smart contracts. We propose a novel approach for achieving scalable decentralization instead of trying to make blockchain scalable, we deliver decentralization to already scalable cloud by using an Ethereum smart contract. We introduce Blockumulus, a framework that can deploy decentralized cloud smart contract environments using a novel technique called overlay consensus. Through experiments, we demonstrate that Blockumulus is scalable in all three dimensions computation, data storage, and transaction throughput. Besides eliminating the current code execution and storage restrictions, Blockumulus delivers a transaction latency between 2 and 5 seconds under normal load. Moreover, the stress test of our prototype reveals the ability to execute 20,000 simultaneous transactions under 26 seconds, which is on par with the average throughput of worldwide credit card transactions.


Varieties of semiassociative relation algebras and tense algebras. It is well known that the subvariety lattice of the variety of relation algebras has exactly three atoms. The (join irreducible) covers of two of these atoms are known, but a complete classification of the (join irreducible) covers of the remaining atom has not yet been found. These statements are also true of a related subvariety lattice, namely the subvariety lattice of the variety of semiassociative relation algebras. The present article shows that this atom has continuum many covers in this subvariety lattice (and in some related subvariety lattices) using a previously established term equivalence between a variety of tense algebras and a variety of semiassociative r algebras.


The mathrm Br mathrm Br ' question for some classifying stacks. In this paper we consider the mathrm Br mathrm Br ' question for classifying stacks by various group schemes. These are algebraic stacks that do not necessarily admit a finite flat cover by a scheme for which mathrm Br mathrm Br ' holds, hence are not amenable to the usual argument of pushing forward a twisted vector bundle. We provide two classes of examples satisfying mathrm Br ne mathrm Br ' that do not "arise from" the scheme case.


On particular examples of planar integral point sets and their classification. A planar integral point set is a set of non collinear points in plane such that for any pair of the points the Euclidean distance between the points is integral. We discuss the classification of planar integral point sets and provide examples of sets that are not covered by the existent classification.


Twin width and polynomial kernels. We study the existence of polynomial kernels, for parameterized problems without a polynomial kernel on general graphs, when restricted to graphs of bounded twin width. Our main result is that a polynomial kernel for k Dominating Set on graphs of twin width at most 4 would contradict a standard complexity theoretic assumption. The reduction is quite involved, especially to get the twin width upper bound down to 4, and can be tweaked to work for Connected k Dominating Set and Total k Dominating Set (albeit with a worse upper bound on the twin width). The k Independent Set problem admits the same lower bound by a much simpler argument, previously observed ICALP '21 , which extends to k Independent Dominating Set, k Path, k Induced Path, k Induced Matching, etc. On the positive side, we obtain a simple quadratic vertex kernel for Connected k Vertex Cover and Capacitated k Vertex Cover on graphs of bounded twin width. Interestingly the kernel applies to graphs of Vapnik Chervonenkis density 1, and does not require a witness sequence. We also present a more intricate O(k 1.5 ) vertex kernel for Connected k Vertex Cover. Finally we show that deciding if a graph has twin width at most 1 can be done in polynomial time, and observe that most optimization decision graph problems can be solved in polynomial time on graphs of twin width at most 1.


Few shot Keypoint Detection with Uncertainty Learning for Unseen Species. Current non rigid object keypoint detectors perform well on a chosen kind of species and body parts, and require a large amount of labelled keypoints for training. Moreover, their heatmaps, tailored to specific body parts, cannot recognize novel keypoints (keypoints not labelled for training) on unseen species. We raise an interesting yet challenging question how to detect both base (annotated for training) and novel keypoints for unseen species given a few annotated samples? Thus, we propose a versatile Few shot Keypoint Detection (FSKD) pipeline, which can detect a varying number of keypoints of different kinds. Our FSKD provides the uncertainty estimation of predicted keypoints. Specifically, FSKD involves main and auxiliary keypoint representation learning, similarity learning, and keypoint localization with uncertainty modeling to tackle the localization noise. Moreover, we model the uncertainty across groups of keypoints by multivariate Gaussian distribution to exploit implicit correlations between neighboring keypoints. We show the effectiveness of our FSKD on (i) novel keypoint detection for unseen species, and (ii) few shot Fine Grained Visual Recognition (FGVR) and (iii) Semantic Alignment (SA) downstream tasks. For FGVR, detected keypoints improve the classification accuracy. For SA, we showcase a novel thin plate spline warping that uses estimated keypoint uncertainty under imperfect keypoint corespondences.


Lyric document embeddings for music tagging. We present an empirical study on embedding the lyrics of a song into a fixed dimensional feature for the purpose of music tagging. Five methods of computing token level and four methods of computing document level representations are trained on an industrial scale dataset of tens of millions of songs. We compare simple averaging of pretrained embeddings to modern recurrent and attention based neural architectures. Evaluating on a wide range of tagging tasks such as genre classification, explicit content identification and era detection, we find that averaging word embeddings outperform more complex architectures in many downstream metrics.


Hyperbolic compartmental models for epidemic spread on networks with uncertain data application to the emergence of Covid 19 in Italy. The importance of spatial networks in the spread of an epidemic is an essential aspect in modeling the dynamics of an infectious disease. Additionally, any realistic data driven model must take into account the large uncertainty in the values reported by official sources, such as the amount of infectious individuals. In this paper we address the above aspects through a hyperbolic compartmental model on networks, in which nodes identify locations of interest, such as cities or regions, and arcs represent the ensemble of main mobility paths. The model describes the spatial movement and interactions of a population partitioned, from an epidemiological point of view, on the basis of an extended compartmental structure and divided into commuters, moving on a suburban scale, and non commuters, acting on an urban scale. Through a diffusive rescaling, the model allows us to recover classical diffusion equations related to commuting dynamics. The numerical solution of the resulting multiscale hyperbolic system with uncertainty is then tackled using a stochastic collocation approach in combination with a finite volume IMEX method. The ability of the model to correctly describe the spatial heterogeneity underlying the spread of an epidemic in a realistic city network is confirmed with a study of the outbreak of COVID 19 in Italy and its spread in the Lombardy Region.


physics.flu-dyn cs.NA math.NA physics.comp-ph

On recovering the second order convergence of the lattice Boltzmann method with reaction type source terms. This study analyses a method to consistently recover the second order convergence of the lattice Boltzmann method (LBM), which is frequently degraded by the improper discretisation of required source terms. The work focuses on advection diffusion models in which the source terms are dependent on the intensity of transported fields. The main findings are applicable to a wide range of formulations within the LBM framework. All considered source terms are interpreted as contributions to the zeroth moment of the distribution function. These account for sources in a scalar field, such as density, concentration or temperature. In addition to this, certain immersed boundary methods can be interpreted as a source term in their formulation, highlighting a further application for this work. This paper is dedicated to three aspects regarding proper inclusion of the source term in LBM schemes. Firstly, it identifies the differences observed between the ways source terms are included in the LBM schemes present in the literature. The algebraic manipulations are explicitly presented in this paper to clarify the differences observed, and identify their origin. Secondly, it analyses in full detail, the implicit relation between the value of the transported macroscopic field, and the sum of the LBM densities. Moreover, three equivalent forms of the collision operator are presented. Finally, closed form solutions of this implicit relation are shown for a variety of common models. The second order convergence of the proposed LBM schemes is verified on both linear and non linear source terms. The pitfalls of the commonly used acoustic and diffusive scaling are identified and discussed. Moreover, for a simplified case, the competing errors are shown visually with isolines of error in the space of spatial and temporal resolutions.


Stability of Poincar 'e constant. We study stability of the sharp Poincar 'e constant of the invariant probability measure of a reversible diffusion process satisfying some natural conditions. The proof is based on the spectral interpretation of Poincar 'e inequalities and Stein's method. In particular, these results are applied to the gamma distributions and to strictly log concave measures in dimension one, giving stability for Brascamp Lieb inequalities.


Meta fences blocking waves utilizing a layer of identical tiny scatters. Wave steering by artificial materials (for example, phononic crystals and acoustic metamaterials) is a fascinating frontier in modern physics and engineering, but suffers from bulky sizes and intractable challenges in fabrication. Here, a sparse layer of identical tiny scatters, which we call meta fences, is presented with a non destructive way to omnidirectionally block flexural waves in plates. The underlying mechanism is that the restraining force and moment of the scatter are tuned simultaneously to counter balance the incident wave. Both our experimental results and numerical analysis have demonstrated that broadband wave sources ranging from 3 to 7 kHz can be segregated from the protected area by the meta fence. In addition, the meta fence is further assembled into a waveguide routing with an arbitrary configuration. Compared with previous isolators and waveguides, our meta fences exhibit absolute advantages in compact size, flexible configuration, and high structural strength. The current scenario sheds light on the design of lightweight and strong architectures for vibration control and energy harvesting with a high efficiency, and can be extended to microfluidics, acoustics, seismology and other fields.


Robustness Evaluation of Transformer based Form Field Extractors via Form Attacks. We propose a novel framework to evaluate the robustness of transformer based form field extraction methods via form attacks. We introduce 14 novel form transformations to evaluate the vulnerability of the state of the art field extractors against form attacks from both OCR level and form level, including OCR location order rearrangement, form background manipulation and form field value augmentation. We conduct robustness evaluation using real invoices and receipts, and perform comprehensive research analysis. Experimental results suggest that the evaluated models are very susceptible to form perturbations such as the variation of field values ( 15 drop in F1 score), the disarrangement of input text order( 15 drop in F1 score) and the disruption of the neighboring words of field values( 10 drop in F1 score). Guided by the analysis, we make recommendations to improve the design of field extractors and the process of data collection.


Linear and dynamic programs for risk sensitive cost minimization. We derive equivalent linear and dynamic programs for infinite horizon risk sensitive control for minimization of the asymptotic growth rate of the cumulative cost.


Heteroclinic traveling waves of 1D parabolic systems with degenerate stable states. We study the existence of traveling waves for the parabolic system begin equation partial t w partial x 2 w nabla mathbf u W(w) mbox in 0, infty) times mathbb R 2 end equation where W is a potential bounded below and possessing two minima at textit different levels . We say that mathfrak w is a traveling wave solution of the previous equation if there exist c star 0 and mathfrak u in mathcal C 2( mathbb R , mathbb R k) such that mathfrak w (t,x) mathfrak u (x ct) . For a class of potentials W , heteroclinic traveling waves of the previous equation where shown to exist by Alikakos and Katzourakis cite alikakos katzourakis . More precisely, assuming the existence of two local minimizers of W at textit different levels which, in addition, satisfy some non degeneracy assumptions, the authors in cite alikakos katzourakis show the existence of a speed c star 0 and profile mathfrak u in mathcal C 2( mathbb R , mathbb R k) such that mathfrak u connects the two local minimizers at infinity. In this paper, we show that the non degeneracy assumption on the local minima can be dropped and replaced by another one which allows for potentials possessing degenerate minima. As we do in cite oliver bonafoux tw , our main result is in fact proven for curves which take values in a general Hilbert space and the main result is deduced as a particular case, in the spirit of the earlier works by Monteil and Santambrogio cite monteil santambrogio and Smyrnelis cite smyrnelis devoted to the existence of stationary heteroclinics.


A simple proof of ill posedness for incompressible Euler equations in critical Sobolev spaces. We provide a simple proof that the Cauchy problem for the incompressible Euler equations in mathbb R d with any d ge3 is ill posed in critical Sobolev spaces, extending an earlier work of Bourgain and Li in the case d 3 . The ill posedness is shown for certain critical Lorentz spaces as well.


Compilation based Solvers for Multi Agent Path Finding a Survey, Discussion, and Future Opportunities. Multi agent path finding (MAPF) attracts considerable attention in artificial intelligence community as well as in robotics, and other fields such as warehouse logistics. The task in the standard MAPF is to find paths through which agents can navigate from their starting positions to specified individual goal positions. The combination of two additional requirements makes the problem computationally challenging (i) agents must not collide with each other and (ii) the paths must be optimal with respect to some objective. Two major approaches to optimal MAPF solving include (1) dedicated search based methods, which solve MAPF directly, and (2) compilation based methods that reduce a MAPF instance to an instance in a different well established formalism, for which an efficient solver exists. The compilation based MAPF solving can benefit from advancements accumulated during the development of the target solver often decades long. We summarize and compare contemporary compilation based solvers for MAPF using formalisms like ASP, MIP, and SAT. We show the lessons learned from past developments and current trends in the topic and discuss its wider impact.


Nonabelian Extensions and Factor Systems for the Algebras of Loday. Factor systems are a tool for working on the extension problem of algebraic structures such as groups, Lie algebras, and associative algebras. Their applications are numerous and well known in these common settings. We construct mathscr P algebra analogues to a series of results from W. R. Scott's textit Group Theory , which gives an explicit theory of factor systems for the group case. Here mathscr P ranges over Leibniz, Zinbiel, diassociative, and dendriform algebras, which we dub "the algebras of Loday," as well as over Lie, associative, and commutative algebras. Fixing a pair of mathscr P algebras, we develop a correspondence between factor systems and extensions. This correspondence is strengthened by the fact that equivalence classes of factor systems correspond to those of extensions. Under this correspondence, central extensions give rise to 2 cocycles while split extensions give rise to (nonabelian) 2 coboundaries.


Geometry Aware Unsupervised Domain Adaptation for Stereo Matching. Recently proposed DNN based stereo matching methods that learn priors directly from data are known to suffer a drastic drop in accuracy in new environments. Although supervised approaches with ground truth disparity maps often work well, collecting them in each deployment environment is cumbersome and costly. For this reason, many unsupervised domain adaptation methods based on image to image translation have been proposed, but these methods do not preserve the geometric structure of a stereo image pair because the image to image translation is applied to each view separately. To address this problem, in this paper, we propose an attention mechanism that aggregates features in the left and right views, called Stereoscopic Cross Attention (SCA). Incorporating SCA to an image to image translation network makes it possible to preserve the geometric structure of a stereo image pair in the process of the image to image translation. We empirically demonstrate the effectiveness of the proposed unsupervised domain adaptation based on the image to image translation with SCA.


Simple Stochastic Games with Almost Sure Energy Parity Objectives are in NP and coNP. We study stochastic games with energy parity objectives, which combine quantitative rewards with a qualitative omega regular condition The maximizer aims to avoid running out of energy while simultaneously satisfying a parity condition. We show that the corresponding almost sure problem, i.e., checking whether there exists a maximizer strategy that achieves the energy parity objective with probability 1 when starting at a given energy level k , is decidable and in NP cap coNP . The same holds for checking if such a k exists and if a given k is minimal.


Morse hyper graphs of topological spaces and decompositions. The cell complex structure is one of the most fundamental structures in topology and combinatorics, the Morse decomposition of a dynamical system analyzes the global gradient behavior, and the Reeb graph of a function is an elementary tool in Morse theory to represent the global connection and is also used to analyze continuous and discrete data in topological data analysis. In this paper, we unify three concepts of cell complexes, Morse decompositions, and Reeb graphs into a concept. In fact, we introduce topological invariants for topological spaces and decompositions, which are analogous to abstract (weak) orbit spaces and Morse graphs for flows. To achieve these, we define analogous concepts of recurrence and "chain recurrence" for topological spaces and decompositions such that the original and new recurrences correspond to each other for a flow orbits on a locally compact Hausdorff space and the orbit space. We show that the Morse hyper graphs exist for any topological spaces and any invariant decompositions (e.g. compact foliated spaces). Moreover, the abstract weak element spaces generalize the Reeb graphs of Morse functions and the Morse (hyper )graphs and refine abstract cell complexes.


The Optimization of Signed Trees. A signed graph G is a graph where each edge is assigned a (positive edge) or a (negative edge). The signed degree of a vertex v in a signed graph, denoted by sdeg(v) , is the number of positive edges incident to v subtracted by the number of negative edges incident to v . Finally, we say G realizes the set D if D sdeg(v) text v in V(G) . The topic of signed degree sets and signed degree sequences has been studied from many directions. In this paper, we study properties needed for signed trees to have a given signed degree set. We start by proving that D is the signed degree set of a tree if and only if 1 in D or 1 in D . Further, for every valid set D , we find the smallest diameter that a tree must have to realize D . Lastly, for valid sets D with nonnegative numbers, we find the smallest order that a tree must have to realize D .


Spoofing Attacks Against Vehicular FMCW Radar. The safety and security of the passengers in vehicles in the face of cyber attacks is a key element in the automotive industry, especially with the emergence of the Advanced Driver Assistance Systems (ADAS) and the vast improvement in Autonomous Vehicles (AVs). Such platforms use various sensors, including cameras, LiDAR and mmWave radar. These sensors themselves may present a potential security hazard if exploited by an attacker. In this paper we propose a system to attack an automotive FMCW mmWave radar, that uses fast chirp modulation. Using a single rogue radar, our attack system is capable of spoofing the distance and velocity measured by the victim vehicle simultaneously, presenting phantom measurements coherent with the laws of physics governing vehicle motion. The attacking radar controls the delay in order to spoof its distance, and uses phase compensation and control in order to spoof its velocity. After developing the attack theory, we demonstrate the spoofing attack by building a proof of concept hardware based system, using a Software Defined Radio. We successfully demonstrate two real world scenarios in which the victim radar is spoofed to detect either a phantom emergency stop or a phantom acceleration, while measuring coherent range and velocity. We also discuss several countermeasures to the attack, in order to propose ways to mitigate the described attack.


First order Hardy inequalities revisited. In this paper, we consider the first order Hardy inequalities using simple equalities. This basic setting not only permits to derive quickly many well known Hardy inequalities with optimal constants, but also supplies improved or new estimates in miscellaneous situations, such as multipolar potential, the exponential weight, hyperbolic space, Heisenberg group, the edge Laplacian, or the Grushin type operator.


Labels, Information, and Computation Efficient, Privacy Preserving Learning Using Sufficient Labels. In supervised learning, obtaining a large set of fully labeled training data is expensive. We show that we do not always need full label information on every single training example to train a competent classifier. Specifically, inspired by the principle of sufficiency in statistics, we present a statistic (a summary) of the fully labeled training set that captures almost all the relevant information for classification but at the same time is easier to obtain directly. We call this statistic "sufficiently labeled data" and prove its sufficiency and efficiency for finding the optimal hidden representations, on which competent classifier heads can be trained using as few as a single randomly chosen fully labeled example per class. Sufficiently labeled data can be obtained from annotators directly without collecting the fully labeled data first. And we prove that it is easier to directly obtain sufficiently labeled data than obtaining fully labeled data. Furthermore, sufficiently labeled data naturally preserves user privacy by storing relative, instead of absolute, information. Extensive experimental results are provided to support our theory.


Convolutional Neural Network Simplification with Progressive Retraining. Kernel pruning methods have been proposed to speed up, simplify, and improve explanation of convolutional neural network (CNN) models. However, the effectiveness of a simplified model is often below the original one. In this letter, we present new methods based on objective and subjective relevance criteria for kernel elimination in a layer by layer fashion. During the process, a CNN model is retrained only when the current layer is entirely simplified, by adjusting the weights from the next layer to the first one and preserving weights of subsequent layers not involved in the process. We call this strategy emph progressive retraining , differently from kernel pruning methods that usually retrain the entire model after each simplification action e.g., the elimination of one or a few kernels. Our subjective relevance criterion exploits the ability of humans in recognizing visual patterns and improves the designer's understanding of the simplification process. The combination of suitable relevance criteria and progressive retraining shows that our methods can increase effectiveness with considerable model simplification. We also demonstrate that our methods can provide better results than two popular ones and another one from the state of the art using four challenging image datasets.


Three dimensional simulations of embolic stroke clinical comparisons and an equation for sizing emboli from imaging. There is a need to develop Monte Carlo simulations of stroke to run in silico trials to replace animal models, explore clinical scenarios to develop hypotheses for clinical studies and for interpreting clinical monitoring. We perform three dimensional (3D) stroke simulations, carrying out in silico trials to relate lesion volume to embolus diameter and calculate probabilistic lesion overlap maps, building on our previous Monte Carlo method. Simulated emboli were released into a 3D in silico vasculature, supplying gray and white matter brain volumes, to generate individual lesion estimates and probabilistic lesion overlap maps. Computer generated lesions were assessed by clinicians and compared with real world radiological images. Simulations of large single emboli reproduced similar middle cerebral artery (MCA), posterior cerebral artery (PCA) and anterior cerebral artery (ACA) lesions to those observed clinically. A proof of concept in silico trial led to a conjecture relating estimated infarct volume as a percentage of total brain volume to relative embolus diameter mathrm relative diameter mathrm infarct volume a 1 b , where a 104.2 pm 0.98 , b 3.380 pm 0.030 . Probabilistic lesion overlap maps were created, confirming the MCA territory as the most probable resting place of emboli in the computational vasculature, followed by the PCA then ACA. The article shows proof of concept for developing a 3D stroke model from an automatically constructed vasculature.


Insights Into Incitement A Computational Perspective on Dangerous Speech on Twitter in India. Dangerous speech on social media platforms can be framed as blatantly inflammatory, or be couched in innuendo. It is also centrally tied to who engages it it can be driven by openly sectarian social media accounts, or through subtle nudges by influential accounts, allowing for complex means of reinforcing vilification of marginalized groups, an increasingly significant problem in the media environment in the Global South. We identify dangerous speech by influential accounts on Twitter in India around three key events, examining both the language and networks of messaging that condones or actively promotes violence against vulnerable groups. We characterize dangerous speech users by assigning Danger Amplification Belief scores and show that dangerous users are more active on Twitter as compared to other users as well as most influential in the network, in terms of a larger following as well as volume of verified accounts. We find that dangerous users have a more polarized viewership, suggesting that their audience is more susceptible to incitement. Using a mix of network centrality measures and qualitative analysis, we find that most dangerous accounts tend to either be in mass media related occupations or allied with low ranking, right leaning politicians, and act as "broadcasters" in the network, where they are best positioned to spearhead the rapid dissemination of dangerous speech across the platform.


Germ typicality of the coexistence of infinitely many sinks. In the spirit of Kolmogorov typicality, we introduce the notion of germ typicality in a space of dynamics, it encompass all these phenomena that occur for a dense and open subset of parameters of any generic parametrized family of systems. For any 2 le r infty , we prove that the Newhouse phenomenon (the coexistence of infinitely many sinks) is locally C r germ typical, nearby a dissipative bicycle a dissipative homoclinic tangency linked to a special heterodimensional cycle. During the proof we show a result of independent interest the stabilization of some heterodimensional cycles for any regularity class r in 1, dots, infty cup omega by introducing a new renormalization scheme. We also continue the study of the paradynamics done in Be15,Be17,BCP16 and prove that parablenders appear by unfolding some heterodimensional cycles.


A Multi Hypothesis Approach to Pose Ambiguity in Object Based SLAM. In object based Simultaneous Localization and Mapping (SLAM), 6D object poses offer a compact representation of landmark geometry useful for downstream planning and manipulation tasks. However, measurement ambiguity then arises as objects may possess complete or partial object shape symmetries (e.g., due to occlusion), making it difficult or impossible to generate a single consistent object pose estimate. One idea is to generate multiple pose candidates to counteract measurement ambiguity. In this paper, we develop a novel approach that enables an object based SLAM system to reason about multiple pose hypotheses for an object, and synthesize this locally ambiguous information into a globally consistent robot and landmark pose estimation formulation. In particular, we (1) present a learned pose estimation network that provides multiple hypotheses about the 6D pose of an object (2) by treating the output of our network as components of a mixture model, we incorporate pose predictions into a SLAM system, which, over successive observations, recovers a globally consistent set of robot and object (landmark) pose estimates. We evaluate our approach on the popular YCB Video Dataset and a simulated video featuring YCB objects. Experiments demonstrate that our approach is effective in improving the robustness of object based SLAM in the face of object pose ambiguity.


A collection of results relating the geometry of plane domains and the exit time of planar Brownian motion. We prove a number of results relating exit times of planar Brownian with the geometric properties of the domains in question. Included are proofs of the conformal invariance of moduli of rectangles and annuli using Brownian motion similarly probabilistic proofs of some recent results of Karafyllia on harmonic measure on starlike domains examples of domains and their complements which are simultaneously large when measured by the moments of exit time of Brownian motion, and examples of domains and their complements which are simultaneously small and proofs of several identities involving the Cauchy distribution using the optional stopping theorem.


IM META Influence Maximization Using Node Metadata in Networks With Unknown Topology. In real world applications of influence maximization (IM), the network structure is often unknown. In this case, we may identify the most influential seed nodes by exploring only a part of the underlying network given a small budget for node queries. Motivated by the fact that collecting node metadata is more cost effective than investigating the relationship between nodes via queried nodes, we develop IM META, an end to end solution to IM in networks with unknown topology by retrieving information from both queries and node metadata. However, using such metadata to aid the IM process is not without risk due to the noisy nature of metadata and uncertainties in connectivity inference. To tackle these challenges, we formulate an IM problem that aims to find two sets, i.e., seed nodes and queried nodes. We propose an effective method that iteratively performs three steps 1) we learn the relationship between collected metadata and edges via a Siamese neural network model, 2) we select a number of inferred influential edges to construct a reinforced graph used for discovering an optimal seed set, and 3) we identify the next node to query by maximizing the inferred influence spread using a topology aware ranking strategy. By querying only 5 of nodes, IM META reaches 93 of the upper bound performance.


Reinit Evaluating the Performance of Global Restart Recovery Methods For MPI Fault Tolerance. Scaling supercomputers comes with an increase in failure rates due to the increasing number of hardware components. In standard practice, applications are made resilient through checkpointing data and restarting execution after a failure occurs to resume from the latest check point. However, re deploying an application incurs overhead by tearing down and re instating execution, and possibly limiting checkpointing retrieval from slow permanent storage. In this paper we present Reinit , a new design and implementation of the Reinit approach for global restart recovery, which avoids application re deployment. We extensively evaluate Reinit contrasted with the leading MPI fault tolerance approach of ULFM, implementing global restart recovery, and the typical practice of restarting an application to derive new insight on performance. Experimentation with three different HPC proxy applications made resilient to withstand process and node failures shows that Reinit recovers much faster than restarting, up to 6x, or ULFM, up to 3x, and that it scales excellently as the number of MPI processes grows.


Determining a priori a RANS model's applicable range via global epistemic uncertainty quantification. Calibrating a Reynolds averaged Navier Stokes (RANS) model against data leads to an improvement. Determining it a priori if such an improvement generalizes to flows outside the calibration data is an outstanding challenge. This work attempts to address this challenge via global epistemic Uncertainty Quantification (UQ). Unlike the available epistemic UQ methods that are local and tell us a model's uncertainty at one specific flow condition, the global epistemic UQ method presented in this work tells us also whether a perturbation of the original model would generalize. Specifically, the global epistemic UQ method evaluates a potential improvement in terms of its "effectiveness" and "inconsistency". Any improvement can be put in one of the following four quadrants first, high effectiveness, low inconsistency second, high effectiveness, high inconsistency third, low effectiveness, low inconsistency and fourth, low effectiveness, high inconsistency. An improvement would generalize if and only if it is in the high effectiveness and low inconsistency quadrant. To demonstrate the concept, we apply the global epistemic UQ to full Reynolds stress modeling of a stratified shear layer. The global epistemic UQ results point to a model coefficient in the pressure strain correlation closure (among others) as effective and consistent for predicting the quantity of interest of shear layer's growth. We calibrate the model coefficient such that our RANS matches direct numerical simulation data at one flow condition. We show that the calibrated model generalizes to several other test flow conditions. On the other hand, when calibrating a high inconsistency term, we get a model that works at only the calibrated condition.