Comment on "A compilation and bioenergetic evaluation of syntrophic microbial growth yields in anaerobic digestion" by Pat 'on, M. and Rodr 'iguez, J. Water Research 162 (2019), 516 517 . Recent efforts have focused on providing a systematic analysis of syntrophic microbial growth yields. These biokinetic parameters are key to developing an accurate mathematical description of the anaerobic digestion process. The agreement between experimentally determined growth yields and those obtained from bioenergetic estimations is therefore of great interest. Considering five important syntrophic groups, including acetoclastic and hydrogenotrophic methanogens, as well as propionate, butyrate and lactate oxidizers, previous findings suggest that measured and estimated growth yields were consistent only for acetoclastic methanogens. A re analysis revealed that data are also consistent for lactate oxidizers and hydrogenotrophic methanogens, whereas the limited data available for propionate and butyrate oxidizers are unsupportive of firm conclusions. These results highlight pertinent challenges in the analysis of microbial syntrophy and encourage more accurate measurements of syntrophic microbial growth yields in the future.


Global Parabolic Induction and Abstract Automorphicity. In arXiv 2011.03313, the author has constructed a category of abstractly automorphic representations for mathrm GL (2) over a function field F . This is a symmetric monoidal Abelian category, constructed with the goal of having the irreducible automorphic representations as its simple objects. The goal of this paper is to systematically study this category. We will prove several structural theorems about this category. We will show that it admits an adjoint pair (r mathrm aut ,i mathrm aut ) of automorphic parabolic restriction and induction functors, respectively. This will allow us to show that the category of abstractly automorphic representations decomposes into cuspidal and Eisenstein components, in analogy with the Bernstein decomposition of the category of p adic representations. Moreover, along the way, we will give a new perspective on the intertwining operator of mathrm GL (2) (and on the functional equation for Eisenstein series), as a form of self duality of the functor of parabolic induction. We will also illustrate how the role of analytic continuation in this theory can be thought of as trivializing a twist by a certain line bundle, which corresponds to an L function via the results of arXiv 2012.03068. If one chooses to keep the twist as a part of the theory, then one avoids the need for analytic continuation.


Coordination of two robotic manipulators for object retrieval in clutter. We consider the problem of retrieving a target object from a confined space by two robotic manipulators where overhand grasps are not allowed. If other movable obstacles occlude the target, more than one object should be relocated to clear the path to reach the target object. With two robots, the relocation could be done efficiently by simultaneously performing relocation tasks. However, the precedence constraint between the tasks (e.g, some objects at the front should be removed to manipulate the objects in the back) makes the simultaneous task execution difficult. We propose a coordination method that determines which robot relocates which object so as to perform tasks simultaneously. Given a set of objects to be relocated, the objective is to maximize the number of turn takings of the robots in performing relocation tasks. Thus, one robot can pick an object in the clutter while the other robot places an object in hand to the outside of the clutter. However, the object to be relocated may not be accessible to all robots, so taking turns could not always be achieved. Our method is based on the optimal uniform cost search so the number of turn takings is proven to be maximized. We also propose a greedy variant whose computation time is shorter. From experiments, we show that our method reduces the completion time of the mission by at least 22.9 (at most 27.3 ) compared to the methods with no consideration of turn taking.


On Mixed Iterated Revisions. Several forms of iterable belief change exist, differing in the kind of change and its strength some operators introduce formulae, others remove them some add formulae unconditionally, others only as additions to the previous beliefs some only relative to the current situation, others in all possible cases. A sequence of changes may involve several of them for example, the first step is a revision, the second a contraction and the third a refinement of the previous beliefs. The ten operators considered in this article are shown to be all reducible to three lexicographic revision, refinement and severe withdrawal. In turn, these three can be expressed in terms of lexicographic revision at the cost of restructuring the sequence. This restructuring needs not to be done explicitly an algorithm that works on the original sequence is shown. The complexity of mixed sequences of belief change operators is also analyzed. Most of them require only a polynomial number of calls to a satisfiability checker, some are even easier.


An alternative reconstruction for WENO schemes with adaptive order. We propose an alternative reconstruction for weighted essentially non oscillatory schemes with adaptive order (WENO AO) for solving hyperbolic conservation laws. The alternative reconstruction has a more concise form than the original WENO AO reconstruction. Moreover, it is a strictly convex combination of polynomials with unequal degrees. Numerical examples show that the alternative reconstruction maintains the accuracy and robustness of the WENO AO schemes.


Deep Autoencoder based Fuzzy C Means for Topic Detection. Topic detection is a process for determining topics from a collection of textual data. One of the topic detection methods is a clustering based method, which assumes that the centroids are topics. The clustering method has the advantage that it can process data with negative representations. Therefore, the clustering method allows a combination with a broader representation learning method. In this paper, we adopt deep learning for topic detection by using a deep autoencoder and fuzzy c means called deep autoencoder based fuzzy c means (DFCM). The encoder of the autoencoder performs a lower dimensional representation learning. Fuzzy c means groups the lower dimensional representation to identify the centroids. The autoencoder's decoder transforms back the centroids into the original representation to be interpreted as the topics. Our simulation shows that DFCM improves the coherence score of eigenspace based fuzzy c means (EFCM) and is comparable to the leading standard methods, i.e., nonnegative matrix factorization (NMF) or latent Dirichlet allocation (LDA).


Efficient Passage Retrieval with Hashing for Open domain Question Answering. Most state of the art open domain question answering systems use a neural retrieval model to encode passages into continuous vectors and extract them from a knowledge source. However, such retrieval models often require large memory to run because of the massive size of their passage index. In this paper, we introduce Binary Passage Retriever (BPR), a memory efficient neural retrieval model that integrates a learning to hash technique into the state of the art Dense Passage Retriever (DPR) to represent the passage index using compact binary codes rather than continuous vectors. BPR is trained with a multi task objective over two tasks efficient candidate generation based on binary codes and accurate reranking based on continuous vectors. Compared with DPR, BPR substantially reduces the memory cost from 65GB to 2GB without a loss of accuracy on two standard open domain question answering benchmarks Natural Questions and TriviaQA. Our code and trained models are available at https github.com studio ousia bpr.


Sharp interface limits of the diffuse interface model for two phase inductionless magnetohydrodynamic fluids. In this paper, we propose and analyze a diffuse interface model for inductionless magnetohydrodynamic fluids. The model couples a convective Cahn Hilliard equation for the evolution of the interface, the Navier Stokes system for fluid flow and the possion quation for electrostatics. The model is derived from Onsager's variational principle and conservation laws systematically. We perform formally matched asymptotic expansions and develop several sharp interface models in the limit when the interfacial thickness tends to zero. It is shown that the sharp interface limit of the models are the standard incompressible inductionless magnetohydrodynamic equations coupled with several different interface conditions for different choice of the mobilities. Numerical results verify the convergence of the diffuse interface model with different mobilitiess.


Common hypercyclic vectors and dimension of the parameter set. We investigate the existence of a common hypercyclic vector for a family (T lambda) lambda in Lambda of hypercyclicoperators acting on the same Banach space X . We give positive and negative results involving the dimension of Lambda and the regularity of each map lambda in Lambda mapsto T lambda n x , x in X , n in mathbb N .


Graphs With Minimal Strength. For any graph G of order p , a bijection f V(G) to 1,p is called a numbering of the graph G of order p . The strength str f(G) of a numbering f V(G) to 1,p of G is defined by str f(G) max f(u) f(v) uv in E(G) , and the strength str(G) of a graph G itself is str(G) min str f(G) f mbox is a numbering of G . A numbering f is called a strength labeling of G if str f(G) str(G) . In this paper, we obtained a sufficient condition for a graph to have str(G) V(G) d(G) . Consequently, many questions raised in Bounds for the strength of graphs, it Aust. J. Combin. bf72(3) , (2018) 492 508 and On the strength of some trees, it AKCE Int. J. Graphs Comb. (Online 2019) doi.org 10.1016 j.akcej.2019.06.002 are solved. Moreover, we showed that every graph G either has str(G) V(G) d(G) or is a proper subgraph of a graph H that has str(H) V(H) d(H) with d(H) d(G) . Further, new good lower bounds of str(G) are also obtained. Using these, we determined the strength of 2 regular graphs and obtained new lower bounds of str(Q n) for various n , where Q n is the n regular hypercube.


Symplectic reduction along a submanifold. We introduce the process of symplectic reduction along a submanifold as a uniform approach to taking quotients in symplectic geometry. This construction holds in the categories of smooth manifolds, complex analytic spaces, and complex algebraic varieties, and has an interpretation in terms of derived stacks in shifted symplectic geometry. It also encompasses Marsden Weinstein Meyer reduction, Mikami Weinstein reduction, the pre images of Poisson transversals under moment maps, symplectic cutting, symplectic implosion, and the Ginzburg Kazhdan construction of Moore Tachikawa varieties in TQFT. A key feature of our construction is a concrete and systematic association of a Hamiltonian G space mathfrak M G, S to each pair (G,S) , where G is any Lie group and S subseteq mathrm Lie (G) is any submanifold satisfying certain non degeneracy conditions. The spaces mathfrak M G, S satisfy a universal property for symplectic reduction which generalizes that of the universal imploded cross section. While these Hamiltonian G spaces are explicit and natural from a Lie theoretic perspective, some of them appear to be new.


Reason induced visual attention for explainable autonomous driving. Deep learning (DL) based computer vision (CV) models are generally considered as black boxes due to poor interpretability. This limitation impedes efficient diagnoses or predictions of system failure, thereby precluding the widespread deployment of DLCV models in safety critical tasks such as autonomous driving. This study is motivated by the need to enhance the interpretability of DL model in autonomous driving and therefore proposes an explainable DL based framework that generates textual descriptions of the driving environment and makes appropriate decisions based on the generated descriptions. The proposed framework imitates the learning process of human drivers by jointly modeling the visual input (images) and natural language, while using the language to induce the visual attention in the image. The results indicate strong explainability of autonomous driving decisions obtained by focusing on relevant features from visual inputs. Furthermore, the output attention maps enhance the interpretability of the model not only by providing meaningful explanation to the model behavior but also by identifying the weakness of and potential improvement directions for the model.


ReMeDi Resources for Multi domain, Multi service, Medical Dialogues. Medical dialogue systems (MDSs) aim to assist doctors and patients with a range of professional medical services, i.e., diagnosis, treatment and consultation. The development of MDSs is hindered because of a lack of resources. In particular. (1) there is no dataset with large scale medical dialogues that covers multiple medical services and contains fine grained medical labels (i.e., intents, actions, slots, values), and (2) there is no set of established benchmarks for MDSs for multi domain, multi service medical dialogues. In this paper, we present ReMeDi, a set of resource for medical dialogues. ReMeDi consists of two parts, the ReMeDi dataset and the ReMeDi benchmarks. The ReMeDi dataset contains 96,965 conversations between doctors and patients, including 1,557 conversations with fine gained labels. It covers 843 types of diseases, 5,228 medical entities, and 3 specialties of medical services across 40 domains. To the best of our knowledge, the ReMeDi dataset is the only medical dialogue dataset that covers multiple domains and services, and has fine grained medical labels. The second part of the ReMeDi resources consists of a set of state of the art models for (medical) dialogue generation. The ReMeDi benchmark has the following methods (1) pretrained models (i.e., BERT WWM, BERT MED, GPT2, and MT5) trained, validated, and tested on the ReMeDi dataset, and (2) a self supervised contrastive learning(SCL) method to expand the ReMeDi dataset and enhance the training of the state of the art pretrained models. We describe the creation of the ReMeDi dataset, the ReMeDi benchmarking methods, and establish experimental results using the ReMeDi benchmarking methods on the ReMeDi dataset for future research to compare against. With this paper, we share the dataset, implementations of the benchmarks, and evaluation scripts.


Characterization of Generalizability of Spike Timing Dependent Plasticity trained Spiking Neural Networks. A Spiking Neural Network (SNN) is trained with Spike Timing Dependent Plasticity (STDP), which is a neuro inspired unsupervised learning method for various machine learning applications. This paper studies the generalizability properties of the STDP learning processes using the Hausdorff dimension of the trajectories of the learning algorithm. The paper analyzes the effects of STDP learning models and associated hyper parameters on the generalizability properties of an SNN. The analysis is used to develop a Bayesian optimization approach to optimize the hyper parameters for an STDP model for improving the generalizability properties of an SNN.


Production of CO3 through the Strong Field Ionization and Coulomb Explosion of Formic Acid Dimer. Femtosecond laser pulses are utilized to drive multiple ionization in gas phase formic acid dimers and ions are studied using time of flight mass spectrometry. The interaction of formic acid dimer with 200 fs linearly polarized laser pulses of 400 nm with intensi ties up to 3.7x1015 W cm2 produces a carbon monoxide trication. Experimental measurements of the kinetic energy release of the ions are consistent with our molecular dynamics simulations of the Coulomb explosion of a formic acid dimer and suggest that no movement occurs during ionization. KER values were recorded as high as 44 eV for CO3 . Potential energy curves for COn , for n 4, have been calculated using CCSD(T) and confirm the existence of metastable states with a large potential barrier with respect to dissociation. This combined experimental and theoretical effort shows the existence of sufficiently long lived CO3 .


Exploring Neural Models for Query Focused Summarization. Query focused summarization (QFS) aims to produce summaries that answer particular questions of interest, enabling greater user control and personalization. While recently released datasets, such as QMSum or AQuaMuSe, facilitate research efforts in QFS, the field lacks a comprehensive study of the broad space of applicable modeling methods. In this paper we conduct a systematic exploration of neural approaches to QFS, considering two general classes of methods two stage extractive abstractive solutions and end to end models. Within those categories, we investigate existing models and explore strategies for transfer learning. We also present two modeling extensions that achieve state of the art performance on the QMSum dataset, up to a margin of 3.38 ROUGE 1, 3.72 ROUGE2, and 3.28 ROUGE L when combined with transfer learning strategies. Results from human evaluation suggest that the best models produce more comprehensive and factually consistent summaries compared to a baseline model. Code and checkpoints are made publicly available https github.com salesforce query focused sum.


Reduced Order Model Based Feedback Design for Thruster Assisted Legged Locomotion. Real time constraint satisfaction for robots can be quite challenging due to the high computational complexity that arises when accounting for the system dynamics and environmental interactions, often requiring simplification in modelling that might not necessarily account for all performance criteria. We instead propose an optimization free approach where reference trajectories are manipulated to satisfy constraints brought on by ground contact as well as those prescribed for states and inputs. Unintended changes to trajectories especially ones optimized to produce periodic gaits can adversely affect gait stability, however we will show our approach can still guarantee stability of a gait by employing the use of coaxial thrusters that are unique to our robot.


Jacobian Regularization for Mitigating Universal Adversarial Perturbations. Universal Adversarial Perturbations (UAPs) are input perturbations that can fool a neural network on large sets of data. They are a class of attacks that represents a significant threat as they facilitate realistic, practical, and low cost attacks on neural networks. In this work, we derive upper bounds for the effectiveness of UAPs based on norms of data dependent Jacobians. We empirically verify that Jacobian regularization greatly increases model robustness to UAPs by up to four times whilst maintaining clean performance. Our theoretical analysis also allows us to formulate a metric for the strength of shared adversarial perturbations between pairs of inputs. We apply this metric to benchmark datasets and show that it is highly correlated with the actual observed robustness. This suggests that realistic and practical universal attacks can be reliably mitigated without sacrificing clean accuracy, which shows promise for the robustness of machine learning systems.


Comparing decision mining approaches with regard to the meaningfulness of their results. Decisions and the underlying rules are indispensable for driving process execution during runtime, i.e., for routing process instances at alternative branches based on the values of process data. Decision rules can comprise unary data conditions, e.g., age 40, binary data conditions where the relation between two or more variables is relevant, e.g. temperature1 temperature2, and more complex conditions that refer to, for example, parts of a medical image. Decision discovery aims at automatically deriving decision rules from process event logs. Existing approaches focus on the discovery of unary, or in some instances binary data conditions. The discovered decision rules are usually evaluated using accuracy, but not with regards to their semantics and meaningfulness, although this is crucial for validation and the subsequent implementation adaptation of the decision rules. Hence, this paper compares three decision mining approaches, i.e., two existing ones and one newly described approach, with respect to the meaningfulness of their results. For comparison, we use one synthetic data set for a realistic manufacturing case and the two real world BPIC 2017 2020 logs. The discovered rules are discussed with regards to their semantics and meaningfulness.


A Comparison of Different Source Code Representation Methods for Vulnerability Prediction in Python. In the age of big data and machine learning, at a time when the techniques and methods of software development are evolving rapidly, a problem has arisen programmers can no longer detect all the security flaws and vulnerabilities in their code manually. To overcome this problem, developers can now rely on automatic techniques, like machine learning based prediction models, to detect such issues. An inherent property of such approaches is that they work with numeric vectors (i.e., feature vectors) as inputs. Therefore, one needs to transform the source code into such feature vectors, often referred to as code embedding. A popular approach for code embedding is to adapt natural language processing techniques, like text representation, to automatically derive the necessary features from the source code. However, the suitability and comparison of different text representation techniques for solving Software Engineering (SE) problems is rarely studied systematically. In this paper, we present a comparative study on three popular text representation methods, word2vec, fastText, and BERT applied to the SE task of detecting vulnerabilities in Python code. Using a data mining approach, we collected a large volume of Python source code in both vulnerable and fixed forms that we embedded with word2vec, fastText, and BERT to vectors and used a Long Short Term Memory network to train on them. Using the same LSTM architecture, we could compare the efficiency of the different embeddings in deriving meaningful feature vectors. Our findings show that all the text representation methods are suitable for code representation in this particular task, but the BERT model is the most promising as it is the least time consuming and the LSTM model based on it achieved the best overall accuracy(93.8 ) in predicting Python source code vulnerabilities.


Assessing the Impact of Automated Suggestions on Decision Making Domain Experts Mediate Model Errors but Take Less Initiative. Automated decision support can accelerate tedious tasks as users can focus their attention where it is needed most. However, a key concern is whether users overly trust or cede agency to automation. In this paper, we investigate the effects of introducing automation to annotating clinical texts a multi step, error prone task of identifying clinical concepts (e.g., procedures) in medical notes, and mapping them to labels in a large ontology. We consider two forms of decision aid recommending which labels to map concepts to, and pre populating annotation suggestions. Through laboratory studies, we find that 18 clinicians generally build intuition of when to rely on automation and when to exercise their own judgement. However, when presented with fully pre populated suggestions, these expert users exhibit less agency accepting improper mentions, and taking less initiative in creating additional annotations. Our findings inform how systems and algorithms should be designed to mitigate the observed issues.


AI and the Everything in the Whole Wide World Benchmark. There is a tendency across different subfields in AI to valorize a small collection of influential benchmarks. These benchmarks operate as stand ins for a range of anointed common problems that are frequently framed as foundational milestones on the path towards flexible and generalizable AI systems. State of the art performance on these benchmarks is widely understood as indicative of progress towards these long term goals. In this position paper, we explore the limits of such benchmarks in order to reveal the construct validity issues in their framing as the functionally "general" broad measures of progress they are set up to be.


OGB LSC A Large Scale Challenge for Machine Learning on Graphs. Enabling effective and efficient machine learning (ML) over large scale graph data (e.g., graphs with billions of edges) can have a great impact on both industrial and scientific applications. However, existing efforts to advance large scale graph ML have been largely limited by the lack of a suitable public benchmark. Here we present OGB Large Scale Challenge (OGB LSC), a collection of three real world datasets for facilitating the advancements in large scale graph ML. The OGB LSC datasets are orders of magnitude larger than existing ones, covering three core graph learning tasks link prediction, graph regression, and node classification. Furthermore, we provide dedicated baseline experiments, scaling up expressive graph ML models to the massive datasets. We show that expressive models significantly outperform simple scalable baselines, indicating an opportunity for dedicated efforts to further improve graph ML at scale. Moreover, OGB LSC datasets were deployed at ACM KDD Cup 2021 and attracted more than 500 team registrations globally, during which significant performance improvements were made by a variety of innovative techniques. We summarize the common techniques used by the winning solutions and highlight the current best practices in large scale graph ML. Finally, we describe how we have updated the datasets after the KDD Cup to further facilitate research advances. The OGB LSC datasets, baseline code, and all the information about the KDD Cup are available at https ogb.stanford.edu docs lsc .


A Polynomial Lower Bound on the Number of Rounds for Parallel Submodular Function Minimization and Matroid Intersection. Submodular function minimization (SFM) and matroid intersection are fundamental discrete optimization problems with applications in many fields. It is well known that both of these can be solved making mathrm poly (N) queries to a relevant oracle (evaluation oracle for SFM and rank oracle for matroid intersection), where N denotes the universe size. However, all known polynomial query algorithms are highly adaptive, requiring at least N rounds of querying the oracle. A natural question is whether these can be efficiently solved in a highly parallel manner, namely, with mathrm poly (N) queries using only poly logarithmic rounds of adaptivity. An important step towards understanding the adaptivity needed for efficient parallel SFM was taken recently in the work of Balkanski and Singer who showed that any SFM algorithm making mathrm poly (N) queries necessarily requires Omega( log N log log N) rounds. This left open the possibility of efficient SFM algorithms in poly logarithmic rounds. For matroid intersection, even the possibility of a constant round, mathrm poly (N) query algorithm was not hitherto ruled out. In this work, we prove that any, possibly randomized, algorithm for submodular function minimization or matroid intersection making mathrm poly (N) queries requires tilde Omega left(N 1 3 right) rounds of adaptivity. In fact, we show a polynomial lower bound on the number of rounds of adaptivity even for algorithms that make at most 2 N 1 delta queries, for any constant delta 0 . Therefore, even though SFM and matroid intersection are efficiently solvable, they are not highly parallelizable in the oracle model.


SoftDICE for Imitation Learning Rethinking Off policy Distribution Matching. We present SoftDICE, which achieves state of the art performance for imitation learning. SoftDICE fixes several key problems in ValueDICE, an off policy distribution matching approach for sample efficient imitation learning. Specifically, the objective of ValueDICE contains logarithms and exponentials of expectations, for which the mini batch gradient estimate is always biased. Second, ValueDICE regularizes the objective with replay buffer samples when expert demonstrations are limited in number, which however changes the original distribution matching problem. Third, the re parametrization trick used to derive the off policy objective relies on an implicit assumption that rarely holds in training. We leverage a novel formulation of distribution matching and consider an entropy regularized off policy objective, which yields a completely offline algorithm called SoftDICE. Our empirical results show that SoftDICE recovers the expert policy with only one demonstration trajectory and no further on policy off policy samples. SoftDICE also stably outperforms ValueDICE and other baselines in terms of sample efficiency on Mujoco benchmark tasks.


Collapsing Calabi Yau fibrations and uniform diameter bounds. As a sequel to cite Licollapsing , we study Calabi Yau metrics collapsing along a holomorphic fibration over a Riemann surface. Assuming at worst canonical singular fibres, we prove a uniform diameter bound for all fibres in the suitable rescaling. This has consequences on the geometry around the singular fibres.


n stage Latent Dirichlet Allocation A Novel Approach for LDA. Nowadays, data analysis has become a problem as the amount of data is constantly increasing. In order to overcome this problem in textual data, many models and methods are used in natural language processing. The topic modeling field is one of these methods. Topic modeling allows determining the semantic structure of a text document. Latent Dirichlet Allocation (LDA) is the most common method among topic modeling methods. In this article, the proposed n stage LDA method, which can enable the LDA method to be used more effectively, is explained in detail. The positive effect of the method has been demonstrated by the applied English and Turkish studies. Since the method focuses on reducing the word count in the dictionary, it can be used language independently. You can access the open source code of the method and the example https github.com anil1055 n stage LDA


Machine Learning Application Development Practitioners' Insights. Nowadays, intelligent systems and services are getting increasingly popular as they provide data driven solutions to diverse real world problems, thanks to recent breakthroughs in Artificial Intelligence (AI) and Machine Learning (ML). However, machine learning meets software engineering not only with promising potentials but also with some inherent challenges. Despite some recent research efforts, we still do not have a clear understanding of the challenges of developing ML based applications and the current industry practices. Moreover, it is unclear where software engineering researchers should focus their efforts to better support ML application developers. In this paper, we report about a survey that aimed to understand the challenges and best practices of ML application development. We synthesize the results obtained from 80 practitioners (with diverse skills, experience, and application domains) into 17 findings outlining challenges and best practices for ML application development. Practitioners involved in the development of ML based software systems can leverage the summarized best practices to improve the quality of their system. We hope that the reported challenges will inform the research community about topics that need to be investigated to improve the engineering process and the quality of ML based applications.


Forward partial inverse half forward splitting algorithm for solving monotone inclusions. In this paper we provide a splitting algorithm for solving coupled monotone inclusions in a real Hilbert space involving the sum of a normal cone to a vector subspace, a maximally monotone, a monotone Lipschitzian, and a cocoercive operator. The proposed method takes advantage of the intrinsic properties of each operator and generalizes the method of partial inverses and the forward backward half forward splitting, among other methods. At each iteration, our algorithm needs two computations of the Lipschitzian operator while the cocoercive operator is activated only once. By using product space techniques, we derive a method for solving a composite monotone primal dual inclusions including linear operators and we apply it to solve constrained composite convex optimization problems. Finally, we apply our algorithm to a constrained total variation least squares problem and we compare its performance with efficient methods in the literature.


Graph based Person Signature for Person Re Identifications. The task of person re identification (ReID) is to match images of the same person over multiple non overlapping camera views. Due to the variations in visual factors, previous works have investigated how the person identity, body parts, and attributes benefit the person ReID problem. However, the correlations between attributes, body parts, and within each attribute are not fully utilized. In this paper, we propose a new method to effectively aggregate detailed person descriptions (attributes labels) and visual features (body parts and global features) into a graph, namely Graph based Person Signature, and utilize Graph Convolutional Networks to learn the topological structure of the visual signature of a person. The graph is integrated into a multi branch multi task framework for person re identification. The extensive experiments are conducted to demonstrate the effectiveness of our proposed approach on two large scale datasets, including Market 1501 and DukeMTMC ReID. Our approach achieves competitive results among the state of the art and outperforms other attribute based or mask guided methods.


Locality aware Channel wise Dropout for Occluded Face Recognition. Face recognition remains a challenging task in unconstrained scenarios, especially when faces are partially occluded. To improve the robustness against occlusion, augmenting the training images with artificial occlusions has been proved as a useful approach. However, these artificial occlusions are commonly generated by adding a black rectangle or several object templates including sunglasses, scarfs and phones, which cannot well simulate the realistic occlusions. In this paper, based on the argument that the occlusion essentially damages a group of neurons, we propose a novel and elegant occlusion simulation method via dropping the activations of a group of neurons in some elaborately selected channel. Specifically, we first employ a spatial regularization to encourage each feature channel to respond to local and different face regions. In this way, the activations affected by an occlusion in a local region are more likely to be located in a single feature channel. Then, the locality aware channel wise dropout (LCD) is designed to simulate the occlusion by dropping out the entire feature channel. Furthermore, by randomly dropping out several feature channels, our method can well simulate the occlusion of larger area. The proposed LCD can encourage its succeeding layers to minimize the intra class feature variance caused by occlusions, thus leading to improved robustness against occlusion. In addition, we design an auxiliary spatial attention module by learning a channel wise attention vector to reweight the feature channels, which improves the contributions of non occluded regions. Extensive experiments on various benchmarks show that the proposed method outperforms state of the art methods with a remarkable improvement.


Generative Causal Explanations for Graph Neural Networks. This paper presents Gem, a model agnostic approach for providing interpretable explanations for any GNNs on various graph learning tasks. Specifically, we formulate the problem of providing explanations for the decisions of GNNs as a causal learning task. Then we train a causal explanation model equipped with a loss function based on Granger causality. Different from existing explainers for GNNs, Gem explains GNNs on graph structured data from a causal perspective. It has better generalization ability as it has no requirements on the internal structure of the GNNs or prior knowledge on the graph learning tasks. In addition, Gem, once trained, can be used to explain the target GNN very quickly. Our theoretical analysis shows that several recent explainers fall into a unified framework of additive feature attribution methods. Experimental results on synthetic and real world datasets show that Gem achieves a relative increase of the explanation accuracy by up to 30 and speeds up the explanation process by up to 110 times as compared to its state of the art alternatives.


Seeking the Shape of Sound An Adaptive Framework for Learning Voice Face Association. Nowadays, we have witnessed the early progress on learning the association between voice and face automatically, which brings a new wave of studies to the computer vision community. However, most of the prior arts along this line (a) merely adopt local information to perform modality alignment and (b) ignore the diversity of learning difficulty across different subjects. In this paper, we propose a novel framework to jointly address the above mentioned issues. Targeting at (a), we propose a two level modality alignment loss where both global and local information are considered. Compared with the existing methods, we introduce a global loss into the modality alignment process. The global component of the loss is driven by the identity classification. Theoretically, we show that minimizing the loss could maximize the distance between embeddings across different identities while minimizing the distance between embeddings belonging to the same identity, in a global sense (instead of a mini batch). Targeting at (b), we propose a dynamic reweighting scheme to better explore the hard but valuable identities while filtering out the unlearnable identities. Experiments show that the proposed method outperforms the previous methods in multiple settings, including voice face matching, verification and retrieval.


SDG Target Interactions The Philippine Analysis of Indivisible and Cancelling Targets. The United Nations developed the 17 Sustainable Development Goals (SDGs), with 169 targets, to serve as a plan for solving the world's problems and achieving a more sustainable future. This is modeled as a graph with the targets as nodes, and with the interaction between targets as the edges of the graph. An exhaustive binary comparison is done to analyze the intra and inter goal target interactions, entailing over 14000 comparisons. The task is to assign a 'color' to an edge positive (indivisible), zero (consistent) or negative (cancelling). This is done via a panel of experts who will evaluate the target interactions, through a web application that was developed for coloring the edges. This is an on going study, and so far, of the 1256 edges colored, only 36 are cancelling (negative), or 2.86 more than 97 are positive interactions. So far, the "most negative" interactions involve "Climate Change" "Life Below Water" "Peace, Justice and Strong Institutions" and "Decent Work and Economic Growth". Most useful for planning might be the 'graph of beautiful targets' feature, which shows target with non negative interactions, and how they connect to each other. These are the targets that may be worked on simultaneously, and currently has more than 130 nodes. This study can help researchers analyze which targets enable or constrain each other, what mitigation can be done to avoid conflicts, and can be configured for sub national or regional study. Web app at http sdg interactions.herokuapp.com


DOI Divergence based Out of Distribution Indicators via Deep Generative Models. To ensure robust and reliable classification results, OoD (out of distribution) indicators based on deep generative models are proposed recently and are shown to work well on small datasets. In this paper, we conduct the first large collection of benchmarks (containing 92 dataset pairs, which is 1 order of magnitude larger than previous ones) for existing OoD indicators and observe that none perform well. We thus advocate that a large collection of benchmarks is mandatory for evaluating OoD indicators. We propose a novel theoretical framework, DOI, for divergence based Out of Distribution indicators (instead of traditional likelihood based) in deep generative models. Following this framework, we further propose a simple and effective OoD detection algorithm Single shot Fine tune. It significantly outperforms past works by 5 8 in AUROC, and its performance is close to optimal. In recent, the likelihood criterion is shown to be ineffective in detecting OoD. Single shot Fine tune proposes a novel fine tune criterion to detect OoD, by whether the likelihood of the testing sample is improved after fine tuning a well trained model on it. Fine tune criterion is a clear and easy following criterion, which will lead the OoD domain into a new stage.


Towards Reformulating Essence Specifications for Robustness. The Essence language allows a user to specify a constraint problem at a level of abstraction above that at which constraint modelling decisions are made. Essence specifications are refined into constraint models using the Conjure automated modelling tool, which employs a suite of refinement rules. However, Essence is a rich language in which there are many equivalent ways to specify a given problem. A user may therefore omit the use of domain attributes or abstract types, resulting in fewer refinement rules being applicable and therefore a reduced set of output models from which to select. This paper addresses the problem of recovering this information automatically to increase the robustness of the quality of the output constraint models in the face of variation in the input Essence specification. We present reformulation rules that can change the type of a decision variable or add attributes that shrink its domain. We demonstrate the efficacy of this approach in terms of the quantity and quality of models Conjure can produce from the transformed specification compared with the original.


Variable Coded Batch Matrix Multiplication. A majority of coded matrix matrix computation literature has broadly focused in two directions matrix partitioning for computing a single computation task and batch processing of multiple distinct computation tasks. While these works provide codes with good straggler resilience and fast decoding for their problem spaces, these codes would not be able to take advantage of the natural redundancy of re using matrices across batch jobs. In this paper, we introduce the Variable Coded Distributed Batch Matrix Multiplication (VCDBMM) problem which tasks a distributed system to perform batch matrix multiplication where matrices are not necessarily distinct among batch jobs. Inspired in part by Cross Subspace Alignment codes, we develop Flexible Cross Subspace Alignments (FCSA) codes that are flexible enough to utilize this redundancy. We provide a full characterization of FCSA codes which allow for a wide variety of system complexities including good straggler resilience and fast decoding. We theoretically demonstrate that, under certain practical conditions, FCSA codes are within a factor of 2 of the optimal solution when it comes to straggler resilience. Furthermore, our simulations demonstrate that our codes can achieve even better optimality gaps in practice, even going as low as 1.7.


Finding a Concise, Precise, and Exhaustive Set of Near Bi Cliques in Dynamic Graphs. A variety of tasks on dynamic graphs, including anomaly detection, community detection, compression, and graph understanding, have been formulated as problems of identifying constituent (near) bi cliques (i.e., complete bipartite graphs). Even when we restrict our attention to maximal ones, there can be exponentially many near bi cliques, and thus finding all of them is practically impossible for large graphs. Then, two questions naturally arise (Q1) What is a "good" set of near bi cliques? That is, given a set of near bi cliques in the input dynamic graph, how should we evaluate its quality? (Q2) Given a large dynamic graph, how can we rapidly identify a high quality set of near bi cliques in it? Regarding Q1, we measure how concisely, precisely, and exhaustively a given set of near bi cliques describes the input dynamic graph. We combine these three perspectives systematically on the Minimum Description Length principle. Regarding Q2, we propose CutNPeel, a fast search algorithm for a high quality set of near bi cliques. By adaptively re partitioning the input graph, CutNPeel reduces the search space and at the same time improves the search quality. Our experiments using six real world dynamic graphs demonstrate that CutNPeel is (a) High quality providing near bi cliques of up to 51.2 better quality than its state of the art competitors, (b) Fast up to 68.8x faster than the next best competitor, and (c) Scalable scaling to graphs with 134 million edges. We also show successful applications of CutNPeel to graph compression and pattern discovery.


Failing Conceptually Concept Based Explanations of Dataset Shift. Despite their remarkable performance on a wide range of visual tasks, machine learning technologies often succumb to data distribution shifts. Consequently, a range of recent work explores techniques for detecting these shifts. Unfortunately, current techniques offer no explanations about what triggers the detection of shifts, thus limiting their utility to provide actionable insights. In this work, we present Concept Bottleneck Shift Detection (CBSD) a novel explainable shift detection method. CBSD provides explanations by identifying and ranking the degree to which high level human understandable concepts are affected by shifts. Using two case studies (dSprites and 3dshapes), we demonstrate how CBSD can accurately detect underlying concepts that are affected by shifts and achieve higher detection accuracy compared to state of the art shift detection methods.


Achievable connectivities of Fatou components for a family of singular perturbations. In this paper we study the connectivity of Fatou components for maps in a large family of singular perturbations. We prove that, for some parameters inside the family, the dynamical planes for the corresponding maps present Fatou components of arbitrarily large connectivity and we determine precisely these connectivities. In particular, these results extend the ones obtained in Can17, Can18 .


Error analysis of a decoupled finite element method for quad curl problems. Finite element approximation to a decoupled formulation for the quad curl problem is studied in this paper. The difficulty of constructing elements with certain conformity to the quad curl problems has been greatly reduced. For convex domains, where the regularity assumption holds for Stokes equation, the approximation to the curl of the true solution has quadratic order of convergence and first order for the energy norm. If the solution shows singularity, an a posterior error estimator is developed and a separate marking adaptive finite element procedure is proposed, together with its convergence proved. Both the a priori and a posteriori error analysis are supported by the numerical examples.


On the structure of groups with polynomial growth IV. Recently we have shown a structure theorem for locally compact groups of polynomial growth. We give now some applications on various growth functions and relations to FC G series. In addition, we show some results on related classes of groups.


Deep Dual Support Vector Data Description for Anomaly Detection on Attributed Networks. Networks are ubiquitous in the real world such as social networks and communication networks, and anomaly detection on networks aims at finding nodes whose structural or attributed patterns deviate significantly from the majority of reference nodes. However, most of the traditional anomaly detection methods neglect the relation structure information among data points and therefore cannot effectively generalize to the graph structure data. In this paper, we propose an end to end model of Deep Dual Support Vector Data description based Autoencoder (Dual SVDAE) for anomaly detection on attributed networks, which considers both the structure and attribute for attributed networks. Specifically, Dual SVDAE consists of a structure autoencoder and an attribute autoencoder to learn the latent representation of the node in the structure space and attribute space respectively. Then, a dual hypersphere learning mechanism is imposed on them to learn two hyperspheres of normal nodes from the structure and attribute perspectives respectively. Moreover, to achieve joint learning between the structure and attribute of the network, we fuse the structure embedding and attribute embedding as the final input of the feature decoder to generate the node attribute. Finally, abnormal nodes can be detected by measuring the distance of nodes to the learned center of each hypersphere in the latent structure space and attribute space respectively. Extensive experiments on the real world attributed networks show that Dual SVDAE consistently outperforms the state of the arts, which demonstrates the effectiveness of the proposed method.


Automated Generation of Interorganizational Disaster Response Networks through Information Extraction. When a disaster occurs, maintaining and restoring community lifelines subsequently require collective efforts from various stakeholders. Aiming at reducing the efforts associated with generating Stakeholder Collaboration Networks (SCNs), this paper proposes a systematic approach to reliable information extraction for stakeholder collaboration and automated network generation. Specifically, stakeholders and their interactions are extracted from texts through Named Entity Recognition (NER), one of the techniques in natural language processing. Once extracted, the collaboration information is transformed into structured datasets to generate the SCNs automatically. A case study of stakeholder collaboration during Hurricane Harvey was investigated and it had demonstrated the feasibility and applicability of the proposed method. Hence, the proposed approach was proved to significantly reduce practitioners' interpretation and data collection workloads. In the end, discussions and future work are provided.


Poisoning Knowledge Graph Embeddings via Relation Inference Patterns. We study the problem of generating data poisoning attacks against Knowledge Graph Embedding (KGE) models for the task of link prediction in knowledge graphs. To poison KGE models, we propose to exploit their inductive abilities which are captured through the relationship patterns like symmetry, inversion and composition in the knowledge graph. Specifically, to degrade the model's prediction confidence on target facts, we propose to improve the model's prediction confidence on a set of decoy facts. Thus, we craft adversarial additions that can improve the model's prediction confidence on decoy facts through different inference patterns. Our experiments demonstrate that the proposed poisoning attacks outperform state of art baselines on four KGE models for two publicly available datasets. We also find that the symmetry pattern based attacks generalize across all model dataset combinations which indicates the sensitivity of KGE models to this pattern.


operatorname Sp (1) symmetric hyper K "ahler quantisation. We provide a new general scheme for the geometric quantisation of operatorname Sp (1) symmetric hyper K "ahler manifolds, considering Hilbert spaces of holomorphic sections with respect to the complex structures in the hyper K "ahler 2 sphere. Under properness of an associated moment map, or other finiteness assumptions, we construct unitary quantum (super) representations of central extensions of certain subgroups of Riemannian isometries preserving the 2 sphere, and we study their decomposition in irreducible components. We apply this quantisation scheme to hyper K "ahler vector spaces, the Taub NUT metric on mathbb R 4 , moduli spaces of framed operatorname SU (r) instantons on mathbb R 4 , and partly to the Atiyah Hitchin manifold of magnetic monopoles in mathbb R 3


DeepDT Learning Geometry From Delaunay Triangulation for Surface Reconstruction. In this paper, a novel learning based network, named DeepDT, is proposed to reconstruct the surface from Delaunay triangulation of point cloud. DeepDT learns to predict inside outside labels of Delaunay tetrahedrons directly from a point cloud and corresponding Delaunay triangulation. The local geometry features are first extracted from the input point cloud and aggregated into a graph deriving from the Delaunay triangulation. Then a graph filtering is applied on the aggregated features in order to add structural regularization to the label prediction of tetrahedrons. Due to the complicated spatial relations between tetrahedrons and the triangles, it is impossible to directly generate ground truth labels of tetrahedrons from ground truth surface. Therefore, we propose a multi label supervision strategy which votes for the label of a tetrahedron with labels of sampling locations inside it. The proposed DeepDT can maintain abundant geometry details without generating overly complex surfaces, especially for inner surfaces of open scenes. Meanwhile, the generalization ability and time consumption of the proposed method is acceptable and competitive compared with the state of the art methods. Experiments demonstrate the superior performance of the proposed DeepDT.


Global solution of anisotropic Quasi Geostrophic Equations in Sobolev Space. In cite YZ , the author proved the global existence of the two dimensional anisotropic quasi geostrophic equations with condition on the parameters alpha, beta in the Sobolev spaces H s( R 2) s geq 2 . In this paper, we show that this equations has a global solution in the spaces H s( R 2) , where max 2 2 alpha,2 2 beta s 2 , with additional condition over alpha and beta . The proof is based on the Gevrey class regularity of the solution in neighborhood of zero.


A Framework for Efficient Memory Utilization in Online Conformance Checking. Conformance checking (CC) techniques of the process mining field gauge the conformance of the sequence of events in a case with respect to a business process model, which simply put is an amalgam of certain behavioral relations or rules. Online conformance checking (OCC) techniques are tailored for assessing such conformance on streaming events. The realistic assumption of having a finite memory for storing the streaming events has largely not been considered by the OCC techniques. We propose three incremental approaches to reduce the memory consumption in prefix alignment based OCC techniques along with ensuring that we incur a minimum loss of the conformance insights. Our first proposed approach bounds the number of maximum states that constitute a prefix alignment to be retained by any case in memory. The second proposed approach bounds the number of cases that are allowed to retain more than a single state, referred to as multi state cases. Building on top of the two proposed approaches, our third approach further bounds the number of maximum states that the multi state cases can retain. All these approaches forget the states in excess to their defined limits and retain a meaningful summary of them. Computing prefix alignments in the future is then resumed for such cases from the current position contained in the summary. We highlight the superiority of all proposed approaches compared to a state of the art prefix alignment based OCC technique through experiments using real life event data under a streaming setting. Our approaches substantially reduce memory consumption by up to 80 on average, while introducing a minor accuracy drop.


REX Revisiting Budgeted Training with an Improved Schedule. Deep learning practitioners often operate on a computational and monetary budget. Thus, it is critical to design optimization algorithms that perform well under any budget. The linear learning rate schedule is considered the best budget aware schedule, as it outperforms most other schedules in the low budget regime. On the other hand, learning rate schedules such as the texttt 30 60 90 step schedule are known to achieve high performance when the model can be trained for many epochs. Yet, it is often not known a priori whether one's budget will be large or small thus, the optimal choice of learning rate schedule is made on a case by case basis. In this paper, we frame the learning rate schedule selection problem as a combination of i) selecting a profile (i.e., the continuous function that models the learning rate schedule), and ii) choosing a sampling rate (i.e., how frequently the learning rate is updated sampled from this profile). We propose a novel profile and sampling rate combination called the Reflected Exponential (REX) schedule, which we evaluate across seven different experimental settings with both SGD and Adam optimizers. REX outperforms the linear schedule in the low budget regime, while matching or exceeding the performance of several state of the art learning rate schedules (linear, step, exponential, cosine, step decay on plateau, and OneCycle) in both high and low budget regimes. Furthermore, REX requires no added computation, storage, or hyperparameters.


Analyzing the Effect of Consistency Violation Faults in Self Stabilizing Programs. Consistency violation faults cvf s refer to faults that occur due to inconsistent reads in a shared memory program. In the execution of shared memory, interleaving, self stabilizing programs, cvf s offer a trade off. Specifically, preventing cvf s requires processes to coordinate with each other thereby slowing the execution of each action. On the other hand, permitting cvf s requires less coordination and faster execution of each action. However, when a cvf occurs, it can disrupt the convergence of self stabilizing programs. Thus, a computation of a program in the presence of cvf s can be thought of as a contest where program actions attempt to take the program to a legitimate state whereas cvf s could potentially this convergence. We analyze three self stabilizing programs (token ring, coloring and maximal matching) to evaluate this contest between program transitions and cvf s . We find that the relative cost of cvf s is generally small, i.e., as long as a few program transitions can execute between cvf s , the program (probabilistically) converges. We also find that the cost distribution of cvf s is exponential in nature in that the fraction of cvf s with cost c exponentially decreases with c . We validate these results via simulation where we control the rate of cvf s .


Differentiable Robust LQR Layers. This paper proposes a differentiable robust LQR layer for reinforcement learning and imitation learning under model uncertainty and stochastic dynamics. The robust LQR layer can exploit the advantages of robust optimal control and model free learning. It provides a new type of inductive bias for stochasticity and uncertainty modeling in control systems. In particular, we propose an efficient way to differentiate through a robust LQR optimization program by rewriting it as a convex program (i.e. semi definite program) of the worst case cost. Based on recent work on using convex optimization inside neural network layers, we develop a fully differentiable layer for optimizing this worst case cost, i.e. we compute the derivative of a performance measure w.r.t the model's unknown parameters, model uncertainty and stochasticity parameters. We demonstrate the proposed method on imitation learning and approximate dynamic programming on stochastic and uncertain domains. The experiment results show that the proposed method can optimize robust policies under uncertain situations, and are able to achieve a significantly better performance than existing methods that do not model uncertainty directly.


Modeling, simulation, and optimization of a monopod hopping on yielding terrain. Legged locomotion on deformable terrain is a challenging and open robo physics problem since the uncertainty in terrain dynamics introduced by ground deformation complicates the dynamical modelling and control methods. Moreover, learning how (e.g. what controls and mechanisms) to move efficiently and stably on soft ground is a bigger issue. This work seeks to control a 1D monopod hopper to jump to desired height. To achieve this goal, I first set up and validate a discrete element method (DEM) based soft ground simulation environment of a spherical granular material. With this simulation environment, I generate resistive force theory (RFT) based models of the ground reaction force. Then I use the RFT model to develop a feedforward force control for this robot. In the DEM simulation, I use feedback control to compensate for variations in the ground reaction force from the RFT model predictions. With the feedback control, the robot tracks the desired trajectories well and reaches the desired height after five hops. It reduces the apex position errors a lot more than a pure feedforward control. I also change the area of the robots square foot from 1cm 2 to 49cm 2. The feedback controller is able to deal with the ground reaction force fluctuations even when the foot dimensions are on the order of a grain diameter.


On the structure of graded 3 Leibniz algebras. We study the structure of a 3 Leibniz algebra T graded by an arbitrary abelian group G, which is considered of arbitrary dimension and over an arbitrary base field bbbf. We show that T is of the form T uu oplus sum jI j, with uu a linear subspace of T 1, the homogeneous component associated to the unit element 1 in G, and any I j a well described graded ideal of T, satisfying I j, T, I k I j, I k, T T, I j, I k 0, if j neq k. In the case of T being of maximal length, we characterize the gr simplicity of the algebra in terms of connections in the support of the grading.


Exploring Stronger Feature for Temporal Action Localization. Temporal action localization aims to localize starting and ending time with action category. Limited by GPU memory, mainstream methods pre extract features for each video. Therefore, feature quality determines the upper bound of detection performance. In this technical report, we explored classic convolution based backbones and the recent surge of transformer based backbones. We found that the transformer based methods can achieve better classification performance than convolution based, but they cannot generate accuracy action proposals. In addition, extracting features with larger frame resolution to reduce the loss of spatial information can also effectively improve the performance of temporal action localization. Finally, we achieve 42.42 in terms of mAP on validation set with a single SlowFast feature by a simple combination BMN TCANet, which is 1.87 higher than the result of 2020's multi model ensemble. Finally, we achieve Rank 1st on the CVPR2021 HACS supervised Temporal Action Localization Challenge.


Manifold learning for coarse graining atomistic simulations Application to amorphous solids. We introduce a generalized machine learning framework to probabilistically parameterize upper scale models in the form of nonlinear PDEs consistent with a continuum theory, based on coarse grained atomistic simulation data of mechanical deformation and flow processes. The proposed framework utilizes a hypothesized coarse graining methodology with manifold learning and surrogate based optimization techniques. Coarse grained high dimensional data describing quantities of interest of the multiscale models are projected onto a nonlinear manifold whose geometric and topological structure is exploited for measuring behavioral discrepancies in the form of manifold distances. A surrogate model is constructed using Gaussian process regression to identify a mapping between stochastic parameters and distances. Derivative free optimization is employed to adaptively identify a unique set of parameters of the upper scale model capable of rapidly reproducing the system's behavior while maintaining consistency with coarse grained atomic level simulations. The proposed method is applied to learn the parameters of the shear transformation zone (STZ) theory of plasticity that describes plastic deformation in amorphous solids as well as coarse graining parameters needed to translate between atomistic and continuum representations. We show that the methodology is able to successfully link coarse grained microscale simulations to macroscale observables and achieve a high level of parity between the models across scales.


Finite groups whose maximal subgroups have only soluble proper subgroups. We give a description of a finite group whose maximal subgroups possess only soluble proper subgroups, which implies the answer to the well known question on composition factors of finite groups, whose second maximal subgroups are soluble.


Distributed Fair Scheduling for Information Exchange in Multi Agent Systems. Information exchange is a crucial component of many real world multi agent systems. However, the communication between the agents involves two major challenges the limited bandwidth, and the shared communication medium between the agents, which restricts the number of agents that can simultaneously exchange information. While both of these issues need to be addressed in practice, the impact of the latter problem on the performance of the multi agent systems has often been neglected. This becomes even more important when the agents' information or observations have different importance, in which case the agents require different priorities for accessing the medium and sharing their information. Representing the agents' priorities by fairness weights and normalizing each agent's share by the assigned fairness weight, the goal can be expressed as equalizing the agents' normalized shares of the communication medium. To achieve this goal, we adopt a queueing theoretic approach and propose a distributed fair scheduling algorithm for providing weighted fairness in single hop networks. Our proposed algorithm guarantees an upper bound on the normalized share disparity among any pair of agents. This can particularly improve the short term fairness, which is important in real time applications. Moreover, our scheduling algorithm adjusts itself dynamically to achieve a high throughput at the same time. The simulation results validate our claims and comparisons with the existing methods show our algorithm's superiority in providing short term fairness, while achieving a high throughput.


Edge Detect Edge centric Network Intrusion Detection using Deep Neural Network. Edge nodes are crucial for detection against multitudes of cyber attacks on Internet of Things endpoints and is set to become part of a multi billion industry. The resource constraints in this novel network infrastructure tier constricts the deployment of existing Network Intrusion Detection System with Deep Learning models (DLM). We address this issue by developing a novel light, fast and accurate 'Edge Detect' model, which detects Distributed Denial of Service attack on edge nodes using DLM techniques. Our model can work within resource restrictions i.e. low power, memory and processing capabilities, to produce accurate results at a meaningful pace. It is built by creating layers of Long Short Term Memory or Gated Recurrent Unit based cells, which are known for their excellent representation of sequential data. We designed a practical data science pipeline with Recurring Neural Network to learn from the network packet behavior in order to identify whether it is normal or attack oriented. The model evaluation is from deployment on actual edge node represented by Raspberry Pi using current cybersecurity dataset (UNSW2015). Our results demonstrate that in comparison to conventional DLM techniques, our model maintains a high testing accuracy of 99 even with lower resource utilization in terms of cpu and memory. In addition, it is nearly 3 times smaller in size than the state of art model and yet requires a much lower testing time.


An enumeration of 1 perfect ternary codes. We study codes with parameters of the ternary Hamming (n,3 n m ,3) code, i.e., ternary 1 perfect codes. The rank of the code is defined as the dimension of its affine span. We characterize ternary 1 perfect codes of rank n m 1 , count their number, and prove that all such codes can be obtained from each other by a sequence of two coordinate switchings. We enumerate ternary 1 perfect codes of length 13 obtained by concatenation from codes of lengths 9 and 4 we find that there are 93241327 equivalence classes of such codes. Keywords perfect codes, ternary codes, concatenation.


Functional annotation of creeping bentgrass protein sequences based on convolutional neural network. Background Creeping bentgrass (Agrostis soionifera) is a perennial grass of Gramineae, belonging to cold season turfgrass, but has shallow adventitious roots, poor disease resistance. Little is known about the ISR mechanism of turfgrass and the signal transduction involved in disease resistance induction, especially the function of a large number of disease resistance related proteins are urgent to be explored. Results In this work, the protein sequences of creeping bentgrass were measured and annotated by a functional prediction model based on convolutional neural network. Creeping bentgrass seedlings were grown with BDO treatment, and the ISR response was induced by infecting Rhizoctonia solani. We preformed the transcriptome analysis by Illumina Sequencing and high quality unigenes were obtained. A minority of assembled unigenes were functionally annotated according to the database alignment while a large part of the obtained amino acid sequences was left non annotated. To treat the non annotated sequences, a prediction model was established by training the data set from GO families in three domains to acquire good performance, especially the higher false positive control rate. With such model, we analyzed the non annotated protein sequences of creeping bentgrass transcriptome, and annotated the disease resistance response and signal transduction related proteins. Conclusions The results provide good candidates of the proteins with certain functions. With the results in this work, the waste of transcriptome sequencing data of creeping bentgrass can be avoided, and research time and labor for the analysis of ISR characteristics of creeping bentgrass will be saved in further research. It also provides reference for the sequence analysis of turfgrass disease resistance research.


Ground states for Maxwell's equations in nonlocal nonlinear media. In this paper we investigate the existence of ground states and dual ground states for Maxwell's Equations in mathbb R 3 in nonlocal nonlinear metamaterials. We prove that several nonlocal models admit ground states in contrast to their local analogues.


Adding Negation to Lambda Mu. We present cal L , an extension of Parigot's lambda mu calculus by adding negation as a type constructor, together with syntactic constructs that represent negation introduction and elimination. We will define a notion of reduction that extends lambda mu 's reduction system with two new reduction rules, and show that the system satisfies subject reduction. Using Aczel's generalisation of Tait and Martin L "of's notion of parallel reduction, we show that this extended reduction is confluent. Although the notion of type assignment has its limitations with respect to representation of proofs in natural deduction with implication and negation, we will show that all propositions that can be shown in there have a witness in cal L . Using Girard's approach of reducibility candidates, we show that all typeable terms are strongly normalisable, and conclude the paper by showing that type assignment for cal L enjoys the principal typing property.


Excluding affine configurations over a finite field. Let a i1 x 1 cdots a ik x k 0 , i in m be a balanced homogeneous system of linear equations with coefficients a ij from a finite field mathbb F q . We say that a solution x (x 1, ldots, x k) with x 1, ldots, x k in mathbb F q n is generic' if every homogeneous balanced linear equation satisfied by x is a linear combination of the given equations. We show that if the given system is tame', subsets S subseteq mathbb F q n without generic solutions must have exponentially small density. Here, the system is called tame if for every implied system the number of equations is less than half the number of used variables. Using a subspace sampling argument this also gives a supersaturation result' there is a constant c such that for epsilon 0 sufficiently small, every subset S subseteq mathbb F q n of size at least q (1 epsilon) n contains Omega(q (k m epsilon c)n ) solutions as n to infty . For q 4 the tameness condition can be left out. Our main tool is a modification of the slice rank method to leverage the existence of many solutions in order to obtain high rank solutions.


Magnitudes, Scalable Monoids and Quantity Spaces. In ancient Greek mathematics, magnitudes such as lengths were strictly distinguished from numbers. In modern quantity calculus, a distinction is made between quantities and scalars that serve as measures of quantities. It can be argued that quantities should play a more prominent, independent role in modern mathematics, as magnitudes earlier. This article presents a mathematical definition of quantities as elements of quantity spaces. We first sketch the development and structure of the pre modern theory of magnitudes and numbers. Then, a scalable monoid over a ring is defined and its basic properties are described. Congruence relations on scalable monoids, direct and tensor products of scalable monoids, subalgebras and homomorphic images of scalable monoids, and unit elements of scalable monoids are also defined and analyzed. A quantity space is defined as a commutative scalable monoid over a field, admitting a finite basis similar to a basis for a free abelian group. The mathematical theory of quantity spaces forms the basis of a rigorous quantity calculus and is developed with a view to applications in metrology and foundations of physics.


A Clinical Evaluation of a Low Cost Strain Gauge Respiration Belt and Machine Learning to Detect Sleep Apnea. Sleep apnea is a serious and severely under diagnosed sleep related respiration disorder characterized by repeated disrupted breathing events during sleep. It is diagnosed via polysomnography which is an expensive test conducted in a sleep lab requiring sleep experts to manually score the recorded data. Since the symptoms of sleep apnea are often ambiguous, it is difficult for a physician to decide whether to prescribe polysomnography. In this study, we investigate whether helpful information can be obtained by collecting and automatically analysing sleep data using a smartphone and an inexpensive strain gauge respiration belt. We evaluate how accurately we can detect sleep apnea with wide variety of machine learning techniques with data from a clinical study with 49 overnight sleep recordings. With less than one hour of training, we can distinguish between normal and apneic minutes with an accuracy, sensitivity, and specificity of 0.7609, 0.7833, and 0.7217, respectively. These results can be achieved even if we train only on high quality data from an entirely separate, clinically certified sensor, which has the potential to substantially reduce the cost of data collection. Data from a complete night can be analyzed in about one second on a smartphone.


Lifelong Learning of Hate Speech Classification on Social Media. Existing work on automated hate speech classification assumes that the dataset is fixed and the classes are pre defined. However, the amount of data in social media increases every day, and the hot topics changes rapidly, requiring the classifiers to be able to continuously adapt to new data without forgetting the previously learned knowledge. This ability, referred to as lifelong learning, is crucial for the real word application of hate speech classifiers in social media. In this work, we propose lifelong learning of hate speech classification on social media. To alleviate catastrophic forgetting, we propose to use Variational Representation Learning (VRL) along with a memory module based on LB SOINN (Load Balancing Self Organizing Incremental Neural Network). Experimentally, we show that combining variational representation learning and the LB SOINN memory module achieves better performance than the commonly used lifelong learning techniques.


A deep convolutional neural network that is invariant to time rescaling. Human learners can readily understand speech, or a melody, when it is presented slower or faster than usual. Although deep convolutional neural networks (CNNs) are extremely powerful in extracting information from time series, they require explicit training to generalize to different time scales. This paper presents a deep CNN that incorporates a temporal representation inspired by recent findings from neuroscience. In the mammalian brain, time is represented by populations of neurons with temporal receptive fields. Critically, the peaks of the receptive fields form a geometric series, such that the population codes a set of temporal basis functions over log time. Because memory for the recent past is a function of log time, rescaling the input results in translation of the memory. The Scale Invariant Temporal History Convolution network (SITHCon) builds a convolutional layer over this logarithmically distributed temporal memory. A max pool operation results in a network that is invariant to rescalings of time modulo edge effects. We compare performance of SITHCon to a Temporal Convolution Network (TCN). Although both networks can learn classification and regression problems on both univariate and multivariate time series f(t), only SITHCon generalizes to rescalings f(at). This property, inspired by findings from contemporary neuroscience and consistent with findings from cognitive psychology, may enable networks that learn with fewer training examples, fewer weights and that generalize more robustly to out of sample data.


Uniform estimates for 2D quasilinear wave. We consider two dimensional quasilinear wave equations with standard null type quadratic nonlinearities. In 2001 Alinhac proved that such systems possess global in time solutions for compactly supported initial data with sufficiently small Sobolev norm. The highest norm of the constructed solution grows polynomially in time. In this work we develop a new strategy and prove uniform boundedness of the highest order norm of the solution for all time.


A transform approach to polycyclic and serial codes over rings. In this paper, a transform approach is used for polycyclic and serial codes over finite local rings in the case that the defining polynomials have no multiple roots. This allows us to study them in terms of linear algebra and invariant subspaces as well as understand the duality in terms of the transform domain. We also make a characterization of when two polycyclic ambient spaces are Hamming isometric.


NEMD modeling of nanoscale hydrodynamics of clay water system at elevated temperature. The engineering problems involving clay under non isothermal conditions (e.g., geothermal energy harvest, landfill cover system, and nuclear waste disposal) are multiscale and multiphysics by nature. The nanoscale hydrodynamics of clay at elevated temperature is essential in developing a physics based multiscale model for clay under non isothermal conditions. The nonequilibrium molecular dynamics (NEMD) is a useful tool to study the nanoscale hydrodyndamics of clay. This article presents an NEMD modeling of hydrodynamics of clay nanopores at elevated temperatures. Water flow confined in pyrophyllite and montmorillonite clay nanopores is investigated. The nonequilibrium state is maintained by uniformly exerting an external force on each water molecule. The NEMD simulations have provided a molecular scale perspective of temperature effect on clay water density, water flow velocity, shear viscosity, clay water slip length, hydraulic conductivity, and clay water friction coefficient. The numerical results have shown a strong temperature dependence of fluid flow velocity, shear viscosity, clay water slip length, and hydraulic conductivity at the nanoscale. We have validated the applicability of cubic law in determining hydraulic conductivity at the nanopore scale under at elevated temperature. It is found from our numerical results that slip clay water boundary condition is an essential factor in properly determining nanoscale fluid flow velocity. By numerical examples, we also study the impact of nanopore size and clay layer thickness on the hydrodynamics of the clay water system.


Data driven controllers and the need for perception systems in underwater manipulation. The underwater environment poses a complex problem for developing autonomous capabilities for Underwater Vehicle Manipulator Systems (UVMSs). The modeling of UVMSs is a complicated and costly process due to the highly nonlinear dynamics and the presence of unknown hydrodynamical effects. This is aggravated in tasks where the manipulation of objects is necessary, as this may not only introduce external disturbances that can lead to a fast degradation of the control system performance, but also requires the coordinating with a vision system for the correct grasping and operation of the object. In this article, we introduce a control strategy for UVMSs working with unknown payloads. The proposed control strategy is based on a data driven optimal controller. We present a number of experimental results showing the benefits of the proposed strategy. Furthermore, we include a discussion regarding the visual perception requirements for the UVMS in order to achieve full autonomy in underwater manipulation tasks of unknown payloads.


Nonlinear absorption in interacting Rydberg electromagnetically induced transparency spectra on two photon resonance. We experimentally investigate the nonlinear transmission spectrum of coherent light fields propagating through a Rydberg EIT medium with strong atomic interactions. In contrast to previous investigations, which have largely focused on resonant control fields, we explore here the full two dimensional spectral response of the Rydberg gas. Our measurements confirm previously observed spectral features for a vanishing control field detuning, but also reveal significant differences on two photon resonance. In particular, we find qualitative deficiencies of mean field models and rate equation simulations as well as a third order nonlinear susceptibility that accounts for pair wise interaction effects at low probe field intensities in describing the nonlinear probe field response under EIT conditions. Our results suggest that a more complete understanding of Rydberg EIT and emerging photon interactions requires to go beyond existing simplified models as well as few photon theories.


A Case Study on the Stability of Performance Tests for Serverless Applications. Context. While in serverless computing, application resource management and operational concerns are generally delegated to the cloud provider, ensuring that serverless applications meet their performance requirements is still a responsibility of the developers. Performance testing is a commonly used performance assessment practice however, it traditionally requires visibility of the resource environment. Objective. In this study, we investigate whether performance tests of serverless applications are stable, that is, if their results are reproducible, and what implications the serverless paradigm has for performance tests. Method. We conduct a case study where we collect two datasets of performance test results (a) repetitions of performance tests for varying memory size and load intensities and (b) three repetitions of the same performance test every day for ten months. Results. We find that performance tests of serverless applications are comparatively stable if conducted on the same day. However, we also observe short term performance variations and frequent long term performance changes. Conclusion. Performance tests for serverless applications can be stable however, the serverless model impacts the planning, execution, and analysis of performance tests.


Contrastive analysis for scatterplot based representations of dimensionality reduction. Cluster interpretation after dimensionality reduction (DR) is a ubiquitous part of exploring multidimensional datasets. DR results are frequently represented by scatterplots, where spatial proximity encodes similarity among data samples. In the literature, techniques support the understanding of scatterplots' organization by visualizing the importance of the features for cluster definition with layout enrichment strategies. However, current approaches usually focus on global information, hampering the analysis whenever the focus is to understand the differences among clusters. Thus, this paper introduces a methodology to visually explore DR results and interpret clusters' formation based on contrastive analysis. We also introduce a bipartite graph to visually interpret and explore the relationship between the statistical variables employed to understand how the data features influence cluster formation. Our approach is demonstrated through case studies, in which we explore two document collections related to news articles and tweets about COVID 19 symptoms. Finally, we evaluate our approach through quantitative results to demonstrate its robustness to support multidimensional analysis.


A Multi purposed Unsupervised Framework for Comparing Embeddings of Undirected and Directed Graphs. Graph embedding is a transformation of nodes of a network into a set of vectors. A good embedding should capture the underlying graph topology and structure, node to node relationship, and other relevant information about the graph, its subgraphs, and nodes themselves. If these objectives are achieved, an embedding is a meaningful, understandable, and often compressed representation of a network. Unfortunately, selecting the best embedding is a challenging task and very often requires domain experts. In this paper, we extend the framework for evaluating graph embeddings that was recently introduced by the authors. Now, the framework assigns two scores, local and global, to each embedding that measure the quality of an evaluated embedding for tasks that require good representation of local and, respectively, global properties of the network. The best embedding, if needed, can be selected in an unsupervised way, or the framework can identify a few embeddings that are worth further investigation. The framework is flexible, scalable, and can deal with undirected directed, weighted unweighted graphs.


Channelized Axial Attention for Semantic Segmentation Considering Channel Relation within Spatial Attention for Semantic Segmentation. Spatial and channel attentions, modelling the semantic interdependencies in spatial and channel dimensions respectively, have recently been widely used for semantic segmentation. However, computing spatial and channel attentions separately sometimes causes errors, especially for those difficult cases. In this paper, we propose Channelized Axial Attention (CAA) to seamlessly integrate channel attention and spatial attention into a single operation with negligible computation overhead. Specifically, we break down the dot product operation of the spatial attention into two parts and insert channel relation in between, allowing for independently optimized channel attention on each spatial location. We further develop grouped vectorization, which allows our model to run with very little memory consumption without slowing down the running speed. Comparative experiments conducted on multiple benchmark datasets, including Cityscapes, PASCAL Context, and COCO Stuff, demonstrate that our CAA outperforms many state of the art segmentation models (including dual attention) on all tested datasets.


Lipschitz regularity of energy minimal mappings between doubly connected Riemann surfaces. Let M and N be doubly connected Riemann surfaces with mathscr C 1, alpha boundaries and with nonvanishing conformal metrics sigma and wp respectively, and assume that wp is a smooth metric with bounded Gauss curvature mathcal K and finite area. Assume that Ho rho(M, N) is the class of all mathscr W 1,2 bomeomorphisms between M and N and assume that mathcal E wp overline Ho rho(M, N) to mathbf R is the Dirichlet energy functional, where overline Ho rho(M, N) is the closure of Ho rho(M, N) in mathscr W 1,2 (M,N) . By using a result of Iwaniec, Kovalev and Onninen in cite duke that the minimizer, is locally Lipschitz, we prove that the minimizer, of the energy functional mathcal E wp , which is not a diffeomorphism in general, is a globally Lipschitz mapping of M onto N .


A Novel Multimodal Biometric Authentication System using Machine Learning and Blockchain. Traditional authentication systems that rely on simple passwords, PIN numbers or tokens have many security issues, like easily guessed passwords, PIN numbers written on the back of cards, etc. Thus, biometric authentication methods that rely on physical and behavioural characteristics have been proposed as an alternative for those systems. In real world applications, authentication systems that involve a single biometric faced many issues, especially lack of accuracy and noisy data, which boost the research community to create multibiometric systems that involve a variety of biometrics. Those systems provide better performance and higher accuracy compared to other authentication methods. However, most of them are inconvenient and requires complex interactions from the user. Thus, in this paper, we introduce a novel multimodal authentication system that relies on machine learning and blockchain, with the aim of providing a more secure, transparent, and convenient authentication mechanism. The proposed system combines four important biometrics, fingerprint, face, age, and gender. The supervised learning algorithm Decision Tree has been used to combine the results of the biometrics verification process and produce a confidence level related to the user. The initial experimental results show the efficiency and robustness of the proposed multimodal systems.


Deep State Inference Toward Behavioral Model Inference of Black box Software Systems. Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software.Most existing inference approaches assume access to code to collect execution sequences. In this paper, we investigate a black box scenario, where the system under analysis cannot be instrumented, in this granular fashion.This scenario is particularly prevalent with control systems' log analysis in the form of continuous signals. In this situation, an execution trace amounts to a multivariate time series of input and output signals, where different states of the system correspond to different phases in the time series. The main challenge is to detect when these phase changes take place. Unfortunately, most existing solutions are either univariate, make assumptions on the data distribution, or have limited learning power.Therefore, we propose a hybrid deep neural network that accepts as input a multivariate time series and applies a set of convolutional and recurrent layers to learn the non linear correlations between signals and the patterns over time.We show how this approach can be used to accurately detect state changes, and how the inferred models can be successfully applied to transfer learning scenarios, to accurately process traces from different products with similar execution characteristics. Our experimental results on two UAV autopilot case studies indicate that our approach is highly accurate (over 90 F1 score for state classification) and significantly improves baselines (by up to 102 for change point detection).Using transfer learning we also show that up to 90 of the maximum achievable F1 scores in the open source case study can be achieved by reusing the trained models from the industrial case and only fine tuning them using as low as 5 labeled samples, which reduces the manual labeling effort by 98 .


EEEA Net An Early Exit Evolutionary Neural Architecture Search. The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable for an on device processor with limited computing resources, performing at substantially lower Network Architecture Search (NAS) costs. A new algorithm entitled an Early Exit Population Initialisation (EE PI) for Evolutionary Algorithm (EA) was developed to achieve both goals. The EE PI reduces the total number of parameters in the search process by filtering the models with fewer parameters than the maximum threshold. It will look for a new model to replace those models with parameters more than the threshold. Thereby, reducing the number of parameters, memory usage for model storage and processing time while maintaining the same performance or accuracy. The search time was reduced to 0.52 GPU day. This is a huge and significant achievement compared to the NAS of 4 GPU days achieved using NSGA Net, 3,150 GPU days by the AmoebaNet model, and the 2,000 GPU days by the NASNet model. As well, Early Exit Evolutionary Algorithm networks (EEEA Nets) yield network architectures with minimal error and computational cost suitable for a given dataset as a class of network algorithms. Using EEEA Net on CIFAR 10, CIFAR 100, and ImageNet datasets, our experiments showed that EEEA Net achieved the lowest error rate among state of the art NAS models, with 2.46 for CIFAR 10, 15.02 for CIFAR 100, and 23.8 for ImageNet dataset. Further, we implemented this image recognition architecture for other tasks, such as object detection, semantic segmentation, and keypoint detection tasks, and, in our experiments, EEEA Net C2 outperformed MobileNet V3 on all of these various tasks. (The algorithm code is available at https github.com chakkritte EEEA Net).


Reciprocity and the Kernel of Dedekind Sums. We use the action of Atkin Lehner operators to generate a family of reciprocity formulas for newform Dedekind sums. This family of reciprocity formulas provides symmetries which we use to investigate the kernel of these Dedekind sums.


Impulse data models for the inverse problem of electrocardiography. The proposed method re frames traditional inverse problems of electrocardiography into regression problems, constraining the solution space by decomposing signals with multidimensional Gaussian impulse basis functions. Impulse HSPs were generated with single Gaussian basis functions at discrete heart surface locations and projected to corresponding BSPs using a volume conductor torso model. Both BSP (inputs) and HSP (outputs) were mapped to regular 2D surface meshes and used to train a neural network. Predictive capabilities of the network were tested with unseen synthetic and experimental data. A dense full connected single hidden layer neural network was trained to map body surface impulses to heart surface Gaussian basis functions for reconstructing HSP. Synthetic pulses moving across the heart surface were predicted from the neural network with root mean squared error of 9.1 pm1.4 . Predicted signals were robust to noise up to 20 dB and errors due to displacement and rotation of the heart within the torso were bounded and predictable. A shift of the heart 40 mm toward the spine resulted in a 4 increase in signal feature localization error. The set of training impulse function data could be reduced and prediction error remained bounded. Recorded HSPs from in vitro pig hearts were reliably decomposed using space time Gaussian basis functions. Predicted HSPs for left ventricular pacing had a mean absolute error of 10.4 pm11.4 ms. Other pacing scenarios were analyzed with similar success. Conclusion Impulses from Gaussian basis functions are potentially an effective and robust way to train simple neural network data models for reconstructing HSPs from decomposed BSPs. The HSPs predicted by the neural network can be used to generate activation maps that non invasively identify features of cardiac electrical dysfunction and can guide subsequent treatment options.


Tackling the Challenges in Scene Graph Generation with Local to Global Interactions. In this work, we seek new insights into the underlying challenges of the Scene Graph Generation (SGG) task. Quantitative and qualitative analysis of the Visual Genome dataset implies 1) Ambiguity even if inter object relationship contains the same object (or predicate), they may not be visually or semantically similar, 2) Asymmetry despite the nature of the relationship that embodied the direction, it was not well addressed in previous studies, and 3) Higher order contexts leveraging the identities of certain graph elements can help to generate accurate scene graphs. Motivated by the analysis, we design a novel SGG framework, Local to Global Interaction Networks (LOGIN). Locally, interactions extract the essence between three instances of subject, object, and background, while baking direction awareness into the network by explicitly constraining the input order of subject and object. Globally, interactions encode the contexts between every graph component (i.e., nodes and edges). Finally, Attract Repel loss is utilized to fine tune the distribution of predicate embeddings. By design, our framework enables predicting the scene graph in a bottom up manner, leveraging the possible complementariness. To quantify how much LOGIN is aware of relational direction, a new diagnostic task called Bidirectional Relationship Classification (BRC) is also proposed. Experimental results demonstrate that LOGIN can successfully distinguish relational direction than existing methods (in BRC task), while showing state of the art results on the Visual Genome benchmark (in SGG task).


Wasserstein Convergence for Empirical Measures of Subordinated Diffusions on Riemannian Manifolds. Let M be a connected compact Riemannian manifold possibly with a boundary, let V in C 2(M) such that mu( d x) e V(x) d x is a probability measure, where d x is the volume measure, and let L Delta nabla V . The exact convergence rate in Wasserstein distance is derived for empirical measures of subordinations for the (reflecting) diffusion process generated by L .