Radial complex scaling for anisotropic scalar resonance problems. The complex scaling perfectly matched layer method is a widely spread technique to simulate wave propagation problems in open domains. The method is very popular, because its implementation is very easy and does not require the knowledge of a fundamental solution. However, for anisotropic media the method may yield an unphysical radiation condition and lead to erroneous and unstable results. In this article we argue that a radial scaling (opposed to a cartesian scaling) does not suffer from this drawback and produces the desired radiation condition. This result is of great importance as it rehabilitates the application of the complex scaling method for anisotropic media. To present further details we consider the radial complex scaling method for scalar anisotropic resonance problems. We prove that the associated operator is Fredholm and show the convergence of approximations generated by simulateneous domain truncation and finite element discretization. We present computational studies to undergird our theoretical results.


Towards a computational definition of the tresillo rhythm and its tracing in popular music. This paper discusses the use and popularity of a rhythm, which henceforth is referred to as "Tresillo rhythm". We first define and formalizes the Tresillo rhythm. Given a mathematical representation of the rhythm, it is then traced in the US Billboard Top 20 Charts of the last 20 years. To detect and determine the use of this rhythm in a song, we compute the similarity of a song with this rhythm. The calculated similarity, then indicates how similar the rhythm of a pop song is compared to the prior defined Tresillo rhythm. To assert and cross validate the computer rhythm similarity, two different formalizations of the Tresillo rhythm have been compiled and several different approaches to calculated rhythm similarities have been tested and compared. This similarity measure is then used to do an empirical study on the usage of the Tresillo rhythm in the US Billboard Top 20 Charts of the past 20 years (1999 2019). Finally, we argue about some of the possible reasons for the observed trend.


Evaluation of Distributed Databases in Hybrid Clouds and Edge Computing Energy, Bandwidth, and Storage Consumption. A benchmark study of modern distributed databases is an important source of information to select the right technology for managing data in the cloud edge paradigms. To make the right decision, it is required to conduct an extensive experimental study on a variety of hardware infrastructures. While most of the state of the art studies have investigated only response time and scalability of distributed databases, focusing on other various metrics (e.g., energy, bandwidth, and storage consumption) is essential to fully understand the resources consumption of the distributed databases. Also, existing studies have explored the response time and scalability of these databases either in private or public cloud. Hence, there is a paucity of investigation into the evaluation of these databases deployed in a hybrid cloud, which is the seamless integration of public and private cloud. To address these research gaps, in this paper, we investigate energy, bandwidth and storage consumption of the most used and common distributed databases. For this purpose, we have evaluated four open source databases (Cassandra, Mongo, Redis and MySQL) on the hybrid cloud spanning over local OpenStack and Microsoft Azure, and a variety of edge computing nodes including Raspberry Pi, a cluster of Raspberry Pi, and low and high power servers. Our extensive experimental results reveal several helpful insights for the deployment selection of modern distributed databases in edge cloud environments.


A Survey of Text Games for Reinforcement Learning informed by Natural Language. Reinforcement Learning has shown success in a number of complex virtual environments. However, many challenges still exist towards solving problems with natural language as a core component. Interactive Fiction Games (or Text Games) are one such problem type that offer a set of partially observable environments where natural language is required as part of the reinforcement learning solutions. Therefore, this survey's aim is to assist in the development of new Text Game problem settings and solutions for Reinforcement Learning informed by natural language. Specifically, this survey summarises 1) the challenges introduced in Text Game Reinforcement Learning problems, 2) the generation tools for evaluating Text Games and the subsequent environments generated and, 3) the agent architectures currently applied are compared to provide a systematic review of benchmark methodologies and opportunities for future researchers.


On the short term stability of financial ARCH price processes. For many financial applications, it is important to have reliable and tractable models for the behavior of assets and indexes, for example in risk evaluation. A successful approach is based on ARCH processes, which strike the right balance between statistical properties and ease of computation. This study focuses on quadratic ARCH processes and the theoretical conditions to have a stable long term behavior. In particular, the weights for the variance estimators should sum to 1, and the variance of the innovations should be 1. Using historical data, the realized empirical innovations can be computed, and their statistical properties assessed. Using samples of 3 to 5 decades, the variance of the empirical innovations are always significantly above 1, for a sample of stock indexes, commodity indexes and FX rates. This departure points to a short term instability, or to a fast adaptability due to changing conditions. Another theoretical condition on the innovations is to have a zero mean. This condition is also investigated empirically, with some time series showing significant departure from zero.


iSeg3D An Interactive 3D Shape Segmentation Tool. A large scale dataset is essential for learning good features in 3D shape understanding, but there are only a few datasets that can satisfy deep learning training. One of the major reasons is that current tools for annotating per point semantic labels using polygons or scribbles are tedious and inefficient. To facilitate segmentation annotations in 3D shapes, we propose an effective annotation tool, named iSeg for 3D shape. It can obtain a satisfied segmentation result with minimal human clicks ( 10). Under our observation, most objects can be considered as the composition of finite primitive shapes, and we train iSeg3D model on our built primitive composed shape data to learn the geometric prior knowledge in a self supervised manner. Given human interactions, the learned knowledge can be used to segment parts on arbitrary shapes, in which positive clicks help associate the primitives into the semantic parts and negative clicks can avoid over segmentation. Besides, We also provide an online human in loop fine tuning module that enables the model perform better segmentation with less clicks. Experiments demonstrate the effectiveness of iSeg3D on PartNet shape segmentation. Data and codes will be made publicly available.


Constitutive Modeling of the Magneto electromechanical Response of Composite Multiferroics Cylinders. Strain mediated multiferroic composite structures are gaining scientific and technological attractions because of the promise of low power consumption and greater flexibility in material and geometry choices. In here, the direct magnetoelectric coupling coefficient (DME) of composite multiferroic cylinders, consisted of two mechanically bonded concentric cylinders, was analytically modeled under the influence of a radially emanating magnetic field. The analysis framework emphasized the effects of shear lag and demagnetization on the overall performance. The shear lag effect was analytically proven to have no bearing on the DME since it has no effect on the induced radial displacement due to the conditions imposed on the composite cylinder. The demagnetization effect was also thoroughly considered as a function of the imposed mechanical boundary conditions, geometrical dimensions of the composite cylinder, and the introduction of a thin elastic layer at the interface between the inner piezomagnetic and outer piezoelectric cylinders. The results indicate that the demagnetization effect adversely impacted the DME coefficient between 70 and 86 . In a trial to compensate for the reduction in peak DME coefficient due to the presence of demagnetization, non dimensional geometrical analysis was carried out to identify the geometrical attributes corresponding to the maximum DME. It was observed that the peak DME coefficient is nearly unaffected by varying the inner radius of the composite cylinder, while it approaches its maximum value when the thickness of the piezoelectric cylinder is almost 60 of the total thickness of the composite cylinder. The latter conclusion was true for all of the considered boundary conditions.


On holomorphic mappings of strictly pseudoconvex domains. We study the boundary regularity of proper holomorphic mappings between strictly pseudoconvex domains with C 2 boundaries.


Exact description of SIR Bass epidemics on 1D lattices. This paper is devoted to the study of a stochastic epidemiological model which is a variant of the SIR model to which we add an extra factor in the transition rate from susceptible to infected accounting for the inflow of infection due to immigration or environmental sources of infection. This factor yields the formation of new clusters of infections, without having to specify a priori and explicitly their date and place of appearance.We establish an exact deterministic description for such stochastic processes on 1D lattices (finite lines, semi infinite lines, infinite lines, circles) by showing that the probability of infection at a given point in space and time can be obtained as the solution of a deterministic ODE system on the lattice. Our results allow stochastic initial conditions and arbitrary spatio temporal heterogeneities on the parameters.We then apply our results to some concrete situations and obtain useful qualitative results and explicit formulae on the macroscopic dynamics and also the local temporal behavior of each individual. In particular, we provide a fine analysis of some aspects of cluster formation through the study of patient zero problems and the effects of time varying point sources .Finally, we show that the space discrete model gives rise to new space continuous models, which are either ODEs or PDEs, depending on the rescaling regime assumed on the parameters.


BBQ A Hand Built Bias Benchmark for Question Answering. It is well documented that NLP models learn social biases, but little work has been done on how these biases manifest in model outputs for applied tasks like question answering (QA). We introduce the Bias Benchmark for QA (BBQ), a dataset of question sets constructed by the authors that highlight attested social biases against people belonging to protected classes along nine social dimensions relevant for U.S. English speaking contexts. Our task evaluates model responses at two levels (i) given an under informative context, we test how strongly responses reflect social biases, and (ii) given an adequately informative context, we test whether the model's biases override a correct answer choice. We find that models often rely on stereotypes when the context is under informative, meaning the model's outputs consistently reproduce harmful biases in this setting. Though models are more accurate when the context provides an informative answer, they still rely on stereotypes and average up to 3.4 percentage points higher accuracy when the correct answer aligns with a social bias than when it conflicts, with this difference widening to over 5 points on examples targeting gender for most models tested.


A reduction of the string bracket to the loop product. The negative cyclic homology for a differential graded algebra over the rational field has a quotient of the Hochschild homology as a direct summand if the S action is trivial. With this fact, we show that the string bracket in the sense of Chas and Sullivan is reduced to the loop product followed by the BV operator on the loop homology provided the given manifold is BV exact. The reduction is indeed derived from the equivalence between the BV exactness and the triviality of the S action. Moreover, it is proved that a Lie bracket on the loop cohomology of the classifying space of a connected compact Lie group possesses the same reduction. By using these results, we consider the non triviality of string brackets. Another highlight is that a simply connected space with positive weights is BV exact. Furthermore, the higher BV exactness is also discussed featuring the cobar type Eilenberg Moore spectral sequence.


Machine learning applications for COVID 19 A state of the art review. The COVID 19 pandemic has galvanized the machine learning community to create new solutions that can help in the fight against the virus. The body of literature related to applications of machine learning and artificial intelligence to COVID 19 is constantly growing. The goal of this article is to present the latest advances in machine learning research applied to COVID 19. We cover four major areas of research forecasting, medical diagnostics, drug development, and contact tracing. We review and analyze the most successful state of the art studies. In contrast to other existing surveys on the subject, our article presents a high level overview of the current research that is sufficiently detailed to provide an informed insight.


On the Ergodic Control of Ensembles in the Presence of Non linear Filters. In many sharing economy applications, one wishes to regulate the behaviour of an ensemble of agents with guarantees on both the regulation of the ensemble in aggregate and the revenue or quality of service associated with each agent. Previous work Automatica, Volume 108, 108483, arXiv 1807.03256 has developed guarantees of unique ergodicity when there are linear filters. Here, we extend the guarantees to non linear filters.


On uniqueness of multi bubble blow up solutions and multi solitons to L 2 critical nonlinear Schr "odinger equations. We are concerned with the focusing L 2 critical nonlinear Schr "odinger equations in mathbb R d for d 1,2 . The uniqueness is proved for a large energy class of multi bubble blow up solutions, which converge to a sum of K pseudo conformal blow up solutions particularly with low rate (T t) 0 , as t to T , 1 leq K infty . Moreover, we also prove the uniqueness in the energy class of multi solitons which converge to a sum of K solitary waves with convergence rate (1 t) 2 , as t to infty . The uniqueness class is further enlarged to contain the multi solitons with even lower convergence rate (1 t) frac 12 in the pseudo conformal space. The proof is mainly based on the pseudo conformal invariance and the monotonicity properties of several functionals adapted to the multi bubble case, the latter is crucial towards the upgradation of the convergence to the fast exponential decay rate.


Bootstrapped Self Supervised Training with Monocular Video for Semantic Segmentation and Depth Estimation. For a robot deployed in the world, it is desirable to have the ability of autonomous learning to improve its initial pre set knowledge. We formalize this as a bootstrapped self supervised learning problem where a system is initially bootstrapped with supervised training on a labeled dataset and we look for a self supervised training method that can subsequently improve the system over the supervised training baseline using only unlabeled data. In this work, we leverage temporal consistency between frames in monocular video to perform this bootstrapped self supervised training. We show that a well trained state of the art semantic segmentation network can be further improved through our method. In addition, we show that the bootstrapped self supervised training framework can help a network learn depth estimation better than pure supervised training or self supervised training.


Homogenization for polynomial optimization with unbounded sets. This paper considers polynomial optimization with unbounded sets. We give a homogenization formulation and propose a hierarchy of Moment SOS relaxations to solve it. Under the assumptions that the feasible set is closed at infinity and the ideal of homogenized equality constraining polynomials is real radical, we show that this hierarchy of Moment SOS relaxations has finite convergence, if some optimality conditions (i.e., the linear independence constraint qualification, strict complementarity and second order sufficiency conditions) hold at every global minimizer of the homogenized optimization problem. Moreover, we prove extended versions of Putinar Vasilescu type Positivstellensatz for polynomials that are nonnegative on unbounded sets. The classical Moment SOS hierarchy with denominators is also studied. In particular, we give a positive answer to a conjecture of Mai, Lasserre and Magron in their recent work.


AI Total Analyzing Security ML Models with Imperfect Data in Production. Development of new machine learning models is typically done on manually curated data sets, making them unsuitable for evaluating the models' performance during operations, where the evaluation needs to be performed automatically on incoming streams of new data. Unfortunately, pure reliance on a fully automatic pipeline for monitoring model performance makes it difficult to understand if any observed performance issues are due to model performance, pipeline issues, emerging data distribution biases, or some combination of the above. With this in mind, we developed a web based visualization system that allows the users to quickly gather headline performance numbers while maintaining confidence that the underlying data pipeline is functioning properly. It also enables the users to immediately observe the root cause of an issue when something goes wrong. We introduce a novel way to analyze performance under data issues using a data coverage equalizer. We describe the various modifications and additional plots, filters, and drill downs that we added on top of the standard evaluation metrics typically tracked in machine learning (ML) applications, and walk through some real world examples that proved valuable for introspecting our models.


BV operators of the Gerstenhaber algebras of holomorphic polyvector fields on toric varieties. The vector space of holomorphic polyvector fields on any complex manifold has a natural Gerstenhaber algebra structure. In this paper, we study BV operators of the Gerstenhaber algebras of holomorphic polyvector fields on smooth compact toric varieties. We give a necessary and sufficient condition for the existence of BV operators of the Gerstenhaber algebra of holomorphic polyvector fields on any smooth compact toric variety.


Unified 2D and 3D Pre training for Medical Image classification and Segmentation. Self supervised learning (SSL) opens up huge opportunities for better utilizing unlabeled data. It is essential for medical image analysis that is generally known for its lack of annotations. However, when we attempt to use as many as possible unlabeled medical images in SSL, breaking the dimension barrier ( ie, making it possible to jointly use both 2D and 3D images) becomes a must. In this paper, we propose a Universal Self Supervised Transformer (USST) framework based on the student teacher paradigm, aiming to leverage a huge of unlabeled medical data with multiple dimensions to learn rich representations. To achieve this, we design a Pyramid Transformer U Net (PTU) as the backbone, which is composed of switchable patch embedding (SPE) layers and Transformer layers. The SPE layer switches to either 2D or 3D patch embedding depending on the input dimension. After that, the images are converted to a sequence regardless of their original dimensions. The Transformer layer then models the long term dependencies in a sequence to sequence manner, thus enabling USST to learn representations from both 2D and 3D images. USST has two obvious merits compared to current dimension specific SSL (1) textbf more effective can learn representations from more and diverse data and (2) textbf more versatile can be transferred to various downstream tasks. The results show that USST provides promising results on six 2D 3D medical image classification and segmentation tasks, outperforming the supervised ImageNet pre training and advanced SSL counterparts substantially.


An Open Access Dataset of Tweets related to Exoskeletons and 100 Research Questions. The exoskeleton technology has been rapidly advancing in the recent past due to its multitude of applications in different fields. With the projected increase in the diverse uses of exoskeletons in the next few years in these application domains and beyond, it is crucial to study, interpret, and analyze user perspectives, opinions, and feedback related to exoskeletons, for which a comprehensive dataset of communications related to exoskeletons is necessary. The Internet of Everything style of today's living, characterized by people spending more time on the Internet than ever before, holds the potential for developing such a dataset by the mining of relevant web behavior data from social media communications, which have increased exponentially in the last few years. Twitter, one such social media platform, is highly popular amongst all age groups, who communicate on diverse topics via tweets while sharing their views, opinions, perspectives, and feedback towards the same. To address this research challenge, this paper makes multiple scientific contributions to this field. First, it presents a novel approach of mining tweets that is not bound by any restrictions on the number of days during which the tweets can be mined. Second, by using this approach, it presents an open access dataset of approximately 20,000 tweets related to exoskeletons, that were posted over a period of 231 days. Finally, based on a review of 108 emerging works in this field, the paper discusses multiple interdisciplinary applications of this dataset and presents 100 research questions for researchers to study, analyze, and investigate.


Cooperative Stochastic Multi agent Multi armed Bandits Robust to Adversarial Corruptions. We study the problem of stochastic bandits with adversarial corruptions in the cooperative multi agent setting, where V agents interact with a common K armed bandit problem, and each pair of agents can communicate with each other to expedite the learning process. In the problem, the rewards are independently sampled from distributions across all agents and rounds, but they may be corrupted by an adversary. Our goal is to minimize both the overall regret and communication cost across all agents. We first show that an additive term of corruption is unavoidable for any algorithm in this problem. Then, we propose a new algorithm that is agnostic to the level of corruption. Our algorithm not only achieves near optimal regret in the stochastic setting, but also obtains a regret with an additive term of corruption in the corrupted setting, while maintaining efficient communication. The algorithm is also applicable for the single agent corruption problem, and achieves a high probability regret that removes the multiplicative dependence of K on corruption level. Our result of the single agent case resolves an open question from Gupta et al. 2019 .


First Order logic and its Infinitary Quantifier Extensions over Countable Words. We contribute to the refined understanding of the language logic algebra interplay in the context of first order properties of countable words. We establish decidable algebraic characterizations of one variable fragment of FO as well as boolean closure of existential fragment of FO via a strengthening of Simon's theorem about piecewise testable languages. We propose a new extension of FO which admits infinitary quantifiers to reason about the inherent infinitary properties of countable words. We provide a very natural and hierarchical block product based characterization of the new extension. We also explicate its role in view of other natural and classical logical systems such as WMSO and FO cut an extension of FO where quantification over Dedekind cuts is allowed. We also rule out the possibility of a finite basis for a block product based characterization of these logical systems. Finally, we report simple but novel algebraic characterizations of one variable fragments of the hierarchies of the new proposed extension of FO.


Vector valued Distance and Gyrocalculus on the Space of Symmetric Positive Definite Matrices. We propose the use of the vector valued distance to compute distances and extract geometric information from the manifold of symmetric positive definite matrices (SPD), and develop gyrovector calculus, constructing analogs of vector space operations in this curved space. We implement these operations and showcase their versatility in the tasks of knowledge graph completion, item recommendation, and question answering. In experiments, the SPD models outperform their equivalents in Euclidean and hyperbolic space. The vector valued distance allows us to visualize embeddings, showing that the models learn to disentangle representations of positive samples from negative ones.


The extremal point process of branching Brownian motion in mathbb R d . We consider a branching Brownian motion in mathbb R d with d geq 1 in which the position X t (u) in mathbb R d of a particle u at time t can be encoded by its direction theta (u) t in mathbb S d 1 and its distance R (u) t to 0. We prove that the it extremal point process sum delta theta (u) t, R (u) t m t (d) (where the sum is over all particles alive at time t and m (d) t is an explicit centring term) converges in distribution to a randomly shifted decorated Poisson point process on mathbb S d 1 times mathbb R . More precisely, the so called it clan leaders form a Cox process with intensity proportional to D infty( theta) e sqrt 2 r mathrm d r mathrm d theta , where D infty( theta) is the limit of the derivative martingale in direction theta and the decorations are i.i.d. copies of the decoration process of the standard one dimensional branching Brownian motion. This proves a conjecture of Stasi 'nski, Berestycki and Mallein (Ann. Inst. H. Poincar ' e 57 1786 1810, 2021), and builds on that paper and on Kim, Lubetzky and Zeitouni (arXiv 2104.07698).


Towards Automated Attack Simulations of BPMN based Processes. Process digitization and integration is an increasing need for enterprises, while cyber attacks denote a growing threat. Using the Business Process Management Notation (BPMN) is common to handle the digital and integration focus within and across organizations. In other parts of the same companies, threat modeling and attack graphs are used for analyzing the security posture and resilience. In this paper, we propose a novel approach to use attack graph simulations on processes represented in BPMN. Our contributions are the identification of BPMN's attack surface, a mapping of BPMN elements to concepts in a Meta Attack Language (MAL) based Domain Specific Language (DSL), called coreLang, and a prototype to demonstrate our approach in a case study using a real world invoice integration process. The study shows that non invasively enriching BPMN instances with cybersecurity analysis through attack graphs is possible without much human expert input. The resulting insights into potential vulnerabilities could be beneficial for the process modelers.


Subgradient methods near active manifolds saddle point avoidance, local convergence, and asymptotic normality. Nonsmooth optimization problems arising in practice tend to exhibit beneficial smooth substructure their domains stratify into "active manifolds" of smooth variation, which common proximal algorithms "identify" in finite time. Identification then entails a transition to smooth dynamics, and accommodates second order acceleration techniques. While identification is clearly useful algorithmically, empirical evidence suggests that even those algorithms that do not identify the active manifold in finite time notably the subgradient method are nonetheless affected by it. This work seeks to explain this phenomenon, asking how do active manifolds impact the subgradient method in nonsmooth optimization? In this work, we answer this question by introducing two algorithmically useful properties aiming and subgradient approximation that fully expose the smooth substructure of the problem. We show that these properties imply that the shadow of the (stochastic) subgradient method along the active manifold is precisely an inexact Riemannian gradient method with an implicit retraction. We prove that these properties hold for a wide class of problems, including cone reducible decomposable functions and generic semialgebraic problems. Moreover, we develop a thorough calculus, proving such properties are preserved under smooth deformations and spectral lifts. This viewpoint then leads to several algorithmic consequences that parallel results in smooth optimization, despite the nonsmoothness of the problem local rates of convergence, asymptotic normality, and saddle point avoidance. The asymptotic normality results appear to be new even in the most classical setting of stochastic nonlinear programming. The results culminate in the following observation the perturbed subgradient method on generic, Clarke regular semialgebraic problems, converges only to local minimizers.


Defocus Map Estimation and Deblurring from a Single Dual Pixel Image. We present a method that takes as input a single dual pixel image, and simultaneously estimates the image's defocus map the amount of defocus blur at each pixel and recovers an all in focus image. Our method is inspired from recent works that leverage the dual pixel sensors available in many consumer cameras to assist with autofocus, and use them for recovery of defocus maps or all in focus images. These prior works have solved the two recovery problems independently of each other, and often require large labeled datasets for supervised training. By contrast, we show that it is beneficial to treat these two closely connected problems simultaneously. To this end, we set up an optimization problem that, by carefully modeling the optics of dual pixel images, jointly solves both problems. We use data captured with a consumer smartphone camera to demonstrate that, after a one time calibration step, our approach improves upon prior works for both defocus map estimation and blur removal, despite being entirely unsupervised.


Rough Cauchy Sequences in a Cone Metric Space. Here we have introduced the idea of rough Cauchyness of sequences in a cone metric space. Also here we have discussed several basic properties of rough Cauchy sequences in a cone metric space using the idea of Phu.


Two grid hp version discontinuous Galerkin finite element methods for quasilinear elliptic PDEs on agglomerated coarse meshes. This article considers the extension of two grid hp version discontinuous Galerkin finite element methods for the numerical approximation of second order quasilinear elliptic boundary value problems of monotone type to the case when agglomerated polygonal polyhedral meshes are employed for the coarse mesh approximation. We recall that within the two grid setting, while it is necessary to solve a nonlinear problem on the coarse approximation space, only a linear problem must be computed on the original fine finite element space. In this article, the coarse space will be constructed by agglomerating elements from the original fine mesh. Here, we extend the existing a priori and a posteriori error analysis for the two grid hp version discontinuous Galerkin finite element method from 10.1007 s10915 012 9644 1 for coarse meshes consisting of standard element shapes to include arbitrarily agglomerated coarse grids. Moreover, we develop an hp adaptive two grid algorithm to adaptively design the fine and coarse finite element spaces we stress that this is undertaken in a fully automatic manner, and hence can be viewed as blackbox solver. Numerical experiments are presented for two and three dimensional problems to demonstrate the computational performance of the proposed hp adaptive two grid method.


Time Aware Language Models as Temporal Knowledge Bases. Many facts come with an expiration date, from the name of the President to the basketball team Lebron James plays for. But language models (LMs) are trained on snapshots of data collected at a specific moment in time, and this can limit their utility, especially in the closed book setting where the pretraining corpus must contain the facts the model should memorize. We introduce a diagnostic dataset aimed at probing LMs for factual knowledge that changes over time and highlight problems with LMs at either end of the spectrum those trained on specific slices of temporal data, as well as those trained on a wide range of temporal data. To mitigate these problems, we propose a simple technique for jointly modeling text with its timestamp. This improves memorization of seen facts from the training time period, as well as calibration on predictions about unseen facts from future time periods. We also show that models trained with temporal context can be efficiently "refreshed" as new data arrives, without the need for retraining from scratch.


Hierarchical Motion Encoder Decoder Network for Trajectory Forecasting. Trajectory forecasting plays a pivotal role in the field of intelligent vehicles or social robots. Recent works focus on modeling spatial social impacts or temporal motion attentions, but neglect inherent properties of motions, i.e. moving trends and driving intentions. This paper proposes a context free Hierarchical Motion Encoder Decoder Network (HMNet) for vehicle trajectory prediction. HMNet first infers the hierarchical difference on motions to encode physically compliant patterns with high expressivity of moving trends and driving intentions. Then, a goal (endpoint) embedded decoder hierarchically constructs multimodal predictions depending on the location velocity acceleration related patterns. Besides, we present a modified social pooling module which considers certain motion properties to represent social interactions. HMNet enables to make the accurate, unimodal multimodal and physically socially compliant prediction. Experiments on three public trajectory prediction datasets, i.e. NGSIM, HighD and Interaction show that our model achieves the state of the art performance both quantitatively and qualitatively. We will release our code here https github.com xuedashuai HMNet.


Discriminative Mutual Information Estimators for Channel Capacity Learning. Channel capacity plays a crucial role in the development of modern communication systems as it represents the maximum rate at which information can be reliably transmitted over a communication channel. Nevertheless, for the majority of channels, finding a closed form capacity expression remains an open challenge. This is because it requires to carry out two formidable tasks a) the computation of the mutual information between the channel input and output, and b) its maximization with respect to the signal distribution at the channel input. In this paper, we address both tasks. Inspired by implicit generative models, we propose a novel cooperative framework to automatically learn the channel capacity, for any type of memory less channel. In particular, we firstly develop a new methodology to estimate the mutual information directly from a discriminator typically deployed to train adversarial networks, referred to as discriminative mutual information estimator (DIME). Secondly, we include the discriminator in a cooperative channel capacity learning framework, referred to as CORTICAL, where a discriminator learns to distinguish between dependent and independent channel input output samples while a generator learns to produce the optimal channel input distribution for which the discriminator exhibits the best performance. Lastly, we prove that a particular choice of the cooperative value function solves the channel capacity estimation problem. Simulation results demonstrate that the proposed method offers high accuracy.


DOC2PPT Automatic Presentation Slides Generation from Scientific Documents. Creating presentation materials requires complex multimodal reasoning skills to summarize key concepts and arrange them in a logical and visually pleasing manner. Can machines learn to emulate this laborious process? We present a novel task and approach for document to slide generation. Solving this involves document summarization, image and text retrieval, slide structure and layout prediction to arrange key elements in a form suitable for presentation. We propose a hierarchical sequence to sequence approach to tackle our task in an end to end manner. Our approach exploits the inherent structures within documents and slides and incorporates paraphrasing and layout prediction modules to generate slides. To help accelerate research in this domain, we release a dataset about 6K paired documents and slide decks used in our experiments. We show that our approach outperforms strong baselines and produces slides with rich content and aligned imagery.


Space Non cooperative Object Active Tracking with Deep Reinforcement Learning. Active visual tracking of space non cooperative object is significant for future intelligent spacecraft to realise space debris removal, asteroid exploration, autonomous rendezvous and docking. However, existing works often consider this task into different subproblems (e.g. image preprocessing, feature extraction and matching, position and pose estimation, control law design) and optimize each module alone, which are trivial and sub optimal. To this end, we propose an end to end active visual tracking method based on DQN algorithm, named as DRLAVT. It can guide the chasing spacecraft approach to arbitrary space non cooperative target merely relied on color or RGBD images, which significantly outperforms position based visual servoing baseline algorithm that adopts state of the art 2D monocular tracker, SiamRPN. Extensive experiments implemented with diverse network architectures, different perturbations and multiple targets demonstrate the advancement and robustness of DRLAVT. In addition, We further prove our method indeed learnt the motion patterns of target with deep reinforcement learning through hundreds of trial and errors.


Exploring CTC Based End to End Techniques for Myanmar Speech Recognition. In this work, we explore a Connectionist Temporal Classification (CTC) based end to end Automatic Speech Recognition (ASR) model for the Myanmar language. A series of experiments is presented on the topology of the model in which the convolutional layers are added and dropped, different depths of bidirectional long short term memory (BLSTM) layers are used and different label encoding methods are investigated. The experiments are carried out in low resource scenarios using our recorded Myanmar speech corpus of nearly 26 hours. The best model achieves character error rate (CER) of 4.72 and syllable error rate (SER) of 12.38 on the test set.


Asymptotics of solutions of the sample average approximation method to solve risk averse stochastic programs. The paper studies the Sample Average Approximation method to solve risk averse stochastic programs expressed in terms of divergence risk measures. It continues the recent contribution 18 on the first order asymptotics of the optimal values. We study asymptotic statistical properties of the optimal solutions, deriving general convergence rates and asymptotic distributions. As a crucial point the investigations are based on a new type of conditions from the theory of empirical processes which do not rely on pathwise analytical properties of the goal functions. In particular, continuity in the parameter is not imposed in advance as usual in the literature on the Sample Average Approximation method. It is also shown that the new condition is satisfied if the paths of the goal functions are Hoelder continuous so that the main results carry over in this case. Moreover, the main results are applied to goal functions whose paths are piecewise linear as e.g. in two stage mixed integer programs.


A CW complex homotopy equivalent to spaces of locally convex curves. Locally convex curves in the sphere S n have been studied for several reasons, including the study of linear ordinary differential equations. Taking Frenet frames obtains corresponding curves Gamma in the group Spin n 1 Pi Spin n 1 to Flag n 1 is the universal cover of the space of flags. Determining the homotopy type of spaces of such curves Gamma with prescribed initial and final points appears to be a hard problem. We may focus on L n , the space of locally convex curves Gamma 0,1 to Spin n 1 with Gamma(0) 1 , Pi( Gamma(1)) Pi(1) . Convex curves form a contractible connected component of L n there are 2 n 1 other components, one for each endpoint. The homotopy type of L n has so far been determined only for n 2 . This paper is a step towards solving the problem for larger values of n . The itinerary of Gamma belongs to W n , the set of finite words in the alphabet S n 1 setminus e . The itinerary of a curve lists the non open Bruhat cells crossed. Itineraries stratify the space L n . We construct a CW complex D n which is a kind of dual of L n under this stratification the construction is similar to Poincar 'e duality. The CW complex D n is homotopy equivalent to L n . The cells of D n are naturally labeled by words in W n D n is locally finite. Explicit glueing instructions are described for lower dimensions. We describe an open subset Y n subset L n , a union of strata of L n . In each non convex component of L n , the intersection with Y n is connected and dense. Most connected components of L n are contained in Y n . For n 3 , in the other components the complement of Y n has codimension at least 2 . The set Y n is homotopy equivalent to the disjoint union of 2 n 1 copies of Omega Spin n 1 . For all n ge 2 , all connected components of L n are simply connected.


Seeing All the Angles Learning Multiview Manipulation Policies for Contact Rich Tasks from Demonstrations. Learned visuomotor policies have shown considerable success as an alternative to traditional, hand crafted frameworks for robotic manipulation. Surprisingly, an extension of these methods to the multiview domain is relatively unexplored. A successful multiview policy could be deployed on a mobile manipulation platform, allowing the robot to complete a task regardless of its view of the scene. In this work, we demonstrate that a multiview policy can be found through imitation learning by collecting data from a variety of viewpoints. We illustrate the general applicability of the method by learning to complete several challenging multi stage and contact rich tasks, from numerous viewpoints, both in a simulated environment and on a real mobile manipulation platform. Furthermore, we analyze our policies to determine the benefits of learning from multiview data compared to learning with data collected from a fixed perspective. We show that learning from multiview data results in little, if any, penalty to performance for a fixed view task compared to learning with an equivalent amount of fixed view data. Finally, we examine the visual features learned by the multiview and fixed view policies. Our results indicate that multiview policies implicitly learn to identify spatially correlated features.


A CPG Based Agile and Versatile Locomotion Framework Using Proximal Symmetry Loss. Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains, or face external disturbances, they combine a set of strategies, unconsciously and efficiently, to regain stability. This paper tackles the problem of developing a robust omnidirectional walking framework, which is able to generate versatile and agile locomotion on complex terrains. The Linear Inverted Pendulum Model and Central Pattern Generator concepts are used to develop a closed loop walk engine, which is then combined with a reinforcement learning module. This module learns to regulate the walk engine parameters adaptively, and generates residuals to adjust the robot's target joint positions (residual physics). Additionally, we propose a proximal symmetry loss function to increase the sample efficiency of the Proximal Policy Optimization algorithm, by leveraging model symmetries and the trust region concept. The effectiveness of the proposed framework was demonstrated and evaluated across a set of challenging simulation scenarios. The robot was able to generalize what it learned in unforeseen circumstances, displaying human like locomotion skills, even in the presence of noise and external pushes.


Deleting, Eliminating and Decomposing to Hereditary Classes Are All FPT Equivalent. For a graph class cal H , the graph parameters elimination distance to cal H (denoted by bf ed cal H ) Bulian and Dawar, Algorithmica, 2016 , and cal H treewidth (denoted by bf tw cal H ) Eiben et al. JCSS, 2021 aim to minimize the treedepth and treewidth, respectively, of the "torso" of the graph induced on a modulator to the graph class cal H . Here, the torso of a vertex set S in a graph G is the graph with vertex set S and an edge between two vertices u, v in S if there is a path between u and v in G whose internal vertices all lie outside S . In this paper, we show that from the perspective of (non uniform) fixed parameter tractability (FPT), the three parameters described above give equally powerful parameterizations for every hereditary graph class cal H that satisfies mild additional conditions. In fact, we show that for every hereditary graph class cal H satisfying mild additional conditions, with the exception of bf tw cal H parameterized by bf ed cal H , for every pair of these parameters, computing one parameterized by itself or any of the others is FPT equivalent to the standard vertex deletion (to cal H ) problem. As an example, we prove that an FPT algorithm for the vertex deletion problem implies a non uniform FPT algorithm for computing bf ed cal H and bf tw cal H . The conclusions of non uniform FPT algorithms being somewhat unsatisfactory, we essentially prove that if cal H is hereditary, union closed, CMSO definable, and (a) the canonical equivalence relation (or any refinement thereof) for membership in the class can be efficiently computed, or (b) the class admits a "strong irrelevant vertex rule", then there exists a uniform FPT algorithm for bf ed cal H .


Time Series is a Special Sequence Forecasting with Sample Convolution and Interaction. Time series is a special type of sequence data, a set of observations collected at even time intervals and ordered chronologically. Existing deep learning techniques use generic sequence models (e.g., recurrent neural network, Transformer model, or temporal convolutional network) for time series analysis, which ignore some of its unique properties. In particular, three components characterize time series trend, seasonality, and irregular components, and the former two components enable us to perform forecasting with reasonable accuracy. Other types of sequence data do not have such characteristics. Motivated by the above, in this paper, we propose a novel neural network architecture that conducts sample convolution and interaction for temporal modeling and apply it for the time series forecasting problem, namely textbf SCINet . Compared to conventional dilated causal convolution architectures, the proposed downsample convolve interact architecture enables multi resolution analysis besides expanding the receptive field of the convolution operation, which facilitates extracting temporal relation features with enhanced predictability. Experimental results show that SCINet achieves significant prediction accuracy improvement over existing solutions across various real world time series forecasting datasets.


Dense Video Captioning Using Unsupervised Semantic Information. We introduce a method to learn unsupervised semantic visual information based on the premise that complex events (e.g., minutes) can be decomposed into simpler events (e.g., a few seconds), and that these simple events are shared across several complex events. We split a long video into short frame sequences to extract their latent representation with three dimensional convolutional neural networks. A clustering method is used to group representations producing a visual codebook (i.e., a long video is represented by a sequence of integers given by the cluster labels). A dense representation is learned by encoding the co occurrence probability matrix for the codebook entries. We demonstrate how this representation can leverage the performance of the dense video captioning task in a scenario with only visual features. As a result of this approach, we are able to replace the audio signal in the Bi Modal Transformer (BMT) method and produce temporal proposals with comparable performance. Furthermore, we concatenate the visual signal with our descriptor in a vanilla transformer method to achieve state of the art performance in captioning compared to the methods that explore only visual features, as well as a competitive performance with multi modal methods. Our code is available at https github.com valterlej dvcusi.


Continuous Tur 'an numbers. In this paper, we define a notion of containment and avoidance for subsets of mathbb R 2 . Then we introduce a new, continuous and super additive extremal function for subsets P subseteq mathbb R 2 called px(n, P) , which is the supremum of mu 2(S) over all open P free subsets S subseteq 0, n 2 , where mu 2(S) denotes the Lebesgue measure of S in mathbb R 2 . We show that px(n, P) fully encompasses the Zarankiewicz problem and more generally the 0 1 matrix extremal function ex(n, M) up to a constant factor. More specifically, we define a natural correspondence between finite subsets P subseteq mathbb R 2 and 0 1 matrices M P , and we prove that px(n, P) Theta(ex(n, M P)) for all finite subsets P subseteq mathbb R 2 , where the constants in the bounds depend only on the distances between the points in P . We also discuss bounded infinite subsets P for which px(n, P) grows faster than ex(n, M) for all fixed 0 1 matrices M . In particular, we show that px(n, P) Theta(n 2 ) for any open subset P subseteq mathbb R 2 . We prove an even stronger result, that if Q P is the set of points with rational coordinates in any open subset P subseteq mathbb R 2 , then px(n, Q P) Theta(n 2) . Finally, we obtain a strengthening of the K H o vari S ' o s Tur ' a n theorem that applies to infinite subsets of mathbb R 2 . Specifically, for subsets P s, t, c subseteq mathbb R 2 consisting of t horizontal line segments of length s with left endpoints on the same vertical line with consecutive segments a distance of c apart, we prove that px(n, P s, t,c ) O(s frac 1 t n 2 frac 1 t ) , where the constant in the bound depends on t and c . When t 2 , we show that this bound is sharp up to a constant factor that depends on c .


A perspective on integrated atomo photonic waveguide circuits. Integrated photonic circuits based on suspended photonic rib waveguides, which can be used for coherent trapping, guiding, and splitting of ultra cold neutral atoms in two colour evanescent light fields near their surfaces, are described. Configurations of quantum inertial sensors based on such integrated atomo photonic waveguides, which are simultaneously guiding photons and atoms along the same paths, are presented. The difference between free space and guided atom interferometers in the presence of external forces is explained. The theoretical and technological challenges, to be overcome on the way to the realization of such a novel platform for quantum technologies, are discussed.


Implementation and user acceptance of research information systems. PurposeThe purpose of this paper is to present empirical evidence on the implementation, acceptance and quality related aspects of research information systems (RIS) in academic institutions.Design methodology approachThe study is based on a 2018 survey with 160 German universities and research institutions.FindingsThe paper presents recent figures about the implementation of RIS in German academic institutions, including results on the satisfaction, perceived usefulness and ease of use. It contains also information about the perceived data quality and the preferred quality management. RIS acceptance can be achieved only if the highest possible quality of the data is to be ensured. For this reason, the impact of data quality on the technology acceptance model (TAM) is examined, and the relation between the level of data quality and user acceptance of the associated institutional RIS is addressed.Research limitations implicationsThe data provide empirical elements for a better understanding of the role of the data quality for the acceptance of RIS, in the framework of a TAM. The study puts the focus on commercial and open source solutions while in house developments have been excluded. Also, mainly because of the small sample size, the data analysis was limited to descriptive statistics.Practical implicationsThe results are helpful for the management of RIS projects, to increase acceptance and satisfaction with the system, and for the further development of RIS functionalities.Originality valueThe number of empirical studies on the implementation and acceptance of RIS is low, and very few address in this context the question of data quality. The study tries to fill the gap.


Multiplicity of solutions for a class of quasilinear problems involving the 1 Laplacian operator with critical growth. The aim of this paper is to establish two results about multiplicity of solutions to problems involving the 1 Laplacian operator, with nonlinearities with critical growth. To be more specific, we study the following problem left begin array l Delta 1 u xi frac u u lambda u q 2 u u 1 2 u, quad text in Omega, u 0, quad text on partial Omega. end array right. where Omega is a smooth bounded domain in mathbb R N , N geq 2 and xi in 0,1 . Moreover, lambda 0 , q in (1,1 ) and 1 frac N N 1 . The first main result establishes the existence of many rotationally non equivalent and nonradial solutions by assuming that xi 1 , Omega x in mathbb R N , ,r x r 1 , N geq 2 , N not 3 and r 0 . In the second one, Omega is a smooth bounded domain, xi 0 , and the multiplicity of solutions is proved through an abstract result which involves genus theory for functionals which are sum of a C 1 functional with a convex lower semicontinuous functional.


Privacy Aware Identity Cloning Detection based on Deep Forest. We propose a novel method to detect identity cloning of social sensor cloud service providers to prevent the detrimental outcomes caused by identity deception. This approach leverages non privacy sensitive user profile data gathered from social networks and a powerful deep learning model to perform cloned identity detection. We evaluated the proposed method against the state of the art identity cloning detection techniques and the other popular identity deception detection models atop a real world dataset. The results show that our method significantly outperforms these techniques models in terms of Precision and F1 score.


Target Propagation via Regularized Inversion. Target Propagation (TP) algorithms compute targets instead of gradients along neural networks and propagate them backward in a way that is similar yet different than gradient back propagation (BP). The idea was first presented as a perturbative alternative to back propagation that may achieve greater accuracy in gradient evaluation when training multi layer neural networks (LeCun et al., 1989). However, TP has remained more of a template algorithm with many variations than a well identified algorithm. Revisiting insights of LeCun et al., (1989) and more recently of Lee et al. (2015), we present a simple version of target propagation based on regularized inversion of network layers, easily implementable in a differentiable programming framework. We compare its computational complexity to the one of BP and delineate the regimes in which TP can be attractive compared to BP. We show how our TP can be used to train recurrent neural networks with long sequences on various sequence modeling problems. The experimental results underscore the importance of regularization in TP in practice.


From hand to brain and back Grip forces deliver insight into the functional plasticity of somatosensory processes. The human somatosensory cortex is intimately linked to other central brain functions such as vision, audition, mechanoreception, and motor planning and control. These links are established through brain learning, and display a considerable functional plasticity. This latter fulfills an important adaptive role and ensures, for example, that humans are able to reliably manipulate and control objects in the physical world under constantly changing conditions in their immediate sensory environment. Variations in human grip force are a direct reflection of this specific kind of functional plasticity. Data from preliminary experiments where wearable wireless sensor technology (sensor gloves) was exploited to measure human grip force variations under varying sensory input conditions (eyes open or shut, soft music or hard music during gripping) are discussed here to show the extent to which grip force sensing permits quantifying somatosensory brain interactions and their functional plasticity. Experiments to take this preliminary work further are suggested. Implications for robotics, in particular the development of end effector robots for upper limb movement planning and control, are brought forward.


Distributed Spectrum and Power Allocation for D2D U Networks A Scheme based on NN and Federated Learning. In this paper, a Device to Device communication on unlicensed bands (D2D U) enabled network is studied. To improve the spectrum efficiency (SE) on the unlicensed bands and fit its distributed structure while ensuring the fairness among D2D U links and the harmonious coexistence with WiFi networks, a distributed joint power and spectrum scheme is proposed. In particular, a parameter, named as price, is defined, which is updated at each D2D U pair by a online trained Neural network (NN) according to the channel state and traffic load. In addition, the parameters used in the NN are updated by two ways, unsupervised self iteration and federated learning, to guarantee the fairness and harmonious coexistence. Then, a non convex optimization problem with respect to the spectrum and power is formulated and solved on each D2D U link to maximize its own data rate. Numerical simulation results are demonstrated to verify the effectiveness of the proposed scheme.


Move Beyond Trajectories Distribution Space Coupling for Crowd Navigation. Cooperatively avoiding collision is a critical functionality for robots navigating in dense human crowds, failure of which could lead to either overaggressive or overcautious behavior. A necessary condition for cooperative collision avoidance is to couple the prediction of the agents' trajectories with the planning of the robot's trajectory. However, it is unclear that trajectory based cooperative collision avoidance captures the correct agent attributes. In this work we migrate from trajectory based coupling to a formalism that couples agent preference distributions. In particular, we show that preference distributions (probability density functions representing agents' intentions) can capture higher order statistics of agent behaviors, such as willingness to cooperate. Thus, coupling in distribution space exploits more information about inter agent cooperation than coupling in trajectory space. We thus introduce a general objective for coupled prediction and planning in distribution space, and propose an iterative best response optimization method based on variational analysis with guaranteed sufficient decrease. Based on this analysis, we develop a sampling based motion planning framework called DistNav that runs in real time on a laptop CPU. We evaluate our approach on challenging scenarios from both real world datasets and simulation environments, and benchmark against a wide variety of model based and machine learning based approaches. The safety and efficiency statistics of our approach outperform all other models. Finally, we find that DistNav is competitive with human safety and efficiency performance.


Automated Detection of GDPR Disclosure Requirements in Privacy Policies using Deep Active Learning. Since GDPR came into force in May 2018, companies have worked on their data practices to comply with this privacy law. In particular, since the privacy policy is the essential communication channel for users to understand and control their privacy, many companies updated their privacy policies after GDPR was enforced. However, most privacy policies are verbose, full of jargon, and vaguely describe companies' data practices and users' rights. Therefore, it is unclear if they comply with GDPR. In this paper, we create a privacy policy dataset of 1,080 websites labeled with the 18 GDPR requirements and develop a Convolutional Neural Network (CNN) based model which can classify the privacy policies with an accuracy of 89.2 . We apply our model to perform a measurement on the compliance in the privacy policies. Our results show that even after GDPR went into effect, 97 of websites still fail to comply with at least one requirement of GDPR.


APEX Unsupervised, Object Centric Scene Segmentation and Tracking for Robot Manipulation. Recent advances in unsupervised learning for object detection, segmentation, and tracking hold significant promise for applications in robotics. A common approach is to frame these tasks as inference in probabilistic latent variable models. In this paper, however, we show that the current state of the art struggles with visually complex scenes such as typically encountered in robot manipulation tasks. We propose APEX, a new latent variable model which is able to segment and track objects in more realistic scenes featuring objects that vary widely in size and texture, including the robot arm itself. This is achieved by a principled mask normalisation algorithm and a high resolution scene encoder. To evaluate our approach, we present results on the real world Sketchy dataset. This dataset, however, does not contain ground truth masks and object IDs for a quantitative evaluation. We thus introduce the Panda Pushing Dataset (P2D) which shows a Panda arm interacting with objects on a table in simulation and which includes ground truth segmentation masks and object IDs for tracking. In both cases, APEX comprehensively outperforms the current state of the art in unsupervised object segmentation and tracking. We demonstrate the efficacy of our segmentations for robot skill execution on an object arrangement task, where we also achieve the best or comparable performance among all the baselines.


ASTANA Practical String Deobfuscation for Android Applications Using Program Slicing. Software obfuscation is widely used by Android developers to protect the source code of their applications against adversarial reverse engineering efforts. A specific type of obfuscation, string obfuscation, transforms the content of all string literals in the source code to non interpretable text and inserts logic to deobfuscate these string literals at runtime. In this work, we demonstrate that string obfuscation is easily reversible. We present ASTANA, a practical tool for Android applications to recovers the human readable content from obfuscated string literals. ASTANA makes minimal assumptions about the obfuscation logic or application structure. The key idea is to execute the deobfuscation logic for a specific (obfuscated) string literal, which yields the original string value. To obtain the relevant deobfuscation logic, we present a lightweight and optimistic algorithm, based on program slicing techniques. By an experimental evaluation with 100 popular real world financial applications, we demonstrate the practicality of ASTANA. We verify the correctness of our deobfuscation tool and provide insights in the behaviour of string obfuscators applied by the developers of the evaluated Android applications.


Some Examples of Family Floer Mirror. In this article, we give explicit calculations for the family Floer mirrors of some non compact Calabi Yau surfaces. We compare it with the mirror construction of Gross Hacking Keel for suitably chosen log Calabi Yau pairs and the rank two cluster varieties of finite type. In particular, the analytifications of the later two give partial compactifications of the family Floer mirrors that we computed.


ViSeRet A simple yet effective approach to moment retrieval via fine grained video segmentation. Video text retrieval has many real world applications such as media analytics, surveillance, and robotics. This paper presents the 1st place solution to the video retrieval track of the ICCV VALUE Challenge 2021. We present a simple yet effective approach to jointly tackle two video text retrieval tasks (video retrieval and video corpus moment retrieval) by leveraging the model trained only on the video retrieval task. In addition, we create an ensemble model that achieves the new state of the art performance on all four datasets (TVr, How2r, YouCook2r, and VATEXr) presented in the VALUE Challenge.


Making Person Search Enjoy the Merits of Person Re identification. Person search is an extended task of person re identification (Re ID). However, most existing one step person search works have not studied how to employ existing advanced Re ID models to boost the one step person search performance due to the integration of person detection and Re ID. To address this issue, we propose a faster and stronger one step person search framework, the Teacher guided Disentangling Networks (TDN), to make the one step person search enjoy the merits of the existing Re ID researches. The proposed TDN can significantly boost the person search performance by transferring the advanced person Re ID knowledge to the person search model. In the proposed TDN, for better knowledge transfer from the Re ID teacher model to the one step person search model, we design a strong one step person search base framework by partially disentangling the two subtasks. Besides, we propose a Knowledge Transfer Bridge module to bridge the scale gap caused by different input formats between the Re ID model and one step person search model. During testing, we further propose the Ranking with Context Persons strategy to exploit the context information in panoramic images for better retrieval. Experiments on two public person search datasets demonstrate the favorable performance of the proposed method.


ezcox An R CRAN Package for Cox Model Batch Processing and Visualization. Cox analysis is a common clinical data analysis technique to link valuable variables to clinical outcomes including dead and relapse. In the omics era, Cox model batch processing is a basic strategy for screening clinically relevant variables, biomarker discovery and gene signature identification. However, all such analyses have been implemented with homebrew code in research community, thus lack of transparency and reproducibility. Here, we present ezcox, the first R CRAN package for Cox model batch processing and visualization. ezcox is an open source R package under GPL 3 license and it is free available at https github.com ShixiangWang ezcox and https cran.r project.org package ezcox.


MedGraph An experimental semantic information retrieval method using knowledge graph embedding for the biomedical citations indexed in PubMed. Here we study the semantic search and retrieval problem in biomedical digital libraries. First, we introduce MedGraph, a knowledge graph embedding based method that provides semantic relevance retrieval and ranking for the biomedical literature indexed in PubMed. Second, we evaluate our method using PubMed's Best Match algorithm. Moreover, we compare our method MedGraph to a traditional TFIDF based algorithm. We use a dataset extracted from PubMed, including 30 million articles' metadata such as abstracts, author information, citation information, and extracted biological entity mentions. We do that by pulling a subset of the dataset to evaluate MedGraph using predefined queries with ground truth ranked results. To our knowledge, this technique has not been explored before in biomedical information retrieval. In addition, our results provide evidence that semantic approaches to search and relevance in biomedical digital libraries that rely on knowledge graph modeling offer better search relevance results when compared with traditional approaches in terms of objective metrics.


Some punctured codes of several families of binary linear codes. Two general constructions of linear codes with functions over finite fields have been extensively studied in the literature. The first one is given by mathcal C (f) left rm Tr (af(x) bx) x in mathbb F q m a,b in mathbb F q m right , where q is a prime power, bF q m bF q m setminus 0 , tr is the trace function from bF q m to bF q , and f(x) is a function from mathbb F q m to mathbb F q m with f(0) 0 . Almost bent functions, quadratic functions and some monomials on bF 2 m were used in the first construction, and many families of binary linear codes with few weights were obtained in the literature. This paper studies some punctured codes of these binary codes. Several families of binary linear codes with few weights and new parameters are obtained in this paper. Several families of distance optimal binary linear codes with new parameters are also produced in this paper.


Paraphrase Generation as Unsupervised Machine Translation. In this paper, we propose a new paradigm for paraphrase generation by treating the task as unsupervised machine translation (UMT) based on the assumption that there must be pairs of sentences expressing the same meaning in a large scale unlabeled monolingual corpus. The proposed paradigm first splits a large unlabeled corpus into multiple clusters, and trains multiple UMT models using pairs of these clusters. Then based on the paraphrase pairs produced by these UMT models, a unified surrogate model can be trained to serve as the final Seq2Seq model to generate paraphrases, which can be directly used for test in the unsupervised setup, or be finetuned on labeled datasets in the supervised setup. The proposed method offers merits over machine translation based paraphrase generation methods, as it avoids reliance on bilingual sentence pairs. It also allows human intervene with the model so that more diverse paraphrases can be generated using different filtering criteria. Extensive experiments on existing paraphrase dataset for both the supervised and unsupervised setups demonstrate the effectiveness the proposed paradigm.


Paths are generically realisable. We show that every 0 1 multiplicity matrix for a simple graph G is generically realisable for G . In particular, every multiplicity matrix for a path is generically realisable. We use this result to provide several families of joins of graphs that are realisable by a matrix with only two distinct eigenvalues.


Do Facial Trait Correlates with Roll Call Voting in Parliament? Using fWHR to Study Performance in Politics. Research has shown that people recognize and select leaders based on their facial appearance. However, considering the correlation between the performance of leaders and their facial traits, empirical findings are mixed. This paper adds to the debate by focusing on two previously understudied aspects of facial traits among political leaders (i) previous studies have focused on electoral success and achievement drive of politicians omitting their actual daily performance after elections (ii) previous research has analyzed individual politicians omitting the context of social circumstances which potentially influence their performance. We address these issues by analyzing Ukrainian members of parliament (MPs) who voted for bills in six consecutive Verkhovna Rada starting from Rada 4 (2002 06) to Rada 9 (2019 Present) to study politicians' performance, which is defined as co voting or cooperation between MPs in voting on the same bill. In simple words, we analyze whether politicians tend to follow leaders when voting. This ability to summon the votes of others is interpreted as better performance. To measure performance, we proposed a generic methodology named Feature Importance For Measuring Performance (FIMP) that can be used in various scenarios. Using FIMP, our data suggest that MPs vote has no impact from their colleagues with higher or lower facial width to height ratio (fWHR), a popular measure of the facial trait.


Arbitrary Order Solutions for the Eikonal Equation using a Discontinuous Galerkin Method. We provide a method to compute the entropy satisfying weak solution to the eikonal equation in an arbitrary order polynomial space. The method uses an artificial viscosity approach and is demonstrated for the signed distance function, where exact solutions are available. The method is designed specifically for an existing high order discontinuous Galerkin framework, which uses standard convection, diffusion, and source terms. We show design order of accuracy and good behavior for both shocks and rarefaction type solutions. Finally the distance function around a complex multi element airfoil is computed using a high order accurate representation.


Impact of pandemic fatigue on the spread of COVID 19 a mathematical modelling study. In late 2020, many countries around the world faced another surge in number of confirmed cases of COVID 19, including United Kingdom, Canada, Brazil, United States, etc., which resulted in a large nationwide and even worldwide wave. While there have been indications that precaution fatigue could be a key factor, no scientific evidence has been provided so far. We used a stochastic metapopulation model with a hierarchical structure and fitted the model to the positive cases in the US from the start of outbreak to the end of 2020. We incorporated non pharmaceutical interventions (NPIs) into this model by assuming that the precaution strength grows with positive cases and studied two types of pandemic fatigue. We found that people in most states and in the whole US respond to the outbreak in a sublinear manner (with exponent k 0.5), while only three states (Massachusetts, New York and New Jersey) have linear reaction (k 1). Case fatigue (decline in people's vigilance to positive cases) is responsible for 58 of cases, while precaution fatigue (decay of maximal fraction of vigilant group) accounts for 26 cases. If there were no pandemic fatigue (no case fatigue and no precaution fatigue), total positive cases would have reduced by 68 on average. Our study shows that pandemic fatigue is the major cause of the worsening situation of COVID 19 in United States. Reduced vigilance is responsible for most positive cases, and higher mortality rate tends to push local people to react to the outbreak faster and maintain vigilant for longer time.


Academic vs. Biological Age in Research on Academic Careers A Large scale Study with Implications for Scientifically Developing Systems. Biological age is an important sociodemographic factor in studies on academic careers (research productivity, scholarly impact, and collaboration patterns). It is assumed that the academic age, or the time elapsed from the first publication, is a good proxy for biological age. In this study, we analyze the limitations of the proxy in academic career studies, using as an example the entire population of Polish academic scientists visible in the last decade in global science and holding at least a PhD (N 20,569). The proxy works well for science, technology, engineering, mathematics, and medicine (STEMM) disciplines however, for non STEMM disciplines (particularly for humanities and social sciences), it has a dramatically worse performance. This negative conclusion is particularly important for systems that have only become recently visible in global academic journals. The micro level data suggest a delayed participation of social scientists and humanists in global science networks, with practical implications for predicting biological age from academic age. We calculate correlation coefficients, present contingency analysis of academic career stages with academic positions and age groups, and create a linear multivariate regression model. Our research suggests that in scientifically developing countries, academic age as a proxy for biological age should be used more cautiously than in advanced countries ideally, it should be used only for STEMM disciplines.


An Epidemiological Model for contact tracing with the Dutch CoronaMelder App. We present an epidemiological model for the effectiveness of CoronaMelder, the Dutch digital contact tracing app developed on top of the Google Apple Exposure Notification framework. We compare the effectiveness of CoronaMelder with manual contract tracing on a number of metrics. CoronaMelder turns out to have a small but noticeable positive influence in slowing down the COVID 19 pandemic, an effect that will become more pronounced in an opened up society where adoption of CoronaMelder is increased.


Unbiased IoU for Spherical Image Object Detection. As one of the most fundamental and challenging problems in computer vision, object detection tries to locate object instances and find their categories in natural images. The most important step in the evaluation of object detection algorithm is calculating the intersection over union (IoU) between the predicted bounding box and the ground truth one. Although this procedure is well defined and solved for planar images, it is not easy for spherical image object detection. Existing methods either compute the IoUs based on biased bounding box representations or make excessive approximations, thus would give incorrect results. In this paper, we first identify that spherical rectangles are unbiased bounding boxes for objects in spherical images, and then propose an analytical method for IoU calculation without any approximations. Based on the unbiased representation and calculation, we also present an anchor free object detection algorithm for spherical images. The experiments on two spherical object detection datasets show that the proposed method can achieve better performance than existing methods.


A Torelli Theorem for Graph Isomorphisms. It is known that isomorphisms of graph Jacobians induce cyclic bijections on the associated graphs. We characterize when such cyclic bijections can be strengthened to graph isomorphisms, in terms of an easily computed divisor. The result refines tools used in algebraic geometry to examine the fibers of the compactified Torelli map.


Chaos in stochastic 2d Galerkin Navier Stokes. We prove that all Galerkin truncations of the 2d stochastic Navier Stokes equations in vorticity form on any rectangular torus subjected to hypoelliptic, additive stochastic forcing are chaotic at sufficiently small viscosity, provided the frequency truncation satisfies N geq 392 . By chaotic'' we mean having a strictly positive Lyapunov exponent, i.e. almost sure asymptotic exponential growth of the derivative with respect to generic initial conditions. A sufficient condition for such results was derived in previous joint work with Alex Blumenthal which reduces the question to the non degeneracy of a matrix Lie algebra implying H "ormander's condition for the Markov process lifted to the sphere bundle (projective hypoellipticity). The purpose of this work is to reformulate this condition to be more amenable for Galerkin truncations of PDEs and then to verify this condition using a) a reduction to genericity properties of a diagonal sub algebra inspired by the root space decomposition of semi simple Lie algebras and b) computational algebraic geometry executed by Maple in exact rational arithmetic. Note that even though we use a computer assisted proof, the result is valid for all aspect ratios and all sufficiently high dimensional truncations in fact, certain steps simplify in the formal infinite dimensional limit.


G CoS GNN Accelerator Co Search Towards Both Better Accuracy and Efficiency. Graph Neural Networks (GNNs) have emerged as the state of the art (SOTA) method for graph based learning tasks. However, it still remains prohibitively challenging to inference GNNs over large graph datasets, limiting their application to large scale real world tasks. While end to end jointly optimizing GNNs and their accelerators is promising in boosting GNNs' inference efficiency and expediting the design process, it is still underexplored due to the vast and distinct design spaces of GNNs and their accelerators. In this work, we propose G CoS, a GNN and accelerator co search framework that can automatically search for matched GNN structures and accelerators to maximize both task accuracy and acceleration efficiency. Specifically, GCoS integrates two major enabling components (1) a generic GNN accelerator search space which is applicable to various GNN structures and (2) a one shot GNN and accelerator co search algorithm that enables simultaneous and efficient search for optimal GNN structures and their matched accelerators. To the best of our knowledge, G CoS is the first co search framework for GNNs and their accelerators. Extensive experiments and ablation studies show that the GNNs and accelerators generated by G CoS consistently outperform SOTA GNNs and GNN accelerators in terms of both task accuracy and hardware efficiency, while only requiring a few hours for the end to end generation of the best matched GNNs and their accelerators.


Identification of Driver Phone Usage Violations via State of the Art Object Detection with Tracking. The use of mobiles phones when driving have been a major factor when it comes to road traffic incidents and the process of capturing such violations can be a laborious task. Advancements in both modern object detection frameworks and high performance hardware has paved the way for a more automated approach when it comes to video surveillance. In this work, we propose a custom trained state of the art object detector to work with roadside cameras to capture driver phone usage without the need for human intervention. The proposed approach also addresses the issues caused by windscreen glare and introduces the steps required to remedy this. Twelve pre trained models are fine tuned with our custom dataset using four popular object detection methods YOLO, SSD, Faster R CNN, and CenterNet. Out of all the object detectors tested, the YOLO yields the highest accuracy levels of up to 96 (AP10) and frame rates of up to 30 FPS. DeepSort object tracking algorithm is also integrated into the best performing model to collect records of only the unique violations, and enable the proposed approach to count the number of vehicles. The proposed automated system will collect the output images of the identified violations, timestamps of each violation, and total vehicle count. Data can be accessed via a purpose built user interface.


Summarization, Simplification, and Generation The Case of Patents. We survey Natural Language Processing (NLP) approaches to summarizing, simplifying, and generating patents' text. While solving these tasks has important practical applications given patents' centrality in the R D process patents' idiosyncrasies open peculiar challenges to the current NLP state of the art. This survey aims at a) describing patents' characteristics and the questions they raise to the current NLP systems, b) critically presenting previous work and its evolution, and c) drawing attention to directions of research in which further work is needed. To the best of our knowledge, this is the first survey of generative approaches in the patent domain.


Multi party Private Set Operations with an External Decider. A Private Set Operation (PSO) protocol involves at least two parties with their private input sets. The goal of the protocol is for the parties to learn the output of a set operation, i.e. set intersection, on their input sets, without revealing any information about the items that are not in the output set. Commonly, the outcome of the set operation is revealed to parties and no one else. However, in many application areas of PSO the result of the set operation should be learned by an external participant whom does not have an input set. We call this participant the decider. In this paper, we present new variants of multi party PSO, where there is a decider who gets the result. All parties expect the decider have a private set. Other parties neither learn this result, nor anything else about this protocol. Moreover, we present a generic solution to the problem of PSO.


Multilayer Resource aware Partitioning for Fog Application Placement. Fog computing emerged as a crucial platform for the deployment of IoT applications. The complexity of such applications requires methods that handle the resource diversity and network structure of Fog devices while maximizing the service placement and reducing resource wastage. Prior studies in this domain primarily focused on optimizing specific application requirements and fail to address the network topology combined with the different types of resources encountered in Fog devices. To overcome these problems, we propose a multilayer resource aware partitioning method to minimize the resource wastage and maximize the service placement and deadline satisfaction rates in a Fog infrastructure with high multi user application placement requests. Our method represents the heterogeneous Fog resources as a multilayered network graph and partitions them based on network topology and resource features. Afterward, it identifies the appropriate device partitions for placing an application according to its requirements, which need to overlap in the same network topology partition. Simulation results show that our multilayer resource aware partitioning method is able to place twice as many services, satisfy deadlines for three times as many application requests, and reduce the resource wastage by up to 15 32 times compared to two availability aware and resource aware methods.


Validation of the Virtual Reality Neuroscience Questionnaire Maximum Duration of Immersive Virtual Reality Sessions Without the Presence of Pertinent Adverse Symptomatology. Research suggests that the duration of a VR session modulates the presence and intensity of VRISE, but there are no suggestions regarding the appropriate maximum duration of VR sessions. The implementation of high end VR HMDs in conjunction with ergonomic VR software seems to mitigate the presence of VRISE substantially. However, a brief tool does not currently exist to appraise and report both the quality of software features and VRISE intensity quantitatively. The VRNQ was developed to assess the quality of VR software in terms of user experience, game mechanics, in game assistance, and VRISE. Forty participants aged between 28 and 43 years were recruited (18 gamers and 22 non gamers) for the study. They participated in 3 different VR sessions until they felt weary or discomfort and subsequently filled in the VRNQ. Our results demonstrated that VRNQ is a valid tool for assessing VR software as it has good convergent, discriminant, and construct validity. The maximum duration of VR sessions should be between 55 70 minutes when the VR software meets or exceeds the parsimonious cut offs of the VRNQ and the users are familiarized with the VR system. Also. the gaming experience does not seem to affect how long VR sessions should last. Also, while the quality of VR software substantially modulates the maximum duration of VR sessions, age and education do not. Finally, deeper immersion, better quality of graphics and sound, and more helpful in game instructions and prompts were found to reduce VRISE intensity. The VRNQ facilitates the brief assessment and reporting of the quality of VR software features and or the intensity of VRISE, while its minimum and parsimonious cut offs may appraise the suitability of VR software. The findings of this study contribute to the establishment of rigorous VR methods that are crucial for the viability of immersive VR as a research and clinical tool.


Rough paths and regularization. Calculus via regularizations and rough paths are two methods to approach stochastic integration and calculus close to pathwise calculus. The origin of rough paths theory is purely deterministic, calculus via regularization is based on deterministic techniques but there is still a probability in the background. The goal of this paper is to establish a connection between stochastically controlled type processes, a concept reminiscent from rough paths theory, and the so called weak Dirichlet processes. As a by product, we present the connection between rough and Stratonovich integrals for c a dl a g weak Dirichlet processes integrands and continuous semimartingales integrators.


Case based Reasoning for Better Generalization in Textual Reinforcement Learning. Text based games (TBG) have emerged as promising environments for driving research in grounded language understanding and studying problems like generalization and sample efficiency. Several deep reinforcement learning (RL) methods with varying architectures and learning schemes have been proposed for TBGs. However, these methods fail to generalize efficiently, especially under distributional shifts. In a departure from deep RL approaches, in this paper, we propose a general method inspired by case based reasoning to train agents and generalize out of the training distribution. The case based reasoner collects instances of positive experiences from the agent's interaction with the world in the past and later reuses the collected experiences to act efficiently. The method can be applied in conjunction with any existing on policy neural agent in the literature for TBGs. Our experiments show that the proposed approach consistently improves existing methods, obtains good out of distribution generalization, and achieves new state of the art results on widely used environments.


On Concentration Inequalities for Vector Valued Lipschitz Functions. We derive two upper bounds for the probability of deviation of a vector valued Lipschitz function of a collection of random variables from its expected value. The resulting upper bounds can be tighter than bounds obtained by a direct application of a classical theorem due to Bobkov and G " o tze.


Curiosity Notebook The Design of a Research Platform for Learning by Teaching. While learning by teaching is a popular pedagogical technique, it is a learning phenomenon that is difficult to study due to variability in the tutor tutee pairings and learning environments. In this paper, we introduce the Curiosity Notebook, a web based research infrastructure for studying learning by teaching via the use of a teachable agent. We describe and provide rationale for the set of features that are essential for such a research infrastructure, outline how these features have evolved over two design iterations of the Curiosity Notebook and through two studies a 4 week field study with 12 elementary school students interacting with a NAO robot and an hour long online observational study with 41 university students interacting with an agent demonstrate the utility of our platform for making observations of learning by teaching phenomena in diverse learning environments. Based on these findings, we conclude the paper by reflecting on our design evolution and envisioning future iterations of the Curiosity Notebook.


Aperiodic two way transducers and FO transductions. Deterministic two way transducers on finite words have been shown by Engelfriet and Hoogeboom to have the same expressive power as MSO transductions. We introduce a notion of aperiodicity for these transducers and we show that aperiodic transducers correspond exactly to FO transductions. This lifts to transducers the classical equivalence for languages between FO definability, recognition by aperiodic monoids and acceptance by counter free automata.


EmergencyNet Efficient Aerial Image Classification for Drone Based Emergency Monitoring Using Atrous Convolutional Feature Fusion. Deep learning based algorithms can provide state of the art accuracy for remote sensing technologies such as unmanned aerial vehicles (UAVs) drones, potentially enhancing their remote sensing capabilities for many emergency response and disaster management applications. In particular, UAVs equipped with camera sensors can operating in remote and difficult to access disaster stricken areas, analyze the image and alert in the presence of various calamities such as collapsed buildings, flood, or fire in order to faster mitigate their effects on the environment and on human population. However, the integration of deep learning introduces heavy computational requirements, preventing the deployment of such deep neural networks in many scenarios that impose low latency constraints on inference, in order to make mission critical decisions in real time. To this end, this article focuses on the efficient aerial image classification from on board a UAV for emergency response monitoring applications. Specifically, a dedicated Aerial Image Database for Emergency Response applications is introduced and a comparative analysis of existing approaches is performed. Through this analysis a lightweight convolutional neural network architecture is proposed, referred to as EmergencyNet, based on atrous convolutions to process multiresolution features and capable of running efficiently on low power embedded platforms achieving upto 20x higher performance compared to existing models with minimal memory requirements with less than 1 accuracy drop compared to state of the art models.


Categorical data as a stone guest in a data science project for predicting defective water meters. After a one year long effort of research on the field, we developed a machine learning based classifier, tailored to predict whether a mechanical water meter would fail with passage of time and intensive use as well. A recurrent deep neural network (RNN) was trained with data extrapolated from 15 million readings of water consumption, gathered from 1 million meters. The data we used for training were essentially of two types continuous vs categorical. Categorical being a type of data that can take on one of a limited and fixed number of possible values, on the basis of some qualitative property while continuous, in this case, are the values of the measurements. taken at the meters, of the quantity of consumed water (cubic meters). In this paper, we want to discuss the fact that while the prediction accuracy of our RNN has exceeded the 80 on average, based on the use of continuous data, those performances did not improve, significantly, with the introduction of categorical information during the training phase. From a specific viewpoint, this remains an unsolved and critical problem of our research. Yet, if we reason about this controversial case from a data science perspective, we realize that we have had a confirmation that accurate machine learning solutions cannot be built without the participation of domain experts, who can differentiate on the importance of (the relation between) different types of data, each with its own sense, validity, and implications. Past all the original hype, the science of data is thus evolving towards a multifaceted discipline, where the designitations of data scientist machine learning expert and domain expert are symbiotic


Scalable Personalised Item Ranking through Parametric Density Estimation. Learning from implicit feedback is challenging because of the difficult nature of the one class problem we can observe only positive examples. Most conventional methods use a pairwise ranking approach and negative samplers to cope with the one class problem. However, such methods have two main drawbacks particularly in large scale applications (1) the pairwise approach is severely inefficient due to the quadratic computational cost and (2) even recent model based samplers (e.g. IRGAN) cannot achieve practical efficiency due to the training of an extra model. In this paper, we propose a learning to rank approach, which achieves convergence speed comparable to the pointwise counterpart while performing similarly to the pairwise counterpart in terms of ranking effectiveness. Our approach estimates the probability densities of positive items for each user within a rich class of distributions, viz. emph exponential family . In our formulation, we derive a loss function and the appropriate negative sampling distribution based on maximum likelihood estimation. We also develop a practical technique for risk approximation and a regularisation scheme. We then discuss that our single model approach is equivalent to an IRGAN variant under a certain condition. Through experiments on real world datasets, our approach outperforms the pointwise and pairwise counterparts in terms of effectiveness and efficiency.