PyTorch, Explain! A Python library for Logic Explained Networks. "PyTorch, Explain!" is a Python module integrating a variety of state of the art approaches to provide logic explanations from neural networks. This package focuses on bringing these methods to non specialists. It has minimal dependencies and it is distributed under the Apache 2.0 licence allowing both academic and commercial use. Source code and documentation can be downloaded from the github repository https github.com pietrobarbiero pytorch explain.


Organization and Understanding of a Tactile Information Dataset TacAct During Physical Human Robot Interactions. Advanced service robots require superior tactile intelligence to guarantee human contact safety and to provide essential supplements to visual and auditory information for human robot interaction, especially when a robot is in physical contact with a human. Tactile intelligence is an essential capability of perception and recognition from tactile information, based on the learning from a large amount of tactile data and the understanding of the physical meaning behind the data. This report introduces a recently collected and organized dataset "TacAct" that encloses real time pressure distribution when a human subject touches the arms of a nursing care robot. The dataset consists of information from 50 subjects who performed a total of 24,000 touch actions. Furthermore, the details of the dataset are described, the data are preliminarily analyzed, and the validity of the collected information is tested through a convolutional neural network LeNet 5 classifying different types of touch actions. We believe that the TacAct dataset would be more than beneficial for the community of human interactive robots to understand the tactile profile under various circumstances.


A note on the Blum Hanson property of some contractions on mathrm L p spaces. If Omega is a measure space, we show that absolute contractions which are selfadjoint on mathrm L 2( Omega) induce contractions on mathrm L p( Omega) which satisfy the Blum Hanson property. Our very short argument relies on the use of noncommutative mathrm L p spaces.


Adapting to the Long Tail A Meta Analysis of Transfer Learning Research for Language Understanding Tasks. Natural language understanding (NLU) has made massive progress driven by large benchmarks, paired with research on transfer learning to broaden its impact. Benchmarks are dominated by a small set of frequent phenomena, leaving a long tail of infrequent phenomena underrepresented. In this work, we reflect on the question have transfer learning methods sufficiently addressed performance of benchmark trained models on the long tail? Since benchmarks do not list included excluded phenomena, we conceptualize the long tail using macro level dimensions such as underrepresented genres, topics, etc. We assess trends in transfer learning research through a qualitative meta analysis of 100 representative papers on transfer learning for NLU. Our analysis asks three questions (i) Which long tail dimensions do transfer learning studies target? (ii) Which properties help adaptation methods improve performance on the long tail? (iii) Which methodological gaps have greatest negative impact on long tail performance? Our answers to these questions highlight major avenues for future research in transfer learning for the long tail. Lastly, we present a case study comparing the performance of various adaptation methods on clinical narratives to show how systematically conducted meta experiments can provide insights that enable us to make progress along these future avenues.


Data Centric Engineering integrating simulation, machine learning and statistics. Challenges and Opportunities. Recent advances in machine learning, coupled with low cost computation, availability of cheap streaming sensors, data storage and cloud technologies, has led to widespread multi disciplinary research activity with significant interest and investment from commercial stakeholders. Mechanistic models, based on physical equations, and purely data driven statistical approaches represent two ends of the modelling spectrum. New hybrid, data centric engineering approaches, leveraging the best of both worlds and integrating both simulations and data, are emerging as a powerful tool with a transformative impact on the physical disciplines. We review the key research trends and application scenarios in the emerging field of integrating simulations, machine learning, and statistics. We highlight the opportunities that such an integrated vision can unlock and outline the key challenges holding back its realisation. We also discuss the bottlenecks in the translational aspects of the field and the long term upskilling requirements of the existing workforce and future university graduates.


Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals. The ability to sequence unordered events is an essential skill to comprehend and reason about real world task procedures, which often requires thorough understanding of temporal common sense and multimodal information, as these procedures are often communicated through a combination of texts and images. Such capability is essential for applications such as sequential task planning and multi source instruction summarization. While humans are capable of reasoning about and sequencing unordered multimodal procedural instructions, whether current machine learning models have such essential capability is still an open question. In this work, we benchmark models' capability of reasoning over and sequencing unordered multimodal instructions by curating datasets from popular online instructional manuals and collecting comprehensive human annotations. We find models not only perform significantly worse than humans but also seem incapable of efficiently utilizing the multimodal information. To improve machines' performance on multimodal event sequencing, we propose sequentiality aware pretraining techniques that exploit the sequential alignment properties of both texts and images, resulting in 5 significant improvements.


Towards a practical lip to speech conversion system using deep neural networks and mobile application frontend. Articulatory to acoustic (forward) mapping is a technique to predict speech using various articulatory acquisition techniques as input (e.g. ultrasound tongue imaging, MRI, lip video). The advantage of lip video is that it is easily available and affordable most modern smartphones have a front camera. There are already a few solutions for lip to speech synthesis, but they mostly concentrate on offline training and inference. In this paper, we propose a system built from a backend for deep neural network training and inference and a fronted as a form of a mobile application. Our initial evaluation shows that the scenario is feasible a top 5 classification accuracy of 74 is combined with feedback from the mobile application user, making sure that the speaking impaired might be able to communicate with this solution.


Automatic Evaluation and Moderation of Open domain Dialogue Systems. The development of Open Domain Dialogue Systems (ODS)is a trending topic due to the large number of research challenges, large societal and business impact, and advances in the underlying technology. However, the development of these kinds of systems requires two important characteristics 1) automatic evaluation mechanisms that show high correlations with human judgements across multiple dialogue evaluation aspects (with explainable features for providing constructive and explicit feedback on the quality of generative models' responses for quick development and deployment)and 2) mechanisms that can help to control chatbot responses,while avoiding toxicity and employing intelligent ways to handle toxic user comments and keeping interaction flow and engagement. This track at the 10th Dialogue System Technology Challenge (DSTC10) is part of the ongoing effort to promote scalable and toxic free ODS. This paper describes the datasets and baselines provided to participants, as well as submission evaluation results for each of the two proposed subtasks.


Mechanochemical models for calcium waves in embryonic epithelia. In embryogenesis, epithelial cells, acting as individual entities or as coordinated aggregates in a tissue, exhibit strong coupling between chemical signalling and mechanical responses to internally or externally applied stresses. Intercellular communication in combination with such coordination of morphogenetic movements can lead to drastic modifications in the calcium distribution in the cells. In this paper we extend the recent mechanochemical model in K. Kaouri, P.K. Maini, P.A. Skourides, N. Christodoulou, S.J. Chapman. J. Math. Biol., 78 (2019) 2059 2092 , for an epithelial continuum in one dimension, to a more realistic multi dimensional case. The resulting parametrised governing equations consist of an advection diffusion reaction system for calcium signalling coupled with active stress linear viscoelasticity and equipped with pure Neumann boundary conditions. We implement a mixed finite element method for the simulation of this complex multiphysics problem. Special care is taken in the treatment of the stress free boundary conditions for the viscoelasticity in order to eliminate rigid motions from the space of admissible displacements. The stability and solvability of the continuous weak formulation is shown using fixed point theory. We investigate numerically the solutions of this system and show that solitary waves and periodic wavetrains of calcium propagate through the embryonic epithelial sheet. We analyse the bifurcations of the system guided by the bifurcation analysis of the one dimensional model. We also demonstrate the nucleation of calcium sparks into synchronous calcium waves coupled with contraction. This coupled model can be employed to gain insights into recent experimental observations in the context of embryogenesis, but also in other biological systems such as cancer cells, wound healing, keratinocytes, or white blood cells.


Towards Debiasing Temporal Sentence Grounding in Video. The temporal sentence grounding in video (TSGV) task is to locate a temporal moment from an untrimmed video, to match a language query, i.e., a sentence. Without considering bias in moment annotations (e.g., start and end positions in a video), many models tend to capture statistical regularities of the moment annotations, and do not well learn cross modal reasoning between video and language query. In this paper, we propose two debiasing strategies, data debiasing and model debiasing, to "force" a TSGV model to capture cross modal interactions. Data debiasing performs data oversampling through video truncation to balance moment temporal distribution in train set. Model debiasing leverages video only and query only models to capture the distribution bias, and forces the model to learn cross modal interactions. Using VSLNet as the base model, we evaluate impact of the two strategies on two datasets that contain out of distribution test instances. Results show that both strategies are effective in improving model generalization capability. Equipped with both debiasing strategies, VSLNet achieves best results on both datasets.


Informative Class Activation Maps. We study how to evaluate the quantitative information content of a region within an image for a particular label. To this end, we bridge class activation maps with information theory. We develop an informative class activation map (infoCAM). Given a classification task, infoCAM depict how to accumulate information of partial regions to that of the entire image toward a label. Thus, we can utilise infoCAM to locate the most informative features for a label. When applied to an image classification task, infoCAM performs better than the traditional classification map in the weakly supervised object localisation task. We achieve state of the art results on Tiny ImageNet.


Remarks on MOBS and cryptosystems using semidirect products. Recently, several cryptosystems have been proposed based semidirect products of various algebraic structures. Efficient attacks against several of them have already been given, along with a very general attack. The purpose of this note is to provide an observation that can be used as a point of attack for similar systems, and show how it can be used to efficiently cryptanalyze the MOBS system.


Monotonic Simultaneous Translation with Chunk wise Reordering and Refinement. Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as yet unarrived words, when dealing with a language pair whose word orders significantly differ. This is unlike human simultaneous interpreters who produce largely monotonic translations at the expense of the grammaticality of a sentence being translated. In this paper, we thus propose an algorithm to reorder and refine the target side of a full sentence translation corpus, so that the words phrases between the source and target sentences are aligned largely monotonically, using word alignment and non autoregressive neural machine translation. We then train a widely used wait k simultaneous translation model on this reordered and refined corpus. The proposed approach improves BLEU scores and resulting translations exhibit enhanced monotonicity with source sentences.


Reputation Gaming in Stack Overflow. Stack Overflow incentive system awards users with reputation scores to ensure quality. The decentralized nature of the forum may make the incentive system prone to manipulation. This paper offers, for the first time, a comprehensive study of the reported types of reputation manipulation scenarios that might be exercised in Stack Overflow and the prevalence of such reputation gamers by qualitative study of 1,697 posts from meta Stack Exchange sites. We found six different types of reputation fraud scenarios, such as voting rings where communities form to upvote each other repeatedly on similar posts. We sought to develop algorithms to allow platform managers to automatically identify these suspicious reputation gaming scenarios, for review. The first algorithm identifies isolated semi isolated communities where probable reputation frauds may occur mostly by collaborating with each other. The second algorithm looks for sudden unusual big jumps in the reputation scores of users. We evaluated the performance of our algorithms by examining the reputation history dashboard of Stack Overflow users from the Stack Overflow website. We observed that around 60 80 of users that are considered to be suspicious by our algorithms got their reputation scores removed by Stack Overflow.


Efficient identification of myocardial material parameters and the stress free reference configuration for patient specific human heart models. Image based computational models of the heart represent a powerful tool to shed new light on the mechanisms underlying physiological and pathological conditions in cardiac function and to improve diagnosis and therapy planning. However, in order to enable the clinical translation of such models, it is crucial to develop personalized models that are able to reproduce the physiological reality of a given patient. There have been numerous contributions in experimental and computational biomechanics to characterize the passive behavior of the myocardium. However, most of these studies suffer from severe limitations and are not applicable to high resolution geometries. In this work, we present a novel methodology to perform an automated identification of in vivo properties of passive cardiac biomechanics. The highly efficient algorithm fits material parameters against the shape of a patient specific approximation of the end diastolic pressure volume relation (EDPVR). Simultaneously, a stress free reference configuration is generated, where a novel fail safe feature to improve convergence and robustness is implemented. Only clinical image data or previously generated meshes at one time point during diastole and one measured data point of the EDPVR are required as an input. The proposed method can be straightforwardly coupled to existing finite element (FE) software packages and is applicable to different constitutive laws and FE formulations. Sensitivity analysis demonstrates that the algorithm is robust with respect to initial input parameters.


DECA Deep viewpoint Equivariant human pose estimation using Capsule Autoencoders. Human Pose Estimation (HPE) aims at retrieving the 3D position of human joints from images or videos. We show that current 3D HPE methods suffer a lack of viewpoint equivariance, namely they tend to fail or perform poorly when dealing with viewpoints unseen at training time. Deep learning methods often rely on either scale invariant, translation invariant, or rotation invariant operations, such as max pooling. However, the adoption of such procedures does not necessarily improve viewpoint generalization, rather leading to more data dependent methods. To tackle this issue, we propose a novel capsule autoencoder network with fast Variational Bayes capsule routing, named DECA. By modeling each joint as a capsule entity, combined with the routing algorithm, our approach can preserve the joints' hierarchical and geometrical structure in the feature space, independently from the viewpoint. By achieving viewpoint equivariance, we drastically reduce the network data dependency at training time, resulting in an improved ability to generalize for unseen viewpoints. In the experimental validation, we outperform other methods on depth images from both seen and unseen viewpoints, both top view, and front view. In the RGB domain, the same network gives state of the art results on the challenging viewpoint transfer task, also establishing a new framework for top view HPE. The code can be found at https github.com mmlab cv DECA.


A paradifferential approach for hyperbolic dynamical systems and applications. We develop a paradifferential approach for studying non smooth hyperbolic dynamics and related non linear PDE from a microlocal point of view. As an application, we describe the microlocal regularity, i.e the H s wave front set for all s , of the unstable bundle E u for an Anosov flow. We also recover rigidity results of Hurder Katok and Hasselblatt in the Sobolev class rather than H "older there is s 0 0 such that if E u has H s regularity for s s 0 then it is smooth (with s 0 2 for volume preserving 3 dimensional Anosov flows). In the appendix by Guedes Bonthonneau, it is also shown that it can be applied to deal with non smooth flows and potentials. This work could serve as a toolbox for other applications.


Emergent networks in fractional percolation. Real networks are vulnerable to random failures and malicious attacks. However, when a node is harmed or damaged, it may remain partially functional, which helps to maintain the overall network structure and functionality. In this paper, we study the network structure for a fractional percolation process Shang, Phys. Rev. E 89, 012813 (2014) , in which the state of a node can be either fully functional (FF), partially functional (PF), or dysfunctional (D). We develop new equations to calculate the relative size of the percolating cluster of FF and PF nodes, that are in agreement with our stochastic simulations. In addition, we find a regime in which the percolating cluster can be described as a coarse grained bipartite network, namely, as a set of finite groups of FF nodes connected by PF nodes. Moreover, these groups behave as a set of "supernodes" with a power law degree distribution. Finally, we show how this emergent structure explains the values of several critical exponents around the percolation threshold.


Greedy Based Feature Selection for Efficient LiDAR SLAM. Modern LiDAR SLAM (L SLAM) systems have shown excellent results in large scale, real world scenarios. However, they commonly have a high latency due to the expensive data association and nonlinear optimization. This paper demonstrates that actively selecting a subset of features significantly improves both the accuracy and efficiency of an L SLAM system. We formulate the feature selection as a combinatorial optimization problem under a cardinality constraint to preserve the information matrix's spectral attributes. The stochastic greedy algorithm is applied to approximate the optimal results in real time. To avoid ill conditioned estimation, we also propose a general strategy to evaluate the environment's degeneracy and modify the feature number online. The proposed feature selector is integrated into a multi LiDAR SLAM system. We validate this enhanced system with extensive experiments covering various scenarios on two sensor setups and computation platforms. We show that our approach exhibits low localization error and speedup compared to the state of the art L SLAM systems. To benefit the community, we have released the source code https ram lab.com file site m loam.


Interpolating sequences for some subsets of analytic Besov type spaces. Let B p(s) be an analytic Besov type space. Let M(B p(s)) be the class of multipliers of B p(s) and let F(p, p 2, s) be the M "obius invariant subspace generated by B p(s) . In this paper, when 0 s 1 and max s, 1 s p leq 1 , we give a completed description of interpolating sequences for M(B p(s)) and F(p, p 2, s) cap H infty . We also consider certain condition appeared in this description by an L p characterization and the closure of F(p, p 2, s) in the Bloch space.


Gradient based Data Subversion Attack Against Binary Classifiers. Machine learning based data driven technologies have shown impressive performances in a variety of application domains. Most enterprises use data from multiple sources to provide quality applications. The reliability of the external data sources raises concerns for the security of the machine learning techniques adopted. An attacker can tamper the training or test datasets to subvert the predictions of models generated by these techniques. Data poisoning is one such attack wherein the attacker tries to degrade the performance of a classifier by manipulating the training data. In this work, we focus on label contamination attack in which an attacker poisons the labels of data to compromise the functionality of the system. We develop Gradient based Data Subversion strategies to achieve model degradation under the assumption that the attacker has limited knowledge of the victim model. We exploit the gradients of a differentiable convex loss function (residual errors) with respect to the predicted label as a warm start and formulate different strategies to find a set of data instances to contaminate. Further, we analyze the transferability of attacks and the susceptibility of binary classifiers. Our experiments show that the proposed approach outperforms the baselines and is computationally efficient.


FCOS3D Fully Convolutional One Stage Monocular 3D Object Detection. Monocular 3D object detection is an important task for autonomous driving considering its advantage of low cost. It is much more challenging than conventional 2D cases due to its inherent ill posed property, which is mainly reflected in the lack of depth information. Recent progress on 2D detection offers opportunities to better solving this problem. However, it is non trivial to make a general adapted 2D detector work in this 3D task. In this paper, we study this problem with a practice built on a fully convolutional single stage detector and propose a general framework FCOS3D. Specifically, we first transform the commonly defined 7 DoF 3D targets to the image domain and decouple them as 2D and 3D attributes. Then the objects are distributed to different feature levels with consideration of their 2D scales and assigned only according to the projected 3D center for the training procedure. Furthermore, the center ness is redefined with a 2D Gaussian distribution based on the 3D center to fit the 3D target formulation. All of these make this framework simple yet effective, getting rid of any 2D detection or 2D 3D correspondence priors. Our solution achieves 1st place out of all the vision only methods in the nuScenes 3D detection challenge of NeurIPS 2020. Code and models are released at https github.com open mmlab mmdetection3d.


Initial degenerations of spinor varieties. We construct closed immersions from initial degenerations of the spinor variety mathbb S n to inverse limits of strata associated to even Delta matroids. As an application, we prove that these initial degenerations are smooth and irreducible for n leq 5 and identify the log canonical model of the Chow quotient of mathbb S 5 by the action of the diagonal torus of operatorname GL (5) .


From driving automation systems to autonomous vehicles clarifying the terminology. The terminological landscape is rather cluttered when referring to autonomous driving or vehicles. A plethora of terms are used interchangeably, leading to misuse and confusion. With its technological, social and legal progress, it is increasingly imperative to establish a clear terminology that allows each concept to be placed in its corresponding place.


PIE Pseudo Invertible Encoder. We consider the problem of information compression from high dimensional data. Where many studies consider the problem of compression by non invertible transformations, we emphasize the importance of invertible compression. We introduce new class of likelihood based autoencoders with pseudo bijective architecture, which we call Pseudo Invertible Encoders. We provide the theoretical explanation of their principles. We evaluate Gaussian Pseudo Invertible Encoder on MNIST, where our model outperforms WAE and VAE in sharpness of the generated images.


MCTS Based Agents for Multistage Single Player Card Game. The article presents the use of Monte Carlo Tree Search algorithms for the card game Lord of the Rings. The main challenge was the complexity of the game mechanics, in which each round consists of 5 decision stages and 2 random stages. To test various decision making algorithms, a game simulator has been implemented. The research covered an agent based on expert rules, using flat Monte Carlo search, as well as complete MCTS UCB. Moreover different playout strategies has been compared. As a result of experiments, an optimal (assuming a limited time) combination of algorithms were formulated. The developed MCTS based method have demonstrated a advantage over agent with expert knowledge.


All Hex Meshing Strategies For Densely Packed Spheres. We develop an all hex meshing strategy for the interstitial space in beds of densely packed spheres that is tailored to turbulent flow simulations based on the spectral element method (SEM). The SEM achieves resolution through elevated polynomial order N and requires two to three orders of magnitude fewer elements than standard finite element approaches do. These reduced element counts place stringent requirements on mesh quality and conformity. Our meshing algorithm is based on a Voronoi decomposition of the sphere centers. Facets of the Voronoi cells are tessellated into quads that are swept to the sphere surface to generate a high quality base mesh. Refinements to the algorithm include edge collapse to remove slivers, node insertion to balance resolution, localized refinement in the radial direction about each sphere, and mesh optimization. We demonstrate geometries with 10 2 10 5 spheres using approximately 300 elements per sphere (for three radial layers), along with mesh quality metrics, timings, flow simulations, and solver performance.


Gradient based Label Binning in Multi label Classification. In multi label classification, where a single example may be associated with several class labels at the same time, the ability to model dependencies between labels is considered crucial to effectively optimize non decomposable evaluation measures, such as the Subset 0 1 loss. The gradient boosting framework provides a well studied foundation for learning models that are specifically tailored to such a loss function and recent research attests the ability to achieve high predictive accuracy in the multi label setting. The utilization of second order derivatives, as used by many recent boosting approaches, helps to guide the minimization of non decomposable losses, due to the information about pairs of labels it incorporates into the optimization process. On the downside, this comes with high computational costs, even if the number of labels is small. In this work, we address the computational bottleneck of such approach the need to solve a system of linear equations by integrating a novel approximation technique into the boosting procedure. Based on the derivatives computed during training, we dynamically group the labels into a predefined number of bins to impose an upper bound on the dimensionality of the linear system. Our experiments, using an existing rule based algorithm, suggest that this may boost the speed of training, without any significant loss in predictive performance.


VSS A Storage System for Video Analytics Technical Report . We present a new video storage system (VSS) designed to decouple high level video operations from the low level details required to store and efficiently retrieve video data. VSS is designed to be the storage subsystem of a video data management system (VDBMS) and is responsible for (1) transparently and automatically arranging the data on disk in an efficient, granular format (2) caching frequently retrieved regions in the most useful formats and (3) eliminating redundancies found in videos captured from multiple cameras with overlapping fields of view. Our results suggest that VSS can improve VDBMS read performance by up to 54 , reduce storage costs by up to 45 , and enable developers to focus on application logic rather than video storage and retrieval.


Uniqueness in determining binary grating profiles and refractive indices with a single incoming wave. We investigate inverse diffraction problems for penetrable gratings in a piecewise constant medium. In the TE polarization case, it is proved that a binary grating profile together with the refractive index beneath it can be uniquely determined by the near field observation data incited by a single plane wave and measured on a line segment above the grating. Our approach relies on the expansion of solutions to the Helmholtz equation and the corner singularity analysis of solutions to the inhomogeneous Laplace equation with a piecewise continuous source term in a sector. This paper also contributes to corner scattering theory for the Helmholtz equation in a special non convex domain.


Detection and Continual Learning of Novel Face Presentation Attacks. Advances in deep learning, combined with availability of large datasets, have led to impressive improvements in face presentation attack detection research. However, state of the art face antispoofing systems are still vulnerable to novel types of attacks that are never seen during training. Moreover, even if such attacks are correctly detected, these systems lack the ability to adapt to newly encountered attacks. The post training ability of continually detecting new types of attacks and self adaptation to identify these attack types, after the initial detection phase, is highly appealing. In this paper, we enable a deep neural network to detect anomalies in the observed input data points as potential new types of attacks by suppressing the confidence level of the network outside the training samples' distribution. We then use experience replay to update the model to incorporate knowledge about new types of attacks without forgetting the past learned attack types. Experimental results are provided to demonstrate the effectiveness of the proposed method on two benchmark datasets as well as a newly introduced dataset which exhibits a large variety of attack types.


The role of resident electrons in manifestation of a spin polarization memory effect in Mn delta doped GaAs heterostructures. The spin memory effect in the GaAs InGaAs heterostructures with delta Mn layer in GaAs barrier have been investigated. The effect consists in spin polarization of Mn atoms due to interaction with photogenerated spin polarized holes. The investigation of the effect was carried out by analyzing the polarization of the probe photoluminescence pulse in the pump probe technique. It was shown that the circular polarization degree of probe pulse generated photoluminescence is strongly affected by the interaction of hole spins with spins of Mn atoms polarized by the pump pulse. The latter leads to decrease of circular polarization degree as compared with single pulse excitation ( delta P effect). The amplitude of delta P effect is most strongly affected by the concentration of resident electrons in the quantum well which is believed to be due the specific compliance with selection rules for optical transition with the participation of unpolarized resident electrons. The rest of the sample's parameters including the spatial separation between delta Mn layer and InGaAs quantum well ( d s ) have a minor effect on the delta P value which leads to a paradoxical situation of decreasing delta P effect with the decrease of d s . The proposed experimental technique consisting in creating the significant concentration of resident electrons in the QW may serve as a reliable photoluminescence method determining the strength of this effect as well as the Mn spin relaxation time in a particular nanostructure.


Breaking the Moments Condition Barrier No Regret Algorithm for Bandits with Super Heavy Tailed Payoffs. Despite a large amount of effort in dealing with heavy tailed error in machine learning, little is known when moments of the error can become non existential the random noise eta satisfies Pr left eta y right le 1 y alpha for some alpha 0 . We make the first attempt to actively handle such super heavy tailed noise in bandit learning problems We propose a novel robust statistical estimator, mean of medians, which estimates a random variable by computing the empirical mean of a sequence of empirical medians. We then present a generic reductionist algorithmic framework for solving bandit learning problems (including multi armed and linear bandit problem) the mean of medians estimator can be applied to nearly any bandit learning algorithm as a black box filtering for its reward signals and obtain similar regret bound as if the reward is sub Gaussian. We show that the regret bound is near optimal even with very heavy tailed noise. We also empirically demonstrate the effectiveness of the proposed algorithm, which further corroborates our theoretical results.


Resource Allocation and Scheduling in Non coherent User centric Cell free MIMO. We study the problem of user scheduling and resource allocation in distributed multi user, multiple input multiple output (MIMO) networks implementing user centric clustering and non coherent transmission. We formulate a weighted sum rate maximization problem which can provide user proportional fairness. As in this setup, users can be served by many transmitters, user scheduling is particularly difficult. To solve this issue, we use block coordinate descent, fractional programming, and compressive sensing to construct an algorithm that performs user scheduling and beamforming. Our results show that the proposed framework provides an 8 to 10 fold gain in the long term user spectral efficiency compared to benchmark schemes such as round robin scheduling. Furthermore, we quantify the performance loss due to imperfect channel state information and pilot training overhead using a defined area based pilot reuse factor.


ML based IoT Malware Detection Under Adversarial Settings A Systematic Evaluation. The rapid growth of the Internet of Things (IoT) devices is paralleled by them being on the front line of malicious attacks. This has led to an explosion in the number of IoT malware, with continued mutations, evolution, and sophistication. These malicious software are detected using machine learning (ML) algorithms alongside the traditional signature based methods. Although ML based detectors improve the detection performance, they are susceptible to malware evolution and sophistication, making them limited to the patterns that they have been trained upon. This continuous trend motivates the large body of literature on malware analysis and detection research, with many systems emerging constantly, and outperforming their predecessors. In this work, we systematically examine the state of the art malware detection approaches, that utilize various representation and learning techniques, under a range of adversarial settings. Our analyses highlight the instability of the proposed detectors in learning patterns that distinguish the benign from the malicious software. The results exhibit that software mutations with functionality preserving operations, such as stripping and padding, significantly deteriorate the accuracy of such detectors. Additionally, our analysis of the industry standard malware detectors shows their instability to the malware mutations.


Diameter Diminishing To Zero IFSs. In this paper we introduce the notion of diameter diminishing to zero iterated function system, study its properties and provide alternative characterizations of it.


Mitigating Temporal Drift A Simple Approach to Keep NER Models Crisp. Performance of neural models for named entity recognition degrades over time, becoming stale. This degradation is due to temporal drift, the change in our target variables' statistical properties over time. This issue is especially problematic for social media data, where topics change rapidly. In order to mitigate the problem, data annotation and retraining of models is common. Despite its usefulness, this process is expensive and time consuming, which motivates new research on efficient model updating. In this paper, we propose an intuitive approach to measure the potential trendiness of tweets and use this metric to select the most informative instances to use for training. We conduct experiments on three state of the art models on the Temporal Twitter Dataset. Our approach shows larger increases in prediction accuracy with less training data than the alternatives, making it an attractive, practical solution.


Question Based Salient Span Selection for More Controllable Text Summarization. In this work, we propose a method for incorporating question answering (QA) signals into a summarization model. Our method identifies salient noun phrases (NPs) in the input document by automatically generating wh questions that are answered by the NPs and automatically determining whether those questions are answered in the gold summaries. This QA based signal is incorporated into a two stage summarization model which first marks salient NPs in the input document using a classification model, then conditionally generates a summary. Our experiments demonstrate that the models trained using QA based supervision generate higher quality summaries than baseline methods of identifying salient spans on benchmark summarization datasets. Further, we show that the content of the generated summaries can be controlled based on which NPs are marked in the input document. Finally, we propose a method of augmenting the training data so the gold summaries are more consistent with the marked input spans used during training and show how this results in models which learn to better exclude unmarked document content.


Fundamental Rate Memory Tradeoff for Coded Caching in Presence of User Inactivity. Coded caching utilizes proper file subpacketization and coded delivery to make full use of the multicast opportunities in content delivery, to alleviate file transfer load in massive content delivery scenarios. Most existing work considers deterministic environments. An important practical topic is to characterize the impact of the uncertainty from user inactivity on coded caching. We consider a one server cache enabled network under homogeneous file and network settings in presence of user inactivity. Unlike random or probabilistic caching studied in the literature, deterministic coded caching is considered, with the objective to minimize the worst case backhaul load by optimizing the file subpacketization and the caching strategy. First, a coded caching method is used, where each file is split into the same type of fragments labeled using sets with fixed cardinality, and the optimality of the selected cardinality is proved. Optimal file subpacketization by splitting the file into multiple types of fragments labeled with multiple cardinalities is then discussed. We show that the closed form optimum turns out to be given by a fixed cardinality optimizing for user inactivity only affects file delivery, cache placement is not affected. A decentralized version is also discussed and analyzed, where each user fills its storage independently at random without centralized coordination, and user inactivity is taken into account in file delivery. Simulation results show that the optimization based centralized coded caching scheme provides performance comparable to the ideal scenario assuming full knowledge of user inactivity in the placement phase, while decentralized caching performs slightly worse against user inactivity.


Da Vinci Architecture Driven Business Solutions. This document has emerged out of Origin's past experiences with architecture driven application development (AD2), and the need to further formalise and consolidate these experiences.


Linear Layouts of Complete Graphs. A page (queue) with respect to a vertex ordering of a graph is a set of edges such that no two edges cross (nest), i.e., have their endpoints ordered in an ABAB pattern (ABBA pattern). A union page (union queue) is a vertex disjoint union of pages (queues). The union page number (union queue number) of a graph is the smallest k such that there is a vertex ordering and a partition of the edges into k union pages (union queues). The local page number (local queue number) is the smallest k for which there is a vertex ordering and a partition of the edges into pages (queues) such that each vertex has incident edges in at most k pages (queues). We present upper and lower bounds on these four parameters for the complete graph K n on n vertices. In three cases we obtain the exact result up to an additive constant. In particular, the local page number of K n is n 3 pm O(1) , while its local and union queue number is (1 1 sqrt 2 )n pm O(1) . The union page number of K n is between n 3 O(1) and 4n 9 O(1) .


CVEH A Dynamic Framework To Profile Vehicle Movements To Mitigate Hit And Run Cases Using Crowdsourcing. In developed countries like the USA, Germany, and the UK, the security forces used highly sophisticated equipment, fast vehicles, drones, and helicopters to catch offenders' vehicles. Whereas, in developing countries with limited resources such schemes cannot be utilized due to management cost and other constraints. In this paper, we proposed a framework called CVEH that enables developing countries to profile the offender vehicle movements through crowdsourcing technique and act as an early warning system to the law forcing agencies. It also engages citizens to play their role in improving security conditions. The proposed CVEH framework allows Vehicle to Infrastructure (V2I) communication to monitor the movement of the offender's vehicle and shared its information with the Command and Control (CC) centre. The CC centre projects the path and engages nearly located law enforcement agencies. CVEH is developed and evaluated on android smartphones. Simulations conducted for this study exhibit the effectiveness of our framework.


One shot Transfer Learning for Population Mapping. Fine grained population distribution data is of great importance for many applications, e.g., urban planning, traffic scheduling, epidemic modeling, and risk control. However, due to the limitations of data collection, including infrastructure density, user privacy, and business security, such fine grained data is hard to collect and usually, only coarse grained data is available. Thus, obtaining fine grained population distribution from coarse grained distribution becomes an important problem. To tackle this problem, existing methods mainly rely on sufficient fine grained ground truth for training, which is not often available for the majority of cities. That limits the applications of these methods and brings the necessity to transfer knowledge between data sufficient source cities to data scarce target cities. In knowledge transfer scenario, we employ single reference fine grained ground truth in target city, which is easy to obtain via remote sensing or questionnaire, as the ground truth to inform the large scale urban structure and support the knowledge transfer in target city. By this approach, we transform the fine grained population mapping problem into a one shot transfer learning problem. In this paper, we propose a novel one shot transfer learning framework PSRNet to transfer spatial temporal knowledge across cities from the view of network structure, the view of data, and the view of optimization. Experiments on real life datasets of 4 cities demonstrate that PSRNet has significant advantages over 8 state of the art baselines by reducing RMSE and MAE by more than 25 . Our code and datasets are released in Github (https github.com erzhuoshao PSRNet CIKM).


Existence and uniqueness for triangulations of volume forms. This paper presents a proof of the fact that any smooth volume form on a smooth manifold can be triangulated and that a triangulation is unique up to piecewise linear equivalence.


Achieving Counterfactual Fairness for Causal Bandit. In online recommendation, customers arrive in a sequential and stochastic manner from an underlying distribution and the online decision model recommends a chosen item for each arriving individual based on some strategy. We study how to recommend an item at each step to maximize the expected reward while achieving user side fairness for customers, i.e., customers who share similar profiles will receive a similar reward regardless of their sensitive attributes and items being recommended. By incorporating causal inference into bandits and adopting soft intervention to model the arm selection strategy, we first propose the d separation based UCB algorithm (D UCB) to explore the utilization of the d separation set in reducing the amount of exploration needed to achieve low cumulative regret. Based on that, we then propose the fair causal bandit (F UCB) for achieving the counterfactual individual fairness. Both theoretical analysis and empirical evaluation demonstrate effectiveness of our algorithms.


Imagined Trailing Whitespace Agnostic Levenshtein Distance For Plaintext Table Detection. The standard algorithm for Levenshtein distance, treats trailing whitespace the same as any other letter or symbol. However, when humans compare 2 strings, we implicitly assume that both strings are padded by infinite trailing whitespace. This informs our expectations for what the costs for insertion, deletion and replacement, should be. This violation of our expectations results in non intuitive edit distance values. To account for this specific human intuition, a naive approach which considers "all possible" substrings of trailing whitespace would yield an O(n 3) algorithm. In this work, we provide an efficient O(n 2) algorithm to compute the same. Keywords Imagined Infinite Trailing Whitespace, Human Friendly, Intuitive Edit Distance, Table Detection, Table Alignment


Biomimetic peptide enriched nonwoven scaffolds promote calcium phosphate mineralisation. Cell free translational strategies are needed to accelerate the repair of mineralised tissues, particularly large bone defects, using minimally invasive approaches. Regenerative bone scaffolds should ideally mimic aspects of the tissue's ECM over multiple length scales and enable surgical handling and fixation during implantation in vivo. Leveraging the knowledge gained with bioactive self assembling peptides (SAPs) and SAP enriched electrospun fibres, we presented a cell free approach for promoting mineralisation via apatite deposition and crystal growth, in vitro, of SAP enriched nonwoven scaffolds. The nonwoven scaffold was made by electrospinning poly(epsilon caprolactone) (PCL) in the presence of either peptide P11 4 (Ac QQRFEWEFEQQ Am) or P11 8 (Ac QQRFOWOFEQQ Am), in light of the polymer's fibre forming capability and its hydrolytic degradability as well as the well known apatite nucleating capability of SAPs. The 11 residue family of peptides (P11 X) has the ability to self assemble into beta sheet ordered structures at the nano scale and to generate hydrogels at the macroscopic scale, some of which are capable of promoting biomineralisation due to their apatite nucleating capability. Both variants of SAP enriched nonwoven used in this study were proven to be biocompatible with murine fibroblasts and supported nucleation and growth of apatite minerals in simulated body fluid (SBF) in vitro. The fibrous nonwoven provided a structurally robust scaffold, with the capability to control SAP release behaviour. Up to 75 of P11 4 and 45 of P11 8 were retained in the fibres after 7 day incubation in aqueous solution at pH 7.4. The encapsulation of SAP in a nonwoven system with apatite forming as well as localised and long term SAP delivery capabilities is appealing as a potential means of achieving cost effective bone repair therapy for critical size defects.


Predicting Different Types of Subtle Toxicity in Unhealthy Online Conversations. This paper investigates the use of machine learning models for the classification of unhealthy online conversations containing one or more forms of subtler abuse, such as hostility, sarcasm, and generalization. We leveraged a public dataset of 44K online comments containing healthy and unhealthy comments labeled with seven forms of subtle toxicity. We were able to distinguish between these comments with a top micro F1 score, macro F1 score, and ROC AUC of 88.76 , 67.98 , and 0.71, respectively. Hostile comments were easier to detect than other types of unhealthy comments. We also conducted a sentiment analysis which revealed that most types of unhealthy comments were associated with a slight negative sentiment, with hostile comments being the most negative ones.


Classifying Tweet Sentiment Using the Hidden State and Attention Matrix of a Fine tuned BERTweet Model. This paper introduces a study on tweet sentiment classification. Our task is to classify a tweet as either positive or negative. We approach the problem in two steps, namely embedding and classifying. Our baseline methods include several combinations of traditional embedding methods and classification algorithms. Furthermore, we explore the current state of the art tweet analysis model, BERTweet, and propose a novel approach in which features are engineered from the hidden states and attention matrices of the model, inspired by empirical study of the tweets. Using a multi layer perceptron trained with a high dropout rate for classification, our proposed approach achieves a validation accuracy of 0.9111.


Data driven mapping between functional connectomes using optimal transport. Functional connectomes derived from functional magnetic resonance imaging have long been used to understand the functional organization of the brain. Nevertheless, a connectome is intrinsically linked to the atlas used to create it. In other words, a connectome generated from one atlas is different in scale and resolution compared to a connectome generated from another atlas. Being able to map connectomes and derived results between different atlases without additional pre processing is a crucial step in improving interpretation and generalization between studies that use different atlases. Here, we use optimal transport, a powerful mathematical technique, to find an optimum mapping between two atlases. This mapping is then used to transform time series from one atlas to another in order to reconstruct a connectome. We validate our approach by comparing transformed connectomes against their "gold standard" counterparts (i.e., connectomes generated directly from an atlas) and demonstrate the utility of transformed connectomes by applying these connectomes to predictive models based on a different atlas. We show that these transformed connectomes are significantly similar to their "gold standard" counterparts and maintain individual differences in brain behavior associations, demonstrating both the validity of our approach and its utility in downstream analyses. Overall, our approach is a promising avenue to increase the generalization of connectome based results across different atlases.


Interplay between COVID 19 vaccines and social measures for ending the SARS CoV 2 pandemic. The development and authorization of COVID 19 vaccines has provided the clearest path forward to eliminate community spread hence end the ongoing SARS CoV 2 pandemic. However, the limited pace at which the vaccine can be administered motivates the question, to what extent must we continue to adhere to social intervention measures such as mask wearing and social distancing? To address this question, we develop a mathematical model of COVID 19 spread incorporating both vaccine dynamics and socio epidemiological parameters. We use this model to study two important measures of disease control and eradication, the effective reproductive number R t and the peak intensive care unit (ICU) caseload, over three key parameters social measure adherence, vaccination rate, and vaccination coverage. Our results suggest that, due to the slow pace of vaccine administration, social measures must be maintained by a large proportion of the population until a sufficient proportion of the population becomes vaccinated for the pandemic to be eradicated. By contrast, with reduced adherence to social measures, hospital ICU cases will greatly exceed capacity, resulting in increased avoidable loss of life. These findings highlight the complex interplays involved between vaccination and social protective measures, and indicate the practical importance of continuing with extent social measures while vaccines are scaled up to allow the development of the herd immunity needed to end or control SARS CoV 2 sustainably.


Adaptive Agent Architecture for Real time Human Agent Teaming. Teamwork is a set of interrelated reasoning, actions and behaviors of team members that facilitate common objectives. Teamwork theory and experiments have resulted in a set of states and processes for team effectiveness in both human human and agent agent teams. However, human agent teaming is less well studied because it is so new and involves asymmetry in policy and intent not present in human teams. To optimize team performance in human agent teaming, it is critical that agents infer human intent and adapt their polices for smooth coordination. Most literature in human agent teaming builds agents referencing a learned human model. Though these agents are guaranteed to perform well with the learned model, they lay heavy assumptions on human policy such as optimality and consistency, which is unlikely in many real world scenarios. In this paper, we propose a novel adaptive agent architecture in human model free setting on a two player cooperative game, namely Team Space Fortress (TSF). Previous human human team research have shown complementary policies in TSF game and diversity in human players' skill, which encourages us to relax the assumptions on human policy. Therefore, we discard learning human models from human data, and instead use an adaptation strategy on a pre trained library of exemplar policies composed of RL algorithms or rule based methods with minimal assumptions of human behavior. The adaptation strategy relies on a novel similarity metric to infer human policy and then selects the most complementary policy in our library to maximize the team performance. The adaptive agent architecture can be deployed in real time and generalize to any off the shelf static agents. We conducted human agent experiments to evaluate the proposed adaptive agent framework, and demonstrated the suboptimality, diversity, and adaptability of human policies in human agent teams.


Pore scale analysis of gas injection in gas condensate reservoirs. Condensate banking around wellbores can significantly shorten the production from gas condensate reservoirs. Different approaches to mitigate this issue have been proposed in the literature, among which gas injection comes out with promising results. With this method, pressure maintenance and condensate re vaporization can be achieved, lessening the flow blockage caused by liquid dropout and accumulation in the porous medium. While gas injection in gas condensate reservoirs has been largely investigated at the meso and macro scales, data regarding the method's efficiency at the micro scale are scarce. Therefore, the effects of local changes in gas and condensate properties stemmed from the interaction between injected and reservoir fluids at the pore scale are poorly understood. In order to evaluate how these changes affect the transport in porous media, a compositional pore network model was used to reproduce gas injection in a sandstone sample following condensate accumulation. C1, C2, CO2, N2, and produced gas were tested as the candidates for condensate banking remediation at different pressure levels. After gas flooding, condensate saturation, heavy component recovery, and gas relative permeability were quantified to appraise the achieved gas flow improvement. The results indicated that C2 and CO2 were the most effective gases to clear the accumulated condensate and re establish the gas flow. Conversely, C1 and N2, especially mixed with the produced fluids, displayed the least favorable results, and could even lead to gas flow impairment.


Study of Design of Rate Compatible Polar Codes Based on Non Uniform Channel Polarization. We propose a novel scheme for rate compatible arbitrary length polar code construction for the additive white Gaussian noise (AWGN) channel. The proposed scheme is based on the concept of non uniform channel polarization. The original polar codes can only be designed with code lengths that are powers of two. Puncturing, shortening and extension are three strategies to obtain arbitrary code lengths and code rates for polar codes. There are other ways to design codes with arbitrary length but which have encoding and decoding with higher complexity such as multi kernel, concatenated codes and specific constructions for Belief propagation (BP) or Successive Cancellation (SC) decoding. In general, the quality of the projected bit channels by these arbitrary length techniques differs from that of the original bit channels, which can greatly affect the performance of the constructed polar codes. The proposed Non Uniform Polarization based on Gaussian Approximation (NUPGA) is an efficient construction technique for rate compatible arbitrary length polar codes, which chooses the best channels (i.e., selects the positions of the information bits) by re polarization of the codeword with desired length. A generalization of the Gaussian Approximation is devised for both polarization and re polarization processes. We also present shortening and extension techniques for design polar codes. Simulations verify the effectiveness of the proposed NUPGA designs against existing rate compatible techniques.


Kori Interactive Synthesis of Text and Charts in Data Documents. Charts go hand in hand with text to communicate complex data and are widely adopted in news articles, online blogs, and academic papers. They provide graphical summaries of the data, while text explains the message and context. However, synthesizing information across text and charts is difficult it requires readers to frequently shift their attention. We investigated ways to support the tight coupling of text and charts in data documents. To understand their interplay, we analyzed the design space of chart text references through news articles and scientific papers. Informed by the analysis, we developed a mixed initiative interface enabling users to construct interactive references between text and charts. It leverages natural language processing to automatically suggest references as well as allows users to manually construct other references effortlessly. A user study complemented with algorithmic evaluation of the system suggests that the interface provides an effective way to compose interactive data documents.


La conjecture de Mordell origines, approches, g 'en 'eralisations. The Mordell conjecture origins, approaches, generalizations The Mordell conjecture predicts that a diophantine equation defining a smooth projective curve of genus at least two has only finity many solutions in a given number field. The century that ran since its statement, in 1922, gave rise to several approaches, several proofs, and vast extensions most of which are still conjectural. This text is based on the oral presentation and aims at recalling this story. La conjecture de Mordell pr 'edit qu'une 'equation diophantienne d 'efinissant une courbe projective lisse de genre au moins deux n'a qu'un nombre fini de solutions dans un corps de nombres donn 'e. Le si ecle qui s'est 'ecoul 'e depuis son 'enonc 'e, en 1922, a vu plusieurs approches, plusieurs d 'emonstrations, ainsi que de vastes extensions dont la plupart sont encore conjecturales. Ce texte, qui reprend l'expos 'e oral, s'efforce de retracer cette histoire.


Adversarially Robust Streaming via Dense Sparse Trade offs. A streaming algorithm is adversarially robust if it is guaranteed to perform correctly even in the presence of an adaptive adversary. Recently, several sophisticated frameworks for robustification of classical streaming algorithms have been developed. One of the main open questions in this area is whether efficient adversarially robust algorithms exist for moment estimation problems under the turnstile streaming model, where both insertions and deletions are allowed. So far, the best known space complexity for streams of length m , achieved using differential privacy (DP) based techniques, is of order tilde O (m 1 2 ) for computing a constant factor approximation with high constant probability. In this work, we propose a new simple approach to tracking moments by alternating between two different regimes a sparse regime, in which we can explicitly maintain the current frequency vector and use standard sparse recovery techniques, and a dense regime, in which we make use of existing DP based robustification frameworks. The results obtained using our technique break the previous m 1 2 barrier for any fixed p . More specifically, our space complexity for F 2 estimation is tilde O (m 2 5 ) and for F 0 estimation, i.e., counting the number of distinct elements, it is tilde O(m 1 3 ) . All existing robustness frameworks have their space complexity depend multiplicatively on a parameter lambda called the emph flip number of the streaming problem, where lambda m in turnstile moment estimation. The best known dependence in these frameworks (for constant factor approximation) is of order tilde O ( lambda 1 2 ) , and it is known to be tight for certain problems. Again, our approach breaks this barrier, achieving a dependence of order tilde O ( lambda 1 2 c(p) ) for F p estimation, where c(p) 0 depends only on p .


The Potential in Frege's Theorem. Is a logicist bound to the claim that as a matter of analytic truth there is an actual infinity of objects? If Hume's Principle is analytic then in the standard setting the answer appears to be yes. Hodes's work pointed to a way out by offering a modal picture in which only a potential infinity was posited. However, this project was abandoned due to apparent failures of cross world predication. We re explore this idea and discover that in the setting of the potential infinite one can interpret first order Peano arithmetic, but not second order Peano arithmetic. We conclude that in order for the logicist to weaken the metaphysically loaded claim of necessary actual infinities, they must also weaken the mathematics they recover.


Utilizing gradient approximations to optimize data selection protocols for tumor growth model calibration. The use of mathematical models to make predictions about tumor growth and response to treatment has become increasingly more prevalent in the clinical setting. The level of complexity within these models ranges broadly, and the calibration of more complex models correspondingly requires more detailed clinical data. This raises questions about how much data should be collected and when, in order to minimize the total amount of data used and the time until a model can be calibrated accurately. To address these questions, we propose a Bayesian information theoretic procedure, using a gradient based score function to determine the optimal data collection times for model calibration. The novel score function introduced in this work eliminates the need for a weight parameter used in a previous study's score function, while still yielding accurate and efficient model calibration using even fewer scans on a sample set of synthetic data, simulating tumors of varying levels of radiosensitivity. We also conduct a robust analysis of the calibration accuracy and certainty, using both error and uncertainty metrics. Unlike the error analysis of the previous study, the inclusion of uncertainty analysis in this work as a means for deciding when the algorithm can be terminated provides a more realistic option for clinical decision making, since it does not rely on data that will be collected later in time.


Dual Adversarial Variational Embedding for Robust Recommendation. Robust recommendation aims at capturing true preference of users from noisy data, for which there are two lines of methods have been proposed. One is based on noise injection, and the other is to adopt the generative model Variational Auto encoder (VAE). However, the existing works still face two challenges. First, the noise injection based methods often draw the noise from a fixed noise distribution given in advance, while in real world, the noise distributions of different users and items may differ from each other due to personal behaviors and item usage patterns. Second, the VAE based models are not expressive enough to capture the true preference since VAE often yields an embedding space of a single modal, while in real world, user item interactions usually exhibit multi modality on user preference distribution. In this paper, we propose a novel model called Dual Adversarial Variational Embedding (DAVE) for robust recommendation, which can provide personalized noise reduction for different users and items, and capture the multi modality of the embedding space, by combining the advantages of VAE and adversarial training between the introduced auxiliary discriminators and the variational inference networks. The extensive experiments conducted on real datasets verify the effectiveness of DAVE on robust recommendation.


Quantitative twisted patterns in positive density subsets. We make quantitative improvements to recently obtained results on the structure of the image of a large difference set under certain quadratic forms and other homogeneous polynomials. Previous proofs used deep results of Benoist Quint on random walks in certain subgroups of operatorname SL r( mathbb Z ) (the symmetry groups of these quadratic forms) that were not of a quantitative nature. Our new observation relies on noticing that rather than studying random walks, one can obtain more quantitative results by considering polynomial orbits of these group actions that are not contained in cosets of submodules of mathbb Z r of small index. Our main new technical tool is a uniform Furstenberg S ' a rk " o zy theorem that holds for a large class of polynomials not necessarily vanishing at zero, which may be of independent interest and is derived from a density increment argument and Hua's bound on polynomial exponential sums.


Deep Insights of Deepfake Technology A Review. Under the aegis of computer vision and deep learning technology, a new emerging techniques has introduced that anyone can make highly realistic but fake videos, images even can manipulates the voices. This technology is widely known as Deepfake Technology. Although it seems interesting techniques to make fake videos or image of something or some individuals but it could spread as misinformation via internet. Deepfake contents could be dangerous for individuals as well as for our communities, organizations, countries religions etc. As Deepfake content creation involve a high level expertise with combination of several algorithms of deep learning, it seems almost real and genuine and difficult to differentiate. In this paper, a wide range of articles have been examined to understand Deepfake technology more extensively. We have examined several articles to find some insights such as what is Deepfake, who are responsible for this, is there any benefits of Deepfake and what are the challenges of this technology. We have also examined several creation and detection techniques. Our study revealed that although Deepfake is a threat to our societies, proper measures and strict regulations could prevent this.


Equilateral Chains and Cyclic Central Configurations of the Planar 5 body Problem. Central configurations and relative equilibria are an important facet of the study of the N body problem, but become very difficult to rigorously analyze for N 3 . In this paper we focus on a particular but interesting class of configurations of the 5 body problem the equilateral pentagonal configurations, which have a cycle of five equal edges. We prove a variety of results concerning central configurations with this property, including a computer assisted proof of the finiteness of such configurations for any positive five masses with a range of rational exponent homogeneous potentials (including the Newtonian case and point vortex model), some constraints on their shapes, and we determine some exact solutions for particular N body potentials.


A study of the wave effects on the current circulation in Galway Bay, using the numerical model COAWST. A model coupling waves and currents is set up for Galway Bay, Ireland, using COAWST. The impact of the coupling on the accuracy of the model is shown to be marginal on the overall statistics. The model is in good agreement with the available in situ observations that are used for the validation. However a closer look at the data during storms shows a deterioration of the agreement, which is barely improved by the coupling. A special analysis of the different processes ruling the ocean circulation and wave propagation is conducted during Storm Hector (2018 06 14). It shows a strong wave induced surge by 7cm in the back of Galway Bay, and a strong response in terms of currents along the coast of Clare of about 30cm s. Most of the surge is attributed to the impact of the conservative wave induced forcing terms, but the main process involved is not identified. The response in currents is partly attributed to the conservative wave induced forcing terms, but mostly to the wave enhanced surface roughness.


X GGM Graph Generative Modeling for Out of Distribution Generalization in Visual Question Answering. Encouraging progress has been made towards Visual Question Answering (VQA) in recent years, but it is still challenging to enable VQA models to adaptively generalize to out of distribution (OOD) samples. Intuitively, recompositions of existing visual concepts ( ie, attributes and objects) can generate unseen compositions in the training set, which will promote VQA models to generalize to OOD samples. In this paper, we formulate OOD generalization in VQA as a compositional generalization problem and propose a graph generative modeling based training scheme (X GGM) to implicitly model the problem. X GGM leverages graph generative modeling to iteratively generate a relation matrix and node representations for the predefined graph that utilizes attribute object pairs as nodes. Furthermore, to alleviate the unstable training issue in graph generative modeling, we propose a gradient distribution consistency loss to constrain the data distribution with adversarial perturbations and the generated distribution. The baseline VQA model (LXMERT) trained with the X GGM scheme achieves state of the art OOD performance on two standard VQA OOD benchmarks, ie, VQA CP v2 and GQA OOD. Extensive ablation studies demonstrate the effectiveness of X GGM components. Code is available at url https github.com jingjing12110 x ggm .


Every smoothly bounded p convex domain in R n admits a p plurisubharmonic defining function. We show that every bounded domain D in mathbb R n with smooth p convex boundary for 2 le p n admits a smooth defining function rho which is p plurisubharmonic on overline D if in addition bD has no p flat points then rho can be chosen strongly p plurisubharmonic on D . If bD is 2 convex then for any open connected conformal surface M and conformal harmonic map f M to overline D , either f(M) subset D or f(M) subset bD . In particular, every conformal harmonic map mathbb D to D from the punctured disc extends to a conformal harmonic map mathbb D to D .


ConAM Confidence Attention Module for Convolutional Neural Networks. The so called "attention" is an efficient mechanism to improve the performance of convolutional neural networks. It uses contextual information to recalibrate the input to strengthen the propagation of informative features. However, the majority of the attention mechanisms only consider either local or global contextual information, which is singular to extract features. Moreover, many existing mechanisms directly use the contextual information to recalibrate the input, which unilaterally enhances the propagation of the informative features, but does not suppress the useless ones. This paper proposes a new attention mechanism module based on the correlation between local and global contextual information and we name this correlation as confidence. The novel attention mechanism extracts the local and global contextual information simultaneously, and calculates the confidence between them, then uses this confidence to recalibrate the input pixels. The extraction of local and global contextual information increases the diversity of features. The recalibration with confidence suppresses useless information while enhancing the informative one with fewer parameters. We use CIFAR 10 and CIFAR 100 in our experiments and explore the performance of our method's components by sufficient ablation studies. Finally, we compare our method with a various state of the art convolutional neural networks and the results show that our method completely surpasses these models. We implement ConAM with the Python library, Pytorch, and the code and models will be publicly available.


Shape and Material Capture at Home. In this paper, we present a technique for estimating the geometry and reflectance of objects using only a camera, flashlight, and optionally a tripod. We propose a simple data capture technique in which the user goes around the object, illuminating it with a flashlight and capturing only a few images. Our main technical contribution is the introduction of a recursive neural architecture, which can predict geometry and reflectance at 2 k 2 k resolution given an input image at 2 k 2 k and estimated geometry and reflectance from the previous step at 2 k 1 2 k 1 . This recursive architecture, termed RecNet, is trained with 256x256 resolution but can easily operate on 1024x1024 images during inference. We show that our method produces more accurate surface normal and albedo, especially in regions of specular highlights and cast shadows, compared to previous approaches, given three or fewer input images. For the video and code, please visit the project website http dlichy.github.io ShapeAndMaterialAtHome .


Logic Blog 2020. This year's blog has focused on the connections of group theory with logic and algorithms. The first post is on automata presentable groups. Then there are several posts related to topological groups, for instance Ivanov and Majcher showing that extreme amenability of closed subgroups of S infty is a Borel property. One post due to Harrison Trainor and Nies reviews notes by Segal on pseudofinite groups, and attempts an effective version. About 25 percent is on computability and randomness, in particular equivalence of reducibilities weaker than Turing on the K trivials by Greenberg, Nies and Turetsky, and the effective SMB theorem in the quantum setting by Nies and Tomamichel.


PDE constrained shape optimization towards product shape spaces and stochastic models. Shape optimization models with one or more shapes are considered in this chapter. Of particular interest for applications are problems in which where a so called shape functional is constrained by a partial differential equation (PDE) describing the underlying physics. A connection can made between a classical view of shape optimization and the differential geometric structure of shape spaces. To handle problems where a shape functional depends on multiple shapes, a theoretical framework is presented, whereby the optimization variable can be represented as a vector of shapes belonging to a product shape space. The multi shape gradient and multi shape derivative are defined, which allows for a rigorous justification of a steepest descent method with Armijo backtracking. As long as the shapes as subsets of a hold all domain do not intersect, solving a single deformation equation is enough to provide descent directions with respect to each shape. Additionally, a framework for handling uncertainties arising from inputs or parameters in the PDE is presented. To handle potentially high dimensional stochastic spaces, a stochastic gradient method is proposed. A model problem is constructed, demonstrating how uncertainty can be introduced into the problem and the objective can be transformed by use of the expectation. Finally, numerical experiments in the deterministic and stochastic case are devised, which demonstrate the effectiveness of the presented algorithms.


Silicon Metasurface Embedded Fabry Perot Cavity Enables High Quality Transmission Structural Color. While nanoscale color generations have been studied for years, high performance transmission structural colors, simultaneously equipped with large gamut, high resolution, low loss and optical multiplexing abilities, still remain as a hanging issue. Here, beneficial from metasurfaces, we demonstrate a silicon metasurface embedded Fabry P 'erot cavity (meta FP cavity), with polydimethylsiloxanes (PDMS) surrounding media and silver film mirrors. By changing the planar geometries of the embedded nanopillars, the meta FP cavity provides transmission colors with ultra large gamut of 194 sRGB and ultrahigh resolution of 141111 DPI, along with considerably average transmittance of 43 and more than 300 enhanced angular tolerance. Such high density allows two dimensional color mixing at diffraction limit scale. The color gamut and the resolution can be flexibly tuned and improved by modifying the silver film thickness and the lattice period. The polarization manipulation ability of the metasurface also enables arbitrary color arrangement between cyan and red for two orthogonal linear polarization states, at deep subwavelength scale. Our proposed cavities can be used in filters, printings, optical storages and many other applications in need of high quality and density colors.


K "ahler tori with almost non negative scalar curvature. Motivated by the torus stability problem, in this work we study K "ahler metrics with almost non negative scalar curvature on complex torus. We prove that after passing to a subsequence, non collapsing sequence of K "ahler metrics with almost non negative scalar curvature will converge to flat torus weakly.


Adaptation to Inexactness for some Gradient type Methods. We introduce a notion of inexact model of a convex objective function, which allows for errors both in the function and in its gradient. For this situation, a gradient method with an adaptive adjustment of some parameters of the model is proposed and an estimate for the convergence rate is found. This estimate is optimal on a class of sufficiently smooth problems in the presence of errors. We consider a special class of convex nonsmooth optimization problems. In order to apply the proposed technique to this class, an artificial error should be introduced. We show that the method can be modified for such problems to guarantee a convergence in the function with a nearly optimal rate on the class of convex nonsmooth optimization problems. An adaptive gradient method is proposed for objective functions with some relaxation of the Lipschitz condition for the gradient that satisfy the Polyak Lojasievicz gradient dominance condition. Here, the objective function and its gradient can be given inexactly. The adaptive choice of the parameters is performed during the operation of the method with respect to both the Lipschitz constant of the gradient and a value corresponding to the error of the gradient and the objective function. The linear convergence of the method is justified up to a value associated with the errors.


Web image search engine based on LSH index and CNN Resnet50. To implement a good Content Based Image Retrieval (CBIR) system, it is essential to adopt efficient search methods. One way to achieve this results is by exploiting approximate search techniques. In fact, when we deal with very large collections of data, using an exact search method makes the system very slow. In this project, we adopt the Locality Sensitive Hashing (LSH) index to implement a CBIR system that allows us to perform fast similarity search on deep features. Specifically, we exploit transfer learning techniques to extract deep features from images this phase is done using two famous Convolutional Neural Networks (CNNs) as features extractors Resnet50 and Resnet50v2, both pre trained on ImageNet. Then we try out several fully connected deep neural networks, built on top of both of the previously mentioned CNNs in order to fine tuned them on our dataset. In both of previous cases, we index the features within our LSH index implementation and within a sequential scan, to better understand how much the introduction of the index affects the results. Finally, we carry out a performance analysis we evaluate the relevance of the result set, computing the mAP (mean Average Precision) value obtained during the different experiments with respect to the number of done comparison and varying the hyper parameter values of the LSH index.


Geometry of a Set and its Random covers. Let E be a bounded open subset of mathbb R n . We study the following questions For i.i.d. samples X 1, dots, X N drawn uniformly from E , what is the probability that cup i mathbf B (X i, delta) , the union of delta balls centered at X i , covers E ? And how does the probability depend on sample size N and the radius of balls delta ? We present geometric conditions of E under which we derive lower bounds to this probability. These lower bounds tend to 1 as a function of exp ( delta n N) . The basic tool that we use to derive the lower bounds is a good partition of E , i.e., one whose partition elements have diameters that are uniformly bounded from above and have volumes that are uniformly bounded from below. We show that if E c , the complement of E , has positive reach then we can construct a good partition of E . This partition is motivated by the Whitney decomposition of E . On the other hand, we identify a class of bounded open subsets of mathbb R n that do not satisfy this positive reach condition but do have good partitions. In 2D when E c subset mathbb R 2 does not have positive reach, we show that the mutliscale flat norm can be used to approximate E with a set that has a good partition under certain conditions. In this case, we provide a lower bound on the probability that the union of the balls emph almost covers E .


The Secrecy Gain of Formally Unimodular Lattices on the Gaussian Wiretap Channel. We consider lattice coding for the Gaussian wiretap channel, where the challenge is to ensure reliable communication between two authorized parties while preventing an eavesdropper from learning the transmitted messages. Recently, a measure called the secrecy function of a lattice coding scheme was proposed as a design criterion to characterize the eavesdropper's probability of correct decision. In this paper, the family of formally unimodular lattices is presented and shown to possess the same secrecy function behavior as unimodular and isodual lattices. Based on Construction A, we provide a universal approach to determine the secrecy gain, i.e., the maximum value of the secrecy function, for formally unimodular lattices obtained from formally self dual codes. Furthermore, we show that formally unimodular lattices can achieve higher secrecy gain than the best known unimodular lattices from the literature.


Regret Minimization Experience Replay in Off Policy Reinforcement Learning. In reinforcement learning, experience replay stores past samples for further reuse. Prioritized sampling is a promising technique to better utilize these samples. Previous criteria of prioritization include TD error, recentness and corrective feedback, which are mostly heuristically designed. In this work, we start from the regret minimization objective, and obtain an optimal prioritization strategy for Bellman update that can directly maximize the return of the policy. The theory suggests that data with higher hindsight TD error, better on policiness and more accurate Q value should be assigned with higher weights during sampling. Thus most previous criteria only consider this strategy partially. We not only provide theoretical justifications for previous criteria, but also propose two new methods to compute the prioritization weight, namely ReMERN and ReMERT. ReMERN learns an error network, while ReMERT exploits the temporal ordering of states. Both methods outperform previous prioritized sampling algorithms in challenging RL benchmarks, including MuJoCo, Atari and Meta World.


Optimized motor control reduces knee joint forces during walking and squatting Validating the inverse dynamics approach for full body movements on instrumented knee prostheses. Joint load forces and torques during biological movements can be predicted using inverse dynamics techniques. It is not yet clear how accurate these predictions are for real life biological movements. Such forces can be measured in implanted prostheses, providing an alternative method of validating the modelling approach. The aim of this study was to investigate the accuracy of predicted forces in a knee joint during walking and squatting based on a computational musculoskeletal model, by comparing the model predictions with the corresponding real life data gained from an instrumented knee prosthesis. We found that musculoskeletal models can accurately predict knee joint forces. Furthermore, we predicted that the muscular coordination strongly influences knee joint forces, by 44 in walking and 15 in squatting. Our findings indicate that patients with a knee prosthesis may adapt their neuromuscular activation pattern to reduce joint forces during locomotion or everyday movements.


On a family of Self Affine IFS whose attractors have a non fractal top. Let 0 lambda mu 1 and lambda mu 1 . In this note we prove that for the vast majority of such parameters the top of the attractor A lambda, mu of the IFS ( lambda x, mu y), ( mu x 1 mu, lambda y 1 lambda) is the graph of a continuous, strictly increasing function. Despite this, for most parameters, A lambda, mu has a box dimension strictly greater than 1, showing that the upper boundary is not representative of the complexity of the fractal. Finally, we prove that if lambda mu ge 2 1 6 , then A lambda, mu has a non empty interior.


Operad Structures in Geometric Quantization of the Moduli Space of Spatial Polygons. The moduli space of spatial polygons is known as a symplectic manifold equipped with both K "ahler and real polarizations. In this paper, associated to the K "ahler and real polarizations, morphisms of operads mathsf f mathsf K ddot mathsf a mathsf h and mathsf f mathsf re are constructed by using the quantum Hilbert spaces mathscr H mathrm K ddot mathrm a mathrm h and mathscr H mathrm re , respectively. Moreover, the relationship between the two morphisms of operads mathsf f mathsf K ddot mathsf a mathsf h and mathsf f mathsf re is studied and then the equality dim mathscr H mathrm K ddot mathrm a mathrm h dim mathscr H mathrm re is proved in general setting. This operadic framework is regarded as a development of the recurrence relation method by Kamiyama for proving dim mathscr H mathrm K ddot mathrm a mathrm h dim mathscr H mathrm re in a special case.


Single Server Private Linear Transformation The Joint Privacy Case. This paper introduces the problem of Private Linear Transformation (PLT) which generalizes the problems of private information retrieval and private linear computation. The PLT problem includes one or more remote server(s) storing (identical copies of) K messages and a user who wants to compute L independent linear combinations of a D subset of messages. The objective of the user is to perform the computation by downloading minimum possible amount of information from the server(s), while protecting the identities of the D messages required for the computation. In this work, we focus on the single server setting of the PLT problem when the identities of the D messages required for the computation must be protected jointly. We consider two different models, depending on whether the coefficient matrix of the required L linear combinations generates a Maximum Distance Separable (MDS) code. We prove that the capacity for both models is given by L (K D L) , where the capacity is defined as the supremum of all achievable download rates. Our converse proofs are based on linear algebraic and information theoretic arguments that establish connections between PLT schemes and linear codes. We also present an achievability scheme for each of the models being considered.


Approximating the Arboricity in Sublinear Time. We consider the problem of approximating the arboricity of a graph G (V,E) , which we denote by mathsf arb (G) , in sublinear time, where the arboricity of a graph is the minimal number of forests required to cover its edges. An algorithm for this problem may perform degree and neighbor queries, and is allowed a small error probability. We design an algorithm that outputs an estimate hat alpha , such that with probability 1 1 textrm poly (n) , mathsf arb (G) c log 2 n leq hat alpha leq mathsf arb (G) , where n V and c is a constant. The expected query complexity and running time of the algorithm are O(n mathsf arb (G)) cdot textrm poly ( log n) , and this upper bound also holds with high probability. ( widetilde O ( cdot) is used to suppress textrm poly ( log n) dependencies). This bound is optimal for such an approximation up to a textrm poly ( log n) factor.


Protecting Intellectual Property of Language Generation APIs with Lexical Watermark. Nowadays, due to the breakthrough in natural language generation (NLG), including machine translation, document summarization, image captioning, etc NLG models have been encapsulated in cloud APIs to serve over half a billion people worldwide and process over one hundred billion word generations per day. Thus, NLG APIs have already become essential profitable services in many commercial companies. Due to the substantial financial and intellectual investments, service providers adopt a pay as you use policy to promote sustainable market growth. However, recent works have shown that cloud platforms suffer from financial losses imposed by model extraction attacks, which aim to imitate the functionality and utility of the victim services, thus violating the intellectual property (IP) of cloud APIs. This work targets at protecting IP of NLG APIs by identifying the attackers who have utilized watermarked responses from the victim NLG APIs. However, most existing watermarking techniques are not directly amenable for IP protection of NLG APIs. To bridge this gap, we first present a novel watermarking method for text generation APIs by conducting lexical modification to the original outputs. Compared with the competitive baselines, our watermark approach achieves better identifiable performance in terms of p value, with fewer semantic losses. In addition, our watermarks are more understandable and intuitive to humans than the baselines. Finally, the empirical studies show our approach is also applicable to queries from different domains, and is effective on the attacker trained on a mixture of the corpus which includes less than 10 watermarked samples.


Representative Forgery Mining for Fake Face Detection. Although vanilla Convolutional Neural Network (CNN) based detectors can achieve satisfactory performance on fake face detection, we observe that the detectors tend to seek forgeries on a limited region of face, which reveals that the detectors is short of understanding of forgery. Therefore, we propose an attention based data augmentation framework to guide detector refine and enlarge its attention. Specifically, our method tracks and occludes the Top N sensitive facial regions, encouraging the detector to mine deeper into the regions ignored before for more representative forgery. Especially, our method is simple to use and can be easily integrated with various CNN models. Extensive experiments show that the detector trained with our method is capable to separately point out the representative forgery of fake faces generated by different manipulation techniques, and our method enables a vanilla CNN based detector to achieve state of the art performance without structure modification.


Extremal product one free sequences over C n rtimes s C 2 . Let G be a finite group multiplicatively written. The small Davenport constant of G is the maximum positive integer sf d (G) such that there exists a sequence S of length sf d (G) for which every subsequence of S is product one free. Let s 2 equiv 1 pmod n , where s not equiv pm1 pmod n . It has been proven that sf d (C n rtimes s C 2) n (see Lemma 6 of Zhuang, Gao Europ. J. Combin. 26 (2005), 1053 1059 ). In this paper, we determine all sequences over C n rtimes s C 2 of length n which are product one free. It completes the classification of all product one free sequences over every group of the form C n rtimes s C 2 , including the quasidihedral groups and the modular maximal cyclic groups.


Operators arising as Second Variation of optimal control problems and their spectral asymptotics. The second variation of an optimal control problems satisfying Legendre strong condition can be written in the form 1 K where K is a compact operator. In the paper a characterization of the compact part K is given and the asymptotic for the eigenvalues is computed.


Audio Visual Collaborative Representation Learning for Dynamic Saliency Prediction. The Dynamic Saliency Prediction (DSP) task simulates the human selective attention mechanism to perceive the dynamic scene, which is significant and imperative in many vision tasks. Most of existing methods only consider visual cues, while neglect the accompanied audio information, which can provide complementary information for the scene understanding. In fact, there exists a strong relation between auditory and visual cues, and humans generally perceive the surrounding scene by collaboratively sensing these cues. Motivated by this, an audio visual collaborative representation learning method is proposed for the DSP task, which explores the audio modality to better predict the dynamic saliency map by assisting vision modality. The proposed method consists of three parts 1) audio visual encoding, 2) audio visual location, and 3) collaborative integration parts. Firstly, a refined SoundNet architecture is adopted to encode audio modality for obtaining corresponding features, and a modified 3D ResNet 50 architecture is employed to learn visual features, containing both spatial location and temporal motion information. Secondly, an audio visual location part is devised to locate the sound source in the visual scene by learning the correspondence between audio visual information. Thirdly, a collaborative integration part is devised to adaptively aggregate audio visual information and center bias prior to generate the final saliency map. Extensive experiments are conducted on six challenging audiovisual eye tracking datasets, including DIEM, AVAD, Coutrot1, Coutrot2, SumMe, and ETMD, which shows significant superiority over state of the art DSP models.


On a regularization approach for solving the inverse Cauchy Stokes problem. In this paper, we are interested to an inverse Cauchy problem governed by the Stokes equation, called the data completion problem. It consists in determining the unspecified fluid velocity, or one of its components over a part of its boundary, by introducing given measurements on its remaining part. As it's known, this problem is one of the highly ill posed problems in the Hadamard's sense cite had , it is then an interesting challenge to carry out a numerical procedure for approximating their solutions, mostly in the particular case of noisy data. To solve this problem, we propose here a regularizing approach based on a coupled complex boundary method, originally proposed in cite source , for solving an inverse source problem. We show the existence of the regularization optimization problem and prove the convergence of the subsequence of optimal solutions of Tikhonov regularization formulations to the solution of the Cauchy problem. Then we suggest the numerical approximation of this problem using the adjoint gradient technic and the finite element method of P1 bubble P1 type. Finally, we provide some numerical results showing the accuracy, effectiveness, and robustness of the proposed approach.