Domain Adaptation for Rare Classes Augmented with Synthetic Samples. To alleviate lower classification performance on rare classes in imbalanced datasets, a possible solution is to augment the underrepresented classes with synthetic samples. Domain adaptation can be incorporated in a classifier to decrease the domain discrepancy between real and synthetic samples. While domain adaptation is generally applied on completely synthetic source domains and real target domains, we explore how domain adaptation can be applied when only a single rare class is augmented with simulated samples. As a testbed, we use a camera trap animal dataset with a rare deer class, which is augmented with synthetic deer samples. We adapt existing domain adaptation methods to two new methods for the single rare class setting DeerDANN, based on the Domain Adversarial Neural Network (DANN), and DeerCORAL, based on deep correlation alignment (Deep CORAL) architectures. Experiments show that DeerDANN has the highest improvement in deer classification accuracy of 24.0 versus 22.4 improvement of DeerCORAL when compared to the baseline. Further, both methods require fewer than 10k synthetic samples, as used by the baseline, to achieve these higher accuracies. DeerCORAL requires the least number of synthetic samples (2k deer), followed by DeerDANN (8k deer).


Erd H o s Ginzburg Ziv type generalizations for linear equations and linear inequalities in three variables. For any linear inequality in three variables mathcal L , we determine (if it exist) the smallest integer R( mathcal L , mathbb Z 3 mathbb Z ) such that for every mapping chi 1,n to 0,1,2 , with n geq R( mathcal L , mathbb Z 3 mathbb Z ) , there is a solution (x 1,x 2,x 3) in 1,n 3 of mathcal L with chi(x 1) chi(x 2) chi(x 3) equiv 0 (mod 3 ). Moreover, we prove that R( mathcal L , mathbb Z 3 mathbb Z ) R( mathcal L , 2) , where R( mathcal L , 2) denotes the classical 2 color Rado number, that is, the smallest integer (provided it exist) such that for every 2 coloring of 1,n , with n geq R( mathcal L , 2) , there exist a monochromatic solution of mathcal L . Thus, we get an Erd H o s Ginzburg Ziv type generalization for all lineal inequalities in three variables having a solution in the positive integers. We also show a number of families of linear equations in three variables mathcal L such that they do not admit such Erd H o s Ginzburg Ziv type generalization, named R( mathcal L , mathbb Z 3 mathbb Z ) neq R( mathcal L , 2) . At the end of this paper some questions are proposed.


Detection of Alzheimer's Disease Using Graph Regularized Convolutional Neural Network Based on Structural Similarity Learning of Brain Magnetic Resonance Images. Objective This paper presents an Alzheimer's disease (AD) detection method based on learning structural similarity between Magnetic Resonance Images (MRIs) and representing this similarity as a graph. Methods We construct the similarity graph using embedded features of the input image (i.e., Non Demented (ND), Very Mild Demented (VMD), Mild Demented (MD), and Moderated Demented (MDTD)). We experiment and compare different dimension reduction and clustering algorithms to construct the best similarity graph to capture the similarity between the same class images using the cosine distance as a similarity measure. We utilize the similarity graph to present (sample) the training data to a convolutional neural network (CNN). We use the similarity graph as a regularizer in the loss function of a CNN model to minimize the distance between the input images and their k nearest neighbours in the similarity graph while minimizing the categorical cross entropy loss between the training image predictions and the actual image class labels. Results We conduct extensive experiments with several pre trained CNN models and compare the results to other recent methods. Conclusion Our method achieves superior performance on the testing dataset (accuracy 0.986, area under receiver operating characteristics curve 0.998, F1 measure 0.987). Significance The classification results show an improvement in the prediction accuracy compared to the other methods. We release all the code used in our experiments to encourage reproducible research in this area


On nonlinear Rudin Carleson type theorem. In this paper we study nonlinear interpolation problems for interpolation and peak interpolation sets of function algebras. The subject goes back to the classical Rudin Carleson interpolation theorem. In particular, we prove the following nonlinear version of this theorem Let bar mathbb D subset mathbb C be the closed unit disk, mathbb T subset bar mathbb D the unit circle, S subset mathbb T a closed subset of Lebesgue measure zero and M a connected complex manifold. Then for every continuous M valued map f on S there exists a continuous M valued map g on bar mathbb D holomorphic on its interior such that g S f . We also consider similar interpolation problems for continuous maps f S rightarrow bar M , where bar M is a complex manifold with boundary partial M and interior M . Assuming that f(S) cap partial M ne emptyset we are looking for holomorphic extensions g of f such that g( bar mathbb D setminus S) subset M .


The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non Native English Writers. We present an in depth analysis of the impact of multi word suggestion choices from a neural language model on user behaviour regarding input and text composition in email writing. Our study for the first time compares different numbers of parallel suggestions, and use by native and non native English writers, to explore a trade off of "efficiency vs ideation", emerging from recent literature. We built a text editor prototype with a neural language model (GPT 2), refined in a prestudy with 30 people. In an online study (N 156), people composed emails in four conditions (0 1 3 6 parallel suggestions). Our results reveal (1) benefits for ideation, and costs for efficiency, when suggesting multiple phrases (2) that non native speakers benefit more from more suggestions and (3) further insights into behaviour patterns. We discuss implications for research, the design of interactive suggestion systems, and the vision of supporting writers with AI instead of replacing them.


A remark on the homology of finite coverings of a surface. Let p S to S g be a finite covering of an orientable closed surface of genus g . We prove that, for g geq 3 , the rational homology group H 1(S mathbb Q ) is generated by cycles supported on simple closed curves gamma subset S such that p( gamma) is contained in a 3 punctured, genus 0 subsurface of S g . In particular, this answers positively, for g geq 3 and rational coefficients, a question by Autumn Kent.


Characterization measurements of the TRISTAN multi pixel silicon drift detector. Sterile neutrinos are a minimal extension of the Standard Model of Particle Physics. A laboratory based approach to search for this particle is via tritium beta decay, where a sterile neutrino would cause a kink like spectral distortion. The Karlsruhe Tritium Neutrino (KATRIN) experiment extended by a multi pixel Silicon Drift Detector system has the potential to reach an unprecedented sensitivity to the keV scale sterile neutrino in a lab based experiment. The new detector system combines good spectroscopic performance with a high rate capability. In this work, we report about the characterization of charge sharing between pixels and the commissioning of a 47 pixel prototype detector in a MAC E filter.


On the non degenerate and degenerate generic singularities formed by mean curvature flow. In this paper we study a neighborhood of generic singularities formed by mean curvature flow (MCF). We limit our consideration to the singularities modelled on mathbb S 3 times mathbb R because, compared to the cases mathbb S k times mathbb R l with l geq 2 , the present case has the fewest possibilities to be considered. For various possibilities, we provide a detailed description for a small, but fixed, neighborhood of singularity, and prove that a small neighborhood of the singularity is mean convex, and the singularity is isolated. For the remaining possibilities, we conjecture that an entire neighborhood of the singularity becomes singular at the time of blowup, and present evidences to support this conjecture. A key technique is that, when looking for a dominating direction for the rescaled MCF, we need a normal form transformation, as a result, the rescaled MCF is parametrized over some chosen curved cylinder, instead over a standard straight one. This is a long paper. The introduction is carefully written to present the key steps and ideas.


Efficient pre training objectives for Transformers. The Transformer architecture deeply changed the natural language processing, outperforming all previous state of the art models. However, well known Transformer models like BERT, RoBERTa, and GPT 2 require a huge compute budget to create a high quality contextualised representation. In this paper, we study several efficient pre training objectives for Transformers based models. By testing these objectives on different tasks, we determine which of the ELECTRA model's new features is the most relevant. We confirm that Transformers pre training is improved when the input does not contain masked tokens and that the usage of the whole output to compute the loss reduces training time. Moreover, inspired by ELECTRA, we study a model composed of two blocks a discriminator and a simple generator based on a statistical model with no impact on the computational performances. Besides, we prove that eliminating the MASK token and considering the whole output during the loss computation are essential choices to improve performance. Furthermore, we show that it is possible to efficiently train BERT like models using a discriminative approach as in ELECTRA but without a complex generator, which is expensive. Finally, we show that ELECTRA benefits heavily from a state of the art hyper parameters search.


One Parameter Semigroups in Two Complex Variables. For self maps of the disk, it can be shown that under the right conditions one can embed a discrete iteration of the map into a continuous semigroup. In this article we extend these results to two complex variables for maps of the unit ball into itself under some restricted conditions.


Quality control tests of the front end optical link components for the ATLAS Liquid Argon Calorimeter Phase 1 upgrade. We present the procedures and results of the quality control tests for the front end optical link components in the ATLAS Liquid Argon Calorimeter Phase 1 upgrade. The components include a Vertical Cavity Surface Emitting Laser (VCSEL) driver ASIC LOCld, custom optical transmitter transceiver modules MTx MTRx, and a transmitter ASIC LOCx2. LOCld, MTx, and LOCx2 each contain two channels with the same structure, while MTRx has a transmitter channel and a receiver channel. Each channel is tested at 5.12 Gbps. A total of 5341 LOCld chips, 3275 MTx modules, 797 MTRx modules, and 3198 LOCx2 chips are qualified. The yields are 73.9 , 98.0 , 98.4 , and 61.9 for LOCld, LOCx2, MTx, and MTRx, respectively.


Rich Prosody Diversity Modelling with Phone level Mixture Density Network. Generating natural speech with diverse and smooth prosody pattern is a challenging task. Although random sampling with phone level prosody distribution has been investigated to generate different prosody patterns, the diversity of the generated speech is still very limited and far from what can be achieved by human. This is largely due to the use of uni modal distribution, such as single Gaussian, in the prior works of phone level prosody modelling. In this work, we propose a novel approach that models phone level prosodies with GMM based mixture density network (GMM MDN). Experiments on the LJSpeech dataset demonstrate that phone level prosodies can precisely control the synthetic speech and GMM MDN can generate more natural and smooth prosody pattern than a single Gaussian. Subjective evaluations further show that the proposed approach not only achieves better naturalness, but also significantly improves the prosody diversity in synthetic speech without the need of manual control.


Sign Language Recognition via Skeleton Aware Multi Model Ensemble. Sign language is commonly used by deaf or mute people to communicate but requires extensive effort to master. It is usually performed with the fast yet delicate movement of hand gestures, body posture, and even facial expressions. Current Sign Language Recognition (SLR) methods usually extract features via deep neural networks and suffer overfitting due to limited and noisy data. Recently, skeleton based action recognition has attracted increasing attention due to its subject invariant and background invariant nature, whereas skeleton based SLR is still under exploration due to the lack of hand annotations. Some researchers have tried to use off line hand pose trackers to obtain hand keypoints and aid in recognizing sign language via recurrent neural networks. Nevertheless, none of them outperforms RGB based approaches yet. To this end, we propose a novel Skeleton Aware Multi modal Framework with a Global Ensemble Model (GEM) for isolated SLR (SAM SLR v2) to learn and fuse multi modal feature representations towards a higher recognition rate. Specifically, we propose a Sign Language Graph Convolution Network (SL GCN) to model the embedded dynamics of skeleton keypoints and a Separable Spatial Temporal Convolution Network (SSTCN) to exploit skeleton features. The skeleton based predictions are fused with other RGB and depth based modalities by the proposed late fusion GEM to provide global information and make a faithful SLR prediction. Experiments on three isolated SLR datasets demonstrate that our proposed SAM SLR v2 framework is exceedingly effective and achieves state of the art performance with significant margins. Our code will be available at https github.com jackyjsy SAM SLR v2


Microservice Maturity of Organizations towards an assessment framework. This early work aims to allow organizations to diagnose their capacity to properly adopt microservices through initial milestones of a Microservice Maturity Model (MiMMo). The objective is to prepare the way towards a general framework to help companies and industries to determine their microservices maturity. Organizations lean more and more on distributed web applications and Line of Business software. This is particularly relevant during the current Covid 19 crisis, where companies are even more challenged to offer their services online, targeting a very high level of responsiveness in the face of rapidly increasing and diverse demands. For this, microservices remain the most suitable delivery application architectural style. They allow agility not only on the technical application, as often considered, but on the enterprise architecture as a whole, influencing the actual financial business of the company. However, microservices adoption is highly risk prone and complex. Before they establish an appropriate migration plan, first and foremost, companies must assess their degree of readiness to adopt microservices. For this, MiMMo, a Microservices Maturity Model framework assessment, is proposed to help companies assess their readiness for the microservice architectural style, based on their actual situation. MiMMo results from observations of and experience with about thirty organizations writing software. It conceptualizes and generalizes the progression paths they have followed to adopt microservices appropriately. Using the model, an organization can evaluate itself in two dimensions and five maturity levels and thus (i) benchmark itself on its current use of microservices (ii) project the next steps it needs to achieve a higher maturity level and (iii) analyze how it has evolved and maintain a global coherence between technical and business stakes.


Addressing Action Oscillations through Learning Policy Inertia. Deep reinforcement learning (DRL) algorithms have been demonstrated to be effective in a wide range of challenging decision making and control tasks. However, these methods typically suffer from severe action oscillations in particular in discrete action setting, which means that agents select different actions within consecutive steps even though states only slightly differ. This issue is often neglected since the policy is usually evaluated by its cumulative rewards only. Action oscillation strongly affects the user experience and can even cause serious potential security menace especially in real world domains with the main concern of safety, such as autonomous driving. To this end, we introduce Policy Inertia Controller (PIC) which serves as a generic plug in framework to off the shelf DRL algorithms, to enables adaptive trade off between the optimality and smoothness of the learned policy in a formal way. We propose Nested Policy Iteration as a general training algorithm for PIC augmented policy which ensures monotonically non decreasing updates under some mild conditions. Further, we derive a practical DRL algorithm, namely Nested Soft Actor Critic. Experiments on a collection of autonomous driving tasks and several Atari games suggest that our approach demonstrates substantial oscillation reduction in comparison to a range of commonly adopted baselines with almost no performance degradation.


Memory Association Networks. We introduce memory association networks(MANs) that memorize and remember any data. This neural network has two memories. One consists of a queue structured short term memory to solve the class imbalance problem and long term memory to store the distribution of objects, introducing the contents of storing and generating various datasets.


Tits groups of Iwahori Weyl groups and presentations of Hecke algebras. Let G be a connected reductive group over a non archimedean local field F and I be an Iwahori subgroup of G(F) . Let I n is the n th Moy Prasad filtration subgroup of I . The purpose of this paper is two fold to give some nice presentations of the Hecke algebra of connected, reductive groups with I n level structure and to introduce the Tits group of the Iwahori Weyl group of groups G that split over an unramified extension of F . The first main result of this paper is a presentation of the Hecke algebra mathcal H(G(F),I n) , generalizing the previous work of Iwahori Matsumoto on the affine Hecke algebras. For split GL n , Howe gave a refined presentation of the Hecke algebra mathcal H(G(F),I n) . To generalize such a refined presentation to other groups requires the existence of some nice lifting of the Iwahori Weyl group W to G(F) . The study of a certain nice lifting of W is the second main motivation of this paper, which we discuss below. In 1966, Tits introduced a certain subgroup of G( mathbf k) , which is an extension of W by an elementary abelian 2 group. This group is called the Tits group and provides a nice lifting of the elements in the finite Weyl group. The "Tits group" mathcal T for the Iwahori Weyl group W is a certain subgroup of G(F) , which is an extension of the Iwahori Weyl group W by an elementary abelian 2 group. The second main result of this paper is a construction of Tits group mathcal T for W when G splits over an unramified extension of F . As a consequence, we generalize Howe's presentation to such groups. We also show that when G is ramified over F , such a group mathcal T of W may not exist.


An Information Theoretic Law Governing Human Multi Task Navigation Decisions. To better understand the process by which humans make navigation decisions when tasked with multiple stopovers, we analyze motion data captured from shoppers in a grocery store. We discover several trends in the data that are consistent with a noisy decision making process for the order of item retrieval, and decompose a shopping trip into a sequence of discrete choices about the next item to retrieve. Our analysis reveals that the likelihood of inverting any two items in the order is monotonically bound to the entropy of the pair wise ordering task. Based on this analysis, we propose a noisy distance estimation model for predicting the order of item retrieval given a shopping list. We show that our model theoretically reproduces the entropy law seen in the data with high accuracy, and in practice matches the trends in the data when used to simulate the same shopping lists. Our approach has direct applications to improving simulations of human navigation in retail and other settings.


BlockGC A Joint Learning Framework for Account Identity Inference on Blockchain with Graph Contrast. Blockchain technology has the characteristics of decentralization, traceability and tamper proof, which creates a reliable decentralized transaction mode, further accelerating the development of the blockchain platforms. However, with the popularization of various financial applications, security problems caused by blockchain digital assets, such as money laundering, illegal fundraising and phishing fraud, are constantly on the rise. Therefore, financial security has become an important issue in the blockchain ecosystem, and identifying the types of accounts in blockchain (e.g. miners, phishing accounts, Ponzi contracts, etc.) is of great significance in risk assessment and market supervision. In this paper, we construct an account interaction graph using raw blockchain data in a graph perspective, and proposes a joint learning framework for account identity inference on blockchain with graph contrast. We first capture transaction feature and correlation feature from interaction graph, and then perform sampling and data augmentation to generate multiple views for account subgraphs, finally jointly train the subgraph contrast and account classification task. Extensive experiments on Ethereum datasets show that our method achieves significant advantages in account identity inference task in terms of classification performance, scalability and generalization.


Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning. Visual search, recommendation, and contrastive similarity learning power technologies that impact billions of users worldwide. Modern model architectures can be complex and difficult to interpret, and there are several competing techniques one can use to explain a search engine's behavior. We show that the theory of fair credit assignment provides a textit unique axiomatic solution that generalizes several existing recommendation and metric explainability techniques in the literature. Using this formalism, we show when existing approaches violate "fairness" and derive methods that sidestep these shortcomings and naturally handle counterfactual information. More specifically, we show existing approaches implicitly approximate second order Shapley Taylor indices and extend CAM, GradCAM, LIME, SHAP, SBSM, and other methods to search engines. These extensions can extract pairwise correspondences between images from trained textit opaque box models. We also introduce a fast kernel based method for estimating Shapley Taylor indices that require orders of magnitude fewer function evaluations to converge. Finally, we show that these game theoretic measures yield more consistent explanations for image similarity architectures.


Chain decompositions of q,t Catalan numbers III tail extensions and flagpole partitions. This article is part of an ongoing investigation of the combinatorics of q,t Catalan numbers textrm Cat n(q,t) . We develop a structure theory for integer partitions based on the partition statistics dinv, deficit, and minimum triangle height. Our goal is to decompose the infinite set of partitions of deficit k into a disjoint union of chains mathcal C mu indexed by partitions of size k . Among other structural properties, these chains can be paired to give refinements of the famous symmetry property textrm Cat n(q,t) textrm Cat n(t,q) . Previously, we introduced a map NU that builds the tail part of each chain mathcal C mu . Our first main contribution here is to extend NU and construct larger second order tails for each chain. Second, we introduce new classes of partitions (flagpole partitions and generalized flagpole partitions) and give a recursive construction of the full chain mathcal C mu for generalized flagpole partitions mu .


Categorical braid group actions and cactus groups. Let mathfrak g be a semisimple simply laced Lie algebra of finite type. Let mathcal C be an abelian categorical representation of the quantum group U q( mathfrak g ) categorifying an integrable representation V . The Artin braid group B of mathfrak g acts on D b( mathcal C ) by Rickard complexes, providing a triangulated equivalence Theta w 0 D b( mathcal C mu) to D b( mathcal C w 0( mu) ) , where mu is a weight of V and Theta w 0 is a positive lift of the longest element of the Weyl group. We prove that this equivalence is t exact up to shift when V is isotypic, generalising a fundamental result of Chuang and Rouquier in the case mathfrak g mathfrak sl 2 . For general V , we prove that Theta w 0 is a perverse equivalence with respect to a Jordan H "older filtration of mathcal C . Using these results we construct, from the action of B on V , an action of the cactus group on the crystal of V . This recovers the cactus group action on V defined via generalised Sch "utzenberger involutions, and provides a new connection between categorical representation theory and crystal bases. We also use these results to give new proofs of theorems of Berenstein Zelevinsky, Rhoades, and Stembridge regarding the action of symmetric group on the Kazhdan Lusztig basis of its Specht modules.


Social Analysis of Young Basque Speaking Communities in Twitter. In this paper we take into account both social and linguistic aspects to perform demographic analysis by processing a large amount of tweets in Basque language. The study of demographic characteristics and social relationships are approached by applying machine learning and modern deep learning Natural Language Processing (NLP) techniques, combining social sciences with automatic text processing. More specifically, our main objective is to combine demographic inference and social analysis in order to detect young Basque Twitter users and to identify the communities that arise from their relationships or shared content. This social and demographic analysis will be entirely based on the automatically collected tweets using NLP to convert unstructured textual information into interpretable knowledge.


ARBERT MARBERT Deep Bidirectional Transformers for Arabic. Pre trained language models (LMs) are currently integral to many natural language processing systems. Although multilingual LMs were also introduced to serve many languages, these have limitations such as being costly at inference time and the size and diversity of non English data involved in their pre training. We remedy these issues for a collection of diverse Arabic varieties by introducing two powerful deep bidirectional transformer based models, ARBERT and MARBERT. To evaluate our models, we also introduce ARLUE, a new benchmark for multi dialectal Arabic language understanding evaluation. ARLUE is built using 42 datasets targeting six different task clusters, allowing us to offer a series of standardized experiments under rich conditions. When fine tuned on ARLUE, our models collectively achieve new state of the art results across the majority of tasks (37 out of 48 classification tasks, on the 42 datasets). Our best model acquires the highest ARLUE score (77.40) across all six task clusters, outperforming all other models including XLM R Large ( 3.4 x larger size). Our models are publicly available at https github.com UBC NLP marbert and ARLUE will be released through the same repository.


Ideals and Virtual Realities. A main step for world progress is to keep sharing ever present Ideals for science and education within today Virtual Realities. On line education is transforming human society to new levels in the way people teach and learn during the ongoing SARS CoV 2 pandemic. There is an increasing interest in having more and more reliable, fast and simple apps to communicate and also to record, assemble and distribute videos and lectures in the fields of Physics Maths still using traditional didactic methods. We describe here how to accurately reproduce chalkboard classes for the popular YouTube video platform using OpenEyA YT. The audience can thus be expanded over continents to help mitigate the effects of physical isolation.


On transformation operators and Riesz basis property of root vectors system for n times n Dirac type operators. Application to the Timoshenko beam model. The paper is concerned with the following n times n Dirac type equation Ly iB(x) 1 (y' Q(x)y) lambda y, quad B(x) B(x) , quad y rm col (y 1, ldots,y n), quad x in 0, ell , on a finite interval 0, ell . Here Q is a summable potential n times n matrix function and B is an invertible self adjoint diagonal bounded matrix function. If n 2m and B(x) rm diag ( I m,I m) , this equation is equivalent to Dirac equation of order n . We show the existence of triangular transformation operators for such equation under additional uniform separation conditions on the entries of the matrix function B . Here we apply this result to study direct spectral properties of the boundary value problem (BVP) associated with the above equation subject to the general boundary conditions U(y) Cy(0) Dy( ell) 0, rm rank (C D) n . We apply this result to show that the deviation of the characteristic determinants of this BVP and the unperturbed BVP (with Q 0 ) is a Fourier transform of some summable function, which in turn yields asymptotic behavior of the spectrum in the case of regular boundary conditions. Namely, lambda m lambda m 0 o(1) as m to infty , where lambda m m in mathbb Z and lambda m 0 m in mathbb Z are sequences of eigenvalues of perturbed and unperturbed ( Q 0 ) BVP, respectively. Further, we prove that the system of root vectors of the above BVP constitutes a Riesz basis in a certain weighted L 2 space, provided that the boundary conditions are strictly regular. The main results are applied to establish asymptotic behavior of eigenvalues and eigenvectors, and the Riesz basis property for the dynamic generator of the Timoshenko beam model. We also found a new case when eigenvalues have an explicit asymptotic, which to the best of our knowledge is new even in the case of constant parameters of the model.


A strong Schottky lemma on n generators for mathrm CAT (0) spaces. We give a criterion for a set of n hyperbolic isometries of a mathrm CAT (0) metric space X to generate a free group on n generators. This extends a result by Alperin, Farb and Noskov who proved this for 2 generators under the additional assumption that X is complete and has no fake zero angles. Moreover, when X is locally compact, the group we obtain is also discrete.


CO NNECT A Framework for Revealing Commonsense Knowledge Paths as Explicitations of Implicit Knowledge in Texts. In this work we leverage commonsense knowledge in form of knowledge paths to establish connections between sentences, as a form of explicitation of implicit knowledge. Such connections can be direct (singlehop paths) or require intermediate concepts (multihop paths). To construct such paths we combine two model types in a joint framework we call Co nnect a relation classifier that predicts direct connections between concepts and a target prediction model that generates target or intermediate concepts given a source concept and a relation, which we use to construct multihop paths. Unlike prior work that relies exclusively on static knowledge sources, we leverage language models finetuned on knowledge stored in ConceptNet, to dynamically generate knowledge paths, as explanations of implicit knowledge that connects sentences in texts. As a central contribution we design manual and automatic evaluation settings for assessing the quality of the generated paths. We conduct evaluations on two argumentative datasets and show that a combination of the two model types generates meaningful, high quality knowledge paths between sentences that reveal implicit knowledge conveyed in text.


Semilinear wave equations of derivative type with spatial weights in one space dimension. This paper is devoted to the initial value problems for semilinear wave equations of derivative type with spatial weights in one space dimension. The lifespan estimates of classical solutions are quite different from those for nonlinearity of unknown function itself as the global in time existence can be established by spatial decay.


An Add On for Empowering Google Forms to be an Automatic Question Generator in Online Assessments. This research suggests an add on to empower Google Forms to be an automatic machine for generating multiple choice questions (MCQs) used in online assessments. In this paper, we elaborate an add on design mainly comprising question formulating software and data storage. The algorithm as an intellectual mechanism of this software can produce MCQs at an analytical level. In an experiment, we found the MCQs could assess levels of students' knowledge comparably with those generated by human experts. This add on can be applied generally to formulate MCQs for any rational concepts. With no effort from an instructor at runtime, the add on can transform a few data instances describing rational concepts to be variety sets of MCQs.


Fluctuating Multiscale Mass Action Law. The classical mass action law in chemical kinetics is put into the context of multiscale thermodynamics.Despite the purely dissipative character of the classical mass action law, inertial effects also play a role in chemical kinetics. Therefore, the kinetics is extended to an enlarged state space with reaction rates as new state variables and bringing inertial effects. The dynamics is then lifted to the Liouville description within kinetic theory on the enlarged state space in order to include fluctuations. Subsequently, the kinetic theory is reduced to its first and second moments, leading to a new Grad like hierarchy in chemical kinetics, expressing the multiscale nature of the chemical kinetic with inertia. Dissipation within the extended state space is proposed and it is shown to lead to the classical mass action law when the moments relax to their respective quasi equilibria. In particular, we demonstrate the possibility of oscillating homogeneous chemical reactions and how the correlations of fluctuations correspond with the chemical kinetics.


Few Shot Learning for Road Object Detection. Few shot learning is a problem of high interest in the evolution of deep learning. In this work, we consider the problem of few shot object detection (FSOD) in a real world, class imbalanced scenario. For our experiments, we utilize the India Driving Dataset (IDD), as it includes a class of less occurring road objects in the image dataset and hence provides a setup suitable for few shot learning. We evaluate both metric learning and meta learning based FSOD methods, in two experimental settings (i) representative (same domain) splits from IDD, that evaluates the ability of a model to learn in the context of road images, and (ii) object classes with less occurring object samples, similar to the open set setting in real world. From our experiments, we demonstrate that the metric learning method outperforms meta learning on the novel classes by (i) 11.2 mAP points on the same domain, and (ii) 1.0 mAP point on the open set. We also show that our extension of object classes in a real world open dataset offers a rich ground for few shot learning studies.


An asymptotic expansion for a twisted Lambert series associated to a cusp form and the M " o bius function level aspect. Recently, Juyal, Maji, and Sathyanarayana have studied a Lambert series associated with a cusp form over the full modular group and the M " o bius function. In this paper, we investigate the Lambert series sum n 1 infty a f(n) psi(n) mu(n) psi'(n) exp( ny), where a f(n) is the n th Fourier coefficient of a cusp form f over any congruence subgroup, and psi and psi' are primitive Dirichlet characters. This extends the earlier work to the case of higher level subgroups and also gives a character analogue.


Some Remarks on Bayesian Multiple Hypothesis Testing. We consider Bayesian multiple hypothesis problem with independent and identically distributed observations. The classical, Sanov's theorem based, analysis of the error probability allows one to characterize the best achievable error exponent. However, this analysis does not generalize to the case where the true distributions of the hypothesis are not exact or partially known via some nominal distributions. This problem has practical significance, because the nominal distributions may be quantized versions of the true distributions in a hardware implementation, or they may be estimates of the true distributions obtained from labeled training sequences as in statistical classification. In this paper, we develop a type based analysis to investigate Bayesian multiple hypothesis testing problem. Our analysis allows one to explicitly calculate the error exponent of a given type and extends the classical analysis. As a generalization of the proposed method, we derive a robust test and obtain its error exponent for the case where the hypothesis distributions are not known but there exist nominal distribution that are close to true distributions in variational distance.


ViBERTgrid A Jointly Trained Multi Modal 2D Document Representation for Key Information Extraction from Documents. Recent grid based document representations like BERTgrid allow the simultaneous encoding of the textual and layout information of a document in a 2D feature map so that state of the art image segmentation and or object detection models can be straightforwardly leveraged to extract key information from documents. However, such methods have not achieved comparable performance to state of the art sequence and graph based methods such as LayoutLM and PICK yet. In this paper, we propose a new multi modal backbone network by concatenating a BERTgrid to an intermediate layer of a CNN model, where the input of CNN is a document image and the BERTgrid is a grid of word embeddings, to generate a more powerful grid based document representation, named ViBERTgrid. Unlike BERTgrid, the parameters of BERT and CNN in our multimodal backbone network are trained jointly. Our experimental results demonstrate that this joint training strategy improves significantly the representation ability of ViBERTgrid. Consequently, our ViBERTgrid based key information extraction approach has achieved state of the art performance on real world datasets.


Characterizations of Forman curvature. We characterize Forman curvature lower bounds via contractivity of the Hodge Laplacian semigroup. We prove that Ollivier and Forman curvature coincide on edges when maximizing the Forman curvature over the choice of 2 cells. To this end, we translate between 2 cells and transport plans. Moreover, we give improved diameter bounds. We explicitly warn the reader that our Forman curvature notion does not coincide with Forman's original definition, but can be seen as generalization of the latter one.


Separations for Estimating Large Frequency Moments on Data Streams. We study the classical problem of moment estimation of an underlying vector whose n coordinates are implicitly defined through a series of updates in a data stream. We show that if the updates to the vector arrive in the random order insertion only model, then there exist space efficient algorithms with improved dependencies on the approximation parameter varepsilon . In particular, for any real p 2 , we first obtain an algorithm for F p moment estimation using tilde mathcal O left( frac 1 varepsilon 4 p cdot n 1 2 p right) bits of memory. Our techniques also give algorithms for F p moment estimation with p 2 on arbitrary order insertion only and turnstile streams, using tilde mathcal O left( frac 1 varepsilon 4 p cdot n 1 2 p right) bits of space and two passes, which is the first optimal multi pass F p estimation algorithm up to log n factors. Finally, we give an improved lower bound of Omega left( frac 1 varepsilon 2 cdot n 1 2 p right) for one pass insertion only streams. Our results separate the complexity of this problem both between random and non random orders, as well as one pass and multi pass streams.


Packet Routing with Graph Attention Multi agent Reinforcement Learning. Packet routing is a fundamental problem in communication networks that decides how the packets are directed from their source nodes to their destination nodes through some intermediate nodes. With the increasing complexity of network topology and highly dynamic traffic demand, conventional model based and rule based routing schemes show significant limitations, due to the simplified and unrealistic model assumptions, and lack of flexibility and adaption. Adding intelligence to the network control is becoming a trend and the key to achieving high efficiency network operation. In this paper, we develop a model free and data driven routing strategy by leveraging reinforcement learning (RL), where routers interact with the network and learn from the experience to make some good routing configurations for the future. Considering the graph nature of the network topology, we design a multi agent RL framework in combination with Graph Neural Network (GNN), tailored to the routing problem. Three deployment paradigms, centralized, federated, and cooperated learning, are explored respectively. Simulation results demonstrate that our algorithm outperforms some existing benchmark algorithms in terms of packet transmission delay and affordable load.


Intrusion Detection System in Smart Home Network Using Bidirectional LSTM and Convolutional Neural Networks Hybrid Model. Internet of Things (IoT) allowed smart homes to improve the quality and the comfort of our daily lives. However, these conveniences introduced several security concerns that increase rapidly. IoT devices, smart home hubs, and gateway raise various security risks. The smart home gateways act as a centralized point of communication between the IoT devices, which can create a backdoor into network data for hackers. One of the common and effective ways to detect such attacks is intrusion detection in the network traffic. In this paper, we proposed an intrusion detection system (IDS) to detect anomalies in a smart home network using a bidirectional long short term memory (BiLSTM) and convolutional neural network (CNN) hybrid model. The BiLSTM recurrent behavior provides the intrusion detection model to preserve the learned information through time, and the CNN extracts perfectly the data features. The proposed model can be applied to any smart home network gateway.


Prediction of Pedestrian Spatiotemporal Risk Levels for Intelligent Vehicles A Data driven Approach. In recent years, road safety has attracted significant attention from researchers and practitioners in the intelligent transport systems domain. As one of the most common and vulnerable groups of road users, pedestrians cause great concerns due to their unpredictable behavior and movement, as subtle misunderstandings in vehicle pedestrian interaction can easily lead to risky situations or collisions. Existing methods use either predefined collision based models or human labeling approaches to estimate the pedestrians' risks. These approaches are usually limited by their poor generalization ability and lack of consideration of interactions between the ego vehicle and a pedestrian. This work tackles the listed problems by proposing a Pedestrian Risk Level Prediction system. The system consists of three modules. Firstly, vehicle perspective pedestrian data are collected. Since the data contains information regarding the movement of both the ego vehicle and pedestrian, it can simplify the prediction of spatiotemporal features in an interaction aware fashion. Using the long short term memory model, the pedestrian trajectory prediction module predicts their spatiotemporal features in the subsequent five frames. As the predicted trajectory follows certain interaction and risk patterns, a hybrid clustering and classification method is adopted to explore the risk patterns in the spatiotemporal features and train a risk level classifier using the learned patterns. Upon predicting the spatiotemporal features of pedestrians and identifying the corresponding risk level, the risk patterns between the ego vehicle and pedestrians are determined. Experimental results verified the capability of the PRLP system to predict the risk level of pedestrians, thus supporting the collision risk assessment of intelligent vehicles and providing safety warnings to both vehicles and pedestrians.


Robust and accurate fine grain power models for embedded systems with no on chip PMU. This paper presents a novel approach to event based power modelling for embedded platforms that do not have a Performance Monitoring Unit (PMU). The method involves complementing the target hardware platform, where the physical power data is measured, with another platform on which the CPU performance data, that is needed for model generation, can be collected. The methodology is used to generate accurate fine grain power models for the the Gaisler GR712RC dual core LEON3 fault tolerant SPARC processor with on board power sensors and no PMU. A Kintex UltraScale FPGA is used as the support platform to obtain the required CPU performance data, by running a soft core representation of the dual core LEON3 as on the GR712RC but with a PMU implementation. Both platforms execute the same benchmark set and data collection is synchronised using per sample timestamps so that the power sensor data from the GR712RC board can be matched to the PMU data from the FPGA. The synchronised samples are then processed by the Robust Energy and Power Predictor Selection (REPPS) software in order to generate power models. The models achieve less than 2 power estimation error when validated on an industrial use case and can successfully follow program phases, which makes them suitable for runtime power profiling.


Super Resolution of Arctic Sea Ice Concentration. Arctic sea ice concentration is often coarsely observed and numerically computed despite its importance for polar climate system. In this work we present three machine learning methods to recover the original high resolution images from the coarse grained low resolution counterparts. The promising results indicate a possibility of extending the application to a broad range of geophysical variables.


Understanding and Improvement of Adversarial Training for Network Embedding from an Optimization Perspective. Network Embedding aims to learn a function mapping the nodes to Euclidean space contribute to multiple learning analysis tasks on networks. However, the noisy information behind the real world networks and the overfitting problem both negatively impact the quality of embedding vectors. To tackle these problems, researchers utilize Adversarial Training for Network Embedding (AdvTNE) and achieve state of the art performance. Unlike the mainstream methods introducing perturbations on the network structure or the data feature, AdvTNE directly perturbs the model parameters, which provides a new chance to understand the mechanism behind. In this paper, we explain AdvTNE theoretically from an optimization perspective. Considering the Power law property of networks and the optimization objective, we analyze the reason for its excellent results. According to the above analysis, we propose a new activation to enhance the performance of AdvTNE. We conduct extensive experiments on four real networks to validate the effectiveness of our method in node classification and link prediction. The results demonstrate that our method is superior to the state of the art baseline methods.


Spatiotemporal impacts of human activities and socio demographics during the COVID 19 outbreak in the U.S. Understanding influencing factors is essential for the surveillance and prevention of infectious diseases, and the factors are likely to vary spatially and temporally as the disease progresses. Taking daily cases and deaths data during the coronavirus disease 2019 (COVID 19) outbreak in the U.S. as a case study, we develop a mobility augmented geographically and temporally weighted regression (M GTWR) model to quantify the spatiotemporal impacts of social demographic factors and human activities on the COVID 19 dynamics. Different from the base GTWR model, we incorporate a mobility adjusted distance weight matrix where travel mobility is used in addition to the spatial adjacency to capture the correlations among local observations. The model residuals suggest that the proposed model achieves a substantial improvement over other benchmark methods in addressing the spatiotemporal nonstationarity. Our results reveal that the impacts of social demographic and human activity variables present significant spatiotemporal heterogeneity. In particular, a 1 increase in population density may lead to 0.63 and 0.71 more daily cases and deaths, and a 1 increase in the mean commuting time may result in 0.22 and 0.95 increases in daily cases and deaths. Although increased human activities will, in general, intensify the disease outbreak, we report that the effects of grocery and pharmacy related activities are insignificant in areas with high population density. And activities at the workplace and public transit are found to either increase or decrease the number of cases and deaths, depending on particular locations. The results of our study establish a quantitative framework for identifying influencing factors during a disease outbreak, and the obtained insights may have significant implications in guiding the policy making against infectious diseases.


Hindsight Goal Ranking on Replay Buffer for Sparse Reward Environment. This paper proposes a method for prioritizing the replay experience referred to as Hindsight Goal Ranking (HGR) in overcoming the limitation of Hindsight Experience Replay (HER) that generates hindsight goals based on uniform sampling. HGR samples with higher probability on the states visited in an episode with larger temporal difference (TD) error, which is considered as a proxy measure of the amount which the RL agent can learn from an experience. The actual sampling for large TD error is performed in two steps first, an episode is sampled from the relay buffer according to the average TD error of its experiences, and then, for the sampled episode, the hindsight goal leading to larger TD error is sampled with higher probability from future visited states. The proposed method combined with Deep Deterministic Policy Gradient (DDPG), an off policy model free actor critic algorithm, accelerates learning significantly faster than that without any prioritization on four challenging simulated robotic manipulation tasks. The empirical results show that HGR uses samples more efficiently than previous methods across all tasks.


Measuring and Improving Model Moderator Collaboration using Uncertainty Estimation. Content moderation is often performed by a collaboration between humans and machine learning models. However, it is not well understood how to design the collaborative process so as to maximize the combined moderator model system performance. This work presents a rigorous study of this problem, focusing on an approach that incorporates model uncertainty into the collaborative process. First, we introduce principled metrics to describe the performance of the collaborative system under capacity constraints on the human moderator, quantifying how efficiently the combined system utilizes human decisions. Using these metrics, we conduct a large benchmark study evaluating the performance of state of the art uncertainty models under different collaborative review strategies. We find that an uncertainty based strategy consistently outperforms the widely used strategy based on toxicity scores, and moreover that the choice of review strategy drastically changes the overall system performance. Our results demonstrate the importance of rigorous metrics for understanding and developing effective moderator model systems for content moderation, as well as the utility of uncertainty estimation in this domain.


Surgical task expertise detected by a self organizing neural network map. Individual grip force profiling of bimanual simulator task performance of experts and novices using a robotic control device designed for endoscopic surgery permits defining benchmark criteria that tell true expert task skills from the skills of novices or trainee surgeons. Grip force variability in a true expert and a complete novice executing a robot assisted surgical simulator task reveal statistically significant differences as a function of task expertise. Here we show that the skill specific differences in local grip forces are predicted by the output metric of a Self Organizing neural network Map (SOM) with a bio inspired functional architecture that maps the functional connectivity of somatosensory neural networks in the primate brain.


Twisted Reidemeister torsion and Gram matrices. We find an explicit formula of the twisted Reidemeister torsion of the fundamental shadow link complements twisted by the adjoint action of the holonomy representation of the (possibly incomplete) hyperbolic structures, and of the double of hyperbolic polyhedral 3 manifolds twisted by the adjoint action of the holonomy representation of the hyperbolic polyhedral metrics, which turn out to be a product of the determinant of the Gram matrix functions evaluated respectively at the logarithmic holonomies of the meridians and at the edge lengths. As a consequence, we obtain an explicit formula of the twisted Reidemeister torsion of closed hyperbolic 3 manifolds obtained by doing a hyperbolic Dehn surgery along a fundamental shadow link complement, and of the double of a geometrically triangulated hyperbolic 3 manifold with totally geodesic boundary, respectively in terms of the boundary logarithmic holonomies and of the edge lengths. We notice that by cite CT most closed oriented hyperbolic 3 manifolds can be obtained from a suitable fundamental shadow link complement by doing a hyperbolic Dehn surgery. These formulas play an essential role in the study of the asymptotic expansion of certain quantum invariants in cite WY .


A note on set theoretical solutions of the Yang Baxter equation with trivial retraction. We show that every set theoretical solution to the YBE whose retraction is a flip linearizes to a twist of the flip solution by roots of unity. This generalizes a result of Gateva Ivanova and Majid. To prove the result we use a new invariant associated to a solution, its Lie algebra. We show also that a solution retracts to a flip solution if and only if its Lie algebra is abelian.


Efficient solvers for shallow water Saint Venant equations and debris transportation deposition models. This research is aimed at achieving an efficient digital infrastructure for evaluating risks and damages caused by tsunami flooding. It is mainly focused on the suitable modeling of debris dynamics for a simple (but accurate enough) assessment of damages. For different reasons including computational performance and Big Data management issues, we focus our research on Eulerian debris flow modeling. Rather than using complex multiphase debris models, we rather use an empirical transportation and deposition model that takes into account the interaction with the main water flow, friction contact with the ground but also debris interaction. In particular, for debris interaction, we have used ideas coming from vehicular traffic flow modeling. We introduce a velocity regularization term similar to the so called anticipation term'' in traffic flow modeling that takes into account the local flow between neighboring debris and makes the problem mathematically well posed. It prevents from the generation of Dirac measures of debris'' at shock waves. As a result, the model is able to capture emerging phenomenons like debris aggregation and accumulations, and possibly to react on the main flow by creating hills of debris and make the main stream deviate. We also discuss the way to derive quantities of interest (QoI), especially damage functions'' from the debris density and momentum fields. We believe that this original unexplored debris approach can lead to a valuable analysis of tsunami flooding damage assessment with Physics based damage functions. Numerical experiments show the nice behaviour of the numerical solvers, including the solution of Saint Venant's shallow water equations and debris dynamics equations.


Finite Element Analysis of Time Fractional Integro differential Equations of Kirchhoff type for Non homogeneous Materials. In this paper, we study an initial boundary value problem of Kirchhoff type involving memory term for non homogeneous materials. The purpose of this research is threefold. First, we prove the existence and uniqueness of weak solutions to the problem using the Galerkin method. Second, to obtain numerical solutions efficiently, we develop a L1 type backward Euler Galerkin FEM, which is O(h k 2 alpha ) accurate, where alpha (0 alpha 1) is the order of fractional time derivative, h and k are the discretization parameters for space and time directions, respectively. Next, to achieve the optimal rate of convergence in time, we propose a fractional Crank Nicolson Galerkin FEM based on L2 1 sigma scheme. We prove that the numerical solutions of this scheme converge to the exact solution with accuracy O(h k 2 ) . We also derive a priori bounds on numerical solutions for the proposed schemes. Finally, some numerical experiments are conducted to validate our theoretical claims.


Smart Vectorizations for Single and Multiparameter Persistence. The machinery of topological data analysis becomes increasingly popular in a broad range of machine learning tasks, ranging from anomaly detection and manifold learning to graph classification. Persistent homology is one of the key approaches here, allowing us to systematically assess the evolution of various hidden patterns in the data as we vary a scale parameter. The extracted patterns, or homological features, along with information on how long such features persist throughout the considered filtration of a scale parameter, convey a critical insight into salient data characteristics and data organization. In this work, we introduce two new and easily interpretable topological summaries for single and multi parameter persistence, namely, saw functions and multi persistence grid functions, respectively. Compared to the existing topological summaries which tend to assess the numbers of topological features and or their lifespans at a given filtration step, our proposed saw and multi persistence grid functions allow us to explicitly account for essential complementary information such as the numbers of births and deaths at each filtration step. These new topological summaries can be regarded as the complexity measures of the evolving subspaces determined by the filtration and are of particular utility for applications of persistent homology on graphs. We derive theoretical guarantees on the stability of the new saw and multi persistence grid functions and illustrate their applicability for graph classification tasks.


Stochastic Geometry Analysis of IRS Assisted Downlink Cellular Networks. Using stochastic geometry tools, we develop a comprehensive framework to analyze the downlink coverage probability, ergodic capacity, and energy efficiency (EE) of various types of users (e.g., users served by direct base station (BS) transmissions and indirect intelligent reflecting surface (IRS) assisted transmissions) in a cellular network with multiple BSs and IRSs. The proposed stochastic geometry framework can capture the impact of channel fading, locations of BSs and IRSs, arbitrary phase shifts and interference experienced by a typical user supported by direct transmission and or IRS assisted transmission. For IRS assisted transmissions, we first model the desired signal power from the nearest IRS as a sum of scaled generalized gamma (GG) random variables whose parameters are functions of the IRS phase shifts. Then, we derive the Laplace Transform (LT) of the received signal power in a closed form. Also, we model the aggregate interference from multiple IRSs as the sum of normal random variables. Then, we derive the LT of the aggregate interference from all IRSs and BSs. The derived LT expressions are used to calculate coverage probability, ergodic capacity, and EE for users served by direct BS transmissions as well as users served by IRS assisted transmissions. Finally, we derive the overall network coverage probability, ergodic capacity, and EE based on the fraction of direct and IRS assisted users, which is defined as a function of the deployment intensity of IRSs, as well as blockage probability of direct transmission links. Numerical results validate the derived analytical expressions and extract useful insights related to the number of IRS elements, large scale deployment of IRSs and BSs, and the impact of IRS interference on direct transmissions.


Massively Winning Configurations in the Convex Grabbing Game on the Plane. The convex grabbing game is a game where two players, Alice and Bob, alternate taking extremal points from the convex hull of a point set on the plane. Rational weights are given to the points. The goal of each player is to maximize the total weight over all points that they obtain. We restrict the setting to the case of binary weights. We show a construction of an arbitrarily large odd sized point set that allows Bob to obtain almost 3 4 of the total weight. This construction answers a question asked by Matsumoto, Nakamigawa, and Sakuma in Graphs and Combinatorics, 36 1 (2020) . We also present an arbitrarily large even sized point set where Bob can obtain the entirety of the total weight. Finally, we discuss conjectures about optimum moves in the convex grabbing game for both players in general.


Accelerate Distributed Stochastic Descent for Nonconvex Optimization with Momentum. Momentum method has been used extensively in optimizers for deep learning. Recent studies show that distributed training through K step averaging has many nice properties. We propose a momentum method for such model averaging approaches. At each individual learner level traditional stochastic gradient is applied. At the meta level (global learner level), one momentum term is applied and we call it block momentum. We analyze the convergence and scaling properties of such momentum methods. Our experimental results show that block momentum not only accelerates training, but also achieves better results.


Revisiting Model's Uncertainty and Confidences for Adversarial Example Detection. Security sensitive applications that rely on Deep Neural Networks (DNNs) are vulnerable to small perturbations that are crafted to generate Adversarial Examples(AEs). The AEs are imperceptible to humans and cause DNN to misclassify them. Many defense and detection techniques have been proposed. Model's confidences and Dropout, as a popular way to estimate the model's uncertainty, have been used for AE detection but they showed limited success against black and gray box attacks. Moreover, the state of the art detection techniques have been designed for specific attacks or broken by others, need knowledge about the attacks, are not consistent, increase model parameters overhead, are time consuming, or have latency in inference time. To trade off these factors, we revisit the model's uncertainty and confidences and propose a novel unsupervised ensemble AE detection mechanism that 1) uses the uncertainty method called SelectiveNet, 2) processes model layers outputs, i.e.feature maps, to generate new confidence probabilities. The detection method is called Selective and Feature based Adversarial Detection (SFAD). Experimental results show that the proposed approach achieves better performance against black and gray box attacks than the state of the art methods and achieves comparable performance against white box attacks. Moreover, results show that SFAD is fully robust against High Confidence Attacks (HCAs) for MNIST and partially robust for CIFAR10 datasets.


Exact DG categories and fully faithful triangulated inclusion functors. We construct an "almost involution" assigning a new DG category to a given one, and use this construction in order to recover, say, the abelian category of graded modules over the graded ring R from the DG category of DG modules over a DG ring (R ,d) . This provides an appropriate technical background for the definition and discussion of abelian and exact DG categories. In the setting of exact DG categories, derived categories of the second kind are defined in the maximal natural generality. We develop the related abstract category theoretic language and use it in order to formulate and prove several full and faithfulness theorems for triangulated functors induced by the inclusions of fully exact DG subcategories. Such functors are fully faithful for derived categories of the second kind more often than for the conventional derived categories. Examples and applications range from the categories of complexes in abelian exact categories to matrix factorization categories, and from curved DG modules over curved DG rings to quasi coherent CDG modules over quasi coherent CDG quasi algebras over schemes.


Parallel Capsule Networks for Classification of White Blood Cells. Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and or the objects to identify have minimal background noise. In this work, we present a new architecture, parallel CapsNets, which exploits the concept of branching the network to isolate certain capsules, allowing each branch to identify different entities. We applied our concept to the two current types of CapsNet architectures, studying the performance for networks with different layers of capsules. We tested our design in a public, highly unbalanced dataset of acute myeloid leukaemia images (15 classes). Our experiments showed that conventional CapsNets show similar performance than our baseline CNN (ResNeXt 50) but depict instability problems. In contrast, parallel CapsNets can outperform ResNeXt 50, is more stable, and shows better rotational invariance than both, conventional CapsNets and ResNeXt 50.


On polynomial solutions of PDE. In this paper we prove that the PDE p(D)f q, where p and q are multivariate polynomials, has a solution in the space of polynomials of total degree not exceeding n s , where n is the degree of q and s is the zero order of O (0, ldots,0) for p.


The IoT Exchange. The IoT ecosystem suffers from a variety of problems around security, identity, access control, data flow and data storage that introduce friction into interactions between various parties. In many respects, the situation is similar to the early days of the Internet, where, prior to the establishment of Internet Exchanges, routing between different BGP autonomous systems was often point to point. We propose a similar solution, the IoT Exchange, where IoT device owners can register their devices and offer data for sale or can upload data into the IoT services of any of the big hyperscale cloud platforms for further processing. The goal of the IoT Exchange is to break down the silos within which device wireless connectivity types and cloud provider IoT systems constrain users to operate. In addition, if the device owner needs to maintain the data close to the edge to reduce access latency, the MillenniumDB service running in an edge data center with minimal latency to the edge device, provides a database with a variety of schema engines (SQL, noSQL, etc). The IoT exchange uses decentralized identifiers for identity management and verifiable credentials for authorizing software updates and to control access to the devices, to avoid dependence on certificate authorities and other centralized identity and authorization management systems. In addition, verifiable credentials provide a way whereby privacy preserving processing can be applied to traffic between a device and an end data or control customer, if some risk of privacy compromise exists.


Pushing the Limits of Capsule Networks. Convolutional neural networks use pooling and other downscaling operations to maintain translational invariance for detection of features, but in their architecture they do not explicitly maintain a representation of the locations of the features relative to each other. This means they do not represent two instances of the same object in different orientations the same way, like humans do, and so training them often requires extensive data augmentation and exceedingly deep networks. A team at Google Brain recently made news with an attempt to fix this problem Capsule Networks. While a normal CNN works with scalar outputs representing feature presence, a CapsNet works with vector outputs representing entity presence. We want to stress test CapsNet in various incremental ways to better understand their performance and expressiveness. In broad terms, the goals of our investigation are (1) test CapsNets on datasets that are like MNIST but harder in a specific way, and (2) explore the internal embedding space and sources of error for CapsNets.


Gagliardo Nirenberg Sobolev inequalities on planar graphs. In this paper we study a family of interpolation Gagliardo Nirenberg Sololev inequalities on planar graphs. We are interested in knowing when the best constants in the inequalities are achieved. We also analyse the set of solutions of the corresponding Euler Lagrange equations.


MACEst The reliable and trustworthy Model Agnostic Confidence Estimator. Reliable Confidence Estimates are hugely important for any machine learning model to be truly useful. In this paper, we argue that any confidence estimates based upon standard machine learning point prediction algorithms are fundamentally flawed and under situations with a large amount of epistemic uncertainty are likely to be untrustworthy. To address these issues, we present MACEst, a Model Agnostic Confidence Estimator, which provides reliable and trustworthy confidence estimates. The algorithm differs from current methods by estimating confidence independently as a local quantity which explicitly accounts for both aleatoric and epistemic uncertainty. This approach differs from standard calibration methods that use a global point prediction model as a starting point for the confidence estimate.


Evolutionary Multi Objective Virtual Network Function Placement A Formal Model and Effective Algorithms. Data centers are critical to the commercial and social activities of modern society but are also major electricity consumers. To minimize their environmental impact, it is imperative to make data centers more energy efficient while maintaining a high quality of service (QoS). Bearing this consideration in mind, we develop an analytical model using queueing theory for evaluating the QoS of a data center. Furthermore, based on this model, we develop a domain specific evolutionary optimization framework featuring a tailored solution representation and a constraint aware initialization operator for finding the optimal placement of virtual network functions in a data center that optimizes multiple conflicting objectives with regard to energy consumption and QoS. In particular, our framework is applicable to any existing evolutionary multi objective optimization algorithm in a plug in manner. Extensive experiments validate the efficiency and accuracy of our QoS model as well as the effectiveness of our tailored algorithms for virtual network function placement problems at various scales.


On Controllability of Driftless Control System on Symmetric Spaces. Symmetric spaces arise in wide variety of problems in Mathematics and Physics. They are mostly studied in Representation theory, Harmonic analysis and Differential geometry. As many physical systems have symmetric spaces as their configuration spaces, the study of controllability on symmetric space is quite interesting. In this paper, a driftless control system of type dot x sum i 1 m u if i(x) is considered on a symmetric space. For this we have established global controllability condition which is illustrated by few examples of exponential submanifolds of SE(3) and random matrix ensembles.


Upper and lower estimates for the separation of solutions to fractional differential equations. Given a fractional differential equation of order alpha in (0,1 with Caputo derivatives, we investigate in a quantitative sense how the associated solutions depend on their respective initial conditions. Specifically, we look at two solutions x 1 and x 2 , say, of the same differential equation, both of which are assumed to be defined on a common interval 0,T , and provide upper and lower bounds for the difference x 1(t) x 2(t) for all t in 0,T that are stronger than the bounds previously described in the literature.


Efficient Training Convolutional Neural Networks on Edge Devices with Gradient pruned Sign symmetric Feedback Alignment. With the prosperity of mobile devices, the distributed learning approach enabling model training with decentralized data has attracted wide research. However, the lack of training capability for edge devices significantly limits the energy efficiency of distributed learning in real life. This paper describes a novel approach of training DNNs exploiting the redundancy and the weight asymmetry potential of conventional backpropagation. We demonstrate that with negligible classification accuracy loss, the proposed approach outperforms the prior arts by 5x in terms of energy efficiency.


Enhancing Loop Invariant Synthesis via Reinforcement Learning. Loop invariant synthesis is the basis of every program verification procedure. Due to its undecidability in general, a tool for invariant synthesis necessarily uses heuristics. Despite the common belief that the design of heuristics is vital for the effective performance of a verifier, little work has been performed toward obtaining the optimal heuristics for each invariant synthesis tool. Instead, developers have hand tuned the heuristics of tools. This study demonstrates that we can effectively and automatically learn a good heuristic via reinforcement learning for an invariant synthesizer PCSat. Our experiment shows that PCSat combined with the heuristic learned by reinforcement learning outperforms the state of the art solvers for this task. To the best of our knowledge, this is the first work that investigates learning the heuristics of an invariant synthesis tool.


Intelligent Reflecting Surfaces for Enhanced NOMA based Visible Light Communications. The emerging intelligent reflecting surface (IRS) technology introduces the potential of controlled light propagation in visible light communication (VLC) systems. This concept opens the door for new applications in which the channel itself can be altered to achieve specific key performance indicators. In this paper, for the first time in the open literature, we investigate the role that IRSs can play in enhancing the link reliability in VLC systems employing non orthogonal multiple access (NOMA). We propose a framework for the joint optimisation of the NOMA and IRS parameters and show that it provides significant enhancements in link reliability. The enhancement is even more pronounced when the VLC channel is subject to blockage and random device orientation.


Fairer Software Made Easier (using "Keys"). Can we simplify explanations for software analytics? Maybe. Recent results show that systems often exhibit a "keys effect" i.e. a few key features control the rest. Just to say the obvious, for systems controlled by a few keys, explanation and control is just a matter of running a handful of "what if" queries across the keys. By exploiting the keys effect, it should be possible to dramatically simplify even complex explanations, such as those required for ethical AI systems.


Fighting the E commerce Giants Efficient Routing and Effective Consolidation for Local Delivery Platforms. Local delivery platforms are collaborative undertakings where local stores offer instant delivery to local customers ordering their products online. Offering such delivery services both cost efficiently and reliably is one of the main challenges for local delivery platforms, as they face a complex, dynamic, stochastic dynamic pickup and delivery problem. Orders need to be consolidated to increase the efficiency of the delivery operations and thereby enable a high service guarantee towards the customer and stores. But, waiting for consolidation opportunities may jeopardize delivery service reliability in the future, and thus requires anticipating future demand. This paper introduces a generic approach to balance the consolidation potential and delivery urgency of orders. Specifically, it presents a newly developed parameterized Cost Function Approximation (CFA) approach that modifies a set packing formulation with two parameters. This CFA approach not only anticipates future demand but also utilizes column generation to search the large decision space related to pickup and delivery problems fast. Inspired by a motivating application in the city of Groningen, the Netherlands, numerical experiments show that our CFA approach strongly increases perceived customer satisfaction while lowering the total travel time of the vehicles compared to various benchmark policies. Furthermore, our CFA also reduces the percentage of late deliveries, and their lateness, to a minimum. Finally, our approach may assist managers in practice to manage the non trivial balance between consolidation opportunity and delivery urgency.


Act Like a Radiologist Towards Reliable Multi view Correspondence Reasoning for Mammogram Mass Detection. Mammogram mass detection is crucial for diagnosing and preventing the breast cancers in clinical practice. The complementary effect of multi view mammogram images provides valuable information about the breast anatomical prior structure and is of great significance in digital mammography interpretation. However, unlike radiologists who can utilize the natural reasoning ability to identify masses based on multiple mammographic views, how to endow the existing object detection models with the capability of multi view reasoning is vital for decision making in clinical diagnosis but remains the boundary to explore. In this paper, we propose an Anatomy aware Graph convolutional Network (AGN), which is tailored for mammogram mass detection and endows existing detection methods with multi view reasoning ability. The proposed AGN consists of three steps. Firstly, we introduce a Bipartite Graph convolutional Network (BGN) to model the intrinsic geometric and semantic relations of ipsilateral views. Secondly, considering that the visual asymmetry of bilateral views is widely adopted in clinical practice to assist the diagnosis of breast lesions, we propose an Inception Graph convolutional Network (IGN) to model the structural similarities of bilateral views. Finally, based on the constructed graphs, the multi view information is propagated through nodes methodically, which equips the features learned from the examined view with multi view reasoning ability. Experiments on two standard benchmarks reveal that AGN significantly exceeds the state of the art performance. Visualization results show that AGN provides interpretable visual cues for clinical diagnosis.


23 mJ high power fiber CPA system using electro optically controlled divided pulse amplification. The pulse energy scaling technique electro optically controlled divided pulse amplification is implemented in a high power ultrafast fiber laser system based on coherent beam combination. A fiber integrated front end and a multi pass cell based back end allow for a small footprint and a modular implementation. Bursts of 8 pulses are amplified parallel in up to 12 ytterbium doped large pitch fiber amplifiers. Subsequent spatio temporal coherent combination of the 96 total amplified pulse replicas to a single pulse results in a pulse energy of 23 mJ at an average power of 674 W, compressible to a pulse duration of 235 fs. To the best of our knowledge, this is the highest pulse energy ever accomplished with a fiber CPA system.


Coarse2Fine Fine grained Text Classification on Coarsely grained Annotated Data. Existing text classification methods mainly focus on a fixed label set, whereas many real world applications require extending to new fine grained classes as the number of samples per label increases. To accommodate such requirements, we introduce a new problem called coarse to fine grained classification, which aims to perform fine grained classification on coarsely annotated data. Instead of asking for new fine grained human annotations, we opt to leverage label surface names as the only human guidance and weave in rich pre trained generative language models into the iterative weak supervision strategy. Specifically, we first propose a label conditioned finetuning formulation to attune these generators for our task. Furthermore, we devise a regularization objective based on the coarse fine label constraints derived from our problem setting, giving us even further improvements over the prior formulation. Our framework uses the fine tuned generative models to sample pseudo training data for training the classifier, and bootstraps on real unlabeled data for model refinement. Extensive experiments and case studies on two real world datasets demonstrate superior performance over SOTA zero shot classification baselines.


Regularity and Continuity properties of the sub Riemannian exponential map. We prove a version of Warner's regularity and continuity properties for the sub Riemannian exponential map. The regularity property is established by considering sub Riemannian Jacobi fields while the continuity property follows from studying the Maslov index of Jacobi curves. We finally show how this implies that the exponential map of the three dimensional Heisenberg group is not injective in any neighbourhood of a conjugate vector.


On universal parity on free two dimensional knots. We prove that the Gaussian parity on free two dimensional knots is universal.


The Pitfall of More Powerful Autoencoders in Lidar Based Navigation. The benefit of pretrained autoencoders for reinforcement learning in comparison to training on raw observations is already known 1 . In this paper, we address the generation of a compact and information rich state representation. In particular, we train a variational autoencoder for 2D lidar scans to use its latent state for reinforcement learning of navigation tasks. To achieve high reconstruction power of our autoencoding pipeline, we propose an in the context of autoencoding 2D lidar scans novel preprocessing into a local binary occupancy image. This has no additional requirements, neither self localization nor robust mapping, and therefore can be applied in any setting and easily transferred from simulation in real world. In a second stage, we show the usage of the compact state representation generated by our autoencoding pipeline in a simplistic navigation task and expose the pitfall that increased reconstruction power will always lead to an improved performance. We implemented our approach in python using tensorflow. Our datasets are simulated with pybullet as well as recorded using a slamtec rplidar A3. The experiments show the significantly improved reconstruction capabilities of our approach for 2D lidar scans w.r.t. the state of the art. However, as we demonstrate in the experiments the impact on reinforcement learning in lidar based navigation tasks is non predictable when improving the latent state representation generated by an autoencoding pipeline. This is surprising and needs to be taken into account during the process of optimizing a pretrained autoencoder for reinforcement learning tasks.


Soft Attention Does it Actually Help to Learn Social Interactions in Pedestrian Trajectory Prediction?. We consider the problem of predicting the future path of a pedestrian using its motion history and the motion history of the surrounding pedestrians, called social information. Since the seminal paper on Social LSTM, deep learning has become the main tool used to model the impact of social interactions on a pedestrian's motion. The demonstration that these models can learn social interactions relies on an ablative study of these models. The models are compared with and without their social interactions module on two standard metrics, the Average Displacement Error and Final Displacement Error. Yet, these complex models were recently outperformed by a simple constant velocity approach. This questions if they actually allow to model social interactions as well as the validity of the proof. In this paper, we focus on the deep learning models with a soft attention mechanism for social interaction modeling and study whether they use social information at prediction time. We conduct two experiments across four state of the art approaches on the ETH and UCY datasets, which were also used in previous work. First, the models are trained by replacing the social information with random noise and compared to model trained with actual social information. Second, we use a gating mechanism along with a L 0 penalty, allowing models to shut down their inner components. The models consistently learn to prune their soft attention mechanism. For both experiments, neither the course of the convergence nor the prediction performance were altered. This demonstrates that the soft attention mechanism and therefore the social information are ignored by the models.


Trends in LEO Satellite Handover Algorithms. In this paper, we review well known handovers algorithms in satellite environment. The modern research trends and contributions are proposed and summarized in order to overcome their considering problems in satellite air ground integrated network environment caused by the fast movement of Low Earth Orbit (LEO) satellite and related frequent handover occurrences.


Multilevel Selective Harmonic Modulation via Optimal Control. We consider the Selective Harmonic Modulation (SHM) problem, consisting in the design of a staircase control signal with some prescribed frequency components. In this work, we propose a novel methodology to address SHM as an optimal control problem in which the admissible controls are piecewise constant functions, taking values only in a given finite set. In order to fulfill this constraint, we introduce a cost functional with piecewise affine penalization for the control, which, by means of Pontryagin's maximum principle, makes the optimal control have the desired staircase form. Moreover, the addition of the penalization term for the control provides uniqueness and continuity of the solution with respect to the target frequencies. Another advantage of our approach is that the number of switching angles and the waveform need not be determined a priori. Indeed, the solution to the optimal control problem is the entire control signal, and therefore, it determines the waveform and the location of the switches. We also provide several numerical examples in which the SHM problem is solved by means of our approach.


Overview of the HASOC track at FIRE 2020 Hate Speech and Offensive Content Identification in Indo European Languages. With the growth of social media, the spread of hate speech is also increasing rapidly. Social media are widely used in many countries. Also Hate Speech is spreading in these countries. This brings a need for multilingual Hate Speech detection algorithms. Much research in this area is dedicated to English at the moment. The HASOC track intends to provide a platform to develop and optimize Hate Speech detection algorithms for Hindi, German and English. The dataset is collected from a Twitter archive and pre classified by a machine learning system. HASOC has two sub task for all three languages task A is a binary classification problem (Hate and Not Offensive) while task B is a fine grained classification problem for three classes (HATE) Hate speech, OFFENSIVE and PROFANITY. Overall, 252 runs were submitted by 40 teams. The performance of the best classification algorithms for task A are F1 measures of 0.51, 0.53 and 0.52 for English, Hindi, and German, respectively. For task B, the best classification algorithms achieved F1 measures of 0.26, 0.33 and 0.29 for English, Hindi, and German, respectively. This article presents the tasks and the data development as well as the results. The best performing algorithms were mainly variants of the transformer architecture BERT. However, also other systems were applied with good success


Accelerating Distributed Memory Autotuning via Statistical Analysis of Execution Paths. The prohibitive expense of automatic performance tuning at scale has largely limited the use of autotuning to libraries for shared memory and GPU architectures. We introduce a framework for approximate autotuning that achieves a desired confidence in each algorithm configuration's performance by constructing confidence intervals to describe the performance of individual kernels (subroutines of benchmarked programs). Once a kernel's performance is deemed sufficiently predictable for a set of inputs, subsequent invocations are avoided and replaced with a predictive model of the execution time. We then leverage online execution path analysis to coordinate selective kernel execution and propagate each kernel's statistical profile. This strategy is effective in the presence of frequently recurring computation and communication kernels, which is characteristic to algorithms in numerical linear algebra. We encapsulate this framework as part of a new profiling tool, Critter, that automates kernel execution decisions and propagates statistical profiles along critical paths of execution. We evaluate performance prediction accuracy obtained by our selective execution methods using state of the art distributed memory implementations of Cholesky and QR factorization on Stampede2, and demonstrate speed ups of up to 7.1x with 98 prediction accuracy.


User oriented Fairness in Recommendation. As a highly data driven application, recommender systems could be affected by data bias, resulting in unfair results for different data groups, which could be a reason that affects the system performance. Therefore, it is important to identify and solve the unfairness issues in recommendation scenarios. In this paper, we address the unfairness problem in recommender systems from the user perspective. We group users into advantaged and disadvantaged groups according to their level of activity, and conduct experiments to show that current recommender systems will behave unfairly between two groups of users. Specifically, the advantaged users (active) who only account for a small proportion in data enjoy much higher recommendation quality than those disadvantaged users (inactive). Such bias can also affect the overall performance since the disadvantaged users are the majority. To solve this problem, we provide a re ranking approach to mitigate this unfairness problem by adding constraints over evaluation metrics. The experiments we conducted on several real world datasets with various recommendation algorithms show that our approach can not only improve group fairness of users in recommender systems, but also achieve better overall recommendation performance.


Breaking the Limits of Message Passing Graph Neural Networks. Since the Message Passing (Graph) Neural Networks (MPNNs) have a linear complexity with respect to the number of nodes when applied to sparse graphs, they have been widely implemented and still raise a lot of interest even though their theoretical expressive power is limited to the first order Weisfeiler Lehman test (1 WL). In this paper, we show that if the graph convolution supports are designed in spectral domain by a non linear custom function of eigenvalues and masked with an arbitrary large receptive field, the MPNN is theoretically more powerful than the 1 WL test and experimentally as powerful as a 3 WL existing models, while remaining spatially localized. Moreover, by designing custom filter functions, outputs can have various frequency components that allow the convolution process to learn different relationships between a given input graph signal and its associated properties. So far, the best 3 WL equivalent graph neural networks have a computational complexity in mathcal O (n 3) with memory usage in mathcal O (n 2) , consider non local update mechanism and do not provide the spectral richness of output profile. The proposed method overcomes all these aforementioned problems and reaches state of the art results in many downstream tasks.


Ensemble deep learning A review. Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning models with multilayer processing architecture is showing better performance as compared to the shallow or traditional classification models. Deep ensemble learning models combine the advantages of both the deep learning models as well as the ensemble learning such that the final model has better generalization performance. This paper reviews the state of art deep ensemble models and hence serves as an extensive summary for the researchers. The ensemble models are broadly categorised into ensemble models like bagging, boosting and stacking, negative correlation based deep ensemble models, explicit implicit ensembles, homogeneous heterogeneous ensemble, decision fusion strategies, unsupervised, semi supervised, reinforcement learning and online incremental, multilabel based deep ensemble models. Application of deep ensemble models in different domains is also briefly discussed. Finally, we conclude this paper with some future recommendations and research directions.


Specifying and Interpreting Reinforcement Learning Policies through Simulatable Machine Learning. Human AI collaborative policy synthesis is a procedure in which (1) a human initializes an autonomous agent's behavior, (2) Reinforcement Learning improves the human specified behavior, and (3) the agent can explain the final optimized policy to the user. This paradigm leverages human expertise and facilitates a greater insight into the learned behaviors of an agent. Existing approaches to enabling collaborative policy specification involve black box methods which are unintelligible and are not catered towards non expert end users. In this paper, we develop a novel collaborative framework to enable humans to initialize and interpret an autonomous agent's behavior, rooted in principles of human centered design. Through our framework, we enable humans to specify an initial behavior model in the form of unstructured, natural language, which we then convert to lexical decision trees. Next, we are able to leverage these human specified policies, to warm start reinforcement learning and further allow the agent to optimize the policies through reinforcement learning. Finally, to close the loop on human specification, we produce explanations of the final learned policy, in multiple modalities, to provide the user a final depiction about the learned policy of the agent. We validate our approach by showing that our model can produce 80 accuracy, and that human initialized policies are able to successfully warm start RL. We then conduct a novel human subjects study quantifying the relative subjective and objective benefits of varying XAI modalities(e.g., Tree, Language, and Program) for explaining learned policies to end users, in terms of usability and interpretability and identify the circumstances that influence these measures. Our findings emphasize the need for personalized explainable systems that can facilitate user centric policy explanations for a variety of end users.


Methodology and Analysis of Smart Contracts in Blockchain Based International Trade Application. Blokchain is used in a variety of applications where trustworthy computing is re quired. Trade finance is one of these areas that would benefit immensely from a decentralized way of doing transactions. This paper presents the preliminary as sessment of Accepire BT, a software platform developed for the practice of col laborative Trade Finance. The proposed solution is enforced by smart contracts using Solidity, the underlying programming language for the Ethereum block chain. We evaluated the performance in the Rinkeby test network by using Remix and MetaMask. The results of the preliminary trial show that smart contracts take less than one minute per cycle. Also, we present a discussion about costs for us ing the public Ethereum Rinkeby network.