A Fair Method for Distributing Collective Assets in the Stellar Blockchain Financial Network. The financial industry is a pioneer in Blockchain technology. One of the most popular platforms in Token based banking is the flexible Stellar platform. This platform is open source, and today, its wide range of features makes it possible for many countries and companies to use it in cryptocurrency and Token based modern banking. This network charges a fee for each transaction. As well, a percentage of the net amount is generated as the inflation rate of the network due to the increased number of tokens. These fees and inflationary amounts are aggregated into a general account and ultimately distributed among members of the network on a collective vote basis. In this mechanism, network users select an account as the destination for which they wish to transfer assets using their user interface, which is generally a wallet. This account could be the account of charities that need this help. It is then determined the target distribution network based on the voting results of all members. One of the challenges in this network is the purposeful and fair distribution of these funds between accounts. In this paper, the first step is a complete infrastructure of a Stellar financial network that will consist of three network based segments of the core network, off chain server, and wallet interface. In the second step, a context aware recommendation system will be explored and implemented as a solution for the purposeful management of payroll account selection. The results of this study concerning the importance of the purposeful division of collective assets and showing a context aware recommendation system as a solution to improve the process of stellar users' participation in the voting process by effectively helping them in choosing an eligible destination


Deep convolutional forest a dynamic deep ensemble approach for spam detection in text. The increase in people's use of mobile messaging services has led to the spread of social engineering attacks like phishing, considering that spam text is one of the main factors in the dissemination of phishing attacks to steal sensitive data such as credit cards and passwords. In addition, rumors and incorrect medical information regarding the COVID 19 pandemic are widely shared on social media leading to people's fear and confusion. Thus, filtering spam content is vital to reduce risks and threats. Previous studies relied on machine learning and deep learning approaches for spam classification, but these approaches have two limitations. Machine learning models require manual feature engineering, whereas deep neural networks require a high computational cost. This paper introduces a dynamic deep ensemble model for spam detection that adjusts its complexity and extracts features automatically. The proposed model utilizes convolutional and pooling layers for feature extraction along with base classifiers such as random forests and extremely randomized trees for classifying texts into spam or legitimate ones. Moreover, the model employs ensemble learning procedures like boosting and bagging. As a result, the model achieved high precision, recall, f1 score and accuracy of 98.38 .


KAMA 3D Keypoint Aware Body Mesh Articulation. We present KAMA, a 3D Keypoint Aware Mesh Articulation approach that allows us to estimate a human body mesh from the positions of 3D body keypoints. To this end, we learn to estimate 3D positions of 26 body keypoints and propose an analytical solution to articulate a parametric body model, SMPL, via a set of straightforward geometric transformations. Since keypoint estimation directly relies on image clues, our approach offers significantly better alignment to image content when compared to state of the art approaches. Our proposed approach does not require any paired mesh annotations and is able to achieve state of the art mesh fittings through 3D keypoint regression only. Results on the challenging 3DPW and Human3.6M demonstrate that our approach yields state of the art body mesh fittings.


Two Chains High Performance Framework for Function Injection and Execution. Some important problems, such as semantic graph analysis, require large scale irregular applications composed of many coordinating tasks that operate on a shared data set so big it has to be stored on many physical devices. In these cases, it may be more efficient to dynamically choose where code runs as the applications progresses. Many programming environments provide task migration or remote function calls, but they have sharp trade offs between flexible composition, portability, performance, and code complexity. We developed Two Chains, a high performance framework inspired by active message communication semantics. We use the GNU Binutils, the ELF binary format, and the RDMA network protocol to provide ultra low granularity distributed function composition at runtime in user space at HPC performance levels using C libraries. Our framework allows the direct injection of function binaries and data to a remote machine cache using the RDMA network. It interoperates seamlessly with existing C libraries using standard dynamic linking and load symbol resolution. We analyze function delivery and execution on cache stashing enabled hardware and show that stashing decreases latency, increases message rates, and improves noise tolerance. This demonstrates one way this method is suited to increasingly network oriented hardware architectures.


Immuno mimetic Deep Neural Networks (Immuno Net). Biomimetics has played a key role in the evolution of artificial neural networks. Thus far, in silico metaphors have been dominated by concepts from neuroscience and cognitive psychology. In this paper we introduce a different type of biomimetic model, one that borrows concepts from the immune system, for designing robust deep neural networks. This immuno mimetic model leads to a new computational biology framework for robustification of deep neural networks against adversarial attacks. Within this Immuno Net framework we define a robust adaptive immune inspired learning system (Immuno Net RAILS) that emulates, in silico, the adaptive biological mechanisms of B cells that are used to defend a mammalian host against pathogenic attacks. When applied to image classification tasks on benchmark datasets, we demonstrate that Immuno net RAILS results in improvement of as much as 12.5 in adversarial accuracy of a baseline method, the DkNN robustified CNN, without appreciable loss of accuracy on clean data.


S n ideals of Commutative Rings. Let R be a commutative ring with identity and S a multiplicatively closed subset of R . This paper aims to introduce the concept of S n ideals as a generalization of n ideals. An ideal I of R disjoint with S is called an S n ideal if there exists s in S such that whenever ab in I for a,b in R , then sa in sqrt 0 or sb in I . The relationship among S n ideals, n ideals, S prime and S primary ideals are clarified. Several properties, characterizations and examples are presented such as investigating S n ideals under various contexts of constructions including direct products, localizations and homomorphic images. Furthermore, for m in TCIMACRO U 2115 BeginExpansion mathbb N EndExpansion and some particular S , all S n ideals of the ring TCIMACRO U 2124 BeginExpansion mathbb Z EndExpansion m are completely determined. The last section is devoted for studying the S n ideals of the idealization ring and amalgamated algebra.


Intra instrument channel workable, optical resolution photoacoustic and ultrasonic mini probe system for clinical gastrointestinal endoscopy. There has been a longstanding expectation that the optical resolution embodiment of photoacoustic tomography could have a substantial impact on gastrointestinal endoscopy by enabling microscopic visualization of the vasculature based on the endogenous contrast mechanism. Although multiple studies have demonstrated the in vivo imaging capability of a developed imaging device over the last decade, the implementation of such an endoscopic system that can be applied immediately when necessary via the instrument channel of a video endoscope has been a challenge. In this study, we developed a 3.38 mm diameter catheter based, integrated optical resolution photoacoustic and ultrasonic miniprobe system and successfully demonstrated its intrainstrument channel workability for the standard 3.7 mm diameter instrument channel of a clinical video endoscope based on a swine model. Through the instrument channel, we acquired the first in vivo photoacoustic and ultrasonic dual mode endoscopic images from the esophagogastric junction, which is one of the most frequently cited anatomical sites in the gastrointestinal tract in relation to Barretts esophagus. Moreover, from a rat colorectum in vivo imaging experiment, we visualized hierarchically developed mesh like capillary networks with a hole size as small as 50 microns, which suggests the potential level of image details that could be photoacoustically provided in clinical settings in the future.


An Efficient Branch and Bound Solver for Hitting Set. The hitting set problem asks for a collection of sets over a universe U to find a minimum subset of U that intersects each of the given sets. It is NP hard and equivalent to the problem set cover. We give a branch and bound algorithm to solve hitting set. Though it requires exponential time in the worst case, it can solve many practical instances from different domains in reasonable time. Our algorithm outperforms a modern ILP solver, the state of the art for hitting set, by at least an order of magnitude on most instances.


Reeb flows transverse to foliations. Let mathcal F be a co oriented C 2 foliation on a closed, oriented 3 manifold. We show that T mathcal F can be perturbed to a contact structure with Reeb flow transverse to mathcal F if and only if mathcal F does not support an invariant transverse measure. The resulting Reeb flow has no contractible orbits. This answers a question of Colin and Honda. The main technical tool in our proof is leafwise Brownian motion which we use to construct good transverse measures for mathcal F this gives a new perspective on the Eliashberg Thurston theorem.


Exploring Modality shared Appearance Features and Modality invariant Relation Features for Cross modality Person Re Identification. Most existing cross modality person re identification works rely on discriminative modality shared features for reducing cross modality variations and intra modality variations. Despite some initial success, such modality shared appearance features cannot capture enough modality invariant discriminative information due to a massive discrepancy between RGB and infrared images. To address this issue, on the top of appearance features, we further capture the modality invariant relations among different person parts (referred to as modality invariant relation features), which are the complement to those modality shared appearance features and help to identify persons with similar appearances but different body shapes. To this end, a Multi level Two streamed Modality shared Feature Extraction (MTMFE) sub network is designed, where the modality shared appearance features and modality invariant relation features are first extracted in a shared 2D feature space and a shared 3D feature space, respectively. The two features are then fused into the final modality shared features such that both cross modality variations and intra modality variations can be reduced. Besides, a novel cross modality quadruplet loss is proposed to further reduce the cross modality variations. Experimental results on several benchmark datasets demonstrate that our proposed method exceeds state of the art algorithms by a noticeable margin.


Non divisible point on a two parameter family of elliptic curves. Let n be a positive integer and t a non zero integer. We consider the elliptic curve over Q given by E y 2 x 3 tx 2 n 2 (t 3n 2)x n 6. It is a special case of an elliptic surface studied recently by Bettin, David and Delaunay 2 and it generalizes Washington's family. The point (0, n 3) belongs to E(Q) and we obtain some results about its nondivisibility in E(Q). Our work extends to this two parameter family of elliptic curves a previous study of Duquesne (mainly stated for n 1 and t 0).


Node Connectivity Augmentation via Iterative Randomized Rounding. Many network design problems deal with the design of low cost networks that are resilient to the failure of their elements, such as nodes or links. One such problem is Connectivity Augmentation, where the goal is to cheaply increase the connectivity of a network from a value k to k 1. The most studied setting focuses on edge connectivity, which reduces to k 2, called Cactus Augmentation. From an approximation perspective, Byrka, Grandoni, and Jabal Ameli (2020) were the first to break the 2 approximation barrier for this problem, by exploiting a connection to the Steiner Tree problem, and by tailoring the analysis of the iterative randomized rounding technique for Steiner Tree to the specific instances arising from this connection. Recently, Nutov (2020) observed that a similar reduction to Steiner Tree holds for a node connectivity problem called Block Tree Augmentation, where the goal is to add edges to a given spanning tree so that the resulting graph 2 node connected. Combining Nutov's result with the algorithm of Byrka, Grandoni, and Jabal Ameli yields a 1.91 approximation for Block Tree Augmentation, that is the best bound known so far. In this work, we give a 1.892 approximation algorithm for the problem of augmenting the node connectivity of any graph from 1 to 2. As a corollary, we improve upon the state of the art approximation factor for Block Tree Augmentation. Our result is obtained by developing a different and simpler analysis of the iterative randomized rounding technique. Our results also imply a 1.892 approximation algorithm for Cactus Augmentation. While this does not beat the best approximation by Cecchetto, Traub, and Zenklusen (2021) known for this problem, our analysis is quite simple compared to previous results in the literature. In addition, our work gives new insights on the iterative randomized rounding method, that might be of independent interest.


Reflectionless wave propagation on shallow water with variable bathymetry and current. In the linear approximation, we study a one dimensional problem of the reflectionless wave propagation on a surface of a shallow duct with the spatially varying water depth, duct width, and current. We show that both global and bounded exact solutions describing reflectionless propagation in opposite directions of long waves of arbitrary shape exist for the particular variations of these parameters. A general analysis of the problem is illustrated by a few solutions constructed for the specific cases of spatial profiles of the flow velocity. The results obtained can be of interest to mitigate the possible impact of waves on ships, marine engineering constructions, and human activity in the coastal zones.


Conditional Generative Adversarial Networks for Speed Control in Trajectory Simulation. Motion behaviour is driven by several factors goals, presence and actions of neighbouring agents, social relations, physical and social norms, the environment with its variable characteristics, and further. Most factors are not directly observable and must be modelled from context. Trajectory prediction, is thus a hard problem, and has seen increasing attention from researchers in the recent years. Prediction of motion, in application, must be realistic, diverse and controllable. In spite of increasing focus on multimodal trajectory generation, most methods still lack means for explicitly controlling different modes of the data generation. Further, most endeavours invest heavily in designing special mechanisms to learn the interactions in latent space. We present Conditional Speed GAN (CSG), that allows controlled generation of diverse and socially acceptable trajectories, based on user controlled speed. During prediction, CSG forecasts future speed from latent space and conditions its generation based on it. CSG is comparable to state of the art GAN methods in terms of the benchmark distance metrics, while being simple and useful for simulation and data augmentation for different contexts such as fast or slow paced environments. Additionally, we compare the effect of different aggregation mechanisms and show that a naive approach of concatenation works comparable to its attention and pooling alternatives.


Compatibility of the Fargues Scholze and Gan Takeda Local Langlands. Given a prime p , a finite extension L mathbb Q p , a connected p adic reductive group G L , and a smooth irreducible representation pi of G(L) , Fargues Scholze recently attached a semisimple Weil parameter to such pi , giving a general candidate for the local Langlands correspondence. It is natural to ask whether this construction is compatible with known instances of the correspondence after semisimplification. For G GL n and its inner forms, Fargues Scholze and Hansen Kaletha Weinstein show that the correspondence is compatible with the correspondence of Harris Taylor Henniart. We verify a similar compatibility for G GSp 4 and its unique non split inner form G GU 2 (D) , where D is the quaternion division algebra over L , assuming that L mathbb Q p is unramified and p 2 . In this case, the local Langlands correspondence has been constructed by Gan Takeda and Gan Tantono. Analogous to the case of GL n and its inner forms, this compatibility is proven by describing the Weil group action on the cohomology of a local Shimura variety associated to GSp 4 , using basic uniformization of abelian type Shimura varieties due to Shen, combined with various global results of Kret Shin and Sorensen on Galois representations in the cohomology of global Shimura varieties associated to inner forms of GSp 4 over a totally real field. After showing the parameters are the same, we apply some ideas from the geometry of the Fargues Scholze construction explored recently by Hansen, to give a more precise description of the cohomology of this local Shimura variety, verifying a strong form of the Kottwitz conjecture in the process.


Chord index for knots in thickened surfaces. In this note, we construct a chord index homomorphism from a subgroup of H 1( Sigma, mathbb Z ) to the group of chord indices of a knot K in Sigma times I . Some knot invariants derived from this homomorphism are discussed.


A Deep Graph Reinforcement Learning Model for Improving User Experience in Live Video Streaming. In this paper we present a deep graph reinforcement learning model to predict and improve the user experience during a live video streaming event, orchestrated by an agent tracker. We first formulate the user experience prediction problem as a classification task, accounting for the fact that most of the viewers at the beginning of an event have poor quality of experience due to low bandwidth connections and limited interactions with the tracker. In our model we consider different factors that influence the quality of user experience and train the proposed model on diverse state action transitions when viewers interact with the tracker. In addition, provided that past events have various user experience characteristics we follow a gradient boosting strategy to compute a global model that learns from different events. Our experiments with three real world datasets of live video streaming events demonstrate the superiority of the proposed model against several baseline strategies. Moreover, as the majority of the viewers at the beginning of an event has poor experience, we show that our model can significantly increase the number of viewers with high quality experience by at least 75 over the first streaming minutes. Our evaluation datasets and implementation are publicly available at https publicresearch.z13.web.core.windows.net


Towards an Open Format for Scalable System Telemetry. A data representation for system behavior telemetry for scalable big data security analytics is presented, affording telemetry consumers comprehensive visibility into workloads at reduced storage and processing overheads. The new abstraction, SysFlow, is a compact open data format that lifts the representation of system activities into a flow centric, object relational mapping that records how applications interact with their environment, relating processes to file accesses, network activities, and runtime information. The telemetry format supports single event and volumetric flow representations of process control flows, file interactions, and network communications. Evaluation on enterprise grade benchmarks shows that SysFlow facilitates deeper introspection into attack kill chains while yielding traces orders of magnitude smaller than current state of the art system telemetry approaches drastically reducing storage requirements and enabling feature filled system analytics, process level provenance tracking, and long term data archival for cyber threat discovery and forensic analysis on historical data.


Scalar Adjective Identification and Multilingual Ranking. The intensity relationship that holds between scalar adjectives (e.g., nice great wonderful) is highly relevant for natural language inference and common sense reasoning. Previous research on scalar adjective ranking has focused on English, mainly due to the availability of datasets for evaluation. We introduce a new multilingual dataset in order to promote research on scalar adjectives in new languages. We perform a series of experiments and set performance baselines on this dataset, using monolingual and multilingual contextual language models. Additionally, we introduce a new binary classification task for English scalar adjective identification which examines the models' ability to distinguish scalar from relational adjectives. We probe contextualised representations and report baseline results for future comparison on this task.


CPPE 5 Medical Personal Protective Equipment Dataset. We present a new challenging dataset, CPPE 5 (Medical Personal Protective Equipment), with the goal to allow the study of subordinate categorization of medical personal protective equipments, which is not possible with other popular data sets that focus on broad level categories (such as PASCAL VOC, ImageNet, Microsoft COCO, OpenImages, etc). To make it easy for models trained on this dataset to be used in practical scenarios in complex scenes, our dataset mainly contains images that show complex scenes with several objects in each scene in their natural context. The image collection for this dataset focusing on obtaining as many non iconic images as possible and making sure all the images are real life images unlike other existing datasets in this area. Our dataset includes 5 object categories (coveralls, face shield, gloves, mask, and goggles) and each image is annotated with a set of bounding boxes and positive labels. We present a detailed analysis of the dataset in comparison to other popular broad category datasets as well as datasets focusing on personal protective equipments, we also find that at present there exist no such publicly available datasets. Finally we also analyze performance and compare model complexities on baseline and state of the art models for bounding box results. Our code, data, and trained models are available at https git.io cppe5 dataset .


A high order discontinuous Galerkin in time discretization for second order hyperbolic equations. The aim of this paper is to apply a high order discontinuous in time scheme to second order hyperbolic partial differential equations (PDEs). We first discretize the PDEs in time while keeping the spatial differential operators undiscretized. The well posedness of this semi discrete scheme is analyzed and a priori error estimates are derived in the energy norm. We then combine this hp version discontinuous Galerkin method for temporal discretization with an H 1 conforming finite element approximation for the spatial variables to construct a fully discrete scheme. A prior error estimates are derived both in the energy norm and the L 2 norm. Numerical experiments are presented to verify the theoretical results.


Normality of the Thue Morse function for finite fields along polynomial values. Let mathbb F q be the finite field of q elements, where q p r is a power of the prime p , and left( beta 1, beta 2, dots, beta r right) be an ordered basis of mathbb F q over mathbb F p . For xi sum i 1 rx i beta i, quad quad x i in mathbb F p, we define the Thue Morse or sum of digits function T( xi) on mathbb F q by T( xi) sum i 1 r x i. , quad xi x 1 beta 1 cdots x r beta r in mathbb F q. For a given pattern length s with 1 le s le q , a subset cal A alpha 1, ldots, alpha s subset mathbb F q , a polynomial f(X) in mathbb F q X of degree d and a vector underline c (c 1, ldots,c s) in mathbb F p s we put cal T ( underline c , cal A ,f) xi in mathbb F q T(f( xi alpha i)) c i, i 1, ldots,s . In this paper we will see that under some natural conditions, the size of cal T ( underline c , cal A ,f) is asymptotically the same for all underline c and cal A in both cases, p rightarrow infty and r rightarrow infty , respectively. More precisely, we have left cal T ( underline c , cal A ,f) p r s right le (d 1)q 1 2 under certain conditions on d,q and s . For monomials of large degree we improve this bound as well as we find conditions on d,q and s for which this bound is not true. In particular, if 1 le d p we have the dichotomy that the bound is valid if s le d and fails for some underline c and cal A if s ge d 1 . The case s 1 was studied before by Dartyge and S 'ark "ozy.


About integral product formula for Jack polynomials of two variables. We present an integral product formula for Jack polynomials of two variables, extending that of zonal polynomials. It provides another way to find the explicit integral representation for the generalized Bessel function of type B 2 , as presented in cite D .


Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing. Recent years pretrained language models (PLMs) hit a success on several downstream tasks, showing their power on modeling language. To better understand and leverage what PLMs have learned, several techniques have emerged to explore syntactic structures entailed by PLMs. However, few efforts have been made to explore grounding capabilities of PLMs, which are also essential. In this paper, we highlight the ability of PLMs to discover which token should be grounded to which concept, if combined with our proposed erasing then awakening approach. Empirical studies on four datasets demonstrate that our approach can awaken latent grounding which is understandable to human experts, even if it is not exposed to such labels during training. More importantly, our approach shows great potential to benefit downstream semantic parsing models. Taking text to SQL as a case study, we successfully couple our approach with two off the shelf parsers, obtaining an absolute improvement of up to 9.8 .


Evaluation of the Penetration Process of Fluorescent Collagenase Nanocapsules in a 3D Collagen Gel. One of the major limitations of nanomedicine is the scarce penetration of nanoparticles in tumoral tissues. These constrains have been tried to be solved by different strategies, such as the employ of polyethyleneglycol (PEG) to avoid the opsonization or reducing the extracellular matrix (ECM) density. Our research group has developed some strategies to overcome these limitations such as the employ of pH sensitive collagenase nanocapsules for the digestion of the collagen rich extracellular matrix present in most of tumoral tissues. However, a deeper understanding of physicochemical kinetics involved in the nanocapsules degradation process is needed to understand the nanocapsule framework degradation process produced during the penetration in the tissue. For this, in this work it has been employed a double fluorescent labelling strategy of the polymeric enzyme nanocapsule as a crucial chemical tool which allowed the analysis of nanocapsules and free collagenase during the diffusion process throughout a tumour like collagen matrix. This extrinsic label strategy provides far greater advantages for observing biological processes. For the detection of enzyme, collagenase has been labelled with fluorescein Isothiocyanate (FITC), whereas the nanocapsule surface was labelled with rhodamine Isothiocyanate (RITC). Thus, it has been possible to monitor the hydrolysis of nanocapsules and their diffusion throughout a thick 3D Collagen gel during the time, obtaining a detailed temporal evaluation of the pH sensitive collagenase nanocapsule behaviour. These collagenase nanocapsules displayed a high enzymatic activity in low concentrations at acidic pH, and their efficiency to penetrate into tissue models pave the way to a wide range of possible nanomedical applications, especially in cancer therapy.


Safe Transformative AI via a Windfall Clause. Society could soon see transformative artificial intelligence (TAI). Models of competition for TAI show firms face strong competitive pressure to deploy TAI systems before they are safe. This paper explores a proposed solution to this problem, a Windfall Clause, where developers commit to donating a significant portion of any eventual extremely large profits to good causes. However, a key challenge for a Windfall Clause is that firms must have reason to join one. Firms must also believe these commitments are credible. We extend a model of TAI competition with a Windfall Clause to show how firms and policymakers can design a Windfall Clause which overcomes these challenges. Encouragingly, firms benefit from joining a Windfall Clause under a wide range of scenarios. We also find that firms join the Windfall Clause more often when the competition is more dangerous. Even when firms learn each other's capabilities, firms rarely wish to withdraw their support for the Windfall Clause. These three findings strengthen the case for using a Windfall Clause to promote the safe development of TAI.


Gradient Masked Federated Optimization. Federated Averaging (FedAVG) has become the most popular federated learning algorithm due to its simplicity and low communication overhead. We use simple examples to show that FedAVG has the tendency to sew together the optima across the participating clients. These sewed optima exhibit poor generalization when used on a new client with new data distribution. Inspired by the invariance principles in (Arjovsky et al., 2019 Parascandolo et al., 2020), we focus on learning a model that is locally optimal across the different clients simultaneously. We propose a modification to FedAVG algorithm to include masked gradients (AND mask from (Parascandolo et al., 2020)) across the clients and uses them to carry out an additional server model update. We show that this algorithm achieves better accuracy (out of distribution) than FedAVG, especially when the data is non identically distributed across clients.


Online Learning in Adversarial MDPs Is the Communicating Case Harder than Ergodic?. We study online learning in adversarial communicating Markov Decision Processes with full information. We give an algorithm that achieves a regret of O( sqrt T ) with respect to the best fixed deterministic policy in hindsight when the transitions are deterministic. We also prove a regret lower bound in this setting which is tight up to polynomial factors in the MDP parameters. We also give an inefficient algorithm that achieves O( sqrt T ) regret in communicating MDPs (with an additional mild restriction on the transition dynamics).


Some recent advances in topological Hochschild homology. We give an account of the construction of the Bhatt Morrow Scholze motivic filtration on topological cyclic homology and related invariants, focusing on the case of equal characteristic p and the connections to crystalline and de Rham Witt theory.


Freudian and Newtonian Recurrent Cell for Sequential Recommendation. A sequential recommender system aims to recommend attractive items to users based on behaviour patterns. The predominant sequential recommendation models are based on natural language processing models, such as the gated recurrent unit, that embed items in some defined space and grasp the user's long term and short term preferences based on the item embeddings. However, these approaches lack fundamental insight into how such models are related to the user's inherent decision making process. To provide this insight, we propose a novel recurrent cell, namely FaNC, from Freudian and Newtonian perspectives. FaNC divides the user's state into conscious and unconscious states, and the user's decision process is modelled by Freud's two principles the pleasure principle and reality principle. To model the pleasure principle, i.e., free floating user's instinct, we place the user's unconscious state and item embeddings in the same latent space and subject them to Newton's law of gravitation. Moreover, to recommend items to users, we model the reality principle, i.e., balancing the conscious and unconscious states, via a gating function. Based on extensive experiments on various benchmark datasets, this paper provides insight into the characteristics of the proposed model. FaNC initiates a new direction of sequential recommendations at the convergence of psychoanalysis and recommender systems.


On the Size and Width of the Decoder of a Boolean Threshold Autoencoder. In this paper, we study the size and width of autoencoders consisting of Boolean threshold functions, where an autoencoder is a layered neural network whose structure can be viewed as consisting of an encoder, which compresses an input vector to a lower dimensional vector, and a decoder which transforms the low dimensional vector back to the original input vector exactly (or approximately). We focus on the decoder part, and show that Omega( sqrt Dn d ) and O( sqrt Dn ) nodes are required to transform n vectors in d dimensional binary space to D dimensional binary space. We also show that the width can be reduced if we allow small errors, where the error is defined as the average of the Hamming distance between each vector input to the encoder part and the resulting vector output by the decoder.


BGG category mathcal O and mathbb Z graded representation theory. We give an introduction to the mathbb Z graded representation theory of the BGG category mathcal O of a complex semisimple Lie algebras, with an emphasis on Soergel's combinatorial mathbb V functor, definitions of mathbb Z graded duality functors and definitions of mathbb Z graded translation functors.


Effects of Coulomb Coupling On Friction In Strongly Magnetized Plasmas. The friction force on a test particle traveling through a plasma that is both strongly coupled and strongly magnetized is studied using molecular dynamics simulations. In addition to the usual stopping power component aligned antiparallel to the velocity, a transverse component that is perpendicular to both the velocity and Lorentz force is observed. This component, which was recently discovered in weakly coupled plasmas, is found to increase in both absolute and relative magnitude in the strongly coupled regime. Strong coupling is also observed to induce a third component of the friction force in the direction of the Lorentz force. These first principles simulations reveal novel physics associated with collisions in strongly coupled, strongly magnetized, plasmas that are not predicted by existing kinetic theories. The effect is expected to influence macroscopic transport in a number of laboratory experiments and astrophysical plasmas.


On the Impact of Random Seeds on the Fairness of Clinical Classifiers. Recent work has shown that fine tuning large networks is surprisingly sensitive to changes in random seed(s). We explore the implications of this phenomenon for model fairness across demographic groups in clinical prediction tasks over electronic health records (EHR) in MIMIC III the standard dataset in clinical NLP research. Apparent subgroup performance varies substantially for seeds that yield similar overall performance, although there is no evidence of a trade off between overall and subgroup performance. However, we also find that the small sample sizes inherent to looking at intersections of minority groups and somewhat rare conditions limit our ability to accurately estimate disparities. Further, we find that jointly optimizing for high overall performance and low disparities does not yield statistically significant improvements. Our results suggest that fairness work using MIMIC III should carefully account for variations in apparent differences that may arise from stochasticity and small sample sizes.


A Multi View Framework for BGP Anomaly Detection via Graph Attention Network. As the default protocol for exchanging routing reachability information on the Internet, the abnormal behavior in traffic of Border Gateway Protocols (BGP) is closely related to Internet anomaly events. The BGP anomalous detection model ensures stable routing services on the Internet through its real time monitoring and alerting capabilities. Previous studies either focused on the feature selection problem or the memory characteristic in data, while ignoring the relationship between features and the precise time correlation in feature (whether it's long or short term dependence). In this paper, we propose a multi view model for capturing anomalous behaviors from BGP update traffic, in which Seasonal and Trend decomposition using Loess (STL) method is used to reduce the noise in the original time series data, and Graph Attention Network (GAT) is used to discover feature relationships and time correlations in feature, respectively. Our results outperform the state of the art methods at the anomaly detection task, with the average F1 score up to 96.3 and 93.2 on the balanced and imbalanced datasets respectively. Meanwhile, our model can be extended to classify multiple anomalous and to detect unknown events.


Multifunctional high frequency circuit capabilities of ambipolar carbon nanotube FETs. An experimentally calibrated carbon nanotube compact transistor model has been used here to design two high frequency (HF) circuits with two different functionalities each a phase configurable amplifier (PCA) and a frequency configurable amplifier (FCA). The former design involves an in phase amplifier and an inverting amplifier while the latter design embraces a frequency doubler as well as a distinct inverting amplifier. The specific functionality selection of each of the two HF circuit designs is enabled mainly by the inherent ambipolar feature at a device level. Furthermore, at a circuit level the matching networks are the same regardless the operation mode. In phase and inverting amplification are enabled in the PCA by switching the gate to source voltage (VGS) from 0.3 V to 0.9 V while the drain to source voltage (VDS) remains at 3 V. By designing carefully the matching and stability networks, power gains of 4.5 dB and 6.7 dB at 2.4 GHz for the in phase and inverting operation mode have been achieved, respectively. The FCA, in its frequency doubler operation mode, exhibits 20 dBc of fundamental harmonic suppression at 2.4 GHz when an input signal at 1.2 GHz is considered. This frequency doubler functionality is enabled at VGS 0.3 V, whereas at VGS 0.9 V amplification of 4.5 dB is obtained while VDS remains at 3 V in both cases. In both configurable circuits the stabilization and matching networks are the same regardless the bias chosen operation mode. The circuits performance degradation due to metallic tubes in the device channel is studied as well as the impact of non ideal inductors in each design. PCA and FCA operation modes are further exploited in high frequency modulators.


LUNAR Unifying Local Outlier Detection Methods via Graph Neural Networks. Many well established anomaly detection methods use the distance of a sample to those in its local neighbourhood so called local outlier methods', such as LOF and DBSCAN. They are popular for their simple principles and strong performance on unstructured, feature based data that is commonplace in many practical applications. However, they cannot learn to adapt for a particular set of data due to their lack of trainable parameters. In this paper, we begin by unifying local outlier methods by showing that they are particular cases of the more general message passing framework used in graph neural networks. This allows us to introduce learnability into local outlier methods, in the form of a neural network, for greater flexibility and expressivity specifically, we propose LUNAR, a novel, graph neural network based anomaly detection method. LUNAR learns to use information from the nearest neighbours of each node in a trainable way to find anomalies. We show that our method performs significantly better than existing local outlier methods, as well as state of the art deep baselines. We also show that the performance of our method is much more robust to different settings of the local neighbourhood size.


Ion acoustic shock waves in magnetized pair ion plasma. A theoretical investigation associated with obliquely propagating ion acoustic shock waves (IASHWs) in a three component magnetized plasma having inertialess non extensive electrons, inertial warm positive and negative ions has been performed. A Burgers equation is derived by employing the reductive perturbation method. Our plasma model supports both positive and negative shock structures under the consideration of non extensive electrons. It is found that the positive and negative shock wave potentials increase with the oblique angle ( delta ) which arises due to the external magnetic field. It is also observed that the magnitude of the amplitude of positive and negative shock waves is not effected by the variation of the ion kinematic viscosity but the steepness of the positive and negative shock waves decreases with ion kinematic viscosity. The implications of our findings in space and laboratory plasmas are briefly discussed.


Tracking Hand Hygiene Gestures with Leap Motion Controller. The process of hand washing, according to the WHO, is divided into stages with clearly defined two handed dynamic gestures. In this paper, videos of hand washing experts are segmented and analyzed with the goal of extracting their corresponding features. These features can be further processed in software to classify particular hand movements, determine whether the stages have been successfully completed by the user and also assess the quality of washing. Having identified the important features, a 3D gesture tracker, the Leap Motion Controller (LEAP), was used to track and detect the hand features associated with these stages. With the help of sequential programming and threshold values, the hand features were combined together to detect the initiation and completion of a sample WHO Stage 2 (Rub hands Palm to Palm). The LEAP provides accurate raw positional data for tracking single hand gestures and two hands in separation but suffers from occlusion when hands are in contact. Other than hand hygiene the approaches shown here can be applied in other biomedical applications requiring close hand gesture analysis.


Developing a New Tool to Implement Computer Supported Active Learning Strategies in the Engineering Classroom. Successful implementation of active learning strategies in the engineering classroom and in particular in certain subjects which are highly technological in nature such as, for instance, rocket engines and space propulsion means overcoming certain challenges that arise from the fact that these are extremely complex systems to analyze. In this paper, we address the specific means to overcome one of such challenges the lack of readily available software tools that are suitable for implementing this sort of teaching strategies within the engineering training. In particular, we develop a new tool for the modeling and simulation of liquid propellant rocket engines specially tailored for the classroom, taking a systematic approach to the development of such tool based on the needs of modern teaching practices. After a thorough review of the available literature on the topic, the few most critical features that our tool should have in order to serve its purported goal are identified. Subsequently, a pilot experience to assess the impact of the usage of said tool on the learners' performance was carried out, showcasing excellent results, both in terms of the students' perceived quality of their training as well as in terms of their grade of retention and understanding of the matter. The conclusions of this study, especially the guidelines for the development of software tools aimed at the classroom, nevertheless, should be applicable to any other highly technological discipline, extending the scope of this paper beyond merely the subject of rocket science in engineering.


An Abstract Factorization Theorem and Some Applications. We combine the language of monoids with the language of preorders so as to refine some fundamental aspects of the classical theory of factorization and prove an abstract factorization theorem with a variety of applications. In particular, we obtain a generalization, from cancellative to Dedekind finite (commutative or non commutative) monoids, of a classical theorem on "atomic factorizations" that traces back to the work of P.M. Cohn in the 1960s recover a theorem of D.D. Anderson and S. Valdes Leon on "irreducible factorizations" in commutative rings improve on a theorem of A.A. Antoniou and the author that characterizes atomicity in certain "monoids of sets" naturally arising from additive number theory and arithmetic combinatorics and give a monoid theoretic proof that every module of finite uniform dimension over a (commutative or non commutative) ring R is a direct sum of finitely many indecomposable modules (this is in fact a special case of a more general decomposition theorem for the objects of certain categories with finite products, where the indecomposable R modules are characterized as the atoms of a suitable "monoid of modules").


Dynamic Fusion Network for RGBT Tracking. For both visible and infrared images have their own advantages and disadvantages, RGBT tracking has attracted more and more attention. The key points of RGBT tracking lie in feature extraction and feature fusion of visible and infrared images. Current RGBT tracking methods mostly pay attention to both individual features (features extracted from images of a single camera) and common features (features extracted and fused from an RGB camera and a thermal camera), while pay less attention to the different and dynamic contributions of individual features and common features for different sequences of registered image pairs. This paper proposes a novel RGBT tracking method, called Dynamic Fusion Network (DFNet), which adopts a two stream structure, in which two non shared convolution kernels are employed in each layer to extract individual features. Besides, DFNet has shared convolution kernels for each layer to extract common features. Non shared convolution kernels and shared convolution kernels are adaptively weighted and summed according to different image pairs, so that DFNet can deal with different contributions for different sequences. DFNet has a fast speed, which is 28.658 FPS. The experimental results show that when DFNet only increases the Mult Adds of 0.02 than the non shared convolution kernel based fusion method, Precision Rate (PR) and Success Rate (SR) reach 88.1 and 71.9 respectively.


Trident Pyramid Networks The importance of processing at the feature pyramid level for better object detection. Feature pyramids have become ubiquitous in multi scale computer vision tasks such as object detection. Based on their importance, we divide a computer vision network into three parts a backbone (generating a feature pyramid), a core (refining the feature pyramid) and a head (generating the final output). Most existing networks operating on feature pyramids, named cores, are shallow and mostly focus on communication based processing in the form of top down and bottom up operations. We present a new core architecture called Trident Pyramid Network (TPN), that allows for a deeper design and for a better balance between communication based processing and self processing. We show consistent improvements when using our TPN core on the COCO object detection benchmark, outperforming the popular BiFPN baseline by 0.5 AP. Additionally, we empirically show that it is more beneficial to put additional computation into the TPN core, rather than into the backbone, by outperforming a ResNet 101 FPN baseline with our ResNet 50 TPN network by 1.7 AP, while operating under similar computation budgets. This emphasizes the importance of performing computation at the feature pyramid level in modern day object detection systems. Code will be released.


GLiDE Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model. Model free reinforcement learning (RL) for legged locomotion commonly relies on a physics simulator that can accurately predict the behaviors of every degree of freedom of the robot. In contrast, approximate reduced order models are commonly used for many model predictive control strategies. In this work we abandon the conventional use of high fidelity dynamics models in RL and we instead seek to understand what can be achieved when using RL with a much simpler centroidal model when applied to quadrupedal locomotion. We show that RL based control of the accelerations of a centroidal model is surprisingly effective, when combined with a quadratic program to realize the commanded actions via ground contact forces. It allows for a simple reward structure, reduced computational costs, and robust sim to real transfer. We show the generality of the method by demonstrating flat terrain gaits, stepping stone locomotion, two legged in place balance, balance beam locomotion, and direct sim to real transfer.


Recursive Contour Saliency Blending Network for Accurate Salient Object Detection. Contour information plays a vital role in salient object detection. However, excessive false positives remain in predictions from existing contour based models due to insufficient contour saliency fusion. In this work, we designed a network for better edge quality in salient object detection. We proposed a contour saliency blending module to exchange information between contour and saliency. We adopted recursive CNN to increase contour saliency fusion while keeping the total trainable parameters the same. Furthermore, we designed a stage wise feature extraction module to help the model pick up the most helpful features from previous intermediate saliency predictions. Besides, we proposed two new loss functions, namely Dual Confinement Loss and Confidence Loss, for our model to generate better boundary predictions. Evaluation results on five common benchmark datasets reveal that our model achieves competitive state of the art performance.


On morphisms between connected commutative algebraic groups. Let K be a field of characteristic 0 and let G and H be connected commutative algebraic groups over K . Let mathrm Mor 0(G,H) denote the set of morphisms of algebraic varieties G to H that map the neutral element to the neutral element. We construct a natural retraction from mathrm Mor 0(G,H) to mathrm Hom (G,H) (for arbitrary G and H ) which commutes with the composition and addition of morphisms. In particular, if G and H are isomorphic as algebraic varieties, then they are isomorphic as algebraic groups. If G has no non trivial unipotent group as a direct factor, we give an explicit description of the sets of all morphisms and isomorphisms of algebraic varieties between G and H .


Intelligent Reflecting Surface Assisted Terahertz Communications toward 6G. Terahertz (THz) communications have emerged as a promising candidate to support the heavy data traffic and exploding network capacity in the future 6G wireless networks. However, THz communications are facing many challenges for practical implementation, such as propagation loss, signal blockage, and hardware cost. In this article, an emerging paradigm of intelligent reflecting surface (IRS) assisted THz communications is analyzed, to address the above issues, by leveraging the joint active and passive beamforming to enhance the communication quality and reduce overheads. Aiming at practical implementation, an overview of the currently available approaches of realizing THz active passive beam steering at transmitter and IRS is presented. Based on these approaches, a beam training strategy for establishing joint beamforming is then investigated in THz communications. Moreover, various emerging and appealing 6G scenarios that integrate IRS into THz communications are envisioned. Open challenges and future research directions for this new paradigm are finally highlighted.


Compressive Features in Offline Reinforcement Learning for Recommender Systems. In this paper, we develop a recommender system for a game that suggests potential items to players based on their interactive behaviors to maximize revenue for the game provider. Our approach is built on a reinforcement learning based technique and is trained on an offline data set that is publicly available on an IEEE Big Data Cup challenge. The limitation of the offline data set and the curse of high dimensionality pose significant obstacles to solving this problem. Our proposed method focuses on improving the total rewards and performance by tackling these main difficulties. More specifically, we utilized sparse PCA to extract important features of user behaviors. Our Q learning based system is then trained from the processed offline data set. To exploit all possible information from the provided data set, we cluster user features to different groups and build an independent Q table for each group. Furthermore, to tackle the challenge of unknown formula for evaluation metrics, we design a metric to self evaluate our system's performance based on the potential value the game provider might achieve and a small collection of actual evaluation metrics that we obtain from the live scoring environment. Our experiments show that our proposed metric is consistent with the results published by the challenge organizers. We have implemented the proposed training pipeline, and the results show that our method outperforms current state of the art methods in terms of both total rewards and training speed. By addressing the main challenges and leveraging the state of the art techniques, we have achieved the best public leaderboard result in the challenge. Furthermore, our proposed method achieved an estimated score of approximately 20 better and can be trained faster by 30 times than the best of the current state of the art methods.


CI dataset and DetDSCI methodology for detecting too small and too large critical infrastructures in satellite images Airports and electrical substations as case study. The detection of critical infrastructures in large territories represented by aerial and satellite images is of high importance in several fields such as in security, anomaly detection, land use planning and land use change detection. However, the detection of such infrastructures is complex as they have highly variable shapes and sizes, i.e., some infrastructures, such as electrical substations, are too small while others, such as airports, are too large. Besides, airports can have a surface area either small or too large with completely different shapes, which makes its correct detection challenging. As far as we know, these limitations have not been tackled yet in previous works. This paper presents (1) a smart Critical Infrastructure dataset, named CI dataset, organised into two scales, small and large scales critical infrastructures and (2) a two level resolution independent critical infrastructure detection (DetDSCI) methodology that first determines the spatial resolution of the input image using a classification model, then analyses the image using the appropriate detector for that spatial resolution. The present study targets two representative classes, airports and electrical substations. Our experiments show that DetDSCI methodology achieves up to 37,53 F1 improvement with respect to Faster R CNN, one of the most influential detection models.


Geometries on the cone of positive definite matrices derived from the power potential and their relation to the power means. We study a Riemannian metric on the cone of symmetric positive definite matrices obtained from the Hessian of the power potential function (1 det(X) beta) beta . We give explicit expressions for the geodesics and distance function, under suitable conditions. In the scalar case, the geodesic between two positive numbers coincides with a weighted power mean, while for matrices of size at least two it yields a notion of weighted power mean different from the ones given in the literature. As beta tends to zero, the power potential converges to the logarithmic potential, that yields a well known metric associated with the matrix geometric mean we show that the geodesic and the distance associated with the power potential converge to the weighted matrix geometric mean and the distance associated with the logarithmic potential, respectively.


Fast Tracker 2.0 Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression. In recent years, several progressive works promote the development of aerial tracking. One of the representative works is our previous work Fast tracker which is applicable to various challenging tracking scenarios. However, it suffers from two main drawbacks 1) the over simplification in target detection by using artificial markers and 2) the contradiction between simultaneous target and environment perception with limited onboard vision. In this paper, we upgrade the target detection in Fast tracker to detect and localize a human target based on deep learning and non linear regression to solve the former problem. For the latter one, we equip the quadrotor system with 360 degree active vision on a customized gimbal camera. Furthermore, we improve the tracking trajectory planning in Fast tracker by incorporating an occlusion aware mechanism that generates observable tracking trajectories. Comprehensive real world tests confirm the proposed system's robustness and real time capability. Benchmark comparisons with Fast tracker validate that the proposed system presents better tracking performance even when performing more difficult tracking tasks.


Principles of the Battery Data Genome. Electrochemical energy storage is central to modern society from consumer electronics to electrified transportation and the power grid. It is no longer just a convenience but a critical enabler of the transition to a resilient, low carbon economy. The large pluralistic battery research and development community serving these needs has evolved into diverse specialties spanning materials discovery, battery chemistry, design innovation, scale up, manufacturing and deployment. Despite the maturity and the impact of battery science and technology, the data and software practices among these disparate groups are far behind the state of the art in other fields (e.g. drug discovery), which have enjoyed significant increases in the rate of innovation. Incremental performance gains and lost research productivity, which are the consequences, retard innovation and societal progress. Examples span every field of battery research , from the slow and iterative nature of materials discovery, to the repeated and time consuming performance testing of cells and the mitigation of degradation and failures. The fundamental issue is that modern data science methods require large amounts of data and the battery community lacks the requisite scalable, standardized data hubs required for immediate use of these approaches. Lack of uniform data practices is a central barrier to the scale problem. In this perspective we identify the data and software sharing gaps and propose the unifying principles and tools needed to build a robust community of data hubs, which provide flexible sharing formats to address diverse needs. The Battery Data Genome is offered as a data centric initiative that will enable the transformative acceleration of battery science and technology, and will ultimately serve as a catalyst to revolutionize our approach to innovation.


Deep Reinforcement Learning for Producing Furniture Layout in Indoor Scenes. In the industrial interior design process, professional designers plan the size and position of furniture in a room to achieve a satisfactory design for selling. In this paper, we explore the interior scene design task as a Markov decision process (MDP), which is solved by deep reinforcement learning. The goal is to produce an accurate position and size of the furniture simultaneously for the indoor layout task. In particular, we first formulate the furniture layout task as a MDP problem by defining the state, action, and reward function. We then design the simulated environment and train reinforcement learning agents to produce the optimal layout for the MDP formulation. We conduct our experiments on a large scale real world interior layout dataset that contains industrial designs from professional designers. Our numerical results demonstrate that the proposed model yields higher quality layouts as compared with the state of art model. The developed simulator and codes are available at url https github.com CODE SUBMIT simulator1 .


On McMullen's algorithm for the Hausdorff dimension of Complex Schottky Groups. We provide a generalization of the McMullen's algorithm to approximate the Hausdorff dimension of the limit set for convex cocompact subgroups of isometries of the Complex Hyperbolic Plane.


Extracting Semantic Process Information from the Natural Language in Event Logs. Process mining focuses on the analysis of recorded event data in order to gain insights about the true execution of business processes. While foundational process mining techniques treat such data as sequences of abstract events, more advanced techniques depend on the availability of specific kinds of information, such as resources in organizational mining and business objects in artifact centric analysis. However, this information is generally not readily available, but rather associated with events in an ad hoc manner, often even as part of unstructured textual attributes. Given the size and complexity of event logs, this calls for automated support to extract such process information and, thereby, enable advanced process mining techniques. In this paper, we present an approach that achieves this through so called semantic role labeling of event data. We combine the analysis of textual attribute values, based on a state of the art language model, with a novel attribute classification technique. In this manner, our approach extracts information about up to eight semantic roles per event. We demonstrate the approach's efficacy through a quantitative evaluation using a broad range of event logs and demonstrate the usefulness of the extracted information in a case study.


Nodal count for Dirichlet to Neumann operators with potential. We consider Dirichlet to Neumann operators associated to Delta q on a Lipschitz domain in a smooth manifold, where q is an L infty potential. We prove a Courant type bound for the nodal count of the extensions u k of the k th Dirichlet to Neumann eigenfunctions phi k to the interior satisfying ( Delta q)u k 0 . The classical Courant nodal domain theorem is known to hold for Steklov eigenfunctions, which are the harmonic extension of the Dirichlet to Neumann eigenfunctions associated to Delta . Our result extends it to a larger family of Dirichlet to Neumann operators. Our proof makes use of the duality between the Steklov and Robin problems.


TransVOS Video Object Segmentation with Transformers. Recently, Space Time Memory Network (STM) based methods have achieved state of the art performance in semi supervised video object segmentation (VOS). A crucial problem in this task is how to model the dependency both among different frames and inside every frame. However, most of these methods neglect the spatial relationships (inside each frame) and do not make full use of the temporal relationships (among different frames). In this paper, we propose a new transformer based framework, termed TransVOS, introducing a vision transformer to fully exploit and model both the temporal and spatial relationships. Moreover, most STM based approaches employ two separate encoders to extract features of two significant inputs, i.e., reference sets (history frames with predicted masks) and query frame (current frame), respectively, increasing the models' parameters and complexity. To slim the popular two encoder pipeline while keeping the effectiveness, we design a single two path feature extractor to encode the above two inputs in a unified way. Extensive experiments demonstrate the superiority of our TransVOS over state of the art methods on both DAVIS and YouTube VOS datasets.


Curious Representation Learning for Embodied Intelligence. Self supervised representation learning has achieved remarkable success in recent years. By subverting the need for supervised labels, such approaches are able to utilize the numerous unlabeled images that exist on the Internet and in photographic datasets. Yet to build truly intelligent agents, we must construct representation learning algorithms that can learn not only from datasets but also learn from environments. An agent in a natural environment will not typically be fed curated data. Instead, it must explore its environment to acquire the data it will learn from. We propose a framework, curious representation learning (CRL), which jointly learns a reinforcement learning policy and a visual representation model. The policy is trained to maximize the error of the representation learner, and in doing so is incentivized to explore its environment. At the same time, the learned representation becomes stronger and stronger as the policy feeds it ever harder data to learn from. Our learned representations enable promising transfer to downstream navigation tasks, performing better than or comparably to ImageNet pretraining without using any supervision at all. In addition, despite being trained in simulation, our learned representations can obtain interpretable results on real images. Code is available at https yilundu.github.io crl .


General Fractional Integrals and Derivatives with the Sonine Kernels. In this paper, we address the general fractional integrals and derivatives with the Sonine kernels on the spaces of functions with an integrable singularity at the point zero. First, the Sonine kernels and their important special classes and particular cases are discussed. In particular, we introduce a class of the Sonine kernels that possess an integrable singularity of power function type at the point zero. For the general fractional integrals and derivatives with the Sonine kernels from this class, two fundamental theorems of fractional calculus are proved. Then, we construct the n fold general fractional integrals and derivatives and study their properties.


Data driven rational function neural networks a new method for generating analytical models of rock physics. Seismic wave velocity of underground rock plays important role in detecting internal structure of the Earth. Rock physics models have long been the focus of predicting wave velocity. However, construction of a theoretical model requires careful physical considerations and mathematical derivations, which means a long research process. In addition, various complicated situations often occur in practice, which brings great difficulties to the application of theoretical models. On the other hand, there are many empirical formulas based on real data. These empirical models are often simple and easy to use, but may be not based on physical principles and lack a proper formulation of physics. This work proposed a rational function neural networks (RafNN) for data driven rock physics modeling. Based on the observation data set, this method can deduce a velocity model which not only satisfies the actual data distribution, but also has a proper mathematical form reflecting the inherent rock physics. The Gassmann's equation, which is the most commonly used theoretical model relating bulk modulus of porous rock to mineral composition, porosity and fluid, is perfectly reconstructed by using data driven RafNN. The advantage of this method is that only observational data sets are required to extract model equations, and no complex mathematical and physical processes are involved. This work opens up for the first time a new avenue on constructing analytical expression of velocity models using neural networks and field data, which is of great interest for exploring the heterogeneous structure of the Earth.


Subalgebras of etale algebras and fusion subcategories. In cite Rem. 3.4 DNO the authors asked the question if any 'etale subalgebra of an 'etale algebra in a braided fusion category is also 'etale. We give a positive answer to this question if the braided fusion category cc is pseudo unitary and non degenerate. In the case of a pseudo unitary fusion category we also give a new description of the lattice correspondence from cite Theorem 4.10 DMNO . This new description enables us to describe the two binary operations on the lattice of fusion subcategories.


Physics constrained intraventricular vector flow mapping by color Doppler. Color Doppler by transthoracic echocardiography creates 2 D fan shaped maps of blood velocities in the cardiac cavities. It is a one component velocimetric technique since it only returns the velocity components parallel to the ultrasound beams. Intraventricular vector flow mapping (iVFM) is a method to recover the blood velocity vectors from the Doppler scalar fields in an echocardiographic three chamber view. We improved our iVFM numerical scheme by imposing physical constraints. The iVFM consisted in minimizing regularized Doppler residuals subject to the condition that two fluid dynamics constraints were satisfied, namely planar mass conservation, and free slip boundary conditions. The optimization problem was solved by using the Lagrange multiplier method. A finite difference discretization of the optimization problem, written in the polar coordinate system centered on the cardiac ultrasound probe, led to a sparse linear system. The single regularization parameter was determined automatically for non supervision considerations. The physics constrained method was validated using realistic intracardiac flow data from a patient specific CFD model. The numerical evaluations showed that the iVFM derived velocity vectors were in very good agreement with the CFD based original velocities, with relative errors ranged between 0.3 and 12 . We calculated two macroscopic measures of flow in the cardiac region of interest, the mean vorticity and mean stream function, and observed an excellent concordance between physics constrained iVFM and CFD. The capability of physics constrained iVFM was finally tested with in vivo color Doppler data acquired in patients routinely examined in the echocardiographic laboratory. The vortex that forms during the rapid filling was deciphered. The physics constrained iVFM algorithm is ready for pilot clinical studies.


GETAM Gradient weighted Element wise Transformer Attention Map for Weakly supervised Semantic segmentation. Weakly Supervised Semantic Segmentation (WSSS) is challenging, particularly when image level labels are used to supervise pixel level prediction. To bridge their gap, a Class Activation Map (CAM) is usually generated to provide pixel level pseudo labels. CAMs in Convolutional Neural Networks suffer from partial activation ie, only the most discriminative regions are activated. Transformer based methods, on the other hand, are highly effective at exploring global context with long range dependency modeling, potentially alleviating the "partial activation" issue. In this paper, we propose the first transformer based WSSS approach, and introduce the Gradient weighted Element wise Transformer Attention Map (GETAM). GETAM shows fine scale activation for all feature map elements, revealing different parts of the object across transformer layers. Further, we propose an activation aware label completion module to generate high quality pseudo labels. Finally, we incorporate our methods into an end to end framework for WSSS using double backward propagation. Extensive experiments on PASCAL VOC and COCO demonstrate that our results beat the state of the art end to end approaches by a significant margin, and outperform most multi stage methods.m most multi stage methods.


Consensus with Bounded Space and Minimal Communication. Population protocols are a fundamental model in distributed computing, where many nodes with bounded memory and computational power have random pairwise interactions over time. This model has been studied in a rich body of literature aiming to understand the tradeoffs between the memory and time needed to perform computational tasks. We study the population protocol model focusing on the communication complexity needed to achieve consensus with high probability. When the number of memory states is s O( log log n ) , the best upper bound known was given by a protocol with O(n log n ) communication, while the best lower bound was Omega(n log(n) s) communication. We design a protocol that shows the lower bound is sharp. When each agent has s O( log n theta ) states of memory, with theta in (0,1 2) , consensus can be reached in time O( log(n)) with O(n log (n) s) communications with high probability.


A note on some information theoretic divergences between Zeta distributions. In this short communication, we first report a closed form formula for calculating the alpha divergences and the Sharma Mittal divergences between any two zeta distributions. Then we report a formula to calculate the Kullback Leibler divergence between any two zeta distributions. We illustrate these formula with examples.


Extracting Clinician's Goals by What if Interpretable Modeling. Although reinforcement learning (RL) has tremendous success in many fields, applying RL to real world settings such as healthcare is challenging when the reward is hard to specify and no exploration is allowed. In this work, we focus on recovering clinicians' rewards in treating patients. We incorporate the what if reasoning to explain the clinician's actions based on future outcomes. We use generalized additive models (GAMs) a class of accurate, interpretable models to recover the reward. In both simulation and a real world hospital dataset, we show our model outperforms baselines. Finally, our model's explanations match several clinical guidelines when treating patients while we found the previously used linear model often contradicts them.


Improved explicit upper bounds for the Cap Set Problem. Ellenberg and Gijswijt gave the best known asymptotic upper bound for the cardinality of subsets of mathbb F q n without 3 term arithmetic progressions. We improve this bound by a factor sqrt n . In the case q 3 , we also obtain more explicit upper bounds for the Cap Set Problem.


Cross Lingual Fine Grained Entity Typing. The growth of cross lingual pre trained models has enabled NLP tools to rapidly generalize to new languages. While these models have been applied to tasks involving entities, their ability to explicitly predict typological features of these entities across languages has not been established. In this paper, we present a unified cross lingual fine grained entity typing model capable of handling over 100 languages and analyze this model's ability to generalize to languages and entities unseen during training. We train this model on cross lingual training data collected from Wikipedia hyperlinks in multiple languages (training languages). During inference, our model takes an entity mention and context in a particular language (test language, possibly not in the training languages) and predicts fine grained types for that entity. Generalizing to new languages and unseen entities are the fundamental challenges of this entity typing setup, so we focus our evaluation on these settings and compare against simple yet powerful string match baselines. Experimental results show that our approach outperforms the baselines on unseen languages such as Japanese, Tamil, Arabic, Serbian, and Persian. In addition, our approach substantially improves performance on unseen entities (even in unseen languages) over the baselines, and human evaluation shows a strong ability to predict relevant types in these settings.


Operationalizing a National Digital Library The Case for a Norwegian Transformer Model. In this work, we show the process of building a large scale training set from digital and digitized collections at a national library. The resulting Bidirectional Encoder Representations from Transformers (BERT) based language model for Norwegian outperforms multilingual BERT (mBERT) models in several token and sequence classification tasks for both Norwegian Bokm aa l and Norwegian Nynorsk. Our model also improves the mBERT performance for other languages present in the corpus such as English, Swedish, and Danish. For languages not included in the corpus, the weights degrade moderately while keeping strong multilingual properties. Therefore, we show that building high quality models within a memory institution using somewhat noisy optical character recognition (OCR) content is feasible, and we hope to pave the way for other memory institutions to follow.


A Voting Based Blockchain Interoperability Oracle. Today's blockchain landscape is severely fragmented as more and more heterogeneous blockchain platforms have been developed in recent years. These blockchain platforms are not able to interact with each other or with the outside world since only little emphasis is placed on the interoperability between them. Already proposed solutions for blockchain interoperability such as naive relay or oracle solutions are usually not broadly applicable since they are either too expensive to operate or very resource intensive. For that reason, we propose a blockchain interoperability oracle that follows a voting based approach based on threshold signatures. The oracle nodes generate a distributed private key to execute an off chain aggregation mechanism to collectively respond to requests. Compared to state of the art relay schemes, our approach does not incur any ongoing costs and since the on chain component only needs to verify a single signature, we can achieve remarkable cost savings compared to conventional oracle solutions.


From Base Data To Knowledge Discovery A Life Cycle Approach Using Multilayer Networks. Any large complex data analysis to infer or discover meaningful information knowledge involves the following steps (in addition to data collection, cleaning, preparing the data for analysis such as attribute elimination) i) Modeling the data an approach for modeling and deriving a data representation for analysis using that approach, ii) translating analysis objectives into computations on the model generated this can be as simple as a single computation (e.g., community detection) or may involve a sequence of operations (e.g., pair wise community detection over multiple networks) using expressions based on the model, iii) computation of the expressions generated efficiency and scalability come into picture here, and iv) drill down of results to interpret or understand them clearly. Beyond this, it is also meaningful to visualize results for easier understanding. Covid 19 visualization dashboard presented in this paper is an example of this. This paper covers all of the above steps of data analysis life cycle using a data representation that is gaining importance for multi entity, multi feature data sets Multilayer Networks. We use several data sets to establish the effectiveness of modeling using MLNs and analyze them using the proposed decoupling approach. For coverage, we use different types of MLNs for modeling, and community and centrality computations for analysis. The data sets used US commercial airlines, IMDb, DBLP, and Covid 19 data set. Our experimental analyses using the identified steps validate modeling, breadth of objectives that can be computed, and overall versatility of the life cycle approach. Correctness of results is verified, where possible, using independently available ground truth. We demonstrate drill down that is afforded by this approach (due to structure and semantics preservation) for a better understanding and visualization of results.


CauseRec Counterfactual User Sequence Synthesis for Sequential Recommendation. Learning user representations based on historical behaviors lies at the core of modern recommender systems. Recent advances in sequential recommenders have convincingly demonstrated high capability in extracting effective user representations from the given behavior sequences. Despite significant progress, we argue that solely modeling the observational behaviors sequences may end up with a brittle and unstable system due to the noisy and sparse nature of user interactions logged. In this paper, we propose to learn accurate and robust user representations, which are required to be less sensitive to (attack on) noisy behaviors and trust more on the indispensable ones, by modeling counterfactual data distribution. Specifically, given an observed behavior sequence, the proposed CauseRec framework identifies dispensable and indispensable concepts at both the fine grained item level and the abstract interest level. CauseRec conditionally samples user concept sequences from the counterfactual data distributions by replacing dispensable and indispensable concepts within the original concept sequence. With user representations obtained from the synthesized user sequences, CauseRec performs contrastive user representation learning by contrasting the counterfactual with the observational. We conduct extensive experiments on real world public recommendation benchmarks and justify the effectiveness of CauseRec with multi aspects model analysis. The results demonstrate that the proposed CauseRec outperforms state of the art sequential recommenders by learning accurate and robust user representations.


Conjectures on the distribution behavior of the class numbers of certain real quadratic number fields. Given a random real quadratic field from mathbb Q ( sqrt p ,) p text primes , the conjectural probability mathbb P (h q) that it has class number q is given for all positive odd integers q . Some related conjectures of the Cohen Lenstra heuristic are given here as corollaries. These results suggest that the set of real quadratic number fields may have some natural hierarchical structures.


Multi replica biased sampling for photoswitchable pi conjugated polymers. In recent years, pi conjugated polymers are attracting considerable interest in view of their light dependent torsional reorganization around the pi conjugated backbone, which determines peculiar light emitting properties. Motivated by the interest in designing conjugated polymers with tunable photoswitchable pathways, we devised a computational framework to enhance the sampling of the torsional conformational space and at the same time estimate ground to excited state free energy differences. This scheme is based on a combination of Hamiltonian Replica Exchange (REM), Parallel Bias metadynamics, and free energy perturbation theory. In our scheme, each REM replica samples an intermediate unphysical state between the ground and the first two excited states, which are characterized by TD DFT simulations at the B3LYP 6 31G level of theory. We applied the method to a 5 mer of 9,9 dioctylfluorene and found that upon irradiation this system can undergo a dihedral inversion from 155 to 155 degrees crossing a barrier that decreases from 0.1 eV in the ground state (S0) to 0.05 eV and 0.04 eV in the first (S1) and second (S2) excited states. Furthermore, S1 and even more S2 were predicted to stabilize coplanar dihedrals, with a local free energy minimum located at 44 degrees. The presence of a free energy barrier of 0.08 eV for the S1 and 0.12 eV for the S2 state can trap this conformation in a basin far from the global free energy minimum located at 155 degrees. The simulation results were compared with the experimental emission spectrum, showing a quantitative agreement with the predictions provided by our framework.


Legendre pairs of lengths ell equiv 0 (mod 3 ). We prove a proposition that connects constant PAF sequences and the corresponding Legendre pairs with integer PSD values. We show how to determine explicitly the complete spectrum of the ( ell 3) rd value of the discrete Fourier transform for Legendre pairs of lengths ell equiv 0 , ( mod 3) . This is accomplished by two new algorithms based on number theoretic arguments. As an application, we prove that Legendre pairs of the open lengths 117, 129, 133, and 147 exist by finding Legendre pairs of these lengths with a multiplier group of order at least 3. As a consequence, 85, 87, 115, 145, 159, 161, 169, 175, 177, 185, 187, 195 are the twelve integers in the range 200 for which the question of existence of Legendre pairs remains unsolved.


BEVDet High performance Multi camera 3D Object Detection in Bird Eye View. Autonomous driving perceives its surroundings for decision making, which is one of the most complex scenarios in visual perception. The success of paradigm innovation in solving the 2D object detection task inspires us to seek an elegant, feasible, and scalable paradigm for fundamentally pushing the performance boundary in this area. To this end, we contribute the BEVDet paradigm in this paper. BEVDet performs 3D object detection in Bird Eye View (BEV), where most target values are defined and route planning can be handily performed. We merely reuse existing modules to build its framework but substantially develop its performance by constructing an exclusive data augmentation strategy and upgrading the Non Maximum Suppression strategy. In the experiment, BEVDet offers an excellent trade off between accuracy and time efficiency. As a fast version, BEVDet Tiny scores 31.2 mAP and 39.2 NDS on the nuScenes val set. It is comparable with FCOS3D, but requires just 11 computational budget of 215.3 GFLOPs and runs 9.2 times faster at 15.6 FPS. Another high precision version dubbed BEVDet Base scores 39.3 mAP and 47.2 NDS, significantly exceeding all published results. With a comparable inference speed, it surpasses FCOS3D by a large margin of 9.8 mAP and 10.0 NDS. The code will be released to facilitate future research.


Opinion Extraction as A Structured Sentiment Analysis using Transformers. Relationship extraction and named entity recognition have always been considered as two distinct tasks that require different input data, labels, and models. However, both are essential for structured sentiment analysis. We believe that both tasks can be combined into a single stacked model with the same input data. We performed different experiments to find the best model to extract multiple opinion tuples from a single sentence. The opinion tuples will consist of holders, targets, and expressions. With the opinion tuples, we will be able to extract the relationship we need.


TriPose A Weakly Supervised 3D Human Pose Estimation via Triangulation from Video. Estimating 3D human poses from video is a challenging problem. The lack of 3D human pose annotations is a major obstacle for supervised training and for generalization to unseen datasets. In this work, we address this problem by proposing a weakly supervised training scheme that does not require 3D annotations or calibrated cameras. The proposed method relies on temporal information and triangulation. Using 2D poses from multiple views as the input, we first estimate the relative camera orientations and then generate 3D poses via triangulation. The triangulation is only applied to the views with high 2D human joint confidence. The generated 3D poses are then used to train a recurrent lifting network (RLN) that estimates 3D poses from 2D poses. We further apply a multi view re projection loss to the estimated 3D poses and enforce the 3D poses estimated from multi views to be consistent. Therefore, our method relaxes the constraints in practice, only multi view videos are required for training, and is thus convenient for in the wild settings. At inference, RLN merely requires single view videos. The proposed method outperforms previous works on two challenging datasets, Human3.6M and MPI INF 3DHP. Codes and pretrained models will be publicly available.


Report on the "The Future of the Shell" Panel at HotOS 2021. This document summarizes the challenges and possible research directions around the shell and its ecosystem, collected during and after the HotOS21 Panel on the future of the shell. The goal is to create a snapshot of what a number of researchers from various disciplines connected to the shell to varying degrees think about its future. We hope that this document will serve as a reference for future research on the shell and its ecosystem.


The ROSMA PTV concept and the impact of rotational setup uncertainties on the tumor control probability in canine brain tumors. Purpose In this modelling study we pursued two main goals. The first was to establish a new CTV to PTV expansion which considers the closest and most critical organ at risk (OAR). The second goal was to investigate the impact of the planning target volume (PTV) margin size on the tumor control probability (TCP) dependent on the geometrical setup uncertainties. The aim was to achieve a smaller margin expansion close to the OAR while allowing a moderately larger expansion in less critical areas further away from the OAR and most importantly while maintaining the TCP. Methods and Materials Imaging data of radiation therapy (RT) plans from pet dogs which had undergone RT for brain tumor were used to estimate the clinic specific rotational setup uncertainties. A Monte Carlo methodology used to quantify the implications of those uncertainties on the TCP. A computational CTV to PTV expansion method based on probability density was established. All required software modules were developed and integrated into a software package which directly interacts with the Varian Eclipse treatment planning system. Results The rotational setup uncertainties were obtained from 44 dog patients. Their frequency distributions were analysed, and the mean values and standard deviations were determined. To investigate the impact on the TCP, several uniform and non isotropic PTV targets were created. Standardized RT plans with equal optimization constraints were defined and automatically applied and calculated on these targets. The resulting TCPs were then evaluated and compared. Conclusion The non isotropic margins were found to result in larger TCPs with smaller margin excess volume. Further we have presented an additional application of the newly established CTV to PTV expansion method for radiation therapy of the spinal axis of human patients.


A New Framework for Matrix Discrepancy Partial Coloring Bounds via Mirror Descent. Motivated by the Matrix Spencer conjecture, we study the problem of finding signed sums of matrices with a small matrix norm. A well known strategy to obtain these signs is to prove, given matrices A 1, dots, A n in mathbb R m times m , a Gaussian measure lower bound of 2 O(n) for a scaling of the discrepancy body x in mathbb R n sum i 1 n x i A i leq 1 . We show this is equivalent to covering its polar with 2 O(n) translates of the cube frac 1 n B n infty , and construct such a cover via mirror descent. As applications of our framework, we show bullet Matrix Spencer for Low Rank Matrices. If the matrices satisfy A i mathrm op leq 1 and mathrm rank (A i) leq r , we can efficiently find a coloring x in pm 1 n with discrepancy sum i 1 n x i A i mathrm op lesssim sqrt n log ( min(rm n, r)) . This improves upon the naive O( sqrt n log r ) bound for random coloring and proves the matrix Spencer conjecture when r m leq n . bullet Matrix Spencer for Block Diagonal Matrices. For block diagonal matrices with A i mathrm op leq 1 and block size h , we can efficiently find a coloring x in pm 1 n with sum i 1 n x i A i mathrm op lesssim sqrt n log (hm n) . Using our proof, we reduce the matrix Spencer conjecture to the existence of a O( log(m n)) quantum relative entropy net on the spectraplex. bullet Matrix Discrepancy for Schatten Norms. We generalize our discrepancy bound for matrix Spencer to Schatten norms 2 le p leq q . Given A i S p leq 1 and mathrm rank (A i) leq r , we can efficiently find a partial coloring x in 1,1 n with i x i 1 ge n 2 and sum i 1 n x i A i S q lesssim sqrt n min(p, log(rk)) cdot k 1 p 1 q , where k min(1,m n) .


Through the Data Management Lens Experimental Analysis and Evaluation of Fair Classification. Classification, a heavily studied data driven machine learning task, drives an increasing number of prediction systems involving critical human decisions such as loan approval and criminal risk assessment. However, classifiers often demonstrate discriminatory behavior, especially when presented with biased data. Consequently, fairness in classification has emerged as a high priority research area. Data management research is showing an increasing presence and interest in topics related to data and algorithmic fairness, including the topic of fair classification. The interdisciplinary efforts in fair classification, with machine learning research having the largest presence, have resulted in a large number of fairness notions and a wide range of approaches that have not been systematically evaluated and compared. In this paper, we contribute a broad analysis of 13 fair classification approaches and additional variants, over their correctness, fairness, efficiency, scalability, robustness to data errors, sensitivity to underlying ML model, data efficiency, and stability using a variety of metrics and real world datasets. Our analysis highlights novel insights on the impact of different metrics and high level approach characteristics on different aspects of performance. We also discuss general principles for choosing approaches suitable for different practical settings, and identify areas where data management centric solutions are likely to have the most impact.


Implementation and Evaluation of a Multivariate Abstraction Based, Interval Based Dynamic Time Warping Method as a Similarity Measure for Longitudinal Medical Records. We extended dynamic time warping (DTW) into interval based dynamic time warping (iDTW), including (A) interval based representation (iRep) 1 abstracting raw, time stamped data into interval based abstractions, 2 comparison period scoping, 3 partitioning abstract intervals into a given temporal granularity (B) interval based matching (iMatch) matching partitioned, abstract concepts records, using a modified DTW. Using domain knowledge, we abstracted the raw data of medical records, for up to three concepts out of four or five relevant concepts, into two interval types State abstractions (e.g. LOW, HIGH) and Gradient abstractions (e.g. INCREASING, DECREASING). We created all uni dimensional (State or Gradient) or multi dimensional (State and Gradient) abstraction combinations. Tasks Classifying 161 oncology patients records as autologous or allogenic bone marrow transplantation classifying 125 hepatitis patients records as B or C hepatitis predicting micro or macro albuminuria in the next year for 151 Type 2 diabetes patients. We used a k Nearest Neighbors majority, k an odd number from 1 to SQRT(N), N set size. 75,936 10 fold cross validation experiments were performed 33,600 (Oncology), 28,800 (Hepatitis), 13,536 (Diabetes). Measures Area Under the Curve (AUC), optimal Youden's Index. Paired t tests compared result vectors for equivalent configurations other than a tested variable, to determine a significant mean accuracy difference (P 0.05). Mean classification and prediction using abstractions was significantly better than using only raw time stamped data. In each domain, at least one abstraction combination led to a significantly better mean performance than raw data. Increasing feature number and using Multi dimensional abstractions enhanced performance. Unlike when using raw data, optimal mean performance was often reached with k 5, using abstractions.


Tensor PDE model of biological network formation. We study an elliptic parabolic system of partial differential equations describing formation of biological network structures. The model takes into consideration the evolution of the permeability tensor under the influence of a diffusion term, representing randomness in the material structure, a decay term describing metabolic cost and a pressure force. A Darcy's law type equation describes the pressure field. In the spatially two dimensional setting, we present a constructive, formal derivation of the PDE system from the discrete network formation model in the refinement limit of a sequence of unstructured triangulations. Moreover, we show that the PDE system is a formal L 2 gradient flow of an energy functional with biological interpretation, and study its convexity properties. For the case when the energy functional is convex, we construct unique global weak solutions of the PDE system. Finally, we construct steady state solutions in one and multi dimensional settings and discuss their stability properties.