Learning Actor centered Representations for Action Localization in Streaming Videos using Predictive Learning. Event perception tasks such as recognizing and localizing actions in streaming videos are essential for tackling visual understanding tasks. Progress has primarily been driven by the use of large scale, annotated training data in a supervised manner. In this work, we tackle the problem of learning textit actor centered representations through the notion of continual hierarchical predictive learning to localize actions in streaming videos without any training annotations. Inspired by cognitive theories of event perception, we propose a novel, self supervised framework driven by the notion of hierarchical predictive learning to construct actor centered features by attention based contextualization. Extensive experiments on three benchmark datasets show that the approach can learn robust representations for localizing actions using only one epoch of training, i.e., we train the model continually in streaming fashion one frame at a time, with a single pass through training videos. We show that the proposed approach outperforms unsupervised and weakly supervised baselines while offering competitive performance to fully supervised approaches. Finally, we show that the proposed model can generalize to out of domain data without significant loss in performance without any finetuning for both the recognition and localization tasks.


A Decentralized Federated Learning Framework via Committee Mechanism with Convergence Guarantee. Federated learning allows multiple participants to collaboratively train an efficient model without exposing data privacy. However, this distributed machine learning training method is prone to attacks from Byzantine clients, which interfere with the training of the global model by modifying the model or uploading the false gradient. In this paper, we propose a novel serverless federated learning framework Committee Mechanism based Federated Learning (CMFL), which can ensure the robustness of the algorithm with convergence guarantee. In CMFL, a committee system is set up to screen the uploaded local gradients. The committee system selects the local gradients rated by the elected members for the aggregation procedure through the selection strategy, and replaces the committee member through the election strategy. Based on the different considerations of model performance and defense, two opposite selection strategies are designed for the sake of both accuracy and robustness. Extensive experiments illustrate that CMFL achieves faster convergence and better accuracy than the typical Federated Learning, in the meanwhile obtaining better robustness than the traditional Byzantine tolerant algorithms, in the manner of a decentralized approach. In addition, we theoretically analyze and prove the convergence of CMFL under different election and selection strategies, which coincides with the experimental results.


Redy Remote Dynamic Memory Cache. Redy is a cloud service that provides high performance caches using RDMA accessible remote memory. An application can customize the performance of each cache with a service level objective (SLO) for latency and throughput. By using remote memory, it can leverage stranded memory and spot VM instances to reduce the cost of its caches and improve data center resource utilization. Redy automatically customizes the resource configuration for the given SLO, handles the dynamics of remote memory regions, and recovers from failures. The experimental evaluation shows that Redy can deliver its promised performance and robustness under remote memory dynamics in the cloud. We augment a production key value store, FASTER, with a Redy cache. When the working set exceeds local memory, using Redy is significantly faster than spilling to SSDs.


FLAME Facial Landmark Heatmap Activated Multimodal Gaze Estimation. 3D gaze estimation is about predicting the line of sight of a person in 3D space. Person independent models for the same lack precision due to anatomical differences of subjects, whereas person specific calibrated techniques add strict constraints on scalability. To overcome these issues, we propose a novel technique, Facial Landmark Heatmap Activated Multimodal Gaze Estimation (FLAME), as a way of combining eye anatomical information using eye landmark heatmaps to obtain precise gaze estimation without any person specific calibration. Our evaluation demonstrates a competitive performance of about 10 improvement on benchmark datasets ColumbiaGaze and EYEDIAP. We also conduct an ablation study to validate our method.


Open Intent Discovery through Unsupervised Semantic Clustering and Dependency Parsing. Intent understanding plays an important role in dialog systems, and is typically formulated as a supervised learning problem. However, it is challenging and time consuming to design the intents for a new domain from scratch, which usually requires a lot of manual effort of domain experts. This paper presents an unsupervised two stage approach to discover intents and generate meaningful intent labels automatically from a collection of unlabeled utterances in a domain. In the first stage, we aim to generate a set of semantically coherent clusters where the utterances within each cluster convey the same intent. We obtain the utterance representation from various pre trained sentence embeddings and present a metric of balanced score to determine the optimal number of clusters in K means clustering for balanced datasets. In the second stage, the objective is to generate an intent label automatically for each cluster. We extract the ACTION OBJECT pair from each utterance using a dependency parser and take the most frequent pair within each cluster, e.g., book restaurant, as the generated intent label. We empirically show that the proposed unsupervised approach can generate meaningful intent labels automatically and achieve high precision and recall in utterance clustering and intent discovery.


A precision on the concept of strict convexity in non Archimedean analysis. We prove that the only non Archimedean strictly convex spaces are the zero space and the one dimensional linear space over , mathbb Z 3 mathbb Z , with any of its trivial norms.


The Eisenlohr Farris Algorithm for Fully Transitive Polyhedra. In this note we describe the algorithm proposed by J. M. Eisenlohr and S. L. Farris for generating every fully transitive polyhedra in mathbb E d . We also apply this algorithm to construct a new polyhedron in the euclidean space mathbb E 3 .


Hyperbolic plane curves near the non singular tropical limit. We determine necessary and sufficient conditions for real algebraic curves near the non singular tropical limit to be hyperbolic with respect to a point, thus generalising Speyer's classification of stable curves near the tropical limit. In order to obtain the conditions, we develop tools of real tropical intersection theory. We introduce the tropical hyperbolicity locus and the signed tropical hyperbolicity locus of a real algebraic curve near the non singular tropical limit. In the case of honeycombs, we characterise the tropical hyperbolicity locus in terms of the set of twisted edges on the tropical limit.


Toward Drug Target Interaction Prediction via Ensemble Modeling and Transfer Learning. Drug target interaction (DTI) prediction plays a crucial role in drug discovery, and deep learning approaches have achieved state of the art performance in this field. We introduce an ensemble of deep learning models (EnsembleDLM) for DTI prediction. EnsembleDLM only uses the sequence information of chemical compounds and proteins, and it aggregates the predictions from multiple deep neural networks. This approach not only achieves state of the art performance in Davis and KIBA datasets but also reaches cutting edge performance in the cross domain applications across different bio activity types and different protein classes. We also demonstrate that EnsembleDLM achieves a good performance (Pearson correlation coefficient and concordance index 0.8) in the new domain with approximately 50 transfer learning data, i.e., the training set has twice as much data as the test set.


Distribution Dependent Stochastic Porous Media Type Equations on General Measure Spaces. Using the generalized variational framework, the strong weak existence and uniqueness of solutions are derived for a class of distribution dependent stochastic porous media type equations on general measure spaces. This work extends some existing results of classical stochastic porous media equations to the distribution dependent case.


Explainable Biomedical Recommendations via Reinforcement Learning Reasoning on Knowledge Graphs. For Artificial Intelligence to have a greater impact in biology and medicine, it is crucial that recommendations are both accurate and transparent. In other domains, a neurosymbolic approach of multi hop reasoning on knowledge graphs has been shown to produce transparent explanations. However, there is a lack of research applying it to complex biomedical datasets and problems. In this paper, the approach is explored for drug discovery to draw solid conclusions on its applicability. For the first time, we systematically apply it to multiple biomedical datasets and recommendation tasks with fair benchmark comparisons. The approach is found to outperform the best baselines by 21.7 on average whilst producing novel, biologically relevant explanations.


Wide Aspect Ratio Matching for Robust Face Detection. Recently, anchor based methods have achieved great progress in face detection. Once anchor design and anchor matching strategy determined, plenty of positive anchors will be sampled. However, faces with extreme aspect ratio always fail to be sampled according to standard anchor matching strategy. In fact, the max IoUs between anchors and extreme aspect ratio faces are still lower than fixed sampling threshold. In this paper, we firstly explore the factors that affect the max IoU of each face in theory. Then, anchor matching simulation is performed to evaluate the sampling range of face aspect ratio. Besides, we propose a Wide Aspect Ratio Matching (WARM) strategy to collect more representative positive anchors from ground truth faces across a wide range of aspect ratio. Finally, we present a novel feature enhancement module, named Receptive Field Diversity (RFD) module, to provide diverse receptive field corresponding to different aspect ratios. Extensive experiments show that our method can help detectors better capture extreme aspect ratio faces and achieve promising detection performance on challenging face detection benchmarks, including WIDER FACE and FDDB datasets.


LNGate Powering IoT with Next Generation Lightning Micro payments using Threshold Cryptography. Bitcoin has emerged as a revolutionary payment system with its decentralized ledger concept however it has significant problems such as high transaction fees and long confirmation times. Lightning Network (LN), which was introduced much later, solves most of these problems with an innovative concept called off chain payments. With this advancement, Bitcoin has become an attractive venue to perform micro payments which can also be adopted in many IoT applications (e.g. toll payments). Nevertheless, it is not feasible to host LN and Bitcoin on IoT devices due to the storage, memory, and processing requirements. Therefore, in this paper, we propose an efficient and secure protocol that enables an IoT device to use LN through an untrusted gateway node. The gateway hosts LN and Bitcoin nodes and can open close LN channels, send LN payments on behalf of the IoT device. This delegation approach is powered by a (2,2) threshold scheme that requires the IoT device and the LN gateway to jointly perform all LN operations which in turn secures both parties' funds. Specifically, we propose to thresholdize LN's Bitcoin public and private keys as well as its commitment points. With these and several other protocol level changes, IoT device is protected against revoked state broadcast, collusion, and ransom attacks. We implemented the proposed protocol by changing LN's source code and thoroughly evaluated its performance using a Raspberry Pi. Our evaluation results show that computational and communication delays associated with the protocol are negligible. To the best of our knowledge, this is the first work that implemented threshold cryptography in LN.


Sinogram Denoise Based on Generative Adversarial Networks. A novel method for sinogram denoise based on Generative Adversarial Networks (GANs) in the field of SPECT imaging is presented. Projection data from software phantoms were used to train the proposed model. For evaluation of the efficacy of the method Shepp Logan based phantom, with various noise levels added where used. The resulting denoised sinograms are reconstructed using Ordered Subset Expectation Maximization (OSEM) and compared to the reconstructions of the original noised sinograms. As the results show, the proposed method significantly denoise the sinograms and significantly improves the reconstructions. Finally, to demonstrate the efficacy and capability of the proposed method results from real world DAT SPECT sinograms are presented.


High frequency stability estimates for a partial data inverse problem. In this article, high frequency stability estimates for the determination of the potential in the Schr "odinger equation are studied when the boundary measurements are made on slightly more than half the boundary. The estimates reflect the increasing stability property with growing frequency.


Discriminant Dynamic Mode Decomposition for Labeled Spatio Temporal Data Collections. Extracting coherent patterns is one of the standard approaches towards understanding spatio temporal data. Dynamic mode decomposition (DMD) is a powerful tool for extracting coherent patterns, but the original DMD and most of its variants do not consider label information, which is often available as side information of spatio temporal data. In this work, we propose a new method for extracting distinctive coherent patterns from labeled spatio temporal data collections, such that they contribute to major differences in a labeled set of dynamics. We achieve such pattern extraction by incorporating discriminant analysis into DMD. To this end, we define a kernel function on subspaces spanned by sets of dynamic modes and develop an objective to take both reconstruction goodness as DMD and class separation goodness as discriminant analysis into account. We illustrate our method using a synthetic dataset and several real world datasets. The proposed method can be a useful tool for exploratory data analysis for understanding spatio temporal data.


On Slice Isolation Options in the Transport Network and Associated Feasibility Indicators. Isolation is one of the more relevant attributes associated to the idea of network slicing, introduced by 5G services. Through isolation it is expected that slices from different customers could gracefully coexist without interfering each other, in the sense that whatever misbehavior or unforeseen demand from one slice customer could not affect the communication service received by any other slice customer supported atop the same physical transport infrastructure. This paper surveys and compare different technical approaches that can be taken for providing distinct isolation levels in the transport network, as a major component of end to end network slices. Furthermore, a number of isolation feasibility indicators are defined and proposed. These indicators are based on the approaches referred before, as a mean of guiding orchestration decisions at the time of provisioning or reconfiguring the transport slices in the network.


Grappling with the Scale of Born Digital Government Publications Toward Pipelines for Processing and Searching Millions of PDFs. Official government publications are key sources for understanding the history of societies. Web publishing has fundamentally changed the scale and processes by which governments produce and disseminate information. Significantly, a range of web archiving programs have captured massive troves of government publications. For example, hundreds of millions of unique U.S. Government documents posted to the web in PDF form have been archived by libraries to date. Yet, these PDFs remain largely unutilized and understudied in part due to the challenges surrounding the development of scalable pipelines for searching and analyzing them. This paper utilizes a Library of Congress dataset of 1,000 government PDFs in order to offer initial approaches for searching and analyzing these PDFs at scale. In addition to demonstrating the utility of PDF metadata, this paper offers computationally efficient machine learning approaches to search and discovery that utilize the PDFs' textual and visual features as well. We conclude by detailing how these methods can be operationalized at scale in order to support systems for navigating millions of PDFs.


Postmortem memory of public figures in news and social media. Deceased public figures are often said to live on in collective memory. We quantify this phenomenon by tracking mentions of 2,362 public figures in English language online news and social media (Twitter) one year before and after death. We measure the sharp spike and rapid decay of attention following death and model collective memory as a composition of communicative and cultural memory. Clustering reveals four patterns of post mortem memory, and regression analysis shows that boosts in media attention are largest for pre mortem popular anglophones who died a young, unnatural death that long term boosts are smallest for leaders and largest for artists and that, while both the news and Twitter are triggered by young and unnatural deaths, the news additionally curates collective memory when old persons or leaders die. Overall, we illuminate the age old question who is remembered by society, and the distinct roles of news and social media in collective memory formation.


Second Harmonic Generation in Etchless Lithium Niobate Nanophotonic Waveguides with Bound States in the Continuum. Bound states in the continuum (BICs) have been extensively studied in various systems since its first proposal in quantum mechanics. Photonic BICs can enable optical mode confinement and provide field enhancement for nonlinear optics, but they have rarely been explored in nonlinear integrated photonic waveguides. Applying BICs in photonic integrated circuits enables low loss light guidance and routing in low refractive index waveguides on high refractive index substrates, which is suitable for integrated photonics with nonlinear materials. Here, we report experimental demonstration of second harmonic generation from telecom to near visible wavelengths on an etchless lithium niobate platform by using a photonic BIC for the second harmonic mode. The devices feature second harmonic conversion efficiency of 0.175 W 1cm 2 and excellent thermal stability with a wavelength shift of only 1.7 nm from 25 deg C to 100 deg C. Our results represent a new paradigm of nonlinear integrated photonics on a cost effective and convenient platform, which can enable a broad range of on chip applications such as optical parametric generation, signal processing, and quantum photonics.


Generalized Steinberg Relations. We consider a field F and positive integers n , m , such that m is not divisible by mathrm Char (F) and is prime to n! . The absolute Galois group G F acts on the group mathbb U n( mathbb Z m) of all (n 1) times(n 1) unipotent upper triangular matrices over mathbb Z m cyclotomically. Given 0,1 neq z in F and an arbitrary list w of n Kummer elements (z) F , (1 z) F in H 1(G F, mu m) , we construct in a canonical way a quotient mathbb U w of mathbb U n( mathbb Z m) and a cohomology element rho z in H 1(G F, mathbb U w) whose projection to the superdiagonal is the prescribed list. This extends results by Wickelgren, and in the case n 2 recovers the Steinberg relation in Galois cohomology, proved by Tate.


Existence of a weak solution to a nonlinear fluid structure interaction problem with heat exchange. In this paper, we study a nonlinear interaction problem between a thermoelastic shell and a heat conducting fluid. The shell is governed by linear thermoelasticity equations and encompasses a time dependent domain which is filled with a fluid governed by the full Navier Stokes Fourier system. The fluid and the shell are fully coupled, giving rise to a novel nonlinear moving boundary fluid structure interaction problem involving heat exchange. The existence of a weak solution is obtained by combining three approximation techniques decoupling, penalization and domain extension. This approximation scheme allows us to use the methods already developed for fluids on moving domains, thus drastically simplifying the analysis at hand.


Topological Deep Learning. This work introduces the Topological CNN (TCNN), which encompasses several topologically defined convolutional methods. Manifolds with important relationships to the natural image space are used to parameterize image filters which are used as convolutional weights in a TCNN. These manifolds also parameterize slices in layers of a TCNN across which the weights are localized. We show evidence that TCNNs learn faster, on less data, with fewer learned parameters, and with greater generalizability and interpretability than conventional CNNs. We introduce and explore TCNN layers for both image and video data. We propose extensions to 3D images and 3D video.


A Portable, Self Contained Neuroprosthetic Hand with Deep Learning Based Finger Control. Objective Deep learning based neural decoders have emerged as the prominent approach to enable dexterous and intuitive control of neuroprosthetic hands. Yet few studies have materialized the use of deep learning in clinical settings due to its high computational requirements. Methods Recent advancements of edge computing devices bring the potential to alleviate this problem. Here we present the implementation of a neuroprosthetic hand with embedded deep learning based control. The neural decoder is designed based on the recurrent neural network (RNN) architecture and deployed on the NVIDIA Jetson Nano a compacted yet powerful edge computing platform for deep learning inference. This enables the implementation of the neuroprosthetic hand as a portable and self contained unit with real time control of individual finger movements. Results The proposed system is evaluated on a transradial amputee using peripheral nerve signals (ENG) with implanted intrafascicular microelectrodes. The experiment results demonstrate the system's capabilities of providing robust, high accuracy (95 99 ) and low latency (50 120 msec) control of individual finger movements in various laboratory and real world environments. Conclusion Modern edge computing platforms enable the effective use of deep learning based neural decoders for neuroprosthesis control as an autonomous system. Significance This work helps pioneer the deployment of deep neural networks in clinical applications underlying a new class of wearable biomedical devices with embedded artificial intelligence.


Bifurcations for Hamiltonian systems via dual variational principle. In this paper we study bifurcations for generalized periodic Hamiltonian systems via the Clarke Ekeland dual variational principle and the abstract bifurcation theory developed in author's previous paper or their proof ideas. Many new results are obtained without any restrictions of growth on Hamiltonian functions.


DANNet A One Stage Domain Adaptation Network for Unsupervised Nighttime Semantic Segmentation. Semantic segmentation of nighttime images plays an equally important role as that of daytime images in autonomous driving, but the former is much more challenging due to poor illuminations and arduous human annotations. In this paper, we propose a novel domain adaptation network (DANNet) for nighttime semantic segmentation without using labeled nighttime image data. It employs an adversarial training with a labeled daytime dataset and an unlabeled dataset that contains coarsely aligned day night image pairs. Specifically, for the unlabeled day night image pairs, we use the pixel level predictions of static object categories on a daytime image as a pseudo supervision to segment its counterpart nighttime image. We further design a re weighting strategy to handle the inaccuracy caused by misalignment between day night image pairs and wrong predictions of daytime images, as well as boost the prediction accuracy of small objects. The proposed DANNet is the first one stage adaptation framework for nighttime semantic segmentation, which does not train additional day night image transfer models as a separate pre processing stage. Extensive experiments on Dark Zurich and Nighttime Driving datasets show that our method achieves state of the art performance for nighttime semantic segmentation.


Universality property of the S functional calculus, noncommuting matrix variables and Clifford operators. The spectral theory on the S spectrum was born out of the need to give quaternionic quantum mechanics (formulated by Birkhoff and von Neumann) a precise mathematical foundation. Then it turned out that this theory has important applications in several fields such as fractional diffusion problems and, moreover, it allows one to define several functional calculi for n tuples of noncommuting operators. With this paper we show that the spectral theory on the S spectrum is much more general and it contains, just as particular cases, the complex, the quaternionic and the Clifford settings. More precisely, we show that the S spectrum is well defined for objects in an algebra that has a complex structure and for operators in general Banach modules. We show that the abstract formulation of the S functional calculus goes beyond quaternionic and Clifford analysis. Indeed we show that the S functional calculus has a certain em universality property . This fact makes the spectral theory on the S spectrum applicable to several fields of operator theory and allows one to define functions of noncommuting matrix variables, and operator variables, as a particular case.


Visual Object Tracking with Discriminative Filters and Siamese Networks A Survey and Outlook. Accurate and robust visual object tracking is one of the most challenging and fundamental computer vision problems. It entails estimating the trajectory of the target in an image sequence, given only its initial location, and segmentation, or its rough approximation in the form of a bounding box. Discriminative Correlation Filters (DCFs) and deep Siamese Networks (SNs) have emerged as dominating tracking paradigms, which have led to significant progress. Following the rapid evolution of visual object tracking in the last decade, this survey presents a systematic and thorough review of more than 90 DCFs and Siamese trackers, based on results in nine tracking benchmarks. First, we present the background theory of both the DCF and Siamese tracking core formulations. Then, we distinguish and comprehensively review the shared as well as specific open research challenges in both these tracking paradigms. Furthermore, we thoroughly analyze the performance of DCF and Siamese trackers on nine benchmarks, covering different experimental aspects of visual tracking datasets, evaluation metrics, performance, and speed comparisons. We finish the survey by presenting recommendations and suggestions for distinguished open challenges based on our analysis.


Topology for Substrate Routing in Semiconductor Package Design. In this work, we propose a new signal routing method for solving routing problems that occur in the design process of semiconductor package substrates. Our work uses a topological transformation of the layers of the package substrate in order to simplify the routing problem into a problem of connecting points on a circle with non intersecting straight line segments. The circle, which we call the Circular Frame, is a polygonal schema, which is originally used in topology to study the topological structure of 2 manifolds. We show through experiments that our new routing method based on the Circular Frame competes with certain grid based routing algorithms.


Blow up of solutions of critical elliptic equation in three dimensions. We describe the asymptotic behavior of positive solutions u epsilon of the equation Delta u au 3 ,u 5 epsilon in Omega subset mathbb R 3 with a homogeneous Dirichlet boundary condition. The function a is assumed to be critical in the sense of Hebey and Vaugon and the functions u epsilon are assumed to be an optimizing sequence for the Sobolev inequality. Under a natural nondegeneracy assumption we derive the exact rate of the blow up and the location of the concentration point, thereby proving a conjecture of Br 'ezis and Peletier (1989). Similar results are also obtained for solutions of the equation Delta u (a epsilon V) u 3 ,u 5 in Omega .


Lower bounds on Betti numbers. We survey recent results on bounds for Betti numbers of modules over polynomial rings, with an emphasis on lower bounds. Along the way, we give a gentle introduction to free resolutions and Betti numbers, and discuss some of the reasons why one would study these.


Total Roman 2 domination in graphs. Given a graph G (V,E) , a function f V rightarrow 0,1,2 is a total Roman 2 dominating function if (1) every vertex v in V for which f(v) 0 satisfies that sum u in N(v) f(u) geq 2 , where N(v) represents the open neighborhood of v , and (2) every vertex x in V for which f(x) geq 1 is adjacent to at least one vertex y in V such that f(y) geq 1 . The weight of the function f is defined as omega(f) sum v in V f(v) . The total Roman 2 domination number, denoted by gamma t R2 (G) , is the minimum weight among all total Roman 2 dominating functions on G . In this article we introduce the concepts above and begin the study of its combinatorial and computational properties. For instance, we give several closed relationships between this parameter and other domination related parameters in graphs. In addition, we prove that the complexity of computing the value gamma t R2 (G) is NP hard, even when restricted to bipartite or chordal graphs.


Generalized Fractional Counting Process. In this paper, we obtain additional results for a fractional counting process introduced and studied by Di Crescenzo et al. (2016). For convenience, we call it the generalized fractional counting process (GFCP). It is shown that the one dimensional distributions of the GFCP are not infinitely divisible. Its covariance structure is studied using which its long range dependence property is established. It is shown that the increments of GFCP exhibits the short range dependence property. Also, we prove that the GFCP is a scaling limit of some continuous time random walk. A particular case of the GFCP, namely, the generalized counting process (GCP) is discussed for which we obtain a limiting result, a martingale result and establish a recurrence relation for its probability mass function. We have shown that many known counting processes such as the Poisson process of order k , the P 'olya Aeppli process of order k , the negative binomial process and their fractional versions etc. are other special cases of the GFCP. An application of the GCP to risk theory is discussed.


Equidistribution of affine random walks on some nilmanifolds. We study quantitative equidistribution in law of affine random walks on nilmanifolds, motivated by a result of Bourgain, Furman, Mozes and the third named author on the torus. Under certain assumptions, we show that a failure to having fast equidistribution is due to a failure on a factor nilmanifold. Combined with equidistribution results on the torus, this leads to an equidistribution statement on some nilmanifolds such as Heisenberg nilmanifolds. In an appendix we strengthen results of de Saxce and the first named author regarding random walks on the torus by eliminating an assumption on Zariski connectedness of the acting group.


Green Lazarsfeld property N p for Hibi rings. In this article, we prove some necessary conditions regarding when Hibi rings satisfy Green Lazarsfeld property N p for p 2 and 3 . We also show that if a Hibi ring satisfies property N 4 , then it is a polynomial ring or it has a linear resolution. Therefore, it satisfies property N p for all p geq 4 as well. Moreover, we show that if a Hibi ring satisfies property N 2 , then its Segre product with a polynomial ring in finitely many variables also satisfies property N 2 . When the polynomial ring is in two variables, we also prove the above statement for N 3 . Furthermore, we characterize complete intersection Hibi rings.


Axial constants and sectional regularity of homogeneous ideals. A notion of sectional regularity for a homogeneous ideal I , which measures the regularity of its generic sections with respect to linear spaces of various dimensions, is introduced. It is related to axial constants defined as the intercepts on the coordinate axes of the set of exponents of monomials in the reverse lexicographic generic initial ideal of I . The equivalence of these notions and several other homological and ideal theoretic invariants is shown. It is also established that these equivalent invariants grow linearly for the family of powers of a given ideal.


Dual backgrounds and their stability during chi (2) comb generation in microresonators. Light states relevant to the chi (2) comb generation in optical microresonators possess typically dual backgrounds for coupled first harmonic (FH) and second harmonic (SH) envelopes. Stability and or instability of these backgrounds is crucial for realization of stable chi (2) combs and also for an efficient SH generation. We explore the properties of the dual backgrounds and their instability for the cases of FH and SH pumping of the resonator. In contrast to the optical parameteric oscillation, the instability is controlled by a 4th degree characteristic equation for the increment. Coefficients of this equation depend not only on wavenumbers of the perturbations, the pump power, and dispersion parameters, but also on FH SH group velocity difference (temporal walk off). Our results include characterization of the regions and conditions of stability for the FH and SH pumping cases and different spectral ranges.


A new discrete distribution arising from a generalised random game and its asymptotic properties. The rules of a game of dice are extended to a "hyper die" with n in mathbb N equally probable faces, numbered from 1 to n . We derive recursive and explicit expressions for the probability mass function and the cumulative distribution function of the gain G n for arbitrary values of n . A numerical study suggests the conjecture that for n to infty the expectation of the scaled gain mathbb E H n mathbb E G n sqrt n , converges to sqrt pi ,2 . The conjecture is proved by deriving an analytic expression of the expected gain mathbb E G n . An analytic expression of the variance of the gain G n is derived by a similar technique. Finally, it is proved that H n converges weakly to the Rayleigh distribution with scale parameter 1.


Appropriate Fairness Perceptions? On the Effectiveness of Explanations in Enabling People to Assess the Fairness of Automated Decision Systems. It is often argued that one goal of explaining automated decision systems (ADS) is to facilitate positive perceptions (e.g., fairness or trustworthiness) of users towards such systems. This viewpoint, however, makes the implicit assumption that a given ADS is fair and trustworthy, to begin with. If the ADS issues unfair outcomes, then one might expect that explanations regarding the system's workings will reveal its shortcomings and, hence, lead to a decrease in fairness perceptions. Consequently, we suggest that it is more meaningful to evaluate explanations against their effectiveness in enabling people to appropriately assess the quality (e.g., fairness) of an associated ADS. We argue that for an effective explanation, perceptions of fairness should increase if and only if the underlying ADS is fair. In this in progress work, we introduce the desideratum of appropriate fairness perceptions, propose a novel study design for evaluating it, and outline next steps towards a comprehensive experiment.


Schematic Memory Persistence and Transience for Efficient and Robust Continual Learning. Continual learning is considered a promising step towards next generation Artificial Intelligence (AI), where deep neural networks (DNNs) make decisions by continuously learning a sequence of different tasks akin to human learning processes. It is still quite primitive, with existing works focusing primarily on avoiding (catastrophic) forgetting. However, since forgetting is inevitable given bounded memory and unbounded task loads, 'how to reasonably forget' is a problem continual learning must address in order to reduce the performance gap between AIs and humans, in terms of 1) memory efficiency, 2) generalizability, and 3) robustness when dealing with noisy data. To address this, we propose a novel ScheMAtic memory peRsistence and Transience (SMART) framework for continual learning with external memory that builds on recent advances in neuroscience. The efficiency and generalizability are enhanced by a novel long term forgetting mechanism and schematic memory, using sparsity and 'backward positive transfer' constraints with theoretical guarantees on the error bound. Robust enhancement is achieved using a novel short term forgetting mechanism inspired by background information gated learning. Finally, an extensive experimental analysis on both benchmark and real world datasets demonstrates the effectiveness and efficiency of our model.


Robust Hierarchical Clustering for Directed Networks An Axiomatic Approach. We provide a complete taxonomic characterization of robust hierarchical clustering methods for directed networks following an axiomatic approach. We begin by introducing three practical properties associated with the notion of robustness in hierarchical clustering linear scale preservation, stability, and excisiveness. Linear scale preservation enforces imperviousness to change in units of measure whereas stability ensures that a bounded perturbation in the input network entails a bounded perturbation in the clustering output. Excisiveness refers to the local consistency of the clustering outcome. Algorithmically, excisiveness implies that we can reduce computational complexity by only clustering a subset of our data while theoretically guaranteeing that the same hierarchical outcome would be observed when clustering the whole dataset. In parallel to these three properties, we introduce the concept of representability, a generative model for describing clustering methods through the specification of their action on a collection of networks. Our main result is to leverage this generative model to give a precise characterization of all robust i.e., excisive, linear scale preserving, and stable hierarchical clustering methods for directed networks. We also address the implementation of our methods and describe an application to real data.


Three way Mixed Effect ANOVA to Estimate MRMC Limits of Agreement. When evaluating the clinical performance of a medical imaging device, a multi reader multi case (MRMC) analysis is usually applied to account for both case and reader variability. For a clinical task that equates to a quantitative measurement, an agreement analysis such as a limits of agreement (LOA) method can be used to compare different measurement methods. In this work, we introduce four types of comparisons these types differ depending on whether the measurements are within or between readers and within or between modalities. A three way mixed effect ANOVA model is applied to estimate the variances of individual differences, which is an essential step for estimating LOA. To verify the estimates of LOA, we propose a hierarchical model to simulate quantitative MRMC data. Two simulation studies were conducted to validate both the simulation and the LOA variance estimates. From the simulation results, we can conclude that our estimate of variance is unbiased, and the uncertainty of the estimation drops as the number of readers and cases increases and rises as the value of true variance increases.


Analysis of Molecular Communications on the Growth Structure of Glioblastoma Multiforme. In this paper we consider the influence of intercellular communication on the development and progression of Glioblastoma Multiforme (GBM), a grade IV malignant glioma which is defined by an interplay Grow i.e. self renewal and Go i.e. invasiveness potential of multiple malignant glioma stem cells. Firstly, we performed wet lab experiments with U87 malignant glioma cells to study the node stem growth pattern of GBM. Next we develop a model accounting for the structural influence of multiple transmitter and receiver glioma stem cells resulting in the node stem growth structure of GBM tumour. By using information theory we study different properties associated with this communication model to show that the growth of GBM in a particular direction (node to stem) is related to an increase in mutual information. We further show that information flow between glioblastoma cells for different levels of invasiveness vary at different points between node and stem. These findings are expected to contribute significantly in the design of future therapeutic mechanisms for GBM.


The iWildCam 2021 Competition Dataset. Camera traps enable the automatic collection of large quantities of image data. Ecologists use camera traps to monitor animal populations all over the world. In order to estimate the abundance of a species from camera trap data, ecologists need to know not just which species were seen, but also how many individuals of each species were seen. Object detection techniques can be used to find the number of individuals in each image. However, since camera traps collect images in motion triggered bursts, simply adding up the number of detections over all frames is likely to lead to an incorrect estimate. Overcoming these obstacles may require incorporating spatio temporal reasoning or individual re identification in addition to traditional species detection and classification. We have prepared a challenge where the training data and test data are from different cameras spread across the globe. The set of species seen in each camera overlap, but are not identical. The challenge is to classify species and count individual animals across sequences in the test cameras.


Solving for best linear approximates. Our goal is to finally settle a persistent problem in Diophantine Approximation, that of finding best inhomogeneous linear approximates. Classical results from the theory of continued fractions solve the special homogeneous case in the form of a complete sequence of normal approximates. Real expansions that allow the notion of normality to percolate into the inhomogeneous setting will provide us with the general solution.


Learning to Drive on the Wrong Side of the Road How American Computing Came to Rely on Conferences for Primary Publication. In contrast to other fields where conferences are typically for less polished or in progress research, computing has long relied on referred conference papers as a venue for the final publication of completed research. While frequently a topic of informal discussion, debates about its efficacy, or library science research, the development of this phenomena has not been historically analyzed. This paper presents the first systematic investigation of the development of modern computing publications. It relies on semi structured interviews with eight computing professors from diverse backgrounds to understand how researchers experienced changes in publication culture over time. Ultimately, the article concludes that the early presence of non academic practitioners in research and a degree of "path dependence"or a tendency to continue on the established path rather than the most economically optimal one" allowed conferences to gain and hold prominence as the field exploded in popularity during the 1980s.


Prediction of dynamical systems using geometric constraints imposed by observations. Solution of Ordinary Differential Equation (ODE) model of dynamical system may not agree with its observed values. Often this discrepancy can be attributed to unmodeled forcings in the evolution rule of the dynamical system. In this article, an approach for data based model improvement is described which exploits the geometric constraints imposed by the system observations to estimate these unmodeled terms. The nominal model is augmented using these extra forcing terms to make predictions. This approach is applied to navigational satellite orbit prediction to bring down the error to approximately 12 of the error when using the nominal force model for a 2 hour prediction. In another example improved temperature predictions over the nominal heat equation are obtained for one dimensional conduction.


Stability Analysis of Fractional Order Memristor Synapse coupled Hopfield Neural Network with Ring Structure. In this paper, we first present a fractional order memristor synapse coupling Hopfield neural network on two neurons and then extend the model to a neural network with a ring structure that consists of n sub network neurons. Necessary and sufficient conditions for the stability of equilibrium points are investigated, highlighting the dependency of the stability on the fractional order value and the number of neurons. Numerical simulations and bifurcation analysis, along with Lyapunov exponents, are given in the two neuron case that substantiates the theoretical findings, suggesting possible routes towards chaos when the fractional order of the system increases. In the n neuron case also, it is revealed that the stability depends on the structure and number of sub networks.


ErrorCompensatedX error compensation for variance reduced algorithms. Communication cost is one major bottleneck for the scalability for distributed learning. One approach to reduce the communication cost is to compress the gradient during communication. However, directly compressing the gradient decelerates the convergence speed, and the resulting algorithm may diverge for biased compression. Recent work addressed this problem for stochastic gradient descent by adding back the compression error from the previous step. This idea was further extended to one class of variance reduced algorithms, where the variance of the stochastic gradient is reduced by taking a moving average over all history gradients. However, our analysis shows that just adding the previous step's compression error, as done in existing work, does not fully compensate the compression error. So, we propose ErrorCompensatedX, which uses the compression error from the previous two steps. We show that ErrorCompensatedX can achieve the same asymptotic convergence rate with the training without compression. Moreover, we provide a unified theoretical analysis framework for this class of variance reduced algorithms, with or without error compensation.


Extremal polynomials on a Jordan arc. Let Gamma be a C 2 Jordan arc and let Gamma 0 be the open arc which consists of interior points of Gamma . We find concrete upper and lower bounds for the limit of Widom factors for L 2( mu) extremal polynomials on Gamma which was given in 18 . In addition, we show that the upper bound for the limit supremum of Widom factors for the weighted Chebyshev polynomials which was obtained in 18 can be improved once two normal derivatives of the Green function do not agree at one point z in Gamma 0 . We also show that if Gamma 0 is not analytic then we have improved upper bounds.


Assessing Human Interaction in Virtual Reality With Continually Learning Prediction Agents Based on Reinforcement Learning Algorithms A Pilot Study. Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research has hitherto under explored interactions that occur while the system is actively learning, and can noticeably change its behaviour in minutes. In this pilot study, we investigate how the interaction between a human and a continually learning prediction agent develops as the agent develops competency. Additionally, we compare two different agent architectures to assess how representational choices in agent design affect the human agent interaction. We develop a virtual reality environment and a time based prediction task wherein learned predictions from a reinforcement learning (RL) algorithm augment human predictions. We assess how a participant's performance and behaviour in this task differs across agent types, using both quantitative and qualitative analyses. Our findings suggest that human trust of the system may be influenced by early interactions with the agent, and that trust in turn affects strategic behaviour, but limitations of the pilot study rule out any conclusive statement. We identify trust as a key feature of interaction to focus on when considering RL based technologies, and make several recommendations for modification to this study in preparation for a larger scale investigation. A video summary of this paper can be found at https youtu.be oVYJdnBqTwQ .


On the Shorey Tijdeman Diophantine equation involving terms of Lucas sequences. Let r ge 1 be an integer and bf U U n n ge 0 be the Lucas sequence given by U 0 0, U 1 1 , and U n 2 rU n 1 U n for n ge 0 . In this paper, we explain how to find all the solutions of the Diophantine equation, AU n BU m CU n 1 DU m 1 , in integers r ge 1 , 0 le m n, 0 le m 1 n 1 , AU n ne CU n 1 , where A,B,C,D are given integers with A ne 0, B ne 0 , m,n,m 1,n 1 are nonnegative integer unknowns and r is also unknown.


Active Tuning of Resonant Lattice Kerker Effect. The Kerker effect has been generalized in nanophotonics and meta optics, and has recently been of great interest by relating to various fascinating functionalities such as scattering management and perfect transmission, reflection or absorption. One of the most interesting generalizations is the resonant lattice Kerker effect in periodic nanostructures. However, its active tuning has not been explored yet. Here, we report, for the first time, the active control of the resonant lattice Kerker effect in periodic Ge2Se2Te5 nanodisks. By changing the crystalline fraction, we show that the electric dipole lattice resonance (ED LR), the magnetic dipole resonance (MDR), and thus the resonant lattice Kerker effect are all red shifted. We therefore realize the transition from the ED LR to the resonant lattice Kerker effect, which enables multilevel tuning of reflection, transmission and absorption with modulation depths above 86 . Taking advantage of the MDR redshifts, we also observe broadband and multilevel tuning of transmission with modulation depth of 87 over a broadband range of 588 nm. Our work establishes a new path for designing high performance active nanophotonic devices.


A Unified Pre training Framework for Conversational AI. In this work, we explore the application of PLATO 2 on various dialogue systems, including open domain conversation, knowledge grounded dialogue, and task oriented conversation. PLATO 2 is initially designed as an open domain chatbot, trained via two stage curriculum learning. In the first stage, a coarse grained response generation model is learned to fit the simplified one to one mapping relationship. This model is applied to the task oriented conversation, given that the semantic mappings tend to be deterministic in task completion. In the second stage, another fine grained generation model and an evaluation model are further learned for diverse response generation and coherence estimation, respectively. With superior capability on capturing one to many mapping, such models are suitable for the open domain conversation and knowledge grounded dialogue. For the comprehensive evaluation of PLATO 2, we have participated in multiple tasks of DSTC9, including interactive evaluation of open domain conversation (Track3 task2), static evaluation of knowledge grounded dialogue (Track3 task1), and end to end task oriented conversation (Track2 task1). PLATO 2 has obtained the 1st place in all three tasks, verifying its effectiveness as a unified framework for various dialogue systems.


Exponentially Handsome Proof Nets and Their Normalization. Handsome proof nets were introduced by Retor 'e as a syntax for multiplicative linear logic. These proof nets are defined by means of cographs (graphs representing formulas) equipped with a vertices partition satisfying simple topological conditions. In this paper we extend this syntax to multiplicative linear logic with units and exponentials. For this purpose we develop a new sound and complete sequent system for the logic, enforcing a stronger notion of proof equivalence with respect to the one usually considered in the literature. We then define combinatorial proofs, a graphical proof system able to capture syntactically the proof equivalence, for the cut free fragment of the calculus. We conclude the paper by defining the exponentially handsome proof nets as combinatorial proofs with cuts and defining an internal normalization procedure for this syntax.


Dynamics of nonlinear hyperbolic equations of Kirchhoff type. In this paper, we study the initial boundary value problem of the important hyperbolic Kirchhoff equation u tt left(a int Omega nabla u 2 dif x b right) Delta u lambda u u p 1 u , where a , b 0 , p 1 , lambda in mathbb R and the initial energy is arbitrarily large. We prove several new theorems on the dynamics such as the boundedness or finite time blow up of solution under the different range of a , b , lambda and the initial data for the following cases (i) 1 p 3 , (ii) p 3 and a 1 Lambda , (iii) p 3 , a leq 1 Lambda and lam b lam 1 , (iv) p 3 , a 1 Lambda and lam b lam 1 , (v) p 3 and lam leq b lam 1 , (vi) p 3 and lam b lam 1 , where lam 1 inf left nabla u 2 2 u in H 1 0( Omega) rm and u 2 1 right , and Lambda inf left nabla u 4 2 u in H 1 0( Omega) rm and u 4 1 right . Moreover, we prove the invariance of some stable and unstable sets of the solution for suitable a , b and lam , and give the sufficient conditions of initial data to generate a vacuum region of the solution. Due to the nonlocal effect caused by the nonlocal integro differential term, we show many interesting differences between the blow up phenomenon of the problem for a 0 and a 0 .


Hierarchical Variational Memory for Few shot Learning Across Domains. Neural memory enables fast adaptation to new tasks with just a few training samples. Existing memory models store features only from the single last layer, which does not generalize well in presence of a domain shift between training and test distributions. Rather than relying on a flat memory, we propose a hierarchical alternative that stores features at different semantic levels. We introduce a hierarchical prototype model, where each level of the prototype fetches corresponding information from the hierarchical memory. The model is endowed with the ability to flexibly rely on features at different semantic levels if the domain shift circumstances so demand. We meta learn the model by a newly derived hierarchical variational inference framework, where hierarchical memory and prototypes are jointly optimized. To explore and exploit the importance of different semantic levels, we further propose to learn the weights associated with the prototype at each level in a data driven way, which enables the model to adaptively choose the most generalizable features. We conduct thorough ablation studies to demonstrate the effectiveness of each component in our model. The new state of the art performance on cross domain and competitive performance on traditional few shot classification further substantiates the benefit of hierarchical variational memory.


Absent Subsequences in Words. An absent factor of a string w is a string u which does not occur as a contiguous substring (a.k.a. factor) inside w . We extend this well studied notion and define absent subsequences a string u is an absent subsequence of a string w if u does not occur as subsequence (a.k.a. scattered factor) inside w . Of particular interest to us are minimal absent subsequences, i.e., absent subsequences whose every subsequence is not absent, and shortest absent subsequences, i.e., absent subsequences of minimal length. We show a series of combinatorial and algorithmic results regarding these two notions. For instance we give combinatorial characterisations of the sets of minimal and, respectively, shortest absent subsequences in a word, as well as compact representations of these sets we show how we can test efficiently if a string is a shortest or minimal absent subsequence in a word, and we give efficient algorithms computing the lexicographically smallest absent subsequence of each kind also, we show how a data structure for answering shortest absent subsequence queries for the factors of a given string can be efficiently computed.


Newton Okounkov body, Rees algebra, and analytic spread of graded families of monomial ideals. Let mathcal I I k k in mathbb N be a graded family of monomial ideal. We use the Newton Okounkov body of mathcal I to (a) give a characterization for the Noetherian property of the Rees algebra of the family and (b) present a combinatorial interpretation for the analytic spread of the family. We also apply these results to investigate the generation type and the Veronese degree of the symbolic Rees algebra of a monomial ideal.


STRIVE Scene Text Replacement In Videos. We propose replacing scene text in videos using deep style transfer and learned photometric transformations.Building on recent progress on still image text replacement,we present extensions that alter text while preserving the appearance and motion characteristics of the original video.Compared to the problem of still image text replacement,our method addresses additional challenges introduced by video, namely effects induced by changing lighting, motion blur, diverse variations in camera object pose over time,and preservation of temporal consistency. We parse the problem into three steps. First, the text in all frames is normalized to a frontal pose using a spatio temporal trans former network. Second, the text is replaced in a single reference frame using a state of art still image text replacement method. Finally, the new text is transferred from the reference to remaining frames using a novel learned image transformation network that captures lighting and blur effects in a temporally consistent manner. Results on synthetic and challenging real videos show realistic text trans fer, competitive quantitative and qualitative performance,and superior inference speed relative to alternatives. We introduce new synthetic and real world datasets with paired text objects. To the best of our knowledge this is the first attempt at deep video text replacement.


Prediction of Metacarpophalangeal joint angles and Classification of Hand configurations based on Ultrasound Imaging of the Forearm. With the advancement in computing and robotics, it is necessary to develop fluent and intuitive methods for interacting with digital systems, AR VR interfaces, and physical robotic systems. Hand movement recognition is widely used to enable this interaction. Hand configuration classification and Metacarpophalangeal (MCP) joint angle detection are important for a comprehensive reconstruction of the hand motion. Surface electromyography and other technologies have been used for the detection of hand motions. Ultrasound images of the forearm offer a way to visualize the internal physiology of the hand from a musculoskeletal perspective. Recent work has shown that these images can be classified using machine learning to predict various hand configurations. In this paper, we propose a Convolutional Neural Network (CNN) based deep learning pipeline for predicting the MCP joint angles. We supplement our results by using a Support Vector Classifier (SVC) to classify the ultrasound information into several predefined hand configurations based on activities of daily living (ADL). Ultrasound data from the forearm was obtained from 6 subjects who were instructed to move their hands according to predefined hand configurations relevant to ADLs. Motion capture data was acquired as the ground truth for hand movements at different speeds (0.5 Hz, 1 Hz, 2 Hz) for the index, middle, ring, and pinky fingers. We were able to get promising SVC classification results on a subset of our collected data set. We demonstrated a correspondence between the predicted MCP joint angles and the actual MCP joint angles for the fingers, with an average root mean square error of 7.35 degrees. We implemented a low latency (6.25 9.1 Hz) pipeline for the prediction of both MCP joint angles and hand configuration estimation aimed at real time control of digital devices, AR VR interfaces, and physical robots.


Minimizing Nonsmooth Convex Functions with Variable Accuracy. We consider unconstrained optimization problems with nonsmooth and convex objective function in the form of mathematical expectation. The proposed method approximates the objective function with a sample average function by using different sample size in each iteration. The sample size is chosen in an adaptive manner based on the Inexact Restoration. The method uses line search and assumes descent directions with respect to the current approximate function. We prove the almost sure convergence under the standard assumptions. The convergence rate is also considered and the worst case complexity of mathcal O ( varepsilon 2 ) is proved. Numerical results for two types of problems, machine learning hinge loss and stochastic linear complementarity problems, show the efficiency of the proposed scheme.


Rapid and Accurate Detection of SARS CoV 2 Mutations using a Cas12a based Sensing Platform. The increasing prevalence of SARS CoV 2 variants with spike mutations has raised concerns owing to higher transmission rates, disease severity, and escape from neutralizing antibodies. Rapid and accurate detection of SARS CoV 2 variants provides crucial information concerning the outbreaks of SARS CoV 2 variants and possible lines of transmission. This information is vital for infection prevention and control. We used a Cas12a based RT PCR combined with CRISPR on site rapid detection system (RT CORDS) platform to detect the key mutations in SARS COV 2 variants, such as 69 70 deletion, N501Y, and D614G. We used type specific CRISPR RNAs (crRNAs) to identify wild type (crRNA W) and mutant (crRNA M) sequences of SARS CoV 2. We successfully differentiated mutant variants from wild type SARS CoV 2 with a sensitivity of 10 17 M (approximately 6 copies mu L). The assay took just 10 min with the Cas12a crRNA reaction after a simple RT PCR using a fluorescence reporting system. In addition, a sensitivity of 10 16 M could be achieved when lateral flow strips were used as readouts. The accuracy of RT CORDS for SARS CoV 2 variant detection was 100 consistent with the sequencing data. In conclusion, using the RT CORDS platform, we accurately, sensitively, specifically, and rapidly detected SARS CoV 2 variants. This method may be used in clinical diagnosis.


GSSF A Generative Sequence Similarity Function based on a Seq2Seq model for clustering online handwritten mathematical answers. Toward a computer assisted marking for descriptive math questions,this paper presents clustering of online handwritten mathematical expressions (OnHMEs) to help human markers to mark them efficiently and reliably. We propose a generative sequence similarity function for computing a similarity score of two OnHMEs based on a sequence to sequence OnHME recognizer. Each OnHME is represented by a similarity based representation (SbR) vector. The SbR matrix is inputted to the k means algorithm for clustering OnHMEs. Experiments are conducted on an answer dataset (Dset Mix) of 200 OnHMEs mixed of real patterns and synthesized patterns for each of 10 questions and a real online handwritten mathematical answer dataset of 122 student answers at most for each of 15 questions (NIER CBT). The best clustering results achieved around 0.916 and 0.915 for purity, and around 0.556 and 0.702 for the marking cost on Dset Mix and NIER CBT, respectively. Our method currently outperforms the previous methods for clustering HMEs.


Understanding the Role of Self Supervised Learning in Out of Distribution Detection Task. Self supervised learning (SSL) has achieved great success in a variety of computer vision tasks. However, the mechanism of how SSL works in these tasks remains a mystery. In this paper, we study how SSL can enhance the performance of the out of distribution (OOD) detection task. We first point out two general properties that a good OOD detector should have 1) the overall feature space should be large and 2) the inlier feature space should be small. Then we demonstrate that SSL can indeed increase the intrinsic dimension of the overall feature space. In the meantime, SSL even has the potential to shrink the inlier feature space. As a result, there will be more space spared for the outliers, making OOD detection much easier. The conditions when SSL can shrink the inlier feature space is also discussed and validated. By understanding the role of SSL in the OOD detection task, our study can provide a guideline for designing better OOD detection algorithms. Moreover, this work can also shed light to other tasks where SSL can improve the performance.


Adam revisited a weighted past gradients perspective. Adaptive learning rate methods have been successfully applied in many fields, especially in training deep neural networks. Recent results have shown that adaptive methods with exponential increasing weights on squared past gradients (i.e., ADAM, RMSPROP) may fail to converge to the optimal solution. Though many algorithms, such as AMSGRAD and ADAMNC, have been proposed to fix the non convergence issues, achieving a data dependent regret bound similar to or better than ADAGRAD is still a challenge to these methods. In this paper, we propose a novel adaptive method weighted adaptive algorithm (WADA) to tackle the non convergence issues. Unlike AMSGRAD and ADAMNC, we consider using a milder growing weighting strategy on squared past gradient, in which weights grow linearly. Based on this idea, we propose weighted adaptive gradient method framework (WAGMF) and implement WADA algorithm on this framework. Moreover, we prove that WADA can achieve a weighted data dependent regret bound, which could be better than the original regret bound of ADAGRAD when the gradients decrease rapidly. This bound may partially explain the good performance of ADAM in practice. Finally, extensive experiments demonstrate the effectiveness of WADA and its variants in comparison with several variants of ADAM on training convex problems and deep neural networks.


Evolutionary Self Replication as a Mechanism for Producing Artificial Intelligence. Can reproduction alone in the context of survival produce intelligence in our machines? In this work, self replication is explored as a mechanism for the emergence of intelligent behavior in modern learning environments. By focusing purely on survival, while undergoing natural selection, evolved organisms are shown to produce meaningful, complex, and intelligent behavior, demonstrating creative solutions to challenging problems without any notion of reward or objectives. Atari and robotic learning environments are re defined in terms of natural selection, and the behavior which emerged in self replicating organisms during these experiments is described in detail.


Self Supervised Domain Adaptation for Diabetic Retinopathy Grading using Vessel Image Reconstruction. This paper investigates the problem of domain adaptation for diabetic retinopathy (DR) grading. We learn invariant target domain features by defining a novel self supervised task based on retinal vessel image reconstructions, inspired by medical domain knowledge. Then, a benchmark of current state of the art unsupervised domain adaptation methods on the DR problem is provided. It can be shown that our approach outperforms existing domain adaption strategies. Furthermore, when utilizing entire training data in the target domain, we are able to compete with several state of the art approaches in final classification accuracy just by applying standard network architectures and using image level labels.


Biogeography Based Optimization of RC structures including static soil structure interaction. A method to minimize the cost of the structural design of reinforced concrete structures using Biogeography Based Optimization, an evolutionary algorithm, is presented. SAP2000 is used as computational engine, taking into account modelling aspects such as static soil structure interaction (SSSI). The optimization problem is formulated to properly reflect an actual design problem, limiting e.g. the size of reinforcement bars to commercially available sections. Strategies to reduce the computational cost of the optimization procedure are proposed and an extensive parameter tuning was performed. The resulting tuned optimization algorithm allows to reduce the direct cost of the construction of a particular structure project with 21 compared to a design based on traditional criteria. We also evaluate the effect on the cost of the superstructure when SSSI is takeninto account.


VSR A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relations. Document layout analysis is crucial for understanding document structures. On this task, vision and semantics of documents, and relations between layout components contribute to the understanding process. Though many works have been proposed to exploit the above information, they show unsatisfactory results. NLP based methods model layout analysis as a sequence labeling task and show insufficient capabilities in layout modeling. CV based methods model layout analysis as a detection or segmentation task, but bear limitations of inefficient modality fusion and lack of relation modeling between layout components. To address the above limitations, we propose a unified framework VSR for document layout analysis, combining vision, semantics and relations. VSR supports both NLP based and CV based methods. Specifically, we first introduce vision through document image and semantics through text embedding maps. Then, modality specific visual and semantic features are extracted using a two stream network, which are adaptively fused to make full use of complementary information. Finally, given component candidates, a relation module based on graph neural network is incorported to model relations between components and output final results. On three popular benchmarks, VSR outperforms previous models by large margins. Code will be released soon.


Neural Distributed Source Coding. Distributed source coding is the task of encoding an input in the absence of correlated side information that is only available to the decoder. Remarkably, Slepian and Wolf showed in 1973 that an encoder that has no access to the correlated side information can asymptotically achieve the same compression rate as when the side information is available at both the encoder and the decoder. While there is significant prior work on this topic in information theory, practical distributed source coding has been limited to synthetic datasets and specific correlation structures. Here we present a general framework for lossy distributed source coding that is agnostic to the correlation structure and can scale to high dimensions. Rather than relying on hand crafted source modeling, our method utilizes a powerful conditional deep generative model to learn the distributed encoder and decoder. We evaluate our method on realistic high dimensional datasets and show substantial improvements in distributed compression performance.


Modeling Electrical Resistance Drift with Ultrafast Saturation of OTS Selectors. Crossbar array architecture is an essential design element for densely connected Non Volatile Memory(NVM) applications. To overcome intrinsic sneak current problem of crossbar arrays, each memory unit is serially attached to a selector unit with highly nonlinear current voltage (I V) characteristics. Recently, Ovonic Threshold Switching (OTS) materials are preferred as selectors due to their fabrication compatibility with PRAM, MRAM or ReRAM technologies however, OTS selectors suffer from the temporal drift of its threshold voltage. First, based on Poole Frenkel conduction, we present time and temperature dependent model that predicts temporally evolving I V characteristics,including threshold voltage of OTS selectors. Second, we report an ultrafast saturation ( sim 10 3 seconds) of the drift and extend the model to predict the time of drift saturation. Our model shows excellent agreement with OTS devices fabricated with 8 nm technology node at 25 deg C and 85 deg C ambient temperatures. The proposed model plays a significant role in understanding OTS device internals and the development of reliable threshold voltage jump table.


Repairing Pronouns in Translation with BERT Based Post Editing. Pronouns are important determinants of a text's meaning but difficult to translate. This is because pronoun choice can depend on entities described in previous sentences, and in some languages pronouns may be dropped when the referent is inferrable from the context. These issues can lead Neural Machine Translation (NMT) systems to make critical errors on pronouns that impair intelligibility and even reinforce gender bias. We investigate the severity of this pronoun issue, showing that (1) in some domains, pronoun choice can account for more than half of a NMT systems' errors, and (2) pronouns have a disproportionately large impact on perceived translation quality. We then investigate a possible solution fine tuning BERT on a pronoun prediction task using chunks of source side sentences, then using the resulting classifier to repair the translations of an existing NMT model. We offer an initial case study of this approach for the Japanese English language pair, observing that a small number of translations are significantly improved according to human evaluators.


Efficient algorithms for maximum induced matching problem in permutation and trapezoid graphs. We first design an mathcal O (n 2) solution for finding a maximum induced matching in permutation graphs given their permutation models, based on a dynamic programming algorithm with the aid of the sweep line technique. With the support of the disjoint set data structure, we improve the complexity to mathcal O (m n) . Consequently, we extend this result to give an mathcal O (m n) algorithm for the same problem in trapezoid graphs. By combining our algorithms with the current best graph identification algorithms, we can solve the MIM problem in permutation and trapezoid graphs in linear and mathcal O (n 2) time, respectively. Our results are far better than the best known mathcal O (mn) algorithm for the maximum induced matching problem in both graph classes, which was proposed by Habib et al.


On Adversarial Vulnerability of PHM algorithms An Initial Study. With proliferation of deep learning (DL) applications in diverse domains, vulnerability of DL models to adversarial attacks has become an increasingly interesting research topic in the domains of Computer Vision (CV) and Natural Language Processing (NLP). DL has also been widely adopted to diverse PHM applications, where data are primarily time series sensor measurements. While those advanced DL algorithms models have resulted in an improved PHM algorithms' performance, the vulnerability of those PHM algorithms to adversarial attacks has not drawn much attention in the PHM community. In this paper we attempt to explore the vulnerability of PHM algorithms. More specifically, we investigate the strategies of attacking PHM algorithms by considering several unique characteristics associated with time series sensor measurements data. We use two real world PHM applications as examples to validate our attack strategies and to demonstrate that PHM algorithms indeed are vulnerable to adversarial attacks.


Graph Based Topological Exploration Planning in Large Scale 3D Environments. Currently, state of the art exploration methods maintain high resolution map representations in order to optimize exploration goals in each step that maximizes information gain. However, during exploring, those "optimal" selections could quickly become obsolete due to the influx of new information, especially in large scale environments, and result in high frequency re planning that hinders the overall exploration efficiency. In this paper, we propose a graph based topological planning framework, building a sparse topological map in three dimensional (3D) space to guide exploration steps with high level intents so as to render consistent exploration maneuvers. Specifically, this work presents a novel method to estimate 3D space's geometry with convex polyhedrons. Then, the geometry information is utilized to group space into distinctive regions. And those regions are added as nodes into the topological map, directing the exploration process. We compared our method with the state of the art in simulated environments. The proposed method achieves higher space coverage and outperforms exploration efficiency by more than 40 during experiments. Finally, a field experiment was conducted to further evaluate the applicability of our method to empower efficient and robust exploration in real world environments.


Relation among n ary algebras and homotopy algebras. We present PL infty algebras in the form of composition of maps and show that a PL infty algebra V can be described by a nilpotent coderivation on coalgebra P V of degree 1 . Using coalgebra maps among T V , wedge V , P V , we show that every A infty algebra carries a PL infty algebra structure and every PL infty algebra carries an L infty algebra structure. In particular, we obtain a pre Lie n algebra structure on an arbitrary partially associative n algebra and deduce pre Lie n algebras are n Lie admissible.


Reifenberg flatness for almost minimizers of the perimeter under minimal assumptions. The aim of this note is to prove that almost minimizers of the perimeter are Reifenberg flat, for a very weak notion of minimality. The main observation is that smallness of the excess at some scale implies smallness of the excess at all smaller scales.


Angular momenta in fields from a rotational mechanical antenna. Mechanic antennas provide opportunities for human portable, VLF communications, where a rotational dipole emits EM signals with angular momenta. In this paper we analytically derive the electromagnetic fields from a rotational electric dipole using Fourier transform method, and find that the radiated fields from the rotational electric dipole carries nonzero energy flow density in both orbital and spin angular momentum (AM) parts by AM flux tensors. Intuitively, a rotation of a dipole induces a longitudinal orbital angular momentum and a longitudinal spin angular momentum both circulating in the rotation direction. And the binding force for the rotational electric dipole is then shown to result mainly from the Coulomb fields. We believe that our work can provide novel communication designs for portable mechanic antennas.


Images of multilinear polynomials on n times n upper triangular matrices over infinite fields. In this paper we prove that the image of multilinear polynomials evaluated on the algebra UT n(K) of n times n upper triangular matrices over an infinite field K equals J r , a power of its Jacobson ideal J J(UT n(K)) . In particular, this shows that the analogue of the Lvov Kaplansky conjecture for UT n(K) is true, solving a conjecture of Fagundes and de Mello. To prove that fact, we introduce the notion of commutator degree of a polynomial and characterize the multilinear polynomials of commutator degree r in terms of its coefficients. It turns out that the image of a multilinear polynomial f on UT n(K) is J r if and only if f has commutator degree r .


Uniqueness of L function with special class of meromorphic function under restricted sharing of sets. The purpose of the paper is to rectify a series of errors occurred in 2 , 17 , 20 for a particular situation. To get a fruitful solution and to overcome the issue, we introduce a new form of set sharing namely restricted set sharing, which is stronger than the usual one. We manipulate the newly introduced notion in this specific section of literature to resolve all the complications. Not only that we have subtly used the same sharing form to a well known unique range set 3 to settle a long time unsolved problem.


Totally nonnegative Grassmannians, Grassmann necklaces and quiver Grassmannians. Postnikov constructed a cellular decomposition of the totally nonnegative Grassmannians. The poset of cells can be described (in particular) via Grassmann necklaces. We study certain quiver Grassmannians for the cyclic quiver admitting a cellular decomposition, whose cells are naturally labeled by Grassmann necklaces. We show that the posets of cells coincide with the reversed cell posets of the cellular decomposition of the totally nonnegative Grassmannians. We investigate algebro geometric and combinatorial properties of these quiver Grassmannians. In particular, we describe the irreducible components, study the action of the automorphism groups of the underlying representations and describe the moment graphs. We also construct a resolution of singularities for each irreducible component the resolutions are defined as quiver Grassmannians for an extended cyclic quiver.


Learning to Diversify for Single Domain Generalization. Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability of multiple source domains, this paper considers a more realistic yet challenging scenario, namely Single Domain Generalization (Single DG), where only one source domain is available for training. In this scenario, the limited diversity may jeopardize the model generalization on unseen target domains. To tackle this problem, we propose a style complement module to enhance the generalization power of the model by synthesizing images from diverse distributions that are complementary to the source ones. More specifically, we adopt a tractable upper bound of mutual information (MI) between the generated and source samples and perform a two step optimization iteratively (1) by minimizing the MI upper bound approximation for each sample pair, the generated images are forced to be diversified from the source samples (2) subsequently, we maximize the MI between the samples from the same semantic category, which assists the network to learn discriminative features from diverse styled images. Extensive experiments on three benchmark datasets demonstrate the superiority of our approach, which surpasses the state of the art single DG methods by up to 25.14 .


A simple variational approach to Nonlinear Maxwell equations. We show that nonlinear Maxwell Equations in R 3 admit a convenient dual variational formulation that permits to prove the existence of nontrivial solutions via standard variational methods.


The Primitive Ideal Space of Groupoid C Algebras for Groupoids with Abelian Isotropy. We study the topology of the primitive ideal space of groupoid C algebras for groupoids with abelian isotropy. Our results include the known results for action groupoids with abelian stabilizers. Furthermore, we obtain complete results when the isotropy map is continuous except for jump discontinuities, and also when G is a unit space fixing extension of a proper groupoid by an abelian group bundle. We hope that our methods will be a springboard to further results of this type.


Congruence Filter Pairs, Adjoints and Leibniz Hierarchy. We review the notion of (finitary) filter pair as a tool for creating and analyzing logics. A filter pair can be seen as a presentation of a logic, given by presenting its lattice of theories as the image of a lattice homomorphism, with certain properties ensuring that the resulting logic is finitary and substitution invariant. Every finitary, substitution invariant logic arises from a filter pair. Particular classes of logics can be characterized as arising from special classes of filter pairs. We consider so called congruence filter pairs, i.e. filter pairs for which the domain of the lattice homomorphism is a lattice of congruences for some quasivariety. We show that the class of logics admitting a presentation by such a filter pair is exactly the class of logics having an algebraic semantics. We study the properties of a certain Galois connection coming with such filter pairs. We give criteria for a congruence filter pair to present a logic in some classes of the Leibniz hierarchy by means of this Galois connection, and its interplay with the Leibniz operator. As an application, we show a bridge theorem, stating that the amalgamation property implies the Craig interpolation property, for a certain class of logics including non protoalgebraic logics.


Golden Tortoise Beetle Optimizer A Novel Nature Inspired Meta heuristic Algorithm for Engineering Problems. This paper proposes a novel nature inspired meta heuristic algorithm called the Golden Tortoise Beetle Optimizer (GTBO) to solve optimization problems. It mimics golden tortoise beetle's behavior of changing colors to attract opposite sex for mating and its protective strategy that uses a kind of anal fork to deter predators. The algorithm is modeled based on the beetle's dual attractiveness and survival strategy to generate new solutions for optimization problems. To measure its performance, the proposed GTBO is compared with five other nature inspired evolutionary algorithms on 24 well known benchmark functions investigating the trade off between exploration and exploitation, local optima avoidance, and convergence towards the global optima is statistically significant. We particularly applied GTBO to two well known engineering problems including the welded beam design problem and the gear train design problem. The results demonstrate that the new algorithm is more efficient than the five baseline algorithms for both problems. A sensitivity analysis is also performed to reveal different impacts of the algorithm's key control parameters and operators on GTBO's performance.


Augmented Memory Computing Dynamically Augmented SRAM Storage for Data Intensive Applications. In this paper, we propose a novel memory centric scheme based on CMOS SRAM for acceleration of data intensive applications. Our proposal aims at dynamically increasing the on chip memory storage capacity of SRAM arrays on demand. The proposed scheme called Augmented Memory Computing allows an SRAM cell to operate in two different modes 1) the Normal mode and 2) the Augmented mode. In the Normal mode of operation, the SRAM cell functions like a standard 6 transistor (6T) SRAM cell, storing one bit of data in static format. While in the Augmented mode, each SRAM cell can store 1 bit of data (in a dynamic fashion). Specifically, we propose two novel SRAM cells an 8 transistor (8T) dual bit storage augmented cell and a 7 transistor (7T) ternary bit storage augmented cell. The proposed 8T dual bit SRAM cell when operated in the Augmented mode, can store a static bit of data while also, simultaneously, storing another bit in a dynamic form. Thus, when operated in Augmented mode, the 8T SRAM cell can store two bits of data one SRAM like data and one DRAM like data, thereby increasing or augmenting the memory storage capacity. On the other hand, the proposed 7T ternary bit storage augmented cell can either store a single SRAM data in Normal mode or can be configured to operate in Augmented mode, wherein it can store ternary data (3 levels (0,0), (0,1), (1,0)) in a dynamic manner. Thus, based on the mode of operation, the proposed augmented memory bit cells can either store one static bit of data or 1 bit of data in a dynamic format. We show the feasibility of our proposed bit cells through extensive simulations at Globalfoundries 22nm FDX node. It is worth mentioning, the novel scheme of augmented memory bit cells can be seamlessly combined with existing in memory computing approaches for added energy and throughput benefits.


Optimal control of parabolic equations a spectral calculus based approach. In this paper we consider a constrained parabolic optimal control problem. The cost functional is quadratic and it combines the distance of the trajectory of the system from the desired evolution profile together with the cost of a control. The constraint is given by a term measuring the distance between the final state and the desired state towards which the solution should be steered. The control enters the system through the initial condition. We present a geometric analysis of this problem and provide a closed form expression for the solution. This approach allows us to present the sensitivity analysis of this problem based on the resolvent estimates for the generator of the system. The numerical implementation is performed by exploring efficient rational Krylov approximation techniques that allow us to approximate a complex function of an operator by a series of linear problems. Our method does not depend on the actual choice of discretization. The main approximation task is to construct an efficient rational approximation of a generalized exponential function. It is well known that this class of functions allows exponentially convergent rational approximations, which, combined with the sensitivity analysis of the closed form solution, allows us to present a robust numerical method. Several case studies are presented to illustrate our results.


Hankel operators on domains with bounded intrinsic geometry. In this paper we consider Hankel operators on domains with bounded intrinsic geometry. For these domains we characterize the L 2 symbols where the associated Hankel operator is compact (respectively bounded) on the space of square integrable holomorphic functions.


Grassmann extrapolation of density matrices for Born Oppenheimer molecular dynamics. Born Oppenheimer Molecular Dynamics (BOMD) is a powerful but expensive technique. The main bottleneck in a density functional theory bomd calculation is the solution to the Kohn Sham (KS) equations, that requires an iterative procedure that starts from a guess for the density matrix. Converged densities from previous points in the trajectory can be used to extrapolate a new guess, however, the non linear constraint that an idempotent density needs to satisfy make the direct use of standard linear extrapolation techniques not possible. In this contribution, we introduce a locally bijective map between the manifold where the density is defined and its tangent space, so that linear extrapolation can be performed in a vector space while, at the same time, retaining the correct physical properties of the extrapolated density using molecular descriptors. We apply the method to real life, multiscale polarizable QM MM.


Formal Verification for Node Based Visual Scripts Using Symbolic Model Checking. Visual script languages with a node based interface have commonly been used in the video game industry. We examined the bug database obtained in the development of FINAL FANTASY XV (FFXV), and noticed that several types of bugs were caused by simple mis descriptions of visual scripts and could therefore be mechanically detected. We propose a method for the automatic verification of visual scripts in order to improve productivity of video game development. Our method can automatically detect those bugs by using symbolic model checking. We show a translation algorithm which can automatically convert a visual script to an input model for NuSMV that is an implementation of symbolic model checking. For a preliminary evaluation, we applied our method to visual scripts used in the production for FFXV. The evaluation results demonstrate that our method can detect bugs of scripts and works well in a reasonable time.


Diversity in Valuing Social Contact and Risk Tolerance Lead to the Emergence of Homophily in Populations Facing Infectious Threats. How self organization leads to the emergence of structure in social populations remains a fascinating and open question in the study of complex systems. One frequently observed structure that emerges again and again across systems is that of self similar community, i.e., homophily. We use a game theoretic perspective to explore a case in which individuals choose affiliation partnerships based on only two factors the value they place on having social contacts, and their risk tolerance for exposure to threat derived from social contact (e.g., infectious disease, threatening ideas, etc.). We show how diversity along just these two influences are sufficient to cause the emergence of self organizing homophily in the population. We further consider a case in which extrinsic social factors influence the desire to maintain particular social ties, and show the robustness of emergent homophilic patterns to these additional influences. These results demonstrate how observable population level homophily may arise out of individual behaviors that balance the value of social contacts against the potential risks associated with those contacts. We present and discuss these results in the context of outbreaks of infectious disease in human populations. Complementing the standard narrative about how social division alters epidemiological risk, we here show how epidemiological risk may deepen social divisions in human populations.


Towards Zero shot Commonsense Reasoning with Self supervised Refinement of Language Models. Can we get existing language models and refine them for zero shot commonsense reasoning? This paper presents an initial study exploring the feasibility of zero shot commonsense reasoning for the Winograd Schema Challenge by formulating the task as self supervised refinement of a pre trained language model. In contrast to previous studies that rely on fine tuning annotated datasets, we seek to boost conceptualization via loss landscape refinement. To this end, we propose a novel self supervised learning approach that refines the language model utilizing a set of linguistic perturbations of similar concept relationships. Empirical analysis of our conceptually simple framework demonstrates the viability of zero shot commonsense reasoning on multiple benchmarks.


Interaction Maxima in Distributed Systems. In this paper we study the maximum degree of interaction which may emerge in distributed systems. It is assumed that a distributed system is represented by a graph of nodes interacting over edges. Each node has some amount of data. The intensity of interaction over an edge is proportional to the product of the amounts of data in each node at either end of the edge. The maximum sum of interactions over the edges is searched for. This model can be extended to other interacting entities. For bipartite graphs and odd length cycles we prove that the greatest degree of interaction emerge when the whole data is concentrated in an arbitrary pair of neighbors. Equal partitioning of the load is shown to be optimum for complete graphs. Finally, we show that in general graphs for maximum interaction the data should be distributed equally between the nodes of the largest clique in the graph. We also present in this context a result of Motzkin and Straus from 1965 for the maximal interaction objective.


A note on "Existence and uniqueness of coexistence states for an elliptic system coupled in the linear part", by Hei Li Jun, Nonlinear Anal. Real World Appl. 5, 2004. In this short paper I report on a paper published in Nonlinear Analysis Real World Applications in 2004. There is a major mistake early in that paper which makes most of its claims false. The class of reaction diffusion systems considered in the paper has been the object of a renewed investigation in the past few years, by myself and others, and recent discoveries provide explicit counterexamples .


Sparse Push Communication Energy Efficient Decentralized Distributed Learning over Directed Time Varying Graphs with non IID Datasets. Current deep learning (DL) systems rely on a centralized computing paradigm which limits the amount of available training data, increases system latency, and adds privacy and security constraints. On device learning, enabled by decentralized and distributed training of DL models over peer to peer wirelessly connected edge devices, not only alleviate the above limitations but also enable next gen applications that need DL models to continuously interact and learn from their environment. However, this necessitates the development of novel training algorithms that train DL models over time varying and directed peer to peer graph structures while minimizing the amount of communication between the devices and also being resilient to non IID data distributions. In this work we propose, Sparse Push, a communication efficient decentralized distributed training algorithm that supports training over peer to peer, directed, and time varying graph topologies. The proposed algorithm enables 466x reduction in communication with only 1 degradation in performance when training various DL models such as ResNet 20 and VGG11 over the CIFAR 10 dataset. Further, we demonstrate how communication compression can lead to significant performance degradation in case of non IID datasets, and propose Skew Compensated Sparse Push algorithm that recovers this performance drop while maintaining similar levels of communication compression.