Multiorders in amenable group actions. The paper offers a thorough study of multiorders and their applications to measure preserving actions of countable amenable groups. By a multiorder on a countable group we mean any probability measure nu on the collection mathcal O of linear orders of type mathbb Z on G , invariant under the natural action of G on such orders. Every free measure preserving G action (X, mu,G) has a multiorder ( mathcal O, nu,G) as a factor and has the same orbits as the mathbb Z action (X, mu,S) , where S is the successor map determined by the multiorder factor. The sub sigma algebra Sigma mathcal O associated with the multiorder factor is invariant under S , which makes the corresponding mathbb Z action ( mathcal O, nu, tilde S) a factor of (X, mu,S) . We prove that the entropy of any G process generated by a finite partition of X , conditional with respect to Sigma mathcal O , is preserved by the orbit equivalence with (X, mu,S) . Furthermore, this entropy can be computed in terms of the so called random past, by a formula analogous to the one known for mathbb Z actions. This fact is applied to prove a variant of a result by Rudolph and Weiss. The original theorem states that orbit equivalence between free actions of countable amenable groups preserves conditional entropy with respect to a sub sigma algebra Sigma , as soon as the "orbit change" is Sigma measurable. In our variant, we replace the measurability assumption by a simpler one Sigma should be invariant under both actions and the actions on the resulting factor should be free. In conclusion we prove that the Pinsker sigma algebra of any G process can be identified (with probability 1) using the following algorithm (1) fix an arbitrary multiorder on G , (2) select any order from the support of that multiorder, (3) in the process, find the "remote past" along the selected order.


Round fold maps on 3 manifolds. We show that a closed orientable 3 dimensional manifold admits a round fold map into the plane, i.e. a fold map whose critical value set consists of disjoint simple closed curves isotopic to concentric circles, if and only if it is a graph manifold, generalizing the characterization for simple stable maps into the plane. Furthermore, we also give a characterization of closed orientable graph manifolds that admit directed round fold maps into the plane, i.e. round fold maps such that the number of regular fiber components of a regular value increases toward the central region in the plane.


Towards Interpretable Deep Metric Learning with Structural Matching. How do the neural networks distinguish two images? It is of critical importance to understand the matching mechanism of deep models for developing reliable intelligent systems for many risky visual applications such as surveillance and access control. However, most existing deep metric learning methods match the images by comparing feature vectors, which ignores the spatial structure of images and thus lacks interpretability. In this paper, we present a deep interpretable metric learning (DIML) method for more transparent embedding learning. Unlike conventional metric learning methods based on feature vector comparison, we propose a structural matching strategy that explicitly aligns the spatial embeddings by computing an optimal matching flow between feature maps of the two images. Our method enables deep models to learn metrics in a more human friendly way, where the similarity of two images can be decomposed to several part wise similarities and their contributions to the overall similarity. Our method is model agnostic, which can be applied to off the shelf backbone networks and metric learning methods. We evaluate our method on three major benchmarks of deep metric learning including CUB200 2011, Cars196, and Stanford Online Products, and achieve substantial improvements over popular metric learning methods with better interpretability. Code is available at https github.com wl zhao DIML


The Ikshana Hypothesis of Human Scene Understanding. In recent years, deep neural networks (DNNs) achieved state of the art performance on several computer vision tasks. However, the one typical drawback of these DNNs is the requirement of massive labeled data. Even though few shot learning methods address this problem, they often use techniques such as meta learning and metric learning on top of the existing methods. In this work, we address this problem from a neuroscience perspective by proposing a hypothesis named Ikshana, which is supported by several findings in neuroscience. Our hypothesis approximates the refining process of conceptual gist in the human brain while understanding a natural scene image. While our hypothesis holds no particular novelty in neuroscience, it provides a novel perspective for designing DNNs for vision tasks. By following the Ikshana hypothesis, we design a novel neural inspired CNN architecture named IkshanaNet. The empirical results demonstrate the effectiveness of our method by outperforming several baselines on the entire and subsets of the Cityscapes and the CamVid semantic segmentation benchmarks.


Circulant decomposition of a matrix and the eigenvalues of Toeplitz type matrices. We begin by showing that a n n matrix can be decomposed into a sum of 'n' circulant matrices with appropriate relaxations. We use Fast Fourier Transform (FFT) operations to perform a sparse similarity transformation representing only the dominant circulant components, to evaluate all eigenvalues of dense Toeplitz, block Toeplitz and other periodic or quasi periodic matrices, to a reasonable approximation in O(n 2) arithmetic operations. This sparse similarity transformation can be exploited for other evaluations as well.


On the primitivity of the AES 128 key schedule. The key scheduling algorithm in the AES is the component responsible for selecting from the master key the sequence of round keys to be xor ed to the partially encrypted state at each iteration. We consider here the group Gamma generated by the action of the AES 128 key scheduling operation, and we prove that the smallest group containing Gamma and all the translations of the message space is primitive. As a consequence, we obtain that no proper and non trivial subspace can be invariant under its action.


Smoothing Estimates of the Vlasov Poisson Landau System. In this work, we consider the smoothing effect of Vlasov Poisson Landau system for both hard and soft potential. In particular, we prove that any classical solutions becomes immediately smooth with respect to all variables. We also give a proof on the global existence to Vlasov Poisson Landau system with optimal large time decay. These results give the regularity to Vlasov Poisson Landau system. The proof is based on the time weighted energy method building upon the pseudo differential calculus.


CALText Contextual Attention Localization for Offline Handwritten Text. Recognition of Arabic like scripts such as Persian and Urdu is more challenging than Latin based scripts. This is due to the presence of a two dimensional structure, context dependent character shapes, spaces and overlaps, and placement of diacritics. Not much research exists for offline handwritten Urdu script which is the 10th most spoken language in the world. We present an attention based encoder decoder model that learns to read Urdu in context. A novel localization penalty is introduced to encourage the model to attend only one location at a time when recognizing the next character. In addition, we comprehensively refine the only complete and publicly available handwritten Urdu dataset in terms of ground truth annotations. We evaluate the model on both Urdu and Arabic datasets and show that contextual attention localization outperforms both simple attention and multi directional LSTM models.


Towards Language Based Mitigation of Traffic Analysis Attacks. Traffic analysis attacks pose a major risk for online security. Distinctive patterns in communication act as fingerprints, enabling adversaries to de anonymise communicating parties or to infer sensitive information. Despite the attacks being known for decades, practical solution are scarce. Network layer countermeasures have relied on black box padding schemes that require significant overheads in latency and bandwidth to mitigate the attacks, without fundamentally preventing them, and the problem has received little attention in the language based information flow literature. Language based methods provide a strong foundation for fundamentally addressing security issues, but previous work has overwhelmingly assumed that interactive programs communicate over secure channels, where messages are undetectable by unprivileged adversaries. This assumption is too strong for online communication where packets can be trivially observed by eavesdropping. In this paper we introduce SELENE, a small language for principled, provably secure communication over channels where packets are publicly observable, and we demonstrate how our program level defence can reduce the latency and bandwidth overheads induced compared with program agnostic defence mechanisms. We believe that our results constitute a step towards practical, secure online communication.


Attack Detection and Localization in Smart Grid with Image based Deep Learning. Smart grid's objective is to enable electricity and information to flow two way while providing effective, robust, computerized, and decentralized energy delivery. This necessitates the use of state estimation based techniques and real time analysis to ensure that effective controls are deployed properly. However, the reliance on communication technologies makes such systems susceptible to sophisticated data integrity attacks imposing serious threats to the overall reliability of smart grid. To detect such attacks, advanced and efficient anomaly detection solutions are needed. In this paper, a two stage deep learning based framework is carefully designed by embedding power system's characteristics enabling precise attack detection and localization. First, we encode temporal correlations of the multivariate power system time series measurements as 2D images using image based representation approaches such as Gramian Angular Field (GAF) and Recurrence Plot (RP) to obtain the latent data characteristics. These images are then utilized to build a highly reliable and resilient deep Convolutional Neural Network (CNN) based multi label classifier capable of learning both low and high level characteristics in the images to detect and discover the exact attack locations without leveraging any prior statistical assumptions. The proposed method is evaluated on the IEEE 57 bus system using real world load data. Also, a comparative study is carried out. Numerical results indicate that the proposed multi class cyber intrusion detection framework outperforms the current conventional and deep learning based attack detection methods.


Contextual Semantic Parsing for Multilingual Task Oriented Dialogues. Robust state tracking for task oriented dialogue systems currently remains restricted to a few popular languages. This paper shows that given a large scale dialogue data set in one language, we can automatically produce an effective semantic parser for other languages using machine translation. We propose automatic translation of dialogue datasets with alignment to ensure faithful translation of slot values and eliminate costly human supervision used in previous benchmarks. We also propose a new contextual semantic parsing model, which encodes the formal slots and values, and only the last agent and user utterances. We show that the succinct representation reduces the compounding effect of translation errors, without harming the accuracy in practice. We evaluate our approach on several dialogue state tracking benchmarks. On RiSAWOZ, CrossWOZ, CrossWOZ EN, and MultiWOZ ZH datasets we improve the state of the art by 11 , 17 , 20 , and 0.3 in joint goal accuracy. We present a comprehensive error analysis for all three datasets showing erroneous annotations can obscure judgments on the quality of the model. Finally, we present RiSAWOZ English and German datasets, created using our translation methodology. On these datasets, accuracy is within 11 of the original showing that high accuracy multilingual dialogue datasets are possible without relying on expensive human annotations.


Faster than Nyquist Signaling for MIMO Communications. Faster than Nyquist (FTN) signaling is a non orthogonal transmission technique, which has the potential to provide significant spectral efficiency improvement. This paper studies the capacity of FTN signaling for both frequency flat and for frequency selective multiple input multiple output (MIMO) channels. We show that precoding in time and waterfilling in space is capacity achieving for frequency flat MIMO FTN. For frequency selective fading, joint waterfilling in time, space and frequency is required.


Analyzing the Behavior of Soccer Fans from a Mobile Phone Network Perspective Euro 2016, a Case Study. In this study, we analyzed one month of Call Detail Records, covering Budapest in June, 2016. During this observation period, the 2016 UEFA European Football Championship took place, where the Hungarian national football team did well, beyond expectations. This case study focuses on the fans' behavior in Budapest, during and after the Hungarian matches, from the perspective of the mobile phone network data. Tense rooting, joy of scoring a goal, self forgetting celebration because of winning the group. All of these have an effect on the data, that can be simply revealed. We used descriptive statistical methods to analyze the available data set, and managed to demonstrate the potential of this kind of data at social sensing. We found that the mobile phone network activity reflects the football fans' behavior, even if the match is played in another country.


Forcing the Pi 1 n Uniformization Property. We generically construct a model in which the Pi 1 3 uniformization property is true, thus lowering the best known consistency strength from the existence of M 1 to just mathsf ZFC . The forcing construction can be adapted to work over canonical inner models with Woodin cardinals, which yields, for the first time, universes where the Pi 1 2n uniformization property holds, thus producing models which contradict the natural mathsf PD induced pattern. It can also be used to obtain models for the Pi 1 1 uniformization property in the generalized Baire space.


LightIoT Lightweight and Secure Communication for Energy Efficient IoT in Health Informatics. Internet of Things (IoT) is considered as a key enabler of health informatics. IoT enabled devices are used for in hospital and in home patient monitoring to collect and transfer biomedical data pertaining to blood pressure, electrocardiography (ECG), blood sugar levels, body temperature, etc. Among these devices, wearables have found their presence in a wide range of healthcare applications. These devices generate data in real time and transmit them to nearby gateways and remote servers for processing and visualization. The data transmitted by these devices are vulnerable to a range of adversarial threats, and as such, privacy and integrity need to be preserved. In this paper, we present LightIoT, a lightweight and secure communication approach for data exchanged among the devices of a healthcare infrastructure. LightIoT operates in three phases initialization, pairing, and authentication. These phases ensure the reliable transmission of data by establishing secure sessions among the communicating entities (wearables, gateways and a remote server). Statistical results exhibit that our scheme is lightweight, robust, and resilient against a wide range of adversarial attacks and incurs much lower computational and communication overhead for the transmitted data in the presence of existing approaches.


Sentiment Aware Measure (SAM) for Evaluating Sentiment Transfer by Machine Translation Systems. In translating text where sentiment is the main message, human translators give particular attention to sentiment carrying words. The reason is that an incorrect translation of such words would miss the fundamental aspect of the source text, i.e. the author's sentiment. In the online world, MT systems are extensively used to translate User Generated Content (UGC) such as reviews, tweets, and social media posts, where the main message is often the author's positive or negative attitude towards the topic of the text. It is important in such scenarios to accurately measure how far an MT system can be a reliable real life utility in transferring the correct affect message. This paper tackles an under recognised problem in the field of machine translation evaluation which is judging to what extent automatic metrics concur with the gold standard of human evaluation for a correct translation of sentiment. We evaluate the efficacy of conventional quality metrics in spotting a mistranslation of sentiment, especially when it is the sole error in the MT output. We propose a numerical sentiment closeness' measure appropriate for assessing the accuracy of a translated affect message in UGC text by an MT system. We will show that incorporating this sentiment aware measure can significantly enhance the correlation of some available quality metrics with the human judgement of an accurate translation of sentiment.


A Need finding Study for Understanding Text Entry in Smartphone App Usage. Text entry makes up about one fourth of the smartphone interaction events, and is known to be challenging and difficult. However, there has been little study about the characteristics of text entry in the context of smartphone app usage. In this paper, we present a mixed method in situ study conducted in 2016 with 17 active smartphone users to better understand text entry in smartphone app usage. Our results show 80 of text was entered into communication apps, with different apps exhibiting distinct usage patterns. We found that structured data such as URLs and email addresses are rarely typed but instead are auto completed or replaced with search, copy and paste is rarely used, and sessions of smartphone usage with text entry involve more apps and last longer. We conclude with a discussion about the implications on the development of systems to better support mobile interaction.


Towards Practical Watermark for Deep Neural Networks in Federated Learning. With the wide application of deep neural networks, it is important to verify a host's possession over a deep neural network model and protect the model. To meet this goal, various mechanisms have been designed. By embedding extra information into a network and revealing it afterward, the watermark becomes a competitive candidate in proving integrity for deep learning systems. However, concurrent watermarking schemes can hardly be adopted for emerging distributed learning paradigms that raise extra requirements during the ownership verification. A spearheading distributed learning paradigm is federated learning (FL) where many parties participate in training one single model. Each author participating in the FL should be able to verify its ownership independently. Moreover, there are other potential threat and corresponding security requirements under this scenario. To meet those requirements, in this paper, we demonstrate a watermarking protocol for protecting deep neural networks in the setting of FL. By incorporating the state of the art watermarking scheme and the cryptological primitive designed for distributed storage, the protocol meets the need for ownership verification in the FL scenario without violating the privacy for each participant. This work paves the way for generalizing watermark as a practical security mechanism for protecting deep learning models in distributed learning platforms.


Conjugate Distribution Laws in Cultural Evolution via Statistical Learning. Many cultural traits characterizing intelligent behaviors are now thought to be transmitted through statistical learning, motivating us to study its effects on cultural evolution. We conduct a large scale music data analysis and observe that various statistical parameters of musical products approximately follow the beta distribution and other conjugate distributions. We construct a simple model of cultural evolution incorporating statistical learning and analytically show that conjugate distributions emerge at equilibrium in the presence of oblique transmission. The results demonstrate that the distribution of a cultural trait within a population depends on the individual's model for cultural production (the conjugate distribution law), and reveal interesting possibilities for theoretical and experimental studies on cultural evolution and social learning.


Logical Characterization of Coherent Uninterpreted Programs. An uninterpreted program (UP) is a program whose semantics is defined over the theory of uninterpreted functions. This is a common abstraction used in equivalence checking, compiler optimization, and program verification. While simple, the model is sufficiently powerful to encode counter automata, and, hence, undecidable. Recently, a class of UP programs, called coherent, has been proposed and shown to be decidable. We provide an alternative, logical characterization, of this result. Specifically, we show that every coherent program is bisimilar to a finite state system. Moreover, an inductive invariant of a coherent program is representable by a formula whose terms are of depth at most 1. We also show that the original proof, via automata, only applies to programs over unary uninterpreted functions. While this work is purely theoretical, it suggests a novel abstraction that is complete for coherent programs but can be soundly used on arbitrary uninterpreted (and partially interpreted) programs.


maplet An extensible R toolbox for modular and reproducible omics pipelines. This paper presents maplet, an open source R package for the creation of highly customizable, fully reproducible statistical pipelines for omics data analysis, with a special focus on metabolomics based methods. It builds on the SummarizedExperiment data structure to create a centralized pipeline framework for storing data, analysis steps, results, and visualizations. maplet's key design feature is its modularity, which offers several advantages, such as ensuring code quality through the individual maintenance of functions and promoting collaborative development by removing technical barriers to code contribution. With over 90 functions, the package includes a wide range of functionalities, covering many widely used statistical approaches and data visualization techniques.


Self Supervised Structure from Motion through Tightly Coupled Depth and Egomotion Networks. Much recent literature has formulated structure from motion (SfM) as a self supervised learning problem where the goal is to jointly learn neural network models of depth and egomotion through view synthesis. Herein, we address the open problem of how to optimally couple the depth and egomotion network components. Toward this end, we introduce several notions of coupling, categorize existing approaches, and present a novel tightly coupled approach that leverages the interdependence of depth and egomotion at training and at inference time. Our approach uses iterative view synthesis to recursively update the egomotion network input, permitting contextual information to be passed between the components without explicit weight sharing. Through substantial experiments, we demonstrate that our approach promotes consistency between the depth and egomotion predictions at test time, improves generalization on new data, and leads to state of the art accuracy on indoor and outdoor depth and egomotion evaluation benchmarks.


A Birds eye (Re)View of Acid suppression Drugs, COVID 19, and the Highly Variable Literature. We consider the recent surge of information on the potential benefits of acid suppression drugs in the context of COVID 19, with an eye on the variability (and confusion) across the reported findings at least as regards the popular antacid famotidine. The inconsistencies reflect contradictory conclusions from independent clinical based studies that took roughly similar approaches, in terms of experimental design (retrospective, cohort based, etc.) and statistical analyses (propensity score matching and stratification, etc.). The confusion has significant ramifications in choosing therapeutic interventions e.g., do potential benefits of famotidine indicate its use in a particular COVID 19 case? Beyond this pressing therapeutic issue, conflicting information on famotidine must be resolved before its integration in ontological and knowledge graph based frameworks, which in turn are useful in drug repurposing efforts. To begin systematically structuring the rapidly accumulating information, in the hopes of clarifying and reconciling the discrepancies, we consider the contradictory information along three proposed 'axes' (1) a context of disease axis, (2) a degree of therapeutic benefit axis, and (3) a mechanism of action axis. We suspect that incongruencies in how these axes have been (implicitly) treated in past studies has led to the contradictory indications for famotidine and COVID 19. We also trace the evolution of information on acid suppression agents as regards the transmission, severity, and mortality of COVID 19, given the many literature reports that have accumulated. By grouping the studies conceptually and thematically, we identify three eras in the progression of our understanding of famotidine and COVID 19. Harmonizing these findings is a key goal for both clinical standards of care (COVID and beyond) as well as ontological and knowledge graph based approaches.


Maximal solvable extensions of a pure non characteristically nilpotent Lie algebra. In the paper we prove that a complex maximal extension of a non characteristically nilpotent finite dimensional nilpotent Lie algebra is isomorphic to a semidirect sum of the nilradical and its maximal torus, where the nilpotent Lie algebra is either non split and non characteristically nilpotent or in the split case it does not contain a characteristically nilpotent direct factor. We also prove that such solvable Lie algebras are complete. It is also shown that among all complex solvable Lie algebras only the maximal extensions of nilpotent algebras do not have outer derivations. We specify a subclass of the maximal solvable extensions of nilpotent Lie algebras that have trivial cohomology group. Some comparisons with the results obtained earlier are given.


Learning through structure towards deep neuromorphic knowledge graph embeddings. Computing latent representations for graph structured data is an ubiquitous learning task in many industrial and academic applications ranging from molecule synthetization to social network analysis and recommender systems. Knowledge graphs are among the most popular and widely used data representations related to the Semantic Web. Next to structuring factual knowledge in a machine readable format, knowledge graphs serve as the backbone of many artificial intelligence applications and allow the ingestion of context information into various learning algorithms. Graph neural networks attempt to encode graph structures in low dimensional vector spaces via a message passing heuristic between neighboring nodes. Over the recent years, a multitude of different graph neural network architectures demonstrated ground breaking performances in many learning tasks. In this work, we propose a strategy to map deep graph learning architectures for knowledge graph reasoning to neuromorphic architectures. Based on the insight that randomly initialized and untrained (i.e., frozen) graph neural networks are able to preserve local graph structures, we compose a frozen neural network with shallow knowledge graph embedding models. We experimentally show that already on conventional computing hardware, this leads to a significant speedup and memory reduction while maintaining a competitive performance level. Moreover, we extend the frozen architecture to spiking neural networks, introducing a novel, event based and highly sparse knowledge graph embedding algorithm that is suitable for implementation in neuromorphic hardware.


How distant? An experimental analysis of students' COVID 19 exposure and physical distancing in university buildings. University buildings are significant closed built environments for COVID 19 spreading. As universities prepare to re start in class activities, students' adherence to physical distancing requirements is a priority topic. While physical distancing in classrooms can be easily managed, the movement of students inside common spaces can pose higher risks due to individuals' proximity. This paper provides an experimental analysis of unidirectional student flow inside a case study university building, by investigating students' movements and grouping behaviour according to physical distancing requirements. Results show general adherence with the minimum required physical distancing guidance, but some spaces, such as corridors, pose higher exposure than doorways. Their width, in combination with group behaviour, affects the students' capacity to keep the recommended distance. Furthermore, students report higher perceived vulnerability while moving along corridors. Evidence based results can support decision makers in understanding individuals' exposure in universities and researchers in developing behavioural models in preparation of future outbreaks and pandemics.


Towards Understanding Persuasion in Computational Argumentation. Opinion formation and persuasion in argumentation are affected by three major factors the argument itself, the source of the argument, and the properties of the audience. Understanding the role of each and the interplay between them is crucial for obtaining insights regarding argument interpretation and generation. It is particularly important for building effective argument generation systems that can take both the discourse and the audience characteristics into account. Having such personalized argument generation systems would be helpful to expose individuals to different viewpoints and help them make a more fair and informed decision on an issue. Even though studies in Social Sciences and Psychology have shown that source and audience effects are essential components of the persuasion process, most research in computational persuasion has focused solely on understanding the characteristics of persuasive language. In this thesis, we make several contributions to understand the relative effect of the source, audience, and language in computational persuasion. We first introduce a large scale dataset with extensive user information to study these factors' effects simultaneously. Then, we propose models to understand the role of the audience's prior beliefs on their perception of arguments. We also investigate the role of social interactions and engagement in understanding users' success in online debating over time. We find that the users' prior beliefs and social interactions play an essential role in predicting their success in persuasion. Finally, we explore the importance of incorporating contextual information to predict argument impact and show improvements compared to encoding only the text of the arguments.


Direction Aggregated Attack for Transferable Adversarial Examples. Deep neural networks are vulnerable to adversarial examples that are crafted by imposing imperceptible changes to the inputs. However, these adversarial examples are most successful in white box settings where the model and its parameters are available. Finding adversarial examples that are transferable to other models or developed in a black box setting is significantly more difficult. In this paper, we propose the Direction Aggregated adversarial attacks that deliver transferable adversarial examples. Our method utilizes aggregated direction during the attack process for avoiding the generated adversarial examples overfitting to the white box model. Extensive experiments on ImageNet show that our proposed method improves the transferability of adversarial examples significantly and outperforms state of the art attacks, especially against adversarial robust models. The best averaged attack success rates of our proposed method reaches 94.6 against three adversarial trained models and 94.8 against five defense methods. It also reveals that current defense approaches do not prevent transferable adversarial attacks.


Structure Preserving Progressive Low rank Image Completion for Defending Adversarial Attacks. Deep neural networks recognize objects by analyzing local image details and summarizing their information along the inference layers to derive the final decision. Because of this, they are prone to adversarial attacks. Small sophisticated noise in the input images can accumulate along the network inference path and produce wrong decisions at the network output. On the other hand, human eyes recognize objects based on their global structure and semantic cues, instead of local image textures. Because of this, human eyes can still clearly recognize objects from images which have been heavily damaged by adversarial attacks. This leads to a very interesting approach for defending deep neural networks against adversarial attacks. In this work, we propose to develop a structure preserving progressive low rank image completion (SPLIC) method to remove unneeded texture details from the input images and shift the bias of deep neural networks towards global object structures and semantic cues. We formulate the problem into a low rank matrix completion problem with progressively smoothed rank functions to avoid local minimums during the optimization process. Our experimental results demonstrate that the proposed method is able to successfully remove the insignificant local image details while preserving important global object structures. On black box, gray box, and white box attacks, our method outperforms existing defense methods (by up to 12.6 ) and significantly improves the adversarial robustness of the network.


Generating images from caption and vice versa via CLIP Guided Generative Latent Space Search. In this research work we present CLIP GLaSS, a novel zero shot framework to generate an image (or a caption) corresponding to a given caption (or image). CLIP GLaSS is based on the CLIP neural network, which, given an image and a descriptive caption, provides similar embeddings. Differently, CLIP GLaSS takes a caption (or an image) as an input, and generates the image (or the caption) whose CLIP embedding is the most similar to the input one. This optimal image (or caption) is produced via a generative network, after an exploration by a genetic algorithm. Promising results are shown, based on the experimentation of the image Generators BigGAN and StyleGAN2, and of the text Generator GPT2


Regularity for Obstacle Problems without Structure Conditions. This paper deals with the Lipschitz regularity of minimizers for a class of variational obstacle problems with possible occurance of the Lavrentiev phenomenon. In order to overcome this problem, the availment of the notions of relaxed functional and Lavrentiev gap are needed. The main tool used here is a ingenious Lemma which reveals to be crucial because it allows us to move from the variational obstacle problem to the relaxed functional related one. This is fundamental in order to find the solutions' regularity that we intended to study. We assume the same Sobolev regularity both for the gradient of the obstacle and for the coefficients.


TIE A Framework for Embedding based Incremental Temporal Knowledge Graph Completion. Reasoning in a temporal knowledge graph (TKG) is a critical task for information retrieval and semantic search. It is particularly challenging when the TKG is updated frequently. The model has to adapt to changes in the TKG for efficient training and inference while preserving its performance on historical knowledge. Recent work approaches TKG completion (TKGC) by augmenting the encoder decoder framework with a time aware encoding function. However, naively fine tuning the model at every time step using these methods does not address the problems of 1) catastrophic forgetting, 2) the model's inability to identify the change of facts (e.g., the change of the political affiliation and end of a marriage), and 3) the lack of training efficiency. To address these challenges, we present the Time aware Incremental Embedding (TIE) framework, which combines TKG representation learning, experience replay, and temporal regularization. We introduce a set of metrics that characterizes the intransigence of the model and propose a constraint that associates the deleted facts with negative labels. Experimental results on Wikidata12k and YAGO11k datasets demonstrate that the proposed TIE framework reduces training time by about ten times and improves on the proposed metrics compared to vanilla full batch training. It comes without a significant loss in performance for any traditional measures. Extensive ablation studies reveal performance trade offs among different evaluation metrics, which is essential for decision making around real world TKG applications.


Deep Generative Learning via Schr " o dinger Bridge. We propose to learn a generative model via entropy interpolation with a Schr " o dinger Bridge. The generative learning task can be formulated as interpolating between a reference distribution and a target distribution based on the Kullback Leibler divergence. At the population level, this entropy interpolation is characterized via an SDE on 0,1 with a time varying drift term. At the sample level, we derive our Schr " o dinger Bridge algorithm by plugging the drift term estimated by a deep score estimator and a deep density ratio estimator into the Euler Maruyama method. Under some mild smoothness assumptions of the target distribution, we prove the consistency of both the score estimator and the density ratio estimator, and then establish the consistency of the proposed Schr " o dinger Bridge approach. Our theoretical results guarantee that the distribution learned by our approach converges to the target distribution. Experimental results on multimodal synthetic data and benchmark data support our theoretical findings and indicate that the generative model via Schr " o dinger Bridge is comparable with state of the art GANs, suggesting a new formulation of generative learning. We demonstrate its usefulness in image interpolation and image inpainting.


The category of finite strings. We introduce the category of finite strings and study its basic properties. The category is closely related to the augmented simplex category, and it models categories of linear representations. Each lattice of non crossing partitions arises naturally as a lattice of subobjects.


Deformable ProtoPNet An Interpretable Image Classifier Using Deformable Prototypes. Machine learning has been widely adopted in many domains, including high stakes applications such as healthcare, finance, and criminal justice. To address concerns of fairness, accountability and transparency, predictions made by machine learning models in these critical domains must be interpretable. One line of work approaches this challenge by integrating the power of deep neural networks and the interpretability of case based reasoning to produce accurate yet interpretable image classification models. These models generally classify input images by comparing them with prototypes learned during training, yielding explanations in the form of "this looks like that." However, methods from this line of work use spatially rigid prototypes, which cannot explicitly account for pose variations. In this paper, we address this shortcoming by proposing a case based interpretable neural network that provides spatially flexible prototypes, called a deformable prototypical part network (Deformable ProtoPNet). In a Deformable ProtoPNet, each prototype is made up of several prototypical parts that adaptively change their relative spatial positions depending on the input image. This enables each prototype to detect object features with a higher tolerance to spatial transformations, as the parts within a prototype are allowed to move. Consequently, a Deformable ProtoPNet can explicitly capture pose variations, improving both model accuracy and the richness of explanations provided. Compared to other case based interpretable models using prototypes, our approach achieves competitive accuracy, gives an explanation with greater context, and is easier to train, thus enabling wider use of interpretable models for computer vision.


Thematic recommendations on knowledge graphs using multilayer networks. We present a framework to generate and evaluate thematic recommendations based on multilayer network representations of knowledge graphs (KGs). In this representation, each layer encodes a different type of relationship in the KG, and directed interlayer couplings connect the same entity in different roles. The relative importance of different types of connections is captured by an intuitive salience matrix that can be estimated from data, tuned to incorporate domain knowledge, address different use cases, or respect business logic. We apply an adaptation of the personalised PageRank algorithm to multilayer models of KGs to generate item item recommendations. These recommendations reflect the knowledge we hold about the content and are suitable for thematic and or cold start recommendation settings. Evaluating thematic recommendations from user data presents unique challenges that we address by developing a method to evaluate recommendations relying on user item ratings, yet respecting their thematic nature. We also show that the salience matrix can be estimated from user data. We demonstrate the utility of our methods by significantly improving consumption metrics in an AB test where collaborative filtering delivered subpar performance. We also apply our approach to movie recommendation using publicly available data to ensure the reproducibility of our results. We demonstrate that our approach outperforms existing thematic recommendation methods and is even competitive with collaborative filtering approaches.


An Extensive Analytical Approach on Human Resources using Random Forest Algorithm. The current job survey shows that most software employees are planning to change their job role due to high pay for recent jobs such as data scientists, business analysts and artificial intelligence fields. The survey also indicated that work life imbalances, low pay, uneven shifts and many other factors also make employees think about changing their work life. In this paper, for an efficient organisation of the company in terms of human resources, the proposed system designed a model with the help of a random forest algorithm by considering different employee parameters. This helps the HR department retain the employee by identifying gaps and helping the organisation to run smoothly with a good employee retention ratio. This combination of HR and data science can help the productivity, collaboration and well being of employees of the organisation. It also helps to develop strategies that have an impact on the performance of employees in terms of external and social factors.


Modeling Interactions of Multimodal Road Users in Shared Spaces. In shared spaces, motorized and non motorized road users share the same space with equal priority. Their movements are not regulated by traffic rules, hence they interact more frequently to negotiate priority over the shared space. To estimate the safeness and efficiency of shared spaces, reproducing the traffic behavior in such traffic places is important. In this paper, we consider and combine different levels of interaction between pedestrians and cars in shared space environments. Our proposed model consists of three layers a layer to plan trajectories of road users a force based modeling layer to reproduce free flow movement and simple interactions and a game theoretic decision layer to handle complex situations where road users need to make a decision over different alternatives. We validate our model by simulating scenarios involving various interactions between pedestrians and cars and also car to car interaction. The results indicate that simulated behaviors match observed behaviors well.


Current controlled non hysteresis magnetic switching in the ansence of magnetic field. By means of local ion implantation, we investigated the influence of lateral interface on current induced magnetic switching by spin orbit torque in a perpendicularly magnetized Pt Co Ta multilayer. The experimental results show that, in this system, the domain wall motion under electrical current can be affected by two mechanisms symmetry breaking and current driven N 'eel wall motion at the lateral interface. The dominant mechanism is symmetry breaking (current driven N 'eel wall motion) at the large (small) current. Due to the competitive relationship of these two mechanisms, the non hysteresis effect magnetic switching without an external magnetic field is obtained. Based on the non hysteresis effect magnetic switching, we can realize AND and OR logic gates without resetting.


Is research with qualitative data more prevalent and impactful now? Interviews, case studies, focus groups and ethnographies. Researchers, editors, educators and publishers need to understand the mix of research methods used in their field to guide decision making, with a current concern being that qualitative research is threatened by big data. Although there have been many studies of the prevalence of different methods within individual narrow fields, there have been no systematic studies across academia. In response, this article assesses the prevalence and citation impact of academic research 1996 2019 that reports one of four common methods to gather qualitative data interviews focus groups case studies ethnography. The results show that, with minor exceptions, the prevalence of qualitative data has increased, often substantially, since 1996. In addition, all 27 broad fields (as classified by Scopus) now publish some qualitative research, with interviewing being by far the most common approach. This suggest that qualitative methods teaching and should increase, and researchers, editors and publishers should be increasingly open to the value that qualitative data can bring.


Mining Interpretable Spatio temporal Logic Properties for Spatially Distributed Systems. The Internet of Things, complex sensor networks, multi agent cyber physical systems are all examples of spatially distributed systems that continuously evolve in time. Such systems generate huge amounts of spatio temporal data, and system designers are often interested in analyzing and discovering structure within the data. There has been considerable interest in learning causal and logical properties of temporal data using logics such as Signal Temporal Logic (STL) however, there is limited work on discovering such relations on spatio temporal data. We propose the first set of algorithms for unsupervised learning for spatio temporal data. Our method does automatic feature extraction from the spatio temporal data by projecting it onto the parameter space of a parametric spatio temporal reach and escape logic (PSTREL). We propose an agglomerative hierarchical clustering technique that guarantees that each cluster satisfies a distinct STREL formula. We show that our method generates STREL formulas of bounded description complexity using a novel decision tree approach which generalizes previous unsupervised learning techniques for Signal Temporal Logic. We demonstrate the effectiveness of our approach on case studies from diverse domains such as urban transportation, epidemiology, green infrastructure, and air quality monitoring.


Quantifying Adaptability in Pre trained Language Models with 500 Tasks. When a neural language model (LM) is adapted to perform a new task, what aspects of the task predict the eventual performance of the model? In NLP, systematic features of LM generalization to individual examples are well characterized, but systematic aspects of LM adaptability to new tasks are not nearly as well understood. We present a large scale empirical study of the features and limits of LM adaptability using a new benchmark, TaskBench500, built from 500 procedurally generated sequence modeling tasks. These tasks combine core aspects of language processing, including lexical semantics, sequence processing, memorization, logical reasoning, and world knowledge. Using TaskBench500, we evaluate three facets of adaptability, finding that (1) adaptation procedures differ dramatically in their ability to memorize small datasets (2) within a subset of task types, adaptation procedures exhibit compositional adaptability to complex tasks and (3) failure to match training label distributions is explained by mismatches in the intrinsic difficulty of predicting individual labels. Our experiments show that adaptability to new tasks, like generalization to new examples, can be systematically described and understood, and we conclude with a discussion of additional aspects of adaptability that could be studied using the new benchmark.


What Do We Want From Explainable Artificial Intelligence (XAI)? A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research. Previous research in Explainable Artificial Intelligence (XAI) suggests that a main aim of explainability approaches is to satisfy specific interests, goals, expectations, needs, and demands regarding artificial systems (we call these stakeholders' desiderata) in a variety of contexts. However, the literature on XAI is vast, spreads out across multiple largely disconnected disciplines, and it often remains unclear how explainability approaches are supposed to achieve the goal of satisfying stakeholders' desiderata. This paper discusses the main classes of stakeholders calling for explainability of artificial systems and reviews their desiderata. We provide a model that explicitly spells out the main concepts and relations necessary to consider and investigate when evaluating, adjusting, choosing, and developing explainability approaches that aim to satisfy stakeholders' desiderata. This model can serve researchers from the variety of different disciplines involved in XAI as a common ground. It emphasizes where there is interdisciplinary potential in the evaluation and the development of explainability approaches.


Radio Frequency (RF) Systems. Radio frequency (RF) systems deliver the power to change the energy of a charged particle beam, and they are integral parts of linear and circular accelerators. A longitudinal electrical field in the direction of the beam is generated in a resonant structure, the RF cavity. As it directly interacts with the bunches of charged particles, the cavity can be considered as a coupler to transport energy from an RF power power amplifier to the beam. The power amplifier itself is driven by a low level RF system assuring that frequency and phase are suitable for acceleration, and feedback loops improve the longitudinal beam stability. The spectrum of RF systems in particle accelerators in terms of frequency range and RF voltage is wide. Special emphasis is given to the constraints and requirements defined by the beam, which guides the appropriate choices for the RF systems.


Ill posedness for the Camassa Holm and related equations in Besov spaces. In this paper, we give a construction of u 0 in B sigma p, infty such that corresponding solution to the Camassa Holm equation starting from u 0 is discontinuous at t 0 in the metric of B sigma p, infty , which implies the ill posedness for this equation in B sigma p, infty . We also apply our method to the b equation and Novikov equation.


Two Contrasting Data Annotation Paradigms for Subjective NLP Tasks. Labelled data is the foundation of most natural language processing tasks. However, labelling data is difficult and there often are diverse valid beliefs about what the correct data labels should be. So far, dataset creators have acknowledged annotator subjectivity, but rarely actively managed it in the annotation process. This has led to partly subjective datasets that fail to serve a clear downstream use. To address this issue, we propose two contrasting paradigms for data annotation. The descriptive paradigm encourages annotator subjectivity, whereas the prescriptive paradigm discourages it. Descriptive annotation allows for the surveying and modelling of different beliefs, whereas prescriptive annotation enables the training of models that consistently apply one belief. We discuss benefits and challenges in implementing both paradigms, and argue that dataset creators should explicitly aim for one or the other to facilitate the intended use of their dataset. Lastly, we conduct an annotation experiment using hate speech data that illustrates the contrast between the two paradigms.


Homological theory of Serre quotient. Inspired by the work of C. Psaroudakis, for an abelian category and a Serre subcategory of it, we investigate homological aspects of the quotient category. The existence of section functor and injective objects are not assumed.


A Multi Chamber Smart Suction Cup for Adaptive Gripping and Haptic Exploration. We present a novel robot end effector for gripping and haptic exploration. Tactile sensing through suction flow monitoring is applied to a new suction cup design that contains multiple chambers for air flow. Each chamber connects with its own remote pressure transducer, which enables both absolute and differential pressure measures between chambers. By changing the overall vacuum applied to this smart suction cup, it can perform different functions such as gentle haptic exploration (low pressure) and monitoring breaks in the seal during strong astrictive gripping (high pressure). Haptic exploration of surfaces through sliding and palpation can guide the selection of suction grasp locations and help to identify the local surface geometry. During suction gripping, this design localizes breaks in the suction seal between four quadrants with up to 97 accuracy and detects breaks in the suction seal early enough to avoid total grasp failure.


Generating Triplets in Organic Semiconductor Tetracene upon Photoexcitation of Transition Metal Dichalcogenide ReS 2 . We studied the dynamics of transfer of photoexcited electronic states in a bilayer of the two dimensional transition metal dichalcogenide ReS 2 and tetracene, with the aim to produce triplets in the latter. This material combination was used as the band gap of ReS 2 (1.5 eV) is slightly larger than the triplet energy of tetracene (1.25 eV). Using time resolved optical absorption spectroscopy, transfer of photoexcited states from ReS 2 to triplet states in tetracene was found to occur within 5 ps with an efficiency near 38 . This result opens up new possibilities for heterostructure design of two dimensional materials with suitable organics to produce long lived triplets. Triplets are of interest as sensitizers in a wide variety of applications including optoelectronics, photovoltaics, photocatalysis, and photon upconversion.


Algebraic Properties of Subquasigroups and Construction of Cryptographically Suitable Finite Quasigroups. In this paper, we identify many important properties and develop criteria for the existence of subquasigroups in finite quasigroups. Based on these results, we propose an effective method that concludes the nonexistence of subquasigroup of a finite quasigroup, otherwise finds its all possible proper subquasigroups. This has an important application in checking the cryptographic suitability of a finite quasigroup. par Further, we propose a binary operation using arithmetic of finite fields to construct quasigroups of order p r . We develop the criteria under which these quasigroups have desirable cryptographic properties, viz. polynomially completeness and possessing no proper subquasigroups. Then a practical method is given to construct cryptographically suitable quasigroups. We also illustrate these methods by some academic examples and implement all proposed algorithms in the computer algebra system sc Singular .


Limit theorems on counting measures for a branching random walk with immigration in a random environment. We consider a branching random walk with immigration in a random environment, where the environment is a stationary and ergodic sequence indexed by time. We focus on the asymptotic properties of the sequence of measures (Z n) that count the number of particles of generation n located in a Borel set of real line. In the present work, a series of limit theorems related to the above counting measures are established, including a central limit theorem, a moderate deviation principle and a large deviation result as well as a convergence theorem of the free energy.


Semantic Segmentation of Periocular Near Infra Red Eye Images Under Alcohol Effects. This paper proposes a new framework to detect, segment, and estimate the localization of the eyes from a periocular Near Infra Red iris image under alcohol consumption. The purpose of the system is to measure the fitness for duty. Fitness systems allow us to determine whether a person is physically or psychologically able to perform their tasks. Our framework is based on an object detector trained from scratch to detect both eyes from a single image. Then, two efficient networks were used for semantic segmentation a Criss Cross attention network and DenseNet10, with only 122,514 and 210,732 parameters, respectively. These networks can find the pupil, iris, and sclera. In the end, the binary output eye mask is used for pupil and iris diameter estimation with high precision. Five state of the art algorithms were used for this purpose. A mixed proposal reached the best results. A second contribution is establishing an alcohol behavior curve to detect the alcohol presence utilizing a stream of images captured from an iris instance. Also, a manually labeled database with more than 20k images was created. Our best method obtains a mean Intersection over Union of 94.54 with DenseNet10 with only 210,732 parameters and an error of only 1 pixel on average.


Smale regular and chaotic A homeomorphisms and A diffeomorphisms. We introduce Smale A homeomorphisms that includes regular, semi chaotic, chaotic, and super chaotic homeomorphisms of topo lo gi cal n manifold M n , n geq 2 . Smale A homeo mor p hisms contain A diffeomorphisms (in particular, structurally stable diffeomorphisms) provided M n admits a smooth structure. Regular A homeomorphisms contain all Morse Smale diffeomorphisms, while semi chaotic and chaotic A homeomorphisms contain A diffeo mor p hisms with trivial and nontrivial basic sets. Super chaotic A homeo mor p hisms contain A diffeomorphisms whose basic sets are nontrivial. We describe invariant sets that determine completely dynamics of regular, semi chaotic, and chaotic Smale A homeo mor p hisms. This allows us to get necessary and sufficient conditions of conjugacy for these Smale A homeomorp hisms. We apply this necessary and sufficient conditions for structu ral ly stable surface diffeomorphisms with arbitrary number of one dimensional expanding attractors. We also use this conditions to get the complete classification of Morse Smale diffeomorphisms on projective like n manifolds for n 2,8,16 .


Global Filter Networks for Image Classification. Recent advances in self attention and pure multi layer perceptrons (MLP) models for vision have shown great potential in achieving promising performance with fewer inductive biases. These models are generally based on learning interaction among spatial locations from raw data. The complexity of self attention and MLP grows quadratically as the image size increases, which makes these models hard to scale up when high resolution features are required. In this paper, we present the Global Filter Network (GFNet), a conceptually simple yet computationally efficient architecture, that learns long term spatial dependencies in the frequency domain with log linear complexity. Our architecture replaces the self attention layer in vision transformers with three key operations a 2D discrete Fourier transform, an element wise multiplication between frequency domain features and learnable global filters, and a 2D inverse Fourier transform. We exhibit favorable accuracy complexity trade offs of our models on both ImageNet and downstream tasks. Our results demonstrate that GFNet can be a very competitive alternative to transformer style models and CNNs in efficiency, generalization ability and robustness. Code is available at https github.com raoyongming GFNet


Inverse Options in a Black Scholes World. Most trading in cryptocurrency options is on inverse products, so called because the contract size is denominated in US dollars and they are margined and settled in crypto, typically bitcoin or ether. Their popularity stems from allowing professional traders in bitcoin or ether options to avoid transferring fiat currency to and from the exchanges. We derive new analytic pricing and hedging formulae for inverse options under the assumption that the underlying follows a geometric Brownian motion. The boundary conditions and hedge ratios exhibit relatively complex but very important new features which warrant further analysis and explanation. We also illustrate some inconsistencies, exhibited in time series of Deribit bitcoin option implied volatilities, which indicate that traders may be applying direct option hedging and valuation methods erroneously. This could be because they are unaware of the correct, inverse option characteristics which are derived in this paper.


Learning neural network potentials from experimental data via Differentiable Trajectory Reweighting. In molecular dynamics (MD), neural network (NN) potentials trained bottom up on quantum mechanical data have seen tremendous success recently. Top down approaches that learn NN potentials directly from experimental data have received less attention, typically facing numerical and computational challenges when backpropagating through MD simulations. We present the Differentiable Trajectory Reweighting (DiffTRe) method, which bypasses differentiation through the MD simulation for time independent observables. Leveraging thermodynamic perturbation theory, we avoid exploding gradients and achieve around 2 orders of magnitude speed up in gradient computation for top down learning. We show effectiveness of DiffTRe in learning NN potentials for an atomistic model of diamond and a coarse grained model of water based on diverse experimental observables including thermodynamic, structural and mechanical properties. Importantly, DiffTRe also generalizes bottom up structural coarse graining methods such as iterative Boltzmann inversion to arbitrary potentials. The presented method constitutes an important milestone towards enriching NN potentials with experimental data, particularly when accurate bottom up data is unavailable.


Nonlocal strong forms of thin plate, gradient elasticity, magneto electro elasticity and phase field fracture by nonlocal operator method. The derivation of nonlocal strong forms for many physical problems remains cumbersome in traditional methods. In this paper, we apply the variational principle weighted residual method based on nonlocal operator method for the derivation of nonlocal forms for elasticity, thin plate, gradient elasticity, electro magneto elasticity and phase field fracture method. The nonlocal governing equations are expressed as integral form on support and dual support. The first example shows that the nonlocal elasticity has the same form as dual horizon non ordinary state based peridynamics. The derivation is simple and general and it can convert efficiently many local physical models into their corresponding nonlocal forms. In addition, a criterion based on the instability of the nonlocal gradient is proposed for the fracture modelling in linear elasticity. Several numerical examples are presented to validate nonlocal elasticity and the nonlocal thin plate .


Multi task Self distillation for Graph based Semi Supervised Learning. Graph convolutional networks have made great progress in graph based semi supervised learning. Existing methods mainly assume that nodes connected by graph edges are prone to have similar attributes and labels, so that the features smoothed by local graph structures can reveal the class similarities. However, there often exist mismatches between graph structures and labels in many real world scenarios, where the structures may propagate misleading features or labels that eventually affect the model performance. In this paper, we propose a multi task self distillation framework that injects self supervised learning and self distillation into graph convolutional networks to separately address the mismatch problem from the structure side and the label side. First, we formulate a self supervision pipeline based on pre text tasks to capture different levels of similarities in graphs. The feature extraction process is encouraged to capture more complex proximity by jointly optimizing the pre text task and the target task. Consequently, the local feature aggregations are improved from the structure side. Second, self distillation uses soft labels of the model itself as additional supervision, which has similar effects as label smoothing. The knowledge from the classification pipeline and the self supervision pipeline is collectively distilled to improve the generalization ability of the model from the label side. Experiment results show that the proposed method obtains remarkable performance gains under several classic graph convolutional architectures.


A hybrid convolutional neural network active contour approach to segmenting dead trees in aerial imagery. The stability and ability of an ecosystem to withstand climate change is directly linked to its biodiversity. Dead trees are a key indicator of overall forest health, housing one third of forest ecosystem biodiversity, and constitute 8 of the global carbon stocks. They are decomposed by several natural factors, e.g. climate, insects and fungi. Accurate detection and modeling of dead wood mass is paramount to understanding forest ecology, the carbon cycle and decomposers. We present a novel method to construct precise shape contours of dead trees from aerial photographs by combining established convolutional neural networks with a novel active contour model in an energy minimization framework. Our approach yields superior performance accuracy over state of the art in terms of precision, recall, and intersection over union of detected dead trees. This improved performance is essential to meet emerging challenges caused by climate change (and other man made perturbations to the systems), particularly to monitor and estimate carbon stock decay rates, monitor forest health and biodiversity, and the overall effects of dead wood on and from climate change.


Intrinisic Gradient Compression for Federated Learning. Federated learning is a rapidly growing area of research which enables a large number of clients to jointly train a machine learning model on privately held data. One of the largest barriers to wider adoption of federated learning is the communication cost of sending model updates from and to the clients, which is accentuated by the fact that many of these devices are bandwidth constrained. In this paper, we aim to address this issue by optimizing networks within a subspace of their full parameter space, an idea known as intrinsic dimension in the machine learning theory community. We use a correspondence between the notion of intrinsic dimension and gradient compressibility to derive a family of low bandwidth optimization algorithms, which we call intrinsic gradient compression algorithms. Specifically, we present three algorithms in this family with different levels of upload and download bandwidth for use in various federated settings, along with theoretical guarantees on their performance. Finally, in large scale federated learning experiments with models containing up to 100M parameters, we show that our algorithms perform extremely well compared to current state of the art gradient compression methods.


The rise and fall of countries in the global value chains. Countries participate in global value chains by engaging in backward and forward transactions connecting multiple geographically dispersed production stages. Inspired by network theory, we model global trade as a multilayer network and study its power structure by investigating the tendency of eigenvector centrality to concentrate on a small fraction of countries, a phenomenon called localization transition. We show that the market underwent a significant structural variation in 2007 just before the global financial crisis. That year witnessed an abrupt repositioning of countries in the global value chains, and in particular a remarkable reversal of leading role between the two major economies, the US and China. We uncover the hierarchical structure of the multilayer network based on countries' time series of eigenvector centralities, and show that trade tends to concentrate between countries with different power dynamics, yet in geographical proximity. We further investigate the contribution of individual industries to countries' economic dominance, and show that also within industry variations in countries' market positioning took place in 2007. Moreover, we shed light on the crucial role that domestic trade played in the geopolitical landscape leading China to overtake the US and cement its status as leading economy of the global value chains. Our study shows how the 2008 crisis can offer insights to policy makers and governments on how to turn early structural signals of upcoming exogenous shocks into opportunities for redesigning countries' global roles in a changing geopolitical landscape.


Drift and Matrix coefficients for discrete group extensions of countable Markov shifts. There has been much interest in generalizing Kesten's criterion for amenability in terms of a random walk to other contexts, such as determining amenability of a deck covering group by the bottom of the spectrum of the Laplacian or entropy of the geodesic flow. One outcome of this work is to generalise the results to so called discrete group extensions of countable Markov shifts that satisfy a strong positive recurrence hypothesis. The other outcome is to further develop the language of unitary representation theory in this problem, and to bring some of the machinery developed by Coulon Dougall Schapira Tapie Twisted Patterson Sullivan measures and applications to amenability and coverings, arXiv 1809.10881, 2018 to the countable Markov shift setting. In particular we recast the problem of determining a drop in Gurevi v c pressure in terms of eventual almost sure decay for matrix coefficients, and explain that a so called twisted measure "finds points with the worst decay." We are also able locate the results of Dougall Sharp Anosov flows, growth rates on covers and group extensions of subshifts, em Inventiones Mathematicae , 223, 445 483, 2021 within this framework.


Revisiting Optimal Resilience of Fast Byzantine Consensus (Extended Version). It is a common belief that Byzantine fault tolerant solutions for consensus are significantly slower than their crash fault tolerant counterparts. Indeed, in PBFT, the most widely known Byzantine fault tolerant consensus protocol, it takes three message delays to decide a value, in contrast with just two in Paxos. This motivates the search for fast Byzantine consensus algorithms that can produce decisions after just two message delays emph in the common case , e.g., under the assumption that the current leader is correct and not suspected by correct processes. The (optimal) two step latency comes with the cost of lower resilience fast Byzantine consensus requires more processes to tolerate the same number of faults. In particular, 5f 1 processes were claimed to be necessary to tolerate f Byzantine failures. In this paper, we present a fast Byzantine consensus algorithm that relies on just 5f 1 processes. Moreover, we show that 5f 1 is the tight lower bound, correcting a mistake in the earlier work. While the difference of just 2 processes may appear insignificant for large values of f , it can be crucial for systems of a smaller scale. In particular, for f 1 , our algorithm requires only 4 processes, which is optimal for any (not necessarily fast) partially synchronous Byzantine consensus algorithm.


A Transformer based Cross modal Fusion Model with Adversarial Training for VQA Challenge 2021. In this paper, inspired by the successes of visionlanguage pre trained models and the benefits from training with adversarial attacks, we present a novel transformerbased cross modal fusion modeling by incorporating the both notions for VQA challenge 2021. Specifically, the proposed model is on top of the architecture of VinVL model 19 , and the adversarial training strategy 4 is applied to make the model robust and generalized. Moreover, two implementation tricks are also used in our system to obtain better results. The experiments demonstrate that the novel framework can achieve 76.72 on VQAv2 test std set.


Measures Form a Complete Lattice. We show that the set of all measures on any measurable space is a complete lattice, i.e. every collection of measures has both a greatest lower bound and a least upper bound.


Determinantal Singularities. We survey determinantal singularities, their deformations, and their topology. This class of singularities generalizes the well studied case of complete intersections in several different aspects, but exhibits a plethora of new phenomena such as for instance non isolated singularities which are finitely determined, or smoothings with low connectivity already the union of the coordinate axes in ( mathbb C 3,0) is determinantal, but not a complete intersection. We start with the algebraic background and then continue by discussing the subtle interplay of unfoldings and deformations in this setting, including a survey of the case of determinantal hypersurfaces, Cohen Macaulay codimension 2 and Gorenstein codimension 3 singularities, and determinantal rational surface singularities. We conclude with a discussion of essential smoothings and provide an appendix listing known classifications of simple determinantal singularities.


Knowledge driven Answer Generation for Conversational Search. The conversational search paradigm introduces a step change over the traditional search paradigm by allowing users to interact with search agents in a multi turn and natural fashion. The conversation flows naturally and is usually centered around a target field of knowledge. In this work, we propose a knowledge driven answer generation approach for open domain conversational search, where a conversation wide entities' knowledge graph is used to bias search answer generation. First, a conversation specific knowledge graph is extracted from the top passages retrieved with a Transformer based re ranker. The entities knowledge graph is then used to bias a search answer generator Transformer towards information rich and concise answers. This conversation specific bias is computed by identifying the most relevant passages according to the most salient entities of that particular conversation. Experiments show that the proposed approach successfully exploits entities knowledge along the conversation, and outperforms a set of baselines on the search answer generation task.


Dirichlet polynomials and a moment problem. Consider a linear functional L defined on the space mathcal D s of Dirichlet polynomials with real coefficients and the set mathcal D s of non negative elements in mathcal D s . An analogue of the Riesz Haviland theorem in this context asks What are all mathcal D s positive linear functionals L, which are moment functionals? Since the space mathcal D s , when considered as a subspace of C( 0, infty), mathbb R), fails to be an adapted space in the sense of Choquet, the general form of Riesz Haviland theorem is not applicable in this situation. In an attempt to answer the forgoing question, we arrive at the notion of a moment sequence, which we call the Hausdorff log moment sequence. Apart from an analogue of the Riesz Haviland theorem, we show that any Hausdorff log moment sequence is a linear combination of 1, 0, ldots, and f( log(n) n geqslant 1 for a completely monotone function f 0, infty) rightarrow 0, infty). Moreover, such an f is uniquely determined by the sequence in question.


Augmented Environment Representations with Complete Object Models. While 2D occupancy maps commonly used in mobile robotics enable safe navigation in indoor environments, in order for robots to understand their environment to the level required for them to perform more advanced tasks, representing 3D geometry and semantic environment information is required. We propose a pipeline that can generate a multi layer representation of indoor environments for robotic applications. The proposed representation includes 3D metric semantic layers, a 2D occupancy layer, and an object instance layer where known objects are replaced with an approximate model obtained through a novel model matching approach. The metric semantic layer and the object instance layer are combined to form an augmented representation of the environment. Experiments show that the proposed shape matching method outperforms a state of the art deep learning method when tasked to complete unseen parts of objects in the scene. The pipeline performance translates well from simulation to real world as shown by F1 score analysis, with semantic segmentation accuracy using Mask R CNN acting as the major bottleneck. Finally, we also demonstrate on a real robotic platform how the multi layer map can be used to improve navigation safety.


GPT Understands, Too. While GPTs with traditional fine tuning fail to achieve strong results on natural language understanding (NLU), we show that GPTs can be better than or comparable to similar sized BERTs on NLU tasks with a novel method P tuning which employs trainable continuous prompt embeddings. On the knowledge probing (LAMA) benchmark, the best GPT recovers 64 (P 1) of world knowledge without any additional text provided during test time, which substantially improves the previous best by 20 percentage points. On the SuperGlue benchmark, GPTs achieve comparable and sometimes better performance to similar sized BERTs in supervised learning. Importantly, we find that P tuning also improves BERTs' performance in both few shot and supervised settings while largely reducing the need for prompt engineering. Consequently, P tuning outperforms the state of the art approaches on the few shot SuperGlue benchmark.


Recent trends in Social Engineering Scams and Case study of Gift Card Scam. Social engineering scams (SES) has been existed since the adoption of the telecommunications by humankind. An earlier version of the scams include leveraging premium phone service to charge the consumers and service providers but not limited to. There are variety of techniques being considered to scam the people due to the advancements in digital data access capabilities and Internet technology. A lot of research has been done to identify the scammer methodologies and characteristics of the scams. However, the scammers finding new ways to lure the consumers and stealing their financial assets. An example would be a recent circumstance of Covid 19 unemployment, which was used as a weapon to scam the US citizens. These scams will not be stopping here, and will keep appearing with new social engineering strategies in the near future. So, to better prepare these kind of scams in ever changing world, we describe the recent trends of various social engineering scams targeting the innocent people all over the world, who oversight the consequences of scams,and also give detailed description of recent social engineering scams including Covid scams. The social engineering scan threat model architecture is also proposed to map various scams. In addition, we discuss the case study of real time gift card scam targeting various enterprise organization customers to steal their money and put the organization reputation in stake. We also provide recommendations to internet users for not falling a victim of social engineering scams. In the end, we provide insights on how to prepare respond to the social engineering scams by following the security incident detection and response life cycle in enterprises


Fourier inversion theorems for integral transforms involving Bessel functions. Usually such area of mathematics as differential equations acts as a consumer of results given by functional analysis. This article will give an example of the reverse interaction of these two fields of knowledge. Namely, the derivation and study of integral transforms will be carried out using partial differential equations. We will study generalised Weber Orr transforms its invertibility theorems in f in L 1 cap L 2 , spectral decomposition, Plancherel Parseval identity. These transforms possess nontrivial kernel, so spectral decomposition must involve not only continuous spectrum, but also eigen functions which correspond to zero eigen value. We give a new approach to the study of classical and generalized Weber Orr transforms with a complete derivation of the inversion formulas.


Learning from Synthetic Data for Opinion free Blind Image Quality Assessment in the Wild. Nowadays, most existing blind image quality assessment (BIQA) models 1) are developed for synthetically distorted images and often generalize poorly to authentic ones 2) heavily rely on human ratings, which are prohibitively labor expensive to collect. Here, we propose an opinion free BIQA method that learns from synthetically distorted images and multiple agents to assess the perceptual quality of authentically distorted ones captured in the wild without relying on human labels. Specifically, we first assemble a large number of image pairs from synthetically distorted images and use a set of full reference image quality assessment (FR IQA) models to assign pseudo binary labels of each pair indicating which image has higher quality as the supervisory signal. We then train a convolutional neural network (CNN) based BIQA model to rank the perceptual quality, optimized for consistency with the binary labels. Since there exists domain shift between the synthetically and authentically distorted images, an unsupervised domain adaptation (UDA) module is introduced to alleviate this issue. Extensive experiments demonstrate the effectiveness of our proposed opinion free BIQA model, yielding state of the art performance in terms of correlation with human opinion scores, as well as gMAD competition. Codes will be made publicly available upon acceptance.


Towards autonomic orchestration of machine learning pipelines in future networks. Machine learning (ML) techniques are being increasingly used in mobile networks for network planning, operation, management, optimisation and much more. These techniques are realised using a set of logical nodes known as ML pipeline. A single network operator might have thousands of such ML pipelines distributed across its network. These pipelines need to be managed and orchestrated across network domains. Thus it is essential to have autonomic multi domain orchestration of ML pipelines in mobile networks. International Telecommunications Union (ITU) has provided an architectural framework for management and orchestration of ML pipelines in future networks. We extend this framework to enable autonomic orchestration of ML pipelines across multiple network domains. We present our system architecture and describe its application using a smart factory use case. Our work allows autonomic orchestration of multi domain ML pipelines in a standardised, technology agnostic, privacy preserving fashion.


Handling Epistemic and Aleatory Uncertainties in Probabilistic Circuits. When collaborating with an AI system, we need to assess when to trust its recommendations. If we mistakenly trust it in regions where it is likely to err, catastrophic failures may occur, hence the need for Bayesian approaches for probabilistic reasoning in order to determine the confidence (or epistemic uncertainty) in the probabilities in light of the training data. We propose an approach to overcome the independence assumption behind most of the approaches dealing with a large class of probabilistic reasoning that includes Bayesian networks as well as several instances of probabilistic logic. We provide an algorithm for Bayesian learning from sparse, albeit complete, observations, and for deriving inferences and their confidences keeping track of the dependencies between variables when they are manipulated within the unifying computational formalism provided by probabilistic circuits. Each leaf of such circuits is labelled with a beta distributed random variable that provides us with an elegant framework for representing uncertain probabilities. We achieve better estimation of epistemic uncertainty than state of the art approaches, including highly engineered ones, while being able to handle general circuits and with just a modest increase in the computational effort compared to using point probabilities.


Satisfiability of Constrained Horn Clauses on Algebraic Data Types A Transformation based Approach. We address the problem of checking the satisfiability of Constrained Horn Clauses (CHCs) defined on Algebraic Data Types (ADTs), such as lists and trees. We propose a new technique for transforming CHCs defined on ADTs into CHCs where the arguments of the predicates have only basic types, such as integers and booleans. Thus, our technique avoids, during satisfiability checking, the explicit use of proof rules based on induction over the ADTs. The main extension over previous techniques for ADT removal is a new transformation rule, called differential replacement, which allows us to introduce auxiliary predicates, whose definitions correspond to lemmas that are used when making inductive proofs. We present an algorithm that performs the automatic removal of ADTs by applying the new rule, together with the traditional folding unfolding rules. We prove that, under suitable hypotheses, the set of the transformed clauses is satisfiable if and only if so is the set of the original clauses. By an experimental evaluation, we show that the use of the new rule significantly improves the effectiveness of ADT removal. We also show that our approach is competitive with respect to tools that extend CHC solvers with the use of inductive rules.


Decentralized trajectory optimization for multi agent exploration. Autonomous exploration is an application of growing importance in robotics. A promising strategy is ergodic trajectory planning, whereby an agent spends in each area a fraction of time which is proportional to its probability information density function. In this paper, a decentralized ergodic multi agent trajectory planning algorithm featuring limited communication constraints is proposed. The agents' trajectories are designed by optimizing a weighted cost encompassing ergodicity, control energy and close distance operation objectives. To solve the underlying optimal control problem, a second order descent iterative method coupled with a projection operator in the form of an optimal feedback controller is used. Exhaustive numerical analyses show that the multi agent solution allows a much more efficient exploration in terms of completion task time and control energy distribution by leveraging collaboration among agents.


Remarks on Liouville type theorems for the steady MHD and Hall MHD equations. In this note we investigate Liouville type theorems for the steady three dimensional MHD and Hall MHD equations, and show that the velocity field u and the magnetic field B are vanishing provided that B in L 6, infty ( mathbb R 3) and u in BMO 1 ( mathbb R 3) , which state that the velocity field plays an important role. Moreover, the similar result holds in the case of partial viscosity or diffusivity for the three dimensional MHD equations.


Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization. This paper investigates the problem of computing the equilibrium of competitive games, which is often modeled as a constrained saddle point optimization problem with probability simplex constraints. Despite recent efforts in understanding the last iterate convergence of extragradient methods in the unconstrained setting, the theoretical underpinnings of these methods in the constrained settings, especially those using multiplicative updates, remain highly inadequate, even when the objective function is bilinear. Motivated by the algorithmic role of entropy regularization in single agent reinforcement learning and game theory, we develop provably efficient extragradient methods to find the quantal response equilibrium (QRE) which are solutions to zero sum two player matrix games with entropy regularization at a linear rate. The proposed algorithms can be implemented in a decentralized manner, where each player executes symmetric and multiplicative updates iteratively using its own payoff without observing the opponent's actions directly. In addition, by controlling the knob of entropy regularization, the proposed algorithms can locate an approximate Nash equilibrium of the unregularized matrix game at a sublinear rate without assuming the Nash equilibrium to be unique. Our methods also lead to efficient policy extragradient algorithms for solving (entropy regularized) zero sum Markov games at similar rates. All of our convergence rates are nearly dimension free, which are independent of the size of the state and action spaces up to logarithm factors, highlighting the positive role of entropy regularization for accelerating convergence.


What Do You See in this Patient? Behavioral Testing of Clinical NLP Models. Decision support systems based on clinical notes have the potential to improve patient care by pointing doctors towards overseen risks. Predicting a patient's outcome is an essential part of such systems, for which the use of deep neural networks has shown promising results. However, the patterns learned by these networks are mostly opaque and previous work revealed flaws regarding the reproduction of unintended biases. We thus introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. The framework helps to understand learned patterns and their influence on model decisions. In this work, we apply it to analyse the change in behavior with regard to the patient characteristics gender, age and ethnicity. Our evaluation of three current clinical NLP models demonstrates the concrete effects of these characteristics on the models' decisions. They show that model behavior varies drastically even when fine tuned on the same data and that allegedly best performing models have not always learned the most medically plausible patterns.


The mountain pass theorem in terms of tangencies. This paper addresses the Mountain Pass Theorem for locally Lipschitz functions on finite dimensional vector spaces in terms of tangencies. Namely, let f colon mathbb R n to mathbb R be a locally Lipschitz function with a mountain pass geometry. Let c inf gamma in mathcal A max t in 0,1 f( gamma(t)), where mathcal A is the set of all continuous paths joining x to y . We show that either c is a critical value of f or c is a tangency value at infinity of f. This reduces to the Mountain Pass Theorem of Ambrosetti and Rabinowitz in the case where the function f is definable (such as, semi algebraic) in an o minimal structure.


Gagliardo Nirenberg and Caffarelli Kohn Nirenberg interpolation inequalities associated with Sobolev Coulomb spaces. We establish the full range Gagliardo Nirenberg and the Caffarelli Kohn Nirenberg interpolation inequalities associated with Sobolev Coulomb spaces for the (fractional) derivative 0 leq s leq 1 . As a result, we rediscover known Gaglairdo Nirenberg interpolation type inequalities associated with Sobolev Coulomb spaces which were previously established in the scale of H s with 0 s leq 1 and extend them for the full range W s, p with 0 leq s leq 1 and 1 p infty . Using these newly established weighted inequalities, we derive a new family of one body Hardy Lieb Thirring inequalities and use it to establish a new family of many body Hardy Lieb Thirring inequalities with a strong repulsive interaction term in L p scale.


Geometric control of algebraic systems. In this paper, we present a geometric approach for computing the controlled invariant set of a continuous time control system. While the problem is well studied for in the ellipsoidal case, this family is quite conservative for constrained or switched linear systems. We reformulate the invariance of a set as an inequality for its support function that is valid for any convex set. This produces novel algebraic conditions for the invariance of sets with polynomial or piecewise quadratic support function. We compare it with the common algebraic approach for polynomial sublevel sets and show that it is significantly more conservative than our method.


REST Relational Event driven Stock Trend Forecasting. Stock trend forecasting, aiming at predicting the stock future trends, is crucial for investors to seek maximized profits from the stock market. Many event driven methods utilized the events extracted from news, social media, and discussion board to forecast the stock trend in recent years. However, existing event driven methods have two main shortcomings 1) overlooking the influence of event information differentiated by the stock dependent properties 2) neglecting the effect of event information from other related stocks. In this paper, we propose a relational event driven stock trend forecasting (REST) framework, which can address the shortcoming of existing methods. To remedy the first shortcoming, we propose to model the stock context and learn the effect of event information on the stocks under different contexts. To address the second shortcoming, we construct a stock graph and design a new propagation layer to propagate the effect of event information from related stocks. The experimental studies on the real world data demonstrate the efficiency of our REST framework. The results of investment simulation show that our framework can achieve a higher return of investment than baselines.


Learning Context Aware Embedding for Person Search. Person Search is a relevant task that aims to jointly solve Person Detection and Person Re identification(re ID). Though most previous methods focus on learning robust individual features for retrieval, it's still hard to distinguish confusing persons because of illumination, large pose variance, and occlusion. Contextual information is practically available in person search task which benefits searching in terms of reducing confusion. To this end, we present a novel contextual feature head named Attention Context Aware Embedding(ACAE) which enhances contextual information. ACAE repeatedly reviews the person features within and across images to find similar pedestrian patterns, allowing it to implicitly learn to find possible co travelers and efficiently model contextual relevant instances' relations. Moreover, we propose Image Memory Bank to improve the training efficiency. Experimentally, ACAE shows extensive promotion when built on different one step methods. Our overall methods achieve state of the art results compared with previous one step methods.


From Organisational Structure to Organisational Behaviour Formalisation. To understand how an organisational structure relates to organisational behaviour is an interesting fundamental challenge in the area of organisation modelling. Specifications of organisational structure usually have a diagrammatic form that abstracts from more detailed dynamics. Dynamic properties of agent systems, on the other hand, are often specified in the form of a set of logical formulae in some temporal language. This paper addresses the question how these two perspectives can be combined in one framework. It is shown how for different aggregation levels and other elements within an organisation structure, sets of dynamic properties can be specified. Organisational structure provides a structure of (interlevel) relationships between these multiple sets of dynamic properties. Thus organisational structure is reflected in the formalisation of the dynamics of organisational behaviour. To illustrate the effectiveness of the approach a formal foundation is presented for the integrated specification of both structure and behaviour of an AGR organisation model.


Construction and application of provable positive and exact cubature formulas. Many applications require multi dimensional numerical integration, often in the form of a cubature formula. These cubature formulas are desired to be positive and exact for certain finite dimensional function spaces (and weight functions). Although there are several efficient procedures to construct positive and exact cubature formulas for many standard cases, it remains a challenge to do so in a more general setting. Here, we show how the method of least squares can be used to derive provable positive and exact formulas in a general multi dimensional setting. Thereby, the procedure only makes use of basic linear algebra operations, such as solving a least squares problem. In particular, it is proved that the resulting least squares cubature formulas are ensured to be positive and exact if a sufficiently large number of equidistributed data points is used. We also discuss the application of provable positive and exact least squares cubature formulas to construct nested stable high order rules and positive interpolatory formulas. Finally, our findings shed new light on some existing methods for multivariate numerical integration and under which restrictions these are ensured to be successful.