Spot What Matters Learning Context Using Graph Convolutional Networks for Weakly Supervised Action Detection. The dominant paradigm in spatiotemporal action detection is to classify actions using spatiotemporal features learned by 2D or 3D Convolutional Networks. We argue that several actions are characterized by their context, such as relevant objects and actors present in the video. To this end, we introduce an architecture based on self attention and Graph Convolutional Networks in order to model contextual cues, such as actor actor and actor object interactions, to improve human action detection in video. We are interested in achieving this in a weakly supervised setting, i.e. using as less annotations as possible in terms of action bounding boxes. Our model aids explainability by visualizing the learned context as an attention map, even for actions and objects unseen during training. We evaluate how well our model highlights the relevant context by introducing a quantitative metric based on recall of objects retrieved by attention maps. Our model relies on a 3D convolutional RGB stream, and does not require expensive optical flow computation. We evaluate our models on the DALY dataset, which consists of human object interaction actions. Experimental results show that our contextualized approach outperforms a baseline action detection approach by more than 2 points in Video mAP. Code is available at url https github.com micts acgcn


Priority Queue based Dynamic Scaling for Efficient Resource Allocation in Fog Computing. In this emerging world of connected devices, the need for more computing devices with a focus on delay sensitive application is critical. In this paper, we propose a priority queue based Fog computing architecture combined with dynamic scalability of fog devices, which not only reduces the delay experienced by delay sensitive tasks by categorizing the delay sensitive and delay insensitive tasks, but also dynamically allocates the fog devices within the network depending upon the computation load for reducing the power consumption. The results show that the proposed algorithm is able to achieve a significantly lower delay for both delay sensitive and insensitive tasks when compared with other related schemes with a 14.5 lower power consumption.


Analysis of Chronic Pain Experiences Based on Online Reports the RRCP Dataset for quality of life assessment. Purpose Validate the applicability of Natural Language Processing (NLP) techniques to reveal, and quantify, qualities of the experience of chronic pain, by means of the novel Reddit Reports of Chronic Pain (RRCP) dataset, aimed at being a standard for future research on this underdeveloped area. Methods Define and validate the RRCP dataset for a set of pathologies related to chronic pain. For each pathology, identify the main qualities emergent of the consequent experience of chronic pain. Compare the identified qualities for each pathology and validate with clinical research. Results The RRCP dataset comprises 136,573 Reddit submissions from 12 subreddits related to chronic pain. Macro analysis reveals that pathologies affecting the same or similar body parts result in semantically similar descriptions of pain. Detailed analysis reveals that there are qualities to experiencing chronic pain from a given pathology that are nothing like experiencing it from another pathology, and that some are common to every experience of chronic pain. These allow us to compare subjective experiences of chronic pain (e.g., for the RRCP population, experiencing arthritis is very similar to experiencing ankylosing spondylitis in its various qualities or concerns, whilst experiencing fibromyalgia encompasses the same qualities and others not emergent of the other two pathologies). Conclusion Our unsupervised semantic analysis of descriptions of chronic pain reflects clinical knowledge on how different pathologies manifest in terms of the chronic pain experience. Our results validate the use of NLP techniques to automatically extract and quantify clinically relevant information from descriptions of chronic pain experiences.


Implementation of conformal digital metasurfaces for THz polarimetric sensing. Monitoring and controlling the state of polarization of electromagnetic waves is of significant interest for various basic and practical applications such as linear position sensing and medical imaging. Here, we propose the first conformal digital metamaterial absorber to detect the polarization state of THz incident waves. The proposed polarimeter is capable of characterizing four independent polarization states of (TE, TM, pm 45 circ linear, and RCP LCP) by observing the reflectivity of the structure with respect to the x and y direction. Besides, the proposed structure displays a strong absorptivity above 90 up to the incidence angle of 50 circ for oblique incident waves with different polarizations. By mere changing the bias voltage of two orthogonal VO2 microwires via two independent computer programmed multichannel DC network, distinct conditions for reflected waves occurs under excitations of different polarizations, whereby the polarization state of the incident wave may readily be estimated. We believe that the proposed metasurface based polarimeter can pave the way for polarization detection applications on curved surfaces.


Artificial Cognitively inspired Generation of the Notion of Topological Group in the Context of Artificial Mathematical Intelligence. The new computational paradigm of conceptual computation has been introduced in the research program of Artificial Mathematical Intelligence. We provide the explicit artificial generation (or conceptual computation) for the fundamental mathematical notion of topological groups. Specifically, we start with two basic notions belonging to topology and abstract algebra, and we describe recursively formal specifications in the Common Algebraic Specification Language (CASL). The notion of conceptual blending between such conceptual spaces can be materialized computationally in the Heterogeneous Tool Set (HETS). The fundamental notion of topological groups is explicitly generated through three different artificial specifications based on conceptual blending and conceptual identification, starting with the concepts of continuous functions and mathematical groups (described with minimal set theoretical conditions). This constitutes in additional heuristic evidence for the third pillar of Artificial Mathematical Intelligence.


Graph Metrics for Internet Robustness A Survey. Research on the robustness of the Internet has gained critical importance in the last decades because more and more individuals, societies and firms rely on this global network infrastructure for communication, knowledge transfer, business processes and e commerce. In particular, modeling the structure of Internet has inspired several novel graph metrics for assessing important topological robustness features of large complex networks such as the Internet. This survey provides a comparative overview of these metrics, presents their strengths and limitations for analyzing the robustness of the Internet topology, and outlines a conceptual tool set in order to facilitate future analysis and adoption in research and practice.


Approximation Algorithms for Two Bar Charts Packing Problem. In the Two Bar Charts Packing Problem (2 BCPP), it is required to pack the bar charts (BCs) consisting of two bars into the horizontal unit height strip of minimal length. The bars may move vertically within the strip, but it is forbidden to change the order and separate the chart's bars. Recently, for this new problem, which is a generalization of the Bin Packing Problem (BPP), Strip Packing Problem (SPP), and 2 Dimensional Vector Packing Problem (2 DVPP), several approximation algorithms with guaranteed estimates were proposed. However, after a preliminary analysis of the solutions constructed by approximation algorithms, we discerned that the guaranteed estimates are inaccurate. This fact inspired us to conduct a numerical experiment in which the approximate solutions are compared to each other and with the optimal ones. To construct the optimal solutions or lower bounds for optimum, we use the Boolean Linear Programming (BLP) formulation of 2 BCPP proposed earlier and apply the CPLEX package. We also use a database of instances for BPP with known optimal solutions to construct the instances for the 2 BCPP with known minimal packing length. The results of the simulation make up the main content of this paper.


Maximizing Efficiency of Language Model Pre training for Learning Representation. Pre trained language models in the past years have shown exponential growth in model parameters and compute time. ELECTRA is a novel approach for improving the compute efficiency of pre trained language models (e.g. BERT) based on masked language modeling (MLM) by addressing the sample inefficiency problem with the replaced token detection (RTD) task. Our work proposes adaptive early exit strategy to maximize the efficiency of the pre training process by relieving the model's subsequent layers of the need to process latent features by leveraging earlier layer representations. Moreover, we evaluate an initial approach to the problem that has not succeeded in maintaining the accuracy of the model while showing a promising compute efficiency by thoroughly investigating the necessity of the generator module of ELECTRA.


Collecting large scale publication data at the level of individual researchers A practical proposal for author name disambiguation. The disambiguation of author names is an important and challenging task in bibliometrics. We propose an approach that relies on an external source of information for selecting and validating clusters of publications identified through an unsupervised author name disambiguation method. The application of the proposed approach to a random sample of Italian scholars shows encouraging results, with an overall precision, recall, and F Measure of over 96 . The proposed approach can serve as a starting point for large scale census of publication portfolios for bibliometric analyses at the level of individual researchers.


LuvHarris A Practical Corner Detector for Event cameras. There have been a number of corner detection methods proposed for event cameras in the last years, since event driven computer vision has become more accessible. Current state of the art have either unsatisfactory accuracy or real time performance when considered for practical use, for example when a camera is randomly moved in an unconstrained environment. In this paper, we present yet another method to perform corner detection, dubbed look up event Harris (luvHarris), that employs the Harris algorithm for high accuracy but manages an improved event throughput. Our method has two major contributions, 1. a novel "threshold ordinal event surface" that removes certain tuning parameters and is well suited for Harris operations, and 2. an implementation of the Harris algorithm such that the computational load per event is minimised and computational heavy convolutions are performed only "as fast as possible", i.e. only as computational resources are available. The result is a practical, real time, and robust corner detector that runs more than 2.6x the speed of current state of the art a necessity when using high resolution event camera in real time. We explain the considerations taken for the approach, compare the algorithm to current state of the art in terms of computational performance and detection accuracy, and discuss the validity of the proposed approach for event cameras.


The Quest for Development When Social Media Brokered Political Power Encounters Political 'Flak Jackets'. Social media provides an extended space for collective action, as netizens leverage it as a tool for claim making and for demanding the dividends of governance. However, political regimes often greet expanding use of social media with censorship, which netizens often have to contend with, particularly in the quest for development outcomes. While existing studies having expansively explored multiple uses of social media, the specific features that signal their massive uptake and how this intersects with the quest for political power has not been substantially documented. This paper argues that social media is characterized by social buttons that expedite the multiplication of 'digital bullets' in forms of tweets and perceived detestable comments which compromise the defense lines of political regimes, hence, their uptake of censorship as metaphorical 'flak jackets'. This research is conducted on the basis of key informant interviews with voices against social media censorship in Nigeria since the inception of Nigeria's ruling government in 2015, particularly following the proposed 'Protection from Internet Falsehood and Manipulations Bill' in 2019.


Minimizing Reachability Times on Temporal Graphs via Shifting Labels. We study how we can accelerate the spreading of information in temporal graphs via delaying operations a problem that captures real world applications varying from information flows to distribution schedules. In a temporal graph there is a set of fixed vertices and the available connections between them change over time in a predefined manner. We observe that, in some cases, the delay of some connections can in fact decrease the time required to reach from some vertex (source) to another vertex (target). We study how we can minimize the maximum time a set of source vertices needs to reach every other vertex of the graph when we are allowed to delay some of the connections of the graph. For one source, we prove that the problem is W 2 hard and NP hard, when parameterized by the number of allowed delays. On the other hand, we derive a polynomial time algorithm for one source and unbounded number of delays. This is the best we can hope for we show that the problem becomes NP hard when there are two sources and the number of delays is not bounded. We complement our negative result by providing an FPT algorithm parameterized by the treewidth of the graph plus the lifetime of the optimal solution. Finally, we provide polynomial time algorithms for several classes of graphs.


Open Domain Conversational Search Assistant with Transformers. Open domain conversational search assistants aim at answering user questions about open topics in a conversational manner. In this paper we show how the Transformer architecture achieves state of the art results in key IR tasks, leveraging the creation of conversational assistants that engage in open domain conversational search with single, yet informative, answers. In particular, we propose an open domain abstractive conversational search agent pipeline to address two major challenges first, conversation context aware search and second, abstractive search answers generation. To address the first challenge, the conversation context is modeled with a query rewriting method that unfolds the context of the conversation up to a specific moment to search for the correct answers. These answers are then passed to a Transformer based re ranker to further improve retrieval performance. The second challenge, is tackled with recent Abstractive Transformer architectures to generate a digest of the top most relevant passages. Experiments show that Transformers deliver a solid performance across all tasks in conversational search, outperforming the best TREC CAsT 2019 baseline.


MVT Mask Vision Transformer for Facial Expression Recognition in the wild. Facial Expression Recognition (FER) in the wild is an extremely challenging task in computer vision due to variant backgrounds, low quality facial images, and the subjectiveness of annotators. These uncertainties make it difficult for neural networks to learn robust features on limited scale datasets. Moreover, the networks can be easily distributed by the above factors and perform incorrect decisions. Recently, vision transformer (ViT) and data efficient image transformers (DeiT) present their significant performance in traditional classification tasks. The self attention mechanism makes transformers obtain a global receptive field in the first layer which dramatically enhances the feature extraction capability. In this work, we first propose a novel pure transformer based mask vision transformer (MVT) for FER in the wild, which consists of two modules a transformer based mask generation network (MGN) to generate a mask that can filter out complex backgrounds and occlusion of face images, and a dynamic relabeling module to rectify incorrect labels in FER datasets in the wild. Extensive experimental results demonstrate that our MVT outperforms state of the art methods on RAF DB with 88.62 , FERPlus with 89.22 , and AffectNet 7 with 64.57 , respectively, and achieves a comparable result on AffectNet 8 with 61.40 .


Multiple GAN Inversion for Exemplar based Image to Image Translation. Existing state of the art techniques in exemplar based image to image translation hold several critical concerns. Existing methods related to exemplar based image to image translation are impossible to translate on an image tuple input (source, target) that is not aligned. Additionally, we can confirm that the existing method exhibits limited generalization ability to unseen images. In order to overcome this limitation, we propose Multiple GAN Inversion for Exemplar based Image to Image Translation. Our novel Multiple GAN Inversion avoids human intervention by using a self deciding algorithm to choose the number of layers using Fr 'echet Inception Distance(FID), which selects more plausible image reconstruction results among multiple hypotheses without any training or supervision. Experimental results have in fact, shown the advantage of the proposed method compared to existing state of the art exemplar based image to image translation methods.


Task adaptive Pre training and Self training are Complementary for Natural Language Understanding. Task adaptive pre training (TAPT) and Self training (ST) have emerged as the major semi supervised approaches to improve natural language understanding (NLU) tasks with massive amount of unlabeled data. However, it's unclear whether they learn similar representations or they can be effectively combined. In this paper, we show that TAPT and ST can be complementary with simple TFS protocol by following TAPT Finetuning Self training (TFS) process. Experimental results show that TFS protocol can effectively utilize unlabeled data to achieve strong combined gains consistently across six datasets covering sentiment classification, paraphrase identification, natural language inference, named entity recognition and dialogue slot classification. We investigate various semi supervised settings and consistently show that gains from TAPT and ST can be strongly additive by following TFS procedure. We hope that TFS could serve as an important semi supervised baseline for future NLP studies.


Probabilistic Trust Intervals for Out of Distribution Detection. Building neural network classifiers with an ability to distinguish between in and out of distribution inputs is an important step towards faithful deep learning systems. Some of the successful approaches for this, resort to architectural novelties, such as ensembles, with increased complexities in terms of the number of parameters and training procedures. Whereas some other approaches make use of surrogate samples, which are easy to create and work as proxies for actual out of distribution (OOD) samples, to train the networks for OOD detection. In this paper, we propose a very simple approach for enhancing the ability of a pretrained network to detect OOD inputs without even altering the original parameter values. We define a probabilistic trust interval for each weight parameter of the network and optimize its size according to the in distribution (ID) inputs. It allows the network to sample additional weight values along with the original values at the time of inference and use the observed disagreement among the corresponding outputs for OOD detection. In order to capture the disagreement effectively, we also propose a measure and establish its suitability using empirical evidence. Our approach outperforms the existing state of the art methods on various OOD datasets by considerable margins without using any real or surrogate OOD samples. We also analyze the performance of our approach on adversarial and corrupted inputs such as CIFAR 10 C and demonstrate its ability to clearly distinguish such inputs as well. By using fundamental theorem of calculus on neural networks, we explain why our technique doesn't need to observe OOD samples during training to achieve results better than the previous works.


Active set identification with complexity guarantees of an almost cyclic 2 coordinate descent method with Armijo line search. In this paper, it is established finite active set identification of an almost cyclic 2 coordinate descent method for problems with one linear coupling constraint and simple bounds. First, general active set identification results are stated for non convex objective functions. Then, under convexity and a quadratic growth condition (satisfied by any strongly convex function), complexity results on the number of iterations required to identify the active set are given. In our analysis, a simple Armijo line search is used to compute the stepsize, thus not requiring exact minimizations or additional information.


Seeking Similarities over Differences Similarity based Domain Alignment for Adaptive Object Detection. In order to robustly deploy object detectors across a wide range of scenarios, they should be adaptable to shifts in the input distribution without the need to constantly annotate new data. This has motivated research in Unsupervised Domain Adaptation (UDA) algorithms for detection. UDA methods learn to adapt from labeled source domains to unlabeled target domains, by inducing alignment between detector features from source and target domains. Yet, there is no consensus on what features to align and how to do the alignment. In our work, we propose a framework that generalizes the different components commonly used by UDA methods laying the ground for an in depth analysis of the UDA design space. Specifically, we propose a novel UDA algorithm, ViSGA, a direct implementation of our framework, that leverages the best design choices and introduces a simple but effective method to aggregate features at instance level based on visual similarity before inducing group alignment via adversarial training. We show that both similarity based grouping and adversarial training allows our model to focus on coarsely aligning feature groups, without being forced to match all instances across loosely aligned domains. Finally, we examine the applicability of ViSGA to the setting where labeled data are gathered from different sources. Experiments show that not only our method outperforms previous single source approaches on Sim2Real and Adverse Weather, but also generalizes well to the multi source setting.


Interpretable Visual Understanding with Cognitive Attention Network. While image understanding on recognition level has achieved remarkable advancements, reliable visual scene understanding requires comprehensive image understanding on recognition level but also cognition level, which calls for exploiting the multi source information as well as learning different levels of understanding and extensive commonsense knowledge. In this paper, we propose a novel Cognitive Attention Network (CAN) for visual commonsense reasoning to achieve interpretable visual understanding. Specifically, we first introduce an image text fusion module to fuse information from images and text collectively. Second, a novel inference module is designed to encode commonsense among image, query and response. Extensive experiments on large scale Visual Commonsense Reasoning (VCR) benchmark dataset demonstrate the effectiveness of our approach. The implementation is publicly available at https github.com tanjatang CAN


3 of 3 Multisignature Approach for Enabling Lightning Network Micro payments on IoT Devices. Bitcoin's success as a cryptocurrency enabled it to penetrate into many daily life transactions. Its problems regarding the transaction fees and long validation times are addressed through an innovative concept called the Lightning Network (LN) which works on top of Bitcoin by leveraging off chain transactions. This made Bitcoin an attractive micro payment solution that can also be used within certain IoT applications (e.g., toll payments) since it eliminates the need for traditional centralized payment systems. Nevertheless, it is not possible to run LN and Bitcoin on resource constrained IoT devices due to their storage, memory, and processing requirements. Therefore, in this paper, we propose an efficient and secure protocol that enables an IoT device to use LN's functions through a gateway LN node even if it is not trusted. The idea is to involve the IoT device only in signing operations, which is possible by replacing LN's original 2 of 2 multisignature channels with 3 of 3 multisignature channels. Once the gateway is delegated to open a channel for the IoT device in a secure manner, our protocol enforces the gateway to request the IoT device's cryptographic signature for all further operations on the channel such as sending payments or closing the channel. LN's Bitcoin transactions are revised to incorporate the 3 of 3 multisignature channels. In addition, we propose other changes to protect the IoT device's funds from getting stolen in possible revoked state broadcast attempts. We evaluated the proposed protocol using a Raspberry Pi considering a toll payment scenario. Our results show that timely payments can be sent and the computational and communication delays associated with the protocol are negligible.


Jordan property for Cremona group over a finite field. We show that the Cremona group of rank 2 over a finite field is Jordan, and provide an upper bound for its Jordan constant which is sharp when the number of elements in the field is different from 2 , 4 , and 8 .


CUI Auto UI Exploring the Fortunate and Unfortunate Futures of Conversational Automotive User Interfaces. This work aims to connect the Automotive User Interfaces (Auto UI) and Conversational User Interfaces (CUI) communities through discussion of their shared view of the future of automotive conversational user interfaces. The workshop aims to encourage creative consideration of optimistic and pessimistic futures, encouraging attendees to explore the opportunities and barriers that lie ahead through a game. Considerations of the future will be mapped out in greater detail through the drafting of research agendas, by which attendees will get to know each other's expertise and networks of resources. The two day workshop, consisting of two 90 minute sessions, will facilitate greater communication and collaboration between these communities, connecting researchers to work together to influence the futures they imagine in the workshop.


Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations. We present a supervised learning method to learn the propagator map of a dynamical system from partial and noisy observations. In our computationally cheap and easy to implement framework a neural network consisting of random feature maps is trained sequentially by incoming observations within a data assimilation procedure. By employing Takens' embedding theorem, the network is trained on delay coordinates. We show that the combination of random feature maps and data assimilation, called RAFDA, outperforms standard random feature maps for which the dynamics is learned using batch data.


Adversarial Graph Augmentation to Improve Graph Contrastive Learning. Self supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real world graph network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence between the representations of the same graph in its different augmented forms, may yield robust and transferable GNNs even without using labels. However, GNNs trained by traditional GCL often risk capturing redundant graph features and thus may be brittle and provide sub par performance in downstream tasks. Here, we propose a novel principle, termed adversarial GCL (AD GCL), which enables GNNs to avoid capturing redundant information during the training by optimizing adversarial graph augmentation strategies used in GCL. We pair AD GCL with theoretical explanations and design a practical instantiation based on trainable edge dropping graph augmentation. We experimentally validate AD GCL by comparing with the state of the art GCL methods and achieve performance gains of up to 14 in unsupervised, 6 in transfer, and 3 in semi supervised learning settings overall with 18 different benchmark datasets for the tasks of molecule property regression and classification, and social network classification.


Optimized Object Tracking Technique Using Kalman Filter. This paper focused on the design of an optimized object tracking technique which would minimize the processing time required in the object detection process while maintaining accuracy in detecting the desired moving object in a cluttered scene. A Kalman filter based cropped image is used for the image detection process as the processing time is significantly less to detect the object when a search window is used that is smaller than the entire video frame. This technique was tested with various sizes of the window in the cropping process. MATLAB was used to design and test the proposed method. This paper found that using a cropped image with 2.16 multiplied by the largest dimension of the object resulted in significantly faster processing time while still providing a high success rate of detection and a detected center of the object that was reasonably close to the actual center.


The Elliptic Net Algorithm Revisited. Pairings have been widely used since their introduction to cryptography. They can be applied to identity based encryption, tripartite Diffie Hellman key agreement, blockchain and other cryptographic schemes. The Acceleration of pairing computations is crucial for these cryptographic schemes or protocols. In this paper, we will focus on the Elliptic Net algorithm which can compute pairings in polynomial time, but it requires more storage than Miller's algorithm. We use several methods to speed up the Elliptic Net algorithm. Firstly, we eliminate the inverse operation in the improved Elliptic Net algorithm. In some circumstance, this finding can achieve further improvements. Secondly, we apply lazy reduction technique to the Elliptic Net algorithm, which helps us achieve a faster implementation. Finally, we propose a new derivation of the formulas for the computation of the Optimal Ate pairing on the twisted curve. Results show that the Elliptic Net algorithm can be significantly accelerated especially on the twisted curve. The algorithm can be 80 faster than the previous ones on the twisted 381 bit BLS12 curve and 71.5 faster on the twisted 676 bit KSS18 curve respectively.


A Proton Computed Tomography Demonstrator for Stopping Power Measurements. Particle therapy is an established method to treat deep seated tumours using accelerator produced ion beams. For treatment planning, the precise knowledge of the relative stopping power (RSP) within the patient is vital. Conversion errors from x ray computed tomography (CT) measurements to RSP introduce uncertainties in the applied dose distribution. Using a proton computed tomography (pCT) system to measure the SP directly could potentially increase the accuracy of treatment planning. A pCT demonstrator, consisting of double sided silicon strip detectors (DSSD) as tracker and plastic scintillator slabs coupled to silicon photomultipliers (SiPM) as a range telescope, was developed. After a significant hardware upgrade of the range telescope, a 3D tomogram of an aluminium stair phantom was recorded at the MedAustron facility in Wiener Neustadt, Austria. In total, 80 projections with 6.5x10 5 primary events were acquired and used for the reconstruction of the RSP distribution in the phantom. After applying a straight line approximation for the particle path inside the phantom, the most probable value (MPV) of the RSP distribution could be measured with an accuracy of 0.59 . The RSP resolution inside the phantom was only 9.3 due to a limited amount of projections and measured events per projection.


A Tutorial on Trace based Simulations of Mobile Ad hoc Networks on the Example of Aeronautical Communications. The OMNeT simulator is well suited for the simulation of randomized user behavior in communication networks. However, there are scenarios, where such a random model is unsuited to evaluate a communication system, and this paper attempts to highlight such a case. Using this example of ad hoc communication between aircraft mid flight, a tutorial style description is attempted that shall show how the OMNeT simulator can be used when a wealth of real world trace data is available. In particular, it is described how mobility trace files can be directly used within OMNeT , and how to link the generation of data messages to this mobility data. This is explained via an example simulation that evaluates a communication network in which an aircraft notifies the ground control when it enters or leaves a specific geographic region. Additionally, a novel trace based application has been developed to achieve this link between mobility and message generation. Furthermore, a new TDMA based medium access protocol for decentralized communication networks is presented, which is oracle based and thus allows a TDMA like behavior of medium access without causing any overhead it can be useful when upper layer protocols should be evaluated under the assumption of TDMA like behavior, but isolated from the effects of a full fledged TDMA protocol. Finally, physical layer behavior is often either overly simplistic or overly computationally expensive. For the latter case, when a detailed channel model is available but its evaluation requires prohibitive computational effort, then averaging its behavior into trace data can find a middle ground between efficient evaluation and realistic representation. Hence, a novel trace based radio model has been developed that makes use of an SNR to PER mapping. In the spirit of open science, all implementations have been made available under open licenses.


Categorical and K theoretic Hall algebras for quivers with potential. Given a quiver with potential (Q,W) , Kontsevich Soibelman constructed a Hall algebra on the critical cohomology of the stack of representations of (Q,W) . Special cases of this construction are related to work of Nakajima, Varagnolo, Schiffmann Vasserot, Maulik Okounkov, Yang Zhao etc. about geometric constructions of Yangians and their representations indeed, given a quiver Q , there exists an associated pair left( widetilde Q , widetilde W right) whose CoHA is conjecturally the positive half of the Maulik Okounkov Yangian Y text MO ( mathfrak g Q) . For a quiver with potential (Q,W) , we follow a suggestion of Kontsevich Soibelman and study a categorification of the above algebra constructed using categories of singularities. Its Grothendieck group is a K theoretic Hall algebra (KHA) for quivers with potential. We construct representations using framed quivers and we prove a wall crossing theorem for KHAs. We expect the KHA for left( widetilde Q , widetilde W right) to recover the positive part of quantum affine algebra U q left( widehat mathfrak g Q right) defined by Okounkov Smirnov.


Universal Randomized Guessing Subjected to Distortion. In this paper, we consider the problem of guessing a sequence subject to a distortion constraint. Specifically, we assume the following game between Alice and Bob Alice has a sequence bx of length n . Bob wishes to guess bx , yet he is satisfied with finding any sequence hat bx which is within a given distortion D from bx . Thus, he successively submits queries to Alice, until receiving an affirmative answer, stating that his guess was within the required distortion. Finding guessing strategies which minimize the number of guesses (the emph guesswork ), and analyzing its properties (e.g., its rho th moment) has several applications in information security, source and channel coding. Guessing subject to a distortion constraint is especially useful when considering contemporary biometrically secured systems, where the "password" which protects the data is not a single, fixed vector but rather a emph ball of feature vectors centered at some bx , and any feature vector within the ball results in acceptance. We formally define the guessing problem under distortion in emph four different setups memoryless sources, guessing through a noisy channel, sources with memory and individual sequences. We suggest a randomized guessing strategy which is asymptotically optimal for all setups and is emph five fold universal , as it is independent of the source statistics, the channel, the moment to be optimized, the distortion measure and the distortion level.


Efficient Hardware Realizations of Feedforward Artificial Neural Networks. This article presents design techniques proposed for efficient hardware implementation of feedforward artificial neural networks (ANNs) under parallel and time multiplexed architectures. To reduce their design complexity, after the weights of ANN are determined in a training phase, we introduce a technique to find the minimum quantization value used to convert the floating point weight values to integers. For each design architecture, we also propose an algorithm that tunes the integer weights to reduce the hardware complexity avoiding a loss in the hardware accuracy. Furthermore, the multiplications of constant weights by input variables are implemented under the shift adds architecture using the fewest number of addition subtraction operations found by prominent previously proposed algorithms. Finally, we introduce a computer aided design (CAD) tool, called SIMURG, that can describe an ANN design in hardware automatically based on the ANN structure and the solutions of proposed design techniques and algorithms. Experimental results indicate that the tuning techniques can significantly reduce the ANN hardware complexity under a design architecture and the multiplierless design of ANN can lead to a significant reduction in area and energy consumption, increasing the latency slightly.


Understanding Intrinsic Robustness Using Label Uncertainty. A fundamental question in adversarial machine learning is whether a robust classifier exists for a given task. A line of research has made some progress towards this goal by studying the concentration of measure, but we argue standard concentration fails to fully characterize the intrinsic robustness of a classification problem since it ignores data labels which are essential to any classification task. Building on a novel definition of label uncertainty, we empirically demonstrate that error regions induced by state of the art models tend to have much higher label uncertainty than randomly selected subsets. This observation motivates us to adapt a concentration estimation algorithm to account for label uncertainty, resulting in more accurate intrinsic robustness measures for benchmark image classification problems.


Inexact Newton combined approximations in the topology optimization of geometrically nonlinear elastic structures and compliant mechanisms. This work blends the inexact Newton method with iterative combined approximations (ICA) for solving topology optimization problems under the assumption of geometric nonlinearity. The density based problem formulation is solved using a sequential piecewise linear programming (SPLP) algorithm. Five distinct strategies have been proposed to control the frequency of the factorizations of the Jacobian matrices of the nonlinear equilibrium equations. Aiming at speeding up the overall iterative scheme while keeping the accuracy of the approximate solutions, three of the strategies also use an ICA scheme for the adjoint linear system associated with the sensitivity analysis. The robustness of the proposed reanalysis strategies is corroborated by means of numerical experiments with four benchmark problems two structures and two compliant mechanisms. Besides assessing the performance of the strategies considering a fixed budget of iterations, the impact of a theoretically supported stopping criterion for the SPLP algorithm was analyzed as well.


Revealing Critical Characteristics of Mobility Patterns in New York City during the Onset of COVID 19 Pandemic. New York has become one of the worst affected COVID 19 hotspots and a pandemic epicenter due to the ongoing crisis. This paper identifies the impact of the pandemic and the effectiveness of government policies on human mobility by analyzing multiple datasets available at both macro and micro levels for the New York City. Using data sources related to population density, aggregated population mobility, public rail transit use, vehicle use, hotspot and non hotspot movement patterns, and human activity agglomeration, we analyzed the inter borough and intra borough moment for New York City by aggregating the data at the borough level. We also assessed the internodal population movement amongst hotspot and non hotspot points of interest for the month of March and April 2020. Results indicate a drop of about 80 in people's mobility in the city, beginning in mid March. The movement to and from Manhattan showed the most disruption for both public transit and road traffic. The city saw its first case on March 1, 2020, but disruptions in mobility can be seen only after the second week of March when the shelter in place orders was put in effect. Owing to people working from home and adhering to stay at home orders, Manhattan saw the largest disruption to both inter and intra borough movement. But the risk of spread of infection in Manhattan turned out to be high because of higher hotspot linked movements. The stay at home restrictions also led to an increased population density in Brooklyn and Queens as people were not commuting to Manhattan. Insights obtained from this study would help policymakers better understand human behavior and their response to the news and governmental policies.


Kompetenzerwerbsf "orderung durch E Assessment Individuelle Kompetenzerfassung am Beispiel des Fachs Mathematik. In this article, we present a concept of how micro and e assessments can be used for the mathematical domain to automatically determine acquired and missing individual skills and, based on these information, guide individuals to acquire missing or additional skills in a software supported process. The models required for this concept are a digitally prepared and annotated e assessment item pool, a digital modeling of the domain that includes topics, necessary competencies, as well as introductory and continuative material, as well as a digital individual model, which can reliably record competencies and integrates aspects about the loss of such.


Matrix Encoding Networks for Neural Combinatorial Optimization. Machine Learning (ML) can help solve combinatorial optimization (CO) problems better. A popular approach is to use a neural net to compute on the parameters of a given CO problem and extract useful information that guides the search for good solutions. Many CO problems of practical importance can be specified in a matrix form of parameters quantifying the relationship between two groups of items. There is currently no neural net model, however, that takes in such matrix style relationship data as an input. Consequently, these types of CO problems have been out of reach for ML engineers. In this paper, we introduce Matrix Encoding Network (MatNet) and show how conveniently it takes in and processes parameters of such complex CO problems. Using an end to end model based on MatNet, we solve asymmetric traveling salesman (ATSP) and flexible flow shop (FFSP) problems as the earliest neural approach. In particular, for a class of FFSP we have tested MatNet on, we demonstrate a far superior empirical performance to any methods (neural or not) known to date.


Quasi feedback forms for differential algebraic systems. We investigate feedback forms for linear time invariant systems described by differential algebraic equations. Feedback forms are representatives of certain equivalence classes. For example state space transformations, invertible transformations from the left, and proportional state feedback constitute an equivalence relation. The representative of such an equivalence class, which we call proportional feedback form for the above example, allows to read off relevant system theoretic properties. Our main contribution is to derive a quasi proportional feedback form. This form is advantageous since it provides some geometric insight and is simple to compute, but still allows to read off the relevant structural properties of the control system. We also derive a quasi proportional and derivative feedback form. Similar advantages hold.


Large rainbow matchings in edge colored graphs with given average color degree. A rainbow matching in an edge colored graph is a matching in which no two edges have the same color. The color degree of a vertex v is the number of different colors on edges incident to v. Kritschgau Electron. J. Combin. 27(2020) studied the existence of rainbow matchings in edge colored graph G with average color degree at least 2k, and proved some sufficient conditions for a rainbow marching of size k in G. The sufficient conditions include that V(G) 12k 2 4k, or G is a properly edge colored graph with V(G) 8k. In this paper, we show that every edge colored graph G with V(G) 4k 4 and average color degree at least 2k 1 contains a rainbow matching of size k. In addition, we also prove that every strongly edge colored graph G with average degree at least 2k 1 contains a rainbow matching of size at least k. The bound is sharp for complete graphs.


Value Function Spaces Skill Centric State Abstractions for Long Horizon Reasoning. Reinforcement learning can train policies that effectively perform complex tasks. However for long horizon tasks, the performance of these methods degrades with horizon, often necessitating reasoning over and chaining lower level skills. Hierarchical reinforcement learning aims to enable this by providing a bank of low level skills as action abstractions. Hierarchies can further improve on this by abstracting the space states as well. We posit that a suitable state abstraction should depend on the capabilities of the available lower level policies. We propose Value Function Spaces a simple approach that produces such a representation by using the value functions corresponding to each lower level skill. These value functions capture the affordances of the scene, thus forming a representation that compactly abstracts task relevant information and robustly ignores distractors. Empirical evaluations for maze solving and robotic manipulation tasks demonstrate that our approach improves long horizon performance and enables better zero shot generalization than alternative model free and model based methods.


Existence of minimizers for a generalized liquid drop model with fractional perimeter. We consider the minimization problem of the functional given by the sum of the fractional perimeter and a general Riesz potential, which is one generalization of Gamow's liquid drop model. We first show the existence of minimizers for any volumes if the kernel of the Riesz potential decays faster than that of the fractional perimeter. Secondly, we show the existence of generalized minimizers for any volumes if the kernel of the Riesz potential just vanishes at infinity. Finally, we study the asymptotic behavior of minimizers when the volume goes to infinity and we prove that a sequence of minimizers converges to the Euclidean ball up to translations if the kernel of the Riesz potential decays sufficiently fast.


Progressive Correspondence Pruning by Consensus Learning. Correspondence selection aims to correctly select the consistent matches (inliers) from an initial set of putative correspondences. The selection is challenging since putative matches are typically extremely unbalanced, largely dominated by outliers, and the random distribution of such outliers further complicates the learning process for learning based methods. To address this issue, we propose to progressively prune the correspondences via a local to global consensus learning procedure. We introduce a pruning'' block that lets us identify reliable candidates among the initial matches according to consensus scores estimated using local to global dynamic graphs. We then achieve progressive pruning by stacking multiple pruning blocks sequentially. Our method outperforms state of the arts on robust line fitting, camera pose estimation and retrieval based image localization benchmarks by significant margins and shows promising generalization ability to different datasets and detector descriptor combinations.


Asymptotic Coefficients and Errors for Chebyshev Polynomial Approximations with Weak Endpoint Singularities Effects of Different Bases. When solving differential equations by a spectral method, it is often convenient to shift from Chebyshev polynomials T n (x) with coefficients a n to modified basis functions that incorporate the boundary conditions. For homogeneous Dirichlet boundary conditions, u( pm 1) 0 , popular choices include the Chebyshev difference basis", varsigma n (x) equiv T n 2 (x) T n (x) with coefficients here denoted b n and the quadratic factor basis functions" varrho n (x) equiv (1 x 2 ) T n (x) with coefficients c n . If u(x) is weakly singular at the boundaries, then a n will decrease proportionally to 1 n kappa for some positive constant kappa . We prove that the Chebyshev difference coefficients b n decrease more slowly by a factor of n while the quadratic factor coefficients c n decrease more slowly still as 1 n kappa 2 . The error for the unconstrained Chebyshev series, truncated at degree n N , is O(1 N kappa ) in the interior, but is worse by one power of N in narrow boundary layers near each of the endpoints. (For functions which are analytic over the whole domain including x pm 1 , the Chebyshev series is much more uniform on x in 1, 1 cite BoydOP63 , but the analytic at the endpoints functions are not discussed here.) Although the error norms are about the same, the error in the Chebyshev basis is concentrated in boundary layers near both endpoints whereas the error in the quadratic factor and difference basis sets are nearly uniform oscillations over the entire interval in x . The value of the derivatives at the endpoints is O(N 2 ) for Chebyshev polynomials and for the quadratic factor basis, but only O(N) for the difference basis. In spite of these differences, there is not a compelling reason to prefer one basis over another.


Tackling Imbalanced Data in Cybersecurity with Transfer Learning A Case with ROP Payload Detection. In recent years, deep learning gained proliferating popularity in the cybersecurity application domain, since when being compared to traditional machine learning, it usually involves less human effort, produces better results, and provides better generalizability. However, the imbalanced data issue is very common in cybersecurity, which can substantially deteriorate the performance of the deep learning models. This paper introduces a transfer learning based method to tackle the imbalanced data issue in cybersecurity using Return Oriented Programming (ROP) payload detection as a case study. We achieved 0.033 average false positive rate, 0.9718 average F1 score and 0.9418 average detection rate on 3 different target domain programs using 2 different source domain programs, with 0 benign training data samples in the target domain. The performance improvement compared to the baseline is a trade off between false positive rate and detection rate. Using our approach, the number of false positives is reduced by 23.20 , and as a trade off, the number of detected malicious samples is reduced by 0.50 .


Solution to Waves in Dissipative Media with Reciprocal Attenuation in Time and Space Domains. The study points out that the traditional solutions to wave equation of dissipative wave and motion equation of block for a multi degree of freedom mass spring damper system are the possible solutions, which are not necessarily objective and conflict each other. The disturbance in discrete system like crystals vibration can be expressed in differential form. A new general solution to dissipative wave equation is proposed with the general Fourier transform. The solution reveals that the attenuation of the disturbance can simultaneously occur in time and space domains. Then the general solution is used in case studies to analyze the properties of dissipative waves. It is concluded that the properties of waves formulated with the same equation can be different because of the difference of attenuation mechanism.


El aula invertida para la docencia de F 'isica. En este trabajo presentamos una experiencia docente on line con estudiantes universitarios de primer curso basada en la aplicaci 'on del aula invertida para el estudio de cinem 'atica de s 'olido r 'igido. Los resultados del estudio no demuestran diferencias significativas con respecto a otros temas tratados ni con respecto al mismo tema en el curso anterior, en el que la docencia no fue virtual sino presencial. In this work, we present an on line educational experience with first year university students based on the application of the flipped classroom to study kinematics of rigid solid. Our results show no statistical differences when compared with other parts of the Physics module nor with the results obtained last year, when the educational process was not virtual but in person.


Contrastive Representation Learning for Rapid Intraoperative Diagnosis of Skull Base Tumors Imaged Using Stimulated Raman Histology. Background Accurate diagnosis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative diagnosis can be challenging due to tumor diversity and lack of intraoperative pathology resources. Objective To develop an independent and parallel intraoperative pathology workflow that can provide rapid and accurate skull base tumor diagnoses using label free optical imaging and artificial intelligence (AI). Method We used a fiber laser based, label free, non consumptive, high resolution microscopy method ( 60 sec per 1 times 1 mm text 2 ), called stimulated Raman histology (SRH), to image a consecutive, multicenter cohort of skull base tumor patients. SRH images were then used to train a convolutional neural network (CNN) model using three representation learning strategies cross entropy, self supervised contrastive learning, and supervised contrastive learning. Our trained CNN models were tested on a held out, multicenter SRH dataset. Results SRH was able to image the diagnostic features of both benign and malignant skull base tumors. Of the three representation learning strategies, supervised contrastive learning most effectively learned the distinctive and diagnostic SRH image features for each of the skull base tumor types. In our multicenter testing set, cross entropy achieved an overall diagnostic accuracy of 91.5 , self supervised contrastive learning 83.9 , and supervised contrastive learning 96.6 . Our trained model was able to identify tumor normal margins and detect regions of microscopic tumor infiltration in whole slide SRH images. Conclusion SRH with AI models trained using contrastive representation learning can provide rapid and accurate intraoperative diagnosis of skull base tumors.


Vertebrate interval graphs. A vertebrate interval graph is an interval graph in which the maximum size of a set of independent vertices equals the number of maximal cliques. For any fixed v ge 1 , there is a polynomial time algorithm for deciding whether a vertebrate interval graph admits a vertex partition into two induced subgraphs with claw number at most v . In particular, when v 2 , whether a vertebrate interval graph can be partitioned into two proper interval graphs can be decided in polynomial time.


The stochastic bilevel continuous knapsack problem with uncertain follower's objective. We consider a bilevel continuous knapsack problem where the leader controls the capacity of the knapsack, while the follower chooses a feasible packing maximizing his own profit. The leader's aim is to optimize a linear objective function in the capacity and in the follower's solution, but with respect to different item values. We address a stochastic version of this problem where the follower's profits are uncertain from the leader's perspective, and only a probability distribution is known. Assuming that the leader aims at optimizing the expected value of her objective function, we first observe that the stochastic problem is tractable as long as the possible scenarios are given explicitly as part of the input, which also allows to deal with general distributions using a sample average approximation. For the case of independently and uniformly distributed item values, we show that the problem is P hard in general, and the same is true even for evaluating the leader's objective function. Nevertheless, we present pseudo polynomial time algorithms for this case, running in time linear in the total size of the items. Based on this, we derive an additive approximation scheme for the general case of independently distributed item values, which runs in pseudo polynomial time.


An Efficient Statistical based Gradient Compression Technique for Distributed Training Systems. The recent many fold increase in the size of deep neural networks makes efficient distributed training challenging. Many proposals exploit the compressibility of the gradients and propose lossy compression techniques to speed up the communication stage of distributed training. Nevertheless, compression comes at the cost of reduced model quality and extra computation overhead. In this work, we design an efficient compressor with minimal overhead. Noting the sparsity of the gradients, we propose to model the gradients as random variables distributed according to some sparsity inducing distributions (SIDs). We empirically validate our assumption by studying the statistical characteristics of the evolution of gradient vectors over the training process. We then propose Sparsity Inducing Distribution based Compression (SIDCo), a threshold based sparsification scheme that enjoys similar threshold estimation quality to deep gradient compression (DGC) while being faster by imposing lower compression overhead. Our extensive evaluation of popular machine learning benchmarks involving both recurrent neural network (RNN) and convolution neural network (CNN) models shows that SIDCo speeds up training by up to 41 7 , 7 6 , and 1 9 compared to the no compression baseline, Topk, and DGC compressors, respectively.


Global Attractor for the Periodic Generalized Korteweg de Vries Equation Through Smoothing. We establish a smoothing result for the generalized KdV (gKdV) on the torus with polynomial non linearity, damping, and forcing that matches the smoothing level for the gKdV at H 1 . As a consequence, we establish the existence of a global attractor for this equation as well as its compactness in H s( mathbb T ) , s in (1,2).


DE RSTC A rational secure two party computation protocol based on direction entropy. Rational secure multi party computation (RSMC) means two or more rational parties to complete a function on private inputs. In the process, the rational parties choose strategies to maximize utility, which will cause players to maliciously execute the protocol and undermine the fairness and correctness of the protocol. To solve this problem, we leverage game theory to propose the direction entropy based solution. First, we utilize the direction vector of the direction entropy to examine the player's strategy uncertainty and quantify its strategy from different dimensions. Specifically, when parties choose a cooperation strategy, the direction vector is positive, and the information transmitted is positive, conversely, it is negative information. Then, we provide mutual information to construct new utility functions for the players. What's more, we measure the mutual information of players to appraise their strategies. Finally, we prove in detail the protocol we gave, and the result show that the fairness problem in rational secure two party computation. We also prove that the proposed protocol reaches the Nash equilibrium. Furthermore, we conduct experiments using mutual information to construct utility, and the results show that the utility obtained when the player is honest will be higher.


Stability of Hardy Littlewood Sobolev Inequality under Bubbling. In this note we will generalize the results deduced in arXiv 1905.08203 and arXiv 2103.15360 to fractional Sobolev spaces. In particular we will show that for s in (0,1) , n 2s and nu in mathbb N there exists constants delta delta(n,s, nu) 0 and C C(n,s, nu) 0 such that for any function u in dot H s( mathbb R n) satisfying, begin align left u sum i 1 nu tilde U i right dot H s leq delta end align where tilde U 1 , tilde U 2 , cdots tilde U nu is a delta interacting family of Talenti bubbles, there exists a family of Talenti bubbles U 1 , U 2 , cdots U nu such that begin align left u sum i 1 nu U i right dot H s leq C left begin array ll Gamma text if 2s n 6s, Gamma log Gamma frac 1 2 text if n 6s, Gamma frac p 2 text if n 6s end array right. end align for Gamma left Delta u u u p 1 right H s and p 2 1 frac n 2s n 2s .


Minimal representations of a finite distributive lattice by principal congruences of a lattice. Let the finite distributive lattice D be isomorphic to the congruence lattice of a finite lattice L . Let Q denote those elements of D that correspond to principal congruences under this isomorphism. Then Q contains 0,1 in D and all the join irreducible elements of D . If Q contains exactly these elements, we say that L is a minimal representations of D by principal congruences of the lattice L . We characterize finite distributive lattices D with a minimal representation by principal congruences with the property that D has at most two dual atoms.


Combinatorial properties of non archimedean convex sets. We study combinatorial properties of convex sets over arbitrary valued fields. We demonstrate analogs of some classical results for convex sets over the reals (e.g. the fractional Helly theorem and B 'ar 'any's theorem on points in many simplices), along with some additional properties not satisfied by convex sets over the reals, including finite breadth and VC dimension. These results are deduced from a simple combinatorial description of modules over the valuation ring in a spherically complete valued field.


Property Directed Reachability as Abstract Interpretation in the Monotone Theory. Inferring inductive invariants is one of the main challenges of formal verification. The theory of abstract interpretation provides a rich framework to devise invariant inference algorithms. One of the latest breakthroughs in invariant inference is property directed reachability (PDR), but the research community views PDR and abstract interpretation as mostly unrelated techniques. This paper shows that, surprisingly, propositional PDR can be formulated as an abstract interpretation algorithm in a logical domain. More precisely, we define a version of PDR, called Lambda PDR, in which all generalizations of counterexamples are used to strengthen a frame. In this way, there is no need to refine frames after their creation, because all the possible supporting facts are included in advance. We analyze this algorithm using notions from Bshouty's monotone theory, originally developed in the context of exact learning. We show that there is an inherent overapproximation between the algorithm's frames that is related to the monotone theory. We then define a new abstract domain in which the best abstract transformer performs this overapproximation, and show that it captures the invariant inference process, i.e., Lambda PDR corresponds to Kleene iterations with the best transformer in this abstract domain. We provide some sufficient conditions for when this process converges in a small number of iterations, with sometimes an exponential gap from the number of iterations required for naive exact forward reachability. These results provide a firm theoretical foundation for the benefits of how PDR tackles forward reachability.


ModGNN Expert Policy Approximation in Multi Agent Systems with a Modular Graph Neural Network Architecture. Recent work in the multi agent domain has shown the promise of Graph Neural Networks (GNNs) to learn complex coordination strategies. However, most current approaches use minor variants of a Graph Convolutional Network (GCN), which applies a convolution to the communication graph formed by the multi agent system. In this paper, we investigate whether the performance and generalization of GCNs can be improved upon. We introduce ModGNN, a decentralized framework which serves as a generalization of GCNs, providing more flexibility. To test our hypothesis, we evaluate an implementation of ModGNN against several baselines in the multi agent flocking problem. We perform an ablation analysis to show that the most important component of our framework is one that does not exist in a GCN. By varying the number of agents, we also demonstrate that an application agnostic implementation of ModGNN possesses an improved ability to generalize to new environments.


Compositional generalization in semantic parsing with pretrained transformers. Large scale pretraining instills large amounts of knowledge in deep neural networks. This, in turn, improves the generalization behavior of these models in downstream tasks. What exactly are the limits to the generalization benefits of large scale pretraining? Here, we report observations from some simple experiments aimed at addressing this question in the context of two semantic parsing tasks involving natural language, SCAN and COGS. We show that language models pretrained exclusively with non English corpora, or even with programming language corpora, significantly improve out of distribution generalization in these benchmarks, compared with models trained from scratch, even though both benchmarks are English based. This demonstrates the surprisingly broad transferability of pretrained representations and knowledge. Pretraining with a large scale protein sequence prediction task, on the other hand, mostly deteriorates the generalization performance in SCAN and COGS, suggesting that pretrained representations do not transfer universally and that there are constraints on the similarity between the pretraining and downstream domains for successful transfer. Finally, we show that larger models are harder to train from scratch and their generalization accuracy is lower when trained up to convergence on the relatively small SCAN and COGS datasets, but the benefits of large scale pretraining become much clearer with larger models.


LGD GCN Local and Global Disentangled Graph Convolutional Networks. Disentangled Graph Convolutional Network (DisenGCN) is an encouraging framework to disentangle the latent factors arising in a real world graph. However, it relies on disentangling information heavily from a local range (i.e., a node and its 1 hop neighbors), while the local information in many cases can be uneven and incomplete, hindering the interpretabiliy power and model performance of DisenGCN. In this paper, we introduce a novel Local and Global Disentangled Graph Convolutional Network (LGD GCN) to capture both local and global information for graph disentanglement. LGD GCN performs a statistical mixture modeling to derive a factor aware latent continuous space, and then constructs different structures w.r.t. different factors from the revealed space. In this way, the global factor specific information can be efficiently and selectively encoded via a message passing along these built structures, strengthening the intra factor consistency. We also propose a novel diversity promoting regularizer employed with the latent space modeling, to encourage inter factor diversity. Evaluations of the proposed LGD GCN on the synthetic and real world datasets show a better interpretability and improved performance in node classification over the existing competitive models.


Detecting mesoscale structures by surprise. The importance of identifying the presence of mesoscale structures in complex networks can be hardly overestimated. So far, much attention has been devoted to the detection of communities, bipartite and core periphery structures on binary networks such an effort has led to the definition of a unified framework based upon the score function called surprise, i.e. a p value that can be assigned to any given partition of nodes, on both undirected and directed networks. Here, we aim at making a step further, by extending the entire framework to the weighted case after reviewing the application of the surprise based formalism to the detection of binary mesoscale structures, we present a suitable generalization of it for detecting weighted mesoscale structures, a topic that has received much less attention. To this aim, we analyze four variants of the surprise from a technical point of view, this amounts at employing four variants of the hypergeometric distribution the binomial one for the detection of binary communities, the multinomial one for the detection of binary "bimodular" structures and their negative counterparts for the detection of communities and "bimodular" structures on weighted networks. On top of that, we define two "enhanced" variants of surprise, able to encode both binary and weighted constraints and whose definition rests upon two suitable generalizations of the hypergeometric distribution itself. As a result, we present a general, statistically grounded approach to detect mesoscale structures on networks via a unified, suprise based framework. To illustrate the performance of our methods, we, first, test them on a variety of well established, synthetic benchmarks and, then, apply them to several real world networks, i.e. social, economic, financial and ecological ones. Moreover, we attach to the paper a Python code implementing all the considered variants of surprise.


Distilling the Knowledge from Conditional Normalizing Flows. Normalizing flows are a powerful class of generative models demonstrating strong performance in several speech and vision problems. In contrast to other generative models, normalizing flows are latent variable models with tractable likelihoods and allow for stable training. However, they have to be carefully designed to represent invertible functions with efficient Jacobian determinant calculation. In practice, these requirements lead to overparameterized and sophisticated architectures that are inferior to alternative feed forward models in terms of inference time and memory consumption. In this work, we investigate whether one can distill flow based models into more efficient alternatives. We provide a positive answer to this question by proposing a simple distillation approach and demonstrating its effectiveness on state of the art conditional flow based models for image super resolution and speech synthesis.


The Gau Wang Wu conjecture on partial isometries holds in the 5 by 5 case. Gau, Wang and Wu in their LAMA'2016 paper conjectured (and proved for n leq 4 ) that an n by n partial isometry cannot have a circular numerical range with a non zero center. We prove that this statement holds also for n 5 .


The Boundary Spanning Mechanisms of Nobel Prize Winning Papers. The breakthrough potentials of research papers can be explained by their boundary spanning qualities. Here, for the first time, we apply the structural variation analysis (SVA) model and its affiliated metrics to investigate the extent to which such qualities characterize a group of Nobel Prize winning papers. We find that these papers share remarkable boundary spanning traits, marked by exceptional abilities to connect disparate and topically diverse clusters of research papers. Further, their publications exert structural variations on the scale that significantly alters the betweenness centrality distributions of existing intellectual space. Overall, SVA not only provides a set of leading indicators for describing future Nobel Prize winning papers, but also broadens our understanding of the similar prize winning properties that may have been overlooked among other regular publications.


FCPose Fully Convolutional Multi Person Pose Estimation with Dynamic Instance Aware Convolutions. We propose a fully convolutional multi person pose estimation framework using dynamic instance aware convolutions, termed FCPose. Different from existing methods, which often require ROI (Region of Interest) operations and or grouping post processing, FCPose eliminates the ROIs and grouping post processing with dynamic instance aware keypoint estimation heads. The dynamic keypoint heads are conditioned on each instance (person), and can encode the instance concept in the dynamically generated weights of their filters. Moreover, with the strong representation capacity of dynamic convolutions, the keypoint heads in FCPose are designed to be very compact, resulting in fast inference and making FCPose have almost constant inference time regardless of the number of persons in the image. For example, on the COCO dataset, a real time version of FCPose using the DLA 34 backbone infers about 4.5x faster than Mask R CNN (ResNet 101) (41.67 FPS vs. 9.26FPS) while achieving improved performance. FCPose also offers better speed accuracy trade off than other state of the art methods. Our experiment results show that FCPose is a simple yet effective multi person pose estimation framework. Code is available at https git.io AdelaiDet


Joint Beamforming Design for Multiuser MISO Downlink Aided by a Reconfigurable Intelligent Surface and a Relay. Reconfigurable intelligent surfaces (RIS) have drawn considerable attention recently due to their controllable scattering elements that are able to direct electromagnetic waves into desirable directions. Although RISs share some similarities with relays, the two have fundamental differences impacting their performance. To harness the benefits of both relaying and RISs, a multi user communication system is proposed in this paper wherein a relay and an RIS cooperate to improve performance in terms of energy efficiency. Using singular value decomposition (SVD), semidefinite programming (SDP), and function approximations, we propose different solutions for optimizing the beamforming matrices at the base station (BS), the relay, and the phase shifts at the RIS to minimize the total transmit power subject to quality of service (QoS) constraints. The problem is solved in different cases when the relay operates in half duplex and full duplex modes and when the reflecting elements have continuous and discrete phase shifts. Simulation results are provided to compare the performance of the system with and without the RIS or the relay in both full duplex and half duplex modes, under different optimization solutions. Generally, the results show that the system with full duplex relay and RIS cooperation outperforms all the other scenarios, and the contribution of full duplex relay is higher than that of the RIS. However, an RIS performs better than a half duplex relay when the required QoS is high. The results also show that increasing the number of RIS reflecting elements improves performance better in the presence of a relay than in its absence.


Partial gamma Positivity for Quasi Stirling Permutations of Multisets. We prove that the enumerative polynomials of quasi Stirling permutations of multisets with respect to the statistics of plateaux, descents and ascents are partial gamma positive, thereby confirming a recent conjecture posed by Lin, Ma and Zhang. This is accomplished by proving the partial gamma positivity of the enumerative polynomials of certain ordered labeled trees, which are in bijection with quasi Stirling permutations of multisets. As an application, we provide an alternative proof of the partial gamma positivity of the enumerative polynomials on Stirling permutations of multisets.


Identifying causal relations in tweets using deep learning Use case on diabetes related tweets from 2017 2021. Objective Leveraging machine learning methods, we aim to extract both explicit and implicit cause effect associations in patient reported, diabetes related tweets and provide a tool to better understand opinion, feelings and observations shared within the diabetes online community from a causality perspective. Materials and Methods More than 30 million diabetes related tweets in English were collected between April 2017 and January 2021. Deep learning and natural language processing methods were applied to focus on tweets with personal and emotional content. A cause effect tweet dataset was manually labeled and used to train 1) a fine tuned Bertweet model to detect causal sentences containing a causal association 2) a CRF model with BERT based features to extract possible cause effect associations. Causes and effects were clustered in a semi supervised approach and visualised in an interactive cause effect network. Results Causal sentences were detected with a recall of 68 in an imbalanced dataset. A CRF model with BERT based features outperformed a fine tuned BERT model for cause effect detection with a macro recall of 68 . This led to 96,676 sentences with cause effect associations. "Diabetes" was identified as the central cluster followed by "Death" and "Insulin". Insulin pricing related causes were frequently associated with "Death". Conclusions A novel methodology was developed to detect causal sentences and identify both explicit and implicit, single and multi word cause and corresponding effect as expressed in diabetes related tweets leveraging BERT based architectures and visualised as cause effect network. Extracting causal associations on real life, patient reported outcomes in social media data provides a useful complementary source of information in diabetes research.


Plinius Secure and Persistent Machine Learning Model Training. With the increasing popularity of cloud based machine learning (ML) techniques there comes a need for privacy and integrity guarantees for ML data. In addition, the significant scalability challenges faced by DRAM coupled with the high access times of secondary storage represent a huge performance bottleneck for ML systems. While solutions exist to tackle the security aspect, performance remains an issue. Persistent memory (PM) is resilient to power loss (unlike DRAM), provides fast and fine granular access to memory (unlike disk storage) and has latency and bandwidth close to DRAM (in the order of ns and GB s, respectively). We present PLINIUS, a ML framework using Intel SGX enclaves for secure training of ML models and PM for fault tolerance guarantees. P LINIUS uses a novel mirroring mechanism to create and maintain (i) encrypted mirror copies of ML models on PM, and (ii) encrypted training data in byte addressable PM, for near instantaneous data recovery after a system failure. Compared to disk based checkpointing systems,PLINIUS is 3.2x and 3.7x faster respectively for saving and restoring models on real PM hardware, achieving robust and secure ML model training in SGX enclaves.


Edgeless GNN Unsupervised Inductive Edgeless Network Embedding. We study the problem of embedding edgeless nodes such as users who newly enter the underlying network, while using graph neural networks (GNNs) widely studied for effective representation learning of graphs thanks to its highly expressive capability via message passing. Our study is motivated by the fact that existing GNNs cannot be adopted for our problem since message passing to such edgeless nodes having no connections is impossible. To tackle this challenge, we propose Edgeless GNN, a new framework that enables GNNs to generate node embeddings even for edgeless nodes through unsupervised inductive learning. Specifically, we start by constructing a k nearest neighbor graph ( k NNG) based on the similarity of node attributes to replace the GNN's computation graph defined by the neighborhood based aggregation of each node. As our main contributions, the known network structure is used to train model parameters, while a new loss function is established using energy based learning in such a way that our model learns the network structure. For the edgeless nodes, we inductively infer embeddings for the edgeless nodes by using edges via k NNG construction as a computation graph. By evaluating the performance of various downstream machine learning (ML) tasks, we empirically demonstrate that Edgeless GNN consistently outperforms state of the art methods of inductive network embedding. Moreover, our findings corroborate the effectiveness of Edgeless GNN in judiciously combining the replaced computation graph with our newly designed loss. Our framework is GNN model agnostic thus, GNN models can be appropriately chosen according to ones' needs and ML tasks.


RATE Overcoming Noise and Sparsity of Textual Features in Real Time Location Estimation. Real time location inference of social media users is the fundamental of some spatial applications such as localized search and event detection. While tweet text is the most commonly used feature in location estimation, most of the prior works suffer from either the noise or the sparsity of textual features. In this paper, we aim to tackle these two problems. We use topic modeling as a building block to characterize the geographic topic variation and lexical variation so that "one hot" encoding vectors will no longer be directly used. We also incorporate other features which can be extracted through the Twitter streaming API to overcome the noise problem. Experimental results show that our RATE algorithm outperforms several benchmark methods, both in the precision of region classification and the mean distance error of latitude and longitude regression.


Socio Technical Root Cause Analysis of Cyber enabled Theft of the U.S. Intellectual Property The Case of APT41. Increased connectivity has made us all more vulnerable. Cyberspace, besides all its benefits, spawned more devices to hack and more opportunities to commit cybercrime. Criminals have found it lucrative to target both individuals and businesses, by holding or stealing their assets via different types of cyber attacks. The cyber enabled theft of Intellectual Property (IP), as one of the most important and critical intangible assets of nations, organizations and individuals, by foreign countries has been a devastating challenge of the United States (U.S.) in the past decades. In this study, we conduct a socio technical root cause analysis to investigate one of the recent cases of IP theft by employing a holistic approach. It concludes with a list of root causes and some corrective actions to stop the impact and prevent the recurrence of the problem in the future. Building upon the findings of this study, the U.S. requires a detailed revision of IP strategies bringing the whole socio technical regulatory system into focus and strengthen IP rights protection considering China's indigenous innovation policies. It is critical that businesses and other organizations take steps to reduce their exposure to cyber attacks. It is particularly important to train employees on how to spot potential threats, and to institute policies that encourage workers to report potential security failures so that action can be taken quickly. Finally, we discuss how cyber ranges can provide an efficient and safe platform for dealing with such challenges. The results of this study can be expanded to other countries in order to protect their IP rights and deter or prevent and respond to future incidents.


End to End Automatic Speech Recognition with Deep Mutual Learning. This paper is the first study to apply deep mutual learning (DML) to end to end ASR models. In DML, multiple models are trained simultaneously and collaboratively by mimicking each other throughout the training process, which helps to attain the global optimum and prevent models from making over confident predictions. While previous studies applied DML to simple multi class classification problems, there are no studies that have used it on more complex sequence to sequence mapping problems. For this reason, this paper presents a method to apply DML to state of the art Transformer based end to end ASR models. In particular, we propose to combine DML with recent representative training techniques. i.e., label smoothing, scheduled sampling, and SpecAugment, each of which are essential for powerful end to end ASR models. We expect that these training techniques work well with DML because DML has complementary characteristics. We experimented with two setups for Japanese ASR tasks large scale modeling and compact modeling. We demonstrate that DML improves the ASR performance of both modeling setups compared with conventional learning methods including knowledge distillation. We also show that combining DML with the existing training techniques effectively improves ASR performance.


Cryptanalyzing two image encryption algorithms based on a first order time delay system. Security is a key problem for the transmission, interchange and storage process of multimedia systems and applications. In 2018, M. Li et al. proposed in depth security analysis on an image encryption algorithm based on a first order time delay system (IEATD) and gave a specific chosen plaintext attack on it. Moreover, an enhanced version called as IEACD was designed to fix the reported security defects. This paper analyzes the essential structures of the two algorithms and evaluates their real security performances 1) no efficient nonlinear operations are adopted to assure the sensibility of keystream 2) the equivalent secret key of IEATD can be efficiently recovered from one known plain image and the corresponding cipher image 3) IEACD can still be efficiently cracked with a chosen plaintext attack. Both rigorous theoretical analyses and detailed experimental results are provided to demonstrate effectiveness of the advanced cryptanalytic methods.


Flexible Compositional Learning of Structured Visual Concepts. Humans are highly efficient learners, with the ability to grasp the meaning of a new concept from just a few examples. Unlike popular computer vision systems, humans can flexibly leverage the compositional structure of the visual world, understanding new concepts as combinations of existing concepts. In the current paper, we study how people learn different types of visual compositions, using abstract visual forms with rich relational structure. We find that people can make meaningful compositional generalizations from just a few examples in a variety of scenarios, and we develop a Bayesian program induction model that provides a close fit to the behavioral data. Unlike past work examining special cases of compositionality, our work shows how a single computational approach can account for many distinct types of compositional generalization.


Towards a Privacy preserving Deep Learning based Network Intrusion Detection in Data Distribution Services. Data Distribution Service (DDS) is an innovative approach towards communication in ICS IoT infrastructure and robotics. Being based on the cross platform and cross language API to be applicable in any computerised device, it offers the benefits of modern programming languages and the opportunities to develop more complex and advanced systems. However, the DDS complexity equally increases its vulnerability, while the existing security measures are limited to plug ins and static rules, with the rest of the security provided by third party applications and operating system. Specifically, traditional intrusion detection systems (IDS) do not detect any anomalies in the publish subscribe method. With the exponentially growing global communication exchange, securing DDS is of the utmost importance to futureproofing industrial, public, and even personal devices and systems. This report presents an experimental work on the simulation of several specific attacks against DDS, and the application of Deep Learning for their detection. The findings show that even though Deep Learning allows to detect all simulated attacks using only metadata analysis, their detection level varies, with some of the advanced attacks being harder to detect. The limitations imposed by the attempts to preserve privacy significantly decrease the detection rate. The report also reviews the drawbacks and limitations of the Deep Learning approach and proposes a set of selected solutions and configurations, that can further improve the DDS security.


Fourier Contour Embedding for Arbitrary Shaped Text Detection. One of the main challenges for arbitrary shaped text detection is to design a good text instance representation that allows networks to learn diverse text geometry variances. Most of existing methods model text instances in image spatial domain via masks or contour point sequences in the Cartesian or the polar coordinate system. However, the mask representation might lead to expensive post processing, while the point sequence one may have limited capability to model texts with highly curved shapes. To tackle these problems, we model text instances in the Fourier domain and propose one novel Fourier Contour Embedding (FCE) method to represent arbitrary shaped text contours as compact signatures. We further construct FCENet with a backbone, feature pyramid networks (FPN) and a simple post processing with the Inverse Fourier Transformation (IFT) and Non Maximum Suppression (NMS). Different from previous methods, FCENet first predicts compact Fourier signatures of text instances, and then reconstructs text contours via IFT and NMS during test. Extensive experiments demonstrate that FCE is accurate and robust to fit contours of scene texts even with highly curved shapes, and also validate the effectiveness and the good generalization of FCENet for arbitrary shaped text detection. Furthermore, experimental results show that our FCENet is superior to the state of the art (SOTA) methods on CTW1500 and Total Text, especially on challenging highly curved text subset.


Weighted norm inequalities for derivatives on Bergman spaces. An equivalent norm in the weighted Bergman space A p omega , induced by an omega in a certain large class of non radial weights, is established in terms of higher order derivatives. Other Littlewood Paley inequalities are also considered. On the way to the proofs, we characterize the q Carleson measures for the weighted Bergman space A p omega and the boundedness of a H "ormander type maximal function. Results obtained are further applied to describe the resolvent set of the integral operators T g(f)(z) int 0 z g'( zeta)f( zeta) ,d zeta acting on A p omega .


edATLAS An Efficient Disambiguation Algorithm for Texting in Languages with Abugida Scripts. Abugida refers to a phonogram writing system where each syllable is represented using a single consonant or typographic ligature, along with a default vowel or optional diacritic(s) to denote other vowels. However, texting in these languages has some unique challenges in spite of the advent of devices with soft keyboard supporting custom key layouts. The number of characters in these languages is large enough to require characters to be spread over multiple views in the layout. Having to switch between views many times to type a single word hinders the natural thought process. This prevents popular usage of native keyboard layouts. On the other hand, supporting romanized scripts (native words transcribed using Latin characters) with language model based suggestions is also set back by the lack of uniform romanization rules. To this end, we propose a disambiguation algorithm and showcase its usefulness in two novel mutually non exclusive input methods for languages natively using the abugida writing system (a) disambiguation of ambiguous input for abugida scripts, and (b) disambiguation of word variants in romanized scripts. We benchmark these approaches using public datasets, and show an improvement in typing speed by 19.49 , 25.13 , and 14.89 , in Hindi, Bengali, and Thai, respectively, using Ambiguous Input, owing to the human ease of locating keys combined with the efficiency of our inference method. Our Word Variant Disambiguation (WDA) maps valid variants of romanized words, previously treated as Out of Vocab, to a vocabulary of 100k words with high accuracy, leading to an increase in Error Correction F1 score by 10.03 and Next Word Prediction (NWP) by 62.50 on average.


Rainbow Tur 'an number of clique subdivisions. We show that for any integer t geq 2 , every properly edge coloured graph on n vertices with more than n 1 o(1) edges contains a rainbow subdivision of K t . Note that this bound on the number of edges is sharp up to the o(1) error term. This is a rainbow analogue of some classical results on clique subdivisions and extends some results on rainbow Tur 'an numbers. Our method relies on the framework introduced by Sudakov and Tomon 2020 which we adapt to find robust expanders in the coloured setting.


Learning Symbolic Expressions Mixed Integer Formulations, Cuts, and Heuristics. In this paper we consider the problem of learning a regression function without assuming its functional form. This problem is referred to as symbolic regression. An expression tree is typically used to represent a solution function, which is determined by assigning operators and operands to the nodes. The symbolic regression problem can be formulated as a nonconvex mixed integer nonlinear program (MINLP), where binary variables are used to assign operators and nonlinear expressions are used to propagate data values through nonlinear operators such as square, square root, and exponential. We extend this formulation by adding new cuts that improve the solution of this challenging MINLP. We also propose a heuristic that iteratively builds an expression tree by solving a restricted MINLP. We perform computational experiments and compare our approach with a mixed integer program based method and a neural network based method from the literature.


Co Embedding Discovering Communities on Bipartite Graphs through Projection. Many datasets take the form of a bipartite graph where two types of nodes are connected by relationships, like the movies watched by a user or the tags associated with a file. The partitioning of the bipartite graph could be used to fasten recommender systems, or reduce the information retrieval system's index size, by identifying groups of items with similar properties. This type of graph is often processed by algorithms using the Vector Space Model representation, where a binary vector represents an item with 0 and 1. The main problem with this representation is the dimension relatedness, like words' synonymity, which is not considered. This article proposes a co clustering algorithm using items projection, allowing the measurement of features similarity. We evaluated our algorithm on a cluster retrieval task. Over various datasets, our algorithm produced well balanced clusters with coherent items in, leading to high retrieval scores on this task..


Completeness in topological vector spaces and filters on N. We study completeness of a topological vector space with respect to different filters on the set N of all naturals. In the metrizable case all these kinds of completeness are the same, but in non metrizable case the situation changes. For example, a space may be complete with respect to one ultrafilter on N, but incomplete with respect to another. Our study was motivated by Aizpuru, List 'an Garc 'ia and Rambla Barreno Quaest. Math., 2014 and List 'an Garc 'ia Bull. Belg. Math. Soc. Simon Stevin, 2016 where for normed spaces the equivalence of the ordinary completeness and completeness with respect to f statistical convergence was established.


Contour Proposal Networks for Biomedical Instance Segmentation. We present a conceptually simple framework for object instance segmentation called Contour Proposal Network (CPN), which detects possibly overlapping objects in an image while simultaneously fitting closed object contours using an interpretable, fixed sized representation based on Fourier Descriptors. The CPN can incorporate state of the art object detection architectures as backbone networks into a single stage instance segmentation model that can be trained end to end. We construct CPN models with different backbone networks, and apply them to instance segmentation of cells in datasets from different modalities. In our experiments, we show CPNs that outperform U Nets and Mask R CNNs in instance segmentation accuracy, and present variants with execution times suitable for real time applications. The trained models generalize well across different domains of cell types. Since the main assumption of the framework are closed object contours, it is applicable to a wide range of detection problems also outside the biomedical domain. An implementation of the model architecture in PyTorch is freely available.