Combining Rules and Embeddings via Neuro Symbolic AI for Knowledge Base Completion. Recent interest in Knowledge Base Completion (KBC) has led to a plethora of approaches based on reinforcement learning, inductive logic programming and graph embeddings. In particular, rule based KBC has led to interpretable rules while being comparable in performance with graph embeddings. Even within rule based KBC, there exist different approaches that lead to rules of varying quality and previous work has not always been precise in highlighting these differences. Another issue that plagues most rule based KBC is the non uniformity of relation paths some relation sequences occur in very few paths while others appear very frequently. In this paper, we show that not all rule based KBC models are the same and propose two distinct approaches that learn in one case 1) a mixture of relations and the other 2) a mixture of paths. When implemented on top of neuro symbolic AI, which learns rules by extending Boolean logic to real valued logic, the latter model leads to superior KBC accuracy outperforming state of the art rule based KBC by 2 10 in terms of mean reciprocal rank. Furthermore, to address the non uniformity of relation paths, we combine rule based KBC with graph embeddings thus improving our results even further and achieving the best of both worlds.


Discrete pseudo differential operators and applications to numerical schemes. We define a class of discrete operators acting on infinite, finite or periodic sequences mimicking the standard properties of pseudo differential operators. In particular we can define the notion of order and regularity, and we recover the fundamental property that the commutator of two discrete operators gains one order of regularity. We show that standard differential operators acting on periodic functions, finite difference operators and fully discrete pseudo spectral methods fall into this class of discrete pseudo differential operators. As examples of practical applications, we revisit standard error estimates for the convergence of splitting methods, obtaining in some Hamiltonian cases no loss of derivative in the error estimates, in particular for discretizations of general waves and or water waves equations. Moreover, we give an example of preconditioner constructions inspired by normal form analysis to deal with the similar question for more general cases.


Robust Recommendation with Implicit Feedback via Eliminating the Effects of Unexpected Behaviors. In the implicit feedback recommendation, incorporating short term preference into recommender systems has attracted increasing attention in recent years. However, unexpected behaviors in historical interactions like clicking some items by accident don't well reflect users' inherent preferences. Existing studies fail to model the effects of unexpected behaviors, thus achieve inferior recommendation performance. In this paper, we propose a Multi Preferences Model (MPM) to eliminate the effects of unexpected behaviors. MPM first extracts the users' instant preferences from their recent historical interactions by a fine grained preference module. Then an unexpected behaviors detector is trained to judge whether these instant preferences are biased by unexpected behaviors. We also integrate user's general preference in MPM. Finally, an output module is performed to eliminate the effects of unexpected behaviors and integrates all the information to make a final recommendation. We conduct extensive experiments on two datasets of a movie and an e retailing, demonstrating significant improvements in our model over the state of the art methods. The experimental results show that MPM gets a massive improvement in HR 10 and NDCG 10, which relatively increased by 3.643 and 4.107 compare with AttRec model on average. We publish our code at https github.com chenjie04 MPM .


Anode metal drop formation and detachment mechanisms in liquid metal batteries. We study numerically localised short circuits in Li Bi liquid metal batteries. In the prototype of a classical, three liquid layer system, we assume a perceptible local deformation of the Li salt interface. We find that there always exists a critical current at which a Li droplet is cut off from this hump, and transferred to the Bi phase. In a second case, we assume that the molten Li is contained in a metal foam, and that a small Li droplet emerges below this foam due to insufficient wetting. This droplet is deformed by Lorentz forces, until eventually being pinched off. Here, the critical current is slightly lower than in the three layer system, and both, a droplet transfer and complete short circuits are observed. Finally, we discuss the relevance of our simulations for experimentally observed short circuits and non faradaic Li transfer.


Formalising Concepts as Grounded Abstractions. The notion of concept has been studied for centuries, by philosophers, linguists, cognitive scientists, and researchers in artificial intelligence (Margolis Laurence, 1999). There is a large literature on formal, mathematical models of concepts, including a whole sub field of AI Formal Concept Analysis devoted to this topic (Ganter Obiedkov, 2016). Recently, researchers in machine learning have begun to investigate how methods from representation learning can be used to induce concepts from raw perceptual data (Higgins, Sonnerat, et al., 2018). The goal of this report is to provide a formal account of concepts which is compatible with this latest work in deep learning. The main technical goal of this report is to show how techniques from representation learning can be married with a lattice theoretic formulation of conceptual spaces. The mathematics of partial orders and lattices is a standard tool for modelling conceptual spaces (Ch.2, Mitchell (1997), Ganter and Obiedkov (2016)) however, there is no formal work that we are aware of which defines a conceptual lattice on top of a representation that is induced using unsupervised deep learning (Goodfellow et al., 2016). The advantages of partially ordered lattice structures are that these provide natural mechanisms for use in concept discovery algorithms, through the meets and joins of the lattice.


Mobility Aware Edge Computing Segmentation Towards Localized Orchestration. The current trend in end user devices' advancements in computing and communication capabilities makes edge computing an attractive solution to pave the way for the coveted ultra low latency services. The success of the edge computing networking paradigm depends on the proper orchestration of the edge servers. Several Edge applications and services are intolerant to latency, especially in 5G and beyond networks, such as intelligent video surveillance, E health, Internet of Vehicles, and augmented reality applications. The edge devices underwent rapid growth in both capabilities and size to cope with the service demands. Orchestrating it on the cloud was a prominent trend during the past decade. However, the increasing number of edge devices poses a significant burden on the orchestration delay. In addition to the growth in edge devices, the high mobility of users renders traditional orchestration schemes impractical for contemporary edge networks. Proper segmentation of the edge space becomes necessary to adapt these schemes to address these challenges. In this paper, we introduce a segmentation technique employing lax clustering and segregated mobility based clustering. We then apply latency mapping to these clusters. The proposed scheme's main objective is to create subspaces (segments) that enable light and efficient edge orchestration by reducing the processing time and the core cloud communication overhead. A bench marking simulation is conducted with the results showing decreased mobility related failures and reduced orchestration delay.


The Blessings of Unlabeled Background in Untrimmed Videos. Weakly supervised Temporal Action Localization (WTAL) aims to detect the action segments with only video level action labels in training. The key challenge is how to distinguish the action of interest segments from the background, which is unlabelled even on the video level. While previous works treat the background as "curses", we consider it as "blessings". Specifically, we first use causal analysis to point out that the common localization errors are due to the unobserved confounder that resides ubiquitously in visual recognition. Then, we propose a Temporal Smoothing PCA based (TS PCA) deconfounder, which exploits the unlabelled background to model an observed substitute for the unobserved confounder, to remove the confounding effect. Note that the proposed deconfounder is model agnostic and non intrusive, and hence can be applied in any WTAL method without model re designs. Through extensive experiments on four state of the art WTAL methods, we show that the deconfounder can improve all of them on the public datasets THUMOS 14 and ActivityNet 1.3.


On weakly coupled systems of partial differential equations with different diffusion terms. We prove maximal Schauder regularity for solutions to elliptic systems and Cauchy problems, in the space C b( mathbb R d mathbb R m) of bounded and continuous functions, associated to a class of nonautonomous weakly coupled second order elliptic operators bf mathcal A , with possibly unbounded coefficients and diffusion and drift terms which vary from equation to equation. We also provide estimates of the spatial derivatives up to the third order and continuity properties both of the evolution operator bf G (t,s) associated to the Cauchy problem D t bf u bf mathcal A (t) bf u in C b( mathbb R d mathbb R m) , and, for fixed overline t , of the semigroup bf T overline t ( tau) associated to the autonomous Cauchy problem D tau bf u bf mathcal A ( overline t) bf u in C b( mathbb R d mathbb R m) . These results allow us to deal with elliptic problems whose coefficients also depend on time.


SOMTimeS Self Organizing Maps for Time Series Clustering and its Application to Serious Illness Conversations. There is an increasing demand for scalable algorithms capable of clustering and analyzing large time series datasets. The Kohonen self organizing map (SOM) is a type of unsupervised artificial neural network for visualizing and clustering complex data, reducing the dimensionality of data, and selecting influential features. Like all clustering methods, the SOM requires a measure of similarity between input data (in this work time series). Dynamic time warping (DTW) is one such measure, and a top performer given that it accommodates the distortions when aligning time series. Despite its use in clustering, DTW is limited in practice because it is quadratic in runtime complexity with the length of the time series data. To address this, we present a new DTW based clustering method, called SOMTimeS (a Self Organizing Map for TIME Series), that scales better and runs faster than other DTW based clustering algorithms, and has similar performance accuracy. The computational performance of SOMTimeS stems from its ability to prune unnecessary DTW computations during the SOM's training phase. We also implemented a similar pruning strategy for K means for comparison with one of the top performing clustering algorithms. We evaluated the pruning effectiveness, accuracy, execution time and scalability on 112 benchmark time series datasets from the University of California, Riverside classification archive. We showed that for similar accuracy, the speed up achieved for SOMTimeS and K means was 1.8x on average however, rates varied between 1x and 18x depending on the dataset. SOMTimeS and K means pruned 43 and 50 of the total DTW computations, respectively. We applied SOMtimeS to natural language conversation data collected as part of a large healthcare cohort study of patient clinician serious illness conversations to demonstrate the algorithm's utility with complex, temporally sequenced phenomena.


Dipole dipole polarizability of the cadmium mathbf 1S 0 state revisited. Experimental results and high level quantum chemical ab initio calculations of the static polarizability alpha 0 alpha( omega 0) of the cadmium 1S 0 state are still in marked disagreement. Here we analyze this discrepancy by using experimentally determined dipole oscillator strength distributions (DOSD). It will be shown that within this procedure the experimentally determined static polarizability alpha 0 will shift from 49.7 pm 1.6 au to considerably lower values. We now conclude an experimentally determined polarizability of alpha 0 47.5 pm 2.0 au in much better agreement with the latest calculations of alpha 0 approx 46 au.


Adaptive Coding for Matrix Multiplication at Edge Networks. Edge computing is emerging as a new paradigm to allow processing data at the edge of the network, where data is typically generated and collected, by exploiting multiple devices at the edge collectively. However, exploiting the potential of edge computing is challenging mainly due to the heterogeneous and time varying nature of edge devices. Coded computation, which advocates mixing data in sub tasks by employing erasure codes and offloading these sub tasks to other devices for computation, is recently gaining interest, thanks to its higher reliability, smaller delay, and lower communication cost. In this paper, our focus is on characterizing the cost benefit trade offs of coded computation for practical edge computing systems, and develop an adaptive coded computation framework. In particular, we focus on matrix multiplication as a computationally intensive task, and develop an adaptive coding for matrix multiplication (ACM 2) algorithm by taking into account the heterogeneous and time varying nature of edge devices. ACM 2 dynamically selects the best coding policy by taking into account the computing time, storage requirements as well as successful decoding probability. We show that ACM 2 improves the task completion delay significantly as compared to existing coded matrix multiplication algorithms.


Sequential Modelling with Applications to Music Recommendation, Fact Checking, and Speed Reading. Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential interest to users on the basis of their previous interactions. In such cases, the sequential order of user interactions is often indicative of what the user is interested in next. Similarly, for systems that automatically infer the semantics of text, capturing the sequential order of words in a sentence is essential, as even a slight re ordering could significantly alter its original meaning. This thesis makes methodological contributions and new investigations of sequential modelling for the specific application areas of systems that recommend music tracks to listeners and systems that process text semantics in order to automatically fact check claims, or "speed read" text for efficient further classification. (Rest of abstract omitted due to arXiv abstract limit)


BLEKeeper Response Time Behavior Based Man In The Middle Attack Detection. Bluetooth Low Energy (BLE) has become one of the most popular wireless communication protocols and is used in billions of smart devices. Despite several security features, the hardware and software limitations of these devices makes them vulnerable to man in the middle (MITM) attacks. Due to the use of these devices in increasingly diverse and safety critical applications, the capability to detect MITM attacks has become more critical. To address this challenge, we propose the use of the response time behavior of a BLE device observed in relation to select read and write operations and introduce an activeMITM attack detection system that identifies changes in response time. Our measurements on several BLE devices show that theirresponse time behavior exhibits very high regularity, making it a very reliable attack indicator that cannot be concealed by an attacker. Test results show that our system can very accurately and quickly detect MITM attacks while requiring a simple learning approach.


Natural Typing Recognition via Surface Electromyography. By using a computer keyboard as a finger recording device, we construct the largest existing dataset for gesture recognition via surface electromyography (sEMG), and use deep learning to achieve over 90 character level accuracy on reconstructing typed text entirely from measured muscle potentials. We prioritize the temporal structure of the EMG signal instead of the spatial structure of the electrode layout, using network architectures inspired by those used for real time spoken language transcription. Our architecture recognizes the rapid movements of natural computer typing, which occur at irregular intervals and often overlap in time. The extensive size of our dataset also allows us to study gesture recognition after synthetically downgrading the spatial or temporal resolution, showing the system capabilities necessary for real time gesture recognition.


CiteWorth Cite Worthiness Detection for Improved Scientific Document Understanding. Scientific document understanding is challenging as the data is highly domain specific and diverse. However, datasets for tasks with scientific text require expensive manual annotation and tend to be small and limited to only one or a few fields. At the same time, scientific documents contain many potential training signals, such as citations, which can be used to build large labelled datasets. Given this, we present an in depth study of cite worthiness detection in English, where a sentence is labelled for whether or not it cites an external source. To accomplish this, we introduce CiteWorth, a large, contextualized, rigorously cleaned labelled dataset for cite worthiness detection built from a massive corpus of extracted plain text scientific documents. We show that CiteWorth is high quality, challenging, and suitable for studying problems such as domain adaptation. Our best performing cite worthiness detection model is a paragraph level contextualized sentence labelling model based on Longformer, exhibiting a 5 F1 point improvement over SciBERT which considers only individual sentences. Finally, we demonstrate that language model fine tuning with cite worthiness as a secondary task leads to improved performance on downstream scientific document understanding tasks.


A Tale of Two Lexica Testing Computational Hypotheses with Deep Convolutional Neural Networks. Gow's (2012) dual lexicon model suggests that the primary purpose of words is to mediate the mappings between acoustic phonetic input and other forms of linguistic representation. Motivated by evidence from functional imaging, aphasia, and behavioral results, the model argues for the existence of two parallel wordform stores the dorsal and ventral processing streams. In this paper, we tested the hypothesis that the complex, but systematic mapping between sound and articulation in the dorsal stream poses different computational pressures on feature sets than the more arbitrary mapping between sound and meaning. To test this hypothesis, we created two deep convolutional neural networks (CNNs). While the dorsal network was trained to identify individual spoken words, the ventral network was trained to map them onto semantic classes. We then extracted patterns of network activation from the penultimate level of each network and tested how well features generated by the network supported generalization to linguistic categorization associated with the dorsal versus ventral processing streams. Our preliminary results showed both models successfully learned their tasks. Secondary generalization testing showed the ventral CNN outperformed the dorsal CNN on a semantic task concreteness classification, while the dorsal CNN outperformed the ventral CNN on articulation tasks classification by onset phoneme class and syllable length. These results are consistent with the hypothesis that the divergent processing demands of the ventral and dorsal processing streams impose computational pressures for the development of multiple lexica.


Monodromies of Projective Structures on Surface of Finite type. We characterize the monodromies of projective structures with fuchsian type singularities. Namely, any representation from the fundamental group of a Riemann surface of finite type in PSL 2( mathbb C ) can be represented as the holonomy of branched projective structure with fuchsian type singularities over the cusps. We made a geometrical topological study of all local conical projective structures whose Schwarzian derivative admits a simple pole at the cusp. Finally, we explore isomonodromic deformations of such projective structures and the problem of minimizing angles.


On the Similarity between von Neumann Graph Entropy and Structural Information Interpretation, Computation, and Applications. The von Neumann graph entropy is a measure of graph complexity based on the Laplacian spectrum. It has recently found applications in various learning tasks driven by networked data. However, it is computational demanding and hard to interpret using simple structural patterns. Due to the close relation between Lapalcian spectrum and degree sequence, we conjecture that the structural information, defined as the Shannon entropy of the normalized degree sequence, might be a good approximation of the von Neumann graph entropy that is both scalable and interpretable. In this work, we thereby study the difference between the structural information and von Neumann graph entropy named as em entropy gap . Based on the knowledge that the degree sequence is majorized by the Laplacian spectrum, we for the first time prove the entropy gap is between 0 and log 2 e in any undirected unweighted graphs. Consequently we certify that the structural information is a good approximation of the von Neumann graph entropy that achieves provable accuracy, scalability, and interpretability simultaneously. This approximation is further applied to two entropy related tasks network design and graph similarity measure, where novel graph similarity measure and fast algorithms are proposed. Our experimental results on graphs of various scales and types show that the very small entropy gap readily applies to a wide range of graphs and weighted graphs. As an approximation of the von Neumann graph entropy, the structural information is the only one that achieves both high efficiency and high accuracy among the prominent methods. It is at least two orders of magnitude faster than SLaQ with comparable accuracy. Our structural information based methods also exhibit superior performance in two entropy related tasks.


Closing the Planning Learning Loop with Application to Autonomous Driving in a Crowd. Imagine an autonomous robot vehicle driving in dense, possibly unregulated urban traffic. To contend with an uncertain, interactive environment with heterogeneous traffic of cars, motorcycles, buses, ..., the robot vehicle has to plan in both short and long terms in order to drive effectively and approach human level performance. Planning explicitly over a long time horizon, however, incurs prohibitive computational cost and is impractical under real time constraints. To achieve real time performance for large scale planning, this work introduces Learning from Tree Search for Driving (LeTS Drive), which integrates planning and learning in a closed loop. LeTS Drive learns a driving policy from a planner, which is based on sparsely sampled tree search. The learned policy in turn guides online planning for real time vehicle control. These two steps are repeated to form a closed loop so that the planner and the learner inform each other and improve in synchrony. The entire system can learn on its own in a self supervised manner, without human effort on explicit data labeling. We applied LeTSDrive to autonomous driving in crowded urban environments in simulation. Experimental results show clearly that LeTS Drive outperforms either planning or learning alone, as well as open loop integration of planning and learning.


SwiftLane Towards Fast and Efficient Lane Detection. Recent work done on lane detection has been able to detect lanes accurately in complex scenarios, yet many fail to deliver real time performance specifically with limited computational resources. In this work, we propose SwiftLane a simple and light weight, end to end deep learning based framework, coupled with the row wise classification formulation for fast and efficient lane detection. This framework is supplemented with a false positive suppression algorithm and a curve fitting technique to further increase the accuracy. Our method achieves an inference speed of 411 frames per second, surpassing state of the art in terms of speed while achieving comparable results in terms of accuracy on the popular CULane benchmark dataset. In addition, our proposed framework together with TensorRT optimization facilitates real time lane detection on a Nvidia Jetson AGX Xavier as an embedded system while achieving a high inference speed of 56 frames per second.


Leaky Frontends Security Vulnerabilities in Processor Frontends. This paper evaluates new security threats due to the processor frontend in modern Intel processors. The root causes of the security threats are the multiple paths in the processor frontend that the micro operations can take through the Micro Instruction Translation Engine (MITE), through the Decode Stream Buffer (DSB), also called the Micro operation Cache, or through the Loop Stream Detector (LSD). Each path has its own unique timing and power signatures, which lead to the side and covert channel attacks presented in this work. Especially, the switching between the different paths leads to observable timing or power differences which, as this work demonstrates, could be exploited by attackers. Because of the different paths, the switching, and way the components are shared in the frontend between hardware threads, two separate threads are able to be mutually influenced and timing or power can reveal activity on the other thread. The security threats are not limited to multi threading, and this work further demonstrates new ways for leaking execution information about SGX enclaves or a new in domain Spectre variant in single thread setting. Finally, this work demonstrates a new method for fingerprinting the microcode patches of the processor by analyzing the behavior of different paths in the frontend. The findings of this work highlight the security threats associated with the processor frontend and the need for deployment of defenses for the modern processor frontend.


Space time wave packets violate the universal relationship between angular dispersion and pulse front tilt. Introducing angular dispersion into a pulsed field tilts the pulse front with respect to the phase front. There exists between the angular dispersion and the pulse front tilt a universal relationship that is device independent, and also independent of the pulse shape and bandwidth. We show here that this relationship is violated by propagation invariant space time (ST) wave packets, which are pulsed beams endowed with precise spatio temporal structure corresponding to a particular form of angular dispersion. We demonstrate theoretically and experimentally that underlying ST wave packets is to the best of our knowledge the first example in optics of non differentiable angular dispersion, resulting in pulse front tilt that depends on the pulse bandwidth even at fixed angular dispersion.


Deep learning based statistical noise reduction for multidimensional spectral data. In spectroscopic experiments, data acquisition in multi dimensional phase space may require long acquisition time, owing to the large phase space volume to be covered. In such case, the limited time available for data acquisition can be a serious constraint for experiments in which multidimensional spectral data are acquired. Here, taking angle resolved photoemission spectroscopy (ARPES) as an example, we demonstrate a denoising method that utilizes deep learning as an intelligent way to overcome the constraint. With readily available ARPES data and random generation of training data set, we successfully trained the denoising neural network without overfitting. The denoising neural network can remove the noise in the data while preserving its intrinsic information. We show that the denoising neural network allows us to perform similar level of second derivative and line shape analysis on data taken with two orders of magnitude less acquisition time. The importance of our method lies in its applicability to any multidimensional spectral data that are susceptible to statistical noise.


Oriented and unitary equivariant bordism of surfaces. Fix a finite group G . We study Omega SO,G 2 and Omega U,G 2 , the unitary and oriented bordism groups of smooth G equivariant compact surfaces, respectively, and we calculate them explicitly. Their ranks are determined by the possible representations around fixed points, while their torsion subgroups are isomorphic to the direct sum of the Bogomolov multipliers of the Weyl groups of representatives of conjugacy classes of all subgroups of G . We present an alternative proof of the fact that surfaces with free actions which induce non trivial elements in the Bogomolov multiplier of the group cannot equivariantly bound. This result permits us to show that the 2 dimensional SK groups (Schneiden und Kleben, or cut and paste") of the classifying spaces of a finite group can be understood in terms of the bordism group of free equivariant surfaces modulo the ones that bound arbitrary actions.


Object Tracking by Detection with Visual and Motion Cues. Self driving cars and other autonomous vehicles need to detect and track objects in camera images. We present a simple online tracking algorithm that is based on a constant velocity motion model with a Kalman filter, and an assignment heuristic. The assignment heuristic relies on four metrics An embedding vector that describes the appearance of objects and can be used to re identify them, a displacement vector that describes the object movement between two consecutive video frames, the Mahalanobis distance between the Kalman filter states and the new detections, and a class distance. These metrics are combined with a linear SVM, and then the assignment problem is solved by the Hungarian algorithm. We also propose an efficient CNN architecture that estimates these metrics. Our multi frame model accepts two consecutive video frames which are processed individually in the backbone, and then optical flow is estimated on the resulting feature maps. This allows the network heads to estimate the displacement vectors. We evaluate our approach on the challenging BDD100K tracking dataset. Our multi frame model achieves a good MOTA value of 39.1 with low localization error of 0.206 in MOTP. Our fast single frame model achieves an even lower localization error of 0.202 in MOTP, and a MOTA value of 36.8 .


Multiplicative equivariant K theory and the Barratt Priddy Quillen theorem. We prove a multiplicative version of the equivariant Barratt Priddy Quillen theorem, starting from the additive version proven in arXiv 1207.3459. The proof uses a multiplicative elaboration of an additive equivariant infinite loop space machine that manufactures orthogonal G spectra from symmetric monoidal G categories. The new machine produces highly structured associative ring and module G spectra from appropriate multiplicative input. It relies on new operadic multicategories that are of considerable independent interest and are defined in a general, not necessarily equivariant or topological, context. Most of our work is focused on constructing and comparing them. We construct a multifunctor from the multicategory of symmetric monoidal G categories to the multicategory of orthogonal G spectra. With this machinery in place, we prove that the equivariant BPQ theorem can be lifted to a multiplicative equivalence. That is the heart of what is needed for the presheaf reconstruction of the category of G spectra in arXiv 1110.3571.


On graphs with unique geoodesics and antipodes. In 1962, Oystein Ore asked in which graphs there is exactly one geodesic between any two vertices. He called such graphs geodetic. In this paper, we systematically study properties of geodetic graphs, and also consider antipodal graphs, in which each vertex has exactly one antipode (a farthest vertex). We find necessary and sufficient conditions for a graph to be geodetic or antipodal, obtain results related to algorithmic construction, and find interesting families of Hamiltonian geodetic graphs. By introducing and describing the maximal hereditary subclasses and the minimal hereditary superclasses of the geodetic and antipodal graphs, we get close to the goal of our research a constructive classification of these graphs.


A spectral element method for modelling streamer discharges in low temperature atmospheric pressure plasmas. Streamers are ionization fronts that occur in gases at atmospheric and sub atmospheric pressures. Numerical studies of streamers are important for practical applications but are challenging due to the multiscale nature of this discharge type. This paper introduces a spectral element method for modelling streamer discharges. The method is developed for Cartesian grids but can be extended to be used on unstructured meshes. The streamer model is based on the Poisson equation for the electric potential and the electron continuity equation. The Poisson equation is discretized via a spectral method based on the integral representation of the solution. The hierarchical Poincare Steklov (HPS) scheme is used to solve the resulting set of equations. The electron continuity equation is solved by means of the discontinuous Galerkin spectral element method (DGSEM). The DGSEM is extended by an alternative definition of the diffusion flux. A subcell finite volume method is used to stabilize the DGSEM scheme, if required. The entire simulation scheme is validated by solving a number of test problems and reproducing the results of previous studies. Adaptive mesh refinement is used to reduce the number of unknowns. The proposed method is found to be sufficiently fast for being used in practical applications. The flexibility of the method provides an interesting opportunity to broaden the range of problems that can be addressed in numerical studies of low temperature plasma discharges.


Measuring Data Leakage in Machine Learning Models with Fisher Information. Machine learning models contain information about the data they were trained on. This information leaks either through the model itself or through predictions made by the model. Consequently, when the training data contains sensitive attributes, assessing the amount of information leakage is paramount. We propose a method to quantify this leakage using the Fisher information of the model about the data. Unlike the worst case a priori guarantees of differential privacy, Fisher information loss measures leakage with respect to specific examples, attributes, or sub populations within the dataset. We motivate Fisher information loss through the Cram ' e r Rao bound and delineate the implied threat model. We provide efficient methods to compute Fisher information loss for output perturbed generalized linear models. Finally, we empirically validate Fisher information loss as a useful measure of information leakage.


Simulating weak field attosecond processes with a Lanczos reduced basis approach to time dependent equation of motion coupled cluster theory. A time dependent equation of motion coupled cluster singles and doubles (TD EOM CCSD) method is implemented, which uses a reduced basis calculated with the asymmetric band Lanczos algorithm. The approach is used to study weak field processes in small molecules induced by ultrashort valence pump and core probe pulses. We assess the reliability of the procedure by comparing TD EOM CCSD absorption spectra to spectra obtained from the time dependent coupled cluster singles and doubles (TDCCSD) method and observe that spectral features can be reproduced for several molecules, at much lower computational times. We discuss how multiphoton absorption and symmetry can be handled in the method and general features of the core valence separation (CVS) projection technique. We also model the transient absorption of an attosecond X ray probe pulse by the glycine molecule.


Detecting and Matching Related Objects with One Proposal Multiple Predictions. Tracking players in sports videos is commonly done in a tracking by detection framework, first detecting players in each frame, and then performing association over time. While for some sports tracking players is sufficient for game analysis, sports like hockey, tennis and polo may require additional detections, that include the object the player is holding (e.g. racket, stick). The baseline solution for this problem involves detecting these objects as separate classes, and matching them to player detections based on the intersection over union (IoU). This approach, however, leads to poor matching performance in crowded situations, as it does not model the relationship between players and objects. In this paper, we propose a simple yet efficient way to detect and match players and related objects at once without extra cost, by considering an implicit association for prediction of multiple objects through the same proposal box. We evaluate the method on a dataset of broadcast ice hockey videos, and also a new public dataset we introduce called COCO Torso. On the ice hockey dataset, the proposed method boosts matching performance from 57.1 to 81.4 , while also improving the meanAP of player stick detections from 68.4 to 88.3 . On the COCO Torso dataset, we see matching improving from 47.9 to 65.2 . The COCO Torso dataset, code and pre trained models will be released at https github.com foreverYoungGitHub detect and match related objects.


Preventing Machine Learning Poisoning Attacks Using Authentication and Provenance. Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to identify such attacks. In this work, we take a different approach to preventing data poisoning attacks which relies on cryptographically based authentication and provenance to ensure the integrity of the data used to train a machine learning model. The same approach is also used to prevent software poisoning and model poisoning attacks. A software poisoning attack maliciously alters one or more software components used to train a model. Once the model has been trained it can also be protected against model poisoning attacks which seek to alter a model's predictions by modifying its underlying parameters or structure. Finally, an evaluation set or test set can also be protected to provide evidence if they have been modified by a second data poisoning attack. To achieve these goals, we propose VAMP which extends the previously proposed AMP system, that was designed to protect media objects such as images, video files or audio clips, to the machine learning setting. We first provide requirements for authentication and provenance for a secure machine learning system. Next, we demonstrate how VAMP's manifest meets these requirements to protect a machine learning system's datasets, software components, and models.


Hyperspherically Regularized Networks for Self Supervision. Bootstrap Your Own Latent (BYOL) introduced an approach to self supervised learning avoiding the contrastive paradigm and subsequently removing the computational burden of negative sampling associated with such methods. However, we empirically find that the image representations produced under the BYOL's self distillation paradigm are poorly distributed in representation space compared to contrastive methods. This work empirically demonstrates that feature diversity enforced by contrastive losses is beneficial to image representation uniformity when employed in BYOL, and as such, provides greater inter class representation separability. Additionally, we explore and advocate the use of regularization methods, specifically the layer wise minimization of hyperspherical energy (i.e. maximization of entropy) of network weights to encourage representation uniformity. We show that directly optimizing a measure of uniformity alongside the standard loss, or regularizing the networks of the BYOL architecture to minimize the hyperspherical energy of neurons can produce more uniformly distributed and therefore better performing representations for downstream tasks.


Potentials, exchange, and correlation in attosecond photoemission delays. We investigate attosecond time delays in the emission of photoelectrons using a hierarchy of models of the CO 2 molecule including the strong field approximation, Coulomb scattering, short range parts of the molecular potential, Hartree and Hartree Fock descriptions. In addition, we present an it ab initio calculation based on quantum chemical structure in combination with strong field techniques, which fully includes multi electron exchange and correlation. Every single of these model constituents is found to modify delays on the scale of 10 as or more, with exchange and correlation having the most pronounced effect.


Impact of On Chip Interconnect on In Memory Acceleration of Deep Neural Networks. With the widespread use of Deep Neural Networks (DNNs), machine learning algorithms have evolved in two diverse directions one with ever increasing connection density for better accuracy and the other with more compact sizing for energy efficiency. The increase in connection density increases on chip data movement, which makes efficient on chip communication a critical function of the DNN accelerator. The contribution of this work is threefold. First, we illustrate that the point to point (P2P) based interconnect is incapable of handling a high volume of on chip data movement for DNNs. Second, we evaluate P2P and network on chip (NoC) interconnect (with a regular topology such as a mesh) for SRAM and ReRAM based in memory computing (IMC) architectures for a range of DNNs. This analysis shows the necessity for the optimal interconnect choice for an IMC DNN accelerator. Finally, we perform an experimental evaluation for different DNNs to empirically obtain the performance of the IMC architecture with both NoC tree and NoC mesh. We conclude that, at the tile level, NoC tree is appropriate for compact DNNs employed at the edge, and NoC mesh is necessary to accelerate DNNs with high connection density. Furthermore, we propose a technique to determine the optimal choice of interconnect for any given DNN. In this technique, we use analytical models of NoC to evaluate end to end communication latency of any given DNN. We demonstrate that the interconnect optimization in the IMC architecture results in up to 6 times improvement in energy delay area product for VGG 19 inference compared to the state of the art ReRAM based IMC architectures.


Multiscale Parareal Algorithm for Long Time Mesoscopic Simulations of Microvascular Blood Flow in Zebrafish. Various biological processes such as transport of oxygen and nutrients, thrombus formation, vascular angiogenesis and remodeling are related to cellular subcellular level biological processes, where mesoscopic simulations resolving detailed cell dynamics provide a key to understanding and identifying the cellular basis of disease. To break this bottleneck and achieve a biologically meaningful timescale, we propose a multiscale parareal algorithm in which a continuum based solver supervises a mesoscopic simulation in the time domain. Using an iterative prediction correction strategy, the parallel in time mesoscopic simulation supervised by its continuum based counterpart can converge fast. The effectiveness of the proposed method is first verified in a time dependent flow with a sinusoidal flowrate through a Y shaped bifurcation channel. Physical quantities of interest including velocity, wall shear stress and flowrate are computed to compare against those of reference solutions, showing a less than 1 relative error on flowrate in the Newtonian flow and a less than 3 relative error in the non Newtonian blood flow. The proposed method is then applied to a large scale mesoscopic simulation of microvessel blood flow in a zebrafish hindbrain for temporal acceleration. The time dependent blood flow from heartbeats in this realistic vascular network of zebrafish hindbrain is simulated using dissipative particle dynamics as the mesoscopic model, which is supervised by a one dimensional blood flow model (continuum based model) in multiple temporal sub domains. The computational analysis shows that the resulting microvessel blood flow converges to the reference solution after only two iterations. The proposed method is suitable for long time mesoscopic simulations with complex fluids and geometries.


(Non )Convergence of Solutions of the Convective Allen Cahn Equation. We consider the sharp interface limit of a convective Allen Cahn equation, which can be part of a Navier Stokes Allen Cahn system, for different scalings of the mobility m varepsilon m 0 varepsilon theta as varepsilon to 0 . In the case theta 2 we show a (non )convergence result in the sense that the concentrations converge to the solution of a transport equation, but they do not behave like a rescaled optimal profile in normal direction to the interface as in the case theta 0 . Moreover, we show that an associated mean curvature functional does not converge the corresponding functional for the sharp interface. Finally, we discuss the convergence in the case theta 0,1 by the method of formally matched asymptotics.


Molecular distance matrix prediction based on graph convolutional networks. Molecular structure has important applications in many fields. For example, some studies show that molecular spatial information can be used to achieve better prediction results when predicting molecular properties. However, traditional molecular geometry calculations, such as density functional theory (DFT), are time consuming. In view of this, we propose a model based on graph convolutional networks to predict the pairwise distance between atoms, also called distance matrix prediction of the molecule(DMGCN). In order to indicate the effect of DMGCN model, the model is compared with the model DeeperGCN DAGNN and the method of calculating molecular conformation in RDKit. Results show that the MAE of DMGCN is smaller than DeeperGCN DAGNN and RDKit. In addition, the distances predicted by the DMGCN model and the distances calculated by the QM9 dataset are used to predict the molecular properties, thus showing the effectiveness of the distance predicted by the DMGCN model.


Dynamics of Public Opinion Evolution with Asymmetric Cognitive Bias. In this paper, we propose a pubic opinion model with incorporation of asymmetric cognitive bias confirmation bias and negativity bias. We then investigate the generic modeling guidance of capturing asymmetric confirmation bias and negativity bias. A numerical examples is provided to demonstrate the correctness of asymmetric cognitive bias model.


Splitting authentication codes with perfect secrecy new results, constructions and connections with algebraic manipulation detection codes. A splitting BIBD is a type of combinatorial design that can be used to construct splitting authentication codes with good properties. In this paper we show that a design theoretic approach is useful in the analysis of more general splitting authentication codes. Motivated by the study of algebraic manipulation detection (AMD) codes, we define the concept of a group generated splitting authentication code. We show that all group generated authentication codes have perfect secrecy, which allows us to demonstrate that algebraic manipulation detection codes can be considered to be a special case of an authentication code with perfect secrecy. We also investigate splitting BIBDs that can be "equitably ordered". These splitting BIBDs yield authentication codes with splitting that also have perfect secrecy. We show that, while group generated BIBDs are inherently equitably ordered, the concept is applicable to more general splitting BIBDs. For various pairs (k,c) , we determine necessary and sufficient (or almost sufficient) conditions for the existence of (v, k times c,1) splitting BIBDs that can be equitably ordered. The pairs for which we can solve this problem are (k,c) (3,2), (4,2), (3,3) and (3,4) , as well as all cases with k 2 .


L p Positivity Preserving and a conjecture by M. Braverman, O. Milatovic and M. Shubin. In this paper we prove that a complete Riemannian manifold is L p positivity preserving for any p in(1, infty) . This means that any L p function which solves ( Delta 1)u ge 0 in the sense of distributions is necessarily non negative. In particular, the case p 2 of our result answers in the affermative a conjecture formulated by M. Braverman, O. Milatovic and M. Shubin in 2002. The two main ingredients are a new a priori regularity result for positive subharmonic distributions, which in turn permits to prove a Liouville type theorem, and a Brezis Kato inequality on Riemannian manifolds. Both these results rely on a smooth monotonic approximation of distributional solutions of Delta u ge lambda(x) u of independent interest.


Robust Allocations with Diversity Constraints. We consider the problem of allocating divisible items among multiple agents, and consider the setting where any agent is allowed to introduce diversity constraints on the items they are allocated. We motivate this via settings where the items themselves correspond to user ad slots or task workers with attributes such as race and gender on which the principal seeks to achieve demographic parity. We consider the following question When an agent expresses diversity constraints into an allocation rule, is the allocation of other agents hurt significantly? If this happens, the cost of introducing such constraints is disproportionately borne by agents who do not benefit from diversity. We codify this via two desiderata capturing robustness. These are no negative externality other agents are not hurt and monotonicity the agent enforcing the constraint does not see a large increase in value. We show in a formal sense that the Nash Welfare rule that maximizes product of agent values is uniquely positioned to be robust when diversity constraints are introduced, while almost all other natural allocation rules fail this criterion. We also show that the guarantees achieved by Nash Welfare are nearly optimal within a widely studied class of allocation rules. We finally perform an empirical simulation on real world data that models ad allocations to show that this gap between Nash Welfare and other rules persists in the wild.


Proof of Work Cryptocurrencies Does Mining Technology Undermine Decentralization?. Does the proof of work protocol serve its intended purpose of supporting decentralized cryptocurrency mining? To address this question, we develop a game theoretical model where miners first invest in hardware to improve the efficiency of their operations, and then compete for mining rewards in a rent seeking game. We argue that because of capacity constraints faced by miners, centralization in mining is lower than indicated by both public discourse and recent academic work. We show that advancements in hardware efficiency do not necessarily lead to larger miners increasing their advantage, but rather allow smaller miners to expand and new miners to enter the competition. Our calibrated model illustrates that hardware efficiency has a small impact on the cost of attacking a network, while the mining reward has a significant impact. This highlights the vulnerability of smaller and emerging cryptocurrencies, as well as of established cryptocurrencies transitioning to a fee based mining reward scheme.


Demystifying Ten Big Ideas and Rules Every Fire Scientist Engineer Should Know About Blackbox, Whitebox Causal Artificial Intelligence. Artificial intelligence (AI) is paving the way towards the fourth industrial revolution with the fire domain (Fire 4.0). As a matter of fact, the next few years will be elemental to how this technology will shape our academia, practice, and entrepreneurship. Despite the growing interest between fire research groups, AI remains absent of our curriculum, and we continue to lack a methodical framework to adopt, apply and create AI solutions suitable for our problems. The above is also true for parallel engineering domains (i.e., civil mechanical engineering), and in order to negate the notion of history repeats itself (e.g., look at the continued debate with regard to modernizing standardized fire testing, etc.), it is the motivation behind this letter to the Editor to demystify some of the big ideas behind AI to jump start prolific and strategic discussions on the front of AI Fire. In addition, this letter intends to explain some of the most fundamental concepts and clear common misconceptions specific to the adoption of AI in fire engineering. This short letter is a companion to the Smart Systems in Fire Engineering special issue sponsored by Fire Technology. An in depth review of AI algorithms 1 and success stories to the proper implementations of such algorithms can be found in the aforenoted special issue and collection of papers. This letter comprises two sections. The first section outlines big ideas pertaining to AI, and answers some of the burning questions with regard to the merit of adopting AI in our domain. The second section presents a set of rules or technical recommendations an AI user may deem helpful to practice whenever AI is used as an investigation methodology. The presented set of rules are complementary to the big ideas.


Linear solvers for power grid optimization problems a review of GPU accelerated linear solvers. The linear equations that arise in interior methods for constrained optimization are sparse symmetric indefinite and become extremely ill conditioned as the interior method converges. These linear systems present a challenge for existing solver frameworks based on sparse LU or LDL T decompositions. We benchmark five well known direct linear solver packages using matrices extracted from power grid optimization problems. The achieved solution accuracy varies greatly among the packages. None of the tested packages delivers significant GPU acceleration for our test cases.


Scheduled Sampling Based on Decoding Steps for Neural Machine Translation. Scheduled sampling is widely used to mitigate the exposure bias problem for neural machine translation. Its core motivation is to simulate the inference scene during training by replacing ground truth tokens with predicted tokens, thus bridging the gap between training and inference. However, vanilla scheduled sampling is merely based on training steps and equally treats all decoding steps. Namely, it simulates an inference scene with uniform error rates, which disobeys the real inference scene, where larger decoding steps usually have higher error rates due to error accumulations. To alleviate the above discrepancy, we propose scheduled sampling methods based on decoding steps, increasing the selection chance of predicted tokens with the growth of decoding steps. Consequently, we can more realistically simulate the inference scene during training, thus better bridging the gap between training and inference. Moreover, we investigate scheduled sampling based on both training steps and decoding steps for further improvements. Experimentally, our approaches significantly outperform the Transformer baseline and vanilla scheduled sampling on three large scale WMT tasks. Additionally, our approaches also generalize well to the text summarization task on two popular benchmarks.


Fredholm Toeplitz operators on doubling Fock spaces. Recently the authors characterized the Fredholmn properties of Toeplitz operators on weighted Fock spaces when the Laplacian of the weight function is bounded below and above. In the present work the authors extend their characterization to doubling Fock spaces with a subharmonic weight whose Laplacian is a doubling measure. The geometry induced by the Bergman metric for doubling Fock spaces is much more complicated than that of the Euclidean metric used in all the previous cases to study Fredholmness, which leads to considerably more involved calculations.


Spike inspired Rank Coding for Fast and Accurate Recurrent Neural Networks. Biological spiking neural networks (SNNs) can temporally encode information in their outputs, e.g. in the rank order in which neurons fire, whereas artificial neural networks (ANNs) conventionally do not. As a result, models of SNNs for neuromorphic computing are regarded as potentially more rapid and efficient than ANNs when dealing with temporal input. On the other hand, ANNs are simpler to train, and usually achieve superior performance. Here we show that temporal coding such as rank coding (RC) inspired by SNNs can also be applied to conventional ANNs such as LSTMs, and leads to computational savings and speedups. In our RC for ANNs, we apply backpropagation through time using the standard real valued activations, but only from a strategically early time step of each sequential input example, decided by a threshold crossing event. Learning then incorporates naturally also when to produce an output, without other changes to the model or the algorithm. Both the forward and the backward training pass can be significantly shortened by skipping the remaining input sequence after that first event. RC training also significantly reduces time to insight during inference, with a minimal decrease in accuracy. The desired speed accuracy trade off is tunable by varying the threshold or a regularization parameter that rewards output entropy. We demonstrate these in two toy problems of sequence classification, and in a temporally encoded MNIST dataset where our RC model achieves 99.19 accuracy after the first input time step, outperforming the state of the art in temporal coding with SNNs, as well as in spoken word classification of Google Speech Commands, outperforming non RC trained early inference with LSTMs.


Information cohomology of classical vector valued observables. We provide here a novel algebraic characterization of two information measures associated with a vector valued random variable, its differential entropy and the dimension of the underlying space, purely based on their recursive properties (the chain rule and the nullity rank theorem, respectively). More precisely, we compute the information cohomology of Baudot and Bennequin with coefficients in a module of continuous probabilistic functionals over a category that mixes discrete observables and continuous vector valued observables, characterizing completely the 1 cocycles evaluated on continuous laws, these cocycles are linear combinations of the differential entropy and the dimension.


Modeling Concentrated Cross Attention for Neural Machine Translation with Gaussian Mixture Model. Cross attention is an important component of neural machine translation (NMT), which is always realized by dot product attention in previous methods. However, dot product attention only considers the pair wise correlation between words, resulting in dispersion when dealing with long sentences and neglect of source neighboring relationships. Inspired by linguistics, the above issues are caused by ignoring a type of cross attention, called concentrated attention, which focuses on several central words and then spreads around them. In this work, we apply Gaussian Mixture Model (GMM) to model the concentrated attention in cross attention. Experiments and analyses we conducted on three datasets show that the proposed method outperforms the baseline and has significant improvement on alignment quality, N gram accuracy, and long sentence translation.


On the Automorphism Group of Polar Codes. The automorphism group of a code is the set of permutations of the codeword symbols that map the whole code onto itself. For polar codes, only a part of the automorphism group was known, namely the lower triangular affine group (LTA), which is solely based upon the partial order of the code's synthetic channels. Depending on the design, however, polar codes can have a richer set of automorphisms. In this paper, we extend the LTA to a larger subgroup of the general affine group (GA), namely the block lower triangular affine group (BLTA) and show that it is contained in the automorphism group of polar codes. Furthermore, we provide a low complexity algorithm for finding this group for a given information frozen set and determining its size. Most importantly, we apply these findings in automorphism based decoding of polar codes and report a comparable error rate performance to that of successive cancellation list (SCL) decoding with significantly lower complexity.


Covering with Chang models over derived models. We present a covering conjecture that we expect to be true below superstrong cardinals. We then show that the conjecture is true in hod mice. This work is a continuation of the work that started in Covering with Universally Baire Functions Advances in Mathematics, and the main conjecture of the current paper is a revision of the UB Covering Conjecture of the aforementioned paper.


Poincar 'e Inequality Meets Brezis Van Schaftingen Yung Formula on Metric Measure Spaces. Let ( mathcal X , rho, mu) be a metric measure space of homogeneous type which supports a certain Poincar 'e inequality. Denote by the symbol mathcal C mathrm c ast( mathcal X ) the space of all continuous functions f with compact support satisfying that operatorname Lip f limsup r rightarrow 0 sup y in B( cdot, r) f( cdot) f(y) r is also a continuous function with compact support and operatorname Lip f lim r rightarrow 0 sup y in B( cdot, r) f( cdot) f(y) r converges uniformly. Let p in 1, infty) . In this article, the authors prove that, for any f in mathcal C mathrm c ast( mathcal X ) , begin align sup lambda in(0, infty) lambda p int mathcal X mu left( left y in mathcal X f(x) f(y) lambda rho(x,y) V(x,y) frac 1p right right) , d mu(x) quad sim int mathcal X operatorname Lip f(x) p ,d mu(x) end align with the positive equivalence constants independent of f , where V(x,y) mu(B(x, rho(x,y))) . This generalizes a recent surprising formula of H. Brezis, J. Van Schaftingen, and P. L. Yung from the n dimensional Euclidean space mathbb R n to mathcal X . Applying this generalization, the authors establish new fractional Sobolev and Gagliardo Nirenberg inequalities in mathcal X . All these results have a wide range of applications. Particularly, when applied to two concrete examples, namely, mathbb R n with weighted Lebesgue measure and the complete n dimensional Riemannian manifold with non negative Ricci curvature, all these results are new. The proofs of these results strongly depend on the geometrical relation of differences and derivatives in the metric measure space and the Poincar 'e inequality.


The Pricing of Vanilla Options with Cash Dividends as a Classic Vanilla Basket Option Problem. In the standard Black Scholes Merton framework, dividends are represented as a continuous dividend yield and the pricing of Vanilla options on a stock is achieved through the well known Black Scholes formula. In reality however, stocks pay a discrete fixed cash dividend at each dividend ex date. This leads to the so called piecewise lognormal model, where the asset jumps from a fixed known amount at each dividend date. There is however no exact closed form formula for the pricing of Vanilla options under this model. Approximations must be used. While there exists many approximations taylored to this specific problem in the litterature, this paper explores the use of existing well known basket option formulas for the pricing of European options on a single asset with cash dividends in the piecewise lognormal model.


Codes approaching the Shannon limit with polynomial complexity per information bit. We consider codes for channels with extreme noise that emerge in various low power applications. Simple LDPC type codes with parity checks of weight 3 are first studied for any dimension m rightarrow infty. These codes form modulation schemes they improve the original channel output for any SNR 6 dB (per information bit) and gain 3 dB over uncoded modulation as SNR grows. However, they also have a floor on the output bit error rate (BER) irrespective of their length. Tight lower and upper bounds, which are virtually identical to simulation results, are then obtained for BER at any SNR. We also study a combined scheme that splits m information bits into b blocks and protects each with some polar code. Decoding moves back and forth between polar and LDPC codes, every time using a polar code of a higher rate. For a sufficiently large constant b and m rightarrow infty , this design yields a vanishing BER at any SNR that is arbitrarily close to the Shannon limit of 1.59 dB. Unlike other existing designs, this scheme has polynomial complexity of order m ln m per information bit.


Evaluation of Saliency based Explainability Method. A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an intuitive way for users to understand predictions made by CNNs. Other than quantitative computational tests, the vast majority of evidence to highlight that the methods are valuable is anecdotal. Given that humans would be the end users of such methods, we devise three human subject experiments through which we gauge the effectiveness of these saliency based explainability methods.


Boundary Induced Embedded Eigenstate in a Single Resonator for Advanced Sensing. Electromagnetic embedded eigenstates, also known as bound states in the continuum (BICs), hold a great potential for applications in sensing, lasing, enhanced nonlinearities and energy harvesting. However, their demonstrations so far have been limited to large area periodic arrays of suitably tailored elements, with fundamental restrictions on the overall footprint and performance in presence of inevitable disorder. In this work, we demonstrate a BIC localized in a single subwavelength resonator obtained by suitably tailoring the boundaries around it, enabling a new degree of control for on demand symmetry breaking. We experimentally demonstrate how boundary induced BICs open exciting opportunities for sensing by tracing the dissolution of NaCl in water, determining evaporation rates of distilled and saltwater with a resolution of less than 1e 6 L using a tabletop experimental setup.


Algebraicity of critical values of triple product L functions in the balanced case. The algebraicity of critical values of triple product L functions in the balanced case was proved by Garrett and Harris, under the assumption that the critical points are on the right and away from center of the critical strip. The missing right half critical points correspond to certain holomorphic Eisenstein series outside the range of absolute convergence. The remaining difficulties are construction of these holomorphic Eisenstein series and verification of the non vanishing of the corresponding non archimedean local zeta integrals. In this paper, we address these problems and complement the result of Garrett and Harris to all critical points. As a consequence, we obtain new cases of Deligne's conjecture for symmetric cube L functions of Hilbert modular forms.


Spontaneous dust pulse formation in the afterglow of complex plasmas under microgravity conditions. A new type of nonlinear dust pulse structures has been observed in afterglow complex plasma under microgravity condition on board the International Space Station (ISS). The dust pulses are triggered spontaneously as the plasma is switched off and the particles start to flow through each other (uni directional or counter streaming) in the presence of a low frequency external electric excitation. The pulses are oblique with respect to the microparticle cloud and appear to be symmetric with respect to the central axis. A possible explanation of this observation with the spontaneous development of a double layer in the afterglow of complex plasma is described.


Comprehensive Comparative Study of Multi Label Classification Methods. Multi label classification (MLC) has recently received increasing interest from the machine learning community. Several studies provide reviews of methods and datasets for MLC and a few provide empirical comparisons of MLC methods. However, they are limited in the number of methods and datasets considered. This work provides a comprehensive empirical study of a wide range of MLC methods on a plethora of datasets from various domains. More specifically, our study evaluates 26 methods on 42 benchmark datasets using 20 evaluation measures. The adopted evaluation methodology adheres to the highest literature standards for designing and executing large scale, time budgeted experimental studies. First, the methods are selected based on their usage by the community, assuring representation of methods across the MLC taxonomy of methods and different base learners. Second, the datasets cover a wide range of complexity and domains of application. The selected evaluation measures assess the predictive performance and the efficiency of the methods. The results of the analysis identify RFPCT, RFDTBR, ECCJ48, EBRJ48 and AdaBoostMH as best performing methods across the spectrum of performance measures. Whenever a new method is introduced, it should be compared to different subsets of MLC methods, determined on the basis of the different evaluation criteria.


Orthogonality of invariant vectors. Let G be a finite group with given subgroups H and K . Let pi be an irreducible complex representation of G such that its space of H invariant vectors as well as the space of K invariant vectors are both one dimensional. Let v H (resp. v K ) denote an H invariant (resp. K invariant) vector of unit norm in the standard G invariant inner product langle , rangle pi on pi . Our interest is in computing the square of the absolute value of langle v H,v K rangle pi . This is the correlation constant c( pi H,K) defined by Gross. In this paper, we give a sufficient condition for langle v H, v K rangle pi to be zero and a sufficient condition for it to be non zero (i.e., H and K are correlated with respect to pi ), when G rm GL 2( mathbb F q) , where mathbb F q is the finite field of q p f elements of odd characteristic p , H is its split torus and K is a non split torus. The key idea in our proof is to analyse the mod p reduction of pi . We give an explicit formula for langle v H,v K rangle pi 2 modulo p . Finally, we study the behaviour of langle v H,v K rangle pi under the Shintani base change and give a sufficient condition for langle v H,v K rangle pi to vanish for an irreducible representation pi rm BC ( tau) of rm PGL 2( mathbb E) , in terms of the epsilon factor of the base changing representation tau of rm PGL 2( mathbb F) , where mathbb E mathbb F is a finite extension of finite fields. This is reminiscent of the vanishing of L(1 2, rm BC ( tau)) , in the theory of automorphic forms, when the global root number of tau is 1 .


S3M Siamese Stack (Trace) Similarity Measure. Automatic crash reporting systems have become a de facto standard in software development. These systems monitor target software, and if a crash occurs they send details to a backend application. Later on, these reports are aggregated and used in the development process to 1) understand whether it is a new or an existing issue, 2) assign these bugs to appropriate developers, and 3) gain a general overview of the application's bug landscape. The efficiency of report aggregation and subsequent operations heavily depends on the quality of the report similarity metric. However, a distinctive feature of this kind of report is that no textual input from the user (i.e., bug description) is available it contains only stack trace information. In this paper, we present S3M ("extreme") the first approach to computing stack trace similarity based on deep learning. It is based on a siamese architecture that uses a biLSTM encoder and a fully connected classifier to compute similarity. Our experiments demonstrate the superiority of our approach over the state of the art on both open sourced data and a private JetBrains dataset. Additionally, we review the impact of stack trace trimming on the quality of the results.


Reducing the feature divergence of RGB and near infrared images using Switchable Normalization. Visual pattern recognition over agricultural areas is an important application of aerial image processing. In this paper, we consider the multi modality nature of agricultural aerial images and show that naively combining different modalities together without taking the feature divergence into account can lead to sub optimal results. Thus, we apply a Switchable Normalization block to our DeepLabV3 segmentation model to alleviate the feature divergence. Using the popular symmetric Kullback Leibler divergence measure, we show that our model can greatly reduce the divergence between RGB and near infrared channels. Together with a hybrid loss function, our model achieves nearly 10 improvements in mean IoU over previously published baseline.


Measuring the Impact of Interference Channels on Multicore Avionics. Measurement based analysis of software timing behavior provides important insight and evidence for flight certification of modern avionics systems. For multicore systems, however, this analysis is challenging due to interference effects from shared hardware resource usage. We present an approach to multicore timing analysis that uses interference generators to stress interference channels in multicore systems. The test methodology comprises two steps. First, platform characterization measures the sensitivity of the hardware and RTOS to targeted interference channels using a combination of interference generators. Second, software characterization measures the timing behavior of instrumented applications while interference is generated on shared resources.


Spike time displacement based error backpropagation in convolutional spiking neural networks. We recently proposed the STiDi BP algorithm, which avoids backward recursive gradient computation, for training multi layer spiking neural networks (SNNs) with single spike based temporal coding. The algorithm employs a linear approximation to compute the derivative of the spike latency with respect to the membrane potential and it uses spiking neurons with piecewise linear postsynaptic potential to reduce the computational cost and the complexity of neural processing. In this paper, we extend the STiDi BP algorithm to employ it in deeper and convolutional architectures. The evaluation results on the image classification task based on two popular benchmarks, MNIST and Fashion MNIST datasets with the accuracies of respectively 99.2 and 92.8 , confirm that this algorithm has been applicable in deep SNNs. Another issue we consider is the reduction of memory storage and computational cost. To do so, we consider a convolutional SNN (CSNN) with two sets of weights real valued weights that are updated in the backward pass and their signs, binary weights, that are employed in the feedforward process. We evaluate the binary CSNN on two datasets of MNIST and Fashion MNIST and obtain acceptable performance with a negligible accuracy drop with respect to real valued weights (about 0.6 and 0.8 drops, respectively).


On the commuting probability for subgroups of a finite group. Let K be a subgroup of a finite group G . The probability that an element of G commutes with an element of K is denoted by Pr(K,G) . Assume that Pr(K,G) geq epsilon for some fixed epsilon 0 . We show that there is a normal subgroup T leq G and a subgroup B leq K such that the indexes G T and K B and the order of the commutator subgroup T,B are epsilon bounded. This extends the well known theorem, due to P. M. Neumann, that covers the case where K G . We deduce a number of corollaries of this result. A typical application is that if K is the generalized Fitting subgroup F (G) then G has a class 2 nilpotent normal subgroup R such that both the index G R and the order of the commutator subgroup R,R are epsilon bounded. In the same spirit we consider the cases where K is a term of the lower central series of G , or a Sylow subgroup, etc.


Uncertainty Quantification by MLMC and Local Time stepping For Wave Propagation. Because of their robustness, efficiency and non intrusiveness, Monte Carlo methods are probably the most popular approach in uncertainty quantification to computing expected values of quantities of interest (QoIs). Multilevel Monte Carlo (MLMC) methods significantly reduce the computational cost by distributing the sampling across a hierarchy of discretizations and allocating most samples to the coarser grids. For time dependent problems, spatial coarsening typically entails an increased time step. Geometric constraints, however, may impede uniform coarsening thereby forcing some elements to remain small across all levels. If explicit time stepping is used, the time step will then be dictated by the smallest element on each level for numerical stability. Hence, the increasingly stringent CFL condition on the time step on coarser levels significantly reduces the advantages of the multilevel approach. To overcome that bottleneck we propose to combine the multilevel approach of MLMC with local time stepping (LTS). By adapting the time step to the locally refined elements on each level, the efficiency of MLMC methods is restored even in the presence of complex geometry without sacrificing the explicitness and inherent parallelism. In a careful cost comparison, we quantify the reduction in computational cost for local refinement either inside a small fixed region or towards a reentrant corner.


Separable Convolutions for Optimizing 3D Stereo Networks. Deep learning based 3D stereo networks give superior performance compared to 2D networks and conventional stereo methods. However, this improvement in the performance comes at the cost of increased computational complexity, thus making these networks non practical for the real world applications. Specifically, these networks use 3D convolutions as a major work horse to refine and regress disparities. In this work first, we show that these 3D convolutions in stereo networks consume up to 94 of overall network operations and act as a major bottleneck. Next, we propose a set of "plug run" separable convolutions to reduce the number of parameters and operations. When integrated with the existing state of the art stereo networks, these convolutions lead up to 7x reduction in number of operations and up to 3.5x reduction in parameters without compromising their performance. In fact these convolutions lead to improvement in their performance in the majority of cases.


A flexible and scalable, fully software based lock in amplifier for nonlinear spectroscopy. We demonstrate a cost effective, fully software based lock in amplifier (LIA) implemented on a commercial computer. The device is designed for application in nonlinear spectroscopy, such as transient absorption and coherent multidi mensional spectroscopy, but may be also used in any other application. The performance of our device is compared to a state of the art commercial LIA with nearly identical results for both devices. Advantages of our device over commercial hardwired electronic lock in amplifiers is the improved flexibility in the data analysis and the possibility of arbitrary up scaling of the number of LIA channels.


Domain Robust Mitotic Figure Detection with Style Transfer. We propose a new training scheme for domain generalization in mitotic figure detection. Mitotic figures show different characteristics for each scanner. We consider each scanner as a 'domain' and the image distribution specified for each domain as 'style'. The goal is to train our network to be robust on scanner types by using various 'style' images. To expand the style variance, we transfer a style of the training image into arbitrary styles, by defining a module based on StarGAN. Our model with the proposed training scheme shows positive performance on MIDOG Preliminary Test Set containing scanners never seen before.


"I'm a Professor, which isn't usually a dangerous job" Internet Facilitated Harassment and its Impact on Researchers. While the Internet has dramatically increased the exposure that research can receive, it has also facilitated harassment against scholars. To understand the impact that these attacks can have on the work of researchers, we perform a series of systematic interviews with researchers including academics, journalists, and activists, who have experienced targeted, Internet facilitated harassment. We provide a framework for understanding the types of harassers that target researchers, the harassment that ensues, and the personal and professional impact on individuals and academic freedom. We then study preventative and remedial strategies available, and the institutions that prevent some of these strategies from being more effective. Finally, we discuss the ethical structures that could facilitate more equitable access to participating in research without serious personal suffering.


Collapse of Coherent Large Scale Flow in Strongly Turbulent Liquid Metal Convection. The large scale flow structure and the turbulent transfer of heat and momentum are directly measured in highly turbulent liquid metal convection experiments for Rayleigh numbers varied between 4 times 10 5 and leq 5 times 10 9 and Prandtl numbers of 0.025 leq Pr leq 0.033 . Our measurements are performed in two cylindrical samples of aspect ratios Gamma diameter height 0.5 and 1 filled with the eutectic alloy GaInSn. The reconstruction of the three dimensional flow pattern by 17 ultrasound Doppler velocimetry sensors detecting the velocity profiles along their beamlines in different planes reveals a clear breakdown of coherence of the large scale circulation for Gamma 0.5 . As a consequence, the scaling laws for heat and momentum transfer inherit a dependence on the aspect ratio. We show that this breakdown of coherence is accompanied with a reduction of the Reynolds number Re . The scaling exponent beta of the power law Nu propto Ra beta crosses FIN eventually over from beta 0.221 to 0.124 when the liquid metal flow at Gamma 0.5 reaches Ra gtrsim 2 times 10 8 and the coherent large scale flow is completely collapsed.


Constrained Motion Planning of A Cable Driven Soft Robot With Compressible Curvature Modeling. A cable driven soft bodied robot with redundancy can conduct the trajectory tracking task and in the meanwhile fulfill some extra constraints, such as tracking through an end effector in designated orientation, or get rid of the evitable manipulator obstacle collision. Those constraints require rational planning of the robot motion. In this work, we derived the compressible curvature kinematics of a cable driven soft robot which takes the compressible soft segment into account. The motion planning of the soft robot for a trajectory tracking task in constrained conditions, including fixed orientation end effector and manipulator obstacle collision avoidance, has been investigated. The inverse solution of cable actuation was formulated as a damped least square optimization problem and iteratively computed off line. The performance of trajectory tracking and the obedience to constraints were evaluated via the simulation we made open source, as well as the prototype experiments. The method can be generalized to the similar multisegment cable driven soft robotic systems by customizing the robot parameters for the prior motion planning of the manipulator.


Scale free percolation mixing time. Assign to each vertex of the one dimensional torus i.i.d. weights with a heavy tail of index tau 1 0 . Connect then each couple of vertices with probability roughly proportional to the product of their weights and that decays polynomially with exponent alpha 0 in their distance. The resulting graph is called scale free percolation. The goal of this work is to study the mixing time of the simple random walk on this structure. We depict a rich phase diagram in alpha and tau . In particular we prove that the presence of hubs can speed up the mixing of the chain. We use different techniques for each phase, the most interesting of which is a bootstrap procedure to reduce the model from a phase where the degrees have bounded averages to a setting with unbounded averages.


GrooMeD NMS Grouped Mathematically Differentiable NMS for Monocular 3D Object Detection. Modern 3D object detectors have immensely benefited from the end to end learning idea. However, most of them use a post processing algorithm called Non Maximal Suppression (NMS) only during inference. While there were attempts to include NMS in the training pipeline for tasks such as 2D object detection, they have been less widely adopted due to a non mathematical expression of the NMS. In this paper, we present and integrate GrooMeD NMS a novel Grouped Mathematically Differentiable NMS for monocular 3D object detection, such that the network is trained end to end with a loss on the boxes after NMS. We first formulate NMS as a matrix operation and then group and mask the boxes in an unsupervised manner to obtain a simple closed form expression of the NMS. GrooMeD NMS addresses the mismatch between training and inference pipelines and, therefore, forces the network to select the best 3D box in a differentiable manner. As a result, GrooMeD NMS achieves state of the art monocular 3D object detection results on the KITTI benchmark dataset performing comparably to monocular video based methods. Code and models at https github.com abhi1kumar groomed nms


Data Augmentation Approaches in Natural Language Processing A Survey. As an effective strategy, data augmentation (DA) alleviates data scarcity scenarios where deep learning techniques may fail. It is widely applied in computer vision then introduced to natural language processing and achieves improvements in many tasks. One of the main focuses of the DA methods is to improve the diversity of training data, thereby helping the model to better generalize to unseen testing data. In this survey, we frame DA methods into three categories based on the diversity of augmented data, including paraphrasing, noising, and sampling. Our paper sets out to analyze DA methods in detail according to the above categories. Further, we also introduce their applications in NLP tasks as well as the challenges.


A Framework of Explanation Generation toward Reliable Autonomous Robots. To realize autonomous collaborative robots, it is important to increase the trust that users have in them. Toward this goal, this paper proposes an algorithm which endows an autonomous agent with the ability to explain the transition from the current state to the target state in a Markov decision process (MDP). According to cognitive science, to generate an explanation that is acceptable to humans, it is important to present the minimum information necessary to sufficiently understand an event. To meet this requirement, this study proposes a framework for identifying important elements in the decision making process using a prediction model for the world and generating explanations based on these elements. To verify the ability of the proposed method to generate explanations, we conducted an experiment using a grid environment. It was inferred from the result of a simulation experiment that the explanation generated using the proposed method was composed of the minimum elements important for understanding the transition from the current state to the target state. Furthermore, subject experiments showed that the generated explanation was a good summary of the process of state transition, and that a high evaluation was obtained for the explanation of the reason for an action.


Complete quaternionic K "ahler manifolds with finite volume ends. We construct examples of complete quaternionic K "ahler manifolds with an end of finite volume, which are not locally homogeneous. The manifolds are aspherical with fundamental group which is up to an infinite cyclic extension a semi direct product of a lattice in a semi simple group with a lattice in a Heisenberg group. Their universal covering is a cohomogeneity one deformation of a symmetric space of noncompact type.


Unsupervised collaborative learning using privileged information. In the collaborative clustering framework, the hope is that by combining several clustering solutions, each one with its own bias and imperfections, one will get a better overall solution. The goal is that each local computation, quite possibly applied to distinct data sets, benefits from the work done by the other collaborators. This article is dedicated to collaborative clustering based on the Learning Using Privileged Information paradigm. Local algorithms weight incoming information at the level of each observation, depending on the confidence level of the classification of that observation. A comparison between our algorithm and state of the art implementations shows improvement of the collaboration process using the proposed approach.


On the moduli spaces of parabolic symplectic orthogonal bundles on curves. We prove that the moduli spaces of parabolic symplectic orthogonal bundles on a smooth curve are globally F regular type. As a consequence, all higher cohomology of theta line bundle vanish. During the proof, we develop a method to estimate codimension, and consider the infinite grassmannians for parabolic G bundles.


On explosive boiling of a multicomponent Leidenfrost drop. The gasification of multicomponent fuel drops is relevant in various energy related technologies. An interesting phenomenon associated with this process is the self induced explosion of the drop, producing a multitude of smaller secondary droplets, which promotes overall fuel atomization and, consequently, improves the combustion efficiency and reduces emissions of liquid fueled engines. Here, we study a unique explosive gasification process of a tricomponent droplet consisting of water, ethanol, and oil ("ouzo"), by high speed monitoring of the entire gasification event taking place in the well controlled, levitated Leidenfrost state over a superheated plate. It is observed that the preferential evaporation of the most volatile component, ethanol, triggers nucleation of the oil microdroplets nanodroplets in the remaining drop, which, consequently, becomes an opaque oil in water microemulsion. The tiny oil droplets subsequently coalesce into a large one, which, in turn, wraps around the remnant water. Because of the encapsulating oil layer, the droplet can no longer produce enough vapor for its levitation, and, thus, falls and contacts the superheated surface. The direct thermal contact leads to vapor bubble formation inside the drop and consequently drop explosion in the final stage.


Global control aspects for long waves in nonlinear dispersive media. A class of models of long waves in dispersive media with coupled quadratic nonlinearities on a periodic domain mathbb T are studied. We used two distributed controls, supported in omega subset mathbb T and assumed to be generated by a linear feedback law conserving the "mass" (or "volume"), to prove global control results. The first result, using spectral analysis, guarantees that the system in consideration is locally controllable in H s( mathbb T ) , for s geq0 . After that, by certain properties of Bourgain spaces we show a property of global exponential stability. This property together with the local exact controllability ensures for the first time in the literature that long waves in nonlinear dispersive media are globally exactly controllable in large time. Precisely, our analysis relies strongly on the bilinear estimates using the Fourier restriction spaces in two different dispersions that will guarantee a global control result for coupled systems of the Korteweg de Vries type. This result, of independent interest in the area of control of coupled dispersive systems, provides a necessary first step for the study of global control properties to the coupled dispersive systems in periodic domains.


Applications of Artificial Intelligence in Particle Radiotherapy. Radiotherapy, due to its technology intensive nature and reliance on digital data and human machine interactions, is particularly suited to benefit from artificial intelligence (AI) to improve the accuracy and efficiency of its clinical workflow. Recently, various artificial intelligence (AI) methods have been successfully developed to exploit the benefit of the inherent physical properties of particle therapy. Many reviews about AI applications in radiotherapy have already been published, but none were specifically dedicated to particle therapy. In this article, we present a comprehensive review of the recent published works on AI applications in particle therapy, which can be classified into particle therapy treatment planning, adaptive particle therapy, range and dose verification and other applications in particle therapy. Although promising results reported in these works demonstrate how AI based methods can help exploit the intrinsic physic advantages of particle therapy, challenges remained to be address before AI applications in particle therapy enjoy widespread implementation in clinical practice.


The PAT model of population dynamics. We introduce a population age time (PAT) model which describes the temporal evolution of the population distribution in age. The surprising result is that the qualitative nature of the population distribution dynamics is robust with respect to the birth rate and death rate distributions in age, and initial conditions. When the number of children born per woman is 2, the population distribution approaches an asymptotically steady state of a kink shape thus the total population approaches a constant. When the number of children born per woman is greater than 2, the total population increases without bound and when the number of children born per woman is less than 2, the total population decreases to zero.


Theorems of Carath ' e odory, Minkowski Weyl, and Gordan up to symmetry. In this paper we extend three classical and fundamental results in polyhedral geometry, namely, Carath ' e odory's theorem, the Minkowski Weyl theorem, and Gordan's lemma to infinite dimensional spaces, in which considered cones and monoids are invariant under actions of symmetric groups.


Diffusion Self Organizing Map on the Hypersphere. We discuss a diffusion based implementation of the self organizing map on the unit hypersphere. We show that this approach can be efficiently implemented using just linear algebra methods, we give a python numpy implementation, and we illustrate the approach using the well known MNIST dataset.


Characterisation of the Weyl H "ormander classes by time frequency shifts. We characterise the Weyl H "ormander symbol classes S(M,g) via the growth of the action of the corresponding Psi DOs on time frequency shifts of a single test function. For this purpose, we introduce a geometric short time Fourier transform which is well suited for the analysis of S(M,g) . We define new modulation spaces and achieve the characterisation of the Weyl H "ormander classes by showing that they are intersections of such modulation spaces suitable for the time frequency characterisation.


Hybrid Epsilon Near Zero Modes of Photonic Gap Antennas. We demonstrate that in photonic gap antennas composed of an epsilon near zero (ENZ) layer embedded within a high index dielectric, hybrid modes emerge from the strong coupling between the ENZ thin film and the photonic modes of the dielectric antenna. These hybrid modes show giant electric field enhancements, large enhancements of the far field spontaneous emission rate and a unidirectional radiation response. We analyze both parent and hybrid modes using quasinormal mode theory and find that the hybridization can be well understood using a coupled oscillator model. Under plane wave illumination, hybrid ENZ antennas can concentrate light with an electric field amplitude sim 100 times higher than that of the incident wave, which places them on par with the best plasmonic antennas. In addition, the far field spontaneous emission rate of a dipole embedded at the antenna hotspot reaches up to sim 2300 that in free space, with nearly perfect unidirectional emission.


Engineering an IoT Edge Cloud Computing System Architecture Lessons Learnt from An Undergraduate Lab Course. With the rapid advances in IoT, edge and cloud computing solutions, it is critical to educate and train students in computer science and engineering in various aspects of IoT edge cloud (IoT E C) system architecture implementations. We outline the design and development of an undergraduate laboratory course that sets the goal of implementing various interfaces and communication protocols to connect IoT, edge and cloud computing systems and evaluating their performance. The lab setup is modular and based on open source tools. In the IoT context, it consists of low cost processing platforms with various sensors and actuators. In the edge and cloud computing context, we implement and deploy single board computers and Firebase cloud solutions, respectively. The modular lab setup allows students to engineer and integrate various communication protocol solutions, including MQTT, COAP and HTTP. In addition to the system implementation, students can evaluate and benchmark the performance of the entire system.