A tutorial on mathbf SE (3) transformation parameterizations and on manifold optimization. An arbitrary rigid transformation in mathbf SE (3) can be separated into two parts, namely, a translation and a rigid rotation. This technical report reviews, under a unifying viewpoint, three common alternatives to representing the rotation part sets of three (yaw pitch roll) Euler angles, orthogonal rotation matrices from mathbf SO (3) and quaternions. It will be described (i) the equivalence between these representations and the formulas for transforming one to each other (in all cases considering the translational and rotational parts as a whole), (ii) how to compose poses with poses and poses with points in each representation and (iii) how the uncertainty of the poses (when modeled as Gaussian distributions) is affected by these transformations and compositions. Some brief notes are also given about the Jacobians required to implement least squares optimization on manifolds, an very promising approach in recent engineering literature. The text reflects which MRPT C library functions implement each of the described algorithms. All formulas and their implementation have been thoroughly validated by means of unit testing and numerical estimation of the Jacobians


Perturbational Complexity by Distribution Mismatch A Systematic Analysis of Reinforcement Learning in Reproducing Kernel Hilbert Space. Most existing theoretical analysis of reinforcement learning (RL) is limited to the tabular setting or linear models due to the difficulty in dealing with function approximation in high dimensional space with an uncertain environment. This work offers a fresh perspective into this challenge by analyzing RL in a general reproducing kernel Hilbert space (RKHS). We consider a family of Markov decision processes mathcal M of which the reward functions lie in the unit ball of an RKHS and transition probabilities lie in a given arbitrary set. We define a quantity called perturbational complexity by distribution mismatch Delta mathcal M ( epsilon) to characterize the complexity of the admissible state action distribution space in response to a perturbation in the RKHS with scale epsilon . We show that Delta mathcal M ( epsilon) gives both the lower bound of the error of all possible algorithms and the upper bound of two specific algorithms (fitted reward and fitted Q iteration) for the RL problem. Hence, the decay of Delta mathcal M ( epsilon) with respect to epsilon measures the difficulty of the RL problem on mathcal M . We further provide some concrete examples and discuss whether Delta mathcal M ( epsilon) decays fast or not in these examples. As a byproduct, we show that when the reward functions lie in a high dimensional RKHS, even if the transition probability is known and the action space is finite, it is still possible for RL problems to suffer from the curse of dimensionality.


SONIC A Sparse Neural Network Inference Accelerator with Silicon Photonics for Energy Efficient Deep Learning. Sparse neural networks can greatly facilitate the deployment of neural networks on resource constrained platforms as they offer compact model sizes while retaining inference accuracy. Because of the sparsity in parameter matrices, sparse neural networks can, in principle, be exploited in accelerator architectures for improved energy efficiency and latency. However, to realize these improvements in practice, there is a need to explore sparsity aware hardware software co design. In this paper, we propose a novel silicon photonics based sparse neural network inference accelerator called SONIC. Our experimental analysis shows that SONIC can achieve up to 5.8x better performance per watt and 8.4x lower energy per bit than state of the art sparse electronic neural network accelerators and up to 13.8x better performance per watt and 27.6x lower energy per bit than the best known photonic neural network accelerators.


ell p Spread Properties of Sparse Matrices. Random subspaces X of mathbb R n of dimension proportional to n are, with high probability, well spread with respect to the ell p norm (for p in 1,2 ). Namely, every nonzero x in X is "robustly non sparse" in the following sense x is varepsilon x p far in ell p distance from all delta n sparse vectors, for positive constants varepsilon, delta bounded away from 0 . This " ell p spread" property is the natural counterpart, for subspaces over the reals, of the minimum distance of linear codes over finite fields, and, for p 2 , corresponds to X being a Euclidean section of the ell 1 unit ball. Explicit ell p spread subspaces of dimension Omega(n) , however, are not known except for p 1 . The construction for p 1 , as well as the best known constructions for p in (1,2 (which achieve weaker spread properties), are analogs of low density parity check (LDPC) codes over the reals, i.e., they are kernels of sparse matrices. We study the spread properties of the kernels of sparse random matrices. Rather surprisingly, we prove that with high probability such subspaces contain vectors x that are o(1) cdot x 2 close to o(n) sparse with respect to the ell 2 norm, and in particular are not ell 2 spread. On the other hand, for p 2 we prove that such subspaces are ell p spread with high probability. Moreover, we show that a random sparse matrix has the stronger restricted isometry property (RIP) with respect to the ell p norm, and this follows solely from the unique expansion of a random biregular graph, yielding a somewhat unexpected generalization of a similar result for the ell 1 norm BGI 08 . Instantiating this with explicit expanders, we obtain the first explicit constructions of ell p spread subspaces and ell p RIP matrices for 1 leq p p 0 , where 1 p 0 2 is an absolute constant.


Progress on the localization number of a graph. We highlight new results on the localization number of a graph, a parameter derived from the localization graph searching game. After introducing the game and providing an overview of existing results, we describe recent results on the localization number. We describe bounds or exact values of the localization number of incidence graphs of designs, polarity graphs, and Kneser graphs.


COVID 19 Face Mask Recognition with Advanced Face Cut Algorithm for Human Safety Measures. In the last year, the outbreak of COVID 19 has deployed computer vision and machine learning algorithms in various fields to enhance human life interactions. COVID 19 is a highly contaminated disease that affects mainly the respiratory organs of the human body. We must wear a mask in this situation as the virus can be contaminated through the air and a non masked person can be affected. Our proposal deploys a computer vision and deep learning framework to recognize face masks from images or videos. We have implemented a Boundary dependent face cut recognition algorithm that can cut the face from the image using 27 landmarks and then the preprocessed image can further be sent to the deep learning ResNet50 model. The experimental result shows a significant advancement of 3.4 percent compared to the YOLOV3 mask recognition architecture in just 10 epochs.


Panoptic Segmentation Meets Remote Sensing. Panoptic segmentation combines instance and semantic predictions, allowing the detection of "things" and "stuff" simultaneously. Effectively approaching panoptic segmentation in remotely sensed data can be auspicious in many challenging problems since it allows continuous mapping and specific target counting. Several difficulties have prevented the growth of this task in remote sensing (a) most algorithms are designed for traditional images, (b) image labelling must encompass "things" and "stuff" classes, and (c) the annotation format is complex. Thus, aiming to solve and increase the operability of panoptic segmentation in remote sensing, this study has five objectives (1) create a novel data preparation pipeline for panoptic segmentation, (2) propose an annotation conversion software to generate panoptic annotations (3) propose a novel dataset on urban areas, (4) modify the Detectron2 for the task, and (5) evaluate difficulties of this task in the urban setting. We used an aerial image with a 0,24 meter spatial resolution considering 14 classes. Our pipeline considers three image inputs, and the proposed software uses point shapefiles for creating samples in the COCO format. Our study generated 3,400 samples with 512x512 pixel dimensions. We used the Panoptic FPN with two backbones (ResNet 50 and ResNet 101), and the model evaluation considered semantic instance and panoptic metrics. We obtained 93.9, 47.7, and 64.9 for the mean IoU, box AP, and PQ. Our study presents the first effective pipeline for panoptic segmentation and an extensive database for other researchers to use and deal with other data or related problems requiring a thorough scene understanding.


ReS2tAC UAV Borne Real Time SGM Stereo Optimized for Embedded ARM and CUDA Devices. With the emergence of low cost robotic systems, such as unmanned aerial vehicle, the importance of embedded high performance image processing has increased. For a long time, FPGAs were the only processing hardware that were capable of high performance computing, while at the same time preserving a low power consumption, essential for embedded systems. However, the recently increasing availability of embedded GPU based systems, such as the NVIDIA Jetson series, comprised of an ARM CPU and a NVIDIA Tegra GPU, allows for massively parallel embedded computing on graphics hardware. With this in mind, we propose an approach for real time embedded stereo processing on ARM and CUDA enabled devices, which is based on the popular and widely used Semi Global Matching algorithm. In this, we propose an optimization of the algorithm for embedded CUDA GPUs, by using massively parallel computing, as well as using the NEON intrinsics to optimize the algorithm for vectorized SIMD processing on embedded ARM CPUs. We have evaluated our approach with different configurations on two public stereo benchmark datasets to demonstrate that they can reach an error rate as low as 3.3 . Furthermore, our experiments show that the fastest configuration of our approach reaches up to 46 FPS on VGA image resolution. Finally, in a use case specific qualitative evaluation, we have evaluated the power consumption of our approach and deployed it on the DJI Manifold 2 G attached to a DJI Matrix 210v2 RTK unmanned aerial vehicle (UAV), demonstrating its suitability for real time stereo processing onboard a UAV.


Functional analysis approach to the Collatz conjecture. We show how the problems related to the Collatz map T can be transferred to the language of functional analysis. We associate with T certain linear operator mathcal T and show that cycles and (hypothetical) diverging trajectory (generated by T ) correspond to certain classes of fixed points of operator mathcal T . Furthermore, we demonstrate connection between dynamical properties of operator mathcal T and map T . We prove that absence of nontrivial cycles of T leads to hypercyclicity of operator mathcal T . In the second part we connect the characteristic function of total stopping time sigma infty with properties of linear operator mathcal F g to g(z 2) frac z frac 1 3 3 left(g(z frac 2 3 ) e frac 2 pi i 3 g(z frac 2 3 e frac 2 pi i 3 ) e frac 4 pi i 3 g(z frac 2 3 e frac 4 pi i 3 ) right). Violation of Collatz conjecture implies existence of fixed point of operator mathcal F of the form sum limits m in mathbb N , sigma infty (m) infty z m in A(D). Furthermore, we construct an invariant measure for mathcal T in a slightly different setup, and investigate how the operator mathcal T acts on generalized arithmetic progressions.


Decoding Continual Muscle Movements Related to Complex Hand Grasping from EEG Signals. Brain computer interface (BCI) is a practical pathway to interpret users' intentions by decoding motor execution (ME) or motor imagery (MI) from electroencephalogram (EEG) signals. However, developing a BCI system driven by ME or MI is challenging, particularly in the case of containing continual and compound muscles movements. This study analyzes three grasping actions from EEG under both ME and MI paradigms. We also investigate the classification performance in offline and pseudo online experiments. We propose a novel approach that uses muscle activity pattern (MAP) images for the convolutional neural network (CNN) to improve classification accuracy. We record the EEG and electromyogram (EMG) signals simultaneously and create the MAP images by decoding both signals to estimate specific hand grasping. As a result, we obtained an average classification accuracy of 63.6( pm 6.7) in ME and 45.8( pm 4.4) in MI across all fifteen subjects for four classes. Also, we performed pseudo online experiments and obtained classification accuracies of 60.5( pm 8.4) in ME and 42.7( pm 6.8) in MI. The proposed method MAP CNN, shows stable classification performance, even in the pseudo online experiment. We expect that MAP CNN could be used in various BCI applications in the future.


On the stability of deep convolutional neural networks under irregular or random deformations. The problem of robustness under location deformations for deep convolutional neural networks (DCNNs) is of great theoretical and practical interest. This issue has been studied in pioneering works, especially for scattering type architectures, for deformation vector fields tau(x) with some regularity at least C 1 . Here we address this issue for any field tau in L infty( mathbb R d mathbb R d) , without any additional regularity assumption, hence including the case of wild irregular deformations such as a noise on the pixel location of an image. We prove that for signals in multiresolution approximation spaces U s at scale s , whenever the network is Lipschitz continuous (regardless of its architecture), stability in L 2 holds in the regime tau L infty s ll 1 , essentially as a consequence of the uncertainty principle. When tau L infty s gg 1 instability can occur even for well structured DCNNs such as the wavelet scattering networks, and we provide a sharp upper bound for the asymptotic growth rate. The stability results are then extended to signals in the Besov space B d 2 2,1 tailored to the given multiresolution approximation. We also consider the case of more general time frequency deformations. Finally, we provide stochastic versions of the aforementioned results, namely we study the issue of stability in mean when tau(x) is modeled as a random field (not bounded, in general) with with identically distributed variables tau(x) , x in mathbb R d .


Existence, Uniqueness and Regularity of the Fractional Harmonic Gradient Flow in General Target Manifolds. In this paper, we continue to study the fractional harmonic gradient flow on S n 1 taking values in a general closed manifold N subset mathbb R n , addressing global existence and uniqueness of solutions of energy class with sufficiently small energy, adding to the existing body of knowledge pertaining to the half harmonic gradient flow and expanding upon our previous work in 34 . We extend the techniques by Struwe in 30 and Rivi ere in 22 to the non local framework analogous to 34 to derive uniqueness, employ commutator estimates as in 8 for regularity and follow 30 for a general existence result.


Converse, Focus and Guess Towards Multi Document Driven Dialogue. We propose a novel task, Multi Document Driven Dialogue (MD3), in which an agent can guess the target document that the user is interested in by leading a dialogue. To benchmark progress, we introduce a new dataset of GuessMovie, which contains 16,881 documents, each describing a movie, and associated 13,434 dialogues. Further, we propose the MD3 model. Keeping guessing the target document in mind, it converses with the user conditioned on both document engagement and user feedback. In order to incorporate large scale external documents into the dialogue, it pretrains a document representation which is sensitive to attributes it talks about an object. Then it tracks dialogue state by detecting evolvement of document belief and attribute belief, and finally optimizes dialogue policy in principle of entropy decreasing and reward increasing, which is expected to successfully guess the user's target in a minimum number of turns. Experiments show that our method significantly outperforms several strong baseline methods and is very close to human's performance.


Unsupervised Deep Image Stitching Reconstructing Stitched Features to Images. Traditional feature based image stitching technologies rely heavily on feature detection quality, often failing to stitch images with few features or low resolution. The learning based image stitching solutions are rarely studied due to the lack of labeled data, making the supervised methods unreliable. To address the above limitations, we propose an unsupervised deep image stitching framework consisting of two stages unsupervised coarse image alignment and unsupervised image reconstruction. In the first stage, we design an ablation based loss to constrain an unsupervised homography network, which is more suitable for large baseline scenes. Moreover, a transformer layer is introduced to warp the input images in the stitching domain space. In the second stage, motivated by the insight that the misalignments in pixel level can be eliminated to a certain extent in feature level, we design an unsupervised image reconstruction network to eliminate the artifacts from features to pixels. Specifically, the reconstruction network can be implemented by a low resolution deformation branch and a high resolution refined branch, learning the deformation rules of image stitching and enhancing the resolution simultaneously. To establish an evaluation benchmark and train the learning framework, a comprehensive real world image dataset for unsupervised deep image stitching is presented and released. Extensive experiments well demonstrate the superiority of our method over other state of the art solutions. Even compared with the supervised solutions, our image stitching quality is still preferred by users.


The extension property for domains with one singular point. An arbitrary outward cuspidal domain is shown to be bi Lipschitz equivalent to a Lipschitz outward cuspidal domain via a global transformation. This allows us to extend earlier Sobolev extension results on Lipschitz outward cuspidal domains from the work of Maz'ya and Poborchi to arbitrary outward cuspidal domains. We also establish a limit case of extension results on outward cuspidal domains.


Graphs with nonnegative Ricci curvature and maximum degree at most 3. In this paper, we classify graphs with nonnegative Lin Lu Yau Ollivier Ricci curvature, maximum degree at most 3 and diameter at least 6.


On Liu morphisms in non Archimedean geometry. We define Liu morphisms and quasi Liu morphisms between Berkovich analytic spaces. We show that Liu morphisms and quasi Liu morphisms behave exactly as affine morphisms and quasi affine morphisms of schemes.


Similar Cases Recommendation using Legal Knowledge Graphs. A legal knowledge graph constructed from court cases, judgments, laws and other legal documents can enable a number of applications like question answering, document similarity, and search. While the use of knowledge graphs for distant supervision in NLP tasks is well researched, using knowledge graphs for downstream graph tasks like node similarity presents challenges in selecting node types and their features. In this demo, we describe our solution for predicting similar nodes in a case graph derived from our legal knowledge graph.


Artificial Intelligence (AI) and Big Data for Coronavirus (COVID 19) Pandemic A Survey on the State of the Arts. The very first infected novel coronavirus case (COVID 19) was found in Hubei, China in Dec. 2019. The COVID 19 pandemic has spread over 214 countries and areas in the world, and has significantly affected every aspect of our daily lives. At the time of writing this article, the numbers of infected cases and deaths still increase significantly and have no sign of a well controlled situation, e.g., as of 13 July 2020, from a total number of around 13.1 million positive cases, 571, 527 deaths were reported in the world. Motivated by recent advances and applications of artificial intelligence (AI) and big data in various areas, this paper aims at emphasizing their importance in responding to the COVID 19 outbreak and preventing the severe effects of the COVID 19 pandemic. We firstly present an overview of AI and big data, then identify the applications aimed at fighting against COVID 19, next highlight challenges and issues associated with state of the art solutions, and finally come up with recommendations for the communications to effectively control the COVID 19 situation. It is expected that this paper provides researchers and communities with new insights into the ways AI and big data improve the COVID 19 situation, and drives further studies in stopping the COVID 19 outbreak.


Entropy based Logic Explanations of Neural Networks. Explainable artificial intelligence has rapidly emerged since lawmakers have started requiring interpretable models for safety critical domains. Concept based neural networks have arisen as explainable by design methods as they leverage human understandable symbols (i.e. concepts) to predict class memberships. However, most of these approaches focus on the identification of the most relevant concepts but do not provide concise, formal explanations of how such concepts are leveraged by the classifier to make predictions. In this paper, we propose a novel end to end differentiable approach enabling the extraction of logic explanations from neural networks using the formalism of First Order Logic. The method relies on an entropy based criterion which automatically identifies the most relevant concepts. We consider four different case studies to demonstrate that (i) this entropy based criterion enables the distillation of concise logic explanations in safety critical domains from clinical data to computer vision (ii) the proposed approach outperforms state of the art white box models in terms of classification accuracy and matches black box performances.


Improving Local Effectiveness for Global robust training. Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several successful robust training methods have been proposed. However, many of them rely on strong adversaries, which can be prohibitively expensive to generate when the input dimension is high and the model structure is complicated. We adopt a new perspective on robustness and propose a novel training algorithm that allows a more effective use of adversaries. Our method improves the model robustness at each local ball centered around an adversary and then, by combining these local balls through a global term, achieves overall robustness. We demonstrate that, by maximizing the use of adversaries via focusing on local balls, we achieve high robust accuracy with weak adversaries. Specifically, our method reaches a similar robust accuracy level to the state of the art approaches trained on strong adversaries on MNIST, CIFAR 10 and CIFAR 100. As a result, the overall training time is reduced. Furthermore, when trained with strong adversaries, our method matches with the current state of the art on MNIST and outperforms them on CIFAR 10 and CIFAR 100.


Evolving spiking neuron cellular automata and networks to emulate in vitro neuronal activity. Neuro inspired models and systems have great potential for applications in unconventional computing. Often, the mechanisms of biological neurons are modeled or mimicked in simulated or physical systems in an attempt to harness some of the computational power of the brain. However, the biological mechanisms at play in neural systems are complicated and challenging to capture and engineer thus, it can be simpler to turn to a data driven approach to transfer features of neural behavior to artificial substrates. In the present study, we used an evolutionary algorithm (EA) to produce spiking neural systems that emulate the patterns of behavior of biological neurons in vitro. The aim of this approach was to develop a method of producing models capable of exhibiting complex behavior that may be suitable for use as computational substrates. Our models were able to produce a level of network wide synchrony and showed a range of behaviors depending on the target data used for their evolution, which was from a range of neuronal culture densities and maturities. The genomes of the top performing models indicate the excitability and density of connections in the model play an important role in determining the complexity of the produced activity.


A note on indecomposable sets of finite perimeter. Bonicatto Pasqualetto Rajala (2020) proved that a decomposition theorem for sets of finite perimeter into indecomposable sets, known to hold in Euclidean spaces, holds also in complete metric spaces equipped with a doubling measure, supporting a Poincar 'e inequality, and satisfying an emph isotropicity condition. We show that the last assumption can be removed.


Semiexplicit Symplectic Integrators for Non separable Hamiltonian Systems. We construct a symplectic integrator for non separable Hamiltonian systems combining an extended phase space approach of Pihajoki and the symmetric projection method. The resulting method is semiexplicit in the sense that the main time evolution step is explicit whereas the symmetric projection step is implicit. The symmetric projection binds potentially diverging copies of solutions, thereby remedying the main drawback of the extended phase space approach. Moreover, our semiexplicit method is symplectic in the original phase space. This is in contrast to existing extended phase space integrators, which are symplectic only in the extended phase space. We demonstrate that our method exhibits an excellent long time preservation of invariants, and also that it tends to be as fast as Tao's explicit modified extended phase space integrator particularly with higher order implementations and for higher dimensional problems.


Asymptotic N soliton like solutions of the fractional Korteweg de Vries equation. We construct N soliton solutions for the fractional Korteweg de Vries (fKdV) equation partial t u partial x left( D alpha u u 2 right) 0, in the whole sub critical range alpha in frac12,2 . More precisely, if Q c denotes the ground state solution associated to fKdV evolving with velocity c , then given 0 c 1 cdots c N , we prove the existence of a solution U of (fKdV) satisfying lim t to infty U(t, cdot) sum j 1 NQ c j (x rho j(t)) H frac alpha 2 0, where rho' j(t) sim c j as t to infty . The proof adapts the construction of Martel in the generalized KdV setting Amer. J. Math. 127 (2005), pp. 1103 1140 ) to the fractional case. The main new difficulties are the polynomial decay of the ground state Q c and the use of local techniques (monotonicity properties for a portion of the mass and the energy) for a non local equation. To bypass these difficulties, we use symmetric and non symmetric weighted commutator estimates. The symmetric ones were proved by Kenig, Martel and Robbiano Annales de l'IHP Analyse Non Lin 'eaire 28 (2011), pp. 853 887 , while the non symmetric ones seem to be new.


Electric field measurements made on a robotic platform. This presentation reports the first known data from a field mill mounted on a ground based robotic platform. The robot's motor and electrostatic charging of its wheels do not perturb the field mill data, and electric field varies smoothly whilst the robot is moving. Test measurements under a charged polystyrene plate are reduced in variability by a factor of 2 compared to a hand held field mill. This technology has potential for autonomous measurements in inaccessible or hazardous environments.


Infinite Servers with Poisson Arrivals Queue Busy Period with PME Distribution. In this article it is shown that if the busy period of a MGinf queue system is PME distributed, the service time is a random variable with a long tail distribution. The result is obtained through Laplace transforms analysis.


MAIR Framework for mining relationships between research articles, strategies, and regulations in the field of explainable artificial intelligence. The growing number of AI applications, also for high stake decisions, increases the interest in Explainable and Interpretable Machine Learning (XI ML). This trend can be seen both in the increasing number of regulations and strategies for developing trustworthy AI and the growing number of scientific papers dedicated to this topic. To ensure the sustainable development of AI, it is essential to understand the dynamics of the impact of regulation on research papers as well as the impact of scientific discourse on AI related policies. This paper introduces a novel framework for joint analysis of AI related policy documents and eXplainable Artificial Intelligence (XAI) research papers. The collected documents are enriched with metadata and interconnections, using various NLP methods combined with a methodology inspired by Institutional Grammar. Based on the information extracted from collected documents, we showcase a series of analyses that help understand interactions, similarities, and differences between documents at different stages of institutionalization. To the best of our knowledge, this is the first work to use automatic language analysis tools to understand the dynamics between XI ML methods and regulations. We believe that such a system contributes to better cooperation between XAI researchers and AI policymakers.


On symmetry breaking of Allen Cahn. We consider numerical solutions for the Allen Cahn equation with standard double well potential and periodic boundary conditions. Surprisingly it is found that using standard numerical discretizations with high precision computational solutions may converge to completely incorrect steady states. This happens for very smooth initial data and state of the art algorithms. We analyze this phenomenon and showcase the resolution of this problem by a new symmetry preserving filter technique. We develop a new theoretical framework and rigorously prove the convergence to steady states for the filtered solutions.


Intensional Artificial Intelligence From Symbol Emergence to Explainable and Empathetic AI. We argue that an explainable artificial intelligence must possess a rationale for its decisions, be able to infer the purpose of observed behaviour, and be able to explain its decisions in the context of what its audience understands and intends. To address these issues we present four novel contributions. Firstly, we define an arbitrary task in terms of perceptual states, and discuss two extremes of a domain of possible solutions. Secondly, we define the intensional solution. Optimal by some definitions of intelligence, it describes the purpose of a task. An agent possessed of it has a rationale for its decisions in terms of that purpose, expressed in a perceptual symbol system grounded in hardware. Thirdly, to communicate that rationale requires natural language, a means of encoding and decoding perceptual states. We propose a theory of meaning in which, to acquire language, an agent should model the world a language describes rather than the language itself. If the utterances of humans are of predictive value to the agent's goals, then the agent will imbue those utterances with meaning in terms of its own goals and perceptual states. In the context of Peircean semiotics, a community of agents must share rough approximations of signs, referents and interpretants in order to communicate. Meaning exists only in the context of intent, so to communicate with humans an agent must have comparable experiences and goals. An agent that learns intensional solutions, compelled by objective functions somewhat analogous to human motivators such as hunger and pain, may be capable of explaining its rationale not just in terms of its own intent, but in terms of what its audience understands and intends. It forms some approximation of the perceptual states of humans.


Output Feedback System Level Synthesis via Dynamic Programming. System Level Synthesis (SLS) allows us to construct internally stabilizing controllers for large scale systems. However, solving large scale SLS problems is computationally expensive and the state of the art methods consider only state feedback output feedback poses additional challenges because the constraints have a more complex form. We exploit the structure of the output feedback SLS problem by vectorizing the multi sided matrix multiplications in the SLS optimization constraints, which allows us to reformulate it as a discrete time control problem and solve using two stages of dynamic programming (DP). Additionally, we derive an approximation algorithm that offers a faster runtime by partially enforcing the constraints, and show that this algorithm offers the same results. DP solves SLS up to 9 times faster, with an additional 23 to 51 improvement using the approximation algorithm, than a convex program solver, and scales with large state, input, output, and finite impulse response horizon.


An Electroencephalography connectome predictive model of major depressive disorder severity. Emerging evidence showed that major depressive disorder (MDD) is associated with disruptions of brain structural and functional networks, rather than impairment of isolated brain region. Thus, connectome based models capable of predicting the depression severity at the individual level can be clinically useful. Here, we applied a machine learning approach to predict the severity of depression using resting state networks derived from source reconstructed Electroencephalography (EEG) signals. Using regression models and three independent EEG datasets (N 328), we tested whether resting state functional connectivity could predict individual depression score. On the first dataset, results showed that individuals scores could be reasonably predicted (r 0.61, p 4 x 10 18) using intrinsic functional connectivity in the EEG alpha band (8 13 Hz). In particular, the brain regions which contributed the most to the predictive network belong to the default mode network. We further tested the predictive potential of the established model by conducting two external validations on (N1 53, N2 154). Results showed high significant correlations between the predicted and the measured depression scale scores (r1 0.49, r2 0.37, p 0.001). These findings lay the foundation for developing a generalizable and scientifically interpretable EEG network based markers that can ultimately support clinicians in a biologically based characterization of MDD.


Deep Learning Aided Packet Routing in Aeronautical Ad Hoc Networks Relying on Real Flight Data From Single Objective to Near Pareto Multi Objective Optimization. Data packet routing in aeronautical ad hoc networks (AANETs) is challenging due to their high dynamic topology. In this paper, we invoke deep learning (DL) to assist routing in AANETs. We set out from the single objective of minimizing the end to end (E2E) delay. Specifically, a deep neural network (DNN) is conceived for mapping the local geographic information observed by the forwarding node into the information required for determining the optimal next hop. The DNN is trained by exploiting the regular mobility pattern of commercial passenger airplanes from historical flight data. After training, the DNN is stored by each airplane for assisting their routing decisions during flight relying solely on local geographic information. Furthermore, we extend the DL aided routing algorithm to a multi objective scenario, where we aim for simultaneously minimizing the delay, maximizing the path capacity, and maximizing the path lifetime. Our simulation results based on real flight data show that the proposed DL aided routing outperforms existing position based routing protocols in terms of its E2E delay, path capacity as well as path lifetime, and it is capable of approaching the Pareto front that is obtained using global link information.


Stateful Function as a Service at the Edge. In FaaS, users invoke remote functions, which encapsulate service(s). These functions typically need to remotely access a persistent state via external services this makes the paradigm less attractive in edge systems, especially for IoT applications, due to the increased delay and outbound traffic. We propose to generalize the FaaS paradigm by allowing functions to alternate between remote state and local state phases, depending on internal and external conditions, and dedicating a container with persistent memory to functions when in a local state phase. We present initial results showing that this simple yet powerful pattern allows to better utilize the available resources, which are scarce on edge nodes, while significantly reducing tail latencies, which is key to enable many new applications based on real time ML, e.g., in smart vehicles and smart factory scenarios


The Tensor Brain A Unified Theory of Perception, Memory and Semantic Decoding. We present a unified computational theory of perception and memory. In our model, perception, episodic memory, and semantic memory are realized by different functional and operational modes of the oscillating interactions between an index layer and a representation layer in a bilayer tensor network (BTN). The memoryless semantic representation layer broadcasts information. In cognitive neuroscience, it would be the "mental canvas", or the "global workspace" and reflects the cognitive brain state. The symbolic index layer represents concepts and past episodes, whose semantic embeddings are implemented in the connection weights between both layers. In addition, we propose a working memory layer as a processing center and information buffer. Episodic and semantic memory realize memory based reasoning, i.e., the recall of relevant past information to enrich perception, and are personalized to an agent's current state, as well as to an agent's unique memories. Episodic memory stores and retrieves past observations and provides provenance and context. Recent episodic memory enriches perception by the retrieval of perceptual experiences, which provide the agent with a sense about the here and now to understand its own state, and the world's semantic state in general, the agent needs to know what happened recently, in recent scenes, and on recently perceived entities. Remote episodic memory retrieves relevant past experiences, contributes to our conscious self, and, together with semantic memory, to a large degree defines who we are as individuals.


Numerical study of the McIntyre instability around Gaussian floating vortices in thermal wind balance. The visco diffusive McIntyre instability (McIntyre 1970) has been suggested as a possible source for density layer formation around laboratory and oceanic vortices. This suggestion is here quantitatively addressed using idealised, axisymmetric, numerical simulations of a simple Gaussian like vortex in thermal wind balance, floating in a rotating, stratified flow. Numerical simulations are complemented by a local stability analysis derived from the seminal study (McIntyre 1970). It is confirmed that the McIntyre instability is responsible for the layering observed around laboratory vortices, but its relevance for explaining layering around meddies remains doubtful.


Towards Automated Psychotherapy via Language Modeling. In this experiment, a model was devised, trained, and evaluated to automate psychotherapist client text conversations through the use of state of the art, Seq2Seq Transformer based Natural Language Generation (NLG) systems. Through training the model upon a mix of the Cornell Movie Dialogue Corpus for language understanding and an open source, anonymized, and public licensed psychotherapeutic dataset, the model achieved statistically significant performance in published, standardized qualitative benchmarks against human written validation data meeting or exceeding human written responses' performance in 59.7 and 67.1 of the test set for two independent test methods respectively. Although the model cannot replace the work of psychotherapists entirely, its ability to synthesize human appearing utterances for the majority of the test set serves as a promising step towards communizing and easing stigma at the psychotherapeutic point of care.


A Unified DRO View of Multi class Loss Functions with top N Consistency. Multi class classification is one of the most common tasks in machine learning applications, where data is labeled by one of many class labels. Many loss functions have been proposed for multi class classification including two well known ones, namely the cross entropy (CE) loss and the crammer singer (CS) loss (aka. the SVM loss). While CS loss has been used widely for traditional machine learning tasks, CE loss is usually a default choice for multi class deep learning tasks. There are also top k variants of CS loss and CE loss that are proposed to promote the learning of a classifier for achieving better top k accuracy. Nevertheless, it still remains unclear the relationship between these different losses, which hinders our understanding of their expectations in different scenarios. In this paper, we present a unified view of the CS CE losses and their smoothed top k variants by proposing a new family of loss functions, which are arguably better than the CS CE losses when the given label information is incomplete and noisy. The new family of smooth loss functions named label distributionally robust (LDR) loss is defined by leveraging the distributionally robust optimization (DRO) framework to model the uncertainty in the given label information, where the uncertainty over true class labels is captured by using distributional weights for each label regularized by a function.


A Label Dependence aware Sequence Generation Model for Multi level Implicit Discourse Relation Recognition. Implicit discourse relation recognition (IDRR) is a challenging but crucial task in discourse analysis. Most existing methods train multiple models to predict multi level labels independently, while ignoring the dependence between hierarchically structured labels. In this paper, we consider multi level IDRR as a conditional label sequence generation task and propose a Label Dependence aware Sequence Generation Model (LDSGM) for it. Specifically, we first design a label attentive encoder to learn the global representation of an input instance and its level specific contexts, where the label dependence is integrated to obtain better label embeddings. Then, we employ a label sequence decoder to output the predicted labels in a top down manner, where the predicted higher level labels are directly used to guide the label prediction at the current level. We further develop a mutual learning enhanced training method to exploit the label dependence in a bottomup direction, which is captured by an auxiliary decoder introduced during training. Experimental results on the PDTB dataset show that our model achieves the state of the art performance on multi level IDRR. We will release our code at https github.com nlpersECJTU LDSGM.


Label differential privacy via clustering. We present new mechanisms for emph label differential privacy , a relaxation of differentially private machine learning that only protects the privacy of the labels in the training set. Our mechanisms cluster the examples in the training set using their (non private) feature vectors, randomly re sample each label from examples in the same cluster, and output a training set with noisy labels as well as a modified version of the true loss function. We prove that when the clusters are both large and high quality, the model that minimizes the modified loss on the noisy training set converges to small excess risk at a rate that is comparable to the rate for non private learning. We describe both a centralized mechanism in which the entire training set is stored by a trusted curator, and a distributed mechanism where each user stores a single labeled example and replaces her label with the label of a randomly selected user from the same cluster. We also describe a learning problem in which large clusters are necessary to achieve both strong privacy and either good precision or good recall. Our experiments show that randomizing the labels within each cluster significantly improves the privacy vs. accuracy trade off compared to applying uniform randomized response to the labels, and also compared to learning a model via DP SGD.


Breakage Suppression in Liquid Marbles driven by Onset of Stable Inertial Fingering Liquid Flowers. Droplet breakage upon impact is undesirable in many applications related to pesticide dispersal, spray cooling, and printing. A coating of hydrophobic particles over droplets, known as liquid marbles, can increase the robustness significantly and delay its breakage. The present study identified two distinct regimes of stability against breakage. Interestingly, one of the regimes lies in the higher velocity range where droplet fragmentation is inevitable. Such anomalous stability regime is due to onset of fingering instability. These fingers evolve into flower like structures (Liquid Flower) at much lower velocities. Moreover, the liquid flower remains stable over a long range of velocities, where the significant role of particle distribution and jamming is identified. In contrast, the lower velocity stability regime is attributed to reduced adhesion of liquid marble compared to droplet. Such reduced adhesion also helps in reducing the contact time of liquid marble up to 20 .


physics.plasm-ph physics.acc-ph physics.app-ph physics.flu-dyn

Effect of Nozzle Curvature on Supersonic Gas Jets Used in Laser Plasma Acceleration. Supersonic gas jets produced by converging diverging (C D) nozzles are commonly used as targets for laser plasma acceleration (LPA) experiments. A major point of interest for these targets is the gas density at the region of interaction where the laser ionizes the gas plume to create a plasma, providing the acceleration structure. Tuning the density profiles at this interaction region is crucial to LPA optimization. A "flat top" density profile is desired at this line of interaction to control laser propagation and high energy electron acceleration, while a short high density profile is often preferred for acceleration of lower energy tightly focused laser plasma interactions. A particular design parameter of interest is the curvature of the nozzle's diverging section. We examine three nozzle designs with different curvatures the concave "bell", straight conical and convex "trumpet" nozzles. We demonstrate that, at mm scale distances from the nozzle exit, the trumpet and straight nozzles, if optimized, produce "flat top" density profiles whereas the bell nozzle creates focused regions of gas with higher densities. An optimization procedure for the trumpet nozzle is derived and compared to the straight nozzle optimization process. We find that the trumpet nozzle, by providing an extra parameter of control through its curvature, is more versatile for creating flat top profiles and its optimization procedure is more refined compared to the straight nozzle and the straight nozzle optimization process. We present results for different nozzle designs from computational fluid dynamics (CFD) simulations performed with the program ANSYS Fluent and verify them experimentally using neutral density interferometry.


An Exact Algorithm for Large scale Non convex Quadratic Facility Location. We study a general class of quadratic capacitated p location problems facility location problems with single assignment where a non separable, non convex, quadratic term is introduced in the objective function to account for the interaction cost between facilities and customer assignments. This problem has many applications in the field of transportation and logistics where its most well known special case is the single allocation hub location problem and its many variants. The non convex, binary quadratic program is linearized by applying a reformulation linearization technique and the resulting continuous auxiliary variables are projected out using Benders decomposition. The obtained Benders reformulation is then solved using an exact branch and cut algorithm that exploits the underlying network flow structure of the decomposed separation subproblems to efficiently generate strong Pareto optimal Benders cuts. Additional enhancements such as a matheuristic, a partial enumeration procedure, and variable elimination tests are also embedded in the proposed algorithmic framework. Extensive computational experiments on benchmark instances (with up to 500 nodes) and on a new set of instances (with up to 1,000 nodes) of four variants of single allocation hub location problems confirm the algorithm's ability to scale to large scale instances.


Two Sided Matching Meets Fair Division. We introduce a new model for two sided matching which allows us to borrow popular fairness notions from the fair division literature such as envy freeness up to one good and maximin share guarantee. In our model, each agent is matched to multiple agents on the other side over whom she has additive preferences. We demand fairness for each side separately, giving rise to notions such as double envy freeness up to one match (DEF1) and double maximin share guarantee (DMMS). We show that (a slight strengthening of) DEF1 cannot always be achieved, but in the special case where both sides have identical preferences, the round robin algorithm with a carefully designed agent ordering achieves it. In contrast, DMMS cannot be achieved even when both sides have identical preferences.


Single versus Multiple Annotation for Named Entity Recognition of Mutations. The focus of this paper is to address the knowledge acquisition bottleneck for Named Entity Recognition (NER) of mutations, by analysing different approaches to build manually annotated data. We address first the impact of using a single annotator vs two annotators, in order to measure whether multiple annotators are required. Once we evaluate the performance loss when using a single annotator, we apply different methods to sample the training data for second annotation, aiming at improving the quality of the dataset without requiring a full pass. We use held out double annotated data to build two scenarios with different types of rankings similarity based and confidence based. We evaluate both approaches on (i) their ability to identify training instances that are erroneous (cases where single annotator labels differ from double annotation after discussion), and (ii) on Mutation NER performance for state of the art classifiers after integrating the fixes at different thresholds.


Techniques for Jointly Extracting Entities and Relations A Survey. Relation Extraction is an important task in Information Extraction which deals with identifying semantic relations between entity mentions. Traditionally, relation extraction is carried out after entity extraction in a "pipeline" fashion, so that relation extraction only focuses on determining whether any semantic relation exists between a pair of extracted entity mentions. This leads to propagation of errors from entity extraction stage to relation extraction stage. Also, entity extraction is carried out without any knowledge about the relations. Hence, it was observed that jointly performing entity and relation extraction is beneficial for both the tasks. In this paper, we survey various techniques for jointly extracting entities and relations. We categorize techniques based on the approach they adopt for joint extraction, i.e. whether they employ joint inference or joint modelling or both. We further describe some representative techniques for joint inference and joint modelling. We also describe two standard datasets, evaluation techniques and performance of the joint extraction approaches on these datasets. We present a brief analysis of application of a general domain joint extraction approach to a Biomedical dataset. This survey is useful for researchers as well as practitioners in the field of Information Extraction, by covering a broad landscape of joint extraction techniques.


The pressureless damped Euler Riesz equations. In this paper, we analyze the pressureless damped Euler Riesz equations posed in either mathbb R d or mathbb T d . We construct the global in time existence and uniqueness of classical solutions for the system around a constant background state. We also establish large time behaviors of classical solutions showing the solutions towards the equilibrium as time goes to infinity. For the whole space case, we first show the algebraic decay rate of solutions under additional assumptions on the initial data compared to the existence theory. We then refine the argument to have the exponential decay rate of convergence even in the whole space. In the case of the periodic domain, without any further regularity assumptions on the initial data, we provide the exponential convergence of solutions.


A Physics Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticity. We explore an application of the Physics Informed Neural Networks (PINNs) in conjunction with Airy stress functions and Fourier series to find optimal solutions to a few reference biharmonic problems of elasticity and elastic plate theory. Biharmonic relations are fourth order partial differential equations (PDEs) that are challenging to solve using classical numerical methods, and have not been addressed using PINNs. Our work highlights a novel application of classical analytical methods to guide the construction of efficient neural networks with the minimal number of parameters that are very accurate and fast to evaluate. In particular, we find that enriching feature space using Airy stress functions can significantly improve the accuracy of PINN solutions for biharmonic PDEs.


Robust Optimization Framework for Training Shallow Neural Networks Using Reachability Method. In this paper, a robust optimization framework is developed to train shallow neural networks based on reachability analysis of neural networks. To characterize noises of input data, the input training data is disturbed in the description of interval sets. Interval based reachability analysis is then performed for the hidden layer. With the reachability analysis results, a robust optimization training method is developed in the framework of robust least square problems. Then, the developed robust least square problem is relaxed to a semidefinite programming problem. It has been shown that the developed robust learning method can provide better robustness against perturbations at the price of loss of training accuracy to some extent. At last, the proposed method is evaluated on a robot arm model learning example.


An Investigation of Drivers' Dynamic Situational Trust in Conditionally Automated Driving. Understanding how trust is built over time is essential, as trust plays an important role in the acceptance and adoption of automated vehicles (AVs). This study aimed to investigate the effects of system performance and participants' trust preconditions on dynamic situational trust during takeover transitions. We evaluated the dynamic situational trust of 42 participants using both self reported and behavioral measures while watching 30 videos with takeover scenarios. The study was a 3 by 2 mixed subjects design, where the within subjects variable was the system performance (i.e., accuracy levels of 95 , 80 , and 70 ) and the between subjects variable was the preconditions of the participants' trust (i.e., overtrust and undertrust). Our results showed that participants quickly adjusted their self reported situational trust (SST) levels which were consistent with different accuracy levels of system performance in both trust preconditions. However, participants' behavioral situational trust (BST) was affected by their trust preconditions across different accuracy levels. For instance, the overtrust precondition significantly increased the agreement fraction compared to the undertrust precondition. The undertrust precondition significantly decreased the switch fraction compared to the overtrust precondition. These results have important implications for designing an in vehicle trust calibration system for conditional AVs.


Educators, Solicitors, Flamers, Motivators, Sympathizers Characterizing Roles in Online Extremist Movements. Social media provides the means by which extremist social movements, such as white supremacy and anti LGBTQ, thrive online. Yet, we know little about the roles played by the participants of such movements. In this paper, we investigate these participants to characterize their roles, their role dynamics, and their influence in spreading online extremism. Our participants, online extremist accounts, are 4,876 public Facebook pages or groups that have shared information from the websites of 289 Southern Poverty Law Center designated extremist groups. By clustering the quantitative features followed by qualitative expert validation, we identify five roles surrounding extremist activism educators, solicitors, flamers, motivators, sympathizers. For example, solicitors use links from extremist websites to attract donations and participation in extremist issues, whereas flamers share inflammatory extremist content inciting anger. We further investigate role dynamics such as, how stable these roles are over time and how likely will extremist accounts transition from one role into another. We find that roles core to the movement, educators and solicitors, are more stable, while flamers and motivators can transition to sympathizers with high probability. We further find that educators and solicitors exert the most influence in triggering extremist link posts, whereas flamers are influential in triggering the spread of information from fake news sources. Our results help in situating various roles on the trajectory of deeper engagement into the extremist movements and understanding the potential effect of various counter extremism interventions. Our findings have implications for understanding how online extremist movements flourish through participatory activism and how they gain a spectrum of allies for mobilizing extremism online.


Value of Information for Argumentation based Intelligence Analysis. Argumentation provides a representation of arguments and attacks between these arguments. Argumentation can be used to represent a reasoning process over evidence to reach conclusions. Within such a reasoning process, understanding the value of information can improve the quality of decision making based on the output of the reasoning process. The value of an item of information is inherently dependent on the available evidence and the question being answered by the reasoning. In this paper we introduce a value of information on argument frameworks to identify the most valuable arguments within the finite set of arguments in the framework, and the arguments and attacks which could be added to change the output of an evaluation. We demonstrate the value of information within an argument framework representing an intelligence analysis in the maritime domain. Understanding the value of information in an intelligence analysis will allow analysts to balance the value against the costs and risks of collection, to effectively request further collection of intelligence to increase the confidence in the analysis of hypotheses.


A PTAS for k hop MST on the Euclidean plane Improving Dependency on k . For any epsilon 0 , Laue and Matijevi ' c CCCG'07, IPL'08 give a PTAS for finding a (1 epsilon) approximate solution to the k hop MST problem in the Euclidean plane that runs in time (n epsilon) O(k epsilon) . In this paper, we present an algorithm that runs in time (n epsilon) O( log k cdot(1 epsilon) 2 cdot log 2(1 epsilon)) . This gives an improvement on the dependency on k on the exponent, while having a worse dependency on epsilon . As in Laue and Matijevi ' c , we follow the framework introduced by Arora for Euclidean TSP. Our key ingredients include exponential distance scaling and compression of dynamic programming state tables.


R BERT CNN Drug target interactions extraction from biomedical literature. In this research, we present our work participation for the DrugProt task of BioCreative VII challenge. Drug target interactions (DTIs) are critical for drug discovery and repurposing, which are often manually extracted from the experimental articles. There are 32M biomedical articles on PubMed and manually extracting DTIs from such a huge knowledge base is challenging. To solve this issue, we provide a solution for Track 1, which aims to extract 10 types of interactions between drug and protein entities. We applied an Ensemble Classifier model that combines BioMed RoBERTa, a state of art language model, with Convolutional Neural Networks (CNN) to extract these relations. Despite the class imbalances in the BioCreative VII DrugProt test corpus, our model achieves a good performance compared to the average of other submissions in the challenge, with the micro F1 score of 55.67 (and 63 on BioCreative VI ChemProt test corpus). The results show the potential of deep learning in extracting various types of DTIs.


Autoionizing Polaritons in Attosecond Atomic Ionization. Light induced states are commonly observed in the photoionization spectra of laser dressed atoms. The properties of autoionizing polaritons, entangled states of light and Auger resonances, however, are largely unexplored. We employ attosecond transient absorption spectroscopy to study the evolution of autoionizing states in argon, dressed by a tunable femtosecond laser pulse. The avoided crossings between the 3s 1 4p and several light induced states indicates the formation of polariton multiplets. We measure a controllable stabilization of the polaritons against ionization, in excellent agreement with emph ab initio theory. Using an extension of the Jaynes Cummings model to autoionizing states, we show that this stabilization is due to the destructive interference between the Auger decay and the radiative ionization of the polaritonic components. These results give new insights into the optical control of electronic structure in the continuum, and unlock the door to applications of autoionizing polaritons in poly electronic systems.


Regularized Non monotone Submodular Maximization. In this paper, we present a thorough study of maximizing a regularized non monotone submodular function subject to various constraints, i.e., max g(A) ell(A) A in mathcal F , where g colon 2 Omega to mathbb R is a non monotone submodular function, ell colon 2 Omega to mathbb R is a normalized modular function and mathcal F is the constraint set. Though the objective function f g ell is still submodular, the fact that f could potentially take on negative values prevents the existing methods for submodular maximization from providing a constant approximation ratio for the regularized submodular maximization problem. To overcome the obstacle, we propose several algorithms which can provide a relatively weak approximation guarantee for maximizing regularized non monotone submodular functions. More specifically, we propose a continuous greedy algorithm for the relaxation of maximizing g ell subject to a matroid constraint. Then, the pipage rounding procedure can produce an integral solution S such that mathbb E g(S) ell(S) geq e 1 g(OPT) ell(OPT) O( epsilon) . Moreover, we present a much faster algorithm for maximizing g ell subject to a cardinality constraint, which can output a solution S with mathbb E g(S) ell(S) geq (e 1 epsilon) g(OPT) ell(OPT) using O( frac n epsilon 2 ln frac 1 epsilon) value oracle queries. We also consider the unconstrained maximization problem and give an algorithm which can return a solution S with mathbb E g(S) ell(S) geq e 1 g(OPT) ell(OPT) using O(n) value oracle queries.


Railgun managing large streaming windows under MAD requirements. Some mission critical systems, e.g., fraud detection, require accurate, real time metrics over long time sliding windows on applications that demand high throughput and low latencies. As these applications need to run 'forever' and cope with large, spiky data loads, they further require to be run in a distributed setting. We are unaware of any streaming system that provides all those properties. Instead, existing systems take large simplifications, such as implementing sliding windows as a fixed set of overlapping windows, jeopardizing metric accuracy (violating regulatory rules) or latency (breaching service agreements). In this paper, we propose Railgun, a fault tolerant, elastic, and distributed streaming system supporting real time sliding windows for scenarios requiring high loads and millisecond level latencies. We benchmarked an initial prototype of Railgun using real data, showing significant lower latency than Flink and low memory usage independent of window size. Further, we show that Railgun scales nearly linearly, respecting our msec level latencies at high percentiles ( 250ms 99.9 ) even under a load of 1 million events per second.


Flexible bandwidth Needlets. We investigate here a generalized construction of spherical wavelets needlets which admits extra flexibility in the harmonic domain, i.e., it allows the corresponding support in multipole (frequency) space to vary in more general forms than in the standard constructions. We study the analytic properties of this system and we investigate its behaviour when applied to isotropic random fields more precisely, we establish asymptotic localization and uncorrelation properties (in the high frequency sense) under broader assumptions than typically considered in the literature.


Robust Optimal Classification Trees Against Adversarial Examples. Decision trees are a popular choice of explainable model, but just like neural networks, they suffer from adversarial examples. Existing algorithms for fitting decision trees robust against adversarial examples are greedy heuristics and lack approximation guarantees. In this paper we propose ROCT, a collection of methods to train decision trees that are optimally robust against user specified attack models. We show that the min max optimization problem that arises in adversarial learning can be solved using a single minimization formulation for decision trees with 0 1 loss. We propose such formulations in Mixed Integer Linear Programming and Maximum Satisfiability, which widely available solvers can optimize. We also present a method that determines the upper bound on adversarial accuracy for any model using bipartite matching. Our experimental results demonstrate that the existing heuristics achieve close to optimal scores while ROCT achieves state of the art scores.


Symmetric Norm Estimation and Regression on Sliding Windows. The sliding window model generalizes the standard streaming model and often performs better in applications where recent data is more important or more accurate than data that arrived prior to a certain time. We study the problem of approximating symmetric norms (a norm on mathbb R n that is invariant under sign flips and coordinate wise permutations) in the sliding window model, where only the W most recent updates define the underlying frequency vector. Whereas standard norm estimation algorithms for sliding windows rely on the smooth histogram framework of Braverman and Ostrovsky (FOCS 2007), analyzing the smoothness of general symmetric norms seems to be a challenging obstacle. Instead, we observe that the symmetric norm streaming algorithm of Braverman et. al. (STOC 2017) can be reduced to identifying and approximating the frequency of heavy hitters in a number of substreams. We introduce a heavy hitter algorithm that gives a (1 epsilon) approximation to each of the reported frequencies in the sliding window model, thus obtaining the first algorithm for general symmetric norm estimation in the sliding window model. Our algorithm is a universal sketch that simultaneously approximates all symmetric norms in a parametrizable class and also improves upon the smooth histogram framework for estimating L p norms, for a range of large p . Finally, we consider the problem of overconstrained linear regression problem in the case that loss function that is an Orlicz norm, a symmetric norm that can be interpreted as a scale invariant version of M estimators. We give the first sublinear space algorithms that produce (1 epsilon) approximate solutions to the linear regression problem for loss functions that are Orlicz norms in both the streaming and sliding window models.


Sequential Recommendation with Bidirectional Chronological Augmentation of Transformer. Sequential recommendation can capture user chronological preferences from their historical behaviors, yet the learning of short sequences (cold start problem) is still an open challenge. Recently, data augmentation with pseudo prior items generated by transformers has drawn considerable attention. These methods can generate pseudo prior items sequentially in reverse chronological order to extend the training sequence. However, the performance may still degrade in very short sequences most notably, the generation of pseudo prior items does not take into account the forward direction (from the past to the future), and so the underlying temporal correlations are not preserved in terms of conditional probabilities. Motivated by this, we propose a Bidirectional Chronological Augmentation of Transformer (BiCAT) that uses a forward learning constraint in the reverse generative process to capture contextual information more effectively. Such self knowledge distillation can bridge the gap between data augmentation and model representation, which enhances the robustness of sequence encoder. Moreover, an informative positive and negative sampling strategy is proposed to accelerate optimization and prevent overfitting. Extensive experiments on two popular real world datasets demonstrate the efficacy of our method on very short sequences and long sequences, our approach can improve state of the art performance by an average of 35.04 and 8.76 respectively, in terms of Recall 5.


Composition series of arbitrary cardinality in abelian categories. We extend the notion of a composition series in an abelian category to allow the multiset of composition factors to have arbitrary cardinality. We then provide sufficient axioms for the existence of such composition series and the validity of "Jordan H "older Schreier like" theorems. We give several examples of objects which satisfy these axioms, including pointwise finite dimensional persistence modules, Pr "ufer modules, and presheaves. Finally, we show that if an abelian category with a simple object has both arbitrary coproducts and arbitrary products, then it contains an object which both fails to satisfy our axioms and admits at least two composition series with distinct cardinalities.


Values of Inhomogeneous Forms at S integral points. We prove effective versions of Oppenheim's conjecture for generic inhomogeneous forms in the S arithmetic setting. We prove an effective result for fixed rational shifts and generic forms and we also prove a result where both the quadratic form and the shift are allowed to vary. In order to do so, we prove analogues of Rogers' moment formulae for S arithmetic congruence quotients as well as for the space of affine lattices. We believe the latter results to be of independent interest.


Discovery of slow variables in a class of multiscale stochastic systems via neural networks. Finding a reduction of complex, high dimensional dynamics to its essential, low dimensional "heart" remains a challenging yet necessary prerequisite for designing efficient numerical approaches. Machine learning methods have the potential to provide a general framework to automatically discover such representations. In this paper, we consider multiscale stochastic systems with local slow fast time scale separation and propose a new method to encode in an artificial neural network a map that extracts the slow representation from the system. The architecture of the network consists of an encoder decoder pair that we train in a supervised manner to learn the appropriate low dimensional embedding in the bottleneck layer. We test the method on a number of examples that illustrate the ability to discover a correct slow representation. Moreover, we provide an error measure to assess the quality of the embedding and demonstrate that pruning the network can pinpoint an essential coordinates of the system to build the slow representation.


A Survey on Trust Metrics for Autonomous Robotic Systems. This paper surveys the area of Trust Metrics related to security for autonomous robotic systems. As the robotics industry undergoes a transformation from programmed, task oriented, systems to Artificial Intelligence enabled learning, these autonomous systems become vulnerable to several security risks, making a security assessment of these systems of critical importance. Therefore, our focus is on a holistic approach for assessing system trust which requires incorporating system, hardware, software, cognitive robustness, and supplier level trust metrics into a unified model of trust. We set out to determine if there were already trust metrics that defined such a holistic system approach. While there are extensive writings related to various aspects of robotic systems such as, risk management, safety, security assurance and so on, each source only covered subsets of an overall system and did not consistently incorporate the relevant costs in their metrics. This paper attempts to put this prior work into perspective, and to show how it might be extended to develop useful system level trust metrics for evaluating complex robotic (and other) systems.


Numerical investigation of the formation and stability of homogeneous pairs of soft particles in inertial microfluidics. We investigate the formation and stability of a pair of identical soft capsules in channel flow under mild inertia. We employ a combination of the lattice Boltzmann, finite element and immersed boundary methods to simulate the elastic particles in flow. Validation tests show excellent agreement with numerical results obtained by other research groups. Our results reveal new trajectory types that have not been observed for pairs of rigid particles. While particle softness increases the likelihood of a stable pair forming, the pair stability is determined by the lateral position of the particles. A key finding is that stabilisation of the axial distance occurs after lateral migration of the particles. During the later phase of pair formation, particles undergo damped oscillations that are independent of initial conditions. These damped oscillations are driven by a strong hydrodynamic coupling of the particle dynamics, particle inertia and viscous dissipation. While the frequency and damping coefficient of the oscillations depend on particle softness, the pair formation time is largely determined by the initial particle positions the time to form a stable pair grows exponentially with the initial axial distance. Our results demonstrate that particle softness has a strong impact on the behaviour of particle pairs. The findings could have significant ramifications for microfluidic applications where a constant and reliable axial distance between particles is required, such as flow cytometry.


Pricing Private Data with Personalized Differential Privacy and Partial Arbitrage Freeness. There is a growing trend regarding perceiving personal data as a commodity. Existing studies have built frameworks and theories about how to determine an arbitrage free price of a given query according to the privacy loss quantified by differential privacy. However, those studies have assumed that data buyers can purchase query answers with the arbitrary privacy loss of data owners, which may not be valid under strict privacy regulations and data owners' increasing privacy concerns. In this paper, we study how to empower data owners to control privacy loss in data trading. First, we propose a framework for trading personal data that enables data owners to bound their personalized privacy losses. Second, since bounded privacy losses indicate bounded utilities of query answers, we propose a reasonable relaxation of arbitrage freeness named partial arbitrage freeness, i.e., the guarantee of arbitrage free pricing only for a limited range of utilities, which provides more possibilities for our market design. Third, to avoid arbitrage, we propose a general method for ensuring arbitrage freeness under personalized differential privacy. Fourth, to fully utilize data owners' personalized privacy loss bounds, we propose privacy budget allocation techniques to allocate privacy losses for queries under arbitrage freeness. Finally, we conduct experiments to verify the effectiveness of our proposed trading protocols.


Alice in Passphraseland Assessing the Memorability of Familiar Vocabularies for System Assigned Passphrases. Text based secrets are still the most commonly used authentication mechanism in information systems. IT managers must strike a balance between security and memorability while developing password policies. Initially introduced as more secure authentication keys that people could recall, passphrases are passwords consisting of multiple words. However, when left to the choice of users, they tend to choose predictable natural language patterns in passphrases, resulting in vulnerability to guessing attacks. System assigned authentication keys can be guaranteed to be secure, but this comes at a cost to memorability. In this study we investigate the memorability of system assigned passphrases from a familiar vocabulary to the user. The passphrases are generated with the Generative Pre trained Transformer 2 (GPT 2) model trained on the familiar vocabulary and are readable, pronounceable, sentence like passphrases resembling natural English sentences. Through an online user study with 500 participants on Amazon Mechanical Turk, we test our hypothesis following a spaced repetition schedule, passphrases as natural English sentences, based on familiar vocabulary are easier to recall than passphrases composed of random common words. As a proof of concept, we tested the idea with Amazon Mechanical Turk participants by assigning them GPT 2 generated passphrases based on stories they were familiar with. Contrary to expectations, following a spaced repetition schedule, passphrases as natural English sentences, based on familiar vocabulary performed similarly to system assigned passphrases based on random common words.


FERMI Fair Empirical Risk Minimization via Exponential R 'enyi Mutual Information. Despite the success of large scale empirical risk minimization (ERM) at achieving high accuracy across a variety of machine learning tasks, fair ERM is hindered by the incompatibility of fairness constraints with stochastic optimization. In this paper, we propose the fair empirical risk minimization via exponential R 'enyi mutual information (FERMI) framework. FERMI is built on a stochastic estimator for exponential R 'enyi mutual information (ERMI), an information divergence measuring the degree of the dependence of predictions on sensitive attributes. Theoretically, we show that ERMI upper bounds existing popular fairness violation metrics, thus controlling ERMI provides guarantees on other commonly used violations, such as L infty . We derive an unbiased estimator for ERMI, which we use to derive the FERMI algorithm. We prove that FERMI converges for demographic parity, equalized odds, and equal opportunity notions of fairness in stochastic optimization. Empirically, we show that FERMI is amenable to large scale problems with multiple (non binary) sensitive attributes and non binary targets. Extensive experiments show that FERMI achieves the most favorable tradeoffs between fairness violation and test accuracy across all tested setups compared with state of the art baselines for demographic parity, equalized odds, equal opportunity. These benefits are especially significant for non binary classification with large sensitive sets and small batch sizes, showcasing the effectiveness of the FERMI objective and the developed stochastic algorithm for solving it.


A Scalable Two Stage Approach to Computing Optimal Decision Sets. Machine learning (ML) is ubiquitous in modern life. Since it is being deployed in technologies that affect our privacy and safety, it is often crucial to understand the reasoning behind its decisions, warranting the need for explainable AI. Rule based models, such as decision trees, decision lists, and decision sets, are conventionally deemed to be the most interpretable. Recent work uses propositional satisfiability (SAT) solving (and its optimization variants) to generate minimum size decision sets. Motivated by limited practical scalability of these earlier methods, this paper proposes a novel approach to learn minimum size decision sets by enumerating individual rules of the target decision set independently of each other, and then solving a set cover problem to select a subset of rules. The approach makes use of modern maximum satisfiability and integer linear programming technologies. Experiments on a wide range of publicly available datasets demonstrate the advantage of the new approach over the state of the art in SAT based decision set learning.


Visual Time Series Forecasting An Image driven Approach. In this work, we address time series forecasting as a computer vision task. We capture input data as an image and train a model to produce the subsequent image. This approach results in predicting distributions as opposed to pointwise values. To assess the robustness and quality of our approach, we examine various datasets and multiple evaluation metrics. Our experiments show that our forecasting tool is effective for cyclic data but somewhat less for irregular data such as stock prices. Importantly, when using image based evaluation metrics, we find our method to outperform various baselines, including ARIMA, and a numerical variation of our deep learning approach.


Conductivity influence on interfacial waves in liquid metal batteries and related two layer systems. Fluid flows in liquid metal batteries can be generated by a number of effects. We start with a short overview of different driving mechanisms and then address questions specific to the metal pad role instabilities in three layer systems. We focus on the role of the conductivity distribution in the cell, noting at the same time that interfacial tension should be considered as well for smaller cells. Following this discussion, numerical results on the excitation of interfacial waves in two layer liquid metal systems with miscibility gaps bearing an interface normal electric current are presented. Confirming recent results from the literature, we find that magnetic damping plays a decisive role for strong vertical magnetic fields. In addition, boundary conditions for the electric field strongly influence critical currents and growth rates.


Exploring Simple 3D Multi Object Tracking for Autonomous Driving. 3D multi object tracking in LiDAR point clouds is a key ingredient for self driving vehicles. Existing methods are predominantly based on the tracking by detection pipeline and inevitably require a heuristic matching step for the detection association. In this paper, we present SimTrack to simplify the hand crafted tracking paradigm by proposing an end to end trainable model for joint detection and tracking from raw point clouds. Our key design is to predict the first appear location of each object in a given snippet to get the tracking identity and then update the location based on motion estimation. In the inference, the heuristic matching step can be completely waived by a simple read off operation. SimTrack integrates the tracked object association, newborn object detection, and dead track killing in a single unified model. We conduct extensive evaluations on two large scale datasets nuScenes and Waymo Open Dataset. Experimental results reveal that our simple approach compares favorably with the state of the art methods while ruling out the heuristic matching rules.


Existence of bistable states in curved compression ramp flows. This paper reports the bistability of curved compression ramp (CCR) flows. It reveals that both separation and attachment states can be stably established even for the same boundary conditions. Firstly, to investigate the effects of initial condition and evolutionary history, a thought experiment involving two processes with the same three steps but in different orders is designed, possibly constructing the two distinct different stable CCR flows. Subsequently, three dimensional direct numerical simulations are then performed to replicate the thought experiment, verifying the existence of the bistable states in CCR flows. In the end, the method of virtual separation disturbance is proposed to detect whether potential bistable states exist, theoretically demonstrating the bistability of CCR flows. As a canonical type of Shock waveBoundary layer interactions, local CCR flows often appear on aircraft, hence the bistability will certainly bring noteworthy changes to the global aerothermodynamic characteristics, which supersonic hypersonic flight has to deal with.


A unified framework for distributed optimization algorithms over time varying directed graphs. In this paper, we propose a framework under which the decentralized optimization algorithms suggested in cite JKJJ,MA, NO,NO2 can be treated in a unified manner. More precisely, we show that the distributed subgradient descent algorithms cite JKJJ, NO , the subgradient push algorithm cite NO2 , and the distributed algorithm with row stochastic matrix cite MA can be derived by making suitable choices of consensus matrices, step size and subgradient from the decentralized subgradient descent proposed in cite NO . As a result of such unified understanding, we provide a convergence proof that covers the algorithms in cite JKJJ,MA, NO,NO2 under a novel algebraic condition that is strictly weaker than the conventional graph theoretic condition in cite NO . This unification also enables us to derive a new distributed optimization scheme.


Fast and Accurate Span based Semantic Role Labeling as Graph Parsing. Currently, BIO based and tuple based approaches perform quite well on the span based semantic role labeling (SRL) task. However, the BIO based approach usually needs to encode a sentence once for each predicate when predicting its arguments, and the tuple based approach has to deal with a huge search space of O(n 3) , greatly reducing the training and inference efficiency. The parsing speed is less than 50 sentences per second. Moreover, both BIO based and tuple based approaches usually consider only local structural information when making predictions. This paper proposes to cast end to end span based SRL as a graph parsing task. Based on a novel graph representation schema, we present a fast and accurate SRL parser on the shoulder of recent works on high order semantic dependency graph parsing. Moreover, we propose a constrained Viterbi procedure to ensure the legality of the output graph. Experiments on English CoNLL05 and CoNLL12 datasets show that our model achieves new state of the art results under both settings of without and with pre trained language models, and can parse over 600 sentences per second.


Distribution of Eigenvalues of Matrix Ensembles arising from Wigner and Palindromic Toeplitz Blocks. Random Matrix Theory (RMT) has successfully modeled diverse systems, from energy levels of heavy nuclei to zeros of L functions this correspondence has allowed RMT to successfully predict many number theoretic behaviors. However there are some operations which to date have no RMT analogue. Our motivation is to find an RMT analogue of Rankin Selberg convolution, which constructs a new L functions from an input pair. We report one such attempt while it does not appear to model convolution, it does create new ensembles with properties hybridizing those of its constituents. For definiteness we concentrate on the ensemble of palindromic real symmetric Toeplitz (PST) matrices and the ensemble of real symmetric matrices, whose limiting spectral measures are the Gaussian and semi circular distributions, respectively these were chosen as they are the two extreme cases in terms of moment calculations. For a PST matrix A and a real symmetric matrix B , we construct an ensemble of random real symmetric block matrices whose first row is lbrace A, B rbrace and whose second row is lbrace B, A rbrace . By Markov's Method of Moments and the use of free probability, we show this ensemble converges weakly and almost surely to a new, universal distribution with a hybrid of Gaussian and semi circular behaviors. We extend this construction by considering an iterated concatenation of matrices from an arbitrary pair of random real symmetric sub ensembles with different limiting spectral measures. We prove that finite iterations converge to new, universal distributions with hybrid behavior, and that infinite iterations converge to the limiting spectral measure of the dominant component matrix.


Rheology of immiscible two phase flow in mixed wet porous media Dynamic pore network model and capillary fiber bundle model results. Immiscible two phase flow in porous media with mixed wet conditions was examined using a capillary fiber bundle model, which is analytically solvable, and a dynamic pore network model. The mixed wettability was implemented in the models by allowing each tube or link to have a different wetting angle chosen randomly from a given distribution. Both models showed that mixed wettability can have significant influence on the rheology in terms of the dependence of the global volumetric flow rate on the global pressure drop. In the capillary fiber bundle model, for small pressure drops when only a small fraction of the tubes were open, it was found that the volumetric flow rate depended on the excess pressure drop as a power law with an exponent equal to 3 2 or 2 depending on the minimum pressure drop necessary for flow. When all the tubes were open due to a high pressure drop, the volumetric flow rate depended linearly on the pressure drop, independent of the wettability. In the transition region in between where most of the tubes opened, the volumetric flow depended more sensitively on the wetting angle distribution function and was in general not a simple power law. The dynamic pore network model results also showed a linear dependence of the flow rate on the pressure drop when the pressure drop is large. However, out of this limit the dynamic pore network model demonstrated a more complicated behaviour that depended on the mixed wettability condition and the saturation. In particular, the exponent relating volumetric flow rate to the excess pressure drop could take on values anywhere between 1.0 and 1.8. The values of the exponent were highest for saturations approaching 0.5, also, the exponent generally increased when the difference in wettability of the two fluids were larger and when this difference was present for a larger fraction of the porous network.


Unsupervised learning of text line segmentation by differentiating coarse patterns. Despite recent advances in the field of supervised deep learning for text line segmentation, unsupervised deep learning solutions are beginning to gain popularity. In this paper, we present an unsupervised deep learning method that embeds document image patches to a compact Euclidean space where distances correspond to a coarse text line pattern similarity. Once this space has been produced, text line segmentation can be easily implemented using standard techniques with the embedded feature vectors. To train the model, we extract random pairs of document image patches with the assumption that neighbour patches contain a similar coarse trend of text lines, whereas if one of them is rotated, they contain different coarse trends of text lines. Doing well on this task requires the model to learn to recognize the text lines and their salient parts. The benefit of our approach is zero manual labelling effort. We evaluate the method qualitatively and quantitatively on several variants of text line segmentation datasets to demonstrate its effectivity.


Cascadable all optical NAND gates using diffractive networks. Owing to its potential advantages such as scalability, low latency and power efficiency, optical computing has seen rapid advances over the last decades. A core unit of a potential all optical processor would be the NAND gate, which can be cascaded to perform an arbitrary logical operation. Here, we present the design and analysis of cascadable all optical NAND gates using diffractive neural networks. We encoded the logical values at the input and output planes of a diffractive NAND gate using the relative optical power of two spatially separated apertures. Based on this architecture, we numerically optimized the design of a diffractive neural network composed of 4 passive layers to all optically perform NAND operation using the diffraction of light, and cascaded these diffractive NAND gates to perform complex logical functions by successively feeding the output of one diffractive NAND gate into another. We demonstrated the cascadability of our diffractive NAND gates by using identical diffractive designs to all optically perform AND and OR operations, as well as a half adder. Cascadable all optical NAND gates composed of spatially engineered passive diffractive layers can serve as a core component of various optical computing platforms.


The refined local lifting problem for cyclic covers of order four. Suppose phi is a mathbb Z 4 cover of a curve over an algebraically closed field k of characteristic 2 , and phi 1 is its mathbb Z 2 sub cover. Suppose, moreover, that Phi 1 is a lift of phi 1 to a complete discrete valuation ring R that is a finite extension of the ring of Witt vectors W(k) (hence in characteristic zero). We show that there exists a finite extension R' of R , and a lift Phi of phi to R' with a sub cover isomorphic to Phi 1 otimes k R' . This gives a non trivial family of cyclic covers where Sa "idi's refined lifting conjecture holds.


ACTION Net Multipath Excitation for Action Recognition. Spatial temporal, channel wise, and motion patterns are three complementary and crucial types of information for video action recognition. Conventional 2D CNNs are computationally cheap but cannot catch temporal relationships 3D CNNs can achieve good performance but are computationally intensive. In this work, we tackle this dilemma by designing a generic and effective module that can be embedded into 2D CNNs. To this end, we propose a spAtio temporal, Channel and moTion excitatION (ACTION) module consisting of three paths Spatio Temporal Excitation (STE) path, Channel Excitation (CE) path, and Motion Excitation (ME) path. The STE path employs one channel 3D convolution to characterize spatio temporal representation. The CE path adaptively recalibrates channel wise feature responses by explicitly modeling interdependencies between channels in terms of the temporal aspect. The ME path calculates feature level temporal differences, which is then utilized to excite motion sensitive channels. We equip 2D CNNs with the proposed ACTION module to form a simple yet effective ACTION Net with very limited extra computational cost. ACTION Net is demonstrated by consistently outperforming 2D CNN counterparts on three backbones (i.e., ResNet 50, MobileNet V2 and BNInception) employing three datasets (i.e., Something Something V2, Jester, and EgoGesture). Codes are available at url https github.com V Sense ACTION Net .


A Survey on The Eisenbud Green Harris Conjecture. The Eisenbud Green Harris (EGH) conjecture offers a generalization of the famous Macaulay's theorem about the Hilbert functions of homogeneous ideals in a polynomial ring K x 1, ldots, x n . In this survey paper, we provide a good compilation of results on the EGH conjecture that have been obtained so far. We discuss these results in terms of their approaches.


Memory based Deep Reinforcement Learning for POMDPs. A promising characteristic of Deep Reinforcement Learning (DRL) is its capability to learn optimal policy in an end to end manner without relying on feature engineering. However, most approaches assume a fully observable state space, i.e. fully observable Markov Decision Processes (MDPs). In real world robotics, this assumption is unpractical, because of issues such as sensor sensitivity limitations and sensor noise, and the lack of knowledge about whether the observation design is complete or not. These scenarios lead to Partially Observable MDPs (POMDPs). In this paper, we propose Long Short Term Memory based Twin Delayed Deep Deterministic Policy Gradient (LSTM TD3) by introducing a memory component to TD3, and compare its performance with other DRL algorithms in both MDPs and POMDPs. Our results demonstrate the significant advantages of the memory component in addressing POMDPs, including the ability to handle missing and noisy observation data.