Task Oriented Image Transmission for Scene Classification in Unmanned Aerial Systems. The vigorous developments of Internet of Things make it possible to extend its computing and storage capabilities to computing tasks in the aerial system with collaboration of cloud and edge, especially for artificial intelligence (AI) tasks based on deep learning (DL). Collecting a large amount of image video data, Unmanned aerial vehicles (UAVs) can only handover intelligent analysis tasks to the back end mobile edge computing (MEC) server due to their limited storage and computing capabilities. How to efficiently transmit the most correlated information for the AI model is a challenging topic. Inspired by the task oriented communication in recent years, we propose a new aerial image transmission paradigm for the scene classification task. A lightweight model is developed on the front end UAV for semantic blocks transmission with perception of images and channel conditions. In order to achieve the tradeoff between transmission latency and classification accuracy, deep reinforcement learning (DRL) is used to explore the semantic blocks which have the best contribution to the back end classifier under various channel conditions. Experimental results show that the proposed method can significantly improve classification accuracy compared to the fixed transmission strategy and traditional content perception methods.


One way communication complexity and non adaptive decision trees. We study the relationship between various one way communication complexity measures of a composed function with the analogous decision tree complexity of the outer function. We consider two gadgets the AND function on 2 inputs, and the Inner Product on a constant number of inputs. Let IP denote Inner Product on 2b bits. If f is a total Boolean function that depends on all of its inputs, the bounded error one way quantum communication complexity of f circ IP equals Omega(n(b 1)) . If f is a partial Boolean function, the deterministic one way communication complexity of f circ IP is at least Omega(b cdot D dt rightarrow (f)) , where D dt rightarrow (f) denotes the non adaptive decision tree complexity of f . Montanaro and Osborne arXiv'09 observed that the deterministic one way communication complexity of f circ XOR 2 equals the non adaptive parity decision tree complexity of f . In contrast, we show the following with the gadget AND 2 . There exists a function for which even the quantum non adaptive AND decision tree complexity of f is exponentially large in the deterministic one way communication complexity of f circ AND 2 . For symmetric functions f , the non adaptive AND decision tree complexity of f is at most quadratic in the (even two way) communication complexity of f circ AND 2 . In view of the first point, a lower bound on non adaptive AND decision tree complexity of f does not lift to a lower bound on one way communication complexity of f circ AND 2 . In our final result we show that for all f , the deterministic one way communication complexity of F f circ AND 2 is at most (rank(M F ))(1 Omega(1)) , where M F denotes the communication matrix of F . This shows that the rank upper bound on one way communication complexity (which can be tight in general) is not tight for AND composed functions.


Polynomial delay algorithm for minimal chordal completions. Motivated by the problem of enumerating all tree decompositions of a graph, we consider in this article the problem of listing all the minimal chordal completions of a graph. In cite carmeli2020 ( textsc Pods 2017 ) Carmeli emph et al. proved that all minimal chordal completions or equivalently all proper tree decompositions of a graph can be listed in incremental polynomial time using exponential space. The total running time of their algorithm is quadratic in the number of solutions and the existence of an algorithm whose complexity depends only linearly on the number of solutions remained open. We close this question by providing a polynomial delay algorithm to solve this problem which, moreover, uses polynomial space. Our algorithm relies on emph Proximity Search , a framework recently introduced by Conte emph et al. cite conte uno2019 ( textsc Stoc 2019 ) which has been shown powerful to obtain polynomial delay algorithms, but generally requires exponential space. In order to obtain a polynomial space algorithm for our problem, we introduce a new general method called emph canonical path reconstruction to design polynomial delay and polynomial space algorithms based on proximity search.


Intra Day Price Simulation with Generative Adversarial Modelling of the Order Flow. Intra day price variations in financial markets are driven by the sequence of orders, called the order flow, that is submitted at high frequency by traders. This paper introduces a novel application of the Sequence Generative Adversarial Networks framework to model the order flow, such that random sequences of the order flow can then be generated to simulate the intra day variation of prices. As a benchmark, a well known parametric model from the quantitative finance literature is selected. The models are fitted, and then multiple random paths of the order flow sequences are sampled from each model. Model performances are then evaluated by using the generated sequences to simulate price variations, and we compare the empirical regularities between the price variations produced by the generated and real sequences. The empirical regularities considered include the distribution of the price log returns, the price volatility, and the heavy tail of the log returns distributions. The results show that the order sequences from the generative model are better able to reproduce the statistical behaviour of real price variations than the sequences from the benchmark.


Theory and Analysis of Optimal Planning over Long and Infinite Horizons for Achieving Independent Partially Observable Tasks that Evolve over Time. We present the theoretical analysis and proofs of a recently developed algorithm that allows for optimal planning over long and infinite horizons for achieving multiple independent tasks that are partially observable and evolve over time.


MetaSys A Practical Open Source Metadata Management System to Implement and Evaluate Cross Layer Optimizations. This paper introduces the first open source FPGA based infrastructure, MetaSys, with a prototype in a RISC V core, to enable the rapid implementation and evaluation of a wide range of cross layer techniques in real hardware. Hardware software cooperative techniques are powerful approaches to improve the performance, quality of service, and security of general purpose processors. They are however typically challenging to rapidly implement and evaluate in real hardware as they require full stack changes to the hardware, OS, system software, and instruction set architecture (ISA). MetaSys implements a rich hardware software interface and lightweight metadata support that can be used as a common basis to rapidly implement and evaluate new cross layer techniques. We demonstrate MetaSys's versatility and ease of use by implementing and evaluating three cross layer techniques for (i) prefetching for graph analytics (ii) bounds checking in memory unsafe languages, and (iii) return address protection in stack frames each technique only requiring 100 lines of Chisel code over MetaSys. Using MetaSys, we perform the first detailed experimental study to quantify the performance overheads of using a single metadata management system to enable multiple cross layer optimizations in CPUs. We identify the key sources of bottlenecks and system inefficiency of a general metadata management system. We design MetaSys to minimize these inefficiencies and provide increased versatility compared to previously proposed metadata systems. Using three use cases and a detailed characterization, we demonstrate that a common metadata management system can be used to efficiently support diverse cross layer techniques in CPUs.


Projective representation theory for compact quantum groups and the quantum Baum Connes assembly map. We study the theory of projective representations for a compact quantum group mathbb G , i.e. actions of mathbb G on mathcal B (H) for some Hilbert space H . We show that any such projective representation is inner, and is hence induced by an Omega twisted representation for some unitary measurable 2 cocycle Omega on mathbb G . We show that a projective representation is continuous, i.e. restricts to an action on the compact operators mathcal K (H) , if and only if the associated 2 cocycle is regular, and that this condition is automatically satisfied if mathbb G is of Kac type. This allows in particular to characterise the torsion of projective type of widehat mathbb G in terms of the projective representation theory of mathbb G . For a given regular unitary 2 cocycle Omega , we then study Omega twisted actions on C algebras. We define deformed crossed products with respect to Omega , obtaining a twisted version of the Baaj Skandalis duality and a quantum version of the Packer Raeburn's trick. As an application, we provide a twisted version of the Green Julg isomorphism and obtain the quantum Baum Connes assembly map for permutation torsion free discrete quantum groups.


GAVIN Gaze Assisted Voice Based Implicit Note taking. Annotation is an effective reading strategy people often undertake while interacting with digital text. It involves highlighting pieces of text and making notes about them. Annotating while reading in a desktop environment is considered trivial but, in a mobile setting where people read while hand holding devices, the task of highlighting and typing notes on a mobile display is challenging. In this paper, we introduce GAVIN, a gaze assisted voice note taking application, which enables readers to seamlessly take voice notes on digital documents by implicitly anchoring them to text passages. We first conducted a contextual enquiry focusing on participants' note taking practices on digital documents. Using these findings, we propose a method which leverages eye tracking and machine learning techniques to annotate voice notes with reference text passages. To evaluate our approach, we recruited 32 participants performing voice note taking. Following, we trained a classifier on the data collected to predict text passage where participants made voice notes. Lastly, we employed the classifier to built GAVIN and conducted a user study to demonstrate the feasibility of the system. This research demonstrates the feasibility of using gaze as a resource for implicit anchoring of voice notes, enabling the design of systems that allow users to record voice notes with minimal effort and high accuracy.


An unstructured C grid type variational formulation for the sea ice dynamics. Historically, B grid formulations of sea ice dynamics have been dominant because they have matched the grid type used by ocean models. The reason for the grid match is simple it facilitates penetration of the curl of ice ocean stress into the deep ocean with minimal numerical diffusivity because sea ice and ocean velocity are co located. In recent years, as ocean models have increasingly progressed to C grids, sea ice models have followed suit on quadrilateral meshes, but few if any implementations of unstructured C grid sea ice models have been developed. We present an unstructured C grid formulation of the elastic viscous plastic rheology, where the velocity unknowns are located at the edges rather than at the vertices, as in the B grid. The mesh cells in our analysis have n sides, with n greater than or equal to four. Numerical results are also included to investigate the features of the proposed method. Our framework of choice is the Model for Prediction Across Scales (MPAS) within E3SM, the climate model of the U.S. Department of Energy, although our approach is general and could be applied to other models as well. While MPAS Seaice is currently defined on a B grid, MPAS Ocean runs on a C grid, hence interpolation operators are heavily used when coupled simulations are performed. The discretization introduced here aims at transitioning the dynamics of MPAS Seaice to a C grid, in order to ultimately facilitate the coupling with MPAS Ocean and reduce numerical errors associated with this communication.


Minimum degree conditions for containing an r regular r connected subgraph. We study optimal minimum degree conditions when an n vertex graph G contains an r regular r connected subgraph. We prove for r fixed and n large the condition to be delta(G) ge frac n r 2 2 when nr equiv 0 pmod 2 . This answers a question of M. Kriesell.


Superconducting Nanowire Single Photon Detector (SNSPD) with 3D Printed Free Form Microlenses. We present an approach to increase the effective light receiving area of superconducting nanowire single photon detectors (SNSPD) by means of free form microlenses that are printed in situ on top of the sensitive detector area using high resolution multi photon lithography. We demonstrate a detector based on a niobium nitride (NbN) nanowire with a 4.5 mathrm mu m times 4.5 mathrm mu m sensitive area, supplemented with a lens of 60 mathrm mu m diameter. For free space illumination at a wavelength of 1550 nm, the lensed sensor has a 100 fold increased effective collection area, which leads to strongly enhanced system detection efficiency without the need for long nanowires. Our approach can be readily applied to a wide range of sensor types and effectively overcomes the inherent design conflict between high counting speed due to short sensor reset time, high timing accuracy, and high fabrication yield on the one hand and high collection efficiency through large effective detection areas on the other hand.


Stability over cDV singularities and other complete local rings. We characterise subcategories of semistable modules for noncommutative minimal models of compound Du Val singularities, including the non isolated case. We find that the stability is controlled by an infinite polyhedral fan that stems from silting theory, and which can be computed from the Dynkin diagram combinatorics of the minimal models found in the work of Iyama Wemyss. In the isolated case, we moreover find an explicit description of the deformation theory of the stable modules in terms of factors of the endomorphism algebras of 2 term tilting complexes. To obtain these results we generalise a correspondence between 2 term silting theory and stability, which is known to hold for finite dimensional algebras, to the much broader setting of algebras over a complete local Noetherian base ring.


A longitudinal analysis of students' motivational characteristics in introductory physics courses Gender differences. The lack of diversity and the under performance of underrepresented students in STEM courses have been the focus of researchers in the last decade. In particular, many hypotheses have been put forth for the reasons for the under representation and under performance of women in physics. Here, we present a framework for helping all students learn in science courses that takes into account four factors 1) characteristics of instruction and learning tools, 2) implementation of instruction and learning tools, 3) student characteristics, and 4) students' environments. While there has been much research on factor 1 (characteristics of instruction and learning tools), there has been less focus on factor 2 (students' characteristics, and in particular, motivational factors). Here, we focus on the baseline motivational characteristics of introductory physics students obtained from survey data to inform factor 2 of the framework. A longitudinal analysis of students' motivational characteristics in two semester introductory physics courses was performed by administering pre and post surveys that evaluated students' self efficacy, grit, fascination with physics, value associated with physics, intelligence mindset, and physics epistemology. Female students reported lower self efficacy, fascination and value, and had a more "fixed" view of intelligence in the context of physics compared to male students. Grit was the only factor on which female students reported averages that were equal to or higher than male students throughout introductory physics courses. These gender differences can at least partly be attributed to the societal stereotypes and biases about who belongs in physics and can excel in it. The findings inform the framework and have implications for the development and implementation of effective pedagogies and learning tools to help all students learn.


LogAvgExp Provides a Principled and Performant Global Pooling Operator. We seek to improve the pooling operation in neural networks, by applying a more theoretically justified operator. We demonstrate that LogSumExp provides a natural OR operator for logits. When one corrects for the number of elements inside the pooling operator, this becomes text LogAvgExp log( text mean ( exp(x))) . By introducing a single temperature parameter, LogAvgExp smoothly transitions from the max of its operands to the mean (found at the limiting cases t to 0 and t to infty ). We experimentally tested LogAvgExp, both with and without a learnable temperature parameter, in a variety of deep neural network architectures for computer vision.


The b symbol weight hierarchy of the Kasami codes. The symbol pair read channel was first proposed by Cassuto and Blaum. Later, Yaakobi et al. generalized it to the b symbol read channel. It is motivated by the limitations of the reading process in high density data storage systems. One main task in b symbol coding theory is to determine the b symbol weight hierarchy of codes. In this paper, we study the b symbol weight hierarchy of the Kasami codes, which are well known for their applications to construct sequences with optimal correlation magnitudes. The complete symbol pair weight distribution of the Kasami codes is determined.


Adams operations on twisted K theory of compact Lie groups. In this paper, extending the results in cite F , we compute Adams operations on twisted K theory of connected, simply connected and simple compact Lie groups G , in both equivariant and nonequivariant settings. Along the way, we also obtain the K theory of G with a twist corresponding to an integer less than the dual Coxeter number, thereby supplementing the Freed Hopkins Teleman Theorem.


On exact discretization of the L 2 norm with a negative weight. For a subspace X of functions from L 2 we consider the minimal number m of nodes necessary for the exact discretization of the L 2 norm of the functions in X . We construct a subspace such that for any exact discretization with m nodes there is at least one negative weight.


Non Parametric Analysis of Non Equilibrium Simulations. We extend the non parametric framework of reaction coordinate optimization to non equilibrium ensembles of (short) trajectories. For example, we show how, starting from such an ensemble, one can obtain an equilibrium free energy profile along the committor, which can be used to determine important properties of the dynamics exactly. New adaptive sampling approach, the transition state ensemble enrichment, is suggested, which samples the configuration space by "growing" committor segments towards each other starting from the boundary states. This framework is suggested as a general tool, alternative to the Markov state models, for a rigorous and accurate analysis of simulations of large biomolecular systems, as it has the following attractive properties. It is immune to the curse of dimensionality, it does not require system specific information, it can approximate arbitrary reaction coordinates with high accuracy and it has sensitive and rigorous criteria to test optimality and convergence. The approaches are illustrated on a 50 dimensional model system and a realistic protein folding trajectory.


A Hierarchy of Network Models Giving Bistability Under Triadic Closure. Triadic closure describes the tendency for new friendships to form between individuals who already have friends in common. It has been argued heuristically that the triadic closure effect can lead to bistability in the formation of large scale social interaction networks. Here, depending on the initial state and the transient dynamics, the system may evolve towards either of two long time states. In this work, we propose and study a hierarchy of network evolution models that incorporate triadic closure, building on the work of Grindrod, Higham, and Parsons Internet Mathematics, 8, 2012, 402 423 . We use a chemical kinetics framework, paying careful attention to the reaction rate scaling with respect to the system size. In a macroscale regime, we show rigorously that a bimodal steady state distribution is admitted. This behavior corresponds to the existence of two distinct stable fixed points in a deterministic mean field ODE. The macroscale model is also seen to capture an apparent metastability property of the microscale system. Computational simulations are used to support the analysis.


Isotropy subgroups of some almost rigid domains. In this paper, we study the isotropy subgroups of some almost rigid domains and give necessary and sufficient conditions for an automorphism to be in the isotropy subgroup.


Graph based Motion Planning for Automated Vehicles using Multi model Branching and Admissible Heuristics. Automated driving in urban scenarios requires efficient planning algorithms able to handle complex situations in real time. A popular approach is to use graph based planning methods in order to obtain a rough trajectory which is subsequently optimized. A key aspect is the generation of trajectories implementing comfortable and safe behavior already during graph search while keeping computation times low. To capture this aspect, on the one hand, a branching strategy is presented in this work that leads to better performance in terms of quality of resulting trajectories and runtime. On the other hand, admissible heuristics are shown which guide the graph search efficiently, where the solution remains optimal.


On the convergence rate of Bergman metrics. We study the convergence rate of Bergman metrics on the class of polarized pointed K "ahler n manifolds (M,L,g,x) with mathrm Vol left( B 1 (x) right) v and sec leq K on M . Relying on Tian's peak section method Tian, 1990 , we show that the C 1, alpha convergence of Bergman metrics is uniform. At the end we discuss the sharpness of our estimates.


Verifying Compliance in Process Choreographies Foundations, Algorithms, and Implementation. The current push towards interoperability drives companies to collaborate through process choreographies. At the same time, they face a jungle of continuously changing regulations, e.g., due to the pandemic and developments such as the BREXIT, which strongly affect cross organizational collaborations. Think of, for example, supply chains spanning several countries with different and maybe even conflicting COVID19 traveling restrictions. Hence, providing automatic compliance verification in process choreographies is crucial for any cross organizational business process. A particular challenge concerns the restricted visibility of the partner processes at the presence of global compliance rules (GCR), i.e., rules that span across the process of several partners. This work deals with the question how to verify global compliance if affected tasks are not fully visible. Our idea is to decompose GCRs into so called assertions that can be checked by each affected partner whereby the decomposition is both correct and lossless. The algorithm exploits transitivity properties of the underlying rule specification, and its correctness and complexity are proven, considering advanced aspects such as loops. The algorithm is implemented in a proof of concept prototype, including a model checker for verifying compliance. The applicability of the approach is further demonstrated on a real world manufacturing use case.


PyHard a novel tool for generating hardness embeddings to support data centric analysis. For building successful Machine Learning (ML) systems, it is imperative to have high quality data and well tuned learning models. But how can one assess the quality of a given dataset? And how can the strengths and weaknesses of a model on a dataset be revealed? Our new tool PyHard employs a methodology known as Instance Space Analysis (ISA) to produce a hardness embedding of a dataset relating the predictive performance of multiple ML models to estimated instance hardness meta features. This space is built so that observations are distributed linearly regarding how hard they are to classify. The user can visually interact with this embedding in multiple ways and obtain useful insights about data and algorithmic performance along the individual observations of the dataset. We show in a COVID prognosis dataset how this analysis supported the identification of pockets of hard observations that challenge ML models and are therefore worth closer inspection, and the delineation of regions of strengths and weaknesses of ML models.


Towards Energy Efficient Federated Learning over 5G Mobile Devices. The continuous convergence of machine learning algorithms, 5G and beyond (5G ) wireless communications, and artificial intelligence (AI) hardware implementation hastens the birth of federated learning (FL) over 5G mobile devices, which pushes AI functions to mobile devices and initiates a new era of on device AI applications. Despite the remarkable progress made in FL, huge energy consumption is one of the most significant obstacles restricting the development of FL over battery constrained 5G mobile devices. To address this issue, in this paper, we investigate how to develop energy efficient FL over 5G mobile devices by making a trade off between energy consumption for "working" (i.e., local computing) and that for "talking" (i.e., wireless communications) in order to boost the overall energy efficiency. Specifically, we first examine energy consumption models for graphics processing unit (GPU) computation and wireless transmissions. Then, we overview the state of the art of integrating FL procedure with energy efficient learning techniques (e.g., gradient sparsification, weight quantization, pruning, etc.). Finally, we present several potential future research directions for FL over 5G mobile devices from the perspective of energy efficiency.


Deterministic Guided LiDAR Depth Map Completion. Accurate dense depth estimation is crucial for autonomous vehicles to analyze their environment. This paper presents a non deep learning based approach to densify a sparse LiDAR based depth map using a guidance RGB image. To achieve this goal the RGB image is at first cleared from most of the camera LiDAR misalignment artifacts. Afterward, it is over segmented and a plane for each superpixel is approximated. In the case a superpixel is not well represented by a plane, a plane is approximated for a convex hull of the most inlier. Finally, the pinhole camera model is used for the interpolation process and the remaining areas are interpolated. The evaluation of this work is executed using the KITTI depth completion benchmark, which validates the proposed work and shows that it outperforms the state of the art non deep learning based methods, in addition to several deep learning based methods.


Improved Lower Bounds for Strongly Separable Matrices and Related Combinatorial Structures. In nonadaptive group testing, the main research objective is to design an efficient algorithm to identify a set of up to t positive elements among n samples with as few tests as possible. Disjunct matrices and separable matrices are two classical combinatorial structures while one provides a more efficient decoding algorithm and the other needs fewer tests, i.e., larger rate. Recently, a notion of strongly separable matrix has been introduced, which has the same identifying ability as a disjunct matrix, but has larger rate. In this paper, we use a modified probabilistic method to improve the lower bounds for the rate of strongly separable matrices. Using this method, we also improve the lower bounds for some well known combinatorial structures, including locally thin set families and cancellative set families.


Cayley Abels graphs and invariants of totally disconnected, locally compact groups. A connected, locally finite graph Gamma is a Cayley Abels graph for a totally disconnected, locally compact group G if G acts vertex transitively with compact, open vertex stabilizers on Gamma . Define the minimal degree of G as the minimal degree of a Cayley Abels graph of G . We relate the minimal degree in various ways to the modular function, the scale function and the structure of compact open subgroups. As an application, we prove that if T d denotes the d regular tree, then the minimal degree of rm Aut (T d) is d for all d geq 2 .


Different Applications and Technologies of Internet of Things (IoT). Internet of things (IoT) has significantly altered the traditional lifestyle to a highly technologically advanced society. Some of the significant transformations that have been achieved through IoT are smart homes, smart transportation, smart city, and control of pollution. A considerable number of studies have been conducted and continue to be done to increase the use of technology through IoT. Furthermore, the research about IoT has not been done fully in improving the application of technology through IoT. Besides, IoT experiences several problems that need to be considered in order to get the full capability of IoT in changing society. This research paper addresses the key applications of IoT, the architecture of IoT, and the key issues affecting IoT. In addition, the paper highlights how big data analytics is essential in improving the effectiveness of IoT in various applications within society.


The Differential Equations of Gravity free Double Pendulum Lauricella Hypergeometric Solutions and Their Inversion. This paper solves in closed form the system of ODEs ruling the 2D motion of a gravity free double pendulum (GFDP), not subjected to any force. In such a way its movement is governed by the initial conditions only. The relevant strongly non linear ODEs have been put back to hyperelliptic quadratures which, through the Integral Representation Theorem (IRT), are driven to the Lauricella hypergeometric functions. We compute time laws and trajectories of both point masses forming the GFDP in explicit closed form. Suitable sample problems are carried out in order to prove the method effectiveness.


Bathymetry and friction estimation from transient velocity data for 1D shallow water flows in open channels with varying width. The shallow water equations (SWE) model a variety of geophysical flows. Flows in channels with rectangular cross sections may be modelled with a simplified one dimensional SWE with varying width. Among other model parameters, information about the bathymetry and friction coefficient is needed for the correct and precise prediction of the flow. Although synthetic values of the model parameters may suffice for testing numerical schemes, approximations of the bathymetry and other parameters may be required for applications. Estimations may be obtained by experimental methods but some of those techniques may be expensive, time consuming, and not always available. In this work, we propose to solve the inverse problem to estimate the bathymetry and the Manning's friction coefficient from transient velocity data. This is done with the aid of a cost functional which includes the SWE through Lagrange multipliers. The solution is obtained by solving the constrained optimization problem by a continuous descent method. The direct and the adjoint problems are both solved numerically using a second order accurate Roe type upwind scheme. Numerical tests are included to show the merits of the algorithm.


Hierarchical Quantized Federated Learning Convergence Analysis and System Design. Federated learning is a collaborative machine learning framework to train deep neural networks without accessing clients' private data. Previous works assume one central parameter server either at the cloud or at the edge. A cloud server can aggregate knowledge from all participating clients but suffers high communication overhead and latency, while an edge server enjoys more efficient communications during model update but can only reach a limited number of clients. This paper exploits the advantages of both cloud and edge servers and considers a Hierarchical Quantized Federated Learning (HQFL) system with one cloud server, several edge servers and many clients, adopting a communication efficient training algorithm, Hier Local QSGD. The high communication efficiency comes from frequent local aggregations at the edge servers and fewer aggregations at the cloud server, as well as weight quantization during model uploading. A tight convergence bound for non convex objective loss functions is derived, which is then applied to investigate two design problems, namely, the accuracy latency trade off and edge client association. It will be shown that given a latency budget for the whole training process, there is an optimal parameter choice with respect to the two aggregation intervals and two quantization levels. For the edge client association problem, it is found that the edge client association strategy has no impact on the convergence speed. Empirical simulations shall verify the findings from the convergence analysis and demonstrate the accuracy latency trade off in the hierarchical federated learning system.


Simulation of Reflected Brownian motion on two dimensional wedges. We study a correlated Brownian motion in two dimensions, which is reflected, stopped or killed in a wedge represented as the intersection of two half spaces. First, we provide explicit density formulas, hinted by the method of images. These explicit expressions rely on infinite oscillating sums of Bessel functions and may demand computationally costly procedures. We propose suitable recursive algorithms for the simulation of the laws of reflected and stopped Brownian motion which are based on generalizations of the reflection principle in two dimensions. We study and give bounds for the complexity of the proposed algorithms.


Transmission Dynamics of COVID 19 Pandemic Non pharmaceutical Interventions and Vaccination. Non pharmaceutical interventions(NPIs) play an important role in the early stage control of COVID 19 pandemic. Vaccination is considered to be the inevitable course to stop the spread of SARS CoV 2. Based on the mechanism, a SVEIR COVID 19 model with vaccination and NPIs is proposed. By means of the basic reproduction number R 0 , it is shown that the disease free equilibrium is globally attractive if mathscr R 0 1 , and COVID 19 is uniform persistence if mathscr R 0 1 . Taking Indian dates for example in the numerical simulation, we find that our dynamical results fits well with the statistical dates. Consequently, we forecast the spreading trend of COVID 19 pandemic in India. Furthermore, our results imply that improving the intensity of NPIs will greatly reduce the number of confirmed cases. Especially, NPIs are indispensable even if all the people were vaccinated when the efficiency of vaccine is relatively low. By simulating the relation ships of the basic reproduction number mathscr R 0 , the vaccination rate and the efficiency of vaccine, we find that it is impossible to achieve the herd immunity without NPIs when the efficiency of vaccine is lower than 76.9 . Therefore, the herd immunity area is defined by the evolution of relationships between the vaccination rate and the efficiency of vaccine. In the study of two patchy, we give the conditions for India and China to be open to navigation. Furthermore, an appropriate dispersal of population between India and China is obtained. A discussion completes the paper.


Higher limits over the fusion orbit category. The fusion orbit category overline mathcal F mathcal C (G) of a discrete group G over a collection mathcal C is the category whose objects are the subgroups H in mathcal C , and whose morphisms H to K are given by the G maps G H to G K modulo the action of the centralizer group C G(H) . We show that the higher limits over overline mathcal F mathcal C (G) can be computed using the hypercohomology spectral sequences coming from the Dwyer G spaces for centralizer and normalizer decompositions for G . If G is the discrete group realizing a saturated fusion system mathcal F , then these hypercohomology spectral sequences give two spectral sequences that converge to the cohomology of the centric orbit category mathcal O c ( mathcal F) . This allows us to apply our results to the sharpness problem for the subgroup decomposition of a p local finite group. We prove that the subgroup decomposition for every p local finite group is sharp (over mathcal F centric subgroups) if it is sharp for every p local finite group with nontrivial center. We also show that for every p local finite group (S, mathcal F, mathcal L) , the subgroup decomposition is sharp if and only if the normalizer decomposition is sharp.


Informed Machine Learning for Improved Similarity Assessment in Process Oriented Case Based Reasoning. Currently, Deep Learning (DL) components within a Case Based Reasoning (CBR) application often lack the comprehensive integration of available domain knowledge. The trend within machine learning towards so called Informed machine learning can help to overcome this limitation. In this paper, we therefore investigate the potential of integrating domain knowledge into Graph Neural Networks (GNNs) that are used for similarity assessment between semantic graphs within process oriented CBR applications. We integrate knowledge in two ways First, a special data representation and processing method is used that encodes structural knowledge about the semantic annotations of each graph node and edge. Second, the message passing component of the GNNs is constrained by knowledge on legal node mappings. The evaluation examines the quality and training time of the extended GNNs, compared to the stock models. The results show that both extensions are capable of providing better quality, shorter training times, or in some configurations both advantages at once.


Linkage of Sets of Cyclic Algebras. Let p be a prime integer and F the function field in two algebraically independent variables over a smaller field F 0 . We prove that if operatorname char (F 0) p geq 3 then there exist p 2 1 cyclic algebras of degree p over F that have no maximal subfield in common, and if operatorname char (F 0) 0 then there exist p 2 cyclic algebras of degree p over F that have no maximal subfield in common.


Standard Generators of Finite Fields and their Cyclic Subgroups. We define standardized constructions of finite fields, and standardized generators of (multiplicative) cyclic subgroups in these fields. The motivation is to provide a substitute for Conway polynomials which can be used by various software packages and in collections of mathematical data which involve finite fields.


Vision Transformer Hashing for Image Retrieval. Deep learning has shown a tremendous growth in hashing techniques for image retrieval. Recently, Transformer has emerged as a new architecture by utilizing self attention without convolution. Transformer is also extended to Vision Transformer (ViT) for the visual recognition with a promising performance on ImageNet. In this paper, we propose a Vision Transformer based Hashing (VTS) for image retrieval. We utilize the pre trained ViT on ImageNet as the backbone network and add the hashing head. The proposed VTS model is fine tuned for hashing under six different image retrieval frameworks, including Deep Supervised Hashing (DSH), HashNet, GreedyHash, Improved Deep Hashing Network (IDHN), Deep Polarized Network (DPN) and Central Similarity Quantization (CSQ) with their objective functions. We perform the extensive experiments on CIFAR10, ImageNet, NUS Wide, and COCO datasets. The proposed VTS based image retrieval outperforms the recent state of the art hashing techniques with a great margin. We also find the proposed VTS model as the backbone network is better than the existing networks, such as AlexNet and ResNet. The code is released at url https github.com shivram1987 VisionTransformerHashing .


Existence of minimizers and convergence of critical points for a new Landau de Gennes energy functional in nematic liquid crystals. The Landau de Gennes energy in nematic liquid crystals depends on four elastic constants L 1 , L 2 , L 3 , L 4 . In the case of L 4 neq 0 , Ball Majumdar cite BM found an example that the original Landau de Gennes energy functional in physics does not satisfy a coercivity condition, which causes a problem in mathematics to establish existence of energy minimizers. At first, we introduce a new Landau de Gennes energy density with L 4 neq 0 , which satisfies the coercivity condition for all Q tensors and keeps most physical quantities of the original Landau de Gennes density. Secondly, we prove that solutions of the Landau de Gennes system can approach a solution of the Q tensor Oseen Frank system without using energy minimizers. Thirdly, we develop a new approach to generalize Nguyen Zarnescu's converging result in cite NZ to the case of nonzero elastic constants L 2 , L 3 , L 4 .


Toward Compact Parameter Representations for Architecture Agnostic Neural Network Compression. This paper investigates deep neural network (DNN) compression from the perspective of compactly representing and storing trained parameters. We explore the previously overlooked opportunity of cross layer architecture agnostic representation sharing for DNN parameters. To do this, we decouple feedforward parameters from DNN architectures and leverage additive quantization, an extreme lossy compression method invented for image descriptors, to compactly represent the parameters. The representations are then finetuned on task objectives to improve task accuracy. We conduct extensive experiments on MobileNet v2, VGG 11, ResNet 50, Feature Pyramid Networks, and pruned DNNs trained for classification, detection, and segmentation tasks. The conceptually simple scheme consistently outperforms iterative unstructured pruning. Applied to ResNet 50 with 76.1 top 1 accuracy on the ILSVRC12 classification challenge, it achieves a 7.2 times compression ratio with no accuracy loss and a 15.3 times compression ratio at 74.79 accuracy. Further analyses suggest that representation sharing can frequently happen across network layers and that learning shared representations for an entire DNN can achieve better accuracy at the same compression ratio than compressing the model as multiple separate parts. We release PyTorch code to facilitate DNN deployment on resource constrained devices and spur future research on efficient representations and storage of DNN parameters.


Broaden the Vision Geo Diverse Visual Commonsense Reasoning. Commonsense is defined as the knowledge that is shared by everyone. However, certain types of commonsense knowledge are correlated with culture and geographic locations and they are only shared locally. For example, the scenarios of wedding ceremonies vary across regions due to different customs influenced by historical and religious factors. Such regional characteristics, however, are generally omitted in prior work. In this paper, we construct a Geo Diverse Visual Commonsense Reasoning dataset (GD VCR) to test vision and language models' ability to understand cultural and geo location specific commonsense. In particular, we study two state of the art Vision and Language models, VisualBERT and ViLBERT trained on VCR, a standard multimodal commonsense benchmark with images primarily from Western regions. We then evaluate how well the trained models can generalize to answering the questions in GD VCR. We find that the performance of both models for non Western regions including East Asia, South Asia, and Africa is significantly lower than that for Western region. We analyze the reasons behind the performance disparity and find that the performance gap is larger on QA pairs that 1) are concerned with culture related scenarios, e.g., weddings, religious activities, and festivals 2) require high level geo diverse commonsense reasoning rather than low order perception and recognition. Dataset and code are released at https github.com WadeYin9712 GD VCR.


Notes on an Elementary Proof for the Stability of Persistence Diagrams. These notes are a self contained short proof of the stability of persistence diagrams.


MURAL An Unsupervised Random Forest Based Embedding for Electronic Health Record Data. A major challenge in embedding or visualizing clinical patient data is the heterogeneity of variable types including continuous lab values, categorical diagnostic codes, as well as missing or incomplete data. In particular, in EHR data, some variables are em missing not at random (MNAR) but deliberately not collected and thus are a source of information. For example, lab tests may be deemed necessary for some patients on the basis of suspected diagnosis, but not for others. Here we present the MURAL forest an unsupervised random forest for representing data with disparate variable types (e.g., categorical, continuous, MNAR). MURAL forests consist of a set of decision trees where node splitting variables are chosen at random, such that the marginal entropy of all other variables is minimized by the split. This allows us to also split on MNAR variables and discrete variables in a way that is consistent with the continuous variables. The end goal is to learn the MURAL embedding of patients using average tree distances between those patients. These distances can be fed to nonlinear dimensionality reduction method like PHATE to derive visualizable embeddings. While such methods are ubiquitous in continuous valued datasets (like single cell RNA sequencing) they have not been used extensively in mixed variable data. We showcase the use of our method on one artificial and two clinical datasets. We show that using our approach, we can visualize and classify data more accurately than competing approaches. Finally, we show that MURAL can also be used to compare cohorts of patients via the recently proposed tree sliced Wasserstein distances.


Notarial timestamps savings in logs management via Merkle trees and Key Derivation Functions. Nowadays log files handling imposes to ISPs (intended in their widest scope) strict normative duties apart from common technological issues. This work analyses how retention time policies and timestamping are deeply interlinked from the point of view of service providers, possibly leading to costs rise. A new schema is proposed trying to mitigate the need for third party suppliers, enforcing cryptographic primitives well established in other fields of Information Technology but perhaps not yet widespread in logs management. The foundations of timestamping are recapped, and properties of cryptographic primitives introduced as a natural way to bypass legacy schema inefficiency and as an extra level of protection these choices are justified by savings estimation (with regard to different ISP magnitudes) and by some basic security considerations.


Sequential Learning on Liver Tumor Boundary Semantics and Prognostic Biomarker Mining. The boundary of tumors (hepatocellular carcinoma, or HCC) contains rich semantics capsular invasion, visibility, smoothness, folding and protuberance, etc. Capsular invasion on tumor boundary has proven to be clinically correlated with the prognostic indicator, microvascular invasion (MVI). Investigating tumor boundary semantics has tremendous clinical values. In this paper, we propose the first and novel computational framework that disentangles the task into two components spatial vertex localization and sequential semantic classification. (1) A HCC tumor segmentor is built for tumor mask boundary extraction, followed by polar transform representing the boundary with radius and angle. Vertex generator is used to produce fixed length boundary vertices where vertex features are sampled on the corresponding spatial locations. (2) The sampled deep vertex features with positional embedding are mapped into a sequential space and decoded by a multilayer perceptron (MLP) for semantic classification. Extensive experiments on tumor capsule semantics demonstrate the effectiveness of our framework. Mining the correlation between the boundary semantics and MVI status proves the feasibility to integrate this boundary semantics as a valid HCC prognostic biomarker.


An old problem of Erd H o s a graph without two cycles of the same length. In 1975, P. Erd H o s proposed the problem of determining the maximum number f(n) of edges in a graph on n vertices in which any two cycles are of different lengths. Let f ast (n) be the maximum number of edges in a simple graph on n vertices in which any two cycles are of different lengths. Let M n be the set of simple graphs on n vertices in which any two cycles are of different lengths and with the edges of f ast (n) . Let mc(n) be the maximum cycle length for all G in M n . In this paper, it is proved that for n sufficiently large, mc(n) leq frac 15 16 n . We make the following conjecture lim n rightarrow infty mc(n) over n 0.


Cautiously Optimistic Policy Optimization and Exploration with Linear Function Approximation. Policy optimization methods are popular reinforcement learning algorithms, because their incremental and on policy nature makes them more stable than the value based counterparts. However, the same properties also make them slow to converge and sample inefficient, as the on policy requirement precludes data reuse and the incremental updates couple large iteration complexity into the sample complexity. These characteristics have been observed in experiments as well as in theory in the recent work of citet agarwal2020pc , which provides a policy optimization method PCPG that can robustly find near optimal polices for approximately linear Markov decision processes but suffers from an extremely poor sample complexity compared with value based techniques. In this paper, we propose a new algorithm, COPOE, that overcomes the sample complexity issue of PCPG while retaining its robustness to model misspecification. Compared with PCPG, COPOE makes several important algorithmic enhancements, such as enabling data reuse, and uses more refined analysis techniques, which we expect to be more broadly applicable to designing new reinforcement learning algorithms. The result is an improvement in sample complexity from widetilde O (1 epsilon 11 ) for PCPG to widetilde O (1 epsilon 3) for PCPG, nearly bridging the gap with value based techniques.


Robust optimization Design of a New Combined Median Barrier Based on Taguchi method and Grey Relational Analysis. Accidents that vehicles cross median and enter opposite lane happen frequently, and the existing median barrier has weak anti collision strength. A new combined median barrier (NCMB) consisted of W beam guardrail and concrete structure was proposed to decrease deformation and enhance anti collision strength in this paper. However, there were some uncertainties in the initial design of the NCMB. If the uncertainties were not considered in the design process, the optimization objectives were especially sensitive to the small fluctuation of the variables, and it might result in design failure. For this purpose, the acceleration and deflection were taken as objectives post thickness, W beam thickness and post spacing were chosen as design variables the velocity, mass of vehicle and the yield stress of barrier components were taken as noise factors, a multi objective robust optimization is carried out for the NCMB based on Taguchi and grey relational analysis (GRA). The results indicate that the acceleration and deflection after optimization are reduced by 47.3 and 76.7 respectively Signal to noise ratio (SNR) of objectives after optimization are increased, it greatly enhances the robustness of the NCMB. The results demonstrate that the effectiveness of the methodology that based on Taguchi method and grey relational analysis.


Adversarial Regularization as Stackelberg Game An Unrolled Optimization Approach. Adversarial regularization has been shown to improve the generalization performance of deep learning models in various natural language processing tasks. Existing works usually formulate the method as a zero sum game, which is solved by alternating gradient descent ascent algorithms. Such a formulation treats the adversarial and the defending players equally, which is undesirable because only the defending player contributes to the generalization performance. To address this issue, we propose Stackelberg Adversarial Regularization (SALT), which formulates adversarial regularization as a Stackelberg game. This formulation induces a competition between a leader and a follower, where the follower generates perturbations, and the leader trains the model subject to the perturbations. Different from conventional approaches, in SALT, the leader is in an advantageous position. When the leader moves, it recognizes the strategy of the follower and takes the anticipated follower's outcomes into consideration. Such a leader's advantage enables us to improve the model fitting to the unperturbed data. The leader's strategic information is captured by the Stackelberg gradient, which is obtained using an unrolling algorithm. Our experimental results on a set of machine translation and natural language understanding tasks show that SALT outperforms existing adversarial regularization baselines across all tasks. Our code is available at https github.com SimiaoZuo Stackelberg Adv.


Generation of cold magnetized relativistic plasmas at the rear of thin foils irradiated by ultra high intensity laser pulses. A scheme to generate magnetized relativistic plasmas in laboratory is proposed. It is based on interaction of ultra high intensity sub picosecond laser pulses with few micron thick foils or films. By means of Particle In Cell simulations it is shown that energetic electrons produced by the laser and evacuated at the rear of the target trigger an expansion of the target and builds up a strong azimuthal magnetic field. It is shown that in the expanding plasma sheath a ratio of the magnetic pressure and the electron rest mass energy density exceeds unity whereas a the plasma pressure is lower than the magnetic pressure and the electron gyroradius is lower than the plasma dimension. This scheme can be utilised to study astrophysical extreme phenomena such as relativistic magnetic reconnection in laboratory.


On the Connectivity and the Diameter of Betweenness Uniform Graphs. Betweenness centrality is a centrality measure based on the overall amount of shortest paths passing through a given vertex. A graph is betweenness uniform if all its vertices have the same betweenness centrality. We study the properties of betweenness uniform graphs. In particular, we show that every connected betweenness uniform graph is either a cycle or a 3 connected graph. Also, we show that betweenness uniform graphs of high maximal degree have small diameter.


Thermal instability of the buoyant flow in a vertical cylindrical porous layer with a uniform internal heat source. The buoyancy induced parallel flow in a vertical cylindrical porous layer is analysed. A radial thermal gradient caused by a uniformly distributed heat source is assumed to induce the buoyant flow. The layer boundaries are modelled as isothermal and permeable to an external fluid reservoir. The onset of the convective instability is analysed by linearising the governing equations for the perturbations. The governing parameters driving the instability are the heat source Rayleigh number and the ratio between the internal radius and the external radius. Neutral stability curves and the critical values of the Rayleigh number, the perturbation wave number and the angular frequency are computed numerically. It is shown that axisymmetric modes form the most dangerous mode of instability.


Spatial and temporal dynamics of RhoA activities of single breast tumor cells in a 3D environment revealed by a machine learning assisted FRET technique. One of the hallmarks of cancer cells is their exceptional ability to migrate within the extracellular matrix (ECM) for gaining access to the circulatory system, a critical step of cancer metastasis. RhoA, a small GTPase, is known to be a key molecular switch that toggles between actomyosin contractility and lamellipodial protrusion during cell migration. Current understanding of RhoA activity in cell migration has been largely derived from studies of cells plated on a two dimensional (2D) substrate using a FRET biosensor. There has been increasing evidence that cells behave differently in a more physiologically relevant three dimensional (3D) environment, however, studies of RhoA activities in 3D have been hindered by low signal to noise ratio in fluorescence imaging. In this paper, we present a machine learning assisted FRET technique to follow the spatiotemporal dynamics of RhoA activities of single breast tumor cells (MDA MB 231) migrating in a 3D as well as a 2D environment using a RhoA biosensor. We found that RhoA activity is more polarized along the long axis of the cell for single cells migrating on 2D fibronectin coated glass versus those embedded in 3D collagen matrices. In particular, RhoA activities of cells in 2D exhibit a distinct front to back and back to front movement during migration in contrast to those in 3D. Finally, regardless of dimensionality, RhoA polarization is found to be correlated with cell shape.


Resource Efficient and Delay Aware Federated Learning Design under Edge Heterogeneity. Federated learning (FL) has emerged as a popular technique for distributing machine learning across wireless edge devices. We examine FL under two salient properties of contemporary networks device server communication delays and device computation heterogeneity. Our proposed StoFedDelAv algorithm incorporates a local global model combiner into the FL synchronization step. We theoretically characterize the convergence behavior of StoFedDelAv and obtain the optimal combiner weights, which consider the global model delay and expected local gradient error at each device. We then formulate a network aware optimization problem which tunes the minibatch sizes of the devices to jointly minimize energy consumption and machine learning training loss, and solve the non convex problem through a series of convex approximations. Our simulations reveal that StoFedDelAv outperforms the current art in FL, evidenced by the obtained improvements in optimization objective.


Interpretable Knowledge Tracing Simple and Efficient Student Modeling with Causal Relations. Intelligent Tutoring Systems have become critically important in future learning environments. Knowledge Tracing (KT) is a crucial part of that system. It is about inferring the skill mastery of students and predicting their performance to adjust the curriculum accordingly. Deep Learning based KT models have shown significant predictive performance compared with traditional models. However, it is difficult to extract psychologically meaningful explanations from the tens of thousands of parameters in neural networks, that would relate to cognitive theory. There are several ways to achieve high accuracy in student performance prediction but diagnostic and prognostic reasoning is more critical in learning sciences. Since KT problem has few observable features (problem ID and student's correctness at each practice), we extract meaningful latent features from students' response data by using machine learning and data mining techniques. In this work, we present Interpretable Knowledge Tracing (IKT), a simple model that relies on three meaningful latent features individual skill mastery, ability profile (learning transfer across skills), and problem difficulty. IKT's prediction of future student performance is made using a Tree Augmented Naive Bayes Classifier (TAN), therefore its predictions are easier to explain than deep learning based student models. IKT also shows better student performance prediction than deep learning based student models without requiring a huge amount of parameters. We conduct ablation studies on each feature to examine their contribution to student performance prediction. Thus, IKT has great potential for providing adaptive and personalized instructions with causal reasoning in real world educational systems.


COVID 19 vaccination strategies on dynamic networks. Coronavirus disease (COVID 19), which was caused by SARS CoV 2, has become a global public health concern. A great proportion of the world needs to be vaccinated in order to stop the rapid spread of the disease. In addition to prioritising vulnerable sections of the population to receive the vaccine, an ideal degree based vaccination strategy uses fine grained contact networks to prioritise vaccine recipients. This strategy is costly and impractical due to the enormous amount of specific contact information needed. It also does not capture indirect famine or aerosol based transmission. We recently proposed a new vaccination strategy called Individual's Movement based Vaccination (IMV), which takes into account both direct and indirect transmission and is based on the types of places people visit. IMV was shown to be cost efficient in the case of influenza like diseases. This paper studies the application of IMV to COVID 19 using its documented transmission parameters. We conduct large scale computer simulations based on a city wide empirical mobility dataset to evaluate the performance and practicability of the strategy. Results show that the proposed strategy achieves nearly five times the efficiency of random vaccination and performs comparably to the degree based strategy, while significantly reducing the data collection requirements.


Knowing when we do not know Bayesian continual learning for sensing based analysis tasks. Despite much research targeted at enabling conventional machine learning models to continually learn tasks and data distributions sequentially without forgetting the knowledge acquired, little effort has been devoted to account for more realistic situations where learning some tasks accurately might be more critical than forgetting previous ones. In this paper we propose a Bayesian inference based framework to continually learn a set of real world, sensing based analysis tasks that can be tuned to prioritize the remembering of previously learned tasks or the learning of new ones. Our experiments prove the robustness and reliability of the learned models to adapt to the changing sensing environment, and show the suitability of using uncertainty of the predictions to assess their reliability.


Characterization of exhaled e cigarette aerosols in a vape shop using a field portable holographic on chip microscope. The past decade marked a drastic increase in the usage of electronic cigarettes (e cigs). The adverse health impact of secondhand exposure due to exhaled e cig particles has raised significant concerns, demanding further research on the characteristics of these particles. In this work, we report direct volatility measurements on exhaled e cig aerosols using a field portable device (termed c Air) enabled by deep learning and lens free holographic microscopy for this analysis, we performed a series of field experiments in a vape shop where customers used vaped their e cig products. During four days of experiments, we periodically sampled the indoor air with intervals of 15 minutes and collected the exhaled particles with c Air. Time lapse inline holograms of the collected particles were recorded by c Air and reconstructed using a convolutional neural network yielding phase recovered microscopic images of the particles. Volumetric decay of individual particles due to evaporation was used as an indicator of the volatility of each aerosol. Volatility dynamics quantified through c Air experiments showed that indoor vaping increased the volatility of particles as well as the percentage of volatile and semi volatile particles in air. The reported methodology and findings can guide further studies on volatility characterization of e cig emission and regulations on indoor vaping.


How to Explain Neural Networks an Approximation Perspective. The lack of interpretability has hindered the large scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based on approximation theory in this study. We first implement this approximation interpretation on a specific model (fully connected neural network) and then propose to use MLP as a universal interpreter to explain arbitrary black box models. Extensive experiments demonstrate the effectiveness of our approach.


Normalisation and Subformula Property for a System of Classical Logic with Tarski's Rule. This paper considers a formalisation of classical logic using general introduction rules and general elimination rules. It proposes a definition of maximal formula', segment' and maximal segment' suitable to the system, and gives reduction procedures for them. It is then shown that deductions in the system convert into normal form, i.e. deductions that contain neither maximal formulas nor maximal segments, and that deductions in normal form satisfy the subformula property. Tarski's Rule is treated as a general introduction rule for implication. The general introduction rule for negation has a similar form. Maximal formulas with implication or negation as main operator require reduction procedures of a more intricate kind not present in normalisation for intuitionist logic.


Moments in the Production of Space Developing a Generic Adolescent Girls and Young Women Health Information Systems in Zimbabwe. With global targets to end AIDS by 2030 and to eliminate new HIV infections, Adolescent Girls and Young Women (AGYW) are seen to be particularly vulnerable, especially in Sub Saharan Africa. Numerous nations have therefore rolled out interventions to provide services to remove the determinants of vulnerability, such as limited education, early marriage, poverty, domestic violence, and exposure by male partners. Within this context, subpopulations such as sex workers increase the vulnerability amongst AGYW and are also supported through prevention programming. This study follows a project to develop a generic health information systems solution to provide a means to monitor and evaluate the successes of the AGYW initiative in reducing new infections. It borrows theoretical ideas from Henri Lefebvre's theory of moments to describe the process in which the space for the development of the solution is produced.


APANet Adaptive Prototypes Alignment Network for Few Shot Semantic Segmentation. Few shot semantic segmentation aims to segment novel class objects in a given query image with only a few labeled support images. Most advanced solutions exploit a metric learning framework that performs segmentation through matching each query feature to a learned class specific prototype. However, this framework suffers from biased classification due to incomplete feature comparisons. To address this issue, we present an adaptive prototype representation by introducing class specific and class agnostic prototypes and thus construct complete sample pairs for learning semantic alignment with query features. The complementary features learning manner effectively enriches feature comparison and helps yield an unbiased segmentation model in the few shot setting. It is implemented with a two branch end to end network ( ie, a class specific branch and a class agnostic branch), which generates prototypes and then combines query features to perform comparisons. In addition, the proposed class agnostic branch is simple yet effective. In practice, it can adaptively generate multiple class agnostic prototypes for query images and learn feature alignment in a self contrastive manner. Extensive experiments on PASCAL 5 i and COCO 20 i demonstrate the superiority of our method. At no expense of inference efficiency, our model achieves state of the art results in both 1 shot and 5 shot settings for semantic segmentation.


Sunda arc seismicity continuing increase of high magnitude earthquakes since 2004. Earthquakes with magnitude M greater than or equal to 6.5 are potentially destructive events which may cause tremendous devastation, huge economic loss and large numbers of casualties. Models with predictive or forecasting power are still lacking. Nevertheless, the spatial and temporal information of these seismic events can provide important information about the seismic history and the potential future of a region. This paper analyzes the recently updated International Seismological Centre earthquake catalog of body wave magnitudes, mb, reported for 313,500 events in the Sunda arc region during the last 56 years, i.e., from 1964 to 2020. Based on the data, we report a hitherto unreported strong increase in seismicity during the last two decades associated with strong earthquakes with mb greater than or equal to 6.5. A Gaussian Process Regression Analysis of these ISC data suggests a continuation of this strong rise in number and strength of events with mb greater than or equal to 6.5, in the region. These yearly maxima in the magnitude of the earthquakes also show another unexpected pattern about every two to three years there is a new maximum in the magnitude and also in the number of earthquakes. Furthermore, a noticeable increase is also observed in the yearly number of the events with mb greater than or equal to 6.5. The trend line generated by Auto Regressive Integrated Moving Average (ARIMA) method suggests continuing increase of such large magnitude events in the Sunda arc region during the next decade.


Approximation of discontinuous functions by Kantorovich exponential sampling series. The Kantorovich exponential sampling series at jump discontinuities of the bounded measurable signal f has been analysed. A representation lemma for the series is established and using this lemma certain approximation theorems for discontinuous signals are proved. The degree of approximation in terms of logarithmic modulus of smoothness for the series is studied. Further a linear prediction of signals based on past sample values has been obtained. Some numerical simulations are performed to validate the approximation of discontinuous signals f by the sampling series.


Fast and Accurate Uncertainty Quantification for the ECG with Random Electrodes Location. The standard electrocardiogram (ECG) is a point wise evaluation of the body potential at certain given locations. These locations are subject to uncertainty and may vary from patient to patient or even for a single patient. In this work, we estimate the uncertainty in the ECG induced by uncertain electrode positions when the ECG is derived from the forward bidomain model. In order to avoid the high computational cost associated to the solution of the bidomain model in the entire torso, we propose a low rank approach to solve the uncertainty quantification (UQ) problem. More precisely, we exploit the sparsity of the ECG and the lead field theory to translate it into a set of deterministic, time independent problems, whose solution is eventually used to evaluate expectation and covariance of the ECG. We assess the approach with numerical experiments in a simple geometry.


The causal interaction between the subnetworks of a complex network. Information flow provides a natural measure for the causal interaction between dynamical events. This study extends our previous rigorous formalism of componentwise information flow to the bulk information flow between two complex subsystems of a large dimensional parental system, in order to investigate problems such as the effective connectivity between two brain regions, each with millions of neurons involved. Analytical formulas have been obtained in a closed form. Under a Gaussian assumption, their maximum likelihood estimators have also been obtained. These formulas have been validated using different subsystems with preset relations, and they yield causalities just as expected. On the contrary, the commonly used proxies for the characterization of subsystems, such as averages and principal components, generally do not work correctly. This study can help diagnose the emergence of patterns in complex systems (e.g., the human brain), and is expected to have applications in many real world problems in different disciplines such as neuroscience, climate science, fluid dynamics, financial economics, to name a few.


Using Transformers to Provide Teachers with Personalized Feedback on their Classroom Discourse The TalkMoves Application. TalkMoves is an innovative application designed to support K 12 mathematics teachers to reflect on, and continuously improve their instructional practices. This application combines state of the art natural language processing capabilities with automated speech recognition to automatically analyze classroom recordings and provide teachers with personalized feedback on their use of specific types of discourse aimed at broadening and deepening classroom conversations about mathematics. These specific discourse strategies are referred to as "talk moves" within the mathematics education community and prior research has documented the ways in which systematic use of these discourse strategies can positively impact student engagement and learning. In this article, we describe the TalkMoves application's cloud based infrastructure for managing and processing classroom recordings, and its interface for providing teachers with feedback on their use of talk moves during individual teaching episodes. We present the series of model architectures we developed, and the studies we conducted, to develop our best performing, transformer based model (F1 79.3 ). We also discuss several technical challenges that need to be addressed when working with real world speech and language data from noisy K 12 classrooms.


Few Shot Intent Detection via Contrastive Pre Training and Fine Tuning. In this work, we focus on a more challenging few shot intent detection scenario where many intents are fine grained and semantically similar. We present a simple yet effective few shot intent detection schema via contrastive pre training and fine tuning. Specifically, we first conduct self supervised contrastive pre training on collected intent datasets, which implicitly learns to discriminate semantically similar utterances without using any labels. We then perform few shot intent detection together with supervised contrastive learning, which explicitly pulls utterances from the same intent closer and pushes utterances across different intents farther. Experimental results show that our proposed method achieves state of the art performance on three challenging intent detection datasets under 5 shot and 10 shot settings.


A Closed Graph Theorem for hyperbolic iterated function systems. In this note we introduce a notion of a morphism between two hyperbolic iterated function systems. We prove that the graph of a morphism is the attractor of an iterated function system, giving a Closed Graph Theorem, and show how it can be used to approach the topological conjugacy problem for iterated function systems.


What's in My LiDAR Odometry Toolbox?. With the democratization of 3D LiDAR sensors, precise LiDAR odometries and SLAM are in high demand. New methods regularly appear, proposing solutions ranging from small variations in classical algorithms to radically new paradigms based on deep learning. Yet it is often difficult to compare these methods, notably due to the few datasets on which the methods can be evaluated and compared. Furthermore, their weaknesses are rarely examined, often letting the user discover the hard way whether a method would be appropriate for a use case. In this paper, we review and organize the main 3D LiDAR odometries into distinct categories. We implemented several approaches (geometric based, deep learning based, and hybrid methods) to conduct an in depth analysis of their strengths and weaknesses on multiple datasets, guiding the reader through the different LiDAR odometries available. Implementation of the methods has been made publicly available at https github.com Kitware pyLiDAR SLAM.


Asymptotically Optimal Massey Like Inequality on Guessing Entropy With Application to Side Channel Attack Evaluations. A Massey like inequality is any useful lower bound on guessing entropy in terms of the computationally scalable Shannon entropy. The asymptotically optimal Massey like inequality is determined and further refined for finite support distributions. The impact of these results are highlighted for side channel attack evaluation where guessing entropy is a key metric. In this context, the obtained bounds are compared to the state of the art.


Investigating a Conceptual Construct for Software Context. A growing number of empirical software engineering researchers suggest that a complementary focus on theory is required if the discipline is to mature. A first step in theory building involves the establishment of suitable theoretical constructs. For researchers studying software projects, the lack of a theoretical construct for context is problematic for both experimentation and effort estimation. For experiments, insufficiently understood contextual factors confound results, and for estimation, unstated contextual factors affect estimation reliability. We have earlier proposed a framework that we suggest may be suitable as a construct for context i.e. represents a minimal, spanning set for the space of software contexts. The framework has six dimensions, described as Who, Where, What, When, How and Why. In this paper, we report the outcomes of a pilot study to test its suitability by categorising contextual factors from the software engineering literature into the framework. We found that one of the dimensions, Why, does not represent context, but rather is associated with objectives. We also identified some factors that do not clearly fit into the framework and require further investigation. Our contributions are the pursuing of a theoretical approach to understanding software context, the initial establishment and evaluation of a construct for context and the exposure of a lack of clarity of meaning in many 'contexts' currently applied as factors for estimating project outcomes.


ANEA Automated (Named) Entity Annotation for German Domain Specific Texts. Named entity recognition (NER) is an important task that aims to resolve universal categories of named entities, e.g., persons, locations, organizations, and times. Despite its common and viable use in many use cases, NER is barely applicable in domains where general categories are suboptimal, such as engineering or medicine. To facilitate NER of domain specific types, we propose ANEA, an automated (named) entity annotator to assist human annotators in creating domain specific NER corpora for German text collections when given a set of domain specific texts. In our evaluation, we find that ANEA automatically identifies terms that best represent the texts' content, identifies groups of coherent terms, and extracts and assigns descriptive labels to these groups, i.e., annotates text datasets into the domain (named) entities.


From Voxel to Point IoU guided 3D Object Detection for Point Cloud with Voxel to Point Decoder. In this paper, we present an Intersection over Union (IoU) guided two stage 3D object detector with a voxel to point decoder. To preserve the necessary information from all raw points and maintain the high box recall in voxel based Region Proposal Network (RPN), we propose a residual voxel to point decoder to extract the point features in addition to the map view features from the voxel based RPN. We use a 3D Region of Interest (RoI) alignment to crop and align the features with the proposal boxes for accurately perceiving the object position. The RoI Aligned features are finally aggregated with the corner geometry embeddings that can provide the potentially missing corner information in the box refinement stage. We propose a simple and efficient method to align the estimated IoUs to the refined proposal boxes as a more relevant localization confidence. The comprehensive experiments on KITTI and Waymo Open Dataset demonstrate that our method achieves significant improvements with novel architectures against the existing methods. The code is available on Github URL footnote url https github.com jialeli1 From Voxel to Point .


Fleet Sizing and Allocation for On demand Last Mile Transportation Systems. The last mile problem refers to the provision of travel service from the nearest public transportation node to home or other destination. Last Mile Transportation Systems (LMTS), which have recently emerged, provide on demand shared transportation. In this paper, we investigate the fleet sizing and allocation problem for the on demand LMTS. Specifically, we consider the perspective of a last mile service provider who wants to determine the number of servicing vehicles to allocate to multiple last mile service regions in a particular city. In each service region, passengers demanding last mile services arrive in batches, and allocated vehicles deliver passengers to their final destinations. The passenger demand (i.e., the size of each batch of passengers) is random and hard to predict in advance, especially with limited data during the planning process. The quality of fleet allocation decisions is a function of vehicle fixed cost plus a weighted sum of passenger's waiting time before boarding a vehicle and in vehicle riding time. We propose and analyze two models a stochastic programming model and a distributionally robust optimization model to solve the problem, assuming a known and unknown distribution of the demand, respectively. We conduct extensive numerical experiments to evaluate the models and discuss insights and implications into the optimal fleet sizing and allocation for the on demand LMTS under demand uncertainty.


Better Self training for Image Classification through Self supervision. Self training is a simple semi supervised learning approach Unlabelled examples that attract high confidence predictions are labelled with their predictions and added to the training set, with this process being repeated multiple times. Recently, self supervision learning without manual supervision by solving an automatically generated pretext task has gained prominence in deep learning. This paper investigates three different ways of incorporating self supervision into self training to improve accuracy in image classification self supervision as pretraining only, self supervision performed exclusively in the first iteration of self training, and self supervision added to every iteration of self training. Empirical results on the SVHN, CIFAR 10, and PlantVillage datasets, using both training from scratch, and Imagenet pretrained weights, show that applying self supervision only in the first iteration of self training can greatly improve accuracy, for a modest increase in computation time.


Randomized FIFO Mechanisms. We study the matching of jobs to workers in a queue, e.g. a ridesharing platform dispatching drivers to pick up riders at an airport. Under FIFO dispatching, the heterogeneity in trip earnings incentivizes drivers to cherry pick, increasing riders' waiting time for a match and resulting in a loss of efficiency and reliability. We first present the direct FIFO mechanism, which offers lower earning trips to drivers further down the queue. The option to skip the rest of the line incentivizes drivers to accept all dispatches, but the mechanism would be considered unfair since drivers closer to the head of the queue may have lower priority for trips to certain destinations. To avoid the use of unfair dispatch rules, we introduce a family of randomized FIFO mechanisms, which send declined trips gradually down the queue in a randomized manner. We prove that a randomized FIFO mechanism achieves the first best throughput and the second best revenue in equilibrium. Extensive counterfactual simulations using data from the City of Chicago demonstrate substantial improvements of revenue and throughput, highlighting the effectiveness of using waiting times to align incentives and reduce the variability in driver earnings.


Lie brackets on Hopf algebra cohomology. By work of Farinati, Solberg, and Taillefer, it is known that the Hopf algebra cohomology of a quasi triangular Hopf algebra, as a graded Lie algebra under the Gerstenhaber bracket, is abelian. Motivated by the question of whether this holds for nonquasi triangular Hopf algebras, we show that Gerstenhaber brackets on Hopf algebra cohomology can be expressed via an arbitrary projective resolution using Volkov's homotopy liftings as generalized to some exact monoidal categories. This is a special case of our more general result that a bracket operation on cohomology is preserved under exact monoidal functors one such functor is an embedding of Hopf algebra cohomology into Hochschild cohomology. As a consequence, we show that this Lie structure on Hopf algebra cohomology is abelian in positive degrees for all quantum elementary abelian groups, most of which are nonquasi triangular.


Gradient play in stochastic games stationary points, convergence, and sample complexity. We study the performance of the gradient play algorithm for stochastic games (SGs), where each agent tries to maximize its own total discounted reward by making decisions independently based on current state information which is shared between agents. Policies are directly parameterized by the probability of choosing a certain action at a given state. We show that Nash equilibria (NEs) and first order stationary policies are equivalent in this setting, and give a local convergence rate around strict NEs. Further, for a subclass of SGs called Markov potential games (which includes the cooperative setting with identical rewards among agents as an important special case), we design a sample based reinforcement learning algorithm and give a non asymptotic global convergence rate analysis for both exact gradient play and our sample based learning algorithm. Our result shows that the number of iterations to reach an epsilon NE scales linearly, instead of exponentially, with the number of agents. Local geometry and local stability are also considered, where we prove that strict NEs are local maxima of the total potential function and fully mixed NEs are saddle points.


Heterogeneous multiscale methods for the Landau Lifshitz equation. In this paper, we present a finite difference heterogeneous multiscale method for the Landau Lifshitz equation with a highly oscillatory diffusion coefficient. The approach combines a higher order discretization and artificial damping in the so called micro problem to obtain an efficient implementation. The influence of different parameters on the resulting approximation error is discussed. Numerical examples for both periodic as well as more general coefficients are given to demonstrate the functionality of the approach.


FiSH Fair Spatial Hotspots. Pervasiveness of tracking devices and enhanced availability of spatially located data has deepened interest in using them for various policy interventions, through computational data analysis tasks such as spatial hot spot detection. In this paper, we consider, for the first time to our best knowledge, fairness in detecting spatial hot spots. We motivate the need for ensuring fairness through statistical parity over the collective population covered across chosen hot spots. We then characterize the task of identifying a diverse set of solutions in the noteworthiness fairness trade off spectrum, to empower the user to choose a trade off justified by the policy domain. Being a novel task formulation, we also develop a suite of evaluation metrics for fair hot spots, motivated by the need to evaluate pertinent aspects of the task. We illustrate the computational infeasibility of identifying fair hot spots using naive and or direct approaches and devise a method, codenamed it FiSH , for efficiently identifying high quality, fair and diverse sets of spatial hot spots. FiSH traverses the tree structured search space using heuristics that guide it towards identifying effective and fair sets of spatial hot spots. Through an extensive empirical analysis over a real world dataset from the domain of human development, we illustrate that FiSH generates high quality solutions at fast response times.


Dynamic Graph Neural Networks for Sequential Recommendation. Modeling user preference from his historical sequences is one of the core problems of sequential recommendation. Existing methods in this field are widely distributed from conventional methods to deep learning methods. However, most of them only model users' interests within their own sequences and ignore the dynamic collaborative signals among different user sequences, making it insufficient to explore users' preferences. We take inspiration from dynamic graph neural networks to cope with this challenge, modeling the user sequence and dynamic collaborative signals into one framework. We propose a new method named Dynamic Graph Neural Network for Sequential Recommendation (DGSR), which connects different user sequences through a dynamic graph structure, exploring the interactive behavior of users and items with time and order information. Furthermore, we design a Dynamic Graph Recommendation Network to extract user's preferences from the dynamic graph. Consequently, the next item prediction task in sequential recommendation is converted into a link prediction between the user node and the item node in a dynamic graph. Extensive experiments on three public benchmarks show that DGSR outperforms several state of the art methods. Further studies demonstrate the rationality and effectiveness of modeling user sequences through a dynamic graph.


Exploratory Design of a Hands free Video Game Controller for a Quadriplegic Individual. From colored pixels to hyper realistic 3D landscapes of virtual reality, video games have evolved immensely over the last few decades. However, video game input still requires two handed dexterous finger manipulations for simultaneous joystick and trigger or mouse and keyboard presses. In this work, we explore the design of a hands free game control method using realtime facial expression recognition for individuals with neurological and neuromuscular diseases who are unable to use traditional game controllers. Similar to other Assistive Technologies (AT), our facial input technique is also designed and tested in collaboration with a graduate student who has Spinal Muscular Atrophy. Our preliminary evaluation shows the potential of facial expression recognition for augmenting the lives of quadriplegic individuals by enabling them to accomplish things like walking, running, flying or other adventures that may not be so attainable otherwise.


An asymptotic preserving discretization scheme for gas transport in pipe networks. We consider the simulation of barotropic flow of gas in long pipes and pipe networks. Based on a Hamiltonian reformulation of the governing system, a fully discrete approximation scheme is proposed using mixed finite elements in space and an implicit Euler method in time. Assuming the existence of a smooth subsonic solution bounded away from vacuum, a full convergence analysis is presented based on relative energy estimates. Particular attention is paid to establishing error bounds that are uniform in the friction parameter. As a consequence, the method and results also cover the parabolic problem arising in the asymptotic large friction limit. The error estimates are derived in detail for a single pipe, but using appropriate coupling conditions and the particular structure of the problem and its discretization, the main results directly generalize to pipe networks. Numerical tests are presented for illustration.


Towards calibration free Mach Zehnder switches on silicon. Silicon photonic Mach Zehnder switches (MZSs) have been extensively investigated as a promising candidate for practical optical interconnects. However, conventional 2 times 2 MZSs are usually prone to the size variations of the arm waveguides due to imperfect fabrication, resulting in considerable random phase imbalance between the two arms, thereby imposing significant challenges for further scaling up NN MZSs. Here we propose a novel design towards calibration free 2 times 2 and N times N MZSs, employing optimally widened arm waveguides, enabled by novel compact tapered Euler S bends with incorporated mode filters. With standard 180 nm CMOS foundry processes, more than thirty 2 times 2 MZSs and one 4 times 4 Benes MZS with the new design are fabricated and characterized. Compared with their conventional counterparts with 0.45 mu m wide arm waveguides, the present 2 times 2 MZSs exhibit 370 fold reduction in the random phase imbalance. The measured extinction ratios of the present 2 times 2 and 4 times 4 MZSs operating in the all cross state are 30 dB and 20 dB across the wavelength range of 60 nm, respectively, even without any calibrations. This work paves the way towards calibration free large scale N times N silicon photonic MZSs.


Multi player Bandits for Distributed Cognitive Radar. With new applications for radar networks such as automotive control or indoor localization, the need for spectrum sharing and general interoperability is expected to rise. This paper describes the application of multi player bandit algorithms for waveform selection to a distributed cognitive radar network that must coexist with a communications system. Specifically, we make the assumption that radar nodes in the network have no dedicated communication channel. As we will discuss later, nodes can communicate indirectly by taking actions which intentionally interfere with other nodes and observing the resulting collisions. The radar nodes attempt to optimize their own spectrum utilization while avoiding collisions, not only with each other, but with the communications system. The communications system is assumed to statically occupy some subset of the bands available to the radar network. First, we examine models that assume each node experiences equivalent channel conditions, and later examine a model that relaxes this assumption.


Target Following Double Deep Q Networks for UAVs. Target tracking in unknown real world environments in the presence of obstacles and target motion uncertainty demand agents to develop an intrinsic understanding of the environment in order to predict the suitable actions to be taken at each time step. This task requires the agents to maximize the visibility of the mobile target maneuvering randomly in a network of roads by learning a policy that takes into consideration the various aspects of a real world environment. In this paper, we propose a DDQN based extension to the state of the art in target tracking using a UAV TF DQN, that we call TF DDQN, that isolates the value estimation and evaluation steps. Additionally, in order to carefully benchmark the performance of any given target tracking algorithm, we introduce a novel target tracking evaluation scheme that quantifies its efficacy in terms of a wide set of diverse parameters. To replicate the real world setting, we test our approach against standard baselines for the task of target tracking in complex environments with varying drift conditions and changes in environmental configuration.


On failure of 0 1 laws. Let alpha in (0,1) mathbb R be irrational and G n G n,1 n alpha be the random graph with edge probability 1 n alpha we know that it satisfies the 0 1 law for first order logic. We deal with the failure of the 0 1 law for stronger logics mathbb L infty,k ,k large enough and the inductive logic.


On some sharper boundedness conditions in the higher dimensional chemotaxis consumption model. For the classical zero flux chemotaxis consumption model begin equation u t Delta u chi nabla cdot (u nabla v) quad textrm and quad v t Delta v uv, quad text with (x,t) in Omega times (0,T max ), end equation Omega being a bounded and smooth domain of mathbb R n , n geq 3 , chi some positive number and T max in (0, infty , the following was established in a paper by Tao for every sufficiently regular initial data u(x,0) u 0(x) geq 0 and v(x,0) v 0(x) geq 0 , there is chi( lVert v 0 rVert L infty( Omega) ) such that for all 0 chi leq chi( lVert v 0 rVert L infty( Omega) ) , the initial boundary value problem has a unique classical solution in Omega times (0, infty) which is bounded. In this paper, whenever n geq 5 , we obtain the same claim for larger values of the constant chi( v 0 L infty ( Omega) ) .


RPS Portfolio Asset Selection using Graph based Representation Learning. Portfolio optimization is one of the essential fields of focus in finance. There has been an increasing demand for novel computational methods in this area to compute portfolios with better returns and lower risks in recent years. We present a novel computational method called Representation Portfolio Selection (RPS) by redefining the distance matrix of financial assets using Representation Learning and Clustering algorithms for portfolio selection to increase diversification. RPS proposes a heuristic for getting closer to the optimal subset of assets. Using empirical results in this paper, we demonstrate that widely used portfolio optimization algorithms, such as MVO, CLA, and HRP, can benefit from our asset subset selection.