Leafy Automata for Higher Order Concurrency. Finitary Idealized Concurrent Algol (FICA) is a prototypical programming language combining functional, imperative, and concurrent computation. There exists a fully abstract game model of FICA, which in principle can be used to prove equivalence and safety of FICA programs. Unfortunately, the problems are undecidable for the whole language, and only very rudimentary decidable sub languages are known. We propose leafy automata as a dedicated automata theoretic formalism for representing the game semantics of FICA. The automata use an infinite alphabet with a tree structure. We show that the game semantics of any FICA term can be represented by traces of a leafy automaton. Conversely, the traces of any leafy automaton can be represented by a FICA term. Because of the close match with FICA, we view leafy automata as a promising starting point for finding decidable subclasses of the language and, more generally, to provide a new perspective on models of higher order concurrent computation. Moreover, we identify a fragment of FICA that is amenable to verification by translation into a particular class of leafy automata. Using a locality property of the latter class, where communication between levels is restricted and every other level is bounded, we show that their emptiness problem is decidable by reduction to Petri net reachability.


Scenario Based Trajectory Optimization in Uncertain Dynamic Environments. We present an optimization based method to plan the motion of an autonomous robot under the uncertainties associated with dynamic obstacles, such as humans. Our method bounds the marginal risk of collisions at each point in time by incorporating chance constraints into the planning problem. This problem is not suitable for online optimization outright for arbitrary probability distributions. Hence, we sample from these chance constraints using an uncertainty model, to generate "scenarios", which translate the probabilistic constraints into deterministic ones. In practice, each scenario represents the collision constraint for a dynamic obstacle at the location of the sample. The number of theoretically required scenarios can be very large. Nevertheless, by exploiting the geometry of the workspace, we show how to prune most scenarios before optimization and we demonstrate how the reduced scenarios can still provide probabilistic guarantees on the safety of the motion plan. Since our approach is scenario based, we are able to handle arbitrary uncertainty distributions. We apply our method in a Model Predictive Contouring Control framework and demonstrate its benefits in simulations and experiments with a moving robot platform navigating among pedestrians, running in real time.


An Inexact Semi smooth Newton Method on Riemannian Manifolds with Application to Duality based Total Variation Denoising. We propose a higher order method for solving non smooth optimization problems on manifolds. In order to obtain superlinear convergence, we apply a Riemannian Semi smooth Newton method to a non smooth non linear primal dual optimality system based on a recent extension of Fenchel duality theory to Riemannian manifolds. We also propose an inexact version of the Riemannian Semi smooth Newton method and prove conditions for local linear and superlinear convergence that hold independent of the sign of the curvature. Numerical experiments on l2 TV like problems with dual regularization confirm superlinear convergence on manifolds with positive and negative curvature.


Unified Learning Approach for Egocentric Hand Gesture Recognition and Fingertip Detection. Head mounted device based human computer interaction often requires egocentric recognition of hand gestures and fingertips detection. In this paper, a unified approach of egocentric hand gesture recognition and fingertip detection is introduced. The proposed algorithm uses a single convolutional neural network to predict the probabilities of finger class and positions of fingertips in one forward propagation. Instead of directly regressing the positions of fingertips from the fully connected layer, the ensemble of the position of fingertips is regressed from the fully convolutional network. Subsequently, the ensemble average is taken to regress the final position of fingertips. Since the whole pipeline uses a single network, it is significantly fast in computation. Experimental results show that the proposed method outperforms the existing fingertip detection approaches including the Direct Regression and the Heatmap based framework. The effectiveness of the proposed method is also shown in the wild scenario as well as in a use case of virtual reality.


Existence of at least one positive continuing solution of Urysohn quadratic integral equation by Schauder fixed point theorem.1. We employ Schauder fixed point Theorem to prove the existence of at least one positive continuous solution of the quadratic integral equation Moreover, the maximal and the minimal solutions of the last equation are also proved.


Flexibility in generating sets of finite groups. Let G be a finite group. It has recently been proved that every nontrivial element of G is contained in a generating set of minimal size if and only if all proper quotients of G require fewer generators than G. It is natural to ask which finite groups, in addition, have the property that any two elements of G that do not generate a cyclic group can be extended to a generating set of minimal size. This note answers the question. The only such finite groups are very specific affine groups elementary abelian groups extended by a cyclic group acting as scalars.


Notes on Monotone Recognition in Multi Valued Grids. Implementation details of method of monotone recognition, based on partitioning of the grid into the discrete structures isomorphic to binary cubes is presented.


Reflective Metagraph Rewriting as a Foundation for an AGI "Language of Thought". MeTTa (Meta Type Talk) is a novel programming language created for use in the OpenCog Hyperon AGI system. It is designed as a meta language with very basic and general facilities for handling symbols, groundings, variables, types, substitutions and pattern matching. Primitives exist for creating new type systems and associated DSLs. IInformally, MeTTa is Hyperon's lowest level "language of thought" the meta language in which algorithms for learning more particular knowledge representations, will operate, and in which these algorithms themselves may be represented. Here we explain how one might go about formalizing the MeTTa language as a system of metagraph rewrite rules, an approach that fits in naturally to the Hyperon framework given that the latter's core component is a distributed metagraph knowledge store (the Atomspace). The metagraph rewrite rules constituting MeTTa programs can also be represented as metagraphs, giving a natural model for MeTTa reflection and self modifying code. Considering MeTTa programs that compute equivalences between execution traces of other MeTTa programs allows us to model spaces of MeTTa execution traces using Homotopy Type Theory. Considering the limit of MeTTa programs mapping between execution traces of MeTTa programs that map between execution traces of MeTTa programs that ..., we find that a given MeTTa codebase is effectively modeled as an infinity groupoid, and the space of all MeTTa codebases as an (infinity,1) topis This topos is basically the same as the so called "Ruliad" previously derived from rewrite rules on hypergraphs, in a discrete physics context. The formalization of MeTTA as metagraph rewrite rules may also provide a useful framework for structuring the implementation of efficient methods for pattern matching and equality inference within the MeTTa interpreter.


The Second Moment of the Product of the Riemann Zeta and Dirichlet L Functions. We establish Motohashi's formula for the second moment of the product of the Riemann zeta function and a Dirichlet L function associated to an arbitrary primitive Dirichlet character modulo q in mathbb N . If the conductor q is an odd prime, our reciprocity formula is consistent with Motohashi's result in the early 1990s. The cubic moment side features two versions of central L values of automorphic forms on Gamma 0 (q) backslash mathbb H weighted by an integral transform of a test function on the second moment side. Our techniques involve a combination of analytic number theory and automorphic forms.


Biomimetic Hierarchical Structuring of PLA by Ultra Short Laser Pulses for Processing of Tissue Engineered Matrices Study of Cellular and Antibacterial Behavior. The influence of ultra short laser modification on the surface morphology and possible chemical alteration of poly lactic acid (PLA) matrix in respect to the optimization of cellular and antibacterial behavior were investigated in this study. Scanning electron microscopy (SEM) morphological examination of the processed PLA surface showed the formation of diverse hierarchical surface microstructures, generated by irradiation with a range of laser fluences (F) and scanning velocities (V) values. By controlling the laser parameters, diverse surface roughness can be achieved, thus influencing cellular dynamics. This surface feedback can be applied to finely tune and control diverse biomaterial surface properties like wettability, reflectivity, and biomimetics. The triggering of thermal effects, leading to the ejection of material with subsequent solidification and formation of raised rims and 3D like hollow structures along the processed zones, demonstrated a direct correlation to the wettability of the PLA. A transition from superhydrophobic (thetha 150 deg.) to super hydrophilic (thetha 20 deg.) surfaces can be achieved by the creation of grooves with V 0.6 mm s, F 1.7 J cm2. The achieved hierarchical architecture affected morphology and thickness of the processed samples which were linked to the nature of ultra short laser material interaction effects, namely the precipitation of temperature distribution during material processing can be strongly minimized with ultrashort pulses leading to non thermal and spatially localized effects that can facilitate volume ablation without collateral thermal damage.


Enumeration of extensions of the cycle matroid of a complete graph. We prove that the number of single element extensions of M(K n 1 ) is 2 n choose n 2 (1 o(1)) . This is done using a characterization of extensions as "linear subclasses".


Safe Multi Agent Reinforcement Learning via Shielding. Multi agent reinforcement learning (MARL) has been increasingly used in a wide range of safety critical applications, which require guaranteed safety (e.g., no unsafe states are ever visited) during the learning process.Unfortunately, current MARL methods do not have safety guarantees. Therefore, we present two shielding approaches for safe MARL. In centralized shielding, we synthesize a single shield to monitor all agents' joint actions and correct any unsafe action if necessary. In factored shielding, we synthesize multiple shields based on a factorization of the joint state space observed by all agents the set of shields monitors agents concurrently and each shield is only responsible for a subset of agents at each step.Experimental results show that both approaches can guarantee the safety of agents during learning without compromising the quality of learned policies moreover, factored shielding is more scalable in the number of agents than centralized shielding.


Realtime Trajectory Smoothing with Neural Nets. In order to safely and efficiently collaborate with humans, industrial robots need the ability to alter their motions quickly to react to sudden changes in the environment, such as an obstacle appearing across a planned trajectory. In Realtime Motion Planning, obstacles are detected in real time through a vision system, and new trajectories are planned with respect to the current positions of the obstacles, and immediately executed on the robot. Existing realtime motion planners, however, lack the smoothing post processing step which are crucial in sampling based motion planning resulting in the planned trajectories being jerky, and therefore inefficient and less human friendly. Here we propose a Realtime Trajectory Smoother based on the shortcutting technique to address this issue. Leveraging fast clearance inference by a novel neural network, the proposed method is able to consistently smooth the trajectories of a 6 DOF industrial robot arm within 200 ms on a commercial GPU. We integrate the proposed smoother into a full Vision Motion Planning Execution loop and demonstrate a realtime, smooth, performance of an industrial robot subject to dynamic obstacles.


Unsupervised deep learning techniques for powdery mildew recognition based on multispectral imaging. Objectives. Sustainable management of plant diseases is an open challenge which has relevant economic and environmental impact. Optimal strategies rely on human expertise for field scouting under favourable conditions to assess the current presence and extent of disease symptoms. This labor intensive task is complicated by the large field area to be scouted, combined with the millimeter scale size of the early symptoms to be detected. In view of this, image based detection of early disease symptoms is an attractive approach to automate this process, enabling a potential high throughput monitoring at sustainable costs. Methods. Deep learning has been successfully applied in various domains to obtain an automatic selection of the relevant image features by learning filters via a training procedure. Deep learning has recently entered also the domain of plant disease detection following this idea, in this work we present a deep learning approach to automatically recognize powdery mildew on cucumber leaves. We focus on unsupervised deep learning techniques applied to multispectral imaging data and we propose the use of autoencoder architectures to investigate two strategies for disease detection i) clusterization of features in a compressed space ii) anomaly detection. Results. The two proposed approaches have been assessed by quantitative indices. The clusterization approach is not fully capable by itself to provide accurate predictions but it does cater relevant information. Anomaly detection has instead a significant potential of resolution which could be further exploited as a prior for supervised architectures with a very limited number of labeled samples.


Quasi plurisubharmonic envelopes 2 Bounds on Monge Amp ere volumes. In cite GL21a we have developed a new approach to L infty a priori estimates for degenerate complex Monge Amp ere equations, when the reference form is closed. This simplifying assumption was used to ensure the constancy of the volumes of Monge Amp ere measures. We study here the way these volumes stay away from zero and infinity when the reference form is no longer closed. We establish a transcendental version of the Grauert Riemenschneider conjecture, partially answering conjectures of Demailly P u a un cite DP04 and Boucksom Demailly P u a un Peternell cite BDPP13 . Our approach relies on a fine use of quasi plurisubharmonic envelopes. The results obtained here will be used in cite GL21b for solving degenerate complex Monge Amp ere equations on compact Hermitian varieties.


Quantum invariants of knotoids. In this paper, we construct quantum invariants for knotoid diagrams in mathbb R 2 . The diagrams are arranged with respect to a given direction in the plane ( it Morse knotoids ). A Morse knotoid diagram can be decomposed into basic elementary diagrams each of which is associated to a matrix that yields solutions of the quantum Yang Baxter equation. We recover the bracket polynomial, and define the rotational bracket polynomial, the binary bracket polynomial, the Alexander polynomial, the generalized Alexander polynomial and an infinity of specializations of the Homflypt polynomial for Morse knotoids via quantum state sum models.


Few shot Intent Classification and Slot Filling with Retrieved Examples. Few shot learning arises in important practical scenarios, such as when a natural language understanding system needs to learn new semantic labels for an emerging, resource scarce domain. In this paper, we explore retrieval based methods for intent classification and slot filling tasks in few shot settings. Retrieval based methods make predictions based on labeled examples in the retrieval index that are similar to the input, and thus can adapt to new domains simply by changing the index without having to retrain the model. However, it is non trivial to apply such methods on tasks with a complex label space like slot filling. To this end, we propose a span level retrieval method that learns similar contextualized representations for spans with the same label via a novel batch softmax objective. At inference time, we use the labels of the retrieved spans to construct the final structure with the highest aggregated score. Our method outperforms previous systems in various few shot settings on the CLINC and SNIPS benchmarks.


On the prime graph of a finite group with unique nonabelian composition factor. We say that finite groups are isospectral if they have the same sets of orders of elements. It is known that every nonsolvable finite group G isospectral to a finite simple group has a unique nonabelian composition factor, that is, the quotient of G by the solvable radical of G is an almost simple group. The main goal of this paper is prove that this almost simple group is a cyclic extension of its socle. To this end, we consider a general situation when G is an arbitrary group with unique nonabelian composition factor, not necessarily isospectral to a simple group, and study the prime graph of G , where the prime graph of G is the graph whose vertices are the prime numbers dividing the order of G and two such numbers r and s are adjacent if and only if r neq s and G has an element of order rs . Namely, we establish some sufficient conditions for the prime graph of such a group to have a vertex adjacent to all other vertices. Besides proving the main result, this allows us to refine a recent result by P. Cameron and N. Maslova concerning finite groups almost recognizable by prime graph.


Capacity Achieving Uncoded PIR Protocol based on Combinatorial Designs. In this paper we study the problem of private information retrieval where a user seeks to retrieve one of the F files from a cluster of N non colluding servers without revealing the identity of the requested file. In our setting the servers are storage constrained in that they can only store a fraction mu t N of each file. Furthermore, we assume that the files are stored in an uncoded fashion. The rate of a PIR protocol is defined as the ratio of the file size and the total number of bits downloaded. The maximum achievable rate is referred to as capacity. It was previously shown that there are capacity achieving PIR protocols when the file size is N F and complete files were stored on all the servers. These results were further extended for the case when servers store only a fraction of each file. However, the subpacketization v of the files required is exponential in the number of servers N . We propose a novel uncoded PIR protocol based on combinatorial designs that are also capacity achieving when the file size is v times t F . Our protocol has linear subpacketization in the number of servers in contrast to previous work in storage constrained uncoded PIR schemes. In the proposed PIR protocol, the given system is projected to multiple instances of reduced systems with replicated servers having full storage capacity. The subfiles stored in these various instances are separately retrieved and lifted to solve the PIR problem for the original system.


Comparing free space and fibre coupled detectors for Fabry P 'erot based all optical photoacoustic tomography. All optical ultrasound detection bears unique advantages for photoacoustics, including wider detection bandwidth, higher signal to noise per unit area and lower susceptibility to electromagnetic noise. These benefits have established optical ultrasound detection as a key method for photoacoustic applications in biology and medicine. However, the use of free space detectors renders this approach sensitive to optical aberrations, which can degrade the pressure sensitivity and result in deteriorated image quality. While spatial mode filtering through fibers has been proposed to alleviate these problems in Fabry P 'erot based pressure sensors, their real functional advantage has never been properly investigated. In this paper we rigorously and quantitatively compare the performance of free space and fibre coupled detectors in a custom correlative setup. We demonstrate the superiority of the latter in terms of both signal level and image quality in realistic all optical photoacoustic tomography settings.


K 1 injectivity of the Paschke dual algebra, and uniqueness. We prove that a large class of Paschke dual algebras of simple unital C algebras are K 1 injective. As a consequence, we obtain interesting KK uniqueness theorems which generalize the Brown Douglas Fillmore essential codimension property.


On the Geometric Zilber Pink Theorem and the Lawrence Venkatesh method. Using our recent results on the algebraicity of the Hodge locus for variations of Hodge structures of level at least 3 , we improve the results of Lawrence Venkatesh in direction of the refined Bombieri Lang conjecture.


Design Challenges for a Multi Perspective Search Engine. Many users turn to document retrieval systems (e.g. search engines) to seek answers to controversial questions. Answering such user queries usually require identifying responses within web documents, and aggregating the responses based on their different perspectives. Classical document retrieval systems fall short at delivering a set of direct and diverse responses to the users. Naturally, identifying such responses within a document is a natural language understanding task. In this paper, we examine the challenges of synthesizing such language understanding objectives with document retrieval, and study a new perspective oriented document retrieval paradigm. We discuss and assess the inherent natural language understanding challenges in order to achieve the goal. Following the design challenges and principles, we demonstrate and evaluate a practical prototype pipeline system. We use the prototype system to conduct a user survey in order to assess the utility of our paradigm, as well as understanding the user information needs for controversial queries.


MPLR a novel model for multi target learning of logical rules for knowledge graph reasoning. Large scale knowledge graphs (KGs) provide structured representations of human knowledge. However, as it is impossible to contain all knowledge, KGs are usually incomplete. Reasoning based on existing facts paves a way to discover missing facts. In this paper, we study the problem of learning logic rules for reasoning on knowledge graphs for completing missing factual triplets. Learning logic rules equips a model with strong interpretability as well as the ability to generalize to similar tasks. We propose a model called MPLR that improves the existing models to fully use training data and multi target scenarios are considered. In addition, considering the deficiency in evaluating the performance of models and the quality of mined rules, we further propose two novel indicators to help with the problem. Experimental results empirically demonstrate that our MPLR model outperforms state of the art methods on five benchmark datasets. The results also prove the effectiveness of the indicators.


Whittle Index for A Class of Restless Bandits with Imperfect Observations. We consider a class of restless bandit problems that finds a broad application area in stochastic optimization, reinforcement learning and operations research. In our model, there are N independent 2 state Markov processes that may be observed and accessed for accruing rewards. The observation is error prone, i.e., both false alarm and miss detection may happen. Furthermore, the user can only choose a subset of M (M N) processes to observe at each discrete time. If a process in state 1 is correctly observed, then it will offer some reward. Due to the partial and imperfect observation model, the system is formulated as a restless multi armed bandit problem with an information state space of uncountable cardinality. Restless bandit problems with finite state spaces are PSPACE HARD in general. In this paper, we establish a low complexity algorithm that achieves a strong performance for this class of restless bandits. Under certain conditions, we theoretically prove the existence (indexability) of Whittle index and its equivalence to our algorithm. When those conditions do not hold, we show by numerical experiments the near optimal performance of our algorithm in general.


Analyzing Online Political Advertisements. Online political advertising is a central aspect of modern election campaigning for influencing public opinion. Computational analysis of political ads is of utmost importance in political science to understand the characteristics of digital campaigning. It is also important in computational linguistics to study features of political discourse and communication on a large scale. In this work, we present the first computational study on online political ads with the aim to (1) infer the political ideology of an ad sponsor and (2) identify whether the sponsor is an official political party or a third party organization. We develop two new large datasets for the two tasks consisting of ads from the U.S.. Evaluation results show that our approach that combines textual and visual information from pre trained neural models outperforms a state of the art method for generic commercial ad classification. Finally, we provide an in depth analysis of the limitations of our best performing models and linguistic analysis to study the characteristics of political ads discourse.


Data driven Algorithms for signal processing with trigonometric rational functions. Rational approximation schemes for reconstructing periodic signals from samples with poorly separated spectral content are described. These methods are automatic and adaptive, requiring no tuning or manual parameter selection. Collectively, they form a framework for fitting trigonometric rational models to data that is robust to various forms of corruption, including additive Gaussian noise, perturbed sampling grids, and missing data. Our approach combines a variant of Prony's method with a modified version of the AAA algorithm. Using representations in both frequency and time space, a collection of algorithms is described for adaptively computing with trigonometric rationals. This includes procedures for differentiation, filtering, convolution, and more. A new MATLAB software system based on these algorithms is introduced. Its effectiveness is illustrated with synthetic and practical examples drawn from applications including biomedical monitoring, acoustic denoising, and feature detection.


Video Imprint. A new unified video analytics framework (ER3) is proposed for complex event retrieval, recognition and recounting, based on the proposed video imprint representation, which exploits temporal correlations among image features across video frames. With the video imprint representation, it is convenient to reverse map back to both temporal and spatial locations in video frames, allowing for both key frame identification and key areas localization within each frame. In the proposed framework, a dedicated feature alignment module is incorporated for redundancy removal across frames to produce the tensor representation, i.e., the video imprint. Subsequently, the video imprint is individually fed into both a reasoning network and a feature aggregation module, for event recognition recounting and event retrieval tasks, respectively. Thanks to its attention mechanism inspired by the memory networks used in language modeling, the proposed reasoning network is capable of simultaneous event category recognition and localization of the key pieces of evidence for event recounting. In addition, the latent structure in our reasoning network highlights the areas of the video imprint, which can be directly used for event recounting. With the event retrieval task, the compact video representation aggregated from the video imprint contributes to better retrieval results than existing state of the art methods.


Deep Visual Anomaly detection with Negative Learning. With the increase in the learning capability of deep convolution based architectures, various applications of such models have been proposed over time. In the field of anomaly detection, improvements in deep learning opened new prospects of exploration for the researchers whom tried to automate the labor intensive features of data collection. First, in terms of data collection, it is impossible to anticipate all the anomalies that might exist in a given environment. Second, assuming we limit the possibilities of anomalies, it will still be hard to record all these scenarios for the sake of training a model. Third, even if we manage to record a significant amount of abnormal data, it's laborious to annotate this data on pixel or even frame level. Various approaches address the problem by proposing one class classification using generative models trained on only normal data. In such methods, only the normal data is used, which is abundantly available and doesn't require significant human input. However, these are trained with only normal data and at the test time, given abnormal data as input, may often generate normal looking output. This happens due to the hallucination characteristic of generative models. Next, these systems are designed to not use abnormal examples during the training. In this paper, we propose anomaly detection with negative learning (ADNL), which employs the negative learning concept for the enhancement of anomaly detection by utilizing a very small number of labeled anomaly data as compared with the normal data during training. The idea is to limit the reconstruction capability of a generative model using the given a small amount of anomaly examples. This way, the network not only learns to reconstruct normal data but also encloses the normal distribution far from the possible distribution of anomalies.


Many Objective Beam Dynamics Optimization for High Repetition Rate XFEL Photoinjector. SHINE, as the first hard x ray free electron laser (FEL) facility in China, is designed to provide high brightness FEL lasing under high repetition rate operation mode. In order to drive x ray FEL pulses with high qualities, the photoinjector section is deployed to provide the specified electron beam with low transverse emittance and high brightness. Normally the multi objective optimization algorithm is employed in the injector beam dynamics design. In this paper, the many objective optimization algorithm NSGA III is introduced to the injector physical design for optimizing the 4 beam quality properties for the first time. The results of the optimization are presented and analyzed. The application of NSGA III can provide guidance for further physical research as well as improve the beam dynamics optimization efficiency.


A simpler proof of the Sternfeld theorem. In Sternfeld's work on Kolmogorov Superposition Theorem appeared combinatorial geometric notions of a basic set and of a Sternfeld's array. A subset K subset mathbb R d is basic if for any continuous function f colon K to mathbb R there are continuous functions varphi 1, ldots, varphi d colon mathbb R to mathbb R such that f(x) sum limits k 1 d varphi k(x k) for each x in K . The notion of a Sternfeld's array will be introduced in the paper. Sternfeld Theorem. If a closed bounded subset K subset mathbb R 2n contains Sternfeld arrays of arbitrary large size then K is not basic.


Mixed Neumann Fourier expressions for solving integral equations. While teaching a course on integral equations, I noticed that a straightforward combination of Neumann series and Fourier series for the resolvent (or the solution) of an integral equation has good approximation qualities. This short article presents and investigates this combination of approximating series.


Worbel Aggregating Point Labels into Word Clouds. Point feature labeling is a classical problem in cartography and GIS that has been extensively studied for geospatial point data. At the same time, word clouds are a popular visualization tool to show the most important words in text data which has also been extended to visualize geospatial data (Buchin et al. PacificVis 2016). In this paper, we study a hybrid visualization, which combines aspects of word clouds and point labeling. In the considered setting, the input data consists of a set of points grouped into categories and our aim is to place multiple disjoint and axis aligned rectangles, each representing a category, such that they cover points of (mostly) the same category under some natural quality constraints. In our visualization, we then place category names inside the computed rectangles to produce a labeling of the covered points which summarizes the predominant categories globally (in a word cloud like fashion) while locally avoiding excessive misrepresentation of points (i.e., retaining the precision of point labeling). We show that computing a minimum set of such rectangles is NP hard. Hence, we turn our attention to developing heuristics and exact SAT models to compute our visualizations. We evaluate our algorithms quantitatively, measuring running time and quality of the produced solutions, on several artificial and real world data sets. Our experiments show that the heuristics produce solutions of comparable quality to the SAT models while running much faster.


Restricted Dyck Paths on Valleys Sequence. In this paper we study a subfamily of a classic lattice path, the emph Dyck paths , called emph restricted d Dyck paths, in short d Dyck. A valley of a Dyck path P is a local minimum of P if the difference between the heights of two consecutive valleys (from left to right) is at least d , we say that P is a restricted d Dyck path. The emph area of a Dyck path is the sum of the absolute values of y components of all points in the path. We find the number of peaks and the area of all paths of a given length in the set of d Dyck paths. We give a bivariate generating function to count the number of the d Dyck paths with respect to the the semi length and number of peaks. After that, we analyze in detail the case d 1 . Among other things, we give both, the generating function and a recursive relation for the total area.


TokenLearner What Can 8 Learned Tokens Do for Images and Videos?. In this paper, we introduce a novel visual representation learning which relies on a handful of adaptively learned tokens, and which is applicable to both image and video understanding tasks. Instead of relying on hand designed splitting strategies to obtain visual tokens and processing a large number of densely sampled patches for attention, our approach learns to mine important tokens in visual data. This results in efficiently and effectively finding a few important visual tokens and enables modeling of pairwise attention between such tokens, over a longer temporal horizon for videos, or the spatial content in images. Our experiments demonstrate strong performance on several challenging benchmarks for both image and video recognition tasks. Importantly, due to our tokens being adaptive, we accomplish competitive results at significantly reduced compute amount. We obtain comparable results to the state of the arts on ImageNet while being computationally more efficient. We also confirm the effectiveness of the approach on multiple video datasets, including Kinetics 400, Kinetics 600, Charades, and AViD. The code is available at https github.com google research scenic tree main scenic projects token learner


ASBERT Siamese and Triplet network embedding for open question answering. Answer selection (AS) is an essential subtask in the field of natural language processing with an objective to identify the most likely answer to a given question from a corpus containing candidate answer sentences. A common approach to address the AS problem is to generate an embedding for each candidate sentence and query. Then, select the sentence whose vector representation is closest to the query's. A key drawback is the low quality of the embeddings, hitherto, based on its performance on AS benchmark datasets. In this work, we present ASBERT, a framework built on the BERT architecture that employs Siamese and Triplet neural networks to learn an encoding function that maps a text to a fixed size vector in an embedded space. The notion of distance between two points in this space connotes similarity in meaning between two texts. Experimental results on the WikiQA and TrecQA datasets demonstrate that our proposed approach outperforms many state of the art baseline methods.


Relay Reconfigurable Intelligent Surface Cooperation for Energy Efficient Multiuser Systems. Reconfigurable intelligent surfaces (RIS) have drawn considerable attention recently due to their controllable scattering elements that are able to direct electromagnetic waves into desirable directions. Although RISs share some similarities with relays, the two have fundamental differences impacting their performance. To harness the benefits of both relaying and RISs, a multi user communication system is proposed in this paper wherein a relay and an RIS cooperate to improve performance in terms of energy efficiency. To utilize the RIS efficiently, the discrete phase shifts of the RIS elements are optimized along with the beamforming matrices at the transmitter and the relay, targeting the minimization of the total transmit power subject to a quality of service (QoS) constraint. Then, two suboptimal efficient solutions are proposed for the resulting discrete and non convex problem, one based on singular value decomposition (SVD) and uplink downlink duality and the other is based on SVD combined with zero forcing. Simulations show that the proposed solutions outperform a system with either a relay or an RIS only, especially when both are closer to the users than to the base station.


Reflections about holographic and non holographic acquisition of surface topography. Recording and (computational) processing of complex wave fields offers a vast realm of new optical methods. Also for optical 3D metrology. We discuss fundamental similarities and differences of holographic surface topography measurement versus non holographic principles, such as triangulation, classical interferometry, rough surface interferometry and slope measuring methods. Key features are the physical origin of the ultimate precision limit and how the topographic information is encoded and decoded. We demonstrate that the question "is holography just interferometry?" has different answers, depending on how we exploit holograms or interferograms for metrology. The answers will help users to find out if their measurement results could be improved or if they already hit the ultimate limit of what physics allows.


Break It Fix It Unsupervised Learning for Program Repair. We consider repair tasks given a critic (e.g., compiler) that assesses the quality of an input, the goal is to train a fixer that converts a bad example (e.g., code with syntax errors) into a good one (e.g., code with no syntax errors). Existing works create training data consisting of (bad, good) pairs by corrupting good examples using heuristics (e.g., dropping tokens). However, fixers trained on this synthetically generated data do not extrapolate well to the real distribution of bad inputs. To bridge this gap, we propose a new training approach, Break It Fix It (BIFI), which has two key ideas (i) we use the critic to check a fixer's output on real bad inputs and add good (fixed) outputs to the training data, and (ii) we train a breaker to generate realistic bad code from good code. Based on these ideas, we iteratively update the breaker and the fixer while using them in conjunction to generate more paired data. We evaluate BIFI on two code repair datasets GitHub Python, a new dataset we introduce where the goal is to repair Python code with AST parse errors and DeepFix, where the goal is to repair C code with compiler errors. BIFI outperforms existing methods, obtaining 90.5 repair accuracy on GitHub Python ( 28.5 ) and 71.7 on DeepFix ( 5.6 ). Notably, BIFI does not require any labeled data we hope it will be a strong starting point for unsupervised learning of various repair tasks.


FedMood Federated Learning on Mobile Health Data for Mood Detection. Depression is one of the most common mental illness problems, and the symptoms shown by patients are not consistent, making it difficult to diagnose in the process of clinical practice and pathological research. Although researchers hope that artificial intelligence can contribute to the diagnosis and treatment of depression, the traditional centralized machine learning needs to aggregate patient data, and the data privacy of patients with mental illness needs to be strictly confidential, which hinders machine learning algorithms clinical application. To solve the problem of privacy of the medical history of patients with depression, we implement federated learning to analyze and diagnose depression. First, we propose a general multi view federated learning framework using multi source data, which can extend any traditional machine learning model to support federated learning across different institutions or parties. Secondly, we adopt late fusion methods to solve the problem of inconsistent time series of multi view data. Finally, we compare the federated framework with other cooperative learning frameworks in performance and discuss the related results.


Revisiting Methods for Finding Influential Examples. Several instance based explainability methods for finding influential training examples for test time decisions have been proposed recently, including Influence Functions, TraceIn, Representer Point Selection, Grad Dot, and Grad Cos. Typically these methods are evaluated using LOO influence (Cook's distance) as a gold standard, or using various heuristics. In this paper, we show that all of the above methods are unstable, i.e., extremely sensitive to initialization, ordering of the training data, and batch size. We suggest that this is a natural consequence of how in the literature, the influence of examples is assumed to be independent of model state and other examples and argue it is not. We show that LOO influence and heuristics are, as a result, poor metrics to measure the quality of instance based explanations, and instead propose to evaluate such explanations by their ability to detect poisoning attacks. Further, we provide a simple, yet effective baseline to improve all of the above methods and show how it leads to very significant improvements on downstream tasks.


A Longitudinal Analysis on Instagram Characteristics of Olympic Champions. This study examines Olympic champions characteristics on Instagram to first understand how age and gender affect the characteristics and their interrelations and second to see if the future changes in those characteristics are predictable. We crawled Instagram data of individual gold medalists in Rio2016 Olympic for a period of 4 months and utilized a content analytic method to analyze their photograph posts. The cross sectional analysis shows as the champions get older, the rate of follower engagement decreases in both genders, but men increase their pure self presentation posts while women extend their circle of followings. In its approval, the longitudinal analysis shows when the higher rate of engagement is achieved, then men and women champions lose their tendency in increasing self presenting posts and number of followings respectively. These findings in the light of relative theories and the previous literature contribute to a better understanding of athletes cyber behavior in social media. Moreover, the findings serve as a guide for sport researchers seeking to grasp the ways that aid athletes to better interact with their followers and build the personal brand, which involves sponsorship and other promotional opportunities.


Designs in finite metric spaces a probabilistic approach. A finite metric space is called here distance degree regular if its distance degree sequence is the same for every vertex. A notion of designs in such spaces is introduced that generalizes that of designs in Q polynomial distance regular graphs. An approximation of their cumulative distribution function, based on the notion of Christoffel function in approximation theory is given. As an application we derive limit laws on the weight distributions of binary orthogonal arrays of strength going to infinity. An analogous result for combinatorial designs of strength going to infinity is given.


Greedy Randomized and Maximal Weighted Residual Kaczmarz Methods with Oblique Projection. For solving large scale consistent linear system, we combine two efficient row index selection strategies with Kaczmarz type method with oblique projection, and propose a greedy randomized Kaczmarz method with oblique projection (GRKO) and the maximal weighted residual Kaczmarz method with oblique projection (MWRKO) . Through those method, the number of iteration steps and running time can be reduced to a greater extent to find the least norm solution, especially when the rows of matrix A are close to linear correlation. Theoretical proof and numerical results show that GRKO method and MWRKO method are more effective than greedy randomized Kaczmarz method and maximal weighted residual Kaczmarz method respectively.


Understanding Information Spreading Mechanisms During COVID 19 Pandemic by Analyzing the Impact of Tweet Text and User Features for Retweet Prediction. COVID 19 has affected the world economy and the daily life routine of almost everyone. It has been a hot topic on social media platforms such as Twitter, Facebook, etc. These social media platforms enable users to share information with other users who can reshare this information, thus causing this information to spread. Twitter's retweet functionality allows users to share the existing content with other users without altering the original content. Analysis of social media platforms can help in detecting emergencies during pandemics that lead to taking preventive measures. One such type of analysis is predicting the number of retweets for a given COVID 19 related tweet. Recently, CIKM organized a retweet prediction challenge for COVID 19 tweets focusing on using numeric features only. However, our hypothesis is, tweet text may play a vital role in an accurate retweet prediction. In this paper, we combine numeric and text features for COVID 19 related retweet predictions. For this purpose, we propose two CNN and RNN based models and evaluate the performance of these models on a publicly available TweetsCOV19 dataset using seven different evaluation metrics. Our evaluation results show that combining tweet text with numeric features improves the performance of retweet prediction significantly.


Adaptive Verifiable Coded Computing Towards Fast, Secure and Private Distributed Machine Learning. Stragglers, Byzantine workers, and data privacy are the main bottlenecks in distributed cloud computing. Some prior works proposed coded computing strategies to jointly address all three challenges. They require either a large number of workers, a significant communication cost or a significant computational complexity to tolerate Byzantine workers. Much of the overhead in prior schemes comes from the fact that they tightly couple coding for all three problems into a single framework. In this paper, we propose Adaptive Verifiable Coded Computing (AVCC) framework that decouples the Byzantine node detection challenge from the straggler tolerance. AVCC leverages coded computing just for handling stragglers and privacy, and then uses an orthogonal approach that leverages verifiable computing to mitigate Byzantine workers. Furthermore, AVCC dynamically adapts its coding scheme to trade off straggler tolerance with Byzantine protection. We evaluate AVCC on a compute intensive distributed logistic regression application. Our experiments show that AVCC achieves up to 4.2 times speedup and up to 5.1 accuracy improvement over the state of the art Lagrange coded computing approach (LCC). AVCC also speeds up the conventional uncoded implementation of distributed logistic regression by up to 7.6 times , and improves the test accuracy by up to 12.1 .


Finding the Gap Neuromorphic Motion Vision in Cluttered Environments. Many animals meander in environments and avoid collisions. How the underlying neuronal machinery can yield robust behaviour in a variety of environments remains unclear. In the fly brain, motion sensitive neurons indicate the presence of nearby objects and directional cues are integrated within an area known as the central complex. Such neuronal machinery, in contrast with the traditional stream based approach to signal processing, uses an event based approach, with events occurring when changes are sensed by the animal. Contrary to von Neumann computing architectures, event based neuromorphic hardware is designed to process information in an asynchronous and distributed manner. Inspired by the fly brain, we model, for the first time, a neuromorphic closed loop system mimicking essential behaviours observed in flying insects, such as meandering in clutter and gap crossing, which are highly relevant for autonomous vehicles. We implemented our system both in software and on neuromorphic hardware. While moving through an environment, our agent perceives changes in its surroundings and uses this information for collision avoidance. The agent's manoeuvres result from a closed action perception loop implementing probabilistic decision making processes. This loop closure is thought to have driven the development of neural circuitry in biological agents since the Cambrian explosion. In the fundamental quest to understand neural computation in artificial agents, we come closer to understanding and modelling biological intelligence by closing the loop also in neuromorphic systems. As a closed loop system, our system deepens our understanding of processing in neural networks and computations in biological and artificial systems. With these investigations, we aim to set the foundations for neuromorphic intelligence in the future, moving towards leveraging the full potential of neuromorphic systems.


Towards Verifiable Remote Voting with Paper Assurance. We propose a protocol for verifiable remote voting with paper assurance. It is intended to augment existing postal voting procedures, allowing a ballot to be electronically constructed, printed on paper, then returned in the post. It allows each voter to verify that their vote has been correctly cast, recorded and tallied by the Electoral Commission. The system is not end to end verifiable, but does allow voters to detect manipulation by an adversary who controls either the voting device, or (the postal service and electoral commission) but not both. The protocol is not receipt free, but if the client honestly follows the protocol (including possibly remembering everything), they cannot subsequently prove how they voted. Our proposal is the first to combine plain paper assurance with cryptographic verification in a (passively) receipt free manner.


Trade offs between sustainable development goals in systems of cities. Sustainable Development Goals are intrinsically competing, but their embedding into urban systems furthermore emphasises such compromises, due to spatial complexity, the non optimal nature of such systems, and multi objective aspects of their agents, among other reasons. We propose in this paper to use a stylised simulation model for systems of cities, focused on innovation diffusion and population dynamics, to show how trade offs may operate at such a scale. We proceed in particular to a bi objective optimisation of emissions and innovation utilities, and show that no single urban optimum exists, but a diversity of regimes forming a compromise between the two objectives.


The first order definability of generic large cardinals. We show that the notions of generic and Laver generic supercompactness are first order definable in the language of ZFC. This also holds for generic and Laver generic (almost) hugeness as well as for generic versions of other large cardinals.


Application of HL7 FHIR in a Microservice Architecture for Patient Navigation on Registration and Appointments. Electronic Health Record Systems (EHR S) are commonly developed in monolithic architectures. This architectural style presents greater complexity and demands more effort when we think of interoperability. A solution proposal is the creation of Microservices that use HL7 FHIR as an interoperability strategy. In this sense, it is presented the development of a prototype, based on a microservices architecture, to act in a real scenario of Patient Navigation (PN). The problem was subdivided into 3 steps definition of architecture, development and construction of an interface to simulate the role of the navigator. The Patient and Appointment microservices are capable of synchronous communication to query and record information. In general, the implemented architectural style not only isolates information domains but can receive data from multiple sources while maintaining essential functionality. This type of approach plays a crucial role in a hospital environment, specifically in PN, highlighting the importance of the standard and expanding the possibilities for further research to be conducted.


Khovanov type homologies of null homologous links in mathbb RP 3 . Let L be a null homologous link in mathbb RP 3 . We define Khovanov type homologies of L which depend on an extra input alpha (V 0,V 1,f,g) consisting of two graded vectors spaces and two maps between them. With some specific choice of alpha alpha APS , we recover the categorification of the Kauffman bracket due to Asaeda Przytycki Sikora. With another choice of alpha alpha HF , we construct a spectral sequence from our theory converging to the Heegaard Floer homology of the even branched double cover of mathbb RP 3 .


Task oriented Communication System Design in Cyber Physical Systems A Survey on Theory and Applications. Communications system design has been traditionally guided by task agnostic principles, which aim at efficiently transmitting as many correct bits as possible through a given channel. However, in the era of cyber physical systems, the effectiveness of communications is not dictated simply by the bit rate, but most importantly by the efficient completion of the task in hand, e.g., controlling remotely a robot, automating a production line or collaboratively sensing through a drone swarm. In parallel, it is projected that by 2023, half of the worldwide network connections will be among machines rather than humans. In this context, it is crucial to establish a new paradigm for designing communications strategies for multi agent cyber physical systems. This is a daunting task, since it requires a combination of principles from information, communication, control theories and computer science in order to formalize a general framework for task oriented communication design. In this direction, this paper reviews and structures the relevant theoretical work across a wide range of scientific communities. Subsequently, it proposes a general conceptual framework for task oriented communication design, along with its specializations according to the targeted use case. Furthermore, it provides a survey of relevant contributions in dominant applications, such as industrial internet of things, multi UAV systems, tactile internet, autonomous vehicles, distributed learning systems, smart manufacturing plants and 5G and beyond self organizing networks. Finally, it highlights the most important open research topics from both the theoretical framework and application points of view.


ReSSL Relational Self Supervised Learning with Weak Augmentation. Self supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information ( ie, the different augmented images of the same instance should have the same feature or cluster into the same class), but there is a lack of attention on the relationships between different instances. In this paper, we introduced a novel SSL paradigm, which we term as relational self supervised learning (ReSSL) framework that learns representations by modeling the relationship between different instances. Specifically, our proposed method employs sharpened distribution of pairwise similarities among different instances as textit relation metric, which is thus utilized to match the feature embeddings of different augmentations. Moreover, to boost the performance, we argue that weak augmentations matter to represent a more reliable relation, and leverage momentum strategy for practical efficiency. Experimental results show that our proposed ReSSL significantly outperforms the previous state of the art algorithms in terms of both performance and training efficiency. Code is available at url https github.com KyleZheng1997 ReSSL .


High Performance Photonic Transformers for DC Voltage Conversion. Direct current (DC) converters play an essential role in electronic circuits. Conventional high efficiency DC voltage converters, especially step up type, rely on switch mode operation, where energy is periodically stored within and released from inductors and or capacitors connected in a variety of circuit topologies. However, since these energy storage components, especially inductors, are difficult to scale down, miniaturization of switching converters for on chip or in package electronics faces fundamental challenges. Furthermore, the resulting switching currents produce electromagnetic noise, which can cause interference problems in nearby circuits, and even acoustic noise and mechanical vibrations that deteriorate the environment. In order to overcome the limitations of switch mode converters, photonic transformers, where voltage conversion is achieved through the use of light emission and detection processes, have been demonstrated. However, the demonstrated efficiency is significantly below that of the switch mode converter. Here we perform a theoretical analysis based on detailed balance, which shows that with a monolithically integrated design that enables efficient photon transport, the photonic transformer can operate with a near unity conversion efficiency and high voltage conversion ratio. We validate the theoretical analysis with an experiment on a transformer constructed with off the shelf discrete components. Our experiment showcases near noiseless operation, as well as a voltage conversion ratio that is significantly higher than obtained in previous photonic transformer works. Our finding points to a high performance optical solution to miniaturizing DC power converters for electronics and improving the electromagnetic compatibility and quality of electrical power.


EventHPE Event based 3D Human Pose and Shape Estimation. Event camera is an emerging imaging sensor for capturing dynamics of moving objects as events, which motivates our work in estimating 3D human pose and shape from the event signals. Events, on the other hand, have their unique challenges rather than capturing static body postures, the event signals are best at capturing local motions. This leads us to propose a two stage deep learning approach, called EventHPE. The first stage, FlowNet, is trained by unsupervised learning to infer optical flow from events. Both events and optical flow are closely related to human body dynamics, which are fed as input to the ShapeNet in the second stage, to estimate 3D human shapes. To mitigate the discrepancy between image based flow (optical flow) and shape based flow (vertices movement of human body shape), a novel flow coherence loss is introduced by exploiting the fact that both flows are originated from the identical human motion. An in house event based 3D human dataset is curated that comes with 3D pose and shape annotations, which is by far the largest one to our knowledge. Empirical evaluations on DHP19 dataset and our in house dataset demonstrate the effectiveness of our approach.


Spatio Temporal meets Wavelet Disentangled Traffic Flow Forecasting via Efficient Spectral Graph Attention Network. Traffic forecasting is crucial for public safety and resource optimization, yet is very challenging due to three aspects i) current existing works mostly exploit intricate temporal patterns (e.g., the short term thunderstorm and long term daily trends) within a single method, which fail to accurately capture spatio temporal dependencies under different schemas ii) the under exploration of the graph positional encoding limit the extraction of spatial information in the commonly used full graph attention network iii) the quadratic complexity of the full graph attention introduces heavy computational needs. To achieve the effective traffic flow forecasting, we propose an efficient spectral graph attention network with disentangled traffic sequences. Specifically, the discrete wavelet transform is leveraged to obtain the low and high frequency components of traffic sequences, and a dual channel encoder is elaborately designed to accurately capture the spatio temporal dependencies under long and short term schemas of the low and high frequency components. Moreover, a novel wavelet based graph positional encoding and a query sampling strategy are introduced in our spectral graph attention to effectively guide message passing and efficiently calculate the attention. Extensive experiments on four real world datasets show the superiority of our model, i.e., the higher traffic forecasting precision with lower computational cost.


Neural Attention Aware Hierarchical Topic Model. Neural topic models (NTMs) apply deep neural networks to topic modelling. Despite their success, NTMs generally ignore two important aspects (1) only document level word count information is utilized for the training, while more fine grained sentence level information is ignored, and (2) external semantic knowledge regarding documents, sentences and words are not exploited for the training. To address these issues, we propose a variational autoencoder (VAE) NTM model that jointly reconstructs the sentence and document word counts using combinations of bag of words (BoW) topical embeddings and pre trained semantic embeddings. The pre trained embeddings are first transformed into a common latent topical space to align their semantics with the BoW embeddings. Our model also features hierarchical KL divergence to leverage embeddings of each document to regularize those of their sentences, thereby paying more attention to semantically relevant sentences. Both quantitative and qualitative experiments have shown the efficacy of our model in 1) lowering the reconstruction errors at both the sentence and document levels, and 2) discovering more coherent topics from real world datasets.


Using Deep Neural Networks to Predict and Improve the Performance of Polar Codes. Polar codes can theoretically achieve very competitive Frame Error Rates. In practice, their performance may depend on the chosen decoding procedure, as well as other parameters of the communication system they are deployed upon. As a consequence, designing efficient polar codes for a specific context can quickly become challenging. In this paper, we introduce a methodology that consists in training deep neural networks to predict the frame error rate of polar codes based on their frozen bit construction sequence. We introduce an algorithm based on Projected Gradient Descent that leverages the gradient of the neural network function to generate promising frozen bit sequences. We showcase on generated datasets the ability of the proposed methodology to produce codes more efficient than those used to train the neural networks, even when the latter are selected among the most efficient ones.


Structured Diversification Emergence via Reinforced Organization Control and Hierarchical Consensus Learning. When solving a complex task, humans will spontaneously form teams and to complete different parts of the whole task, respectively. Meanwhile, the cooperation between teammates will improve efficiency. However, for current cooperative MARL methods, the cooperation team is constructed through either heuristics or end to end blackbox optimization. In order to improve the efficiency of cooperation and exploration, we propose a structured diversification emergence MARL framework named sc Rochico based on reinforced organization control and hierarchical consensus learning. sc Rochico first learns an adaptive grouping policy through the organization control module, which is established by independent multi agent reinforcement learning. Further, the hierarchical consensus module based on the hierarchical intentions with consensus constraint is introduced after team formation. Simultaneously, utilizing the hierarchical consensus module and a self supervised intrinsic reward enhanced decision module, the proposed cooperative MARL algorithm sc Rochico can output the final diversified multi agent cooperative policy. All three modules are organically combined to promote the structured diversification emergence. Comparative experiments on four large scale cooperation tasks show that sc Rochico is significantly better than the current SOTA algorithms in terms of exploration efficiency and cooperation strength.


Functional Calculus via the extension technique a first hitting time approach. In this article, we present a solution to the problem "Which type of linear operators can be realized by the Dirichlet to Neumann operator associated with the operator Delta a(z) frac partial 2 partial z 2 on an extension problem?", which was raised in the pioneering work Comm. Par.Diff. Equ. 32 (2007) by Caffarelli and Silvestre. In fact, we even go a step further by replacing the negative Laplace operator Delta on mathbb R d by an m accretive operator A on a general Banach space X and the Dirichlet to Neumann operator by the Dirichlet to Wentzell operator. We establish uniqueness of solutions to the extension problem in this general framework, which seems to be new in the literature and independent interest. The aim of this paper is to provide a new Phillips Bochner type functional calculus which uses probabilistic tools from excursion theory. With our method, we are able to characterize all linear operators psi(A) among the class CBF of complete Bernstein functions psi , resulting in a new characterization of the famous Phillips' subordination theorem within this class CBF .


Interpreting Expert Annotation Differences in Animal Behavior. Hand annotated data can vary due to factors such as subjective differences, intra rater variability, and differing annotator expertise. We study annotations from different experts who labelled the same behavior classes on a set of animal behavior videos, and observe a variation in annotation styles. We propose a new method using program synthesis to help interpret annotation differences for behavior analysis. Our model selects relevant trajectory features and learns a temporal filter as part of a program, which corresponds to estimated importance an annotator places on that feature at each timestamp. Our experiments on a dataset from behavioral neuroscience demonstrate that compared to baseline approaches, our method is more accurate at capturing annotator labels and learns interpretable temporal filters. We believe that our method can lead to greater reproducibility of behavior annotations used in scientific studies. We plan to release our code.


Maximum first Zagreb index of orientations of bicyclic graphs with given matching number. Let D (V, A) be a digraphs without isolated vertices. The first Zagreb index of a digraph D defined as a sum of the weights (d u d v) of all uv in A(D) , where d u (resp. d u ) denotes the out degree (resp. in degree) of the vertex u . We solve the problem on the maximal values and maximal digraphs of first Zagreb index over all oriented bicyclic graphs with n vertices and matching number m (3 leq m leq lfloor frac n 2 rfloor) in this paper.


Enhancing business process execution with a context engine. Changes in workflow relevant data of business processes at run time can hinder their completion or impact their profitability as they have been instantiated under different circumstances. The purpose of this paper is to propose a context engine to enhance a business process management (BPM) system's context awareness. The generic architecture provides the flexibility to configure processes during initialization as well as to adapt running instances at decision gates or during execution due to significant context change. The paper discusses context awareness as the conceptual background. The technological capabilities of business rules and complex event processing (CEP) are outlined in an architecture design. A reference process is proposed and discussed in an exemplary application. The results provide an improvement over the current situation of static variable instantiation of business processes with local information. The proposed architecture extends the well known combination of business rules and BPM systems with a context engine based on CEP. The resulting architecture for a BPM system using a context engine is generic in nature and, hence, requires to be contextualized for situated implementations. Implementation success is dependent on the availability of context information and process compensation options. Practitioners receive advice on a reference architecture and technology choices for implementing systems, which can provide and monitor context information for business processes as well as intervene and adapt the execution. Currently, there is no multi purpose non proprietary context engine based on CEP or any other technology available for BPM, which facilitates the adaptation of processes at run time due to changes in context variables. This paper will stimulate a debate between research and practice on suitable design and technology.


How molecular effects affect solutal Marangoni convection. Interfacial tension gradients drive flow along liquid liquid interfaces in a process known as the Marangoni effect. Such gradients can be caused by surfactants, which has been extensively studied in the literature. Less is known of its nanoscale properties, where molecular interfaces display properties separate from bulk liquid matter such as interfacial viscosity. In this report we study the molecular solutal Marangoni effect using molecular dynamics simulations. We show that molecular interfacial effects are important and should be accounted for in nanofluidic regimes. Hydrodynamic models can be extended with effective terms which include them.


Determination of Nanoscale Mechanical Properties of Polymers via Plasmonic Nanoantennas. Nanotechnology and the consequent emergence of miniaturized devices are driving the need to improve our understanding of the mechanical properties of a myriad of materials. Here we focus on amorphous polymeric materials and introduce a new way to determine the nanoscale mechanical response of polymeric thin films in the GHz range, using ultrafast optical means. Coupling of the films to plasmonic nanoantennas excited at their vibrational eigenfrequencies allows the extraction of the values of the mechanical moduli as well as the estimation of the glass transition temperature via time domain measurements, here demonstrated for PMMA films. This nanoscale method can be extended to the determination of mechanical and elastic properties of a wide range of spatially strongly confined materials.


Kernel based Diffusion Approximated Markov Decision Processes for Off Road Autonomous Navigation and Control. We propose a diffusion approximation method to the continuous state Markov Decision Processes (MDPs) that can be utilized to address autonomous navigation and control in unstructured off road environments. In contrast to most decision theoretic planning frameworks that assume fully known state transition models, we design a method that eliminates such a strong assumption that is often extremely difficult to engineer in reality. We first take the second order Taylor expansion of the value function. The Bellman optimality equation is then approximated by a partial differential equation, which only relies on the first and second moments of the transition model. By combining the kernel representation of the value function, we then design an efficient policy iteration algorithm whose policy evaluation step can be represented as a linear system of equations characterized by a finite set of supporting states. We first validate the proposed method through extensive simulations in 2D obstacle avoidance and 2.5D terrain navigation problems. The results show that the proposed approach leads to a much superior performance over several baselines. We then develop a system that integrates our decision making framework with onboard perception and conduct real world experiments in both cluttered indoor and unstructured outdoor environments. The results from the physical systems further demonstrate the applicability of our method in challenging real world environments.


Composable Energy Policies for Reactive Motion Generation and Reinforcement Learning. Reactive motion generation problems are usually solved by computing actions as a sum of policies. However, these policies are independent of each other and thus, they can have conflicting behaviors when summing their contributions together. We introduce Composable Energy Policies (CEP), a novel framework for modular reactive motion generation. CEP computes the control action by optimization over the product of a set of stochastic policies. This product of policies will provide a high probability to those actions that satisfy all the components and low probability to the others. Optimizing over the product of the policies avoids the detrimental effect of conflicting behaviors between policies choosing an action that satisfies all the objectives. Besides, we show that CEP naturally adapts to the Reinforcement Learning problem allowing us to integrate, in a hierarchical fashion, any distribution as prior, from multimodal distributions to non smooth distributions and learn a new policy given them.


A four mean theorem and its application to pseudospectra. Let N ge 4 . We show that, if x 1, dots,x N and y 1, dots,y N are N tuples of strictly positive numbers whose arithmetic, geometric and harmonic means agree, then max j x j (N 2) max j y j quad text and quad min j x j (N 2) min j y j. This is used to show that, if N ge4 and A,B are N times N matrices with super identical pseudospectra, then, for every polynomial p , we have p(A) sqrt N 2 p(B) , unless p(A) p(B) 0 . This improves a previously known inequality to the point of being sharp, at least for N 4 .


Open Vocabulary Instance Segmentation via Robust Cross Modal Pseudo Labeling. Open vocabulary instance segmentation aims at segmenting novel classes without mask annotations. It is an important step toward reducing laborious human supervision. Most existing works first pretrain a model on captioned images covering many novel classes and then finetune it on limited base classes with mask annotations. However, the high level textual information learned from caption pretraining alone cannot effectively encode the details required for pixel wise segmentation. To address this, we propose a cross modal pseudo labeling framework, which generates training pseudo masks by aligning word semantics in captions with visual features of object masks in images. Thus, our framework is capable of labeling novel classes in captions via their word semantics to self train a student model. To account for noises in pseudo masks, we design a robust student model that selectively distills mask knowledge by estimating the mask noise levels, hence mitigating the adverse impact of noisy pseudo masks. By extensive experiments, we show the effectiveness of our framework, where we significantly improve mAP score by 4.5 on MS COCO and 5.1 on the large scale Open Images Conceptual Captions datasets compared to the state of the art.


Multi Feasibility Variable Selection. This paper is the report of the problem proposed for the !Optimizer 2021 competition, and the solutions of the gold medalist team, i.e., the Panda team. The competition was held in two stages, the research and development stage and a two week contest stage, consisting of five rounds, and seven teams succeeded in finishing both stages to the end. In this joint report of the winner team Panda and the problem design committee coordinated by Mojtaba Tefagh, we first explain each of the five rounds and then provide the solutions proposed by our team (Panda) to fulfill the required tasks in the fastest and most accurate way. Afterward, some preprocessing and data manipulating ideas used to enhance the algorithms would be presented. All codes are written in the Julia language, which showed a better performance than Python on optimization problems in our comparisons during the R D stage, and are publicly available in the Github repository https github.com Optimizer Competition Panda


A Ruelle Perron Frobenius theorem for expanding circle maps with an indifferent fixed point. In this note, we establish an original result for the thermodynamic formalism in the context of expanding circle transformations with an indifferent fixed point. For an observable whose continuity modulus is linked to the dynamics near such a fixed point, by identifying an appropriate linear space to evaluate the action of the transfer operator, we show that there is a strictly positive eigenfunction associated with the maximal eigenvalue given as the exponential of the topological pressure. Taking into account also the corresponding eigenmeasure, the invariant probability thus obtained is proved to be the unique Gibbs equilibrium state of the system.


DSC Deep Scan Context Descriptor for Large Scale Place Recognition. LiDAR based place recognition is an essential and challenging task both in loop closure detection and global relocalization. We propose Deep Scan Context (DSC), a general and discriminative global descriptor that captures the relationship among segments of a point cloud. Unlike previous methods that utilize either semantics or a sequence of adjacent point clouds for better place recognition, we only use raw point clouds to get competitive results. Concretely, we first segment the point cloud egocentrically to acquire centroids and eigenvalues of the segments. Then, we introduce a graph neural network to aggregate these features into an embedding representation. Extensive experiments conducted on the KITTI dataset show that DSC is robust to scene variants and outperforms existing methods.


The Optimal Decay Rate of Strong Solution for the Compressible Nematic Liquid Crystal Equations with Large Initial Data. This paper is devoted to establishing the optimal decay rate of the global large solution to compressible nematic liquid crystal equations when the initial perturbation is large and belongs to L 1( mathbb R 3) cap H 2( mathbb R 3) . More precisely, we show that the first and second order spatial derivatives of large solution ( rho 1, u, nabla d)(t) converges to zero at the L 2 rate (1 t) frac54 and L 2 rate (1 t) frac74 respectively, which are optimal in the sense that they coincide with the decay rates of solution to the heat equation. Thus, we establish optimal decay rate for the second order derivative of global large solution studied in 12,18 since the compressible nematic liquid crystal flow becomes the compressible Navier Stokes equations when the director is a constant vector. It is worth noticing that there is no decay loss for the highest order spatial derivative of solution although the associated initial perturbation is large. Moreover, we also establish the lower bound of decay rates of ( rho 1, u, nabla d)(t) itself and its spatial derivative, which coincide with the upper one. Therefore, the decay rates of global large solution nabla 2( rho 1,u, nabla d)(t) (k 0,1,2) are actually optimal.


BERT SE A Pre trained Language Representation Model for Software Engineering. The application of Natural Language Processing (NLP) has achieved a high level of relevance in several areas. In the field of software engineering (SE), NLP applications are based on the classification of similar texts (e.g. software requirements), applied in tasks of estimating software effort, selection of human resources, etc. Classifying software requirements has been a complex task, considering the informality and complexity inherent in the texts produced during the software development process. The pre trained embedding models are shown as a viable alternative when considering the low volume of textual data labeled in the area of software engineering, as well as the lack of quality of these data. Although there is much research around the application of word embedding in several areas, to date, there is no knowledge of studies that have explored its application in the creation of a specific model for the domain of the SE area. Thus, this article presents the proposal for a contextualized embedding model, called BERT SE, which allows the recognition of specific and relevant terms in the context of SE. The assessment of BERT SE was performed using the software requirements classification task, demonstrating that this model has an average improvement rate of 13 concerning the BERT base model, made available by the authors of BERT. The code and pre trained models are available at https github.com elianedb.


On the Wasserstein Distance Between k Step Probability Measures on Finite Graphs. We consider random walks X,Y on a finite graph G with respective lazinesses alpha, beta in 0,1 . Let mu k and nu k be the k step transition probability measures of X and Y . In this paper, we study the Wasserstein distance between mu k and nu k for general k . We consider the sequence formed by the Wasserstein distance at odd values of k and the sequence formed by the Wasserstein distance at even values of k . We first establish that these sequences always converge, and then we characterize the possible values for the sequences to converge to. We further show that each of these sequences is either eventually constant or converges at an exponential rate. By analyzing the cases of different convergence values separately, we are able to partially characterize when the Wasserstein distance is constant for sufficiently large k .


Reverse Psychology in Trust Aware Human Robot Interaction. To facilitate effective human robot interaction (HRI), trust aware HRI has been proposed, wherein the robotic agent explicitly considers the human's trust during its planning and decision making. The success of trust aware HRI depends on the specification of a trust dynamics model and a trust behavior model. In this study, we proposed one novel trust behavior model, namely the reverse psychology model, and compared it against the commonly used disuse model. We examined how the two models affect the robot's optimal policy and the human robot team performance. Results indicate that the robot will deliberately "manipulate" the human's trust under the reverse psychology model. To correct this "manipulative" behavior, we proposed a trust seeking reward function that facilitates trust establishment without significantly sacrificing the team performance.


On transfer homomorphisms of Krull monoids. Every Krull monoid has a transfer homomorphism onto a monoid of zero sum sequences over a subset of its class group. This transfer homomorphism is a crucial tool for studying the arithmetic of Krull monoids. In the present paper, we strengthen and refine this tool for Krull monoids with finitely generated class group.


Object Shell Reconstruction Camera centric Object Representation for Robotic Grasping. Robots can effectively grasp and manipulate objects using their 3D models. In this paper, we propose a simple shape representation and a reconstruction method that outperforms state of the art methods in terms of geometric metrics and enables grasp generation with high precision and success. Our reconstruction method models the object geometry as a pair of depth images, composing the "shell" of the object. This representation allows using image to image residual ConvNet architectures for 3D reconstruction, generates object reconstruction directly in the camera frame, and generalizes well to novel object types. Moreover, an object shell can be converted into an object mesh in a fraction of a second, providing time and memory efficient alternative to voxel or implicit representations. We explore the application of shell representation for grasp planning. With rigorous experimental validation, both in simulation and on a real setup, we show that shell reconstruction encapsulates sufficient geometric information to generate precise grasps and the associated grasp quality with over 90 accuracy. Diverse grasps computed on shell reconstructions allow the robot to select and execute grasps in cluttered scenes with more than 93 success rate.


Intelligent Electric Vehicle Charging Recommendation Based on Multi Agent Reinforcement Learning. Electric Vehicle (EV) has become a preferable choice in the modern transportation system due to its environmental and energy sustainability. However, in many large cities, EV drivers often fail to find the proper spots for charging, because of the limited charging infrastructures and the spatiotemporally unbalanced charging demands. Indeed, the recent emergence of deep reinforcement learning provides great potential to improve the charging experience from various aspects over a long term horizon. In this paper, we propose a framework, named Multi Agent Spatio Temporal Reinforcement Learning (Master), for intelligently recommending public accessible charging stations by jointly considering various long term spatiotemporal factors. Specifically, by regarding each charging station as an individual agent, we formulate this problem as a multi objective multi agent reinforcement learning task. We first develop a multi agent actor critic framework with the centralized attentive critic to coordinate the recommendation between geo distributed agents. Moreover, to quantify the influence of future potential charging competition, we introduce a delayed access strategy to exploit the knowledge of future charging competition during training. After that, to effectively optimize multiple learning objectives, we extend the centralized attentive critic to multi critics and develop a dynamic gradient re weighting strategy to adaptively guide the optimization direction. Finally, extensive experiments on two real world datasets demonstrate that Master achieves the best comprehensive performance compared with nine baseline approaches.


Disability and Library Services Global Research Trend. The research on differently abled persons, and their use of library is getting global attention in recent years. The field has shown a modest, continuous but wide scale growth. This research paper aimed at capturing the dynamics of the field using various bibliometrics and text mining tools. The bibliographic data of journal articles published in the field were collected from the Web of Science (WoS) database. The records were collected form the year 1991 to 2021 and analysed to observed the trends of literature growth, core journals, institutes from where most of the literature is being published, prominent keywords and so on. The results show that there is a significant growth of publications since the year 2000. The trends shows that the research in these areas is mostly emerging from developed countries. The developing countries should also pay more attention to do research in this area because differently abled peoples need in developed countries may vary with respect to developed countries.


Extreme outbreak dynamics in epidemic models. Motivated by recent epidemic outbreaks, including those of COVID 19, we solve the canonical problem of calculating the dynamics and likelihood of extensive outbreaks in a population within a large class of stochastic epidemic models with demographic noise, including the Susceptible Infected Recovered (SIR) model and its general extensions. In the limit of large populations, we compute the probability distribution for all extensive outbreaks, including those that entail unusually large or small (extreme) proportions of the population infected. Our approach reveals that, unlike other well known examples of rare events occurring in discrete state stochastic systems, the statistics of extreme outbreaks emanate from a full continuum of Hamiltonian paths, each satisfying unique boundary conditions with a conserved probability flux.


Actions of automorphism groups of free groups on spaces of Jacobi diagrams. II. The automorphism group operatorname Aut (F n) of the free group F n acts on a space A d(n) of Jacobi diagrams of degree d on n oriented arcs. We study the operatorname Aut (F n) module structure of A d(n) by using two actions on the associated graded vector space of A d(n) an action of the general linear group operatorname GL (n,Z) and an action of the graded Lie algebra mathrm gr ( operatorname IA (n)) of the IA automorphism group operatorname IA (n) of F n associated with its lower central series. We extend the action of mathrm gr ( operatorname IA (n)) to an action of the associated graded Lie algebra of the Andreadakis filtration of the endomorphism monoid of F n . By using this action, we study the operatorname Aut (F n) module structure of A d(n) . We obtain an indecomposable decomposition of A d(n) as operatorname Aut (F n) modules for n geq 2d . Moreover, we obtain the radical filtration of A d(n) for n geq 2d and the socle of A 3(n) .


Quantifying the noise in bursty gene expression under regulation by small RNAs. Gene expression is a fundamental process in a living system. The small RNAs (sRNAs) is widely observed as a global regulator in gene expression. The inherent nonlinearity in this regulatory process together with the bursty production of messenger RNA (mRNA), sRNA and protein make the exact solution for this stochastic process intractable. This is particularly the case when quantifying the protein noise level, which has great impact on multiple cellular processes. Here we propose an approximate yet reasonably accurate solution for the gene expression noise with infrequent burst and strong regulation by sRNAs. This analytical solution allows us to better analyze the noise and stochastic deviation of protein level. We find that the regulation amplifies the noise, reduces the protein level. The stochasticity in the regulation generates more proteins than what if the stochasticity is removed from the system. The sRNA level is most important to the relationship between the noise and stochastic deviation. The results provide analytical tools for more general studies of gene expression and strengthen our quantitative understandings of post transcriptional regulation in controlling gene expression processes.


Generalized Stallings' decomposition theorem for pro p groups. The celebrated Stallings' decomposition theorem states that the splitting of a finite index subgroup H of a finitely generated group G as an amalgamated free product or an HNN extension over a finite group implies the same for G . We generalize the pro p version of it proved by Weigel and the second author to splittings over infinite pro p groups. This generalization does not have any abstract analogs. We also prove that generalized accessibility of finitely generated pro p groups is closed for commensurability.


Sphericity of kappa classes and positive curvature via block bundles. Given a manifold M , we completely determine which rational kappa classes are non trivial for (fiber homotopy trivial) M bundles over the k sphere, provided that the dimension of M is large compared to k . We furthermore study the vector space of these spherical kappa classes and give an upper and a lower bound on its dimension. The proof is based on the classical approach to studying diffeomorphism groups via block bundles and surgery theory and we make use of ideas developed by Krannich Kupers Randal Williams. As an application, we show the existence of elements of infinite order in the homotopy groups of the spaces mathcal R Ric 0 (M) and mathcal R sec 0 (M) of positive Ricci and positive sectional curvature, provided that M is spin, has a non trivial rational Pontryagin class and admits such a metric. This is done by showing that the kappa class associated to the hat mathcal A class is spherical for such a manifold. In the appendix co authored by Jens Reinhold it is (partially) determined which classes of the rational oriented cobordism ring contain an element that fibers over a sphere of a given dimension.


Multigrid and saddle point preconditioners for unfitted finite element modelling of inclusions. In this work, we consider the modeling of inclusions in the material using an unfitted finite element method. In the unfitted methods, structured background meshes are used and only the underlying finite element space is modified to incorporate the discontinuities, such as inclusions. Hence, the unfitted methods provide a more flexible framework for modeling the materials with multiple inclusions. We employ the method of Lagrange multipliers for enforcing the interface conditions between the inclusions and matrix, this gives rise to the linear system of equations of saddle point type. We utilize the Uzawa method for solving the saddle point system and propose preconditioning strategies for primal and dual systems. For the dual systems, we review and compare the preconditioning strategies that are developed for FETI and SIMPLE methods. While for the primal system, we employ a tailored multigrid method specifically developed for the unfitted meshes. Lastly, the comparison between the proposed preconditioners is made through several numerical experiments.


Broadband photonic RF channelizer with a Kerr soliton crystal micro comb. We report a 92 channel RF channelizer based on a 48.9 GHz integrated micro comb that operates via soliton crystals, together with a passive high Q ring resonator that acts as a periodic filter with an optical 3dB bandwidth of 121.4 MHz. We obtain an instant RF bandwidth of 8.08 GHz and 17.55 GHz achieved through temperature tuning. These results represent a major advance to achieving fully integrated photonic RF spectrum channelizers with reduced low complexity, size, and high performance for digital compatible signal detection and broadband analog signal processing.


A geometric characterization of unstable blow up solutions with computer assisted proof. In this paper, blow up solutions of autonomous ordinary differential equations (ODEs) which are unstable under perturbations of initial conditions are studied. Combining dynamical systems machinery (e.g. phase space compactifications, time scale desingularizations of vector fields) with tools from computer assisted proofs (e.g. rigorous integrators, parameterization method for invariant manifolds), these unstable blow up solutions are obtained as trajectories on stable manifolds of hyperbolic (saddle) equilibria at infinity. In this process, important features are obtained smooth dependence of blow up times on initial points near blow up, level set distribution of blow up times, singular behavior of blow up times on unstable blow up solutions, organization of the phase space via separatrices (stable manifolds). In particular, we show that unstable blow up solutions themselves, and solutions defined globally in time connected by those blow up solutions can separate initial conditions into two regions where solution trajectories are either globally bounded or blow up, no matter how the large initial points are.


A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines From Medical to Remote Sensing. We look into Generative Adversarial Network (GAN), its prevalent variants and applications in a number of sectors. GANs combine two neural networks that compete against one another using zero sum game theory, allowing them to create much crisper and discrete outputs. GANs can be used to perform image processing, video generation and prediction, among other computer vision applications. GANs can also be utilised for a variety of science related activities, including protein engineering, astronomical data processing, remote sensing image dehazing, and crystal structure synthesis. Other notable fields where GANs have made gains include finance, marketing, fashion design, sports, and music. Therefore in this article we provide a comprehensive overview of the applications of GANs in a wide variety of disciplines. We first cover the theory supporting GAN, GAN variants, and the metrics to evaluate GANs. Then we present how GAN and its variants can be applied in twelve domains, ranging from STEM fields, such as astronomy and biology, to business fields, such as marketing and finance, and to arts, such as music. As a result, researchers from other fields may grasp how GANs work and apply them to their own study. To the best of our knowledge, this article provides the most comprehensive survey of GAN's applications in different fields.