Scene Adaptive Attention Network for Crowd Counting. In recent years, significant progress has been made on the research of crowd counting. However, as the challenging scale variations and complex scenes existed in crowds, neither traditional convolution networks nor recent Transformer architectures with fixed size attention could handle the task well. To address this problem, this paper proposes a scene adaptive attention network, termed SAANet. First of all, we design a deformable attention in built Transformer backbone, which learns adaptive feature representations with deformable sampling locations and dynamic attention weights. Then we propose the multi level feature fusion and count attentive feature enhancement modules further, to strengthen feature representation under the global image context. The learned representations could attend to the foreground and are adaptive to different scales of crowds. We conduct extensive experiments on four challenging crowd counting benchmarks, demonstrating that our method achieves state of the art performance. Especially, our method currently ranks No.1 on the public leaderboard of the NWPU Crowd benchmark. We hope our method could be a strong baseline to support future research in crowd counting. The source code will be released to the community.


2 Prime Hyperideals. Multiplicative hyperrings are an important class of algebraic hyperstructures which generalize rings further to allow multiple output values for the multiplication operation. Let R be a commutative multiplicative hyperring. The 2 prime hyperideals are a generalization of prime hyperideals. In this paper, we aim to study 2 prime hyperideals and give some results. Moreover, we investigate delta 2 primary hyperideals which are an expansion of 2 prime hyperideals.


Cycles of paleomagnetic activity in the phanerozoic. Quasi periodic changes of the paleointensity and geomagnetic polarity in the intervals of 170 Ma to the present time and of 550 Ma to the present time were studied, respectively. It is revealed that the spectrum of the basic variations in the paleointensity and of the duration of the polar intervals is discrete and includes quasi periodic oscillations with characteristic times of 15 Ma, 8 Ma, 5 Ma, and 3 Ma. The characteristic time of these quasi periodic changes of the geomagnetic field at the beginning and at the end of the Phanerozoic differed by no more than 10 . The spectral density of quasi periodic variations of the geomagnetic field changed cyclically over geological time. The relation between the behaviors of the amplitude of paleointensity variations, the duration of the polar intervals, and their spectral density was shown. Quasi periodic variations of the paleointensity (geomagnetic activity) had a relatively high spectral density in the interval of (150 40) Ma (in the Cretaceous Early Paleogene). In this interval, both the amplitude of paleointensity variations and the duration of polar intervals increased. In the intervals of (170 150) Ma and of 30 Ma to the present, a quasi periodic variation in the paleointensity practically did not detect against the background of its noise variations. At the same time, the amplitude of the paleointensity variations and duration of polar intervals decreased. An alternation of time intervals in which the paleointensity variations acquired either a quasi periodic or noise character took place during the geomagnetic history.


Hearing the shape of ancient noncollapsed flows in mathbb R 4 . We consider ancient noncollapsed mean curvature flows in mathbb R 4 whose tangent flow at infty is a bubble sheet. We carry out a fine spectral analysis for the bubble sheet function u that measures the deviation of the renormalized flow from the round cylinder mathbb R 2 times S 1( sqrt 2 ) and prove that for tau to infty we have the fine asymptotics u(y, theta, tau) (y top Qy 2 textrm tr (Q)) tau o( tau 1 ) , where Q Q( tau) is a symmetric 2 times 2 matrix whose eigenvalues are quantized to be either 0 or 1 sqrt 8 . This naturally breaks up the classification problem for general ancient noncollapsed flows in mathbb R 4 into three cases depending on the rank of Q . In the case mathrm rk (Q) 0 , generalizing a prior result of Choi, Hershkovits and the second author, we prove that the flow is either a round shrinking cylinder or mathbb R times 2d bowl. In the case mathrm rk (Q) 1 , under the additional assumption that the flow either splits off a line or is selfsimilarly translating, as a consequence of recent work by Angenent, Brendle, Choi, Daskalopoulos, Hershkovits, Sesum and the second author we show that the flow must be mathbb R times 2d oval or belongs to the one parameter family of 3d oval bowls constructed by Hoffman Ilmanen Martin White, respectively. Finally, in the case mathrm rk (Q) 2 we show that the flow is compact and mathrm SO (2) symmetric and for tau to infty has the same sharp asymptotics as the mathrm O (2) times mathrm O (2) symmetric ancient ovals constructed by Hershkovits and the second author. The full classification problem will be addressed in subsequent papers based on the results of the present paper.


Applications of Multi Agent Reinforcement Learning in Future Internet A Comprehensive Survey. Future Internet involves several emerging technologies such as 5G and beyond 5G networks, vehicular networks, unmanned aerial vehicle (UAV) networks, and Internet of Things (IoTs). Moreover, future Internet becomes heterogeneous and decentralized with a large number of involved network entities. Each entity may need to make its local decision to improve the network performance under dynamic and uncertain network environments. Standard learning algorithms such as single agent Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) have been recently used to enable each network entity as an agent to learn an optimal decision making policy adaptively through interacting with the unknown environments. However, such an algorithm fails to model the cooperations or competitions among network entities, and simply treats other entities as a part of the environment that may result in the non stationarity issue. Multi agent Reinforcement Learning (MARL) allows each network entity to learn its optimal policy by observing not only the environments, but also other entities' policies. As a result, MARL can significantly improve the learning efficiency of the network entities, and it has been recently used to solve various issues in the emerging networks. In this paper, we thus review the applications of MARL in the emerging networks. In particular, we provide a tutorial of MARL and a comprehensive survey of applications of MARL in next generation Internet. In particular, we first introduce single agent RL and MARL. Then, we review a number of applications of MARL to solve emerging issues in future Internet. The issues consist of network access, transmit power control, computation offloading, content caching, packet routing, trajectory design for UAV aided networks, and network security issues.


Pair approximation for the q voter models with quenched disorder on networks. Using two models of opinion dynamics, the q voter model with independence and the q voter model with anticonformity, we discuss how the change of disorder from annealed to quenched affects phase transitions on networks. Up till now, such an analysis has been done only at the mean field level. To derive phase diagrams on networks, we develop the pair approximation for the quenched versions of the models. This formalism can be also applied to other quenched dynamics of similar kind. The results indicate that such a change of disorder eliminates all discontinuous phase transitions and broadens ordered phases. We show that although the annealed and quenched types of disorder lead to the same result in the q voter model with anticonformity at the mean field level, they do lead to distinct phase diagrams on networks. These phase diagrams shift towards each other as the average node degree of a network increases, and eventually, they coincide in the mean field limit. In contrast, for the q voter model with independence, the phase diagrams move towards the same direction regardless of the disorder type, and they do not coincide even in the mean filed limit. To validate our results, we carry out Monte Carlo simulations on random regular graphs and Barab ' a si Albert networks. Although the pair approximation may incorrectly predict the type of phase transitions for the annealed models, we have not observed such errors for their quenched counterparts.


Compact representations of convolutional neural networks via weight pruning and quantization. The state of the art performance for several real world problems is currently reached by convolutional neural networks (CNN). Such learning models exploit recent results in the field of deep learning, typically leading to highly performing, yet very large neural networks with (at least) millions of parameters. As a result, the deployment of such models is not possible when only small amounts of RAM are available, or in general within resource limited platforms, and strategies to compress CNNs became thus of paramount importance. In this paper we propose a novel lossless storage format for CNNs based on source coding and leveraging both weight pruning and quantization. We theoretically derive the space upper bounds for the proposed structures, showing their relationship with both sparsity and quantization levels of the weight matrices. Both compression rates and excution times have been tested against reference methods for matrix compression, and an empirical evaluation of state of the art quantization schemes based on weight sharing is also discussed, to assess their impact on the performance when applied to both convolutional and fully connected layers. On four benchmarks for classification and regression problems and comparing to the baseline pre trained uncompressed network, we achieved a reduction of space occupancy up to 0.6 on fully connected layers and 5.44 on the whole network, while performing at least as competitive as the baseline.


The solid fluid transmission problem. We study microlocally the transmission problem at the interface between an isotropic linear elastic solid and a linear inviscid fluid. We set up a system of evolution equations describing the particle displacement and velocity in the solid, and pressure and velocity in the fluid, coupled by suitable transmission conditions at the interface. We show well posedness for the coupled system and study the problem microlocally, constructing a parametrix for it using geometric optics. This construction describes the reflected and transmitted waves, including mode converted ones, related to incoming waves from either side. We also study formation of surface Scholte waves. Finally, we prove that under suitable assumptions, we can recover the s and the p speeds, as well as the speed of the liquid, from boundary measurements.


Bayesian inversion for unified ductile phase field fracture. The prediction of crack initiation and propagation in ductile failure processes are challenging tasks for the design and fabrication of metallic materials and structures on a large scale. Numerical aspects of ductile failure dictate a sub optimal calibration of plasticity and fracture related parameters for a large number of material properties. These parameters enter the system of partial differential equations as a forward model. In this work, we develop a step wise Bayesian inversion framework for ductile fracture to provide accurate knowledge regarding the effective mechanical parameters. To this end, synthetic and experimental observations are used to estimate the posterior density of the unknowns. To model the ductile failure behavior of solid materials, we rely on the phase field approach to fracture, for which we present a unified formulation that allows recovering different models on a variational basis. In the variational framework, incremental minimization principles for a class of gradient type dissipative materials are used to derive the governing equations. The overall formulation is revisited and extended to the case of anisotropic ductile fracture. Three different models are subsequently recovered by certain choices of parameters and constitutive functions, which are later assessed through Bayesian inversion techniques. To estimate the posterior density function of ductile material parameters, three common Markov chain Monte Carlo (MCMC) techniques are employed (i) the Metropolis Hastings algorithm, (ii) delayed rejection adaptive Metropolis, and (iii) ensemble Kalman filter combined with MCMC. To examine the computational efficiency of the MCMC methods, we employ the R convergence tool.


Reconfiguring Independent Sets on Interval Graphs. We study reconfiguration of independent sets in interval graphs under the token sliding rule. We show that if two independent sets of size k are reconfigurable in an n vertex interval graph, then there is a reconfiguration sequence of length mathcal O (k cdot n 2) . We also provide a construction in which the shortest reconfiguration sequence is of length Omega(k 2 cdot n) . As a counterpart to these results, we also establish that textsf Independent Set Reconfiguration is PSPACE hard on incomparability graphs, of which interval graphs are a special case.


Near squares in binary recurrence sequences. We call an integer a emph near square if it is a prime times a square. In 1993, Mignotte and Peth H o proved that, for all integers a 3 , there are no elements that are squares, two times squares or three times squares in the sequence defined by u 0 0 , u 1 1 and u n 2 au n 1 u n for n geq 0 , once n 6 . Our investigations suggest that something stronger is happening in this sequence. For n 7 , it appears that there are no elements in this sequence that are near squares (i.e., it appears that 2 and 3 in Mignotte and Peth H o 's paper can be replaced with any prime whatsoever at the expense of increasing the bound on n only slightly). Furthermore, if we generalize the recurrence relation to u n 2 au n 1 b 2 u n with a b 2 , then the same appears to hold once n 13 . We explain why this appears to be the case. There is something special about such sequences. While we have not been able to prove this in the generality that we state here, we give the partial results we have obtained in this direction. More specifically, for b 1 and prime p 3 (unspecified) we show that a relation of the form u n p Box is impossible for n geq 5 if a is of the form a c 2 1 with c an integer geq 2 . Various intermediate results concerning terms of second order binary sequences being a near square are included. Some of these results are valid for general a geq 3 .


MAML is a Noisy Contrastive Learner in Classification. Model agnostic meta learning (MAML) is one of the most popular and widely adopted meta learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner loop and outer loop updates, which govern the task specific and meta model centric learning, respectively, the underlying learning objective of MAML remains implicit and thus impedes a more straightforward understanding of it. In this paper, we provide a new perspective of the working mechanism of MAML. We discover that MAML is analogous to a meta learner using a supervised contrastive objective. The query features are pulled towards the support features of the same class and against those of different classes. Such contrastiveness is experimentally verified via an analysis based on the cosine similarity. Moreover, we reveal that vanilla MAML has an undesirable interference term originating from the random initialization and the cross task interaction. We thus propose a simple but effective technique, zeroing trick, to alleviate the interference. Extensive experiments are conducted on both mini ImageNet and Omniglot datasets to demonstrate the consistent improvement brought by our proposed method, validating its effectiveness.


Characterization of deferred type statistical convergence and P summability method for operators Applications to q Lagrange Hermite operator. The present work considers two important convergence techniques, namely deferred type statistical convergence and P summability method in respect of positive linear operators. With regard to these techniques, we state and prove two general non trivial Korovkin type approximation results for such operators. Further, we define an operator based on multivariate q Lagrange Hermite polynomials and exhibit the applicability of our general theorems.


An Evaluation of the Archive of Formal Proofs. The Archive of Formal Proofs (AFP) is an online repository of formal proofs for the Isabelle proof assistant. It serves as a central location for publishing, discovering, and viewing libraries of proofs. We conducted an online survey in November 2020 to assess the suitability of the website. In this report, we present and discuss the results, which showed that long term users of the website are generally satisfied with the AFP but that there are a number of areas, such as navigation, search and script browsing, that need improvement.


Complete singular collineations and quadrics. We construct wonderful compactifications of the spaces of linear maps, and symmetric linear maps of a given rank as blow ups of secant varieties of Segre and Veronese varieties. Furthemore, we investigate their birational geometry and their relations with some spaces of degree two stable maps.


Sparsifying the Update Step in Graph Neural Networks. Message Passing Neural Networks (MPNNs), the most prominent Graph Neural Network (GNN) framework, celebrate much success in the analysis of graph structured data. Concurrently, the sparsification of Neural Network models attracts a great amount of academic and industrial interest. In this paper we conduct a structured, empirical study of the effect of sparsification on the trainable part of MPNNs known as the Update step. To this end, we design a series of models to successively sparsify the linear transform in the Update step. Specifically, we propose the ExpanderGNN model with a tuneable sparsification rate and the Activation Only GNN, which has no linear transform in the Update step. In agreement with a growing trend in the literature the sparsification paradigm is changed by initialising sparse neural network architectures rather than expensively sparsifying already trained architectures. Our novel benchmark models enable a better understanding of the influence of the Update step on model performance and outperform existing simplified benchmark models such as the Simple Graph Convolution. The ExpanderGNNs, and in some cases the Activation Only models, achieve performance on par with their vanilla counterparts on several downstream tasks, while containing significantly fewer trainable parameters. Our code is publicly available at https github.com ChangminWu ExpanderGNN.


On obtaining the convex hull of quadratic inequalities via aggregations. A classical approach for obtaining valid inequalities for a set involves weighted aggregations of the inequalities that describe such set. When the set is described by linear inequalities, thanks to the Farkas lemma, we know that every valid inequality can be obtained using aggregations. When the inequalities describing the set are two quadratics, Yildiran showed that the convex hull of the set is given by at most two aggregated inequalities. In this work, we study the case of a set described by three or more quadratic inequalities. We show that, under technical assumptions, the convex hull of a set described by three quadratic inequalities can be obtained via (potentially infinitely many) aggregated inequalities. We also show, through counterexamples, that it is unlikely to have a similar result if either the technical conditions are relaxed, or if we consider four or more inequalities.


Processing M.A. Castr 'en's Materials Multilingual Typed and Handwritten Manuscripts. The study forms a technical report of various tasks that have been performed on the materials collected and published by Finnish ethnographer and linguist, Matthias Alexander Castr 'en (1813 1852). The Finno Ugrian Society is publishing Castr 'en's manuscripts as new critical and digital editions, and at the same time different research groups have also paid attention to these materials. We discuss the workflows and technical infrastructure used, and consider how datasets that benefit different computational tasks could be created to further improve the usability of these materials, and also to aid the further processing of similar archived collections. We specifically focus on the parts of the collections that are processed in a way that improves their usability in more technical applications, complementing the earlier work on the cultural and linguistic aspects of these materials. Most of these datasets are openly available in Zenodo. The study points to specific areas where further research is needed, and provides benchmarks for text recognition tasks.


Top Score in Axelrod Tournament. The focus of the project will be an examination of obtaining the highest score in the Axelrod Tournament. The initial design of the highest score in the Axelrod Tournament consisted of looking at the Cooperation rates of the top strategies currently in the Axelrod Library. After creating an initial Finite State Machine strategy that utilized the Cooperation Rates of the top players our ten state FSM finished within the top 35 players out of 220 in the short run time strategies in the Axelrod Library. After a quick evolutionary algorithm, 50 generations, our original ten state FSM was changed into an eight state FSM, which finished within the top 5 of the short run time strategies in the Axelrod Library. This eight state FSM was then evolved again using a full evolutionary algortihm process, which lasted 500 generations, where the eight state FSM evolved into a another eight state FSM which finishes first in the Axelrod Library among the short run time strategies and the full Axelrod Tournament. From that final FSM, two of the eight states are inaccessible, so the final FSM strategy is a six state FSM that finishes first in the Full Axelrod Tournament, against the short run time strategies as well as the long run time strategies.


Decentralized Multi Agent Reinforcement Learning An Off Policy Method. We discuss the problem of decentralized multi agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each agent, and thus cannot be shared with others. There is a communication graph, among which the agents can exchange information with their neighbors. The agents make individual decisions and cooperate to reach a higher accumulated reward. Towards this end, we first propose a decentralized actor critic (AC) setting. Then, the policy evaluation and policy improvement algorithms are designed for discrete and continuous state action space Markov Decision Process (MDP) respectively. Furthermore, convergence analysis is given under the discrete space case, which guarantees that the policy will be reinforced by alternating between the processes of policy evaluation and policy improvement. In order to validate the effectiveness of algorithms, we design experiments and compare them with previous algorithms, e.g., Q learning cite watkins1992q and MADDPG cite lowe2017multi . The results show that our algorithms perform better from the aspects of both learning speed and final performance. Moreover, the algorithms can be executed in an off policy manner, which greatly improves the data efficiency compared with on policy algorithms.


Relativistic calculations of the chemical properties of the superheavy element with Z 119 and its homologues. Relativistic calculations of the electronic structure of the superheavy element of the eighth period eka francium ( Z 119 ) and its homologues, which form the group of alkali metals, are performed in the framework of the configuration interaction method and many body perturbation theory using the basis of the Dirac Fock Sturm orbitals (DFS). The obtained values of the ionization potentials, electron affinities, and root mean square radii are compared with the corresponding values calculated within the non relativistic approximation. A comparison with the available experimental data and the results of previous theoretical calculations is given as well. The analysis of the obtained results indicates a significant influence of the relativistic effects for the francium and eka francium atoms, which leads to a violation of the monotonic behaviour of the listed above chemical properties as a function of the alkaline element atomic number. In addition, the quantum electrodynamics corrections to the ionization potentials are evaluated by employing the model Lamb shift operator (QEDMOD).


Noisy multistate voter model for flocking in finite dimensions. We study a model for the collective behavior of self propelled particles subject to pairwise copying interactions and noise. Particles move at a constant speed v on a two dimensional space and, in a single step of the dynamics, each particle adopts the direction of motion of a randomly chosen neighboring particle, with the addition of a perturbation of amplitude eta (noise). We investigate how the global level of particles' alignment (order) is affected by their motion and the noise amplitude eta . In the static case scenario v 0 where particles are fixed at the sites of a square lattice and interact with their first neighbors, we find that for any noise eta c 0 the system reaches a steady state of complete disorder in the thermodynamic limit, while for eta 0 full order is eventually achieved for a system with any number of particles N . Therefore, the model displays a transition at zero noise when particles are static, and thus there are no ordered steady states for a finite noise ( eta 0 ). We show that the finite size transition noise vanishes with N as eta c 1D sim N 1 and eta c 2D sim left(N ln N right) 1 2 in one and two dimensional lattices, respectively, which is linked to known results on the behavior of a type of noisy voter model for catalytic reactions. When particles are allowed to move in the space at a finite speed v 0 , an ordered phase emerges, characterized by a fraction of particles moving in a similar direction. The system exhibits an order disorder phase transition at a noise amplitude eta c 0 that is proportional to v , and that scales approximately as eta c sim v , ( ln v) 1 2 for v ll 1 . These results show that the motion of particles is able to sustain a state of global order in a system with voter like interactions.


Inexact Sequential Quadratic Optimization for Minimizing a Stochastic Objective Function Subject to Deterministic Nonlinear Equality Constraints. An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is assumed that constraint function and derivative values can be computed, but that only stochastic approximations are available for the objective function and its derivatives. The algorithm is of the sequential quadratic optimization variety. A distinguishing feature of the algorithm is that it allows inexact subproblem solutions to be employed, which is particularly useful in large scale settings when the matrices defining the subproblems are too large to form and or factorize. Conditions are imposed on the inexact subproblem solutions that account for the fact that only stochastic objective gradient estimates are available. Convergence results in expectation are established for the method. Numerical experiments show that it outperforms an alternative algorithm that employs highly accurate subproblem solutions in every iteration.


Serverless Predictions 2021 2030. Within the next 10 years, advances on resource disaggregation will enable full transparency for most Cloud applications to run unmodified single machine applications over effectively unlimited remote computing resources. In this article, we present five serverless predictions for the next decade that will realize this vision of transparency equivalent to Tim Wagner's Serverless SuperComputer or AnyScale's Infinite Laptop proposals.


Isoparametric foliations and the Pompeiu problem. A bounded domain Omega in a Riemannian manifold M is said to have the Pompeiu property if the only continuous function which integrates to zero on Omega and on all its congruent images is the zero function. In some respects, the Pompeiu property can be viewed as an overdetermined problem, given its relation with the Schiffer problem. It is well known that every Euclidean ball fails the Pompeiu property while spherical balls have the property for almost all radii (Ungar's Freak theorem). In the present paper we discuss the Pompeiu property when M is compact and admits an isoparametric foliation. In particular, we identify precise conditions on the spectrum of the Laplacian on M under which the level domains of an isoparametric function fail the Pompeiu property. Specific calculations are carried out when the ambient manifold is the round sphere, and some consequences are derived. Moreover, a detailed discussion of Ungar's Freak theorem and its generalizations is also carried out.


Synaptic polarity and sign balance prediction using gene expression data in the Caenorhabditis elegans chemical synapse neuronal connectome network. Graph theoretical analyses of nervous systems usually omit the aspect of connection polarity, due to data insufficiency. The chemical synapse network of Caenorhabditis elegans is a well reconstructed directed network, but the signs of its connections are yet to be elucidated. Here, we present the gene expression based sign prediction of the ionotropic chemical synapse connectome of C. elegans (3,638 connections and 20,589 synapses total), incorporating available presynaptic neurotransmitter and postsynaptic receptor gene expression data for three major neurotransmitter systems. We made predictions for more than two thirds of these chemical synapses and observed an excitatory inhibitory (E I) ratio close to 4 1 which was found similar to that observed in many real world networks. Our open source tool (http EleganSign.linkgroup.hu) is simple but efficient in predicting polarities by integrating neuronal connectome and gene expression data.


Global Local Item Embedding for Temporal Set Prediction. Temporal set prediction is becoming increasingly important as many companies employ recommender systems in their online businesses, e.g., personalized purchase prediction of shopping baskets. While most previous techniques have focused on leveraging a user's history, the study of combining it with others' histories remains untapped potential. This paper proposes Global Local Item Embedding (GLOIE) that learns to utilize the temporal properties of sets across whole users as well as within a user by coining the names as global and local information to distinguish the two temporal patterns. GLOIE uses Variational Autoencoder (VAE) and dynamic graph based model to capture global and local information and then applies attention to integrate resulting item embeddings. Additionally, we propose to use Tweedie output for the decoder of VAE as it can easily model zero inflated and long tailed distribution, which is more suitable for several real world data distributions than Gaussian or multinomial counterparts. When evaluated on three public benchmarks, our algorithm consistently outperforms previous state of the art methods in most ranking metrics.


Structured World Belief for Reinforcement Learning in POMDP. Object centric world models provide structured representation of the scene and can be an important backbone in reinforcement learning and planning. However, existing approaches suffer in partially observable environments due to the lack of belief states. In this paper, we propose Structured World Belief, a model for learning and inference of object centric belief states. Inferred by Sequential Monte Carlo (SMC), our belief states provide multiple object centric scene hypotheses. To synergize the benefits of SMC particles with object representations, we also propose a new object centric dynamics model that considers the inductive bias of object permanence. This enables tracking of object states even when they are invisible for a long time. To further facilitate object tracking in this regime, we allow our model to attend flexibly to any spatial location in the image which was restricted in previous models. In experiments, we show that object centric belief provides a more accurate and robust performance for filtering and generation. Furthermore, we show the efficacy of structured world belief in improving the performance of reinforcement learning, planning and supervised reasoning.


Construction of Blow up Sequences for the Prescribed Scalar Curvature Equation on S n . IV. Clustered Blow ups. For the prescribed scalar curvature equation on S n ( n ge 6 ), we consider the situation where the number of bubbles tends to infinity in the Lyapunov Schmidt (finite dimension) reduction method. In an outstanding paper by Wei and Yan, the special case where the bubbles are arranged "evenly" (close to a great circle) is considered. Here we are concerned with the generic scenario, where the bubbles are "planted" (arranged) in general position, in adjacent to the critical points of the prescribed function. The main interest of this article is to extract key information in the finite dimensional reduced functional, as well as in its first partial derivatives. Overall, there are two main contributions in the "expansions", namely, interaction between bubbles and curvature involvement. As each bubble becomes infinitesimally close to other bubbles in the neighborhood, the errors in the expansions are carefully estimated in terms of the geometric parameters. This lays the foundation for our next step on constructing blow up sequences of solutions with dense blow up points (clustered blow up), where the (non radial symmetric) prescribed scalar curvature function has non isolated critical points.


Searching for an Intruder on Graphs and Their Subdivisions. In this paper we analyze a variant of the pursuit evasion game on a graph G where the intruder occupies a vertex, is allowed to move to adjacent vertices or remain in place, and is 'invisible' to the searcher, meaning that the searcher operates with no knowledge of the position of the intruder. On each stage, the searcher is allowed to inspect an arbitrary set of k vertices. The minimum k for which the searcher can guarantee the capture of the intruder is called the inspection number of G . We also introduce and study the topological inspection number, a quantity that captures the limiting behavior of the inspection number under subdivisions of G . Our central theorem provides a full classification of graphs with topological inspection number up to 3 .


Multi Modal Pedestrian Detection with Large Misalignment Based on Modal Wise Regression and Multi Modal IoU. The combined use of multiple modalities enables accurate pedestrian detection under poor lighting conditions by using the high visibility areas from these modalities together. The vital assumption for the combination use is that there is no or only a weak misalignment between the two modalities. In general, however, this assumption often breaks in actual situations. Due to this assumption's breakdown, the position of the bounding boxes does not match between the two modalities, resulting in a significant decrease in detection accuracy, especially in regions where the amount of misalignment is large. In this paper, we propose a multi modal Faster RCNN that is robust against large misalignment. The keys are 1) modal wise regression and 2) multi modal IoU for mini batch sampling. To deal with large misalignment, we perform bounding box regression for both the RPN and detection head with both modalities. We also propose a new sampling strategy called "multi modal mini batch sampling" that integrates the IoU for both modalities. We demonstrate that the proposed method's performance is much better than that of the state of the art methods for data with large misalignment through actual image experiments.


Connected sums of codimension two locally flat submanifolds. Let X and Y be oriented topological manifolds of dimension n 2, and let K and J be connected, locally flat, oriented, n dimensional submanifolds of X and Y. We show that up to orientation preserving homeomorphism there is a well defined connected sum K J in X Y. For n 1, the proof is classical, relying on results of Rado and Moise. For dimensions n 3 and n 5, results of Edwards Kirby, Kirby, and Kirby Siebenmann concerning higher dimensional topological manifolds are required. For n 2, 4, and 5, Freedman and Quinn's work on topological four manifolds is needed. The truth of the corresponding statement for higher codimension seems to be unknown.


Communication networks and group effectiveness the case of English Wikipedia. A selection of intellectual goods produced by online communities e.g. open source software or knowledge bases like Wikipedia are in daily use by a broad audience, and thus their quality impacts the public at large. Yet, it is still unclear what contributes to the effectiveness of such online peer production systems what conditions or social processes help them deliver quality products. Specifically, while co contribution (i.e. bipartite networks) are often investigated in online collaboration, the role of interpersonal communication in coordination of online peer production is much less investigated. To address this gap we have reconstructed networks of personal communication (direct messaging) between Wikipedia editors gathered in so called Wikiprojects teams of contributors who focus on articles within specific topical areas. We found that effective projects exchange larger volume of direct messages and that their communication structure allows for complex coordination for sharing of information locally through selective ties, and at the same time globally across the whole group. To verify how these network measures relate to the subjective perception of importance of group communication we conducted semi structured interviews with members of selected projects. Our interviewees used direct communication for providing feedback, for maintaining close relations and for tapping on the social capital of the Wikipedia community. Our results underscore the importance of communication structure in online collaboration online peer production communities rely on interpersonal communication to coordinate their work and to maintain high levels of engagement. Design of platforms for such communities should allow for ample group level communication as well as for one on one interactions.


Medium Scale Ricci Curvature for Hyperbolic Groups. We study the relationship between a notion of medium scale Ricci curvature for finitely generated groups and that of hyperbolicity in the sense of Gromov. We give an example of a generating set that gives zero curvature with positive density for the free group of rank 2. We prove that, by making the radius used in computing the curvature sufficiently large, we can always have negative curvature outside of a ball in non elementary hyperbolic groups. On the other hand, we give an example of a group which has negative curvature for all non identity points but is not hyperbolic.


Independent Sets in Semi random Hypergraphs. A set of vertices in a hypergraph is called an independent set if no hyperedge is completely contained inside the set. Given a hypergraph, computing its largest size independent set is an NP hard problem. In this work, we study the independent set problem on hypergraphs in a natural semi random family of instances. Our semi random model is inspired by the Feige Kilian model FK01 . This popular model has also been studied in the works of FK01, Ste17, MMT20 etc. McKenzie, Mehta, and Trevisan MMT20 gave algorithms for computing independent sets in such a semi random family of graphs. The algorithms by McKenzie et al. MMT20 are based on rounding a "crude SDP". We generalize their results and techniques to hypergraphs for an analogous family of hypergraph instances. Our algorithms are based on rounding the "crude SDP" of McKenzie et al. MMT20 , augmented with "Lasserre SoS like" hierarchy of constraints. Analogous to the results of McKenzie et al. MMT20 , we study the ranges of input parameters where we can recover the planted independent set or a large independent set.


Splitting fields of real irreducible representations of finite groups. We show that any irreducible representation rho of a finite group G of exponent n , realisable over mathbb R , is realisable over the field E mathbb Q ( zeta n) cap mathbb R of real cyclotomic numbers of order n , and describe an algorithmic procedure transforming a realisation of rho over mathbb Q ( zeta n) to one over E .


Effective dose fractionation schemes of radiotherapy for prostate cancer. Radiation therapy has remained as one of the main cancer treatment modalities and a highly cost effective single modality treatment of cancer care. Typical regimens for fractionated external beam radiotherapy comprise a constant dose administered on weekdays, and no radiation on weekends. However, every patient has a tumor with distinct properties depending on intra tumor heterogeneity, aggressiveness, and interactive properties with other cells that may make it more resistant or sensitive to radiation treatment. Accordingly, the concept of personalized cancer treatment is emerging to specialize each patient treatment case to the unique properties of the tumor. In this paper, we examine adaptive radiation treatment strategies for heterogeneous tumors using a dynamical system model that consists of radiation resistant and parental cell populations with unique interactive properties. We study different adaptive dosage strategies for PC3 and DU145 prostate cancer cell lines. We show that stronger doses of radiation given in longer time intervals, while keeping the overall dosage the same, reduce final tumor volume by more than half in PC3 cell lines, but by only five percent in DU145 cell lines. In addition, we tested an adaptive dosing schedule by administering a stronger dosage on Friday to compensate for the treatment off period during the weekend, which was effective in decreasing the final tumor volume of both cell lines. This result creates interesting possibilities for new radiotherapy strategies at clinics that cannot provide treatment on weekends. Finally, we propose a dosage plan incorporating our findings.


Defect reconstruction in a 2D semi analytical waveguide model via derivative based optimization. This paper considers the reconstruction of a defect in a two dimensional waveguide during non destructive ultrasonic inspection using a derivative based optimization approach. The propagation of the mechanical waves is simulated by the Scaled Boundary Finite Element Method (SBFEM) that builds on a semi analytical approach. The simulated data is then fitted to a given set of data describing the reflection of a defect to be reconstructed. For this purpose, we apply an iteratively regularized Gauss Newton method in combination with algorithmic differentiation to provide the required derivative information accurately and efficiently. We present numerical results for three different kinds of defects, namely a crack, a delamination, and a corrosion. These examples show that the parameterization of the defect can be reconstructed efficiently and robustly in the presence of noise.


On a stiff problem in two dimensional space. In this paper we will study a stiff problem in two dimensional space and especially its probabilistic counterpart. Roughly speaking, the heat equation with a parameter varepsilon 0 is under consideration partial t u varepsilon(t,x) frac 1 2 nabla cdot left( mathbf A varepsilon(x) nabla u varepsilon(t,x) right), quad t geq 0, x in mathbb R 2, where mathbf A varepsilon(x) text Id 2 , the identity matrix, for x notin Omega varepsilon x (x 1,x 2) in mathbb R 2 x 2 varepsilon while mathbf A varepsilon(x) begin pmatrix a varepsilon 0 0 a shortmid varepsilon end pmatrix with two positive constants a varepsilon, a shortmid varepsilon for x in Omega varepsilon . There exists a diffusion process X varepsilon on mathbb R 2 associated to this heat equation in the sense that u varepsilon(t,x) mathbf E xu varepsilon(0,X t varepsilon) is its unique weak solution. Note that Omega varepsilon collapses to the x 1 axis, a barrier of zero volume, as varepsilon downarrow 0 . The main purpose of this paper is to derive all possible limiting process X of X varepsilon as varepsilon downarrow 0 . In addition, the limiting flux u of the solution u varepsilon as varepsilon downarrow 0 and all possible boundary conditions satisfied by u will be also characterized.


Binary extended formulations and sequential convexification. A binarization of a bounded variable x is a linear formulation with variables x and additional binary variables y 1, dots, y k , so that integrality of x is implied by the integrality of y 1, dots, y k . A binary extended formulation of a polyhedron P is obtained by adding to the original description of P binarizations of some of its variables. In the context of mixed integer programming, imposing integrality on 0 1 variables rather than on general integer variables has interesting convergence properties and has been studied both from the theoretical and from the practical point of view. We propose a notion of emph natural binarizations and binary extended formulations, encompassing all the ones studied in the literature. We give a simple characterization of the vertices of such formulations, which allows us to study their behavior with respect to sequential convexification. 0 1 disjunctions. In particular, given a binary extended formulation and a binarization B of one of its variables x , we study a parameter that measures the progress made towards ensuring the integrality of x via application of sequential convexification. We formulate this parameter, which we call rank, as the solution of a set covering problem and express it exactly for the classical binarizations from the literature.


Using reinforcement learning to autonomously identify the source of errors for agents in a group mission. When agents are swarmed to execute a mission, there is often a sudden failure of some of the agents observed from the command base. Solely relying on the communication between the command base and the concerning agent, it is generally difficult to determine whether the failure is caused by actuators (hypothesis, h a ) or sensors (hypothesis, h s ) However, by instigating collusion between the agents, we can pinpoint the cause of the failure, that is, for h a , we expect to detect corresponding displacements while for h a we do not. We recommend that such swarm strategies applied to grasp the situation be autonomously generated by artificial intelligence (AI). Preferable actions ( e.g., the collision) for the distinction will be those maximizing the difference between the expected behaviors for each hypothesis, as a value function. Such actions exist, however, only very sparsely in the whole possibilities, for which the conventional search based on gradient methods does not make sense. To mitigate the abovementioned shortcoming, we (successfully) applied the reinforcement learning technique, achieving the maximization of such a sparse value function. Machine learning was concluded autonomously.The colliding action is the basis of distinguishing the hypothesizes. To pinpoint the agent with the actuator error via this action, the agents behave as if they are assisting the malfunctioning one to achieve a given mission.


Regionalized location obfuscation mechanism with personalized privacy levels. Global Positioning Systems are now a standard module in mobile devices, and their ubiquity is fueling the rapid growth of location based services (LBSs). This poses the risk of location privacy disclosure. Effective location privacy preservation is foremost for various mobile applications. Recently two strong privacy notions, geo indistinguishability and expected inference error, are proposed based on statistical quantification. They are shown to be complementary for limiting the leakage of location information. In this paper, we argue that personalization means regionalization for geo indistinguishability, and we propose a regionalized location obfuscation mechanism with personalized utility sensitivities. This substantially corrects the differential privacy problem of PIVE framework proposed by Yu, Liu and Pu on ISOC Network and Distributed System Security Symposium (NDSS) in 2017. Since PIVE fails to provide differential privacy guarantees on adaptive protection location set (PLS) as pointed in our previous work, we develop DPIVE with two phases. In Phase I, we determine disjoint sets by partitioning all possible positions such that different locations in the same set share the common PLS. In Phase II, we construct a probability distribution matrix by exponential mechanism in which the rows corresponding to the same PLS have their own sensitivity of utility (diameter of PLS). Moreover, we improve DPIVE with refined location partition and fine grained personalization, in which each location has its own privacy level on two privacy control knobs, minimum inference error and differential privacy parameter. Experiments with two public datasets demonstrate that our mechanisms have the superior performance typically on skewed locations.


Self Supervised Claim Identification for Automated Fact Checking. We propose a novel, attention based self supervised approach to identify "claim worthy" sentences in a fake news article, an important first step in automated fact checking. We leverage "aboutness" of headline and content using attention mechanism for this task. The identified claims can be used for downstream task of claim verification for which we are releasing a benchmark dataset of manually selected compelling articles with veracity labels and associated evidence. This work goes beyond stylistic analysis to identifying content that influences reader belief. Experiments with three datasets show the strength of our model. Data and code available at https github.com architapathak Self Supervised ClaimIdentification


On constructions and properties of self dual generalized bent functions. Bent functions of the form mathbb F 2 n rightarrow mathbb Z q , where q geqslant2 is a positive integer, are known as generalized bent (gbent) functions. Gbent functions for which it is possible to define a dual gbent function are called regular. A regular gbent function is said to be self dual if it coincides with its dual. In this paper we explore self dual gbent functions for even q . We consider several primary and secondary constructions of such functions. It is proved that the numbers of self dual and anti self dual gbent functions coincide. We give necessary and sufficient conditions for the self duality of Maiorana McFarland gbent functions and find Hamming and Lee distances spectrums between them. We find all self dual gbent functions symmetric with respect to two variables and prove that self dual gbent function can not be affine. The properties of sign functions of self dual gbent functions are considered. Symmetries that preserve self duality are also discussed.


L 2 Extension of Adjoint bundles and Koll 'ar's Conjecture. We give a new proof of Koll 'ar's conjecture on the pushforward of the dualizing sheaf twisted by a variation of Hodge structure. This conjecture was settled by M. Saito via mixed Hodge modules and has applications in the investigation of Albanese maps. Our technique is the L 2 method and we give a concrete construction and proofs of the conjecture. The L 2 point of view allows us to generalize Koll 'ar's conjecture to the context of non abelian Hodge theory.


Technical Report for HW2VEC A Graph Learning Tool for Automating Hardware Security. In this technical report, we present HW2VEC 11 , an open source graph learning tool for hardware security, and its implementation details (Figure 1). HW2VEC provides toolboxes for graph representation extraction in the form of Data Flow Graphs (DFGs) or Abstract Syntax Trees (ASTs) from hardware designs at RTL and GLN levels. Besides, HW2VEC also offers graph learning tools for representing hardware designs in vectors that preserve both structural features and behavioral features. To the best of our knowledge, HW2VEC is the first open source research tool that supports applying graph learning methods to hardware designs in different abstraction levels for hardware security. We organize the remainder of this technical report as follows Section 2 introduces the architecture of HW2VEC Section 3 gives information about the use case implementations Section 4 provides the experimental results and demonstrates the performance of HW2VEC for two hardware security applications HT detection and IP piracy detection finally, Section 5 will conclude this report.


Catalyzing collaborations Prescribed interactions at conferences determine team formation. Collaboration plays a key role in knowledge production. Here, we show that patterns of interaction during conferences can be used to predict who will subsequently form a new collaboration, even when interaction is prescribed rather than freely chosen. We introduce a novel longitudinal dataset tracking patterns of interaction among hundreds of scientists during multi day conferences encompassing different scientific fields over the span of 5 years. We find that participants who formed new collaborations interacted 63 more on average than those who chose not to form new teams, and that those assigned to a higher interaction scenario had more than an eightfold increase in their odds of collaborating. We propose a simple mathematical framework for the process of team formation that incorporates this observation as well as the effect of memory beyond interaction time. The model accurately reproduces the collaborations formed across all conferences and outperforms seven other candidate models. This work not only suggests that encounters between individuals at conferences play an important role in shaping the future of science, but that these encounters can be designed to better catalyze collaborations.


GLaM Efficient Scaling of Language Models with Mixture of Experts. Scaling language models with more data, compute and parameters has driven significant progress in natural language processing. For example, thanks to scaling, GPT 3 was able to achieve strong results on in context learning tasks. However, training these large dense models requires significant amounts of computing resources. In this paper, we propose and develop a family of language models named GLaM (Generalist Language Model), which uses a sparsely activated mixture of experts architecture to scale the model capacity while also incurring substantially less training cost compared to dense variants. The largest GLaM has 1.2 trillion parameters, which is approximately 7x larger than GPT 3. It consumes only 1 3 of the energy used to train GPT 3 and requires half of the computation flops for inference, while still achieving better overall zero shot and one shot performance across 29 NLP tasks.


MultiFace A Generic Training Mechanism for Boosting Face Recognition Performance. Deep Convolutional Neural Networks (DCNNs) and their variants have been widely used in large scale face recognition(FR) recently. Existing methods have achieved good performance on many FR benchmarks. However, most of them suffer from two major problems. First, these methods converge quite slowly since they optimize the loss functions in a high dimensional and sparse Gaussian Sphere. Second, the high dimensionality of features, despite the powerful descriptive ability, brings difficulty to the optimization, which may lead to a sub optimal local optimum. To address these problems, we propose a simple yet efficient training mechanism called MultiFace, where we approximate the original high dimensional features by the ensemble of low dimensional features. The proposed mechanism is also generic and can be easily applied to many advanced FR models. Moreover, it brings the benefits of good interpretability to FR models via the clustering effect. In detail, the ensemble of these low dimensional features can capture complementary yet discriminative information, which can increase the intra class compactness and inter class separability. Experimental results show that the proposed mechanism can accelerate 2 3 times with the softmax loss and 1.2 1.5 times with Arcface or Cosface, while achieving state of the art performances in several benchmark datasets. Especially, the significant improvements on large scale datasets(e.g., IJB and MageFace) demonstrate the flexibility of our new training mechanism.


A no expanding breather theorem for noncompact Ricci flows. In this note we show that, under certain curvature positivity conditions (the weak operatorname PIC 2 condition or the nonnegative bisectional curvature condition), a complete and noncompact expanding breather of the Ricci flow is also an expanding gradient Ricci soliton. This is the first no expanding breather theorem in the noncompact category.


Random subcomplexes of finite buildings, and fibering of commutator subgroups of right angled Coxeter groups. The main theme of this paper is higher virtual algebraic fibering properties of right angled Coxeter groups (RACGs), with a special focus on those whose defining flag complex is a finite building. We prove for particular classes of finite buildings that their random induced subcomplexes have a number of strong properties, most prominently that they are highly connected. From this we are able to deduce that the commutator subgroup of a RACG, with defining flag complex a finite building of a certain type, admits an epimorphism to mathbb Z whose kernel has strong topological finiteness properties. We additionally use our techniques to present examples where the kernel is of type textrm F 2 but not textrm FP 3 , and examples where the RACG is hyperbolic and the kernel is finitely generated and non hyperbolic. The key tool we use is a generalization of an approach due to Jankiewicz Norin Wise involving Bestvina Brady discrete Morse theory applied to the Davis complex of a RACG, together with some probabilistic arguments.


The measures with L 2 bounded Riesz transform and the Painlev 'e problem for Lipschitz harmonic functions. This work provides a geometric characterization of the measures mu in mathbb R n 1 with polynomial upper growth of degree n such that the n dimensional Riesz transform R mu (x) int frac x y x y n 1 ,d mu(y) belongs to L 2( mu) . More precisely, it is shown that R mu L 2( mu) 2 mu approx int ! ! int 0 infty beta 2, mu (x,r) 2 , frac mu(B(x,r)) r n , frac dr r ,d mu(x) mu , where beta mu,2 (x,r) 2 inf L frac1 r n int B(x,r) left( frac dist(y,L) r right) 2 ,d mu(y), with the infimum taken over all affine n planes L subset mathbb R n 1 . As a corollary, one obtains a characterization of the removable sets for Lipschitz harmonic functions in terms of a metric geometric potential and one deduces that the class of removable sets for Lipschitz harmonic functions is invariant by bilipschitz mappings.


Learning from My Friends Few Shot Personalized Conversation Systems via Social Networks. Personalized conversation models (PCMs) generate responses according to speaker preferences. Existing personalized conversation tasks typically require models to extract speaker preferences from user descriptions or their conversation histories, which are scarce for newcomers and inactive users. In this paper, we propose a few shot personalized conversation task with an auxiliary social network. The task requires models to generate personalized responses for a speaker given a few conversations from the speaker and a social network. Existing methods are mainly designed to incorporate descriptions or conversation histories. Those methods can hardly model speakers with so few conversations or connections between speakers. To better cater for newcomers with few resources, we propose a personalized conversation model (PCM) that learns to adapt to new speakers as well as enabling new speakers to learn from resource rich speakers. Particularly, based on a meta learning based PCM, we propose a task aggregator (TA) to collect other speakers' information from the social network. The TA provides prior knowledge of the new speaker in its meta learning. Experimental results show our methods outperform all baselines in appropriateness, diversity, and consistency with speakers.


Joining Forces Applying Design Thinking Techniques in Scrum Meetings. The most prominent Agile framework Scrum, is often criticized for its amount of meetings. These regular events are essential to the empirical inspect and adapt cycle proposed by Agile methods. Scrum meetings face several challenges, such as being perceived as boring, repetitive, or irrelevant, leading to decreased cooperation in teams and less successful projects. In an attempt to address these challenges, Agile practitioners have adopted teamwork, innovation, and design techniques geared towards improving collaboration. Additionally, they have developed their own activities to be used in Scrum meetings, most notably for conducting retrospective and planning events. Design thinking incorporates non designers and designers in design and conceptualization activities, including user research, ideation, or testing. Accordingly, the design thinking approach provides a process with different phases and accompanying techniques for each step. These design thinking techniques can support shared understanding in teams and can improve collaboration, creativity, and product understanding. For these reasons, design thinking techniques represent a worthwhile addition to the Scrum meeting toolkit and can support Agile meetings in preventing or countering common meeting challenges and achieving meeting goals. This chapter explores how techniques from the design thinking toolkit can support Scrum meetings from a theoretical and practical viewpoint. We analyze Scrum meetings' requirements, goals, and challenges and link them to groups of techniques from the design thinking toolkit. In addition, we review interview and observational data from two previous studies with software development practitioners and derive concrete examples. As a result, we present initial guidelines on integrating design thinking techniques into Scrum meetings to make them more engaging, collaborative, and interactive.


On the Number of Arrows of Cluster Quivers. Let tilde Q (resp. Q ) be an extended exchange (resp. exchange) cluster quiver of finite mutation type. We introduce the distribution set of the number of arrows for Mut tilde Q (resp. Mut Q ), give the maximum and minimum numbers of the distribution set and establish the existence of an extended complete walk (resp. a complete walk). As a consequence, we prove that the distribution set for Mut tilde Q (resp. Mut Q ) is continuous except the exceptional cases. In case of cluster quivers Q inf of infinite mutation type, the number of arrows does not present a continuous distribution. Besides, we show that the maximal number of arrows of quivers in Mut Q inf is infinite if and only if the maximal number of arrows between any two vertices of a quiver in Mut Q inf is infinite.


A relative mass cocycle and the mass of asymptotically hyperbolic manifolds. We construct a cocycle that, for a given n manifold, maps pairs of asymptotically locally hyperbolic (ALH) metrics to a tractor valued (n 1) form field on the conformal infinity. This describes, locally on the boundary, a relative mass difference between the pairs of ALH metrics, where the latter are required to be asymptotically related to a given order that depends on the dimension. It is distinguished as a geometric object by its property of being invariant under suitable diffeomorphisms fixing the boundary, and that act on (either) one of the argument metrics. Specialising to the case of an ALH metric h that is suitably asymptotically related to a locally hyperbolic conformally compact metric, we show that the cocycle detemines an absolute invariant c(h) . This tractor valued (n 1) form field on the conformal infinity is canonically associated to h (i.e. is not dependent on other choices) and is equivariant under the appropriate diffeomorphisms. Finally specialising further to the case that the boundary is a sphere and that a metric h is asymptotically related to a hyperbolic metric on the interior, we show that the invariant c(h) can be integrated over the boundary. The result pairs with solutions of the KID (Killing initial data) equation to recover the known description of hyperbolic mass integrals of Wang, and Chru ' s ciel Herzlich.


SelfDoc Self Supervised Document Representation Learning. We propose SelfDoc, a task agnostic pre training framework for document image understanding. Because documents are multimodal and are intended for sequential reading, our framework exploits the positional, textual, and visual information of every semantically meaningful component in a document, and it models the contextualization between each block of content. Unlike existing document pre training models, our model is coarse grained instead of treating individual words as input, therefore avoiding an overly fine grained with excessive contextualization. Beyond that, we introduce cross modal learning in the model pre training phase to fully leverage multimodal information from unlabeled documents. For downstream usage, we propose a novel modality adaptive attention mechanism for multimodal feature fusion by adaptively emphasizing language and vision signals. Our framework benefits from self supervised pre training on documents without requiring annotations by a feature masking training strategy. It achieves superior performance on multiple downstream tasks with significantly fewer document images used in the pre training stage compared to previous works.


An electro optically tunable microring laser monolithically integrated on lithium niobate on insulator. We demonstrate monolithic integration of an electro optically (EO) tunable microring laser on lithium niobate on insulator (LNOI) platform. The device is fabricated by photolithography assisted chemo mechanical etching (PLACE), and the pump laser is evanescently coupled into the erbium (Er3 ) doped LN microring laser using an undoped LN waveguide mounted above the microring. The quality factor of the LN microring resonator is measured as high as 1.54x10 5 at the wavelength of 1542 nm. Lasing action can be observed at a pump power threshold below 3.5 mW using a 980 nm continuous wave pump laser. Finally, tuning of the laser wavelength is achieved by varying the electric voltage on the microelectrodes fabricated in the vicinity of microring waveguide, showing an EO coefficient of 0.33 pm V.


Baseline Skinning for Point Sets of Articulated Bodies. General skinning techniques aim to deform the surface of an articulated model following the pose change of a skeleton. Their rapidity makes them ideal tools for real time animation purposes. However, popular skinning algorithms are simple, but they tend to generate undesirable geometric artefacts. In our work, we consider skeletons given in the form of sphere mesh models controlling both the pose and morphology of the shape that is either described as a mesh or a raw point set. We propose a novel skinning method that encodes the point set details above a bundle of baselines covering the sphere mesh. In particular, we propose a geometrical model of the baseline and detail direction evolution during bone twisting and joints bending rotations. Our approach works directly on point sets and thus preserves the accuracy of the initial sampling. It further avoids computing a weight per point or a costly explicit muscle modelling step. We evaluate our method on several articulated body point sets, showing that it creates fewer artefacts than classical methods.


Optimal Spanners for Unit Ball Graphs in Doubling Metrics. Resolving an open question from 2006, we prove the existence of light weight bounded degree spanners for unit ball graphs in the metrics of bounded doubling dimension, and we design a simple mathcal O ( log n) round distributed algorithm that given a unit ball graph G with n vertices and a positive constant epsilon 1 finds a (1 epsilon) spanner with constant bounds on its maximum degree and its lightness using only 2 hop neighborhood information. This immediately improves the algorithm of Damian, Pandit, and Pemmaraju which runs in mathcal O ( log n) rounds but has a mathcal O ( log Delta) bound on its lightness, where Delta is the ratio of the length of the longest edge in G to the length of the shortest edge. We further study the problem in the two dimensional Euclidean plane and we provide a construction with similar properties that has a constant average number of edge intersection per node. This is the first distributed low intersection topology control algorithm to the best of our knowledge. Our distributed algorithms rely on the maximal independent set algorithm of Schneider and Wattenhofer that runs in mathcal O ( log n) rounds of communication. If a maximal independent set is known beforehand, our algorithms run in constant number of rounds.


Cucker Smale model with finite speed of information propagation well posedness, flocking and mean field limit. We study a variant of the Cucker Smale model where information between agents propagates with a finite speed mathfrak c 0 . This leads to a system of functional differential equations with state dependent delay. We prove that, if initially the agents travel slower than c , then the discrete model admits unique global solutions. Moreover, under a generic assumption on the influence function, we show that there exists a critical information propagation speed mathfrak c ast 0 such that if mathfrak c geq mathfrak c ast , the system exhibits asymptotic flocking in the sense of the classical definition of Cucker and Smale. For constant initial datum the value of mathfrak c ast is explicitly calculable. Finally, we derive a mean field limit of the discrete system, which is formulated in terms of probability measures on the space of time dependent trajectories. We show global well posedness of the mean field problem and argue that it does not admit a description in terms of the classical Fokker Planck equation.


INODE Building an End to End Data Exploration System in Practice Extended Vision . A full fledged data exploration system must combine different access modalities with a powerful concept of guiding the user in the exploration process, by being reactive and anticipative both for data discovery and for data linking. Such systems are a real opportunity for our community to cater to users with different domain and data science expertise. We introduce INODE an end to end data exploration system that leverages, on the one hand, Machine Learning and, on the other hand, semantics for the purpose of Data Management (DM). Our vision is to develop a classic unified, comprehensive platform that provides extensive access to open datasets, and we demonstrate it in three significant use cases in the fields of Cancer Biomarker Reearch, Research and Innovation Policy Making, and Astrophysics. INODE offers sustainable services in (a) data modeling and linking, (b) integrated query processing using natural language, (c) guidance, and (d) data exploration through visualization, thus facilitating the user in discovering new insights. We demonstrate that our system is uniquely accessible to a wide range of users from larger scientific communities to the public. Finally, we briefly illustrate how this work paves the way for new research opportunities in DM.


Prime Tuples and Siegel Zeros. Under the assumption of infinitely many Siegel zeroes s with Re(s) 1 frac 1 ( log q) r r for a sufficiently large value of r , we prove that there exist infinitely many m tuples of primes that are ll e 1.9828m apart. This "improves" (in some sense) on the bounds of Maynard Tao, Baker Irving, and Polymath 8b, who found bounds of e 3.815m unconditionally and me 2m assuming the Elliott Halberstam conjecture it also generalizes a 1983 result of Heath Brown that states that infinitely many Siegel zeroes would imply infinitely many twin primes. Under this assumption of Siegel zeroes, we also improve the upper bounds for the gaps between prime triples, quadruples, quintuples, and sextuples beyond the bounds found via Elliott Halberstam.


Fundamentals of Partial Rejection Sampling. Partial Rejection Sampling is an algorithmic approach to obtaining a perfect sample from a specified distribution. The objects to be sampled are assumed to be represented by a number of random variables. In contrast to classical rejection sampling, in which all variables are resampled until a feasible solution is found, partial rejection sampling aims at greater efficiency by resampling only a subset of variables that go wrong'. Partial rejection sampling is closely related to Moser and Tardos' algorithmic version of the Lov 'asz Local Lemma, but with the additional requirement that a specified output distribution should be met. This article provides a largely self contained account of the basic form of the algorithm and its analysis.


Linear Principal Minor Polynomials Hyperbolic Determinantal Inequalities and Spectral Containment. A linear principal minor polynomial or lpm polynomial is a linear combination of principal minors of a symmetric matrix. By restricting to the diagonal, lpm polynomials are in bijection to multiaffine polynomials. We show that this establishes a one to one correspondence between homogeneous multiaffine stable polynomials and PSD stable lpm polynomials. This yields new construction techniques for hyperbolic polynomials and allows us to generalize the well known Fisher Hadamard and Koteljanskii inequalities from determinants to PSD stable lpm polynomials. We investigate the relationship between the associated hyperbolicity cones and conjecture a relationship between the eigenvalues of a symmetric matrix and the values of certain lpm polynomials evaluated at that matrix. We refer to this relationship as spectral containment.


The Pareto Frontier of model selection for general Contextual Bandits. Recent progress in model selection raises the question of the fundamental limits of these techniques. Under specific scrutiny has been model selection for general contextual bandits with nested policy classes, resulting in a COLT2020 open problem. It asks whether it is possible to obtain simultaneously the optimal single algorithm guarantees over all policies in a nested sequence of policy classes, or if otherwise this is possible for a trade off alpha in frac 1 2 ,1) between complexity term and time ln( Pi m ) 1 alpha T alpha . We give a disappointing answer to this question. Even in the purely stochastic regime, the desired results are unobtainable. We present a Pareto frontier of up to logarithmic factors matching upper and lower bounds, thereby proving that an increase in the complexity term ln( Pi m ) independent of T is unavoidable for general policy classes. As a side result, we also resolve a COLT2016 open problem concerning second order bounds in full information games.


The k path vertex cover general bounds and chordal graphs. For an integer k ge 3 , a k path vertex cover of a graph G (V,E) is a set T subseteq V that shares a vertex with every path subgraph of order k in G . The minimum cardinality of a k path vertex cover is denoted by psi k(G) . We give estimates mostly upper bounds on psi k(G) in terms of various parameters, including vertex degrees and the number of vertices and edges. The problem is also considered on chordal graphs and planar graphs.


Longest minimal length partitions. This article provides numerical evidence that under volume constraint the ball is the set which maximizes the perimeter of the least perimeter partition into cells with prescribed areas. We introduce a numerical maximization algorithm which performs multiple optimizations steps at each iteration to approximate minimal partitions. Using these partitions we compute perturbations of the domain which increase the minimal perimeter. The initialization of the optimal partitioning algorithm uses capacity constrained Voronoi diagrams. A new algorithm is proposed to identify such diagrams, by computing the gradients of areas and perimeters for the Voronoi cells with respect to the Voronoi points.


Self Calibration of the Offset Between GPS and Semantic Map Frames for Robust Localization. In self driving, standalone GPS is generally considered to have insufficient positioning accuracy to stay in lane. Instead, many turn to LIDAR localization, but this comes at the expense of building LIDAR maps that can be costly to maintain. Another possibility is to use semantic cues such as lane lines and traffic lights to achieve localization, but these are usually not continuously visible. This issue can be remedied by combining semantic cues with GPS to fill in the gaps. However, due to elapsed time between mapping and localization, the live GPS frame can be offset from the semantic map frame, requiring calibration. In this paper, we propose a robust semantic localization algorithm that self calibrates for the offset between the live GPS and semantic map frames by exploiting common semantic cues, including traffic lights and lane markings. We formulate the problem using a modified Iterated Extended Kalman Filter, which incorporates GPS and camera images for semantic cue detection via Convolutional Neural Networks. Experimental results show that our proposed algorithm achieves decimetre level accuracy comparable to typical LIDAR localization performance and is robust against sparse semantic features and frequent GPS dropouts.


Gaussian fluctuations for interacting particle systems with singular kernels. We consider the asymptotic behavior of the fluctuations for the empirical measures of interacting particle systems with singular kernels. We prove that the sequence of fluctuation processes converges in distribution to a generalized Ornstein Uhlenbeck process. Our result considerably extends classical results to singular kernels, including the Biot Savart law. The result applies to the point vortex model approximating the 2D incompressible Navier Stokes equation and the 2D Euler equation. We also obtain Gaussianity and optimal regularity of the limiting Ornstein Uhlenbeck process. The method relies on the martingale approach and the Donsker Varadhan variational formula, which transfers the uniform estimate to some exponential integrals. Estimation of those exponential integrals follows by cancellations and combinatorics techniques and is of the type of large deviation principle.


Self Adaptive Reconfigurable Arrays (SARA) Using ML to Assist Scaling GEMM Acceleration. With increasing diversity in Deep Neural Network(DNN) models in terms of layer shapes and sizes, the research community has been investigating flexible reconfigurable accelerator substrates. This line of research has opened up two challenges. The first is to determine the appropriate amount of flexibility within an accelerator array that that can trade off the performance benefits versus the area overheads of the reconfigurability. The second is being able to determine the right configuration of the array for the current DNN model and or layer and reconfigure the accelerator at runtime. This work introduces a new class of accelerators that we call Self Adaptive Reconfigurable Array (SARA). SARA architectures comprise of both a reconfigurable array and a hardware unit capable of determining an optimized configuration for the array at runtime. We demonstrate an instance of SARA with an accelerator we call SAGAR, which introduces a novel reconfigurable systolic array that can be configured to work as a distributed collection of smaller arrays of various sizes or as a single array with flexible aspect ratios. We also develop a novel recommendation neural network called ADAPTNET which recommends an array configuration and dataflow for the current layer parameters. ADAPTNET runs on an integrated custom hardware ADAPTNETX that runs ADAPTNET at runtime and reconfigures the array, making the entire accelerator self sufficient. SAGAR is capable of providing the same mapping flexibility as a collection of 1024 4x4 arrays working as a distributed system while achieving 3.5x more power efficiency and 3.2x higher compute density Furthermore, the runtime achieved on the recommended parameters from ADAPTNET is 99.93 of the best achievable runtime.


A Survey on Threat Situation Awareness Systems Framework, Techniques, and Insights. Cyberspace is full of uncertainty in terms of advanced and sophisticated cyber threats which are equipped with novel approaches to learn the system and propagate themselves, such as AI powered threats. To debilitate these types of threats, a modern and intelligent Cyber Situation Awareness (SA) system need to be developed which has the ability of monitoring and capturing various types of threats, analyzing and devising a plan to avoid further attacks. This paper provides a comprehensive study on the current state of the art in the cyber SA to discuss the following aspects of SA key design principles, framework, classifications, data collection, and analysis of the techniques, and evaluation methods. Lastly, we highlight misconceptions, insights and limitations of this study and suggest some future work directions to address the limitations.


Image Fusion Transformer. In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state of the art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features for image fusion. Specifically, CNN based methods perform image fusion by fusing local features. However, they do not consider long range dependencies that are present in the image. Transformer based models are designed to overcome this by modeling the long range dependencies with the help of self attention mechanism. This motivates us to propose a novel Image Fusion Transformer (IFT) where we develop a transformer based multi scale fusion strategy that attends to both local and long range information (or global context). The proposed method follows a two stage training approach. In the first stage, we train an auto encoder to extract deep features at multiple scales. In the second stage, multi scale features are fused using a Spatio Transformer (ST) fusion strategy. The ST fusion blocks are comprised of a CNN and a transformer branch which capture local and long range features, respectively. Extensive experiments on multiple benchmark datasets show that the proposed method performs better than many competitive fusion algorithms. Furthermore, we show the effectiveness of the proposed ST fusion strategy with an ablation analysis. The source code is available at https github.com Vibashan Image Fusion Transformer.


Interactive Model with Structural Loss for Language based Abductive Reasoning. The abductive natural language inference task ( alpha NLI) is proposed to infer the most plausible explanation between the cause and the event. In the alpha NLI task, two observations are given, and the most plausible hypothesis is asked to pick out from the candidates. Existing methods model the relation between each candidate hypothesis separately and penalize the inference network uniformly. In this paper, we argue that it is unnecessary to distinguish the reasoning abilities among correct hypotheses and similarly, all wrong hypotheses contribute the same when explaining the reasons of the observations. Therefore, we propose to group instead of ranking the hypotheses and design a structural loss called joint softmax focal loss'' in this paper. Based on the observation that the hypotheses are generally semantically related, we have designed a novel interactive language model aiming at exploiting the rich interaction among competing hypotheses. We name this new model for alpha NLI Interactive Model with Structural Loss (IMSL). The experimental results show that our IMSL has achieved the highest performance on the RoBERTa large pretrained model, with ACC and AUC results increased by about 1 and 5 respectively.


Constitutive Relation by Regression Reveals Scaling Law for Hydrodynamic Transport Coefficients. Finding extended hydrodynamics equations valid from the dense gas region to the rarefied gas region remains a great challenge. The key to success is to obtain accurate constitutive relations for stress and heat flux. Recent data driven models offer a new phenomenological approach to learning constitutive relations from data. Such models enable complex constitutive relations that extend Newton's law of viscosity and Fourier's law of heat conduction, by regression on higher derivatives. However, choices of derivatives in these models are ad hoc without a clear physical explanation. We investigated data driven models theoretically on a linear system. We argue that these models are equivalent to non linear length scale scaling laws of transport coefficients. The equivalence to scaling laws justified the physical plausibility and revealed the limitation of data driven models. Our argument also points out modeling the scaling law explicitly could avoid practical difficulties in data driven models like derivative estimation and variable selection on noisy data. We further proposed a constitutive relation model based on scaling law and tested it on the calculation of Rayleigh scattering spectra. The result shows data driven model has a clear advantage over the Chapman Enskog expansion and moment methods for the first time.


Cascaded optical nonlinearities in dielectric metasurfaces. Since the discovery of the laser, optical parametric nonlinearities have been at the core of efficient light conversion sources. Typically, thick transparent crystals or quasi phase matched waveguides, are utilized in conjunction with phase matching techniques to select a single parametric process. In recent years, due to the rapid developments in artificially structured materials, optical frequency mixing has been achieved at the nanoscale in subwavelength resonators arrayed as metasurfaces. Phase matching becomes relaxed for these wavelength scale structures, and all allowed nonlinear processes can, in principle, occur on an equal footing. This could promote harmonic generation via a cascaded (consisting of several frequency mixing steps) process. However, so far, all reported work on dielectric metasurfaces have assumed frequency mixing from a direct (single step) nonlinear process. In this work, we prove the existence of cascaded second order optical nonlinearities by analyzing the second and third wave mixing from a highly nonlinear metasurface in conjunction with polarization selection rules and crystal symmetries. We find that the third wave mixing signal from a cascaded process can be of comparable strength to that from conventional third harmonic generation, and that surface nonlinearities are the dominant mechanism that contributes to cascaded second order nonlinearities


Blockchain empowered Edge Intelligence for Internet of Medical Things Against COVID 19. We have witnessed an unprecedented public health crisis caused by the new coronavirus disease (COVID 19), which has severely affected medical institutions, our common lives, and social economic activities. This crisis also reveals the brittleness of existing medical services, such as over centralization of medical resources, the hysteresis of medical services digitalization, and weak security and privacy protection of medical data. The integration of the Internet of Medical Things (IoMT) and blockchain is expected to be a panacea to COVID 19 attributed to the ubiquitous presence and the perception of IoMT as well as the enhanced security and immutability of the blockchain. However, the synergy of IoMT and blockchain is also faced with challenges in privacy, latency, and context absence. The emerging edge intelligence technologies bring opportunities to tackle these issues. In this article, we present a blockchain empowered edge intelligence for IoMT in addressing the COVID 19 crisis. We first review IoMT, edge intelligence, and blockchain in addressing the COVID 19 pandemic. We then present an architecture of blockchain empowered edge intelligence for IoMT after discussing the opportunities of integrating blockchain and edge intelligence. We next offer solutions to COVID 19 brought by blockchain empowered edge intelligence from 1) monitoring and tracing COVID 19 pandemic origin, 2) traceable supply chain of injectable medicines and COVID 19 vaccines, and 3) telemedicine and remote healthcare services. Moreover, we also discuss the challenges and open issues in blockchain empowered edge intelligence.


Inferring Offensiveness In Images From Natural Language Supervision. Probing or fine tuning (large scale) pre trained models results in state of the art performance for many NLP tasks and, more recently, even for computer vision tasks when combined with image data. Unfortunately, these approaches also entail severe risks. In particular, large image datasets automatically scraped from the web may contain derogatory terms as categories and offensive images, and may also underrepresent specific classes. Consequently, there is an urgent need to carefully document datasets and curate their content. Unfortunately, this process is tedious and error prone. We show that pre trained transformers themselves provide a methodology for the automated curation of large scale vision datasets. Based on human annotated examples and the implicit knowledge of a CLIP based model, we demonstrate that one can select relevant prompts for rating the offensiveness of an image. In addition to e.g. privacy violation and pornographic content previously identified in ImageNet, we demonstrate that our approach identifies further inappropriate and potentially offensive content.


Predicting the spread of COVID 19 in Delhi, India using Deep Residual Recurrent Neural Networks. Detecting the spread of coronavirus will go a long way toward reducing human and economic loss. Unfortunately, existing Epidemiological models used for COVID 19 prediction models are too slow and fail to capture the COVID 19 development in detail. This research uses Partial Differential Equations to improve the processing speed and accuracy of forecasting of COVID 19 governed by SEIRD model equations. The dynamics of COVID 19 were extracted using Convolutional Neural Networks and Deep Residual Recurrent Neural Networks from data simulated using PDEs. The DRRNNs accuracy is measured using Mean Squared Error. The DRRNNs COVID 19 prediction model has been shown to have accurate COVID 19 predictions. In addition, we concluded that DR RNNs can significantly advance the ability to support decision making in real time COVID 19 prediction.


Blow up algebras of secant varieties of rational normal scrolls. In this paper, we are mainly concerned with the blow up algebras of the secant varieties of balanced rational normal scrolls. In the first part, we give implicit defining equations of their associated Rees algebras and fiber cones. Consequently, we can tell that the fiber cones are Cohen Macaulay normal domains. Meanwhile, these fiber cones have rational singularities in characteristic zero, and are F rational in positive characteristic. The Gorensteinness of the fiber cones can also be characterized. In the second part, we compute the Castelnuovo Mumford regularities and mathbf a invariants of the fiber cones. We also present the reduction numbers of the ideals defined by the secant varieties.


Clinica an open source software platform for reproducible clinical neuroscience studies. We present Clinica (www.clinica.run), an open source software platform designed to make clinical neuroscience studies easier and more reproducible. Clinica aims for researchers to i) spend less time on data management and processing, ii) perform reproducible evaluations of their methods, and iii) easily share data and results within their institution and with external collaborators. The core of Clinica is a set of automatic pipelines for processing and analysis of multimodal neuroimaging data (currently, T1 weighted MRI, diffusion MRI and PET data), as well as tools for statistics, machine learning and deep learning. It relies on the brain imaging data structure (BIDS) for the organization of raw neuroimaging datasets and on established tools written by the community to build its pipelines. It also provides converters of public neuroimaging datasets to BIDS (currently ADNI, AIBL, OASIS and NIFD). Processed data include image valued scalar fields (e.g. tissue probability maps), meshes, surface based scalar fields (e.g. cortical thickness maps) or scalar outputs (e.g. regional averages). These data follow the ClinicA Processed Structure (CAPS) format which shares the same philosophy as BIDS. Consistent organization of raw and processed neuroimaging files facilitates the execution of single pipelines and of sequences of pipelines, as well as the integration of processed data into statistics or machine learning frameworks. The target audience of Clinica is neuroscientists or clinicians conducting clinical neuroscience studies involving multimodal imaging, and researchers developing advanced machine learning algorithms applied to neuroimaging data.


(Mis)alignment Between Stance Expressed in Social Media Data and Public Opinion Surveys. Stance detection, which aims to determine whether an individual is for or against a target concept, promises to uncover public opinion from large streams of social media data. Yet even human annotation of social media content does not always capture "stance" as measured by public opinion polls. We demonstrate this by directly comparing an individual's self reported stance to the stance inferred from their social media data. Leveraging a longitudinal public opinion survey with respondent Twitter handles, we conducted this comparison for 1,129 individuals across four salient targets. We find that recall is high for both "Pro" and "Anti" stance classifications but precision is variable in a number of cases. We identify three factors leading to the disconnect between text and author stance temporal inconsistencies, differences in constructs, and measurement errors from both survey respondents and annotators. By presenting a framework for assessing the limitations of stance detection models, this work provides important insight into what stance detection truly measures.


The 23 rd and 24 th homotopy groups of the n th rotation group. We denote by pi k(R n) the k th homotopy group of the n th rotation group R n and pi k(R n 2) the 2 primary components of it. We determine the group structures of pi k(R n 2) for k 23 and 24 by use of the fibration R n 1 overset R n longrightarrow S n . The method is based on Toda's composition methods.


Second order finite difference approximations of the upper convected time derivative. In this work, new finite difference schemes are presented for dealing with the upper convected time derivative in the context of the generalized Lie derivative. The upper convected time derivative, which is usually encountered in the constitutive equation of the popular viscoelastic models, is reformulated in order to obtain approximations of second order in time for solving a simplified constitutive equation in one and two dimensions. The theoretical analysis of the truncation errors of the methods takes into account the linear and quadratic interpolation operators based on a Lagrangian framework. Numerical experiments illustrating the theoretical results for the model equation defined in one and two dimensions are included. Finally, the finite difference approximations of second order in time are also applied for solving a two dimensional Oldroyd B constitutive equation subjected to a prescribed velocity field at different Weissenberg numbers.


Executable Interval Temporal Logic Specifications. In this paper the reversibility of executable Interval Temporal Logic (ITL) specifications is investigated. ITL allows for the reasoning about systems in terms of behaviours which are represented as non empty sequences of states. It allows for the specification of systems at different levels of abstraction. At a high level this specification is in terms of properties, for instance safety and liveness properties. At concrete level one can specify a system in terms of programming constructs. One can execute these concrete specification, i.e., test and simulate the behaviour of the system. In this paper we will formalise this notion of executability of ITL specifications. ITL also has a reflection operator which allows for the reasoning about reversed behaviours. We will investigate the reversibility of executable ITL specifications, i.e., how one can use this reflection operator to reverse the concrete behaviour of a particular system.


Near Zero Shot Suggestion Mining with a Little Help from WordNet. In this work, we explore the constructive side of online reviews advice, tips, requests, and suggestions that users provide about goods, venues, services, and other items of interest. To reduce training costs and annotation efforts needed to build a classifier for a specific label set, we present and evaluate several entailment based zero shot approaches to suggestion classification in a label fully unseen fashion. In particular, we introduce the strategy of assigning target class labels to sentences in English language with user intentions, which significantly improves prediction quality. The proposed strategies are evaluated with a comprehensive experimental study that validated our results both quantitatively and qualitatively.