Majorizing Norms on Majorized Spaces. We introduce a new type of norm for ordered vector spaces majorized by a proper (convex) cone that generalizes the notions of order unit norm and base norm. Then we give sufficient conditions to ensure its completeness. In the case of normed Riesz spaces, we also present necessary completeness conditions and describe the completed norm. Finally, we define a particular family of well behaving sets. Spaces majorized by the cone generated by these sets display surprisingly interesting structural properties. In particular, we generalize two famous standard results in Banach lattice theory. Namely, every principal ideal in a Banach lattice is an AM space and every Banach lattice having a generating cone with a compact base admits an equivalent L norm.


Verifying C11 Style Weak Memory Libraries via Refinement. Deductive verification of concurrent programs under weak memory has thus far been limited to simple programs over a monolithic state space. For scalability, we also require modular techniques with verifiable library abstractions. This paper addresses this challenge in the context of RC11 RAR, a subset of the C11 memory model that admits relaxed and release acquire accesses, but disallows, so called, load buffering cycles. We develop a simple framework for specifying abstract objects that precisely characterises the observability guarantees of abstract method calls. We show how this framework can be integrated with an operational semantics that enables verification of client programs that execute abstract method calls from a library they use. Finally, we show how implementations of such abstractions in RC11 RAR can be verified by developing a (contextual) refinement framework for abstract objects. Our framework, including the operational semantics, verification technique for client library programs, and simulation between abstract libraries and their implementations, has been mechanised in Isabelle HOL.


Condenser a Pre training Architecture for Dense Retrieval. Pre trained Transformer language models (LM) have become go to text representation encoders. Prior research fine tunes deep LMs to encode text sequences such as sentences and passages into single dense vector representations for efficient text comparison and retrieval. However, dense encoders require a lot of data and sophisticated techniques to effectively train and suffer in low data situations. This paper finds a key reason is that standard LMs' internal attention structure is not ready to use for dense encoders, which needs to aggregate text information into the dense representation. We propose to pre train towards dense encoder with a novel Transformer architecture, Condenser, where LM prediction CONditions on DENSE Representation. Our experiments show Condenser improves over standard LM by large margins on various text retrieval and similarity tasks.


Visualization of Nonlinear Programming for Robot Motion Planning. Nonlinear programming targets nonlinear optimization with constraints, which is a generic yet complex methodology involving humans for problem modeling and algorithms for problem solving. We address the particularly hard challenge of supporting domain experts in handling, understanding, and trouble shooting high dimensional optimization with a large number of constraints. Leveraging visual analytics, users are supported in exploring the computation process of nonlinear constraint optimization. Our system was designed for robot motion planning problems and developed in tight collaboration with domain experts in nonlinear programming and robotics. We report on the experiences from this design study, illustrate the usefulness for relevant example cases, and discuss the extension to visual analytics for nonlinear programming in general.


Totally Umbilical Hypersurfaces of Product Spaces. Given a Riemannian manifold M, and an open interval I subset mathbb R , we characterize nontrivial totally umbilical hypersurfaces of the product M times I as well as of warped products I times omega M as those which are local graphs built on isoparametric families of totally umbilical hypersurfaces of M. By means of this characterization, we fully extend to mathbb S n times mathbb R and mathbb H n times mathbb R the results by Souam and Toubiana on the classification of totally umbilical hypersurfaces of mathbb S 2 times mathbb R and mathbb H 2 times mathbb R . It is also shown that an analogous classification holds for arbitrary warped products I times omega mathbb S n and I times omega mathbb H n.


Universal flapping states of elastic fibers in modulated turbulence. We study the fully coupled dynamics between a fully developed turbulent flow and an ensemble of immersed flexible fibers. We vary the concentration of the suspension, the mechanical properties and the length of the fibers in a vast parametric range. For all configurations, the fiber dynamics falls in only two possible dynamical states (i) the fiber manifests its natural response to the flow forcing or (ii) its motion fully synchronizes to the hydrodynamic timescales of the turbulent flow. This scenario holds for both a dilute condition, where the carrier flow is not affected by the fluid structure interaction, as well as in the case where the flow is substantially altered by the presence of the immersed objects. Such backreaction effect can be macroscopically modelled in terms of the mass fraction of the suspension. Our results can be readily extended to any elastic objects interacting with fluid turbulence.


Networking Group Content RESTful Multiparty Access to a Data centric Web of Things. Content replication to many destinations is a common use case in the Internet of Things (IoT). The deployment of IP multicast has proven inefficient, though, due to its lack of layer 2 support by common IoT radio technologies and its synchronous end to end transmission, which is highly susceptible to interference. Information centric networking (ICN) introduced hop wise multi party dissemination of cacheable content, which has proven valuable in particular for low power lossy networking regimes. Even NDN, however, the most prominent ICN protocol, suffers from a lack of deployment. In this paper, we explore how multiparty content distribution in an information centric Web of Things (WoT) can be built on CoAP. We augment the CoAP proxy by request aggregation and response replication functions, which together with proxy caches enable asynchronous group communication. In a further step, we integrate content object security with OSCORE into the CoAP multicast proxy system, which enables ubiquitous caching of certified authentic content. In our evaluation, we compare NDN with different deployment models of CoAP, including our data centric approach in realistic testbed experiments. Our findings indicate that multiparty content distribution based on CoAP proxies performs equally well as NDN, while remaining fully compatible with the established IoT protocol world of CoAP on the Internet.


Hedging with Bitcoin Futures The Effect of Liquidation Loss Aversion and Aggressive Trading. We consider the hedging problem where a futures position can be automatically liquidated by the exchange without notice. We derive a semi closed form for an optimal hedging strategy with dual objectives to minimise both the variance of the hedged portfolio and the probability of liquidations due to insufficient collateral. The optimal solution depends on the statistical characteristics of the spot and futures extreme returns and parameters that characterise the hedger by loss aversion, choice of leverage and collateral management. An empirical analysis of bitcoin shows that the optimal strategy combines superior hedge effectiveness with a reduction in the probability of liquidation. We compare the performance of seven major direct and inverse hedging instruments traded on five different exchanges, based on minute level data. We also link this performance to novel speculative trading metrics, which differ markedly between venues.


Vassiliev invariants for knots from the ADO polynomials. In this paper we prove that the r th ADO polynomial of a knot, for r a power of prime number, can be expanded as Vassiliev invariants with values in mathbb Z . Nevertheless this expansion is not unique and not easily computable. We can obtain a unique computable expansion, but we only get r adic topological Vassiliev invariants as coefficients. To do so, we exploit the fact that the colored Jones polynomials can be decomposed as Vassiliev invariants and we tranpose it to ADO using the unified knot invariant recovering both ADO and colored Jones defined in arXiv 2003.09854. Finally we prove some asymptotic behavior of the ADO polynomials modulo r as r goes to infinity.


Cardinality constrained Distributionally Robust Portfolio Optimization. This paper studies a distributionally robust portfolio optimization model with a cardinality constraint for limiting the number of invested assets. We formulate this model as a mixed integer semidefinite optimization (MISDO) problem by means of the moment based uncertainty set of probability distributions of asset returns. To exactly solve large scale problems, we propose a specialized cutting plane algorithm that is based on bilevel optimization reformulation. We prove the finite convergence of the algorithm. We also apply a matrix completion technique to lower level SDO problems to make their problem sizes much smaller. Numerical experiments demonstrate that our cutting plane algorithm is significantly faster than the state of the art MISDO solver SCIP SDP. We also show that our portfolio optimization model can achieve good investment performance compared with the conventional mean variance model.


What Makes Good In Context Examples for GPT 3 ?. GPT 3 has attracted lots of attention due to its superior performance across a wide range of NLP tasks, especially with its powerful and versatile in context few shot learning ability. Despite its success, we found that the empirical results of GPT 3 depend heavily on the choice of in context examples. In this work, we investigate whether there are more effective strategies for judiciously selecting in context examples (relative to random sampling) that better leverage GPT 3 's few shot capabilities. Inspired by the recent success of leveraging a retrieval module to augment large scale neural network models, we propose to retrieve examples that are semantically similar to a test sample to formulate its corresponding prompt. Intuitively, the in context examples selected with such a strategy may serve as more informative inputs to unleash GPT 3 's extensive knowledge. We evaluate the proposed approach on several natural language understanding and generation benchmarks, where the retrieval based prompt selection approach consistently outperforms the random baseline. Moreover, it is observed that the sentence encoders fine tuned on task related datasets yield even more helpful retrieval results. Notably, significant gains are observed on tasks such as table to text generation (41.9 on the ToTTo dataset) and open domain question answering (45.5 on the NQ dataset). We hope our investigation could help understand the behaviors of GPT 3 and large scale pre trained LMs in general and enhance their few shot capabilities.


VeeAlign Multifaceted Context Representation using Dual Attention for Ontology Alignment. Ontology Alignment is an important research problem applied to various fields such as data integration, data transfer, data preparation, etc. State of the art (SOTA) Ontology Alignment systems typically use naive domain dependent approaches with handcrafted rules or domain specific architectures, making them unscalable and inefficient. In this work, we propose VeeAlign, a Deep Learning based model that uses a novel dual attention mechanism to compute the contextualized representation of a concept which, in turn, is used to discover alignments. By doing this, not only is our approach able to exploit both syntactic and semantic information encoded in ontologies, it is also, by design, flexible and scalable to different domains with minimal effort. We evaluate our model on four different datasets from different domains and languages, and establish its superiority through these results as well as detailed ablation studies. The code and datasets used are available at https github.com Remorax VeeAlign.


Cross Domain Label Adaptive Stance Detection. Stance detection concerns the classification of a writer's viewpoint towards a target. There are different task variants, e.g., stance of a tweet vs. a full article, or stance with respect to a claim vs. an (implicit) topic. Moreover, task definitions vary, which includes the label inventory, the data collection, and the annotation protocol. All these aspects hinder cross domain studies, as they require changes to standard domain adaptation approaches. In this paper, we perform an in depth analysis of 16 stance detection datasets, and we explore the possibility for cross domain learning from them. Moreover, we propose an end to end unsupervised framework for out of domain prediction of unseen, user defined labels. In particular, we combine domain adaptation techniques such as mixture of experts and domain adversarial training with label embeddings, and we demonstrate sizable performance gains over strong baselines, both (i) in domain, i.e., for seen targets, and (ii) out of domain, i.e., for unseen targets. Finally, we perform an exhaustive analysis of the cross domain results, and we highlight the important factors influencing the model performance.


Cooperative Multi Agent Path Finding Beyond Path Planning and Collision Avoidance. We introduce the Cooperative Multi Agent Path Finding (Co MAPF) problem, an extension to the classical MAPF problem, where cooperative behavior is incorporated. In this setting, a group of autonomous agents operate in a shared environment and have to complete cooperative tasks while avoiding collisions with the other agents in the group. This extension naturally models many real world applications, where groups of agents are required to collaborate in order to complete a given task. To this end, we formalize the Co MAPF problem and introduce Cooperative Conflict Based Search (Co CBS), a CBS based algorithm for solving the problem optimally for a wide set of Co MAPF problems. Co CBS uses a cooperation planning module integrated into CBS such that cooperation planning is decoupled from path planning. Finally, we present empirical results on several MAPF benchmarks demonstrating our algorithm's properties.


Learning Orientations a Discrete Geometry Model. In the mammalian brain, many neuronal ensembles are involved in representing spatial structure of the environment. In particular, there exist cells that encode the animal's location and cells that encode head direction. A number of studies have addressed properties of the spatial maps produced by these two populations of neurons, mainly by establishing correlations between their spiking parameters and geometric characteristics of the animal's environments. The question remains however, how the brain may intrinsically combine the direction and the location information into a unified spatial framework that enables animals' orientation. Below we propose a model of such a framework, using ideas and constructs from algebraic topology and synthetic affine geometry.


Lorentz equivariant flow with four delays of neutral type. We generalize electrodynamics with a second interaction in lightcone. The time reversible equations for two body motion define a semiflow on C 2( mathbb R ) with four state dependent delays of neutral type and nonlinear gyroscopic terms. Furthermore, if the initial segment includes velocity discontinuities, their propagation requires two energetic corner conditions defining boundary layer neighborhoods of large velocities and small denominators. Finally, we discuss a motion restricted to a straight line and a segment pair with vanishing accelerations that iterates to another constant velocity segment pair.


Alkalinity Concentration Swing for Direct Air Capture of Carbon Dioxide. We describe a new principle the Alkalinity Concentration Swing (ACS) for direct air capture of carbon dioxide driven by concentrating an alkaline solution that has been exposed to the atmosphere and loaded with dissolved inorganic carbon. Upon concentration, the partial pressure of carbon dioxide increases, allowing for extraction and compression. We find that higher concentration factors result in proportionally higher outgassing pressure, and higher initial alkalinity concentrations at the same concentration factor outgas a higher concentration of CO2 relative to the feed solution. We examine two desalination technologies, reverse osmosis and capacitive deionization, as possible implementation for the ACS, and evaluate two simplified corresponding energy models. We compare the ACS to incumbent technologies and make estimates on water, land, and energy requirements for capturing one million tonnes of CO2 per year. We find that estimates for the lower end of the energy range for both reverse osmosis and capacitive deionization approaches are lower than or roughly equal to incumbent direct air capture approaches. For most conditions, we find an inverse relationship between the required energy and water processing volume per million tonnes of CO2. Realizing the ACS requires a simple alkaline aqueous solvent (e.g. potassium alkalinity carrier) and does not require heat as a driving mechanism. More generally, the ACS can be implemented through industrial scale desalination approaches, meaning current technology could be leveraged for scale up.


Subtrajectory Clustering Finding Set Covers for Set Systems of Subcurves. We study subtrajectory clustering under the Fr 'echet distance. Given one or more trajectories, the task is to split the trajectories into several parts, such that the parts have a good clustering structure. We approach this problem via a new set cover formulation, which we think provides a natural formalization of the problem as it is studied in many applications. Given a polygonal curve P with n vertices in fixed dimension, integers k , ell geq 1 , and a real value Delta 0 , the goal is to find k center curves of complexity at most ell such that every point on P is covered by a subtrajectory that has small Fr 'echet distance to one of the k center curves ( leq Delta ). In many application scenarios, one is interested in finding clusters of small complexity, which is controlled by the parameter ell . Our main result is a bicriterial approximation algorithm if there exists a solution for given parameters k , ell , and Delta , then our algorithm finds a set of k' center curves of complexity at most ell with covering radius Delta' with k' in O( k ell 2 log (k ell)) , and Delta' leq 19 Delta . Moreover, within these approximation bounds, we can minimize k while keeping the other parameters fixed. If ell is a constant independent of n , then, the approximation factor for the number of clusters k is O( log k) and the approximation factor for the radius Delta is constant. In this case, the algorithm has expected running time in tilde O left( k m 2 mn right) and uses space in O(n m) , where m lceil frac L Delta rceil and L is the total arclength of the curve P .


OptSmart A Space Efficient Optimistic Concurrent Execution of Smart Contracts. Popular blockchains such as Ethereum and several others execute complex transactions in blocks through user defined scripts known as smart contracts. Serial execution of smart contract transactions atomic units (AUs) fails to harness the multiprocessing power offered by the prevalence of multi core processors. By adding concurrency to the execution of AUs, we can achieve better efficiency and higher throughput. In this paper, we develop a concurrent miner that proposes a block by executing the AUs concurrently using optimistic Software Transactional Memory systems (STMs). It captures the independent AUs in a concurrent bin and dependent AUs in the block graph (BG) efficiently. Later, we propose a concurrent validator that re executes the same AUs concurrently and deterministically using a concurrent bin followed by a BG given by the miner to verify the proposed block. We rigorously prove the correctness of concurrent execution of AUs and achieve significant performance gain over the state of the art.


Nonlinear Jordan type derivations on alternative algebras. Let A be an unital alternative algebra. Assume that A contains a nontrivial symmetric idempotent element e which satisfies xA cdot e 0 implies x 0 and xA cdot (1 A e) 0 implies x 0 . In this paper, it is shown that Phi is a nonlinear Jordan type derivation on A if and only if Phi is an additive derivation. As application, we get a result on alternative W algebras.


Efficient and passive learning of networked dynamical systems driven by non white exogenous inputs. We consider a networked linear dynamical system with p agents nodes. We study the problem of learning the underlying graph of interactions dependencies from observations of the nodal trajectories over a time interval T . We present a regularized non casual consistent estimator for this problem and analyze its sample complexity over two regimes (a) where the interval T consists of n i.i.d. observation windows of length T n (restart and record), and (b) where T is one continuous observation window (consecutive). Using the theory of M estimators, we show that the estimator recovers the underlying interactions, in either regime, in a time interval that is logarithmic in the system size p . To the best of our knowledge, this is the first work to analyze the sample complexity of learning linear dynamical systems emph driven by unobserved not white wide sense stationary (WSS) inputs .


The convergence rates for the superdiffusion in the Boltzmann Grad limit of the periodic Lorentz gas. In this article, we obtain the rates of convergence for superdiffusion in the Boltzmann Grad limit of the periodic Lorentz gas, which is one of the fundamental models to study diffusions in deterministic systems. In their seminal work, Marklof and Str "ombergsson proved the Boltzmann Grad limit of the periodic Lorentz gas cite M Sannals2 , and then Marklof and T 'oth established a superdiffusive central limit theorem in large time for the Boltzmann Grad limit cite M T16 . Based on their work, we apply Stein's method to derive the convergence rates for the superdiffusion in the Boltzmann Grad limit of the periodic Lorentz gas. For the discrete time displacement the rate of convergence in Wasserstein distance is obtained, while in the context of the continuous time displacement the result is presented for the Berry Essen type bound.


Unsupervised Belief Representation Learning in Polarized Networks A Variational Graph Auto Encoder Approach. In this paper, we propose an Information Theoretic Variational Graph Auto Encoder (InfoVGAE) for polarity representation learning in an unsupervised manner. It jointly learns the belief embedding of both users and their claims in the same latent space. In order to better disentangle the latent space, a total correlation regularizer, a PI controller, and the rectified Gaussian Distribution are adopted to constrain the generated distribution. Experimental results show that the proposed InfoVGAE outperforms the existing unsupervised polarity detection methods, and achieves a highly comparable result with supervised methods in terms of F1 score and purity.


Fundamental groups of Galois covers as tools to study non planar degenerations. This study establishes a preliminary investigation of geometric objects that degenerate to non planar shapes, along with their Galois covers and groups. The study aims to determine the fundamental groups and signatures of the Galois covers of algebraic surfaces in general, as they are invariants of the classification of surfaces in the moduli space. The study investigates the tetrahedron and the double tetrahedron as first examples. The study's findings can advance the classification of surfaces and provide further links between algebraic geometry, group theory, and the topology of degenerative processes and their properties. The resulting groups indicate that the tetrahedron and the double tetrahedron are in different components in the moduli space.


Spectrum of FO logic with quantifier depth 4 is finite. The k spectrum is the set of all alpha 0 such that G(n,n alpha ) does not obey the 0 1 law for FO sentences with quantifier depth at most k . In this paper, we prove that the minimum k such that the k spectrum is infinite equals 5.


Variational Modeling of Paperboard Delamination Under Bending. We develop and analyze a variational model for multi ply (i.e., multi layered) paperboard. The model consists of a number of elastic sheets of a given thickness, which at the expense of an energy per unit area may delaminate. By providing an explicit construction for possible admissible deformations subject to boundary conditions that introduce a single bend, we discover a rich variety of energetic regimes. The regimes correspond to the experimentally observed initial purely elastic response for small bending angle and the formation of a localized inelastic, delaminated hinge once the angle reaches a critical value. Our scaling upper bound then suggests the occurrence of several additional regimes as the angle increases. The upper bounds for the energy are partially matched by scaling lower bounds.


Description based Label Attention Classifier for Explainable ICD 9 Classification. ICD 9 coding is a relevant clinical billing task, where unstructured texts with information about a patient's diagnosis and treatments are annotated with multiple ICD 9 codes. Automated ICD 9 coding is an active research field, where CNN and RNN based model architectures represent the state of the art approaches. In this work, we propose a description based label attention classifier to improve the model explainability when dealing with noisy texts like clinical notes. We evaluate our proposed method with different transformer based encoders on the MIMIC III 50 dataset. Our method achieves strong results together with augmented explainablilty.


Multimodal Deep Learning Framework for Image Popularity Prediction on Social Media. Billions of photos are uploaded to the web daily through various types of social networks. Some of these images receive millions of views and become popular, whereas others remain completely unnoticed. This raises the problem of predicting image popularity on social media. The popularity of an image can be affected by several factors, such as visual content, aesthetic quality, user, post metadata, and time. Thus, considering all these factors is essential for accurately predicting image popularity. In addition, the efficiency of the predictive model also plays a crucial role. In this study, motivated by multimodal learning, which uses information from various modalities, and the current success of convolutional neural networks (CNNs) in various fields, we propose a deep learning model, called visual social convolutional neural network (VSCNN), which predicts the popularity of a posted image by incorporating various types of visual and social features into a unified network model. VSCNN first learns to extract high level representations from the input visual and social features by utilizing two individual CNNs. The outputs of these two networks are then fused into a joint network to estimate the popularity score in the output layer. We assess the performance of the proposed method by conducting extensive experiments on a dataset of approximately 432K images posted on Flickr. The simulation results demonstrate that the proposed VSCNN model significantly outperforms state of the art models, with a relative improvement of greater than 2.33 , 7.59 , and 14.16 in terms of Spearman's Rho, mean absolute error, and mean squared error, respectively.


Intermittent Private Information Retrieval with Application to Location Privacy. We study the problem of intermittent private information retrieval with multiple servers, in which a user consecutively requests one of K messages from N replicated databases such that part of requests need to be protected while others do not need privacy. Motivated by the location privacy application, the correlation between requests is modeled by a Markov chain. We propose an intermittent private information retrieval scheme that concatenates an obfuscation scheme and a private information retrieval scheme for the time period when privacy is not needed, to prevent leakage incurred by the correlation over time. In the end, we illustrate how the proposed scheme for the problem of intermittent private information retrieval with Markov structure correlation can be applied to design a location privacy protection mechanism in the location privacy problem.


Arena Rosnav Towards Deployment of Deep Reinforcement Learning Based Obstacle Avoidance into Conventional Autonomous Navigation Systems. Recently, mobile robots have become important tools in various industries, especially in logistics. Deep reinforcement learning emerged as an alternative planning method to replace overly conservative approaches and promises more efficient and flexible navigation. However, deep reinforcement learning approaches are not suitable for long range navigation due to their proneness to local minima and lack of long term memory, which hinders its widespread integration into industrial applications of mobile robotics. In this paper, we propose a navigation system incorporating deep reinforcement learning based local planners into conventional navigation stacks for long range navigation. Therefore, a framework for training and testing the deep reinforcement learning algorithms along with classic approaches is presented. We evaluated our deep reinforcement learning enhanced navigation system against various conventional planners and found that our system outperforms them in terms of safety, efficiency and robustness.


Categorising Fine to Coarse Grained Misinformation An Empirical Study of COVID 19 Infodemic. The spreading COVID 19 misinformation over social media already draws the attention of many researchers. According to Google Scholar, about 26000 COVID 19 related misinformation studies have been published to date. Most of these studies focusing on 1) detect and or 2) analysing the characteristics of COVID 19 related misinformation. However, the study of the social behaviours related to misinformation is often neglected. In this paper, we introduce a fine grained annotated misinformation tweets dataset including social behaviours annotation (e.g. comment or question to the misinformation). The dataset not only allows social behaviours analysis but also suitable for both evidence based or non evidence based misinformation classification task. In addition, we introduce leave claim out validation in our experiments and demonstrate the misinformation classification performance could be significantly different when applying to real world unseen misinformation.


Noise effect on 2D photoluminescence decay analysis using the RATS method in single pixel camera configuration. Using a random temporal signal for sample excitation (RATS method) is a new, efficient approach to measuring photoluminescence (PL) dynamics. The method can be used in single point measurement (0D), but also it can be converted to PL decay imaging (2D) using a single pixel camera configuration. In both cases, the reconstruction of the PL decay and PL snapshot is affected by ubiquitous noise. This article provides a detailed analysis of the noise effect on the RATS method and possible strategies for its elimination. We carried out an extensive set of simulations focusing on the effect of noise introduced through the random excitation signal and the corresponding PL waveform. We show that the PL signal noise level is critical for the method. Furthermore, we analyze the role of acquisition time, where we demonstrate the need for a non periodic excitation signal. We show that it is beneficial to increase the acquisition time while increasing the number of measurements in the single pixel camera configuration has a minimal effect above a certain threshold. Finally, we study the effect of a regularization parameter used in the deconvolution step, and we observe that there is an optimum value set by the noise present in the PL dataset. Our results provide a guideline for optimization of the RATS measurement, but also study effects generally occurring in PL decay measurements methods relying on the deconvolution step.


It is AI's Turn to Ask Humans a Question Question Answer Pair Generation for Children's Story Books. Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers often need to decide what questions they should ask, in order to help students to improve their narrative understanding capabilities. We design an automated question answer generation (QAG) system for this education scenario given a story book at the kindergarten to eighth grade level as input, our system can automatically generate QA pairs that are capable of testing a variety of dimensions of a student's comprehension skills. Our proposed QAG model architecture is demonstrated using a new expert annotated FairytaleQA dataset, which has 278 child friendly storybooks with 10,580 QA pairs. Automatic and human evaluations show that our model outperforms state of the art QAG baseline systems. On top of our QAG system, we also start to build an interactive story telling application for the future real world deployment in this educational scenario.


Deep Interpretable Models of Theory of Mind. When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent modeling approaches are 1) not interpretable and 2) only model external behavior, ignoring internal mental states, which potentially limits their capability for assistance, interventions, discovering false beliefs, etc. To this end, we develop an interpretable modular neural framework for modeling the intentions of other observed entities. We demonstrate the efficacy of our approach with experiments on data from human participants on a search and rescue task in Minecraft, and show that incorporating interpretability can significantly increase predictive performance under the right conditions.


Traffic Flow Forecasting with Spatial Temporal Graph Diffusion Network. Accurate forecasting of citywide traffic flow has been playing critical role in a variety of spatial temporal mining applications, such as intelligent traffic control and public risk assessment. While previous work has made significant efforts to learn traffic temporal dynamics and spatial dependencies, two key limitations exist in current models. First, only the neighboring spatial correlations among adjacent regions are considered in most existing methods, and the global inter region dependency is ignored. Additionally, these methods fail to encode the complex traffic transition regularities exhibited with time dependent and multi resolution in nature. To tackle these challenges, we develop a new traffic prediction framework Spatial Temporal Graph Diffusion Network (ST GDN). In particular, ST GDN is a hierarchically structured graph neural architecture which learns not only the local region wise geographical dependencies, but also the spatial semantics from a global perspective. Furthermore, a multi scale attention network is developed to empower ST GDN with the capability of capturing multi level temporal dynamics. Experiments on several real life traffic datasets demonstrate that ST GDN outperforms different types of state of the art baselines. Source codes of implementations are available at https github.com jill001 ST GDN.


Group theoretic approach and analytical solutions of the compressible Navier Stokes equations. A group theoretic analysis of the compressible Navier Stokes equations of an ideal gas are carried out. The 12 dimensional Lie symmetry group is computed. The commutation table and the Levi decomposition of its Lie algebra are presented. The equations are reduced and self similar one , two and three dimensional solutions are computed. Many of them are graphically illustrated.


HALMA Humanlike Abstraction Learning Meets Affordance in Rapid Problem Solving. Humans learn compositional and causal abstraction, ie, knowledge, in response to the structure of naturalistic tasks. When presented with a problem solving task involving some objects, toddlers would first interact with these objects to reckon what they are and what can be done with them. Leveraging these concepts, they could understand the internal structure of this task, without seeing all of the problem instances. Remarkably, they further build cognitively executable strategies to emph rapidly solve novel problems. To empower a learning agent with similar capability, we argue there shall be three levels of generalization in how an agent represents its knowledge perceptual, conceptual, and algorithmic. In this paper, we devise the very first systematic benchmark that offers joint evaluation covering all three levels. This benchmark is centered around a novel task domain, HALMA, for visual concept development and rapid problem solving. Uniquely, HALMA has a minimum yet complete concept space, upon which we introduce a novel paradigm to rigorously diagnose and dissect learning agents' capability in understanding and generalizing complex and structural concepts. We conduct extensive experiments on reinforcement learning agents with various inductive biases and carefully report their proficiency and weakness.


Learning on Abstract Domains A New Approach for Verifiable Guarantee in Reinforcement Learning. Formally verifying Deep Reinforcement Learning (DRL) systems is a challenging task due to the dynamic continuity of system behaviors and the black box feature of embedded neural networks. In this paper, we propose a novel abstraction based approach to train DRL systems on finite abstract domains instead of concrete system states. It yields neural networks whose input states are finite, making hosting DRL systems directly verifiable using model checking techniques. Our approach is orthogonal to existing DRL algorithms and off the shelf model checkers. We implement a resulting prototype training and verification framework and conduct extensive experiments on the state of the art benchmark. The results show that the systems trained in our approach can be verified more efficiently while they retain comparable performance against those that are trained without abstraction.


On L 12 square root cancellation for exponential sums associated with nondegenerate curves in mathbb R 4 . We prove sharp L 12 estimates for exponential sums associated with nondegenerate curves in mathbb R 4 . We place Bourgain's progress on the Lindel"of hypothesis in a larger framework that contains a continuum of estimates of different flavor. We enlarge the spectrum of methods by combining decoupling with quadratic Weyl sum estimates, to address new cases of interest. All results are proved in the general framework of real analytic curves.


Systematic Evaluation and Usability Analysis of Formal Tools for Railway System Design. Formal methods and supporting tools have a long record of success in the development of safety critical systems. However, no single tool has emerged as the dominant solution for system design. Each tool differs from the others in terms of the modeling language used, its verification capabilities and other complementary features, and each development context has peculiar needs that require different tools. This is particularly problematic for the railway industry, in which formal methods are highly recommended by the norms, but no actual guidance is provided for the selection of tools. To guide companies in the selection of the most appropriate formal tools to adopt in their contexts, a clear assessment of the features of the currently available tools is required. To address this goal, this paper considers a set of 13 formal tools that have been used for railway system design, and it presents a systematic evaluation of such tools and a preliminary usability analysis of a subset of 7 tools, involving railway practitioners. The results are discussed considering the most desired aspects by industry and earlier related studies. While the focus is on the railway domain, the overall methodology can be applied to similar contexts. Our study thus contributes with a systematic evaluation of formal tools and it shows that despite the poor graphical interfaces, usability and maturity of the tools are not major problems, as claimed by contributions from the literature. Instead, support for process integration is the most relevant obstacle for the adoption of most of the tools.


Event and Activity Recognition in Video Surveillance for Cyber Physical Systems. This chapter aims to aid the development of Cyber Physical Systems (CPS) in automated understanding of events and activities in various applications of video surveillance. These events are mostly captured by drones, CCTVs or novice and unskilled individuals on low end devices. Being unconstrained, these videos are immensely challenging due to a number of quality factors. We present an extensive account of the various approaches taken to solve the problem over the years. This ranges from methods as early as Structure from Motion (SFM) based approaches to recent solution frameworks involving deep neural networks. We show that the long term motion patterns alone play a pivotal role in the task of recognizing an event. Consequently each video is significantly represented by a fixed number of key frames using a graph based approach. Only the temporal features are exploited using a hybrid Convolutional Neural Network (CNN) Recurrent Neural Network (RNN) architecture. The results we obtain are encouraging as they outperform standard temporal CNNs and are at par with those using spatial information along with motion cues. Further exploring multistream models, we conceive a multi tier fusion strategy for the spatial and temporal wings of a network. A consolidated representation of the respective individual prediction vectors on video and frame levels is obtained using a biased conflation technique. The fusion strategy endows us with greater rise in precision on each stage as compared to the state of the art methods, and thus a powerful consensus is achieved in classification. Results are recorded on four benchmark datasets widely used in the domain of action recognition, namely CCV, HMDB, UCF 101 and KCV. It is inferable that focusing on better classification of the video sequences certainly leads to robust actuation of a system designed for event surveillance and object cum activity tracking.


Automated Runtime Aware Scheduling for Multi Tenant DNN Inference on GPU. With the fast development of deep neural networks (DNNs), many real world applications are adopting multiple models to conduct compound tasks, such as co running classification, detection, and segmentation models on autonomous vehicles. Such multi tenant DNN inference cases greatly exacerbate the computational complexity and call for comprehensive collaboration for graph level operator scheduling, runtime level resource awareness, as well as hardware scheduler support. However, the current scheduling support for such multi tenant inference is still relatively backward. In this work, we propose a resource aware scheduling framework for efficient multi tenant DNN inference on GPU, which automatically coordinates DNN computing in different execution levels. Leveraging the unified scheduling intermediate representation and the automated ML based searching algorithm, optimal schedules could be generated to wisely adjust model concurrency and interleave DNN model operators, maintaining a continuously balanced resource utilization across the entire inference process, and eventually improving the runtime efficiency. Experiments show that we could consistently achieve 1.3 1.7x speed up, compared to regular DNN runtime libraries (e.g., CuDNN, TVM) and particular concurrent scheduling methods (e.g., NVIDIA Multi Stream).


Copper Large scale Grain Growth by UV Nanosecond Pulsed Laser Annealing. UV nanosecond pulsed laser annealing (UV NLA) enables both surface localized heating and short timescale high temperature processing, which can be advantageous to reduce metal line resistance by enlarging metal grains in lines or in thin films, while maintaining the integrity and performance of surrounding structures. In this work UV NLA is applied on a typical Cu thin film, demonstrating a mean grain size of over 1 mu m and 400 nm in a melt and sub melt regime, respectively. Along with such grain enlargement, film resistivity is also reduced.


High frequency shape recovery from shading by CNN and domain adaptation. Importance of structured light based one shot scanning technique is increasing because of its simple system configuration and ability of capturing moving objects. One severe limitation of the technique is that it can capture only sparse shape, but not high frequency shapes, because certain area of projection pattern is required to encode spatial information. In this paper, we propose a technique to recover high frequency shapes by using shading information, which is captured by one shot RGB D sensor based on structured light with single camera. Since color image comprises shading information of object surface, high frequency shapes can be recovered by shape from shading techniques. Although multiple images with different lighting positions are required for shape from shading techniques, we propose a learning based approach to recover shape from a single image. In addition, to overcome the problem of preparing sufficient amount of data for training, we propose a new data augmentation method for high frequency shapes using synthetic data and domain adaptation. Experimental results are shown to confirm the effectiveness of the proposed method.


Stable solutions to the fractional Allen Cahn equation in the nonlocal perimeter regime. We study stable solutions to the fractional Allen Cahn equation linebreak ( Delta) s 2 u u u 3 , u 1 in mathbb R n . For every s in (0,1) and dimension n geq 2 , we establish sharp energy estimates, density estimates, and the convergence of blow downs to stable nonlocal s minimal cones. As a consequence, we obtain a new classification result if for some pair (n,s) , with n ge 3 , hyperplanes are the only stable nonlocal s minimal cones in mathbb R n setminus 0 , then every stable solution to the fractional Allen Cahn equation in mathbb R n is 1D, namely, its level sets are parallel hyperplanes. Combining this result with the classification of stable s minimal cones in mathbb R 3 setminus 0 for s sim 1 obtained by the authors in a recent paper, we give positive answers to the "stability conjecture" in mathbb R 3 and to the "De Giorgi conjecture" in mathbb R 4 for the fractional Allen Cahn equation when the order s in (0,1) of the operator is sufficiently close to 1 .


Latent Variable Models for Visual Question Answering. Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching machine to carry out question answering. Hence in this paper, we propose latent variable models for VQA where extra information (e.g. captions and answer categories) are incorporated as latent variables, which are observed during training but in turn benefit question answering performance at test time. Experiments on the VQA v2.0 benchmarking dataset demonstrate the effectiveness of our proposed models they improve over strong baselines, especially those that do not rely on extensive language vision pre training.


Exponentially convergent trapezoidal rules to approximate fractional powers of operators. In this paper we are interested in the approximation of fractional powers of self adjoint positive operators. Starting from the integral representation of the operators, we apply the trapezoidal rule combined with a single exponential and a double exponential transform of the integrand function. For the first approach our aim is only to review some theoretical aspects in order to refine the choice of the parameters that allow a faster convergence. As for the double exponential transform, in this work we show how to improve the existing error estimates for the scalar case and also extend the analysis to operators. We report some numerical experiments to show the reliability of the estimates obtained.


Dict BERT Enhancing Language Model Pre training with Dictionary. Pre trained language models (PLMs) aim to learn universal language representations by conducting self supervised training tasks on large scale corpora. Since PLMs capture word semantics in different contexts, the quality of word representations highly depends on word frequency, which usually follows a heavy tailed distributions in the pre training corpus. Therefore, the embeddings of rare words on the tail are usually poorly optimized. In this work, we focus on enhancing language model pre training by leveraging definitions of the rare words in dictionaries (e.g., Wiktionary). To incorporate a rare word definition as a part of input, we fetch its definition from the dictionary and append it to the end of the input text sequence. In addition to training with the masked language modeling objective, we propose two novel self supervised pre training tasks on word and sentence level alignment between input text sequence and rare word definitions to enhance language modeling representation with dictionary. We evaluate the proposed Dict BERT model on the language understanding benchmark GLUE and eight specialized domain benchmark datasets. Extensive experiments demonstrate that Dict BERT can significantly improve the understanding of rare words and boost model performance on various NLP downstream tasks.


Explainable Artificial Intelligence for Human Decision Support System in Medical Domain. In the present paper we present the potential of Explainable Artificial Intelligence methods for decision support in medical image analysis scenarios. With three types of explainable methods applied to the same medical image data set our aim was to improve the comprehensibility of the decisions provided by the Convolutional Neural Network (CNN). The visual explanations were provided on in vivo gastral images obtained from a Video capsule endoscopy (VCE), with the goal of increasing the health professionals' trust in the black box predictions. We implemented two post hoc interpretable machine learning methods LIME and SHAP and the alternative explanation approach CIU, centered on the Contextual Value and Utility (CIU). The produced explanations were evaluated using human evaluation. We conducted three user studies based on the explanations provided by LIME, SHAP and CIU. Users from different non medical backgrounds carried out a series of tests in the web based survey setting and stated their experience and understanding of the given explanations. Three user groups (n 20, 20, 20) with three distinct forms of explanations were quantitatively analyzed. We have found that, as hypothesized, the CIU explainable method performed better than both LIME and SHAP methods in terms of increasing support for human decision making as well as being more transparent and thus understandable to users. Additionally, CIU outperformed LIME and SHAP by generating explanations more rapidly. Our findings suggest that there are notable differences in human decision making between various explanation support settings. In line with that, we present three potential explainable methods that can with future improvements in implementation be generalized on different medical data sets and can provide great decision support for medical experts.


Medical Matting A New Perspective on Medical Segmentation with Uncertainty. It is difficult to accurately label ambiguous and complex shaped targets manually by binary masks. The weakness of binary mask under expression is highlighted in medical image segmentation, where blurring is prevalent. In the case of multiple annotations, reaching a consensus for clinicians by binary masks is more challenging. Moreover, these uncertain areas are related to the lesions' structure and may contain anatomical information beneficial to diagnosis. However, current studies on uncertainty mainly focus on the uncertainty in model training and data labels. None of them investigate the influence of the ambiguous nature of the lesion itself.Inspired by image matting, this paper introduces alpha matte as a soft mask to represent uncertain areas in medical scenes and accordingly puts forward a new uncertainty quantification method to fill the gap of uncertainty research for lesion structure. In this work, we introduce a new architecture to generate binary masks and alpha mattes in a multitasking framework, which outperforms all state of the art matting algorithms compared. The proposed uncertainty map is able to highlight the ambiguous regions and a novel multitasking loss weighting strategy we presented can improve performance further and demonstrate their concrete benefits. To fully evaluate the effectiveness of our proposed method, we first labelled three medical datasets with alpha matte to address the shortage of available matting datasets in medical scenes and prove the alpha matte to be a more efficient labeling method than a binary mask from both qualitative and quantitative aspects.


Deep Face Fuzzy Vault Implementation and Performance. Biometric technologies, especially face recognition, have become an essential part of identity management systems worldwide. In deployments of biometrics, secure storage of biometric information is necessary in order to protect the users' privacy. In this context, biometric cryptosystems are designed to meet key requirements of biometric information protection enabling a privacy preserving storage and comparison of biometric data. This work investigates the application of a well known biometric cryptosystem, i.e. the improved fuzzy vault scheme, to facial feature vectors extracted through deep convolutional neural networks. To this end, a feature transformation method is introduced which maps fixed length real valued deep feature vectors to integer valued feature sets. As part of said feature transformation, a detailed analysis of different feature quantisation and binarisation techniques is conducted. At key binding, obtained feature sets are locked in an unlinkable improved fuzzy vault. For key retrieval, the efficiency of different polynomial reconstruction techniques is investigated. The proposed feature transformation method and template protection scheme are agnostic of the biometric characteristic. In experiments, an unlinkable improved deep face fuzzy vault based template protection scheme is constructed employing features extracted with a state of the art deep convolutional neural network trained with the additive angular margin loss (ArcFace). For the best configuration, a false non match rate below 1 at a false match rate of 0.01 , is achieved in cross database experiments on the FERET and FRGCv2 face databases. On average, a security level of up to approximately 28 bits is obtained. This work presents an effective face based fuzzy vault scheme providing privacy protection of facial reference data as well as digital key derivation from face.


Smart Contract Vulnerability Detection From Pure Neural Network to Interpretable Graph Feature and Expert Pattern Fusion. Smart contracts hold digital coins worth billions of dollars, their security issues have drawn extensive attention in the past years. Towards smart contract vulnerability detection, conventional methods heavily rely on fixed expert rules, leading to low accuracy and poor scalability. Recent deep learning approaches alleviate this issue but fail to encode useful expert knowledge. In this paper, we explore combining deep learning with expert patterns in an explainable fashion. Specifically, we develop automatic tools to extract expert patterns from the source code. We then cast the code into a semantic graph to extract deep graph features. Thereafter, the global graph feature and local expert patterns are fused to cooperate and approach the final prediction, while yielding their interpretable weights. Experiments are conducted on all available smart contracts with source code in two platforms, Ethereum and VNT Chain. Empirically, our system significantly outperforms state of the art methods. Our code is released.


Towards exact structural thresholds for parameterized complexity. Parameterized complexity seeks to use input structure to obtain faster algorithms for NP hard problems. This has been most successful for graphs of low treewidth Many problems admit fast algorithms relative to treewidth and many of them are optimal under SETH. Fewer such results are known for more general structure such as low clique width and more restrictive structure such as low deletion distance to a sparse graph class. Despite these successes, such results remain "islands'' within the realm of possible structure. Rather than adding more islands, we seek to determine the transitions between them, that is, we aim for structural thresholds where the complexity increases as input structure becomes more general. Going from deletion distance to treewidth, is a single deletion set to a graph with simple components enough to yield the same lower bound as for treewidth or does it take many disjoint separators? Going from treewidth to clique width, how much more density entails the same complexity as clique width? Conversely, what is the most restrictive structure that yields the same lower bound? For treewidth, we obtain both refined and new lower bounds that apply already to graphs with a single separator X such that G X has treewidth r O(1) , while G has treewidth X O(1) . We rule out algorithms running in time O ((r 1 epsilon) k ) for Deletion to r Colorable parameterized by k X . For clique width, we rule out time O ((2 r epsilon) k) for Deletion to r Colorable, where X is now allowed to consist of k twinclasses. There are further results on Vertex Cover, Dominating Set and Maximum Cut. All lower bounds are matched by existing and newly designed algorithms.


L 2 type invariants and cohomology jump loci for complex smooth quasi projective varieties. Let X be a complex smooth quasi projective variety with a fixed epimorphsim nu colon pi 1(X) twoheadrightarrow mathbb Z . In this paper, we consider the asymptotic behaviour of invariants such as Betti numbers with all possible field coefficients and the order of the torsion subgroup of singular homology associated to nu , known as the L 2 type invariants. For degree 1, we give concrete formulas to compute these limits by the geometric information of X when nu is orbifold effective. The proof relies on the theory of cohomology jump loci. We give a detailed study about the degree 1 cohomology jump loci of X with arbitrary algebraically closed field coefficients. In particular, we extend part of Arapura's result for degree 1 cohomology jump loci of X with complex field coefficients to the one with positive characteristic field coefficients. As an application, when X is a hyperplane arrangement complement, an combinatoric upper bound is given for the number of parallel positive dimension components in degree 1 cohomology jump loci with complex coefficients. Another application is that we give a positive answer to a question posed by Denham and Suciu for any prime number p geq 2 , there exists a central hyperplane arrangement such that its Milnor fiber has non trivial p torsion in homology and p does not divide the number of hyperplanes in the arrangement.


"Sharks are not the threat humans are" Argument Component Segmentation in School Student Essays. Argument mining is often addressed by a pipeline method where segmentation of text into argumentative units is conducted first and proceeded by an argument component identification task. In this research, we apply a token level classification to identify claim and premise tokens from a new corpus of argumentative essays written by middle school students. To this end, we compare a variety of state of the art models such as discrete features and deep learning architectures (e.g., BiLSTM networks and BERT based architectures) to identify the argument components. We demonstrate that a BERT based multi task learning architecture (i.e., token and sentence level classification) adaptively pretrained on a relevant unlabeled dataset obtains the best results


ResAtom System Protein and Ligand Affinity Prediction Model Based on Deep Learning. Motivation Protein ligand affinity prediction is an important part of structure based drug design. It includes molecular docking and affinity prediction. Although molecular dynamics can predict affinity with high accuracy at present, it is not suitable for large scale virtual screening. The existing affinity prediction and evaluation functions based on deep learning mostly rely on experimentally determined conformations. Results We build a predictive model of protein ligand affinity through the ResNet neural network with added attention mechanism. The resulting ResAtom Score model achieves Pearson's correlation coefficient R 0.833 on the CASF 2016 benchmark test set. At the same time, we evaluated the performance of a variety of existing scoring functions in combination with ResAtom Score in the absence of experimentally determined conformations. The results show that the use of Delta VinaRF20 in combination with ResAtom Score can achieve affinity prediction close to scoring functions in the presence of experimentally determined conformations. These results suggest that ResAtom system may be used for in silico screening of small molecule ligands with target proteins in the future. Availability https github.com wyji001 ResAtom


Study of waveguide background at visible wavelengths for on chip nanoscopy. On chip super resolution optical microscopy is an emerging field relying on waveguide excitation with visible light. Here, we investigate two commonly used high refractive index waveguide platforms, tantalum pentoxide (Ta 2 O 5 ) and silicon nitride (Si 3 N 4 ), with respect to their background with excitation in the range 488 640 nm. The background strength from these waveguides were estimated by imaging fluorescent beads. The spectral dependence of the background from these waveguide platforms was also measured. For 640 nm wavelength excitation both the materials had a weak background, but the background increases progressively for shorter wavelengths for Si3N4. We further explored the effect of the waveguide background on localization precision of single molecule localization for direct stochastic optical reconstruction microscopy (dSTORM). An increase in background for Si 3 N 4 at 488 nm is shown to reduce the localization precision and thus the resolution of the reconstructed images. The localization precision at 640 nm was very similar for both the materials. Thus, for shorter wavelength applications Ta 2 O 5 is preferable. Reducing the background from Si 3 N 4 at shorter wavelengths via improved fabrication will be worth pursuing.


Explicit numerical approximation for logistic models with regime switching in finite and infinite horizons. The stochastic logistic model with regime switching is an important model in the ecosystem. While analytic solution to this model is positive, current numerical methods are unable to preserve such boundaries in the approximation. So, proposing appropriate numerical method for solving this model which preserves positivity and dynamical behaviors of the model's solution is very important. In this paper, we present a positivity preserving truncated Euler Maruyama scheme for this model, which taking advantages of being explicit and easily implementable. Without additional restriction conditions, strong convergence of the numerical algorithm is studied, and 1 2 order convergence rate is obtained. In the particular case of this model without switching the first order strong convergence rate is obtained. Furthermore, the approximation of long time dynamical properties is realized, including the stochastic permanence, extinctive and stability in distribution. Some simulations and examples are provided to confirm the theoretical results and demonstrate the validity of the approach.


Back to Prior Knowledge Joint Event Causality Extraction via Convolutional Semantic Infusion. Joint event and causality extraction is a challenging yet essential task in information retrieval and data mining. Recently, pre trained language models (e.g., BERT) yield state of the art results and dominate in a variety of NLP tasks. However, these models are incapable of imposing external knowledge in domain specific extraction. Considering the prior knowledge of frequent n grams that represent cause effect events may benefit both event and causality extraction, in this paper, we propose convolutional knowledge infusion for frequent n grams with different windows of length within a joint extraction framework. Knowledge infusion during convolutional filter initialization not only helps the model capture both intra event (i.e., features in an event cluster) and inter event (i.e., associations across event clusters) features but also boosts training convergence. Experimental results on the benchmark datasets show that our model significantly outperforms the strong BERT CSNN baseline.


3DARVisualizer Debugging 3D Models using Augmented Reality. Often neglected in traditional education, spatial thinking has played a critical role in science, technology, engineering, and mathematics (STEM) education. Spatial thinking skills can be enhanced by training, life experience, and practice. One approach to train these skills is through 3D modeling (also known as Computer Aided Design or CAD). Although 3D modeling tools have shown promising results in training and enhancing spatial thinking skills in undergraduate engineering students when it comes to novices, especially middle and high school students, they are not sufficient to provide rich 3D experience since the 3D models created in CAD are isolated the actual 3D physical world. Resulting in novice students finding it difficult to create error free 3D models that would 3D print successfully. This leads to student frustration where students are not motivated to create 3D models themselves instead, they prefer to download them from online repositories. To address this problem, researchers are focusing on integrating 3D models and displays into the physical world with the help of technologies like Augmented Reality (AR). In this demo, we present an AR application, 3DARVisualizer, that helps us explore the role of AR as a 3D model debugger, including enhancing 3D modeling abilities and spatial thinking skills of middle and high school students.


An extension of Thomassen's result on choosability. Thomassen proved that all planar graphs are 5 choosable. v S krekovski strengthened the result by showing that all K 5 minor free graphs are 5 choosable. Dvo v r ' a k and Postle pointed out that all planar graphs are DP 5 colorable. In this note, we first improve these results by showing that every K 5 minor free or K 3, 3 minor free graph is DP 5 colorable. In the final section, we further improve these results under the term strictly f degenerate transversal.


The Evolution of Imitation Without Cultural Transmission. The evolution and function of imitation have always been placed within the confines of animal learning and associated with its crucial role in cultural transmission and cultural evolution. Can imitation evolve as a form of phenotypic plasticity in the absence of cultural transmission, in phenotypes beyond behavior? We investigate a model in which imitation is unbundled from cultural transmission an organism's adult phenotype is plastically altered by its experiences as a juvenile of other juveniles' genetically determined traits. The only information transmitted between generations is genetic. We find that during a period of directional selection towards a phenotypic optimum, natural selection favors modifiers which cause an organism to bias its plastic phenotype in the direction opposite to the mean phenotype of the population anti imitation. As the population approaches the phenotypic optimum and shifts into stabilizing selection, selection on the modifier reverses and favors strong imitation of the population mean. Imitation can evolve to overshoot the target and produce an evolutionary pathology where mean fitness decreases. When purifying selection for an extreme phenotype is modeled, only selection for anti imitation occurs, even at a mutation selection balance. Imitation and anti imitation emerge from these models in the absence of any goal representation, cognitive understanding of its purpose, or discernment of any kind. These theoretical outcomes are all novel evolutionary and biological phenomena, and we discuss their implications.


Can Transformer Language Models Predict Psychometric Properties?. Transformer based language models (LMs) continue to advance state of the art performance on NLP benchmark tasks, including tasks designed to mimic human inspired "commonsense" competencies. To better understand the degree to which LMs can be said to have certain linguistic reasoning skills, researchers are beginning to adapt the tools and concepts of the field of psychometrics. But to what extent can the benefits flow in the other direction? I.e., can LMs be of use in predicting what the psychometric properties of test items will be when those items are given to human participants? We gather responses from numerous human participants and LMs (transformer and non transformer based) on a broad diagnostic test of linguistic competencies. We then use the responses to calculate standard psychometric properties of the items in the diagnostic test, using the human responses and the LM responses separately. We then determine how well these two sets of predictions match. We find cases in which transformer based LMs predict psychometric properties consistently well in certain categories but consistently poorly in others, thus providing new insights into fundamental similarities and differences between human and LM reasoning.


Assessing the Effectiveness of (Parallel) Branch and bound Algorithms. Empirical studies are fundamental in assessing the effectiveness of implementations of branch and bound algorithms. The complexity of such implementations makes empirical study difficult for a wide variety of reasons. Various attempts have been made to develop and codify a set of standard techniques for the assessment of optimization algorithms and their software implementations however, most previous work has been focused on classical sequential algorithms. Since parallel computation has become increasingly mainstream, it is necessary to re examine and modernize these practices. In this paper, we propose a framework for assessment based on the notion that emph resource consumption is at the heart of what we generally refer to as the "effectiveness" of an implementation. The proposed framework carefully distinguishes between an implementation's baseline efficiency, the efficacy with which it utilizes a fixed allocation of resources, and its scalability, a measure of how the efficiency changes as resources (typically additional computing cores) are added or removed. Efficiency is typically applied to sequential implementations, whereas scalability is applied to parallel implementations. Efficiency and scalability are both important contributors in determining the overall effectiveness of a given parallel implementation, but the goal of improved efficiency is often at odds with the goal of improved scalability. Within the proposed framework, we review the challenges to effective evaluation and discuss the strengths and weaknesses of existing methods of assessment.


A Customized NoC Architecture to Enable Highly Localized Computing On the Move DNN Dataflow. The ever increasing computation complexity of fastgrowing Deep Neural Networks (DNNs) has requested new computing paradigms to overcome the memory wall in conventional Von Neumann computing architectures. The emerging Computing In Memory (CIM) architecture has been a promising candidate to accelerate neural network computing. However, data movement between CIM arrays may still dominate the total power consumption in conventional designs. This paper proposes a flexible CIM processor architecture named Domino and "Computing On the Move" (COM) dataflow, to enable stream computing and local data access to significantly reduce data movement energy. Meanwhile, Domino employs customized distributed instruction scheduling within Network on Chip (NoC) to implement inter memory computing and attain mapping flexibility. The evaluation with prevailing DNN models shows that Domino achieves 1.77 to 2.37 times power efficiency over several state of the art CIM accelerators and improves the throughput by 1.28 to 13.16 times .


Throughput Maximization of UAV Networks. In this paper we study the deployment of multiple unmanned aerial vehicles (UAVs) to form a temporal UAV network for the provisioning of emergent communications to affected people in a disaster zone, where each UAV is equipped with a lightweight base station device and thus can act as an aerial base station for users. Unlike most existing studies that assumed that a UAV can serve all users in its communication range, we observe that both computation and communication capabilities of a single lightweight UAV are very limited, due to various constraints on its size, weight, and power supply. Thus, a single UAV can only provide communication services to a limited number of users. We study a novel problem of deploying K UAVs in the top of a disaster area such that the sum of the data rates of users served by the UAVs is maximized, subject to that (i) the number of users served by each UAV is no greater than its service capacity and (ii) the communication network induced by the K UAVs is connected. We then propose a frac 1 1 e lfloor sqrt K rfloor approximation algorithm for the problem, improving the current best result of the problem by five times (the best approximation ratio so far is frac 1 1 e 5( sqrt K 1) ), where e is the base of the natural logarithm. We finally evaluate the algorithm performance via simulation experiments. Experimental results show that the proposed algorithm is very promising. Especially, the solution delivered by the proposed algorithm is up to 12 better than those by existing algorithms.


Survey Vitals Screening Techniques for a Safer Environment. With COVID 19 disrupting operations across various sectors of the workforce (e.g., offices, airports, libraries, schools), preventative measures enabling resumption of work are quickly becoming a necessity. In this paper, we present the need for Vitals Screening Techniques (VIST) where more than one vital is screened to ensure the safety of the population (e.g. temperature, heart rate, and blood oxygen levels). VIST can be deployed in crowded environments to provide the new necessary layer of safety. We provide extensive coverage of state of art technology that can assist in tackling this emerging problem, and evaluate one of the existing products on the market that employ VIST.


FacTeR Check Semi automated fact checking through Semantic Similarity and Natural Language Inference. Our society produces and shares overwhelming amounts of information through Online Social Networks (OSNs). Within this environment, misinformation and disinformation have proliferated, becoming a public safety concern in most countries. Allowing the public and professionals to efficiently find reliable evidences about the factual veracity of a claim is a crucial step to mitigate this harmful spread. To this end, we propose FacTeR Check, a multilingual architecture for semi automated fact checking that can be used for either applications designed for the general public and by fact checking organisations. FacTeR Check enables retrieving fact checked information, unchecked claims verification and tracking dangerous information over social media. This architectures involves several modules developed to evaluate semantic similarity, to calculate natural language inference and to retrieve information from Online Social Networks. The union of all these components builds a semi automated fact checking tool able of verifying new claims, to extract related evidence, and to track the evolution of a hoax on a OSN. While individual modules are validated on related benchmarks (mainly MSTS and SICK), the complete architecture is validated using a new dataset called NLI19 SP that is publicly released with COVID 19 related hoaxes and tweets from Spanish social media. Our results show state of the art performance on the individual benchmarks, as well as producing a useful analysis of the evolution over time of 61 different hoaxes.


Maneuver Identification Challenge. AI algorithms that identify maneuvers from trajectory data could play an important role in improving flight safety and pilot training. AI challenges allow diverse teams to work together to solve hard problems and are an effective tool for developing AI solutions. AI challenges are also a key driver of AI computational requirements. The Maneuver Identification Challenge hosted at maneuver id.mit.edu provides thousands of trajectories collected from pilots practicing in flight simulators, descriptions of maneuvers, and examples of these maneuvers performed by experienced pilots. Each trajectory consists of positions, velocities, and aircraft orientations normalized to a common coordinate system. Construction of the data set required significant data architecture to transform flight simulator logs into AI ready data, which included using a supercomputer for deduplication and data conditioning. There are three proposed challenges. The first challenge is separating physically plausible (good) trajectories from unfeasible (bad) trajectories. Human labeled good and bad trajectories are provided to aid in this task. Subsequent challenges are to label trajectories with their intended maneuvers and to assess the quality of those maneuvers.


Evaluating Meta Feature Selection for the Algorithm Recommendation Problem. With the popularity of Machine Learning (ML) solutions, algorithms and data have been released faster than the capacity of processing them. In this context, the problem of Algorithm Recommendation (AR) is receiving a significant deal of attention recently. This problem has been addressed in the literature as a learning task, often as a Meta Learning problem where the aim is to recommend the best alternative for a specific dataset. For such, datasets encoded by meta features are explored by ML algorithms that try to learn the mapping between meta representations and the best technique to be used. One of the challenges for the successful use of ML is to define which features are the most valuable for a specific dataset since several meta features can be used, which increases the meta feature dimension. This paper presents an empirical analysis of Feature Selection and Feature Extraction in the meta level for the AR problem. The present study was focused on three criteria predictive performance, dimensionality reduction, and pipeline runtime. As we verified, applying Dimensionality Reduction (DR) methods did not improve predictive performances in general. However, DR solutions reduced about 80 of the meta features, obtaining pretty much the same performance as the original setup but with lower runtimes. The only exception was PCA, which presented about the same runtime as the original meta features. Experimental results also showed that various datasets have many non informative meta features and that it is possible to obtain high predictive performance using around 20 of the original meta features. Therefore, due to their natural trend for high dimensionality, DR methods should be used for Meta Feature Selection and Meta Feature Extraction.


TANet Triple Attention Network with Filtered Pointcloud on 3D Detection. TANet is one of state of the art 3D object detection method on KITTI and JRDB benchmark, the network contains a Triple Attention module and Coarse to Fine Regression module to improve the robustness and accuracy of 3D Detection. However, since the original input data (point clouds) contains a lot of noise during collecting the data, which will further affect the training of the model. For example, the object is far from the robot, the sensor is difficult to obtain enough pointcloud. If the objects only contains few point clouds, and the samples are fed into model with the normal samples together during training, the detector will be difficult to distinguish the individual with few pointcloud belong to object or background. In this paper, we propose TANet to improve the performance on 3D Detection, which adopt a novel training strategy on training the TANet. In order to reduce the negative impact by the weak samples, the training strategy previously filtered the training data, and then the TANet is trained by the rest of data. The experimental results shows that AP score of TANet is 8.98 higher than TANet on JRDB benchmark.


Euler sums of generalized alternating hyperharmonic numbers II. In this paper, we introduce a new type of generalized alternating hyperharmonic numbers H n (p,r,s 1 ,s 2 ) , and show that Euler sums of the generalized alternating hyperharmonic numbers H n (p,r,s 1 ,s 2 ) can be expressed in terms of linear combinations of classical (alternating) Euler sums.


Comparison and Improvement for Delay Analysis Approaches Theoretical Models and Experimental Tests. Computer network tends to be subjected to the proliferation of mobile demands and increasingly multifarious, therefore it poses a great challenge to guarantee the quality of network service. By designing the model according to different requirements, we may get some related indicators such as delay and packet loss rate in order to evaluate the quality of network service and verify the user data surface and capacity of the network environment. In this paper, we describe an analytical model based on the measurement for the delay of each packet passing through the single existing routers in the network environment. In previous studies, the emulation of real network service behaviors was generally under ideal condition. In our work, the test environment is built to get the relevant test results of the actual network, and the corresponding theoretical results are obtained by our model. The test results are compared with the theoretical results, analyzed and corrected, in order to verify the feasibility of our analysis model for the performance analysis of the actual network. With this concern, calculation results are modified with different schemes to realize more precise calculation of delay boundary with the comparison with the experimental test results. The results show the analysis methods after the amendment can realistically estimate the performance of network element.


GF Flush A GF(2) Algebraic Attack on Secure Scan Chains. Scan chains provide increased controllability and observability for testing digital circuits. The increased testability, however, can also be a source of information leakage for sensitive designs. The state of the art defenses to secure scan chains apply dynamic keys to pseudo randomly invert the scan vectors. In this paper, we pinpoint an algebraic vulnerability of these dynamic defenses that involves creating and solving a system of linear equations over the finite field GF(2). In particular, we propose a novel GF(2) based flush attack that breaks even the most rigorous version of state of the art dynamic defenses. Our experimental results demonstrate that our attack recovers the key as long as 500 bits in less than 7 seconds, the attack times are about one hundredth of state of the art SAT based attacks on the same defenses. We then demonstrate how our attacks can be extended to scan chains compressed with Multiple Input Signature Registers (MISRs).


The Spatio Temporal Poisson Point Process A Simple Model for the Alignment of Event Camera Data. Event cameras, inspired by biological vision systems, provide a natural and data efficient representation of visual information. Visual information is acquired in the form of events that are triggered by local brightness changes. Each pixel location of the camera's sensor records events asynchronously and independently with very high temporal resolution. However, because most brightness changes are triggered by relative motion of the camera and the scene, the events recorded at a single sensor location seldom correspond to the same world point. To extract meaningful information from event cameras, it is helpful to register events that were triggered by the same underlying world point. In this work we propose a new model of event data that captures its natural spatio temporal structure. We start by developing a model for aligned event data. That is, we develop a model for the data as though it has been perfectly registered already. In particular, we model the aligned data as a spatio temporal Poisson point process. Based on this model, we develop a maximum likelihood approach to registering events that are not yet aligned. That is, we find transformations of the observed events that make them as likely as possible under our model. In particular we extract the camera rotation that leads to the best event alignment. We show new state of the art accuracy for rotational velocity estimation on the DAVIS 240C dataset. In addition, our method is also faster and has lower computational complexity than several competing methods.


Diet Soda and Liquid Nitrogen. Letter to the Editor about how the diet soda and Mentos reaction can be produced by the direct immersion of a plastic soda bottle in liquid nitrogen.


Injective Objects and Fibered Codensity Liftings. Functor lifting along a fibration is used for several different purposes in computer science. In the theory of coalgebras, it is used to define coinductive predicates, such as simulation preorder and bisimilarity. Codensity lifting is a scheme to obtain a functor lifting along a fibration. It generalizes a few previous lifting schemes including the Kantorovich lifting. In this paper, we seek a property of functor lifting called fiberedness. Hinted by a known result for Kantorovich lifting, we identify a sufficient condition for a codensity lifting to be fibered. We see that this condition applies to many examples that have been studied. As an application, we derive some results on bisimilarity like notions.


BGG categories in prime characteristics. Let mathfrak g be a simple complex Lie algebra. In this paper we study the BGG category mathcal O q for the quantum group U q( mathfrak g) with q being a root of unity in a field K of characteristic p 0 . We first consider the simple modules in mathcal O q and prove a Steinberg tensor product theorem for them. This result reduces the problem of determining the corresponding irreducible characters to the same problem for a finite subset of finite dimensional simple modules. Then we investigate more closely the Verma modules in mathcal O q . Except for the special Verma module, which has highest weight rho , they all have infinite length. Nevertheless, we show that each Verma module has a certain finite filtration with an associated strong linkage principle. The special Verma module turns out to be both simple and projective injective. This leads to a family of projective modules in mathcal O q , which are also tilting modules. We prove a reciprocity law, which gives a precise relation between the corresponding family of characters for indecomposable tilting modules and the family of characters of simple modules with antidominant highest weights. All these results are of particular interest when q 1 , and we have paid special attention to this case.


Elliptic genus and string cobordism at dimension 24 . It is known that spin cobordism can be determined by Stiefel Whitney numbers and index theory invariants, namely KO theoretic Pontryagin numbers. In this paper, we show that string cobordism at dimension 24 can be determined by elliptic genus, a higher index theory invariant. We also compute the image of 24 dimensional string cobordism under elliptic genus. Using our results, we show that under certain curvature conditions, a compact 24 dimensional string manifold must bound a string manifold.


Farview Disaggregated Memory with Operator Off loading for Database Engines. Cloud deployments disaggregate storage from compute, providing more flexibility to both the storage and compute layers. In this paper, we explore disaggregation by taking it one step further and applying it to memory (DRAM). Disaggregated memory uses network attached DRAM as a way to decouple memory from CPU. In the context of databases, such a design offers significant advantages in terms of making a larger memory capacity available as a central pool to a collection of smaller processing nodes. To explore these possibilities, we have implemented Farview, a disaggregated memory solution for databases, operating as a remote buffer cache with operator offloading capabilities. Farview is implemented as an FPGA based smart NIC making DRAM available as a disaggregated, network attached memory module capable of performing data processing at line rate over data streams to from disaggregated memory. Farview supports query offloading using operators such as selection, projection, aggregation, regular expression matching and encryption. In this paper we focus on analytical queries and demonstrate the viability of the idea through an extensive experimental evaluation of Farview under different workloads. Farview is competitive with a local buffer cache solution for all the workloads and outperforms it in a number of cases, proving that a smart disaggregated memory can be a viable alternative for databases deployed in cloud environments.


Energy and Network Aware Workload Management for Geographically Distributed Data Centers. Cloud service providers are distributing data centers geographically to minimize energy costs through intelligent workload distribution. With increasing data volumes in emerging cloud workloads, it is critical to factor in the network costs for transferring workloads across data centers. For geo distributed data centers, many researchers have been exploring strategies for energy cost minimization and intelligent inter data center workload distribution separately. However, prior work does not comprehensively and simultaneously consider data center energy costs, data transfer costs, and data center queueing delay. In this paper, we propose a novel game theory based workload management framework that takes a holistic approach to the cloud operating cost minimization problem by making intelligent scheduling decisions aware of data transfer costs and the data center queueing delay. Our framework performs intelligent workload management that considers heterogeneity in data center compute capability, cooling power, interference effects from task co location in servers, time of use electricity pricing, renewable energy, net metering, peak demand pricing distribution, and network pricing. Our simulations show that the proposed game theoretic technique can minimize the cloud operating cost more effectively than existing approaches.


DemSelf, a Mobile App for Self Administered Touch Based Cognitive Screening Participatory Design With Stakeholders. Early detection of mild cognitive impairment and dementia is vital as many therapeutic interventions are particularly effective at an early stage. A self administered touch based cognitive screening instrument, called DemSelf, was developed by adapting an examiner administered paper based instrument, the Quick Mild Cognitive Impairment (Qmci) screen. We conducted five semi structured expert interviews including a think aloud phase to evaluate usability problems. The extent to which the characteristics of the original subtests change by the adaption, as well as the conditions and appropriate context for practical application, were also in question. The participants had expertise in the domain of usability and human machine interaction and or in the domain of dementia and neuropsychological assessment. Participants identified usability issues in all components of the DemSelf prototype. For example, confirmation of answers was not consistent across subtests. Answers were sometimes logged directly when a button is tapped and cannot be corrected. This can lead to frustration and bias in test results, especially for people with vision or motor impairments. The direct adoption of time limits from the original paper based instrument or the simultaneous verbal and textual item presentation also caused usability problems. DemSelf is a different test than Qmci and needs to be re validated. Visual recognition instead of a free verbal recall is one of the main differences. Reading skill level seems to be an important confounding variable. Participants would generally prefer if the test is conducted in a medical office rather than at a patient's home so that someone is present for support and the result can be discussed directly.


Simplified DOM Trees for Transferable Attribute Extraction from the Web. There has been a steady need to precisely extract structured knowledge from the web (i.e. HTML documents). Given a web page, extracting a structured object along with various attributes of interest (e.g. price, publisher, author, and genre for a book) can facilitate a variety of downstream applications such as large scale knowledge base construction, e commerce product search, and personalized recommendation. Considering each web page is rendered from an HTML DOM tree, existing approaches formulate the problem as a DOM tree node tagging task. However, they either rely on computationally expensive visual feature engineering or are incapable of modeling the relationship among the tree nodes. In this paper, we propose a novel transferable method, Simplified DOM Trees for Attribute Extraction (SimpDOM), to tackle the problem by efficiently retrieving useful context for each node by leveraging the tree structure. We study two challenging experimental settings (i) intra vertical few shot extraction, and (ii) cross vertical fewshot extraction with out of domain knowledge, to evaluate our approach. Extensive experiments on the SWDE public dataset show that SimpDOM outperforms the state of the art (SOTA) method by 1.44 on the F1 score. We also find that utilizing knowledge from a different vertical (cross vertical extraction) is surprisingly useful and helps beat the SOTA by a further 1.37 .


Order Integrals. We define an integral of real valued functions with respect to a measure that takes its values in the extended positive cone of a partially ordered vector space E . The monotone convergence theorem, Fatou's lemma, and the dominated convergence theorem are established the analogues of the classical mathcal L 1 and mathrm L 1 spaces are investigated. The results extend earlier work by Wright and specialise to those for the Lebesgue integral when E equals the real numbers. The hypothesis on E that is needed for the definition of the integral and for the monotone convergence theorem to hold ( sigma monotone completeness) is a rather mild one. It is satisfied, for example, by the space of regular operators between a directed partially ordered vector space and a sigma monotone complete partially ordered vector space, and by every JBW algebra. Fatou's lemma and the dominated convergence theorem hold for every sigma Dedekind complete space. When E consists of the regular operators on a Banach lattice with an order continuous norm, or when it consists of the self adjoint elements of a strongly closed complex linear subspace of the bounded operators on a complex Hilbert space, then the finite measures as in the current paper are precisely the strongly sigma additive positive operator valued measures. When E is a partially ordered Banach space with a closed positive cone, then every positive vector measure is a measure in our sense, but not conversely. Even when a measure falls into both categories, the domain of the integral as defined in this paper can properly contain that of any reasonably defined integral with respect to the vector measure using Banach space methods.


SSPNet Scale Selection Pyramid Network for Tiny Person Detection from UAV Images. With the increasing demand for search and rescue, it is highly demanded to detect objects of interest in large scale images captured by Unmanned Aerial Vehicles (UAVs), which is quite challenging due to extremely small scales of objects. Most existing methods employed Feature Pyramid Network (FPN) to enrich shallow layers' features by combing deep layers' contextual features. However, under the limitation of the inconsistency in gradient computation across different layers, the shallow layers in FPN are not fully exploited to detect tiny objects. In this paper, we propose a Scale Selection Pyramid network (SSPNet) for tiny person detection, which consists of three components Context Attention Module (CAM), Scale Enhancement Module (SEM), and Scale Selection Module (SSM). CAM takes account of context information to produce hierarchical attention heatmaps. SEM highlights features of specific scales at different layers, leading the detector to focus on objects of specific scales instead of vast backgrounds. SSM exploits adjacent layers' relationships to fulfill suitable feature sharing between deep layers and shallow layers, thereby avoiding the inconsistency in gradient computation across different layers. Besides, we propose a Weighted Negative Sampling (WNS) strategy to guide the detector to select more representative samples. Experiments on the TinyPerson benchmark show that our method outperforms other state of the art (SOTA) detectors.