Minimal mass design of a tensegrity tower for lunar electromagnetic launching. Lunar explorations have provided us with information about its abundant resources that can be utilized in orbiting resource depots as lunar derived commodities. To reduce the energy requirements of a launcher to send these commodities from the lunar surface to the space depots, this paper explores the application of the electromagnetic acceleration principle and provides an assessment of the actual technical characteristics of the launcher's installation to ensure the acceleration of a payload with a mass of 1,500 kg to a speed of 2,200 m s (circumlunar orbit speed). To fulfill a lightweight (fewer materials and less energy) support structure for the electromagnetic launcher with strength requirements, the tensegrity structure minimum mass principle without global buckling has been developed and applied to support the electromagnetic acceleration device. Therefore, this paper proposes and develops a minimal mass electromagnetic tensegrity lunar launcher. We first demonstrate the mechanics of launcher and payload, how a payload can be accelerated to a specific velocity, and how a payload carrier can be recycled for another launch. Then, a detailed discussion on the lunar launch system, procedures of propulsion, the required mass, and energy of the launch barrel are given. The governing equations of tensegrity minimal mass tensegrity design algorithm with gravity and without global buckling. Finally, a case study is conducted to show a feasible structure design, the required mass, and energy. The principles developed in this paper are also applicable to the rocket launch system, space elevator, space train transportation, interstellar payload package delivery, etc.


NH PINN Neural homogenization based physics informed neural network for multiscale problems. Physics informed neural network (PINN) is a data driven approach to solve equations. It is successful in many applications however, the accuracy of the PINN is not satisfactory when it is used to solve multiscale equations. Homogenization is a way of approximating a multiscale equation by a homogenized equation without multiscale property it includes solving cell problems and the homogenized equation. The cell problems are periodic and we propose an oversampling strategy which greatly improves the PINN accuracy on periodic problems. The homogenized equation has constant or slow dependency coefficient and can also be solved by PINN accurately. We hence proposed a 3 step method to improve the PINN accuracy for solving multiscale problems with the help of the homogenization. We apply our method to solve three equations which represent three different homogenization. The results show that the proposed method greatly improves the PINN accuracy. Besides, we also find that the PINN aided homogenization may achieve better accuracy than the numerical methods driven homogenization PINN hence is a potential alternative to implementing the homogenization.


QA4PRF A Question Answering based Framework for Pseudo Relevance Feedback. Pseudo relevance feedback (PRF) automatically performs query expansion based on top retrieved documents to better represent the user's information need so as to improve the search results. Previous PRF methods mainly select expansion terms with high occurrence frequency in top retrieved documents or with high semantic similarity with the original query. However, existing PRF methods hardly try to understand the content of documents, which is very important in performing effective query expansion to reveal the user's information need. In this paper, we propose a QA based framework for PRF called QA4PRF to utilize contextual information in documents. In such a framework, we formulate PRF as a QA task, where the query and each top retrieved document play the roles of question and context in the corresponding QA system, while the objective is to find some proper terms to expand the original query by utilizing contextual information, which are similar answers in QA task. Besides, an attention based pointer network is built on understanding the content of top retrieved documents and selecting the terms to represent the original query better. We also show that incorporating the traditional supervised learning methods, such as LambdaRank, to integrate PRF information will further improve the performance of QA4PRF. Extensive experiments on three real world datasets demonstrate that QA4PRF significantly outperforms the state of the art methods.


Containing Malicious Package Updates in npm with a Lightweight Permission System. The large amount of third party packages available in fast moving software ecosystems, such as Node.js npm, enables attackers to compromise applications by pushing malicious updates to their package dependencies. Studying the npm repository, we observed that many packages in the npm repository that are used in Node.js applications perform only simple computations and do not need access to filesystem or network APIs. This offers the opportunity to enforce least privilege design per package, protecting applications and package dependencies from malicious updates. We propose a lightweight permission system that protects Node.js applications by enforcing package permissions at runtime. We discuss the design space of solutions and show that our system makes a large number of packages much harder to be exploited, almost for free.


Ride Acceptance Behaviour of Ride sourcing Drivers. The performance of ride sourcing services such as Uber and Lyft is determined by the collective choices of individual drivers who are not only chauffeurs but private fleet providers. In such a context, ride sourcing drivers are free to decide whether to accept or decline ride requests assigned by the ride hailing platform. Drivers' ride acceptance behaviour can significantly influence system performance in terms of riders' waiting time (associated with the level of service), drivers' occupation rate and idle time (related to drivers' income), and platform revenue and reputation. Hence, it is of great importance to identify the underlying determinants of the ride acceptance behaviour of drivers. To this end, we collected a unique dataset from ride sourcing drivers working in the United States and the Netherlands through a cross sectional stated preference experiment designed based upon disparate information conveyed to the respondents. Using a choice modelling approach, we estimated the effects of various existing and hypothetical attributes influencing the ride acceptance choice. Employment status, experience level with the platform, and working shift are found to be the key individual specific determinants. Part time and beginning drivers who work on midweek days (Monday Thursday) have a higher tendency to accept ride offers. Results also reveal that pickup time, which is the travel time between the driver's location and the rider's waiting spot, has a negative impact on ride acceptance. Moreover, the findings suggest that a guaranteed tip (i.e., the minimum amount of tip that is indicated upfront by the prospective rider, a feature that is currently not available) and an additional income due to surge pricing are valued noticeably higher than trip fare. The provided insights can be used to develop customised matching and pricing strategies to improve system efficiency.


Ome new theorems on generating functions and their applications on odd and even certain numbers attached to p and q parameters. In this study, we first provide some new theorems by using the symmetrizing operator. After that, by using this theorems we introduce a new family of generating functions of odd and even terms of (p,q) Fibonacci numbers, (p,q) Lucas numbers, (p,q) Pell numbers, (p,q) Pell Lucas numbers, (p,q) Jacobsthal numbers and (p,q) Jacobsthal Lucas numbers. Then, we give the new generating functions of the products of these (p,q) numbers with odd and even phrases of (p,q) numbers.


Mention Memory incorporating textual knowledge into Transformers through entity mention attention. Natural language understanding tasks such as open domain question answering often require retrieving and assimilating factual information from multiple sources. We propose to address this problem by integrating a semi parametric representation of a large text corpus into a Transformer model as a source of factual knowledge. Specifically, our method represents knowledge with mention memory', a table of dense vector representations of every entity mention in a corpus. The proposed model TOME is a Transformer that accesses the information through internal memory layers in which each entity mention in the input passage attends to the mention memory. This approach enables synthesis of and reasoning over many disparate sources of information within a single Transformer model. In experiments using a memory of 150 million Wikipedia mentions, TOME achieves strong performance on several open domain knowledge intensive tasks, including the claim verification benchmarks HoVer and FEVER and several entity based QA benchmarks. We also show that the model learns to attend to informative mentions without any direct supervision. Finally we demonstrate that the model can generalize to new unseen entities by updating the memory without retraining.


Arbitrary order intrinsic virtual element method for elliptic equations on surfaces. We develop a geometrically intrinsic formulation of the arbitrary order Virtual Element Method (VEM) on polygonal cells for the numerical solution of elliptic surface partial differential equations (PDEs). The PDE is first written in covariant form using an appropriate local reference system. The knowledge of the local parametrization allows us to consider the two dimensional VEM scheme, without any explicit approximation of the surface geometry. The theoretical properties of the classical VEM are extended to our framework by taking into consideration the highly anisotropic character of the final discretization. These properties are extensively tested on triangular and polygonal meshes using a manufactured solution. The limitations of the scheme are verified as functions of the regularity of the surface and its approximation.


Solving Large Scale Extensive Form Network Security Games via Neural Fictitious Self Play. Securing networked infrastructures is important in the real world. The problem of deploying security resources to protect against an attacker in networked domains can be modeled as Network Security Games (NSGs). Unfortunately, existing approaches, including the deep learning based approaches, are inefficient to solve large scale extensive form NSGs. In this paper, we propose a novel learning paradigm, NSG NFSP, to solve large scale extensive form NSGs based on Neural Fictitious Self Play (NFSP). Our main contributions include i) reforming the best response (BR) policy network in NFSP to be a mapping from action state pair to action value, to make the calculation of BR possible in NSGs ii) converting the average policy network of an NFSP agent into a metric based classifier, helping the agent to assign distributions only on legal actions rather than all actions iii) enabling NFSP with high level actions, which can benefit training efficiency and stability in NSGs and iv) leveraging information contained in graphs of NSGs by learning efficient graph node embeddings. Our algorithm significantly outperforms state of the art algorithms in both scalability and solution quality.


Learning Self Similarity in Space and Time as Generalized Motion for Video Action Recognition. Spatio temporal convolution often fails to learn motion dynamics in videos and thus an effective motion representation is required for video understanding in the wild. In this paper, we propose a rich and robust motion representation based on spatio temporal self similarity (STSS). Given a sequence of frames, STSS represents each local region as similarities to its neighbors in space and time. By converting appearance features into relational values, it enables the learner to better recognize structural patterns in space and time. We leverage the whole volume of STSS and let our model learn to extract an effective motion representation from it. The proposed neural block, dubbed SELFY, can be easily inserted into neural architectures and trained end to end without additional supervision. With a sufficient volume of the neighborhood in space and time, it effectively captures long term interaction and fast motion in the video, leading to robust action recognition. Our experimental analysis demonstrates its superiority over previous methods for motion modeling as well as its complementarity to spatio temporal features from direct convolution. On the standard action recognition benchmarks, Something Something V1 V2, Diving 48, and FineGym, the proposed method achieves the state of the art results.


Volume preserving particle integrator based on exact flow of velocity for nonrelativistic particle in cell simulations. We construct a particle integrator for nonrelativistic particles by means of the splitting method based on the exact flow of the equation of motion of particles in the presence of constant electric and magnetic field. This integrator is volume preserving similar to the standard Boris integrator and is suitable for long term integrations in particle in cell simulations. Numerical tests reveal that it is significantly more accurate than previous volume preserving integrators with second order accuracy. For example, in the E times B drift test, this integrator is more accurate than the Boris integrator and the integrator based on the exact solution of gyro motion by three and two orders of magnitude, respectively. In addition, we derive approximate integrators that incur low computational cost and high precision integrators displaying fourth to tenth order accuracy with the aid of the composition method. These integrators are also volume preserving. It is also demonstrated that the Boris integrator is equivalent to the simplest case of the approximate integrators derived in this study.


Technology Fitness Landscape and the Future of Innovation. We present a deep learning based technology fitness landscape premised on a neural embedding space of 1,757 technology domains and their respective improvement rates. The technology embedding space is a high dimensional vector space trained via applying neural embedding techniques to patent data. The improvement rates of respective technology domains are drawn from a prior study. The technology fitness landscape exhibits a high hill related to information and communication technologies (ICT) and a vast low plain of the remaining domains. The technology fitness landscape presents a bird's eye view of the structure of the total technology space, a new way to interpret technology evolution with a biological analogy, and a biologically inspired inference to next innovation.


Ab initio calculations of the spectrum of lawrencium. Planned optical spectroscopy experiments in lawrencium (Lr, Z 103) require accurate theoretical predictions of the location of spectral lines in order to narrow the experimental search window. We present ab initio calculations of the atomic energy levels, transition amplitudes and g factors for lawrencium, as well as its lighter homologue lutetium (Lu, Z 71). We use the configuration interaction with many body perturbation theory (CI MBPT) method to calculate energy levels and transition properties, and benchmark the accuracy of our predicted energies using relativistic coupled cluster codes. Our results are numerically converged and in close agreement with experimentally measured energy levels for Lu, and we expect a similar accuracy for Lr. These systematic calculations have identified multiple transitions of experimental utility and will serve to guide future experimental studies of Lr.


Axisymmetric dynamo action produced by differential rotation, with anisotropic electrical conductivity and anisotropic magnetic permeability. The effect on dynamo action of an anisotropic electrical conductivity conjugated to an anisotropic magnetic permeability is considered. Not only is the dynamo fully axisymmetric, but it requires only a simple differential rotation, which twice challenges the well established dynamo theory. Stability analysis is conducted entirely analytically, leading to an explicit expression of the dynamo threshold. The results show a competition between the anisotropy of electrical conductivity and that of magnetic permeability, the dynamo effect becoming impossible if the two anisotropies are identical. For isotropic electrical conductivity, Cowling's neutral point argument does imply the absence of an azimuthal component of current density, but does not prevent the dynamo effect as long as the magnetic permeability is anisotropic.


Evolution of mass, surface layer composition and light scattering of evaporating, single microdroplets of SDS DEG suspension. Shrinking droplet surface as the micelles generator. We study the evolution of the mass of evaporating single microdroplets of sodium do decyl sulphate (SDS) diethylene glycol (DEG) mixture. First, we recognise and deconvolute the influence of residual water evaporation Kolwas et al. Soft Matter 2019 15 1825 , which accelerates the composite droplet evaporation, a simple exponential decay of the evaporating droplet surface change rate. This enables us to study the influence of SDS concentration on the composite droplet evaporation. Next, we establish a simple relationship between the average SDS concentration and the droplet evaporation rate to enable the study of the evolution of SDS concentration at the droplet surface. The oscillatory nature of surface SDS concentration indicates cyclic changes in the surface monolayer associated with the cyclic creation of vesicles (micelles) at the surface. The model we developed, allows the determination of SDS critical micelles concentration (CMC) in DEG as 60 2 mM.


The Square Root Normal Field Distance and Unbalanced Optimal Transport. This paper explores a novel connection between two areas shape analysis of surfaces and unbalanced optimal transport. Specifically, we characterize the square root normal field (SRNF) shape distance as the pullback of the Wasserstein Fisher Rao (WFR) unbalanced optimal transport distance. In addition, we propose a new algorithm for computing the WFR distance and present numerical results that highlight the effectiveness of this algorithm. As a consequence of our results we obtain a precise method for computing the SRNF shape distance directly on piecewise linear surfaces and gain new insights about the degeneracy of this distance.


Convergence Rate of the (1 1) Evolution Strategy with Success Based Step Size Adaptation on Convex Quadratic Functions. The (1 1) evolution strategy (ES) with success based step size adaptation is analyzed on a general convex quadratic function and its monotone transformation, that is, f(x) g((x x ) mathrm T H (x x )) , where g mathbb R to mathbb R is a strictly increasing function, H is a positive definite symmetric matrix, and x in mathbb R d is the optimal solution of f . The convergence rate, that is, the decrease rate of the distance from a search point m t to the optimal solution x , is proven to be in O( exp( L mathrm Tr (H) )) , where L is the smallest eigenvalue of H and mathrm Tr (H) is the trace of H . This result generalizes the known rate of O( exp( 1 d )) for the case of H I d ( I d is the identity matrix of dimension d ) and O( exp( 1 (d cdot xi) )) for the case of H mathrm diag ( xi cdot I d 2 , I d 2 ) . To the best of our knowledge, this is the first study in which the convergence rate of the (1 1) ES is derived explicitly and rigorously on a general convex quadratic function, which depicts the impact of the distribution of the eigenvalues in the Hessian H on the optimization and not only the impact of the condition number of H .


Coherence for plactic monoids via rewriting theory and crystal structures. Rewriting methods have been developed for the study of coherence for algebraic objects. This consists in starting with a convergent presentation, and expliciting a family of generating confluences to obtain a coherent presentation one with generators, generating relations, and generating relations between relations (syzygies). In this article we develop these ideas for a class of monoids which encode the representation theory of complex symmetrizable Kac Moody algebras, called plactic monoids. The main tools for this are the crystal realization of plactic monoids due to Kashiwara, and a class of presentations compatible with a crystal structure, called crystal presentations. We show that the compatibility of the crystal structure with the presentation reduces certain aspects of the study of plactic monoids by rewriting theory to components of highest weight in the crystal. We thus obtain reduced versions of Newman's Lemma and Critical Pair Lemma, which are results for verifying convergence of a presentation. Further we show that the family of generating confluences of a convergent crystal presentation is entirely determined by the components of highest weight. Finally we apply these constructions to the finite convergent presentations of plactic monoids of type A n , B n , C n , D n , and G 2 , due to Cain Gray Malheiro.


Approximate inversion of discrete Fourier integral operators. This paper introduces a factorization for the inverse of discrete Fourier integral operators that can be applied in quasi linear time. The factorization starts by approximating the operator with the butterfly factorization. Next, a hierarchical matrix representation is constructed for the hermitian matrix arising from composing the Fourier integral operator with its adjoint. This representation is inverted efficiently with a new algorithm based on the hierarchical interpolative factorization. By combining these two factorizations, an approximate inverse factorization for the Fourier integral operator is obtained as a product of O( log N) sparse matrices of size N times N . The resulting approximate inverse factorization can be used as a direct solver or as a preconditioner. Numerical examples on 1D and 2D Fourier integral operators, including a generalized Radon transform, demonstrate the performance of this new approach.


Cyclic projections in Hadamard spaces. We show that cyclic products of projections onto convex subsets of Hadamard spaces can behave in a more complicated way than in Hilbert spaces, resolving a problem formulated by Miroslav Ba v c 'ak. Namely, we construct an example of convex subsets in a Hadamard space such that the corresponding cyclic product of projections is not asymptotically regular.


Dataset of Propaganda Techniques of the State Sponsored Information Operation of the People's Republic of China. The digital media, identified as computational propaganda provides a pathway for propaganda to expand its reach without limit. State backed propaganda aims to shape the audiences' cognition toward entities in favor of a certain political party or authority. Furthermore, it has become part of modern information warfare used in order to gain an advantage over opponents. Most of the current studies focus on using machine learning, quantitative, and qualitative methods to distinguish if a certain piece of information on social media is propaganda. Mainly conducted on English content, but very little research addresses Chinese Mandarin content. From propaganda detection, we want to go one step further to provide more fine grained information on propaganda techniques that are applied. In this research, we aim to bridge the information gap by providing a multi labeled propaganda techniques dataset in Mandarin based on a state backed information operation dataset provided by Twitter. In addition to presenting the dataset, we apply a multi label text classification using fine tuned BERT. Potentially this could help future research in detecting state backed propaganda online especially in a cross lingual context and cross platforms identity consolidation.


Concentration inequalities for the hydrodynamic limit of a two species stochastic particle system. We study a stochastic particle system which is motivated from grain boundary coarsening in two dimensional networks. Each particles lives on the positive real line and is labeled as belonging to either Species 1 or Species 2. Species 1 particles drift at unit speed toward the origin, while Species 2 particles do not move. When a particle in Species 1 hits the origin, it is removed, and a randomly selected particle mutates from Species 2 to Species 1. The process described is an example of a high dimensional piecewise deterministic Markov process (PDMP), in which deterministic flow is punctuated with stochastic jumps. Our main result is a proof of exponential concentration inequalities of the Kolmogorov Smirnoff distance between empirical measures of the particle system and solutions of limiting nonlinear kinetic equations. Our method of proof involves a time and space discretization of the kinetic equations, which we compare with the particle system to derive recurrence inequalities for comparing total numbers in small intervals. To show these recurrences occur with high probability, we appeal to a state dependent Hoeffding type inequality at each time increment.


A generalisation of Pisier homogeneous Banach algebra. In 1979 Pisier proved remarkably that a sequence of independent and identically distributed standard Gaussian random variables determines, via random Fourier series, a homogeneous Banach algebra mathscr P strictly contained in C( mathbb T ) , the class of continuous functions on the unit circle mathbb T and strictly containing the classical Wiener algebra mathbb A ( mathbb T ) , that is, mathbb A ( mathbb T ) subsetneqq mathscr P subsetneqq C( mathbb T ). This improved some previous results obtained by Zafran in solving a long standing problem raised by Katznelson. In this paper we extend Pisier's result by showing that any probability measure on the unit circle defines a homogeneous Banach algebra contained in C( mathbb T ) . Thus Pisier algebra is not an isolated object but rather an element in a large class of Pisier type algebras. We consider the case of spectral measures of stationary sequences of Gaussian random variables and obtain a sufficient condition for the boundedness of the random Fourier series sum n in mathbb Z hat f(n) , xi n exp(2 pi i n t) in the general setting of dependent random variables ( xi n) .


A Survey of Natural Language Generation. This paper offers a comprehensive review of the research on Natural Language Generation (NLG) over the past two decades, especially in relation to data to text generation and text to text generation deep learning methods, as well as new applications of NLG technology. This survey aims to (a) give the latest synthesis of deep learning research on the NLG core tasks, as well as the architectures adopted in the field (b) detail meticulously and comprehensively various NLG tasks and datasets, and draw attention to the challenges in NLG evaluation, focusing on different evaluation methods and their relationships (c) highlight some future emphasis and relatively recent research issues that arise due to the increasing synergy between NLG and other artificial intelligence areas, such as computer vision, text and computational creativity.


Efficient Symptom Inquiring and Diagnosis via Adaptive Alignment of Reinforcement Learning and Classification. The medical automatic diagnosis system aims to imitate human doctors in the real diagnostic process. This task is formulated as a sequential decision making problem with symptom inquiring and disease diagnosis. In recent years, many researchers have used reinforcement learning methods to handle this task. However, most recent works neglected to distinguish the symptom inquiring and disease diagnosing actions and mixed them into one action space. This results in the unsatisfactory performance of reinforcement learning methods on this task. Moreover, there is a lack of a public evaluation dataset that contains various diseases and corresponding information. To address these issues, we first propose a novel method for medical automatic diagnosis with symptom inquiring and disease diagnosing formulated as a reinforcement learning task and a classification task, respectively. We also propose a robust and adaptive method to align the two tasks using distribution entropies as media. Then, we create a new dataset extracted from the MedlinePlus knowledge base. The dataset contains more diseases and more complete symptom information. The simulated patients for experiments are more realistic. Experimental evaluation results show that our method outperforms three recent state of the art methods on different datasets by achieving higher medical diagnosis accuracies with few inquiring turns.


On Satisficing in Quantitative Games. Several problems in planning and reactive synthesis can be reduced to the analysis of two player quantitative graph games. em Optimization is one form of analysis. We argue that in many cases it may be better to replace the optimization problem with the em satisficing problem , where instead of searching for optimal solutions, the goal is to search for solutions that adhere to a given threshold bound. This work defines and investigates the satisficing problem on a two player graph game with the discounted sum cost model. We show that while the satisficing problem can be solved using numerical methods just like the optimization problem, this approach does not render compelling benefits over optimization. When the discount factor is, however, an integer, we present another approach to satisficing, which is purely based on automata methods. We show that this approach is algorithmically more performant both theoretically and empirically and demonstrates the broader applicability of satisficing overoptimization.


Industry 4.0 in Finland Towards Twin Transition. This submission has been removed by arXiv administrators as the submitter did not have the right to agree to the license at the time of submission.


P2P Loc Point to Point Tiny Person Localization. Bounding box annotation form has been the most frequently used method for visual object localization tasks. However, bounding box annotation relies on a large amount of precisely annotating bounding boxes, and it is expensive and laborious. It is impossible to be employed in practical scenarios and even redundant for some applications (such as tiny person localization) that the size would not matter. Therefore, we propose a novel point based framework for the person localization task by annotating each person as a coarse point (CoarsePoint) instead of an accurate bounding box that can be any point within the object extent. Then, the network predicts the person's location as a 2D coordinate in the image. Although this greatly simplifies the data annotation pipeline, the CoarsePoint annotation inevitably decreases label reliability (label uncertainty) and causes network confusion during training. As a result, we propose a point self refinement approach that iteratively updates point annotations in a self paced way. The proposed refinement system alleviates the label uncertainty and progressively improves localization performance. Experimental results show that our approach has achieved comparable object localization performance while saving up to 80 of annotation cost.


Optimizing Build Orientation for Support Removal using Multi Axis Machining. Parts fabricated by additive manufacturing (AM) are often fabricated first as a near net shape, a combination of intended nominal geometry and sacrificial support structures, which need to be removed in a subsequent post processing stage using subtractive manufacturing (SM). In this paper, we present a framework for optimizing the build orientation with respect to removability of support structures. In particular, given a general multi axis machining setup and sampled build orientations, we define a Pareto optimality criterion based on the total support volume and the "secluded" support volume defined as the support volume that is not accessible by a given set of machining tools. Since total support volume mainly depends on the build orientation and the secluded volume is dictated by the machining setup, in many cases the two objectives are competing and their trade off needs to be taken into account. The accessibility analysis relies on the inaccessibility measure field (IMF), which is a continuous field in the Euclidean space that quantifies the inaccessibility of each point given a collection of tools and fixturing devices. The value of IMF at each point indicates the minimum possible volumetric collision between objects in relative motion including the part, fixtures, and the tools, over all possible tool orientations and sharp points on the tool. We also propose an automated support removal planning algorithm based on IMF, where a sequence of actions are provided in terms of the fixturing devices, cutting tools, and tool orientation at each step. In our approach, each step is chosen based on the maximal removable volume to iteratively remove accessible supports. The effectiveness of the proposed approach is demonstrated through benchmark examples in 2D and realistic examples in 3D.


Space Time Tradeoffs for Answering Boolean Conjunctive Queries. In this paper, we investigate space time tradeoffs for answering boolean conjunctive queries. The goal is to create a data structure in an initial preprocessing phase and use it for answering (multiple) queries. Previous work has developed data structures that trade off space usage for answering time and has proved conditional space lower bounds for queries of practical interest such as the path and triangle query. However, most of these results cater to only those queries, lack a comprehensive framework, and are not generalizable. The isolated treatment of these queries also fails to utilize the connections with extensive research on related problems within the database community. The key insight in this work is to exploit the formalism of relational algebra by casting the problems as answering join queries over a relational database. Using the notion of boolean em adorned queries and em access patterns , we propose a unified framework that captures several widely studied algorithmic problems. Our main contribution is three fold. First, we present an algorithm that recovers existing space time tradeoffs for several problems. The algorithm is based on an application of the em join size bound to capture the space usage of our data structure. We combine our data structure with em query decomposition techniques to further improve the tradeoffs and show that it is readily extensible to queries with negation. Second, we falsify two conjectures proposed in the existing literature that relates to the space time lower bound for path queries and triangle detection by proposing an unexpectedly better algorithm. This result opens a new avenue for improving several algorithmic results that have so far been assumed to be (conditionally) optimal. Finally, we prove new conditional space time lower bounds for star and path queries.


Enhanced Audit Techniques Empowered by the Reinforcement Learning Pertaining to IFRS 16 Lease. The purpose of accounting audit is to have clear understanding on the financial activities of a company, which can be enhanced by machine learning or reinforcement learning as numeric analysis better than manual analysis can be made. For the purpose of assessment on the relevance, completeness and accuracy of the information produced by entity pertaining to the newly implemented International Financial Reporting Standard 16 Lease (IFRS 16) is one of such candidates as its characteristic of requiring the understanding on the nature of contracts and its complete analysis from listing up without omission, which can be enhanced by the digitalization of contracts for the purpose of creating the lists, still leaving the need of auditing cash flows of companies for the possible omission due to the potential error at the stage of data collection, especially for entities with various short or middle term business sites and related leases, such as construction entities. The implementation of the reinforcement learning and its well known code is to be made for the purpose of drawing the possibility and utilizability of interpreters from domain knowledge to numerical system, also can be called 'gamification interpreter' or 'numericalization interpreter' which can be referred or compared to the extrapolation with nondimensional numbers, such as Froude Number, in physics, which was a source of inspiration at this study. Studies on the interpreters can be able to empower the utilizability of artificial general intelligence in domain and commercial area.


Low threshold induced side scattering instability in the edge transport barrier at O mode ECRH experiments in magnetic fusion devices. The lower hybrid wave trapping in a tokamak edge transport barrier is predicted. This effect makes possible excitation of the low power threshold absolute parametric decay instability leading to side scattering of the ordinary microwave pump in the electron cyclotron resonance heating experiments. The instability can result in broadening of the power deposition profile both in present day machines and in ITER.


JIZHI A Fast and Cost Effective Model As A Service System for Web Scale Online Inference at Baidu. In modern internet industries, deep learning based recommender systems have became an indispensable building block for a wide spectrum of applications, such as search engine, news feed, and short video clips. However, it remains challenging to carry the well trained deep models for online real time inference serving, with respect to the time varying web scale traffics from billions of users, in a cost effective manner. In this work, we present JIZHI a Model as a Service system that per second handles hundreds of millions of online inference requests to huge deep models with more than trillions of sparse parameters, for over twenty real time recommendation services at Baidu, Inc. In JIZHI, the inference workflow of every recommendation request is transformed to a Staged Event Driven Pipeline (SEDP), where each node in the pipeline refers to a staged computation or I O intensive task processor. With traffics of real time inference requests arrived, each modularized processor can be run in a fully asynchronized way and managed separately. Besides, JIZHI introduces heterogeneous and hierarchical storage to further accelerate the online inference process by reducing unnecessary computations and potential data access latency induced by ultra sparse model parameters. Moreover, an intelligent resource manager has been deployed to maximize the throughput of JIZHI over the shared infrastructure by searching the optimal resource allocation plan from historical logs and fine tuning the load shedding policies over intermediate system feedback. Extensive experiments have been done to demonstrate the advantages of JIZHI from the perspectives of end to end service latency, system wide throughput, and resource consumption. JIZHI has helped Baidu saved more than ten million US dollars in hardware and utility costs while handling 200 more traffics without sacrificing inference efficiency.


Exploiting Features with Split and Share Module. Deep convolutional neural networks (CNNs) have shown state of the art performances in various computer vision tasks. Advances on CNN architectures have focused mainly on designing convolutional blocks of the feature extractors, but less on the classifiers that exploit extracted features. In this work, we propose Split and Share Module (SSM),a classifier that splits a given feature into parts, which are partially shared by multiple sub classifiers. Our intuition is that the more the features are shared, the more common they will become, and SSM can encourage such structural characteristics in the split features. SSM can be easily integrated into any architecture without bells and whistles. We have extensively validated the efficacy of SSM on ImageNet 1K classification task, andSSM has shown consistent and significant improvements over baseline architectures. In addition, we analyze the effect of SSM using the Grad CAM visualization.


White Paper Objectionable Online Content What is harmful, to whom, and why. This White Paper summarizes the authors' discussion regarding objectionable content for the University of Houston (UH) Research Team to outline a strategy for building an extensive repository of online videos to support research into automated multimodal approaches to detect objectionable content. The workshop focused on defining what harmful content is, to whom it is harmful, and why it is harmful.


Towards a Model to Appraise and Suggest Identifier Names. Unknowingly, identifiers in the source code of a software system play a vital role in determining the quality of the system. Ambiguous and confusing identifier names lead developers to not only misunderstand the behavior of the code but also increases comprehension time and thereby causes a loss in productivity. Even though correcting poor names through rename operations is a viable option for solving this problem, renaming itself is an act of rework and is not immune to defect injection. In this study, we aim to understand the motivations that drive developers to name and rename identifiers and the decisions they make in determining the name. Using our results, we propose the development of a linguistic model that determines identifier names based on the behavior of the identifier. As a prerequisite to constructing the model, we conduct multiple studies to determine the features that should feed into the model. In this paper, we discuss findings from our completed studies and justify the continuation of research on this topic through further studies.


Polynomial XL A Variant of the XL Algorithm Using Macaulay Matrices over Polynomial Rings. Solving a system of m multivariate quadratic equations in n variables (the mathcal MQ problem) is one of the main challenges of algebraic cryptanalysis. The XL algorithm (XL for short) is a major approach for solving the mathcal MQ problem with linearization over a coefficient field. Furthermore, the hybrid approach with XL (h XL) is a variant of XL guessing some variables beforehand. In this paper, we present a variant of h XL, which we call the polynomial XL (PXL). In PXL, the whole n variables are divided into k variables to be fixed and the remaining n k variables as "main variables", and we generate the Macaulay matrix with respect to the n k main variables over a polynomial ring of the k variables. By eliminating some columns of the Macaulay matrix over the polynomial ring before guessing k variables, the amount of manipulations required for each guessed value can be reduced. Our complexity analysis indicates that PXL is efficient on the system with n approx m . For example, on systems over mathbb F 2 8 with n m 80 , the number of manipulations required by the hybrid approaches with XL and Wiedemann XL and PXL is estimated as 2 252 , 2 234 , and 2 220 , respectively.


A proof of the Multiplicative 1 2 3 Conjecture. We prove that the product version of the 1 2 3 Conjecture, raised by Skowronek Kazi 'o w in 2012, is true. Namely, for every connected graph with order at least 3, we prove that we can assign labels 1,2,3 to the edges in such a way that no two adjacent vertices are incident to the same product of labels.


Justifying Groups in Multiwinner Approval Voting. Justified representation (JR) is a standard notion of representation in multiwinner approval voting. Not only does a JR committee always exist, but previous work has also shown through experiments that the JR condition can typically be fulfilled by groups of fewer than k candidates. In this paper, we study such groups known as n k justifying groups both theoretically and empirically. First, we show that under the impartial culture model, n k justifying groups of size less than k 2 are likely to exist, which implies that the number of JR committees is usually large. We then present efficient approximation algorithms that compute a small n k justifying group for any given instance, and a polynomial time exact algorithm when the instance admits a tree representation. In addition, we demonstrate that small n k justifying groups can often be useful for obtaining a gender balanced JR committee even though the problem is NP hard.


Fine with "1234"? An Analysis of SMS One Time Password Randomness in Android Apps. A fundamental premise of SMS One Time Password (OTP) is that the used pseudo random numbers (PRNs) are uniquely unpredictable for each login session. Hence, the process of generating PRNs is the most critical step in the OTP authentication. An improper implementation of the pseudo random number generator (PRNG) will result in predictable or even static OTP values, making them vulnerable to potential attacks. In this paper, we present a vulnerability study against PRNGs implemented for Android apps. A key challenge is that PRNGs are typically implemented on the server side, and thus the source code is not accessible. To resolve this issue, we build an analysis tool, sysname, to assess implementations of the PRNGs in an automated manner without the source code requirement. Through reverse engineering, sysname identifies the apps using SMS OTP and triggers each app's login functionality to retrieve OTP values. It further assesses the randomness of the OTP values to identify vulnerable PRNGs. By analyzing 6,431 commercially used Android apps downloaded from tool Google Play and tool Tencent Myapp , sysname identified 399 vulnerable apps that generate predictable OTP values. Even worse, 194 vulnerable apps use the OTP authentication alone without any additional security mechanisms, leading to insecure authentication against guessing attacks and replay attacks.


On Star Expressions and Coalgebraic Completeness Theorems. An open problem posed by Milner asks for a proof that a certain axiomatisation, which Milner showed is sound with respect to bisimilarity for regular expressions, is also complete. One of the main difficulties of the problem is the lack of a full Kleene theorem, since there are automata that can not be specified, up to bisimilarity, by an expression. Grabmayer and Fokkink (2020) characterise those automata that can be expressed by regular expressions without the constant 1, and use this characterisation to give a positive answer to Milner's question for this subset of expressions. In this paper, we analyse Grabmayer and Fokkink's proof of completeness from the perspective of universal coalgebra, and thereby give an abstract account of their proof method. We then compare this proof method to another approach to completeness proofs from coalgebraic language theory. This culminates in two abstract proof methods for completeness, what we call the local and global approaches, and a description of when one method can be used in place of the other.


House GAN Generative Adversarial Layout Refinement Networks. This paper proposes a novel generative adversarial layout refinement network for automated floorplan generation. Our architecture is an integration of a graph constrained relational GAN and a conditional GAN, where a previously generated layout becomes the next input constraint, enabling iterative refinement. A surprising discovery of our research is that a simple non iterative training process, dubbed component wise GT conditioning, is effective in learning such a generator. The iterative generator also creates a new opportunity in further improving a metric of choice via meta optimization techniques by controlling when to pass which input constraints during iterative layout refinement. Our qualitative and quantitative evaluation based on the three standard metrics demonstrate that the proposed system makes significant improvements over the current state of the art, even competitive against the ground truth floorplans, designed by professional architects.


A Stochastic Variance Reduction Algorithm with Bregman Distances for Structured Composite Problems. We develop a novel stochastic primal dual splitting method with Bregman distances for solving a structured composite problems involving infimal convolutions in non Euclidean spaces. The sublinear convergence in expectation of the primal dual gap is proved under mild conditions on stepsize for the general case. The linear convergence rate is obtained under additional condition like the strong convexity relative to Bregman functions.


A hyperparameter tuning approach to automated inverse planning. Radiotherapy inverse planning often requires planners to modify parameters in the treatment planning system's objective function to produce clinically acceptable plans. Due to the manual steps in this process, plan quality can vary depending on the planning time available and the planner's skills. This study investigates two hyperparameter tuning methods for automated inverse planning. Because this framework does not train a model on previously optimized plans, it can be readily adapted to practice pattern changes, and plan quality is not limited by that of a training cohort. We selected 10 patients who received lung SBRT using manually generated clinical plans. We used random sampling (RS) and Bayesian optimization (BO) to tune parameters using linear quadratic utility functions based on 11 clinical goals. Normalizing all plans to have PTV D95 equal to 48 Gy, we compared plan quality for the automatically generated and manually generated plans. We also investigated the impact of iteration count on the automatically generated plans, comparing planning time and plan utility for RS and BO plans with and without stopping criteria. Without stopping criteria, the median planning time was 1.9 and 2.3 hours for RS and BO plans. The OAR doses in the RS and BO plans had a median percent difference (MPD) of 48.7 and 60.4 below clinical dose limits and an MPD of 2.8 and 3.3 below clinical plan doses. With stopping criteria, the utility decreased by an MPD of 5.3 and 3.9 for RS and BO plans, but the median planning time was reduced to 0.5 and 0.7 hours, and the OAR doses still had an MPD of 42.9 and 49.7 below clinical dose limits and an MPD of 0.3 and 1.8 below clinical plan doses. This study demonstrates that hyperparameter tuning approaches to automated inverse planning can reduce active planning time with plan quality that is similar to or better than manually generated plans.


Waveguide Integrated Mid Infrared Photodetection using Graphene on a Scalable Chalcogenide Glass Platform. The development of compact and fieldable mid infrared (mid IR) spectroscopy devices represents a critical challenge for distributed sensing with applications from gas leak detection to environmental monitoring. Recent work has focused on mid IR photonic integrated circuit (PIC) sensing platforms and waveguide integrated mid IR light sources and detectors based on semiconductors such as PbTe, black phosphorus and tellurene. However, material bandgaps and reliance on SiO 2 substrates limit operation to wavelengths lambda lesssim4 , mu textrm m . Here we overcome these challenges with a chalcogenide glass on CaF 2 PIC architecture incorporating split gate photothermoelectric graphene photodetectors. Our design extends operation to lambda 5.2 , mu textrm m with a Johnson noise limited noise equivalent power of 1.1 , mathrm nW mathrm Hz 1 2 , no fall off in photoresponse up to f 1 , mathrm MHz , and a predicted 3 dB bandwidth of f 3 textrm dB 1 , mathrm GHz . This mid IR PIC platform readily extends to longer wavelengths and opens the door to applications from distributed gas sensing and portable dual comb spectroscopy to weather resilient free space optical communications.


Beating Betz' Law A larger fundamental upper bound for wind energy harvesting. Betz' law, purportedly, says an ideal wind harvester cannot extract more than 16 27 ( sim 59 ) of the wind energy. As the law's derivation relies on momentum and energy conservation with incompressible flow and not the mechanical mechanism coupling the wind field to the extraction of work it is ubiquitously regarded as a universal upper bound on efficiency, as inclusion of mechanics, aerodynamics and thermodynamics are presumed to worsen this limit. Here we show that when unneeded assumptions in the Betz' law derivation are relaxed a higher limit 2 3 ( sim 67 ) can be achieved. A concrete example, implemented with the same energy and momentum conservation laws used to derive the Betz law is given, achieving the higher 2 3 limit. Thus Betz law is not a universal limit on wind energy harvesting efficiency. More surprisingly, we show Betz law is not simply the limit case of a thin turbine either. Radial flow has been considered previously as a consequence of including angular moment, Sharpe,2004 but here we showed that allowing any lateral flux emission out of the harvester cross section increases the efficiency without any need to consider angular momentum or explicit 2 D models. A key design insight for high load harvesters is to strive for the least pressure build up (to increase flux) the exact opposite of the Betz model's sole operational principle of high pressure differentials. Additionally, we derive an alternative metric of harvester efficiency which takes into account the downstream wake expansion ignored by the conventional definition of power conversion factors, and the resulting upper bound this places on power extraction from dense grids of harvesters.


Local limit of sparse random planar graphs. Let P(n,m) be a graph chosen uniformly at random from the class of all planar graphs on vertex set left 1, ldots, n right with m m(n) edges. We determine the (Benjamini Schramm) local weak limit of P(n,m) in the sparse regime when m leq n o left(n left( log n right) 2 3 right) . Assuming that the average degree 2m n tends to a constant c in 0,2 the local weak limit of P(n,m) is a Galton Watson tree with offspring distribution Po(c) if c leq 1 , while it is the Skeleton tree if c 2 . Furthermore, there is a smooth transition between these two cases in the sense that the local weak limit of P(n,m) is a linear combination of a Galton Watson tree and the Skeleton tree if c in left(1,2 right) .


Text to Table A New Way of Information Extraction. We study a new problem setting of information extraction (IE), referred to as text to table. In text to table, given a text, one creates a table or several tables expressing the main content of the text, while the model is learned from text table pair data. The problem setting differs from those of the existing methods for IE. First, the extraction can be carried out from long texts to large tables with complex structures. Second, the extraction is entirely data driven, and there is no need to explicitly define the schemas. As far as we know, there has been no previous work that studies the problem. In this work, we formalize text to table as a sequence to sequence (seq2seq) problem. We first employ a seq2seq model fine tuned from a pre trained language model to perform the task. We also develop a new method within the seq2seq approach, exploiting two additional techniques in table generation table constraint and table relation embeddings. We consider text to table as an inverse problem of the well studied table to text, and make use of four existing table to text datasets in our experiments on text to table. Experimental results show that the vanilla seq2seq model can outperform the baseline methods of using relation extraction and named entity extraction. The results also show that our method can further boost the performances of the vanilla seq2seq model. We further discuss the main challenges of the proposed task. The code and data are available at https github.com shirley wu text to table.


On The Limiting Distribution of Free Path Lengths for Flat Surfaces with Circular Obstacles. In this note, we prove the existence of a limiting distribution of the free path lengths on flat surfaces with circular obstacles as the radius of the obstacles goes to zero. Moreover, we relate this distribution to the distribution of the heights of zippered rectangle decompositions of flat surfaces.


Convolutional neural networks for fluid flow analysis toward effective metamodeling and low dimensionalization. We focus on a convolutional neural network (CNN), which has recently been utilized for fluid flow analyses, from the perspective on the influence of various operations inside it by considering some canonical regression problems with fluid flow data. We consider two types of CNN based fluid flow analyses 1. CNN metamodeling and 2. CNN autoencoder. For the first type of CNN with additional scalar inputs, which is one of the common forms of CNN for fluid flow analysis, we investigate the influence of input placements in the CNN training pipeline. As an example, estimation of force coefficients of an inclined flat plate and two side by side cylinders in laminar flows is considered. We find that care should be taken for the placement of additional scalar inputs depending on the problem setting and the complexity of flows that users handle. We then discuss the influence of various parameters and operations on the CNN performance, with the utilization of autoencoder (AE). A two dimensional turbulence is considered for the demonstration of AE. The results of AE highly rely on the decaying nature. Investigation on the influence of padding operation at a convolutional layer is also performed. The zero padding shows reasonable ability compared to other methods which account for the boundary conditions assumed in the numerical data. Moreover, the effect of the dimensional reduction extension methods inside CNN is also examined. The CNN model is robust against the difference in dimension reduction operations, while it is sensitive to the dimensional extension methods. The findings of this paper will help us better design a CNN architecture for practical fluid flow analysis


Synthetic Data for Model Selection. Recent improvements in synthetic data generation make it possible to produce images that are highly photorealistic and indistinguishable from real ones. Furthermore, synthetic generation pipelines have the potential to generate an unlimited number of images. The combination of high photorealism and scale turn the synthetic data into a promising candidate for potentially improving various machine learning (ML) pipelines. Thus far, a large body of research in this field has focused on using synthetic images for training, by augmenting and enlarging training data. In contrast to using synthetic data for training, in this work we explore whether synthetic data can be beneficial for model selection. Considering the task of image classification, we demonstrate that when data is scarce, synthetic data can be used to replace the held out validation set, thus allowing to train on a larger dataset.


Boundedness of non local operators with spatially dependent coefficients and L p estimates for non local equations. We prove the boundedness of the non local operator mathcal L a u(x) int mathbb R d left(u(x y) u(x) chi alpha(y) big( nabla u(x),y big) right) a(x,y) frac dy y d alpha from H p,w alpha( mathbb R d) to L p,w ( mathbb R d) for the whole range of p in (1, infty) , where w is a Muckenhoupt weight. The coefficient a(x,y) is bounded, merely measurable in y , and H " o lder continuous in x with an arbitrarily small exponent. We extend the previous results by removing the largeness assumption on p as well as considering weighted spaces with Muckenhoupt weights. Using the boundedness result, we prove the unique solvability in L p spaces of the corresponding parabolic and elliptic non local equations.


A Logic based Multi agent System for Ethical Monitoring and Evaluation of Dialogues. Dialogue Systems are tools designed for various practical purposes concerning human machine interaction. These systems should be built on ethical foundations because their behavior may heavily influence a user (think especially about children). The primary objective of this paper is to present the architecture and prototype implementation of a Multi Agent System (MAS) designed for ethical monitoring and evaluation of a dialogue system. A prototype application, for monitoring and evaluation of chatting agents' (human artificial) ethical behavior in an online customer service chat point w.r.t their institution company's codes of ethics and conduct, is developed and presented. Future work and open issues with this research are discussed.


Influential groups for seeding and sustaining nonlinear contagion in heterogeneous hypergraphs. Several biological and social contagion phenomena, such as superspreading events or social reinforcement, are the results of multi body interactions, for which hypergraphs offer a natural mathematical description. In this paper, we develop a novel mathematical framework based on approximate master equations to study contagions on random hypergraphs with a heterogeneous structure, both in terms of group size (hyperedge cardinality) and of membership of nodes to groups (hyperdegree). The characterization of the inner dynamics of groups provides an accurate description of the contagion process, without losing the analytical tractability. Using a contagion model where multi body interactions are mapped onto a nonlinear infection rate, our two main results show how large groups are influential, in the sense that they drive both the early spread of a contagion and its endemic state (i.e., its stationary state). First, we provide a detailed characterization of the phase transition, which can be continuous or discontinuous with a bistable regime, and derive analytical expressions for the critical and tricritical points. We find that large values of the third moment of the membership distribution suppress the emergence of a discontinuous phase transition. Furthermore, the combination of heterogeneous group sizes and nonlinear contagion facilitates the onset of a mesoscopic localization phase, where contagion is sustained only by the largest groups, thereby inhibiting bistability as well. Second, we formulate the problem of optimal seeding for hypergraph contagion, and we compare two strategies tuning the allocation of seeds according to either individual node or group properties. We find that, when the contagion is sufficiently nonlinear, groups are more effective seeds of contagion than individual nodes.


Imagine Networks. In this paper, we introduce an imagine network that can simulate itself through artificial association networks. Association, deduction, and memory networks are learned, and a network is created by combining the discriminator and reinforcement learning models. This model can learn various datasets or data samples generated in environments and generate new data samples.


GuideBoot Guided Bootstrap for Deep Contextual Bandits. The exploration exploitation (E E) dilemma lies at the core of interactive systems such as online advertising, for which contextual bandit algorithms have been proposed. Bayesian approaches provide guided exploration with principled uncertainty estimation, but the applicability is often limited due to over simplified assumptions. Non Bayesian bootstrap methods, on the other hand, can apply to complex problems by using deep reward models, but lacks clear guidance to the exploration behavior. It still remains largely unsolved to develop a practical method for complex deep contextual bandits. In this paper, we introduce Guided Bootstrap (GuideBoot for short), combining the best of both worlds. GuideBoot provides explicit guidance to the exploration behavior by training multiple models over both real samples and noisy samples with fake labels, where the noise is added according to the predictive uncertainty. The proposed method is efficient as it can make decisions on the fly by utilizing only one randomly chosen model, but is also effective as we show that it can be viewed as a non Bayesian approximation of Thompson sampling. Moreover, we extend it to an online version that can learn solely from streaming data, which is favored in real applications. Extensive experiments on both synthetic task and large scale advertising environments show that GuideBoot achieves significant improvements against previous state of the art methods.


Analysis of COVID 19 in Japan with Extended SEIR model and ensemble Kalman filter. We introduce an extended SEIR infectious disease model with data assimilation for the study of the spread of COVID 19. In this framework, undetected asymptomatic and pre symptomatic cases are taken into account, and the impact of their uncertain proportion is fully investigated. The standard SEIR model does not consider these populations, while their role in the propagation of the disease is acknowledged. An ensemble Kalman filter is implemented to assimilate reliable observations of three compartments in the model. The system tracks the evolution of the effective reproduction number and estimates the unobservable subpopulations. The analysis is carried out for three main prefectures of Japan and for the entire population of Japan. For these four populations, our estimated effective reproduction numbers are more stable than the corresponding ones estimated by a different method (Toyokeizai). We also perform sensitivity tests for different values of some uncertain medical parameters, like the relative infectivity of symptomatic asymptomatic cases. The regional analysis results suggest the decreasing efficiency of the states of emergency.


Decentralized optimization with non identical sampling in presence of stragglers. We consider decentralized consensus optimization when workers sample data from non identical distributions and perform variable amounts of work due to slow nodes known as stragglers. The problem of non identical distributions and the problem of variable amount of work have been previously studied separately. In our work we analyze them together under a unified system model. We study the convergence of the optimization algorithm when combining worker outputs under two heuristic methods (1) weighting equally, and (2) weighting by the amount of work completed by each. We prove convergence of the two methods under perfect consensus, assuming straggler statistics are independent and identical across all workers for all iterations. Our numerical results show that under approximate consensus the second method outperforms the first method for both convex and non convex objective functions. We make use of the theory on minimum variance unbiased estimator (MVUE) to evaluate the existence of an optimal method for combining worker outputs. While we conclude that neither of the two heuristic methods are optimal, we also show that an optimal method does not exist.


Optimization Based GenQSGD for Federated Edge Learning. Optimal algorithm design for federated learning (FL) remains an open problem. This paper explores the full potential of FL in practical edge computing systems where workers may have different computation and communication capabilities, and quantized intermediate model updates are sent between the server and workers. First, we present a general quantized parallel mini batch stochastic gradient descent (SGD) algorithm for FL, namely GenQSGD, which is parameterized by the number of global iterations, the numbers of local iterations at all workers, and the mini batch size. We also analyze its convergence error for any choice of the algorithm parameters. Then, we optimize the algorithm parameters to minimize the energy cost under the time constraint and convergence error constraint. The optimization problem is a challenging non convex problem with non differentiable constraint functions. We propose an iterative algorithm to obtain a KKT point using advanced optimization techniques. Numerical results demonstrate the significant gains of GenQSGD over existing FL algorithms and reveal the importance of optimally designing FL algorithms.


Heuristics facilitates the evolution of transitive inference and social hierarchy in a large group. Transitive inference (TI) refers to social cognition that facilitates the discernment of unknown relationships between individuals using known relationships. It is extensively reported that TI evolves in animals living in a large group because TI could assess relative rank without deducing all dyadic relationships, which averts costly fights.The relationships in a large group become so complex that social cognition may not be developed adequately to handle such complexity. If all group members apply TI to all possible members in the group, TI is supposed to require extremely highly developed cognitive abilities especially in a large group. Instead of developing cognitive abilities significantly, animals may apply simplified TI we call reference TI in this study as heuristic approaches. The reference TI allows members to recognize and remember social interactions only among a set of reference members rather than all potential members. Our study assumes that information processes in the reference TI comprises 1) the number of reference members based on which individuals infer transitively, 2) the number of reference members shared by the same strategists, and 3) memory capacity. We examined how information processes evolve in a large group using evolutionary simulations in the hawk dove game. Information processes with almost any numbers of reference members could evolve in a large group as long as the numbers of shared reference member are high because information from the others' experiences is shared. TI dominates immediate inference, which assesses relative rank on direct interactions, because TI could establish social hierarchy more rapidly applying information from others' experiences.


Learning Graph Embeddings for Compositional Zero shot Learning. In compositional zero shot learning, the goal is to recognize unseen compositions (e.g. old dog) of observed visual primitives states (e.g. old, cute) and objects (e.g. car, dog) in the training set. This is challenging because the same state can for example alter the visual appearance of a dog drastically differently from a car. As a solution, we propose a novel graph formulation called Compositional Graph Embedding (CGE) that learns image features, compositional classifiers, and latent representations of visual primitives in an end to end manner. The key to our approach is exploiting the dependency between states, objects, and their compositions within a graph structure to enforce the relevant knowledge transfer from seen to unseen compositions. By learning a joint compatibility that encodes semantics between concepts, our model allows for generalization to unseen compositions without relying on an external knowledge base like WordNet. We show that in the challenging generalized compositional zero shot setting our CGE significantly outperforms the state of the art on MIT States and UT Zappos. We also propose a new benchmark for this task based on the recent GQA dataset. Code is available at https github.com ExplainableML czsl


Regstar Efficient Strategy Synthesis for Adversarial Patrolling Games. We design a new efficient strategy synthesis method applicable to adversarial patrolling problems on graphs with arbitrary length edges and possibly imperfect intrusion detection. The core ingredient is an efficient algorithm for computing the value and the gradient of a function assigning to every strategy its "protection" achieved. This allows for designing an efficient strategy improvement algorithm by differentiable programming and optimization techniques. Our method is the first one applicable to real world patrolling graphs of reasonable sizes. It outperforms the state of the art strategy synthesis algorithm by a margin.


A Method to Reveal Speaker Identity in Distributed ASR Training, and How to Counter It. End to end Automatic Speech Recognition (ASR) models are commonly trained over spoken utterances using optimization methods like Stochastic Gradient Descent (SGD). In distributed settings like Federated Learning, model training requires transmission of gradients over a network. In this work, we design the first method for revealing the identity of the speaker of a training utterance with access only to a gradient. We propose Hessian Free Gradients Matching, an input reconstruction technique that operates without second derivatives of the loss function (required in prior works), which can be expensive to compute. We show the effectiveness of our method using the DeepSpeech model architecture, demonstrating that it is possible to reveal the speaker's identity with 34 top 1 accuracy (51 top 5 accuracy) on the LibriSpeech dataset. Further, we study the effect of two well known techniques, Differentially Private SGD and Dropout, on the success of our method. We show that a dropout rate of 0.2 can reduce the speaker identity accuracy to 0 top 1 (0.5 top 5).


A coupled discontinuous Galerkin Finite Volume framework for solving gas dynamics over embedded geometries. We present a computational framework for solving the equations of inviscid gas dynamics using structured grids with embedded geometries. The novelty of the proposed approach is the use of high order discontinuous Galerkin (dG) schemes and a shock capturing Finite Volume (FV) scheme coupled via an hp adaptive mesh refinement ( hp AMR) strategy that offers high order accurate resolution of the embedded geometries. The hp AMR strategy is based on a multi level block structured domain partition in which each level is represented by block structured Cartesian grids and the embedded geometry is represented implicitly by a level set function. The intersection of the embedded geometry with the grids produces the implicitly defined mesh that consists of a collection of regular rectangular cells plus a relatively small number of irregular curved elements in the vicinity of the embedded boundaries. High order quadrature rules for implicitly defined domains enable high order accuracy resolution of the curved elements with a cell merging strategy to address the small cell problem. The hp AMR algorithm treats the system with a second order finite volume scheme at the finest level to dynamically track the evolution of solution discontinuities while using dG schemes at coarser levels to provide high order accuracy in smooth regions of the flow. On the dG levels, the methodology supports different orders of basis functions on different levels. The space discretized governing equations are then advanced explicitly in time using high order Runge Kutta algorithms. Numerical tests are presented for two dimensional and three dimensional problems involving an ideal gas. The results are compared with both analytical solutions and experimental observations and demonstrate that the framework provides high order accuracy for smooth flows and accurately captures solution discontinuities.


Heteroscedastic Temporal Variational Autoencoder For Irregularly Sampled Time Series. Irregularly sampled time series commonly occur in several domains where they present a significant challenge to standard deep learning models. In this paper, we propose a new deep learning framework for probabilistic interpolation of irregularly sampled time series that we call the Heteroscedastic Temporal Variational Autoencoder (HeTVAE). HeTVAE includes a novel input layer to encode information about input observation sparsity, a temporal VAE architecture to propagate uncertainty due to input sparsity, and a heteroscedastic output layer to enable variable uncertainty in output interpolations. Our results show that the proposed architecture is better able to reflect variable uncertainty through time due to sparse and irregular sampling than a range of baseline and traditional models, as well as recently proposed deep latent variable models that use homoscedastic output layers.


q-bio.CB math.DS physics.bio-ph q-bio.TO

Global cell cell communication enables spatial segregation of cells in organoids of the inner cell mass. During development, cell fates are determined through a combination of intracellular transcriptional regulations and extracellular signaling. As a result, spatial patterns of different cell types arise. We investigate the decision between epiblast and primitive endoderm cells in the inner cell mass of the preimplantation mouse embryo. Our computational model uses global cell signaling for the pattern formation. By varying the signal dispersion, cell type arrangements ranging from a checkerboard to an engulfing pattern can be generated. Pair correlation functions provide a well suited way of characterizing the model output. With these, we established a quantitative comparison between the simulation results and experimental data of inner cell mass organoids. We obtained an astonishing agreement. Thus, our model proves its capability to replicate the cell differentiation patterns, making global signaling a strong contender to explain pattern formation in the preimplantation embryo.


Decentralized Stability Conditions for DC Microgrids Beyond Passivity Approaches. We consider the problem of ensuring stability in a DC microgrid by means of decentralized conditions. Such conditions are derived which are formulated as input output properties of locally defined subsystems. These follow from various decompositions of the microgrid and corresponding properties of the resulting representations. It is shown that these stability conditions can be combined together by means of appropriate homotopy arguments, thus reducing the conservatism relative to more conventional decentralized approaches that often rely on a passivation of the bus dynamics. Examples are presented to demonstrate the efficiency and the applicability of the results derived.


Boundary regularity for parabolic systems in convex domains. In a cylindrical space time domain with a convex, spatial base, we establish a local Lipschitz estimate for weak solutions to parabolic systems with Uhlenbeck structure up to the lateral boundary, provided homogeneous Dirichlet data are assumed on that part of the lateral boundary.


Rigidity of Euler Products. We report a simple rigidity theorem for certain Euler products.


Bridging the Gap between Events and Frames through Unsupervised Domain Adaptation. Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of robot vision. However, event based vision has been held back by the shortage of labeled datasets due to the novelty of event cameras. To overcome this drawback, we propose a task transfer method to train models directly with labeled images and unlabeled event data. Compared to previous approaches, (i) our method transfers from single images to events instead of high frame rate videos, and (ii) does not rely on paired sensor data. To achieve this, we leverage the generative event model to split event features into content and motion features. This split enables efficient matching between latent spaces for events and images, which is crucial for successful task transfer. Thus, our approach unlocks the vast amount of existing image datasets for the training of event based neural networks. Our task transfer method consistently outperforms methods targeting Unsupervised Domain Adaptation for object detection by 0.26 mAP (increase by 93 ) and classification by 2.7 accuracy.


A comparison principle for the Lane Emden equation and applications to geometric estimates. We prove a comparison principle for positive supersolutions and subsolutions to the Lane Emden equation for the p Laplacian, with subhomogeneous power in the right hand side. The proof uses variational tools and the result applies with no regularity assumptions, both on the set and the functions. We then show that such a comparison principle can be applied to prove uniqueness of solutions sharp pointwise estimates for positive solutions in convex sets localization estimates for maximum points and sharp geometric estimates for generalized principal frequencies in convex sets.


Average Case Communication Complexity of Statistical Problems. We study statistical problems, such as planted clique, its variants, and sparse principal component analysis in the context of average case communication complexity. Our motivation is to understand the statistical computational trade offs in streaming, sketching, and query based models. Communication complexity is the main tool for proving lower bounds in these models, yet many prior results do not hold in an average case setting. We provide a general reduction method that preserves the input distribution for problems involving a random graph or matrix with planted structure. Then, we derive two party and multi party communication lower bounds for detecting or finding planted cliques, bipartite cliques, and related problems. As a consequence, we obtain new bounds on the query complexity in the edge probe, vector matrix vector, matrix vector, linear sketching, and mathbb F 2 sketching models. Many of these results are nearly tight, and we use our techniques to provide simple proofs of some known lower bounds for the edge probe model.


Chromatic convergence for the algebraic K theory of the sphere spectrum. We show that the map from K( mathbb S ) to its chromatic completion is a connective cover and identify the fiber in K theoretic terms. We combine this with recent work of Land Mathew Meier Tamme to prove a form of "Waldhausen's Chromatic Convergence Conjecture" we show that the map K( mathbb S (p) ) (p) to mathop rm holim K(L f n mathbb S ) (p) is the inclusion of a wedge summand.


A series representation of the discrete fractional Laplace operator of arbitrary order. Although fractional powers of non negative operators have received much attention in recent years, there is still little known about their behavior if real valued exponents are greater than one. In this article, we define and study the discrete fractional Laplace operator of arbitrary real valued positive order. A series representation of the discrete fractional Laplace operator for positive non integer powers is developed. Its convergence to a series representation of a known case of positive integer powers is proven as the power tends to the integer value. Furthermore, we show that the new representation for arbitrary real valued positive powers of the discrete Laplace operator is consistent with existing theoretical results.


Coded Gradient Aggregation A Tradeoff Between Communication Costs at Edge Nodes and at Helper Nodes. The increasing amount of data generated at the edge client nodes and the privacy concerns have resulted in learning at the edge, in which the computations are performed at edge devices and are communicated to a central node for updating the model. The edge nodes have low bandwidth and may be available only intermittently. There are helper nodes present in the network that aid the edge nodes in the communication to the server. The edge nodes communicate the local gradient to helper nodes which relay these messages to the central node after possible aggregation. Recently, schemes using repetition codes and maximum distance separable (MDS) codes, respectively known as Aligned MDS Coding (AMC) scheme and Aligend Repetition Coding (ARC) scheme, were proposed. It was observed that in AMC scheme the communication between edge nodes and helper nodes is optimal but with an increased cost of communication between helper and master. An upper bound on the communication cost between helpers and master was obtained. In this paper, a tradeoff between communication costs at edge nodes and helper nodes is established with the help of pyramid codes, a well known class of locally repairable codes. The communication costs at both the helper nodes and edge nodes are exactly characterized. Using the developed technique, the exact communication cost at helper nodes can be computed for the scheme using MDS codes. In the end, we provide two improved aggregation strategies for the existing AMC and ARC schemes, yielding significant reduction in communication cost at helpers, without changing any of the code parameters.


Strain controlled Domain Wall injection into nanowires for sensor applications. We investigate experimentally the effects of externally applied strain on the injection of 180 circ domain walls (DW) from a nucleation pad into magnetic nanowires, as typically used for DW based sensors. In our study the strain, generated by substrate bending, induces in the material a uniaxial anisotropy due to magnetoelastic coupling. To compare the strain effects, Co 40 Fe 40 B 20 , Ni and Ni 82 Fe 18 samples with in plane magnetization and different magnetoelastic coupling are deposited. In these samples, we measure the magnetic field required for the injection of a DW, by imaging differential contrast in a magneto optical Kerr microscope. We find that strain increases the DW injection field, however, the switching mechanism depends strongly on the direction of the strain with respect to the wire axis. We observe that low magnetic anisotropy facilitates the creation of a domain wall at the junction between the pad and the wire, whereas a strain induced magnetic easy axis significantly increases the coercive field of the nucleation pad. Additionally, we find that the effects of mechanical strain can be counteracted by a magnetic uniaxial anisotropy perpendicular to the strain induced easy axis. In Co 40 Fe 40 B 20 , we show that this anisotropy can be induced by annealing in a magnetic field. We perform micromagnetic simulations to support the interpretation of our experimental findings. Our simulations show that the above described observations can be explained by the effective anisotropy in the device. The anisotropy influences the switching mechanism in the nucleation pad as well as the pinning of the DW at the wire entrance. As the DW injection is a key operation for sensor performances, the observations show that strain is imposing a lower limit for the sensor field operating window.


Towards a Theory on Architecting for Continuous Deployment. Context As the adoption of continuous delivery practices increases in software organizations, different scenarios struggle to make it scales for their products in long term evolution. This study looks at the concrete software architecture as a relevant factor for successfully achieving continuous delivery goals. Objective This study aims to understand how the design of software architectures impacts the continuous deployment of their software product. Method We conducted a systematic literature review to identify proper evidence regarding the research objective. We analyzed the selected sources adopting a synthesis and analysis approach based on Grounded Theory. Results We selected 14 primary sources. Through our analysis process, we developed a theory that explains the phenomenon of Architecting for Continuous Deployment. The theory describes three other phenomena that support Architecting for Continuous Deployment Supporting Operations, Continuous Evolution, and Improving Deployability. Furthermore, the theory comprises the following elements contexts, actions and interactions, quality attributes, principles, and effects. We instantiated these elements and identified their interrelationships. The theory is supported by providing bi directional traceability from the selected sources to the elements and vice versa. Conclusions Developing adequate architecture plays a crucial role in enabling continuous delivery. Supporting operations becomes vital to increase the deployability and monitorability of software architecture. These two outcomes require that developers accept responsibility for maintaining the operations. The continuous evolution of the architecture is essential, but it must consider balanced management of technical debt. Finally, improving deployability requires attention to the test strategy and how it affects downtime to enable efficient pipelines.


Universal Captioner Inducing Content Style Separation in Vision and Language Model Training. While captioning models have obtained compelling results in describing natural images, there is a growing effort to increase their capability of dealing with real world concepts. In this paper, we address the task of generating fluent descriptions by training on a non uniform combination of data sources, containing both human and automatically collected captions. To this end, we propose a model which induces a separation between content and descriptive style through the incorporation of stylistic parameters and keywords extracted from large scale multi modal models as pivotal data. In terms of visual features, our model avoids the need of object detectors and employs grid like features together with a single objective of prompt language modeling. Experimentally, we consistently outperform existing methods in terms of caption quality and capability of describing out of domain concepts. Finally, our model obtains a new state of the art on both COCO and nocaps.


Persistence and Ball Exponents for Gaussian Stationary Processes. Consider a real Gaussian stationary process f rho , indexed on either mathbb R or mathbb Z and admitting a spectral measure rho . We study theta rho ell lim limits T to infty frac 1 T log mathbb P left( inf t in 0,T f rho (t) ell right) , the persistence exponent of f rho . We show that, if rho has a positive density at the origin, then the persistence exponent exists moreover, if rho has an absolutely continuous component, then theta rho ell 0 if and only if this spectral density at the origin is finite. We further establish continuity of theta rho ell in ell , in rho (under a suitable metric) and, if rho is compactly supported, also in dense sampling. Analogous continuity properties are shown for psi rho ell lim limits T to infty frac 1 T log mathbb P left( inf t in 0,T f rho (t) le ell right) , the ball exponent of f rho , and it is shown to be positive if and only if rho has an absolutely continuous component.


Multiscale modeling of cancellous bone considering full coupling of mechanical, electrical and magnetic effects. Modeling of cancellous bone has important applications in the detection and treatment of fatigue fractures and diseases like osteoporosis. In this paper, we present a fully coupled multiscale approach considering mechanical, electrical and magnetic effects by using the multiscale finite element method and a two phase material model on the microscale. We show numerical results for both scales, including calculations for a femur bone, comparing a healthy bone to ones affected by different stages of osteoporosis. Here, the magnetic field strength resulting from a small mechanical impact decreases drastically for later stages of the disease, confirming experimental research.


Agent Spaces. Exploration is one of the most important tasks in Reinforcement Learning, but it is not well defined beyond finite problems in the Dynamic Programming paradigm (see Subsection 2.4). We provide a reinterpretation of exploration which can be applied to any online learning method. We come to this definition by approaching exploration from a new direction. After finding that concepts of exploration created to solve simple Markov decision processes with Dynamic Programming are no longer broadly applicable, we reexamine exploration. Instead of extending the ends of dynamic exploration procedures, we extend their means. That is, rather than repeatedly sampling every state action pair possible in a process, we define the act of modifying an agent to itself be explorative. The resulting definition of exploration can be applied in infinite problems and non dynamic learning methods, which the dynamic notion of exploration cannot tolerate. To understand the way that modifications of an agent affect learning, we describe a novel structure on the set of agents a collection of distances (see footnote 7) d a in A , which represent the perspectives of each agent possible in the process. Using these distances, we define a topology and show that many important structures in Reinforcement Learning are well behaved under the topology induced by convergence in the agent space.


Prototypical Cross Attention Networks for Multiple Object Tracking and Segmentation. Multiple object tracking and segmentation requires detecting, tracking, and segmenting objects belonging to a set of given classes. Most approaches only exploit the temporal dimension to address the association problem, while relying on single frame predictions for the segmentation mask itself. We propose Prototypical Cross Attention Network (PCAN), capable of leveraging rich spatio temporal information for online multiple object tracking and segmentation. PCAN first distills a space time memory into a set of prototypes and then employs cross attention to retrieve rich information from the past frames. To segment each object, PCAN adopts a prototypical appearance module to learn a set of contrastive foreground and background prototypes, which are then propagated over time. Extensive experiments demonstrate that PCAN outperforms current video instance tracking and segmentation competition winners on both Youtube VIS and BDD100K datasets, and shows efficacy to both one stage and two stage segmentation frameworks. Code and video resources are available at http vis.xyz pub pcan.


Stability of a Composite Wave of Two Seperate Strong Viscous Shock Waves for 1 D Isentropic Navier Stokes System. In this paper, the large time behavior of solutions of 1 D isentropic Navier Stokes system is investigated. It is shown that a composite wave consisting of two viscous shock waves is stable for the Cauchy problem provided that the two waves are initially far away from each other. Moreover the strengths of two waves could be arbitrarily large.


Grafana plugin for visualising vote based consensus mechanisms, and network P2P overlay networks. In this paper, we present a plugin for visualising vote based consensus mechanisms primarily aimed to help engineers understand and debug blockchain and distributed ledger protocols. Both tools are built as Grafana plugins and make no assumptions on the data storage implementation. The plugins can be configured via Grafana plugin configuration interface to fit the specifics of the protocol implementation.


A New Continuous Optimization Method for Mixed Integer Space Travelling Salesman Problem. The travelling salesman problem (TSP) of space trajectory design is complicated by its complex structure design space. The graph based tree search and stochastic seeding combinatorial approaches are commonly employed to tackle the time dependent TSP due to their combinatorial nature. In this paper, a new continuous optimization strategy for the mixed integer combinatorial problem is proposed. The space trajectory combinatorial problem is tackled using continuous gradient based method. A continuous mapping technique is developed to map the integer type ID of targets on the sequence to a set of continuous design variables. Expected flyby targets are introduced as references and used as priori to select the candidate target to fly by. Bayesian based analysis is employed to model accumulated posterior of the sequence and a new objective function with quadratic form constraints is constructed. The new introduced auxiliary design variables of expected targets together with the original design variables are set to be optimized. A gradient based optimizer is used to search optimal sequence parameter. Performances of the proposed algorithm are demonstrated through a multiple debris rendezvous problem and a static TSP benchmark.


Matlab program method of computing Carleman estimates and applications. In this paper, we introduce a Matlab program method to compute Carleman estimate for the fourth order partial differential operator gamma partial t partial x 4 ( gamma in mathbb R ) . We obtain two kinds of Carleman estimates with different weight functions, i.e. singular weight function and regular weight function, respectively. Based on Carleman estimate with singular weight function, one can obtain the known controllability and observability results for the 1 d fourth order parabolic type equation, while based on Carleman estimate with regular weight function, one can deduce not only the known result on conditional stability in the inverse problem of half order fractional diffusion equation, but also a new result on conditional stability in the inverse problem of half order fractional Schr "odinger equation.


Transductive Learning for Unsupervised Text Style Transfer. Unsupervised style transfer models are mainly based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases. However, the lacking of parallel corpus hinders the ability of these inductive learning methods on this task. As a result, it is likely to cause severe inconsistent style expressions, like the salad is rude . To tackle this problem, we propose a novel transductive learning approach in this paper, based on a retrieval based context aware style representation. Specifically, an attentional encoder decoder with a retriever framework is utilized. It involves top K relevant sentences in the target style in the transfer process. In this way, we can learn a context aware style embedding to alleviate the above inconsistency problem. In this paper, both sparse (BM25) and dense retrieval functions (MIPS) are used, and two objective functions are designed to facilitate joint learning. Experimental results show that our method outperforms several strong baselines. The proposed transductive learning approach is general and effective to the task of unsupervised style transfer, and we will apply it to the other two typical methods in the future.