Weighted Neural Tangent Kernel A Generalized and Improved Network Induced Kernel. The Neural Tangent Kernel (NTK) has recently attracted intense study, as it describes the evolution of an over parameterized Neural Network (NN) trained by gradient descent. However, it is now well known that gradient descent is not always a good optimizer for NNs, which can partially explain the unsatisfactory practical performance of the NTK regression estimator. In this paper, we introduce the Weighted Neural Tangent Kernel (WNTK), a generalized and improved tool, which can capture an over parameterized NN's training dynamics under different optimizers. Theoretically, in the infinite width limit, we prove i) the stability of the WNTK at initialization and during training, and ii) the equivalence between the WNTK regression estimator and the corresponding NN estimator with different learning rates on different parameters. With the proposed weight update algorithm, both empirical and analytical WNTKs outperform the corresponding NTKs in numerical experiments.


Complex Fault Geometry of the 2020 MWW6.5 Monte Cristo Range, Nevada Earthquake Sequence. On 15 May 2020 an MWW 6.5 earthquake occurred beneath the Monte Cristo Range in the Mina Deflection region of western Nevada. Rapid deployment of eight temporary seismic stations enables detailed analysis of its productive and slowly decaying aftershock sequence (p 0.8) which included 18,000 autodetected events in 3.5 months. Double difference, waveform based relative relocation of 16,714 earthquakes reveals a complex network of faults, many of which cross the inferred 35 km long east northeast striking, left lateral mainshock rupture. Seismicity aligns with left lateral, right lateral, and normal mechanism moment tensors of 128 of the largest earthquakes. The mainshock occurred near the middle of the aftershock zone at the intersection of two distinct zones of seismicity. In the western section, numerous subparallel, shallow, north northeast striking faults form a broad flower structure like fault mesh that coalesces at depth into a near vertical, left lateral fault. We infer the near vertical fault to be a region of significant slip in the mainshock and an eastward extension of the left lateral Candelaria fault. Near the mainshock hypocenter, seismicity occurs on a northeast striking, west dipping structure which extends north from the Eastern Columbus Salt Marsh normal fault. Together, these two intersecting structures bound the Columbus Salt Marsh tectonic basin. East of this intersection and the mainshock hypocenter, seismicity occurs in a narrow, near vertical, east northeast striking fault zone through to its eastern terminus. At the eastern end, the aftershock zone broadens and extends northwest towards the southern extension of the northwest striking, right lateral Petrified Springs fault system. The eastern section hosts significantly fewer aftershocks than the western section, but has more moment release.


A Low Cost, Easy to Manufacture, Flexible, Multi Taxel Tactile Sensor and its Application to In Hand Object Recognition. Soft robotics is an emerging field that yields promising results for tasks that require safe and robust interactions with the environment or with humans, such as grasping, manipulation, and human robot interaction. Soft robots rely on intrinsically compliant components and are difficult to equip with traditional, rigid sensors which would interfere with their compliance. We propose a highly flexible tactile sensor that is low cost and easy to manufacture while measuring contact pressures independently from 14 taxels. The sensor is built from piezoresistive fabric for highly sensitive, continuous responses and from a custom designed flexible printed circuit board which provides a high taxel density. From these taxels, location and intensity of contact with the sensor can be inferred. In this paper, we explain the design and manufacturing of the proposed sensor, characterize its input output relation, evaluate its effects on compliance when equipped to the silicone based pneumatic actuators of the soft robotic RBO Hand 2, and demonstrate that the sensor provides rich and useful feedback for learning based in hand object recognition.


Unified Analysis of Discontinuous Galerkin Methods for Frictional Contact Problem with normal compliance. In this article, a reliable and efficient a posteriori error estimator of residual type is derived for a class of discontinuous Galerkin methods for the frictional contact problem with reduced normal compliance which is modeled as a quasi variational inequality. We further derive a priori error estimates in the energy norm under the minimal regularity assumption on the exact solution. The convergence behavior of error over uniform mesh and the performance of error estimator are illustrated by the numerical results.


Isometries of lattices and automorphisms of K3 surfaces. The aim of this paper is to give necessary and sufficient conditions for an integral polynomial to be the characteristic polynomial of a semi simple isometry of some even unimodular lattice of given signature. This result has applications applications to automorphisms of K3 surfaces in particular, we show that every Salem number of degree 4, 6, 8,1 2, 14 or 16 is the dynamical degree of an automorphism of a non projective K3 surface.


Conformational ensembles of intrinsically disordered proteins and flexible multidomain proteins. Intrinsically disordered proteins (IDPs) and multidomain proteins with flexible linkers show a high level of structural heterogeneity and are best described by ensembles consisting of multiple conformations with associated thermodynamic weights. Determining conformational ensembles usually involves integration of biophysical experiments and computational models. In this review, we discuss current approaches to determining conformational ensembles of IDPs and multidomain proteins, including the choice of biophysical experiments, computational models used to sample protein conformations, models to calculate experimental observables from protein structure, and methods to refine ensembles against experimental data. We also provide examples of recent applications of integrative conformational ensemble determination to study IDPs and multidomain proteins and suggest future directions for research in the field.


A Remark on Attractor Bifurcation. In this paper we present some local dynamic bifurcation results in terms of invariant sets of nonlinear evolution equations. We show that if the trivial solution is an isolated invariant set of the system at the critical value lambda lambda 0 , then either there exists a one sided neighborhood I of lambda 0 such that for each lambda in I , the system bifurcates from the trivial solution to an isolated nonempty compact invariant set K lambda with 0 not in K lambda , or there is a one sided neighborhood I of lambda 0 such that the system undergoes an attractor bifurcation for lambda in I from (0, lambda 0) . Then we give a modified version of the attractor bifurcation theorem. Finally, we consider the classical Swift Hohenberg equation and illustrate how to apply our results to a concrete evolution equation.


BERT is to NLP what AlexNet is to CV Can Pre Trained Language Models Identify Analogies?. Analogies play a central role in human commonsense reasoning. The ability to recognize analogies such as "eye is to seeing what ear is to hearing", sometimes referred to as analogical proportions, shape how we structure knowledge and understand language. Surprisingly, however, the task of identifying such analogies has not yet received much attention in the language model era. In this paper, we analyze the capabilities of transformer based language models on this unsupervised task, using benchmarks obtained from educational settings, as well as more commonly used datasets. We find that off the shelf language models can identify analogies to a certain extent, but struggle with abstract and complex relations, and results are highly sensitive to model architecture and hyperparameters. Overall the best results were obtained with GPT 2 and RoBERTa, while configurations using BERT were not able to outperform word embedding models. Our results raise important questions for future work about how, and to what extent, pre trained language models capture knowledge about abstract semantic relations.


Compositions of Digraphs A Survey. In this survey we overview known results on digraph compositions which generalize several classes of digraphs, such as quasi transitive digraphs. After an introductory section, the paper is divided into eight sections connectivity, linkages, kings, kernels, paths, cycles, acyclic spanning subdigraphs, strong spanning subdigraphs. This survey also contains some conjectures and open problems for further study.


Frobenius matrices and a variant of Zolotarev's theorem. In this paper, with the help of the theory of matrices and finite fields we generalize Zolotarev's theorem to an arbitrary finite dimensional vector space over mathbb F q , where mathbb F q denotes the finite field with q elements.


Markov modulated Affine Processes. We study Markov modulated affine processes (abbreviated MMAPs), a class of Markov processes that are created from affine processes by allowing some of their coefficients to be a function of an exogenous Markov process. MMAPs allow for richer models in various applications. At the same time MMAPs largely preserve the tractability of standard affine processes, as their characteristic function has a computationally convenient functional form. Our setup is a substantial generalization of earlier work, since we consider the case where the generator of the exogenous process X is an unbounded operator (as is the case for diffusions or jump processes with infinite activity). We prove existence of MMAPs via a martingale problem approach, we derive the formula for their characteristic function and we study various mathematical properties of MMAPs. The paper closes with a discussion of several applications of MMAPs in finance.


Mean Field Game Theoretic Edge Caching. In this book chapter, we study a problem of distributed content caching in an ultra dense edge caching network (UDCN), in which a large number of small base stations (SBSs) prefetch popular files to cope with the ever growing user demand in 5G and beyond. In a UDCN, even a small misprediction of user demand may render a large amount of prefetched data obsolete. Furtherproacmore, the interference variance is high due to the short inter SBS distances, making it difficult to quantify data downloading rates. Lastly, since the caching decision of each SBS interacts with those of all other SBSs, the problem complexity of exponentially increases with the number of SBSs, which is unfit for UDCNs. To resolve such challenging issues while reflecting time varying and location dependent user demand, we leverage mean field game (MFG) theory through which each SBS interacts only with a single virtual SBS whose state is drawn from the state distribution of the entire SBS population, i.e., mean field (MF) distribution. This MF approximation asymptotically guarantees achieving the epsilon Nash equilibrium as the number of SBSs approaches infinity. To describe such an MFG theoretic caching framework, this chapter aims to provide a brief review of MFG, and demonstrate its effectiveness for UDCNs.


Nonlinear RF Fingerprints Authentication for OFDM Wireless Devices based on Demodulated Symbols. Radio Frequency fingerprints (RFF) authentication is one of the methods for the physical layer information security, which uses the hardware characteristics of the transmitter to identify its real identity. In order to improve the performance of RFF based on preamble with fixed duration, a nonlinear RFF authentication method based on payload symbols is proposed for the wireless OFDM devices with the bit mapping scheme of QPSK. The communication system is modeled as a Hammerstein system containing the nonlinear transmitter and wireless multipath fading channel. A parameter separation technique based on orthogonal polynomial is presented for the estimation of the parameters of the Hammerstein system. The Hammerstein system parameter separation technique is firstly used to estimate the linear parameter with the training signal, which is used to compensate the adverse effect of the linear channel for the demodulation of the successive payload symbols. The demodulated payload symbols are further used to estimate the nonlinear coefficients of the transmitter with the Hammerstein system parameter separation technique again, which is used as the novel RFF for the authentication of the QPSK OFDM devices. Numerical experiments demonstrate that the proposed method is feasible. The novel method can also be extended to the OFDM signals with other bit mapping schemes.


RetaGNN Relational Temporal Attentive Graph Neural Networks for Holistic Sequential Recommendation. Sequential recommendation (SR) is to accurately recommend a list of items for a user based on her current accessed ones. While new coming users continuously arrive in the real world, one crucial task is to have inductive SR that can produce embeddings of users and items without re training. Given user item interactions can be extremely sparse, another critical task is to have transferable SR that can transfer the knowledge derived from one domain with rich data to another domain. In this work, we aim to present the holistic SR that simultaneously accommodates conventional, inductive, and transferable settings. We propose a novel deep learning based model, Relational Temporal Attentive Graph Neural Networks (RetaGNN), for holistic SR. The main idea of RetaGNN is three fold. First, to have inductive and transferable capabilities, we train a relational attentive GNN on the local subgraph extracted from a user item pair, in which the learnable weight matrices are on various relations among users, items, and attributes, rather than nodes or edges. Second, long term and short term temporal patterns of user preferences are encoded by a proposed sequential self attention mechanism. Third, a relation aware regularization term is devised for better training of RetaGNN. Experiments conducted on MovieLens, Instagram, and Book Crossing datasets exhibit that RetaGNN can outperform state of the art methods under conventional, inductive, and transferable settings. The derived attention weights also bring model explainability.


Toward Native Artificial Intelligence in 6G Networks System Design, Architectures, and Paradigms. The mobile communication system has transformed to be the fundamental infrastructure to support digital demands from all industry sectors, and 6G is envisioned to go far beyond the communication only purpose. There is coming to a consensus that 6G will treat Artificial Intelligence (AI) as the cornerstone and has a potential capability to provide "intelligence inclusion", which implies to enable the access of AI services at anytime and anywhere by anyone. Apparently, the intelligent inclusion vision produces far reaching influence on the corresponding network architecture design in 6G and deserves a clean slate rethink. In this article, we propose an end to end system architecture design scope for 6G, and talk about the necessity to incorporate an independent data plane and a novel intelligent plane with particular emphasis on end to end AI workflow orchestration, management and operation. We also highlight the advantages to provision converged connectivity and computing services at the network function plane. Benefiting from these approaches, we believe that 6G will turn to an "everything as a service" (XaaS) platform with significantly enhanced business merits.


Connecting the dots in ethology applying network theory to understand neural and animal collectives. A major goal shared by neuroscience and collective behavior is to understand how dynamic interactions between individual elements give rise to behaviors in populations of neurons and animals, respectively. This goal has recently become within reach thanks to techniques providing access to the connectivity and activity of neuronal ensembles as well as to behaviors among animal collectives. The next challenge using these datasets is to unravel network mechanisms generating population behaviors. This is aided by network theory, a field that studies structure function relationships in interconnected systems. Here we review studies that have taken a network view on modern datasets to provide unique insights into individual and collective animal behaviors. Specifically, we focus on how analyzing signal propagation, controllability, symmetry, and geometry of networks can tame the complexity of collective system dynamics. These studies illustrate the potential of network theory to accelerate our understanding of behavior across ethological scales.


Causal Abstractions of Neural Networks. Structural analysis methods (e.g., probing and feature attribution) are increasingly important tools for neural network analysis. We propose a new structural analysis method grounded in a formal theory of causal abstraction that provides rich characterizations of model internal representations and their roles in input output behavior. In this method, neural representations are aligned with variables in interpretable causal models, and then interchange interventions are used to experimentally verify that the neural representations have the causal properties of their aligned variables. We apply this method in a case study to analyze neural models trained on Multiply Quantified Natural Language Inference (MQNLI) corpus, a highly complex NLI dataset that was constructed with a tree structured natural logic causal model. We discover that a BERT based model with state of the art performance successfully realizes parts of the natural logic model's causal structure, whereas a simpler baseline model fails to show any such structure, demonstrating that BERT representations encode the compositional structure of MQNLI.


Understanding Bounding Functions in Safety Critical UAV Software. Unmanned Aerial Vehicles (UAVs) are an emerging computation platform known for their safety critical need. In this paper, we conduct an empirical study on a widely used open source UAV software framework, Paparazzi, with the goal of understanding the safety critical concerns of UAV software from a bottom up developer in the field perspective. We set our focus on the use of Bounding Functions (BFs), the runtime checks injected by Paparazzi developers on the range of variables. Through an in depth analysis on BFs in the Paparazzi autopilot software, we found a large number of them (109 instances) are used to bound safety critical variables essential to the cyber physical nature of the UAV, such as its thrust, its speed, and its sensor values. The novel contributions of this study are two fold. First, we take a static approach to classify all BF instances, presenting a novel datatype based 5 category taxonomy with fine grained insight on the role of BFs in ensuring the safety of UAV systems. Second, we dynamically evaluate the impact of the BF uses through a differential approach, establishing the UAV behavioral difference with and without BFs. The two pronged static and dynamic approach together illuminates a rarely studied design space of safety critical UAV software systems.


Convergence of Sobolev gradient trajectories to elastica. In this paper we study the H 2(ds) gradient flow for the modified elastic energy defined on closed curves in mathbb R n . We prove the existence of a unique global in time solution to the flow and establish full convergence to elastica by way of a L ojasiewicz Simon gradient inequality.


Enabling SQL based Training Data Debugging for Federated Learning. How can we debug a logistical regression model in a federated learning setting when seeing the model behave unexpectedly (e.g., the model rejects all high income customers' loan applications)? The SQL based training data debugging framework has proved effective to fix this kind of issue in a non federated learning setting. Given an unexpected query result over model predictions, this framework automatically removes the label errors from training data such that the unexpected behavior disappears in the retrained model. In this paper, we enable this powerful framework for federated learning. The key challenge is how to develop a security protocol for federated debugging which is proved to be secure, efficient, and accurate. Achieving this goal requires us to investigate how to seamlessly integrate the techniques from multiple fields (Databases, Machine Learning, and Cybersecurity). We first propose FedRain, which extends Rain, the state of the art SQL based training data debugging framework, to our federated learning setting. We address several technical challenges to make FedRain work and analyze its security guarantee and time complexity. The analysis results show that FedRain falls short in terms of both efficiency and security. To overcome these limitations, we redesign our security protocol and propose Frog, a novel SQL based training data debugging framework tailored for federated learning. Our theoretical analysis shows that Frog is more secure, more accurate, and more efficient than FedRain. We conduct extensive experiments using several real world datasets and a case study. The experimental results are consistent with our theoretical analysis and validate the effectiveness of Frog in practice.


RAFT A Real World Few Shot Text Classification Benchmark. Large pre trained language models have shown promise for few shot learning, completing text based tasks given only a few task specific examples. Will models soon solve classification tasks that have so far been reserved for human research assistants? Existing benchmarks are not designed to measure progress in applied settings, and so don't directly answer this question. The RAFT benchmark (Real world Annotated Few shot Tasks) focuses on naturally occurring tasks and uses an evaluation setup that mirrors deployment. Baseline evaluations on RAFT reveal areas current techniques struggle with reasoning over long texts and tasks with many classes. Human baselines show that some classification tasks are difficult for non expert humans, reflecting that real world value sometimes depends on domain expertise. Yet even non expert human baseline F1 scores exceed GPT 3 by an average of 0.11. The RAFT datasets and leaderboard will track which model improvements translate into real world benefits at https raft.elicit.org .


Learning Generative Vision Transformer with Energy Based Latent Space for Saliency Prediction. Vision transformer networks have shown superiority in many computer vision tasks. In this paper, we take a step further by proposing a novel generative vision transformer with latent variables following an informative energy based prior for salient object detection. Both the vision transformer network and the energy based prior model are jointly trained via Markov chain Monte Carlo based maximum likelihood estimation, in which the sampling from the intractable posterior and prior distributions of the latent variables are performed by Langevin dynamics. Further, with the generative vision transformer, we can easily obtain a pixel wise uncertainty map from an image, which indicates the model confidence in predicting saliency from the image. Different from the existing generative models which define the prior distribution of the latent variables as a simple isotropic Gaussian distribution, our model uses an energy based informative prior which can be more expressive to capture the latent space of the data. We apply the proposed framework to both RGB and RGB D salient object detection tasks. Extensive experimental results show that our framework can achieve not only accurate saliency predictions but also meaningful uncertainty maps that are consistent with the human perception.


SmartScan An approach to detect Denial of Service Vulnerability in Ethereum Smart Contracts. Blockchain technology (BT) Ethereum Smart Contracts allows programmable transactions that involve the transfer of monetary assets among peers on a BT network independent of a central authorizing agency. Ethereum Smart Contracts are programs that are deployed as decentralized applications, having the building blocks of the blockchain consensus protocol. This technology enables consumers to make agreements in a transparent and conflict free environment. However, the security vulnerabilities within these smart contracts are a potential threat to the applications and their consumers and have shown in the past to cause huge financial losses. In this paper, we propose a framework that combines static and dynamic analysis to detect Denial of Service (DoS) vulnerability due to an unexpected revert in Ethereum Smart Contracts. Our framework, SmartScan, statically scans smart contracts under test (SCUTs) to identify patterns that are potentially vulnerable in these SCUTs and then uses dynamic analysis to precisely confirm their exploitability of the DoS Unexpected Revert vulnerability, thus achieving increased performance and more precise results. We evaluated SmartScan on a set of 500 smart contracts collected from the Etherscan. Our approach shows an improvement in precision and recall when compared to available state of the art techniques.


Mean Based Trace Reconstruction over Oblivious Synchronization Channels. Mean based reconstruction is a fundamental, natural approach to worst case trace reconstruction over channels with synchronization errors. It is known that exp(O(n 1 3 )) traces are necessary and sufficient for mean based worst case trace reconstruction over the deletion channel, and this result was also extended to certain channels combining deletions and geometric insertions of uniformly random bits. In this work, we use a simple extension of the original complex analytic approach to show that these results are examples of a much more general phenomenon. We introduce oblivious synchronization channels, which map each input bit to an arbitrarily distributed sequence of replications and insertions of random bits. This general class captures all previously considered synchronization channels. We show that for any oblivious synchronization channel whose output length follows a sub exponential distribution either mean based trace reconstruction is impossible or exp(O(n 1 3 )) traces suffice for this task.


Mapping illegal waste dumping sites with neural network classification of satellite imagery. Public health and habitat quality are crucial goals of urban planning. In recent years, the severe social and environmental impact of illegal waste dumping sites has made them one of the most serious problems faced by cities in the Global South, in a context of scarce information available for decision making. To help identify the location of dumping sites and track their evolution over time we adopt a data driven model from the machine learning domain, analyzing satellite images. This allows us to take advantage of the increasing availability of geo spatial open data, high resolution satellite imagery, and open source tools to train machine learning algorithms with a small set of known waste dumping sites in Buenos Aires, and then predict the location of other sites over vast areas at high speed and low cost. This case study shows the results of a collaboration between Dymaxion Labs and Fundaci 'on Bunge y Born to harness this technique in order to create a comprehensive map of potential locations of illegal waste dumping sites in the region.


Pitfalls of Explainable ML An Industry Perspective. As machine learning (ML) systems take a more prominent and central role in contributing to life impacting decisions, ensuring their trustworthiness and accountability is of utmost importance. Explanations sit at the core of these desirable attributes of a ML system. The emerging field is frequently called Explainable AI (XAI)'' or Explainable ML.'' The goal of explainable ML is to intuitively explain the predictions of a ML system, while adhering to the needs to various stakeholders. Many explanation techniques were developed with contributions from both academia and industry. However, there are several existing challenges that have not garnered enough interest and serve as roadblocks to widespread adoption of explainable ML. In this short paper, we enumerate challenges in explainable ML from an industry perspective. We hope these challenges will serve as promising future research directions, and would contribute to democratizing explainable ML.


Experiences from Using LoRa and IEEE 802.15.4 for IoT enabled Classrooms. Several networking technologies targeting the IoT application space currently compete within the smart city domain, both in outdoor and indoor deployments. However, up till now, there is no clear winner, and results from real world deployments have only recently started to surface. In this paper, we present a comparative study of 2 popular IoT networking technologies, LoRa and IEEE 802.15.4, within the context of a research oriented IoT deployment inside school buildings in Europe, targeting energy efficiency in education. We evaluate the actual performance of these two technologies in real world settings, presenting a comparative study on the effect of parameters like the built environment, network quality, or data rate. Our results indicate that both technologies have their advantages, and while in certain cases both are perfectly adequate, in our use case LoRa exhibits a more robust behavior. Moreover, LoRa's characteristics make it a very good choice for indoor IoT deployments such as in educational buildings, and especially in cases where there are low bandwidth requirements.


Four dimensional hybrid chaos system and its application in creating a secure image transfer environment by cellular automata. One of the most important and practical researches which has been considered by researchers is creating secure environments for information exchanges. Due to their structures, chaos systems are efficient tools in the are of data transferring. In this research, using a mathematical structure such as composing and transferring, we improve classical chaotic systems by creating a four dimensional system. Then we introduce a new encryption algorithm based on the chaos and cellular automata. The security of the proposed environment which is evaluated using different types of security tests shows the efficiency of the proposed algorithm.


Geometry of Linear Convolutional Networks. We study the family of functions that are represented by a linear convolutional neural network (LCN). These functions form a semi algebraic subset of the set of linear maps from input space to output space. In contrast, the families of functions represented by fully connected linear networks form algebraic sets. We observe that the functions represented by LCNs can be identified with polynomials that admit certain factorizations, and we use this perspective to describe the impact of the network's architecture on the geometry of the resulting function space. We further study the optimization of an objective function over an LCN, analyzing critical points in function space and in parameter space, and describing dynamical invariants for gradient descent. Overall, our theory predicts that the optimized parameters of an LCN will often correspond to repeated filters across layers, or filters that can be decomposed as repeated filters. We also conduct numerical and symbolic experiments that illustrate our results and present an in depth analysis of the landscape for small architectures.


Notes on the diameter of the complement of the power graph of a finite group. We determine the diameter of every connected component of the complement of the power graph and the enhanced power graph of a finite group, which completely answers two questions by Peter J. Cameron.


What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition. Dialog acts can be interpreted as the atomic units of a conversation, more fine grained than utterances, characterized by a specific communicative function. The ability to structure a conversational transcript as a sequence of dialog acts dialog act recognition, including the segmentation is critical for understanding dialog. We apply two pre trained transformer models, XLNet and Longformer, to this task in English and achieve strong results on Switchboard Dialog Act and Meeting Recorder Dialog Act corpora with dialog act segmentation error rates (DSER) of 8.4 and 14.2 . To understand the key factors affecting dialog act recognition, we perform a comparative analysis of models trained under different conditions. We find that the inclusion of a broader conversational context helps disambiguate many dialog act classes, especially those infrequent in the training data. The presence of punctuation in the transcripts has a massive effect on the models' performance, and a detailed analysis reveals specific segmentation patterns observed in its absence. Finally, we find that the label set specificity does not affect dialog act segmentation performance. These findings have significant practical implications for spoken language understanding applications that depend heavily on a good quality segmentation being available.


On the chain structure in the de Branges spaces. We study the indivisible intervals and the monotonicity of the growth of the exponential type in the chains of de Branges subspaces in terms of the spectral measure. We prove that for spectral measures supported on mathbb Z , there exist at most two subspaces of the same type, which then bound an indivisible interval. Furthermore, in this case, we study possible locations of the indivisible intervals.


How Developers Choose Names. The names of variables and functions serve as implicit documentation and are instrumental for program comprehension. But choosing good meaningful names is hard. We perform a sequence of experiments in which a total of 334 subjects are required to choose names in given programming scenarios. The first experiment shows that the probability that two developers would select the same name is low in the 47 instances in our experiments the median probability was only 6.9 . At the same time, given that a specific name is chosen, it is usually understood by the majority of developers. Analysis of the names given in the experiment suggests a model where naming is a (not necessarily cognizant or serial) three step process (1) selecting the concepts to include in the name, (2) choosing the words to represent each concept, and (3) constructing a name using these words. A followup experiment, using the same experimental setup, then checked whether using this model explicitly can improve the quality of names. The results were that names selected by subjects using the model were judged by two independent judges to be superior to names chosen in the original experiment by a ratio of two to one. Using the model appears to encourage the use of more concepts and longer names.


A note on visible islands. Given a finite point set P in the plane, a subset S subseteq P is called an island in P if conv(S) cap P S . We say that S subset P is a visible island if the points in S are pairwise visible and S is an island in P . The famous Big line Big clique Conjecture states that for any k geq 3 and ell geq 4 , there is an integer n n(k, ell) , such that every finite set of at least n points in the plane contains ell collinear points or k pairwise visible points. In this paper, we show that this conjecture is false for visible islands, by replacing each point in a Horton set by a triple of collinear points. Hence, there are arbitrarily large finite point sets in the plane with no 4 collinear members and no visible island of size 13 .


Stochastic Binning and Coded Demixing for Unsourced Random Access. Unsourced random access is a novel communication paradigm designed for handling a large number of uncoordinated users that sporadically transmit very short messages. Under this model, coded compressed sensing (CCS) has emerged as a low complexity scheme that exhibits good error performance. Yet, one of the challenges faced by CCS pertains to disentangling a large number of codewords present on a single factor graph. To mitigate this issue, this article introduces a modified CCS scheme whereby active devices stochastically partition themselves into groups that utilize separate sampling matrices with low cross coherence for message transmission. At the receiver, ideas from the field of compressed demixing are employed for support recovery, and separate factor graphs are created for message disambiguation in each cluster. This reduces the number of active users on a factor graph, which improves performance significantly in typical scenarios. Indeed, coded demixing reduces the probability of error as the number of groups increases, up to a point. Findings are supported with numerical simulations.


A Mathematical Approach to Constraining Neural Abstraction and the Mechanisms Needed to Scale to Higher Order Cognition. Artificial intelligence has made great strides in the last decade but still falls short of the human brain, the best known example of intelligence. Not much is known of the neural processes that allow the brain to make the leap to achieve so much from so little beyond its ability to create knowledge structures that can be flexibly and dynamically combined, recombined, and applied in new and novel ways. This paper proposes a mathematical approach using graph theory and spectral graph theory, to hypothesize how to constrain these neural clusters of information based on eigen relationships. This same hypothesis is hierarchically applied to scale up from the smallest to the largest clusters of knowledge that eventually lead to model building and reasoning.


Evanescent affine isometric actions and weak identity excluding groups. We investiguate a property of affine isometric actions on Hilbert spaces called evanescence. Evanescent actions are the extreme opposite of irreducible actions. Every affine isometric action decomposes naturally into an evanescent part and an irreducible part. We study when this decomposition is unique. We also study when an action that has almost fixed points is automatically evanescent. We relate these questions to the identity excluding property for groups. We also relate them to the finiteness of the von Neumann algebras generated by the linear part of the action.


Improved lower bounds for van der Waerden numbers. Recently, Ben Green proved that the two color van der Waerden number w(3,k) is bounded from below by k b 0(k) where b 0(k) c 0 left( frac log k log log k right) 1 3 . We prove a new lower bound of k b(k) with b(k) frac c log k log log k . This is done by modifying Green's argument, replacing a complicated result about random quadratic forms with an elementary probabilistic result.


Generalizing to New Domains by Mapping Natural Language to Lifted LTL. Recent work on using natural language to specify commands to robots has grounded that language to LTL. However, mapping natural language task specifications to LTL task specifications using language models require probability distributions over finite vocabulary. Existing state of the art methods have extended this finite vocabulary to include unseen terms from the input sequence to improve output generalization. However, novel out of vocabulary atomic propositions cannot be generated using these methods. To overcome this, we introduce an intermediate contextual query representation which can be learned from single positive task specification examples, associating a contextual query with an LTL template. We demonstrate that this intermediate representation allows for generalization over unseen object references, assuming accurate groundings are available. We compare our method of mapping natural language task specifications to intermediate contextual queries against state of the art CopyNet models capable of translating natural language to LTL, by evaluating whether correct LTL for manipulation and navigation task specifications can be output, and show that our method outperforms the CopyNet model on unseen object references. We demonstrate that the grounded LTL our method outputs can be used for planning in a simulated OO MDP environment. Finally, we discuss some common failure modes encountered when translating natural language task specifications to grounded LTL.


SpookyNet Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effects. Machine learned force fields (ML FFs) combine the accuracy of ab initio methods with the efficiency of conventional force fields. However, current ML FFs typically ignore electronic degrees of freedom, such as the total charge or spin state, and assume chemical locality, which is problematic when molecules have inconsistent electronic states, or when nonlocal effects play a significant role. This work introduces SpookyNet, a deep neural network for constructing ML FFs with explicit treatment of electronic degrees of freedom and quantum nonlocality. Chemically meaningful inductive biases and analytical corrections built into the network architecture allow it to properly model physical limits. SpookyNet improves upon the current state of the art (or achieves similar performance) on popular quantum chemistry data sets. Notably, it is able to generalize across chemical and conformational space and can leverage the learned chemical insights, e.g. by predicting unknown spin states, thus helping to close a further important remaining gap for today's machine learning models in quantum chemistry.


Two remarks on Merimovich's model of the total failure of GCH. Let M denote the Merimovich's model in which for each infinite cardinal lambda, 2 lambda lambda 3 . We show that in M the following hold (1) Shelah's strong hypothesis fails at all singular cardinals, indeed, forall lambda ( lambda is a singular cardinal Rightarrow pp( lambda) lambda 3 ). (2) For each singular cardinal lambda there is an inner model N of M such that M and N have the same bounded subsets of lambda, lambda is a singular cardinal in N , ( lambda i ) N ( lambda i ) M , for i 1,2,3, and N models 2 lambda lambda . Thus it is possible to add many new fresh subsets to lambda without adding any new bounded subsets to lambda .


One Model to Rule them All Towards Zero Shot Learning for Databases. In this paper, we present our vision of so called zero shot learning for databases which is a new learning approach for database components. Zero shot learning for databases is inspired by recent advances in transfer learning of models such as GPT 3 and can support a new database out of the box without the need to train a new model. Furthermore, it can easily be extended to few shot learning by further retraining the model on the unseen database. As a first concrete contribution in this paper, we show the feasibility of zero shot learning for the task of physical cost estimation and present very promising initial results. Moreover, as a second contribution we discuss the core challenges related to zero shot learning for databases and present a roadmap to extend zero shot learning towards many other tasks beyond cost estimation or even beyond classical database systems and workloads.


Cyclist Intention Detection A Probabilistic Approach. This article presents a holistic approach for probabilistic cyclist intention detection. A basic movement detection based on motion history images (MHI) and a residual convolutional neural network (ResNet) are used to estimate probabilities for the current cyclist motion state. These probabilities are used as weights in a probabilistic ensemble trajectory forecast. The ensemble consists of specialized models, which produce individual forecasts in the form of Gaussian distributions under the assumption of a certain motion state of the cyclist (e.g. cyclist is starting or turning left). By weighting the specialized models, we create forecasts in the from of Gaussian mixtures that define regions within which the cyclists will reside with a certain probability. To evaluate our method, we rate the reliability, sharpness, and positional accuracy of our forecasted distributions. We compare our method to a single model approach which produces forecasts in the form of Gaussian distributions and show that our method is able to produce more reliable and sharper outputs while retaining comparable positional accuracy. Both methods are evaluated using a dataset created at a public traffic intersection. Our code and the dataset are made publicly available.


Habituation Effect in Social Networks as a Potential Factor Silently Crushing Influence Maximisation Efforts. Information spreading processes are a key phenomenon observed within real and digital social networks. Network members are often under pressure from incoming information with different sources, such as informative campaigns for increasing awareness, viral marketing, rumours, fake news, or the results of other activities. Messages are often repeated, and such repetition can improve performance in the form of cumulative influence. Repeated messages may also be ignored due to a limited ability to process information. Learning processes are leading to the repeated messages being ignored, as their content has already been absorbed. In such cases, responsiveness decreases with repetition, and the habituation effect can be observed. Here, we analyse spreading processes while considering the habituation effect and performance drop along with an increased number of contacts. The the ability to recover when reducing the number of messages is also considered. The results show that even low habituation and a decrease in propagation probability may substantially impact network coverage. This can lead to a significant reduction in the potential for a seed set selected with an influence maximisation method. Apart from the impact of the habituation effect on spreading processes, we show how it can be reduced with the use of the sequential seeding approach. This shows that sequential seeding is less sensitive to the habituation effect than single stage seeding, and that it can be used to limit the negative impact on users overloaded with incoming messages.


A Boolean Algebra for Genetic Variants. Beyond identifying genetic variants, we introduce a set of Boolean relations that allows for a comprehensive classification of the relation for every pair of variants by taking all minimal alignments into account. We present an efficient algorithm to compute these relations, including a novel way of efficiently computing all minimal alignments within the best theoretical complexity bounds. We show that for all variants of the CFTR gene in dbSNP these relations are common and many non trivial. Ultimately, we present an approach for the storing and indexing of variants in the context of a database that enables the efficient querying for all these relations.


Contrarians synchronize beyond the limit of pairwise interactions. We give evidence that a population of pure contrarians globally coupled D dimensional Kuramoto oscillators reaches a collective synchronous state when the interplay between the units goes beyond the limit of pairwise interactions. Namely, we will show that the presence of higher order interactions may induce the appearance of a coherent state even when the oscillators are coupled negatively to the mean field. An exact solution for the description of the microscopic dynamics for forward and backward transitions is provided, which entails imperfect symmetry breaking of the population into a frequency locked state featuring two clusters of different instantaneous phases. Our results contribute to a better understanding of the powerful potential of group interactions entailing multi dimensional choices and novel dynamical states in many circumstances, such as in social systems.


Existence of strong solutions for It o's stochastic equations via approximations. Revisited. Given strong uniqueness for an It o's stochastic equation, we prove that its solution can beconstructed on "any" probability space by using, for example, Euler's polygonal approximations. Stochastic equations in mathbb R d and in domains in mathbb R d are considered. This is almost a copy of an old article in which we correct errors in the original proof of Lemma 4.1 found by Martin Dieckmann in 2013. We present also a new result on the convergence of "tamed Euler approximations" for SDEs with locally unbounded drifts, which we achieve by proving an estimate for appropriate exponential moments.


Improving the constant in Nesterov's frac pi 2 theorem. One of the hard optimization problems that has a semi definite relaxation with quantitative bound on the approximation error is the maximization of a convex quadratic form on the hypercube. The relaxation not only yields an upper bound on the optimal value, but its solution can be used to construct random sub optimal solutions of the original problem whose expected value is not less than frac 2 pi times the value of the relaxation. This constant cannot be improved globally. More precisely, for every epsilon 0 there exists a problem instance for which the ratio of the two values in question is larger than frac pi 2 epsilon . However, if a given problem instance is considered, then the relaxation yields a concrete solution which may result in a much better ratio. In this contribution we present an improved, explicit bound depending on the rank of the solution. We consider also the problem of maximization of a convex hermitian quadratic form on the complex poly disc. In this case a bound on the approximation error is given by the frac 4 pi theorem of Ben Tal, Nemirovski, and Roos. The derivation of a rank dependent improved bound is similar to the real case. In the complex case we provide explicit expressions in the form of an infinite series and conjecture a closed form expression.


StreamHover Livestream Transcript Summarization and Annotation. With the explosive growth of livestream broadcasting, there is an urgent need for new summarization technology that enables us to create a preview of streamed content and tap into this wealth of knowledge. However, the problem is nontrivial due to the informal nature of spoken language. Further, there has been a shortage of annotated datasets that are necessary for transcript summarization. In this paper, we present StreamHover, a framework for annotating and summarizing livestream transcripts. With a total of over 500 hours of videos annotated with both extractive and abstractive summaries, our benchmark dataset is significantly larger than currently existing annotated corpora. We explore a neural extractive summarization model that leverages vector quantized variational autoencoder to learn latent vector representations of spoken utterances and identify salient utterances from the transcripts to form summaries. We show that our model generalizes better and improves performance over strong baselines. The results of this study provide an avenue for future research to improve summarization solutions for efficient browsing of livestreams.


Variational Encoders and Autoencoders Information theoretic Inference and Closed form Solutions. This work develops problem statements related to encoders and autoencoders with the goal of elucidating variational formulations and establishing clear connections to information theoretic concepts. Specifically, four problems with varying levels of input are considered a) The data, likelihood and prior distributions are given, b) The data and likelihood are given c) The data and prior are given d) the data and the dimensionality of the parameters is specified. The first two problems seek encoders (or the posterior) and the latter two seek autoencoders (i.e. the posterior and the likelihood). A variational Bayesian setting is pursued, and detailed derivations are provided for the resulting optimization problem. Following this, a linear Gaussian setting is adopted, and closed form solutions are derived. Numerical experiments are also performed to verify expected behavior and assess convergence properties. Explicit connections are made to rate distortion theory, information bottleneck theory, and the related concept of sufficiency of statistics is also explored. One of the motivations of this work is to present the theory and learning dynamics associated with variational inference and autoencoders, and to expose information theoretic concepts from a computational science perspective.


Centrally symmetric analytic plane domains are spectrally determined in this class. We prove that, under some generic non degeneracy assumptions, real analytic, centrally symmetric plane domains are determined by their Dirichlet (resp. Neumann) spectra. We prove that the conditions are open dense for real analytic convex domains. The proof is parallel to the proof that up down symmetric domains are spectrally determined. One step is to use a Maslov index calculation to show that the second derivative of the defining function of a centrally symmetric domain at the endpoints of a bouncing ball orbit is a spectral invariant. This is also true for up down symmetric domains, removing an assumption from the proof in that case.


Integrated and Iterative Requirements Analysis and Test Specification A Case Study at Kostal. Currently, practitioners follow a top down approach in automotive development projects. However, recent studies have shown that this top down approach is not suitable for the implementation and testing of modern automotive systems. Specifically, practitioners increasingly fail to specify requirements and tests for systems with complex component interactions (e.g., e mobility systems). In this paper, we address this research gap and propose an integrated and iterative scenario based technique for the specification of requirements and test scenarios. Our idea is to combine both a top down and a bottom up integration strategy. For the top down approach, we use a behavior driven development (BDD) technique to drive the modeling of high level system interactions from the user's perspective. For the bottom up approach, we discovered that natural language processing (NLP) techniques are suited to make textual specifications of existing components accessible to our technique. To integrate both directions, we support the joint execution and automated analysis of system level interactions and component level behavior. We demonstrate the feasibility of our approach by conducting a case study at Kostal (Tier1 supplier). The case study corroborates, among other things, that our approach supports practitioners in improving requirements and test specifications for integrated system behavior.


VisBuddy A Smart Wearable Assistant for the Visually Challenged. Vision plays a crucial role in comprehending the world around us. More than 85 of the external information is obtained through the vision system. It influences our mobility, cognition, information access, and interaction with the environment and other people. Blindness prevents a person from gaining knowledge of the surrounding environment and makes unassisted navigation, object recognition, obstacle avoidance, and reading tasks significant challenges. Many existing systems are often limited by cost and complexity. To help the visually challenged overcome these difficulties faced in everyday life, we propose VisBuddy, a smart assistant to help the visually challenged with their day to day activities. VisBuddy is a voice based assistant where the user can give voice commands to perform specific tasks. It uses the techniques of image captioning for describing the user's surroundings, optical character recognition (OCR) for reading the text in the user's view, object detection to search and find the objects in a room and web scraping to give the user the latest news. VisBuddy has been built by combining the concepts from Deep Learning and the Internet of Things. Thus, VisBuddy serves as a cost efficient, powerful, all in one assistant for the visually challenged by helping them with their day to day activities.


Probabilistic Inference of Winners in Elections by Independent Random Voters. We investigate the problem of computing the probability of winning in an election where voter attendance is uncertain. More precisely, we study the setting where, in addition to a total ordering of the candidates, each voter is associated with a probability of attending the poll, and the attendances of different voters are probabilistically independent. We show that the probability of winning can be computed in polynomial time for the plurality and veto rules. However, it is computationally hard ( P hard) for various other rules, including k approval and k veto for k 1 , Borda, Condorcet, and Maximin. For some of these rules, it is even hard to find a multiplicative approximation since it is already hard to determine whether this probability is nonzero. In contrast, we devise a fully polynomial time randomized approximation scheme (FPRAS) for the complement probability, namely the probability of losing, for every positional scoring rule (with polynomial scores), as well as for the Condorcet rule.


Last Query Transformer RNN for knowledge tracing. This paper presents an efficient model to predict a student's answer correctness given his past learning activities. Basically, I use both transformer encoder and RNN to deal with time series input. The novel point of the model is that it only uses the last input as query in transformer encoder, instead of all sequence, which makes QK matrix multiplication in transformer Encoder to have O(L) time complexity, instead of O(L 2). It allows the model to input longer sequence. Using this model I achieved the 1st place in the 'Riiid! Answer Correctness Prediction' competition hosted on kaggle.


Kinetic beam energy determination via collinear laser spectroscopy. An approach to determine the kinetic beam energy at the 10 5 level is presented, which corresponds to an improvement by more than one order of magnitude compared to conventional methods. Particularly, collinear fluorescence and resonance ionization spectroscopy measurements on rare isotope beams, where the beam energy is a major contribution to the uncertainty, can benefit from this method. The approach is based on collinear spectroscopy and requires no special equipment besides a wavelength meter, which is commonly available. Its advent is demonstrated in a proof of principle experiment on a Ni beam. In preparation for the energy measurement, the rest frame transition frequencies of the 3d 9 4s 3 mathrm D 3 rightarrow 3d 9 4p 3 mathrm P 2 transitions in neutral nickel isotopes have been identified to be nu 0( 58 mathrm Ni ) 850 ,343 ,678 ,(20) MHz and nu 0( 60 mathrm Ni ) 850 ,344 ,183 ,(20) MHz.


On Ethnomathematics In Memory of Ubiratan D'Ambrosio. The purpose of this note is to honour memory of Ubiratan D'Ambrosio, a Brazilian mathematics educator, who passed away on May 12, 2021.


On properties of positive solutions to nonlinear tri harmonic and bi harmonic equations with negative exponents. In this paper, we investigate various properties (e.g., nonexistence, asymptotic behavior, uniqueness and integral representation formula) of positive solutions to nonlinear tri harmonic equations in mathbb R n ( n geq2 ) and bi harmonic equations in mathbb R 2 with negative exponents. Such kind of equations arise from conformal geometry.


Neural Fitted Q Iteration based Optimal Bidding Strategy in Real Time Reactive Power Market 1. In real time electricity markets, the objective of generation companies while bidding is to maximize their profit. The strategies for learning optimal bidding have been formulated through game theoretical approaches and stochastic optimization problems. Similar studies in reactive power markets have not been reported so far because the network voltage operating conditions have an increased impact on reactive power markets than on active power markets. Contrary to active power markets, the bids of rivals are not directly related to fuel costs in reactive power markets. Hence, the assumption of a suitable probability distribution function is unrealistic, making the strategies adopted in active power markets unsuitable for learning optimal bids in reactive power market mechanisms. Therefore, a bidding strategy is to be learnt from market observations and experience in imperfect oligopolistic competition based markets. In this paper, a pioneer work on learning optimal bidding strategies from observation and experience in a three stage reactive power market is reported.


Using the structural kinome to systematize kinase drug discovery. Kinase targeted drug design is challenging. It requires designing inhibitors that can bind to specific kinases when all kinase catalytic domains share a common folding scaffold that binds ATP. Thus, obtaining the desired selectivity, given the whole human kinome, is a fundamental task during early stage drug discovery. This begins with deciphering the kinase ligand characteristics, analyzing the structure activity relationships, and prioritizing the desired drug molecules across the whole kinome. Currently, there are more than 300 kinases with released PDB structures, which provides a substantial structural basis to gain these necessary insights. Here, we review in silico structure based methods notably, a function site interaction fingerprint approach used in exploring the complete human kinome. In silico methods can be explored synergistically with multiple cell based or protein based assay platforms such as KINOMEscan. We conclude with new drug discovery opportunities associated with kinase signaling networks and using machine deep learning techniques broadly referred to as structural biomedical data science.


LoGG3D Net Locally Guided Global Descriptor Learning for 3D Place Recognition. Retrieval based place recognition is an efficient and effective solution for re localization within a pre built map, or global data association for Simultaneous Localization and Mapping (SLAM). The accuracy of such an approach is heavily dependent on the quality of the extracted scene level representation. While end to end solutions which learn a global descriptor from input point clouds have demonstrated promising results, such approaches are limited in their ability to enforce desirable properties at the local feature level. In this paper, we introduce a local consistency loss to guide the network towards learning local features which are consistent across revisits, hence leading to more repeatable global descriptors resulting in an overall improvement in 3D place recognition performance. We formulate our approach in an end to end trainable architecture called LoGG3D Net. Experiments on two large scale public benchmarks (KITTI and MulRan) show that our method achieves mean F1 max scores of 0.939 and 0.968 on KITTI and MulRan respectively, achieving state of the art performance while operating in near real time. The open source implementation is available at https github.com csiro robotics LoGG3D Net.


On Two Classes of Modules Related to CS Trivial Extensions. All rings considered are commutative. In this article we introduce and study two notions of modules which are stronger than CS modules, namely weakly IN modules and strongly CS modules. Our main aim is to characterize when a trivial extension A R propto M (of a ring R by an R module M ) is a CS ring.


The Fault in the Stars Understanding the Underground Market of Amazon Reviews. In recent times, the Internet has been plagued by a tremendous amount of misinformation. Online markets such as Amazon are also not free from misinformation. In this work, we study the misinformation propagated to consumers through the form of Amazon reviews. There exists a vast underground market where reviews by real Amazon users are purchased and sold. While such a practice violates Amazon's terms of service, we observe that there exists a complex network consisting of thousands of sellers and agents, who provide a rebate to consumers for leaving positive reviews to over 5000 products. Based on interviews with members involved in the reviews market, we understand the working of this market, and the tactics used to avoid detection by Amazon. We also present a set of recommendations of features that Amazon and similar online markets can take into consideration to detect such reviews.


Evolutionary Neural Architecture Search Supporting Approximate Multipliers. There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS methods utilizing multi objective evolutionary algorithms are especially useful when the objective is not only to minimize the network error but also to minimize the number of parameters (weights) or power consumption of the inference phase. We propose a multi objective NAS method based on Cartesian genetic programming for evolving convolutional neural networks (CNN). The method allows approximate operations to be used in CNNs to reduce the power consumption of a target hardware implementation. During the NAS process, a suitable CNN architecture is evolved together with approximate multipliers to deliver the best trade offs between the accuracy, network size, and power consumption. The most suitable approximate multipliers are automatically selected from a library of approximate multipliers. Evolved CNNs are compared with common human created CNNs of a similar complexity on the CIFAR 10 benchmark problem.


On the Interaction of Belief Bias and Explanations. A myriad of explainability methods have been proposed in recent years, but there is little consensus on how to evaluate them. While automatic metrics allow for quick benchmarking, it isn't clear how such metrics reflect human interaction with explanations. Human evaluation is of paramount importance, but previous protocols fail to account for belief biases affecting human performance, which may lead to misleading conclusions. We provide an overview of belief bias, its role in human evaluation, and ideas for NLP practitioners on how to account for it. For two experimental paradigms, we present a case study of gradient based explainability introducing simple ways to account for humans' prior beliefs models of varying quality and adversarial examples. We show that conclusions about the highest performing methods change when introducing such controls, pointing to the importance of accounting for belief bias in evaluation.


Identity Signals in Emoji Do not Influence Perception of Factual Truth on Twitter. Prior work has shown that Twitter users use skin toned emoji as an act of self representation to express their racial ethnic identity. We test whether this signal of identity can influence readers' perceptions about the content of a post containing that signal. In a large scale (n 944) pre registered controlled experiment, we manipulate the presence of skin toned emoji and profile photos in a task where readers rate obscure trivia facts (presented as tweets) as true or false. Using a Bayesian statistical analysis, we find that neither emoji nor profile photo has an effect on how readers rate these facts. This result will be of some comfort to anyone concerned about the manipulation of online users through the crafting of fake profiles.


BV solutions for mean curvature flow with constant contact angle Allen Cahn approximation and weak strong uniqueness. We study weak solutions to mean curvature flow satisfying Young's angle condition for general contact angles alpha in (0, pi) . First, we construct BV solutions using the Allen Cahn approximation with boundary contact energy as proposed by Owen and Sternberg. Second, we prove the weak strong uniqueness and stability for this solution concept. The main ingredient for both results is a relative energy, which can also be interpreted as a tilt excess.


Geometric Approaches on Persistent Homology. We introduce several geometric notions, including the width of a homology class, to the theory of persistent homology. These ideas provide geometric interpretations of persistence diagrams. Indeed, we give quantitative and geometric descriptions of the "life span" or "persistence" of a homology class. As a case study, we analyze the power filtration on unweighted graphs, and provide explicit bounds for the life spans of homology classes in persistence diagrams in all dimensions.


End to End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Driving. With the recent advancement of deep learning technology, data driven approaches for autonomous car prediction and planning have achieved extraordinary performance. Nevertheless, most of these approaches follow a non interactive prediction and planning paradigm, hypothesizing that a vehicle's behaviors do not affect others. The approaches based on such a non interactive philosophy typically perform acceptably in sparse traffic scenarios but can easily fail in dense traffic scenarios. Therefore, we propose an end to end interactive neural motion planner (INMP) for autonomous driving in this paper. Given a set of past surrounding view images and a high definition map, our INMP first generates a feature map in bird's eye view space, which is then processed to detect other agents and perform interactive prediction and planning jointly. Also, we adopt an optical flow distillation paradigm, which can effectively improve the network performance while still maintaining its real time inference speed. Extensive experiments on the nuScenes dataset and in the closed loop Carla simulation environment demonstrate the effectiveness and efficiency of our INMP for the detection, prediction, and planning tasks. Our project page is at sites.google.com view inmp ofd.


Traffic Aware Service Relocation in Cloud Oriented Elastic Optical Networks. In this paper, we study problem of efficient service relocation (i.e., changing assigned data center for a selected client node) in elastic optical networks (EONs) in order to increase network performance (measured by the volume of accepted traffic). To this end, we first propose novel traffic model for cloud ready transport networks. The model takes into account four flow types (i.e., city to city, city to data center, data center to data center and data center to data center) while the flow characteristics are based on real economical and geographical parameters of the cities related to network nodes. Then, we propose dedicated flow allocation algorithm that can be supported by the service relocation process. We also introduce 21 different relocation policies, which use three types of data for decision making network topological characteristics, rejection history and traffic prediction. Eventually, we perform extensive numerical experiments in order to (i) tune proposed optimization approaches and (ii) evaluate and compare their efficiency and select the best one. The results of the investigation prove high efficiency of the proposed policies. The propoerly designed relocation policy allowed to allocate up to 3 more traffic (compared to the allocation without that policy). The results also reveal that the most efficient relocation policy bases its decisions on two types of data simultaneously the rejection history and traffic prediction.


Complete weight enumerators for several classes of two weight and three weight linear codes. In this paper, for an odd prime p , by extending Li et al.'s construction cite CL2016 , several classes of two weight and three weight linear codes over the finite field mathbb F p are constructed from a defining set, and then their complete weight enumerators are determined by using Weil sums. Furthermore, we show that some examples of these codes are optimal or almost optimal with respect to the Griesmer bound. Our results generalize the corresponding results in cite CL2016, GJ2019 .


Learning Transferable Motor Skills with Hierarchical Latent Mixture Policies. For robots operating in the real world, it is desirable to learn reusable behaviours that can effectively be transferred and adapted to numerous tasks and scenarios. We propose an approach to learn abstract motor skills from data using a hierarchical mixture latent variable model. In contrast to existing work, our method exploits a three level hierarchy of both discrete and continuous latent variables, to capture a set of high level behaviours while allowing for variance in how they are executed. We demonstrate in manipulation domains that the method can effectively cluster offline data into distinct, executable behaviours, while retaining the flexibility of a continuous latent variable model. The resulting skills can be transferred and fine tuned on new tasks, unseen objects, and from state to vision based policies, yielding better sample efficiency and asymptotic performance compared to existing skill and imitation based methods. We further analyse how and when the skills are most beneficial they encourage directed exploration to cover large regions of the state space relevant to the task, making them most effective in challenging sparse reward settings.


Relaxed solutions for incompressible inviscid flows A variational and gravitational approximation to the initial value problem. Following Arnold's geometric interpretation, the Euler equations of an incompressible fluid moving in a domain D are known to be the optimality equation of the minimizing geodesic problem along the group of orientation and volume preserving diffeomorphisms of D. This problem admits a well established convex relaxation which generates a set of "relaxed", "multi stream", version of the Euler equations. However, it is unclear that such relaxed equations are appropriate for the initial value problem and the theory of turbulence, due to their lack of well posedness for most initial data. As an attempt to get a more relevant set of relaxed Euler equations, we address the multi stream pressure less gravitational Euler Poisson system as an approximate model, for which we show that the initial value problem can be stated as a concave maximization problem from which we can at least recover a large class of smooth solutions for short enough times.


Schema Guided Paradigm for Zero Shot Dialog. Developing mechanisms that flexibly adapt dialog systems to unseen tasks and domains is a major challenge in dialog research. Neural models implicitly memorize task specific dialog policies from the training data. We posit that this implicit memorization has precluded zero shot transfer learning. To this end, we leverage the schema guided paradigm, wherein the task specific dialog policy is explicitly provided to the model. We introduce the Schema Attention Model (SAM) and improved schema representations for the STAR corpus. SAM obtains significant improvement in zero shot settings, with a 22 F1 score improvement over prior work. These results validate the feasibility of zero shot generalizability in dialog. Ablation experiments are also presented to demonstrate the efficacy of SAM.


Cross Attention is All You Need Adapting Pretrained Transformers for Machine Translation. We study the power of cross attention in the Transformer architecture within the context of transfer learning for machine translation, and extend the findings of studies into cross attention when training from scratch. We conduct a series of experiments through fine tuning a translation model on data where either the source or target language has changed. These experiments reveal that fine tuning only the cross attention parameters is nearly as effective as fine tuning all parameters (i.e., the entire translation model). We provide insights into why this is the case and observe that limiting fine tuning in this manner yields cross lingually aligned embeddings. The implications of this finding for researchers and practitioners include a mitigation of catastrophic forgetting, the potential for zero shot translation, and the ability to extend machine translation models to several new language pairs with reduced parameter storage overhead.


The interplay of fast waves and slow convection in geodynamo simulations nearing Earth's core conditions. Ground observatory and satellite based determinations of temporal variations in the geomagnetic field probe a decadal to annual time scale range where Earth's core slow, inertialess convective motions and rapidly propagating, inertia bearing hydromagnetic waves are in interplay. Here we numerically model and jointly investigate these two important features with the help of a geodynamo simulation that (to date) is the closest to the dynamical regime of Earth's core. This model also considerably enlarges the scope of a previous asymptotic scaling analysis. Three classes of hydrodynamic and hydromagnetic waves are identified in the model output, all with propagation velocity largely exceeding that of convective advection axisymmetric, geostrophic Alfv 'en torsional waves, and non axisymmetric, quasi geostrophic Alfv 'en and Rossby waves. The contribution of these waves to the geomagnetic acceleration amounts to an enrichment and flattening of its energy density spectral profile at decadal time scales, thereby providing a constraint on the extent of the f 4 range observed in the geomagnetic frequency power spectrum. The flow and magnetic acceleration energies carried by waves both linearly increase with the ratio of the magnetic diffusion time scale to the Alfv 'en time scale, highlighting the dominance of Alfv 'en waves in the signal and the stabilising control of magnetic dissipation at non axisymmetric scales. Extrapolation of the results to Earth's core conditions supports the detectability of Alfv 'en waves in geomagnetic observations, either as axisymmetric torsional oscillations or through the geomagnetic jerks caused by non axisymmetric waves. In contrast, Rossby waves appear to be too fast and carry too little magnetic energy to be detectable in geomagnetic acceleration signals of limited spatio temporal resolution.


Limit theorems for exponential random graphs. We consider the edge triangle model, a two parameter family of exponential random graphs in which dependence between edges is introduced through triangles. In the so called replica symmetric regime, the limiting free energy exists together with a complete characterization of the phase diagram of the model. We borrow tools from statistical mechanics to obtain limit theorems for the edge density. First, we determine the asymptotic distribution of this quantity, as the graph size tends to infinity, in the various phases. Then we study the fluctuations of the edge density around its average value off the critical curve and formulate conjectures about the behavior at criticality based on the analysis of a mean field approximation of the model. Some of our results can be extended with no substantial changes to more general classes of exponential random graphs.


A note on the generalized hypergeometric solutions of general and single confluent Heun equations. We review the series solutions of the general and single confluent Heun equations in terms of powers, ordinary hypergeometric and confluent hypergeometric functions. The conditions under which the expansions reduce to finite sums as well as the cases when the coefficients of power series expansions obey two term recurrence relations are discussed. Infinitely many cases for which a solution of a general or single confluent Heun equation is written through a single generalized hypergeometric function are indicated. It is shown that the parameters of this generalized hypergeometric function are the roots of a certain polynomial equation, which we explicitly present for any given order.


A logical framework with a graph meta language. We conjecture that the relative unpopularity of logical frameworks among practitioners is partly due to their complex meta languages, which often demand both programming skills and theoretical knowledge of the meta language in question for them to be fruitfully used. We present ongoing work on a logical framework with a meta language based on graphs. A simpler meta language leads to a shallower embedding of the object language, but hopefully leads to easier implementation and usage. A graph based logical framework also opens up interesting possibilities in time and space performance by using heavily optimized graph databases as backends and by proof compression algorithms geared towards graphs. Deductive systems can be specified using simple domain specific languages built on top of the graph database's query language. There is support for interactive (through a web based interface) and semiautomatic (following user defined tactics specified by a domain specific language) proof modes. We have so far implemented nine systems for propositional logic, including Fitch style and backward directed Natural Deduction systems for intuitionistic and classical logic (with the classical systems reusing the rules of the intuitionistic ones), and a Hilbert style system for the K modal logic.


The bridges to consensus Network effects in a bounded confidence opinion dynamics model. In this work we present novel results to the problem of the Hegselmann Krause dynamics in networks obtained by an extensive study of the behavior of the standard order parameter sensitive to the onset of consensus the normalized size of the giant cluster. This order parameter reveals the non trivial effect of the network topology on the steady states of the dynamics, overlooked by previous works, which concentrated on the onset of unanimity, and allows to detect regions of polarization between the fragmented and the consensus phases. While the previous results on unanimity are confirmed, the consensus threshold shifts in the opposite direction compared to the threshold for unanimity. A detailed finite size scaling analysis shows that, in general, consensus is easier to obtain in networks than in mixed populations. At a difference with previous studies, we show that the network topology is relevant beyond the finitness of the average degree with increasing system size. In particular, in pure random networks (either uniform random graphs or scale free networks), the consensus threshold seems to vanish in the thermodynamic limit. A detailed analysis of the time evolution of the dynamics reveals the role of bridges in the network, which allow for the interaction between agents belonging to clusters of very different opinions, after several repeated interaction steps. These bridges are at the origin of the shift of the confidence threshold to lower values in networks as compared to lattices or the mixed population.


Gamma Ray Flash in the Interaction of a Tightly Focused Single Cycle Ultraintense Laser Pulse with a Solid Target. We employ the lambda 3 regime where a near single cycle laser pulse is tightly focused, thus providing the highest possible intensity for the minimal energy at a certain laser power. The quantum electrodynamics processes in the course of the interaction of the ultraintense laser with a solid target are studied via three dimensional particle in cell simulations, revealing the generation of copious gamma photons and electron positron pairs. The parametric study on the laser polarisation, target thickness and electron number density shows that the radially polarised laser provides the optimal regime for gamma photon generation. By varying the laser power in the range of 1 to 300 petawatt we find the scaling of the laser to gamma photon energy conversion efficiency. The laser generated gamma photon interaction with a high Z target is further studied by using Monte Carlo simulations revealing further electron positron pair generation and radioactive nuclides creation.


Asymptotic behavior of blowing up radial solutions for quasilinear elliptic systems arising in the study of viscous, heat conducting fluids. In this paper, we deal with the following quasilinear elliptic system involving gradient terms in the form begin center begin cases Delta p u v m nabla u alpha text in quad Omega Delta p v v beta nabla u q text in quad Omega, end cases end center where Omega subset mathbb R N(N geq 2) is either equal to mathbb R N or equal to a ball B R centered at the origin and having radius R 0 , 1 p infty , m,q 0 , alpha geq 0 , 0 leq beta leq m and delta (p 1 alpha)(p 1 beta) qm neq 0 . Our aim is to establish the asymptotics of the blowing up radial solutions to the above system. Precisely, we provide the accurate asymptotic behavior at the boundary for such blowing up radial solutions. For that,we prove a strong maximal principle for the problem of independent interest and study an auxiliary asymptotically autonomous system in R 3 .


HiFT Hierarchical Feature Transformer for Aerial Tracking. Most existing Siamese based tracking methods execute the classification and regression of the target object based on the similarity maps. However, they either employ a single map from the last convolutional layer which degrades the localization accuracy in complex scenarios or separately use multiple maps for decision making, introducing intractable computations for aerial mobile platforms. Thus, in this work, we propose an efficient and effective hierarchical feature transformer (HiFT) for aerial tracking. Hierarchical similarity maps generated by multi level convolutional layers are fed into the feature transformer to achieve the interactive fusion of spatial (shallow layers) and semantics cues (deep layers). Consequently, not only the global contextual information can be raised, facilitating the target search, but also our end to end architecture with the transformer can efficiently learn the interdependencies among multi level features, thereby discovering a tracking tailored feature space with strong discriminability. Comprehensive evaluations on four aerial benchmarks have proven the effectiveness of HiFT. Real world tests on the aerial platform have strongly validated its practicability with a real time speed. Our code is available at https github.com vision4robotics HiFT.


Contextual Dropout An Efficient Sample Dependent Dropout Module. Dropout has been demonstrated as a simple and effective module to not only regularize the training process of deep neural networks, but also provide the uncertainty estimation for prediction. However, the quality of uncertainty estimation is highly dependent on the dropout probabilities. Most current models use the same dropout distributions across all data samples due to its simplicity. Despite the potential gains in the flexibility of modeling uncertainty, sample dependent dropout, on the other hand, is less explored as it often encounters scalability issues or involves non trivial model changes. In this paper, we propose contextual dropout with an efficient structural design as a simple and scalable sample dependent dropout module, which can be applied to a wide range of models at the expense of only slightly increased memory and computational cost. We learn the dropout probabilities with a variational objective, compatible with both Bernoulli dropout and Gaussian dropout. We apply the contextual dropout module to various models with applications to image classification and visual question answering and demonstrate the scalability of the method with large scale datasets, such as ImageNet and VQA 2.0. Our experimental results show that the proposed method outperforms baseline methods in terms of both accuracy and quality of uncertainty estimation.


physics.comp-ph physics.app-ph physics.atom-ph physics.plasm-ph

On the Role of Atomic Binding Forces and Warm Dense Matter Physics in the Modeling of mJ Class Laser Induced Surface Ablation. Ultrafast laser heating of electrons on a metal surface breaks the pressure equilibrium within the material, thus initiating ablation. The stasis of a room temperature metal results from a balance between repulsive and attractive binding pressures. We calculate this with a choice of Equation of State (EOS), whose applicability in the Warm Dense Matter regime is varied. Hydrodynamic modeling of surface ablation in this regime involves calculation of electrostatic and thermal forces implied by the EOS, and therefore the physics outlining the evolution of the net inter atomic binding (negative pressure) during rapid heating is of interest. In particular, we discuss the Thomas Fermi Dirac Weizsacker model, and Averaged Atom Model, and their binding pressure as compared to the more commonly used models. A fully nonlinear hydrodynamic code with a pressure sourced electrostatic field solver is then implemented to simulate the ablation process, and the ablation depths are compared with known measurements with good agreement. Results also show that re condensation of a previously melted layer significantly reduces the overall ablated depth of copper for laser fluence between 10 30J cm 2, further explaining a well known trend observed in experiments in this regime. A transition from electrostatic to pressure driven ablation is observed with laser fluence increasing.


Anytime Ranking on Document Ordered Indexes. Inverted indexes continue to be a mainstay of text search engines, allowing efficient querying of large document collections. While there are a number of possible organizations, document ordered indexes are the most common, since they are amenable to various query types, support index updates, and allow for efficient dynamic pruning operations. One disadvantage with document ordered indexes is that high scoring documents can be distributed across the document identifier space, meaning that index traversal algorithms that terminate early might put search effectiveness at risk. The alternative is impact ordered indexes, which primarily support top k disjunctions, but also allow for anytime query processing, where the search can be terminated at any time, with search quality improving as processing latency increases. Anytime query processing can be used to effectively reduce high percentile tail latency which is essential for operational scenarios in which a service level agreement (SLA) imposes response time requirements. In this work, we show how document ordered indexes can be organized such that they can be queried in an anytime fashion, enabling strict latency control with effective early termination. Our experiments show that processing document ordered topical segments selected by a simple score estimator outperforms existing anytime algorithms, and allows query runtimes to be accurately limited in order to comply with SLA requirements.


Unbounded Algebraic Derivators. We show that the unbounded derived category of a Grothendieck category with enough projective objects is the base category of a derivator whose category of diagrams is the full 2 category of small categories. With this structure, we give a description of the localization functor associated to a specialization closed subset of the spectrum of a commutative noetherian ring. In addition, using the derivator of modules, we prove some basic theorems of group cohomology for complexes of representations over an arbitrary base ring.


Intraclass clustering an implicit learning ability that regularizes DNNs. Several works have shown that the regularization mechanisms underlying deep neural networks' generalization performances are still poorly understood. In this paper, we hypothesize that deep neural networks are regularized through their ability to extract meaningful clusters among the samples of a class. This constitutes an implicit form of regularization, as no explicit training mechanisms or supervision target such behaviour. To support our hypothesis, we design four different measures of intraclass clustering, based on the neuron and layer level representations of the training data. We then show that these measures constitute accurate predictors of generalization performance across variations of a large set of hyperparameters (learning rate, batch size, optimizer, weight decay, dropout rate, data augmentation, network depth and width).


On Geometric Fourier Particle In Cell Methods. In this article we describe a unifying framework for variational electromagnetic particle schemes of spectral type, and we propose a novel spectral Particle In Cell (PIC) scheme that preserves a discrete Hamiltonian structure. Our work is based on a new abstract variational derivation of particle schemes which builds on a de Rham complex where Low's Lagrangian is discretized using a particle approximation of the distribution function. In this framework, which extends the recent Finite Element based Geometric Electromagnetic PIC (GEMPIC) method to a variety of field solvers, the discretization of the electromagnetic potentials and fields is represented by a de Rham sequence of compatible spaces, and the particle field coupling procedure is described by approximation operators that commute with the differential operators in the sequence. In particular, for spectral Maxwell solvers the choice of truncated L 2 projections using continuous Fourier transform coefficients for the commuting approximation operators yields the gridless Particle in Fourier method, whereas spectral Particle in Cell methods are obtained by using discrete Fourier transform coefficients computed from a grid. By introducing a new sequence of spectral pseudo differential approximation operators, we then obtain a novel variational spectral PIC method with discrete Hamiltonian structure that we call Fourier GEMPIC. Fully discrete schemes are then derived using a Hamiltonian splitting procedure, leading to explicit time steps that preserve the Gauss laws and the discrete Poisson bracket associated with the Hamiltonian structure. These explicit steps share many similarities with standard spectral PIC methods. As arbitrary filters are allowed in our framework, we also discuss aliasing errors and study a natural back filtering procedure to mitigate the damping caused by anti aliasing smoothing particle shapes.


On the Evaluation of Machine Translation for Terminology Consistency. As neural machine translation (NMT) systems become an important part of professional translator pipelines, a growing body of work focuses on combining NMT with terminologies. In many scenarios and particularly in cases of domain adaptation, one expects the MT output to adhere to the constraints provided by a terminology. In this work, we propose metrics to measure the consistency of MT output with regards to a domain terminology. We perform studies on the COVID 19 domain over 5 languages, also performing terminology targeted human evaluation. We open source the code for computing all proposed metrics https github.com mahfuzibnalam terminology evaluation


Positioning Error Probabilities for Some Forms of Center of Gravity Algorithm Calculated with the Cumulative Distributions. Part II. To complete a previous work, the probability density functions for the errors in the center of gravity as positioning algorithm are derived with the usual methods of the cumulative distribution functions. These methods introduce substantial complications compared to the approaches used in a previous publication on similar problems. The combinations of random variables considered are X g3 theta(x 2 x 1) (x 1 x 3) (x 1 x 2 x 3) theta(x 1 x 2)(x 1 2x 4) (x 1 x 2 x 4) and X g4 ( theta(x 4 x 5)(2x 4 x 1 x 3) (x 1 x 2 x 3 x 4) theta(x 5 x 4)(x 1 x 3 2x 5) (x 1 x 2 x 3 x 5) The complete and partial forms of the probability density functions of these expressions of the center of gravity algorithms are calculated for general probability density functions of the observation noise. The cumulative probability distributions are the essential steps in this study, never calculated elsewhere.


Coverage Analysis for UAV Assisted Cellular Networks in Rural Areas. Despite coverage enhancement in rural areas is one of the main requirements in next generations of wireless networks (i.e., 5G and 6G), the low expected profit prevents telecommunication providers from investing in such sparsely populated areas. Hence, it is required to design and deploy cost efficient alternatives for extending the cellular infrastructure to these regions. A concrete mathematical model that characterizes and clearly captures the aforementioned problem might be a key enabler for studying the efficiency of any potential solution. Unfortunately, the commonly used mathematical tools that model large scale wireless networks are not designed to capture the unfairness, in terms of cellular coverage, suffered by exurban and rural areas. In big cities, in fact, cellular deployment is essentially capacity driven and thus cellular base station densities are maximum in the town centers and decline when getting far from them. In this paper, a new stochastic geometry based model is implemented in order to show the coverage spatial variation among urban, suburban, and exurban settlements. Indeed, by implementing inhomogeneous Poisson point processes (PPPs) it is possible to study the performance metrics in a realistic scenario where terrestrial base stations (TBSs) are clustered around the urban center while outer aerial base stations (ABSs) are uniformly distributed outside an urban exclusion zone. Based on this, our simulation results can quantify the improvement, in terms of coverage probability, that even a surprisingly low density of ABSs can bring to peripheral regions depending on the extension of the exclusion zone, enabling us to draw insightful considerations.


Combining Sobolev Smoothing with Parameterized Shape Optimization. On the one hand, Sobolev gradient smoothing can considerably improve the performance of aerodynamic shape optimization and prevent issues with regularity. On the other hand, Sobolev smoothing can also be interpreted as an approximation for the shape Hessian. This paper demonstrates, how Sobolev smoothing, interpreted as a shape Hessian approximation, offers considerable benefits, although the parameterization is smooth in itself already. Such an approach is especially beneficial in the context of simultaneous analysis and design, where we deal with inexact flow and adjoint solutions, also called One Shot optimization. Furthermore, the incorporation of the parameterization allows for direct application to engineering test cases, where shapes are always described by a CAD model. The new methodology presented in this paper is used for reference test cases from aerodynamic shape optimization and performance improvements in comparison to a classical Quasi Newton scheme are shown.