A Structural Invariant On Certain Two Dimensional Noetherian Partially Ordered Sets. If (X, le X) is a partially ordered set satisfying certain necessary conditions for X to be order isomorphic to the spectrum of a Noetherian domain of dimension two, we describe a new poset ( text str X, le text str X ) that completely determines X up to isomorphism. The order relation le text str X imposed on text str X is modeled after R. Wiegand's well known "P5" condition that can be used to determine when a given partially ordered set (U, le U) of a certain type is order isomorphic to ( text Spec mathbb Z x , subseteq).


What drives adsorption of ions on surface of nanodiamonds in aqueous solutions?. It is not yet clear what drives the adsorption of ions on detonation nanodiamonds (DNDs), which plays a critical role on the loading (unloading) of chemotherapeutic drugs on (from) the surface of DNDs in their targeted therapy applications. Furthermore, effects of adsorbed ions on the hydration layers of water around DNDs with different surface chemistries have not been studied yet. Through a series of Molecular Dynamics simulations, we found out that the law of matching water affinity generally explains well the adsorption patterns of ions onto the surface functional groups of DNDs. Depending on whether the water affinity of the ion matches with that of the surface functional group or not, the former predominantly forms either Contact Ion Pair (CIP) or Solvent shared Ion Pair (SIP) with the latter. In this regard, Na and Mg 2 have the highest tendencies to form, respectively, CIP and SIP associations with COO functional groups. In the extreme case of 84 COO groups on DND COOH, however, we observed few Mg 2 COO CIP associations, for which we have proposed a hypothesis based on the entropy gains. Furthermore, Mg 2 and to a lesser extent Ca 2 in cooperation with COO functional groups on the surface of charged DND COOH lead to relatively high residence times of water in the first hydration layer of DND. This study also provides a firsthand molecular level insight about the preferential orientation of water in the vicinity of positively charged DND H, on which prior experimental studies have not yet reached a consensus.


Representations and Deformations of 3 Hom rho Lie algebras. The aim of this paper is to introduce 3 Hom rho Lie algebra structures generalizing the algebras of 3 Hom Lie algebra. Also, we investigate the representations and deformations theory of this type of Hom Lie algebras. Moreover, we introduce the definition of extensions and abelian extensions of 3 Hom rho Lie algebras and show that associated to any abelian extension, there is a representation and a 2 cocycle.


Magnetic Fluctuations in Gyrokinetic Simulations of Tokamak Scrape Off Layer Turbulence. Understanding turbulent transport physics in the tokamak edge and scrape off layer (SOL) is critical to developing a successful fusion reactor. The dynamics in these regions plays a key role in achieving high fusion performance by determining the edge pedestal that suppresses turbulence in H mode. Additionally, the survivability of a reactor is set by the heat load to the vessel walls, making it important to understand turbulent spreading of heat as it flows along open magnetic field lines in the SOL. Large amplitude fluctuations, magnetic X point geometry, and plasma interactions with material walls make simulating turbulence in the edge SOL more challenging than in the core region, necessitating specialized gyrokinetic codes. Further, the inclusion of electromagnetic effects in gyrokinetic simulations that can handle the unique challenges of the boundary plasma is critical to the understanding of phenomena such as the pedestal and ELMs, for which electromagnetic dynamics are expected to be important. In this thesis, we develop the first capability to simulate electromagnetic gyrokinetic turbulence on open magnetic field lines. This is an important step towards comprehensive electromagnetic gyrokinetic simulations of the coupled edge SOL system. By using a continuum full f approach via an energy conserving discontinuous Galerkin (DG) discretization scheme that avoids the Ampere cancellation problem, we show that electromagnetic fluctuations can be handled in a robust, stable, and efficient manner in the gyrokinetic module of the Gkeyll code. We then present results which roughly model the scrape off layer of the National Spherical Torus Experiment (NSTX), and show that electromagnetic effects can affect blob dynamics and transport. We also formulate the gyrokinetic system in field aligned coordinates for modeling realistic edge and scrape off layer geometries in experiments.


Uncovering the Local Hidden Community Structure in Social Networks. Hidden community is a useful concept proposed recently for social network analysis. To handle the rapid growth of network scale, in this work, we explore the detection of hidden communities from the local perspective, and propose a new method that detects and boosts each layer iteratively on a subgraph sampled from the original network. We first expand the seed set from a single seed node based on our modified local spectral method and detect an initial dominant local community. Then we temporarily remove the members of this community as well as their connections to other nodes, and detect all the neighborhood communities in the remaining subgraph, including some "broken communities" that only contain a fraction of members in the original network. The local community and neighborhood communities form a dominant layer, and by reducing the edge weights inside these communities, we weaken this layer's structure to reveal the hidden layers. Eventually, we repeat the whole process and all communities containing the seed node can be detected and boosted iteratively. We theoretically show that our method can avoid some situations that a broken community and the local community are regarded as one community in the subgraph, leading to the inaccuracy on detection which can be caused by global hidden community detection methods. Extensive experiments show that our method could significantly outperform the state of the art baselines designed for either global hidden community detection or multiple local community detection.


Short range correlation energy of the relativistic homogeneous electron gas. We construct the complementary short range correlation relativistic local density approximation functional to be used in relativistic range separated density functional theory based on a Dirac Coulomb Hamiltonian in the no pair approximation. For this, we perform relativistic random phase approximation calculations of the correlation energy of the relativistic homogeneous electron gas with a modified electron electron interaction, we study the high density behavior, and fit the results to a parametrized expression. The obtained functional should eventually be useful for electronic structure calculations of strongly correlated systems containing heavy elements.


Hypoelliptic entropy dissipation for stochastic differential equations. We study the Lyapunov convergence analysis for degenerate and non reversible stochastic differential equations (SDEs). We apply the Lyapunov method towards the Fokker Planck equation, in which the Lyapunov functional is chosen as a weighted relative Fisher information functional. We derive a structure condition under which the Lypapunov constant is obtained explicitly. Given the positive Lypapunov constant, we prove the exponential convergence result for the probability density function of SDEs towards its invariant distribution in L 1 norm. Two examples are presented, including underdamped Langevin dynamics with variable diffusions and 3 oscillator chain model with nearest neighbor couplings.


Shape of Elephant Study of Macro Properties of Word Embeddings Spaces. Pre trained word representations became a key component in many NLP tasks. However, the global geometry of the word embeddings remains poorly understood. In this paper, we demonstrate that a typical word embeddings cloud is shaped as a high dimensional simplex with interpretable vertices and propose a simple yet effective method for enumeration of these vertices. We show that the proposed method can detect and describe vertices of the simplex for GloVe and fasttext spaces.


Information transmission in a two step cascade Interplay of activation and repression. We present an information theoretic formalism to study signal transduction in four architectural variants of a model two step cascade with increasing input population. Our results categorize these four types into two classes depending upon the effect played out by activation and repression on mutual information, net synergy, and signal to noise ratio. Within the Gaussian framework and using the linear noise approximation, we derive the analytic expressions for these metrics to establish their underlying relationships in terms of the biochemical parameters. We also verify our approximations through stochastic simulations.


GradTS A Gradient Based Automatic Auxiliary Task Selection Method Based on Transformer Networks. A key problem in multi task learning (MTL) research is how to select high quality auxiliary tasks automatically. This paper presents GradTS, an automatic auxiliary task selection method based on gradient calculation in Transformer based models. Compared to AUTOSEM, a strong baseline method, GradTS improves the performance of MT DNN with a bert base cased backend model, from 0.33 to 17.93 on 8 natural language understanding (NLU) tasks in the GLUE benchmarks. GradTS is also time saving since (1) its gradient calculations are based on single task experiments and (2) the gradients are re used without additional experiments when the candidate task set changes. On the 8 GLUE classification tasks, for example, GradTS costs on average 21.32 less time than AUTOSEM with comparable GPU consumption. Further, we show the robustness of GradTS across various task settings and model selections, e.g. mixed objectives among candidate tasks. The efficiency and efficacy of GradTS in these case studies illustrate its general applicability in MTL research without requiring manual task filtering or costly parameter tuning.


TravelBERT Pre training Language Model Incorporating Domain specific Heterogeneous Knowledge into A Unified Representation. Existing technologies expand BERT from different perspectives, e.g. designing different pre training tasks, different semantic granularities and different model architectures. Few models consider expanding BERT from different text formats. In this paper, we propose a heterogeneous knowledge language model (HKLM), a unified pre trained language model (PLM) for all forms of text, including unstructured text, semi structured text and well structured text. To capture the corresponding relations among these multi format knowledge, our approach uses masked language model objective to learn word knowledge, uses triple classification objective and title matching objective to learn entity knowledge and topic knowledge respectively. To obtain the aforementioned multi format text, we construct a corpus in the tourism domain and conduct experiments on 5 tourism NLP datasets. The results show that our approach outperforms the pre training of plain text using only 1 4 of the data. The code, datasets, corpus and knowledge graph will be released.


Fast and scalable neuroevolution deep learning architecture search for multivariate anomaly detection. Neuroevolution is one of the methodologies that can be used for learning optimal architecture during training. It uses evolutionary algorithms to generate the topology of artificial neural networks and its parameters. The main benefits are that it is scalable and can be fully or partially non gradient method. In this work, a modified neuroevolution technique is presented which incorporates multi level optimisation. The presented approach adapts evolution strategies for evolving an ensemble model based on the bagging technique, using genetic operators for optimising single anomaly detection models, reducing the training dataset to speedup the search process and perform non gradient fine tuning. Multivariate anomaly detection as an unsupervised learning task is the case study upon which the presented approach is tested. Single model optimisation is based on mutation and crossover operators and is focused on finding optimal window sizes, the number of layers, layer depths, hyperparameters etc. to boost the anomaly detection scores of new and already known models. The proposed framework and its protocol shows that it is possible to find architecture within a reasonable time frame which can boost all well known multivariate anomaly detection deep learning architectures. The work concentrates on improvements to the multi level neuroevolution approach for anomaly detection. The main modifications are in the methods of mixing groups and single model evolution, non gradient fine tuning and a voting mechanism. The presented framework can be used as an efficient learning network architecture method for any different unsupervised task where autoencoder architectures can be used. The tests were run on SWAT and WADI datasets and the presented approach evolved the architectures that achieved the best scores among other deep learning models.


A Modulation Layer to Increase Neural Network Robustness Against Data Quality Issues. Data quality is a common problem in machine learning, especially in high stakes settings such as healthcare. Missing data affects accuracy, calibration, and feature attribution in complex patterns. Developers often train models on carefully curated datasets to minimize missing data bias however, this reduces the usability of such models in production environments, such as real time healthcare records. Making machine learning models robust to missing data is therefore crucial for practical application. While some classifiers naturally handle missing data, others, such as deep neural networks, are not designed for unknown values. We propose a novel neural network modification to mitigate the impacts of missing data. The approach is inspired by neuromodulation that is performed by biological neural networks. Our proposal replaces the fixed weights of a fully connected layer with a function of an additional input (reliability score) at each input, mimicking the ability of cortex to up and down weight inputs based on the presence of other data. The modulation function is jointly learned with the main task using a multi layer perceptron. We tested our modulating fully connected layer on multiple classification, regression, and imputation problems, and it either improved performance or generated comparable performance to conventional neural network architectures concatenating reliability to the inputs. Models with modulating layers were more robust against degradation of data quality by introducing additional missingness at evaluation time. These results suggest that explicitly accounting for reduced information quality with a modulating fully connected layer can enable the deployment of artificial intelligence systems in real time settings.


TWEETSUMM A Dialog Summarization Dataset for Customer Service. In a typical customer service chat scenario, customers contact a support center to ask for help or raise complaints, and human agents try to solve the issues. In most cases, at the end of the conversation, agents are asked to write a short summary emphasizing the problem and the proposed solution, usually for the benefit of other agents that may have to deal with the same customer or issue. The goal of the present article is advancing the automation of this task. We introduce the first large scale, high quality, customer care dialog summarization dataset with close to 6500 human annotated summaries. The data is based on real world customer support dialogs and includes both extractive and abstractive summaries. We also introduce a new unsupervised, extractive summarization method specific to dialogs.


2 times2 block representations of the Moore Penrose inverse and orthogonal projection matrices. In this paper, new block representations of Moore Penrose inverses for arbitrary complex 2 times2 block matrices are given. The approach is based on block representations of orthogonal projection matrices.


Masked Language Modeling and the Distributional Hypothesis Order Word Matters Pre training for Little. A possible explanation for the impressive performance of masked language model (MLM) pre training is that such models have learned to represent the syntactic structures prevalent in classical NLP pipelines. In this paper, we propose a different explanation MLMs succeed on downstream tasks almost entirely due to their ability to model higher order word co occurrence statistics. To demonstrate this, we pre train MLMs on sentences with randomly shuffled word order, and show that these models still achieve high accuracy after fine tuning on many downstream tasks including on tasks specifically designed to be challenging for models that ignore word order. Our models perform surprisingly well according to some parametric syntactic probes, indicating possible deficiencies in how we test representations for syntactic information. Overall, our results show that purely distributional information largely explains the success of pre training, and underscore the importance of curating challenging evaluation datasets that require deeper linguistic knowledge.


Revisiting Negation in Neural Machine Translation. In this paper, we evaluate the translation of negation both automatically and manually, in English German (EN DE) and English Chinese (EN ZH). We show that the ability of neural machine translation (NMT) models to translate negation has improved with deeper and more advanced networks, although the performance varies between language pairs and translation directions. The accuracy of manual evaluation in EN DE, DE EN, EN ZH, and ZH EN is 95.7 , 94.8 , 93.4 , and 91.7 , respectively. In addition, we show that under translation is the most significant error type in NMT, which contrasts with the more diverse error profile previously observed for statistical machine translation. To better understand the root of the under translation of negation, we study the model's information flow and training data. While our information flow analysis does not reveal any deficiencies that could be used to detect or fix the under translation of negation, we find that negation is often rephrased during training, which could make it more difficult for the model to learn a reliable link between source and target negation. We finally conduct intrinsic analysis and extrinsic probing tasks on negation, showing that NMT models can distinguish negation and non negation tokens very well and encode a lot of information about negation in hidden states but nevertheless leave room for improvement.


CoANE Modeling Context Co occurrence for Attributed Network Embedding. Attributed network embedding (ANE) is to learn low dimensional vectors so that not only the network structure but also node attributes can be preserved in the embedding space. Existing ANE models do not consider the specific combination between graph structure and attributes. While each node has its structural characteristics, such as highly interconnected neighbors along with their certain patterns of attribute distribution, each node's neighborhood should be not only depicted by multi hop nodes, but consider certain clusters or social circles. To model such information, in this paper, we propose a novel ANE model, Context Co occurrence aware Attributed Network Embedding (CoANE). The basic idea of CoANE is to model the context attributes that each node's involved diverse patterns, and apply the convolutional mechanism to encode positional information by treating each attribute as a channel. The learning of context co occurrence can capture the latent social circles of each node. To better encode structural and semantic knowledge of nodes, we devise a three way objective function, consisting of positive graph likelihood, contextual negative sampling, and attribute reconstruction. We conduct experiments on five real datasets in the tasks of link prediction, node label classification, and node clustering. The results exhibit that CoANE can significantly outperform state of the art ANE models.


Seismic wave propagation and inversion with Neural Operators. Seismic wave propagation forms the basis for most aspects of seismological research, yet solving the wave equation is a major computational burden that inhibits the progress of research. This is exacerbated by the fact that new simulations must be performed when the velocity structure or source location is perturbed. Here, we explore a prototype framework for learning general solutions using a recently developed machine learning paradigm called Neural Operator. A trained Neural Operator can compute a solution in negligible time for any velocity structure or source location. We develop a scheme to train Neural Operators on an ensemble of simulations performed with random velocity models and source locations. As Neural Operators are grid free, it is possible to evaluate solutions on higher resolution velocity models than trained on, providing additional computational efficiency. We illustrate the method with the 2D acoustic wave equation and demonstrate the method's applicability to seismic tomography, using reverse mode automatic differentiation to compute gradients of the wavefield with respect to the velocity structure. The developed procedure is nearly an order of magnitude faster than using conventional numerical methods for full waveform inversion.


Debiasing a First order Heuristic for Approximate Bi level Optimization. Approximate bi level optimization (ABLO) consists of (outer level) optimization problems, involving numerical (inner level) optimization loops. While ABLO has many applications across deep learning, it suffers from time and memory complexity proportional to the length r of its inner optimization loop. To address this complexity, an earlier first order method (FOM) was proposed as a heuristic that omits second derivative terms, yielding significant speed gains and requiring only constant memory. Despite FOM's popularity, there is a lack of theoretical understanding of its convergence properties. We contribute by theoretically characterizing FOM's gradient bias under mild assumptions. We further demonstrate a rich family of examples where FOM based SGD does not converge to a stationary point of the ABLO objective. We address this concern by proposing an unbiased FOM (UFOM) enjoying constant memory complexity as a function of r . We characterize the introduced time variance tradeoff, demonstrate convergence bounds, and find an optimal UFOM for a given ABLO problem. Finally, we propose an efficient adaptive UFOM scheme.


Neutral dissociation of methane by electron impact and a complete and consistent cross section set. We present cross sections for the neutral dissociation of methane, in a large part obtained through analytical approximations. With these cross sections the work of Song textit et al. J. Phys. Chem. Ref. Data, textbf 44 , 023101, (2015) can be extended which results in a complete and consistent set of cross sections for the collision of electrons with up to 100 eV energy with methane molecules. Notably, the resulting cross section set does not require any data fitting to produce bulk swarm parameters that match with experiments. Therefore consistency can be considered an inherent trait of the set, since swarm parameters are used exclusively for validation of the cross sections. Neutral dissociation of methane is essential to include (1) because it is a crucial electron energy sink in methane plasma, and (2) because it largely contributes to the production of hydrogen radicals that can be vital for plasma chemical processes. Finally, we compare the production rates of hydrogen species for a swarm fitted data set with ours. The two consistent cross section sets predict different production rates, with differences of 45 (at 100 Td) and 125 (at 50 Td) for production of H 2 and a similar trend for production of H. With this comparison we underline that the swarm fitting procedure, used to ensure consistency of the electron swarm parameters, can possibly deteriorate the accuracy with which chemical production rates are estimated. This is of particular importance for applications with an emphasis on plasma chemical activation of the gas.


Torsion points of elliptic curves over multi quadratic number fields. We compute the Mordell Weil groups of the modular Jacobian varieties of hyperelliptic modular curves X 1(M, MN) over every number field which is the composition of quadratic fields. Also we prove criteria for the existence of elliptic curves over such number fields with prescribed torsion points generalizing the results for quadratic number fields of Kamienny and Najman.


Class Knowledge Overlay to Visual Feature Learning for Zero Shot Image Classification. New categories can be discovered by transforming semantic features into synthesized visual features without corresponding training samples in zero shot image classification. Although significant progress has been made in generating high quality synthesized visual features using generative adversarial networks, guaranteeing semantic consistency between the semantic features and visual features remains very challenging. In this paper, we propose a novel zero shot learning approach, GAN CST, based on class knowledge to visual feature learning to tackle the problem. The approach consists of three parts, class knowledge overlay, semi supervised learning and triplet loss. It applies class knowledge overlay (CKO) to obtain knowledge not only from the corresponding class but also from other classes that have the knowledge overlay. It ensures that the knowledge to visual learning process has adequate information to generate synthesized visual features. The approach also applies a semi supervised learning process to re train knowledge to visual model. It contributes to reinforcing synthesized visual features generation as well as new category prediction. We tabulate results on a number of benchmark datasets demonstrating that the proposed model delivers superior performance over state of the art approaches.


Simulations of turbulence over compliant walls. Direct numerical simulations of turbulent flow in a channel with one rigid and one viscoelastic wall are performed. An Eulerian Eulerian model is adopted with a level set approach to identify the fluid compliant material interface. Focus is placed on the propagation of Rayleigh waves in the compliant material, whose speed depends on the shear modulus of elasticity and whose dominant wavelength depends on the thickness of the viscoelastic layer. These parameters are selected to ensure coupling between the compliant surface and turbulence. When the phase speed of Rayleigh waves is commensurate with the advection velocity of near wall pressure fluctuations, sheets of vorticity are lifted up and detached near the critical layer and lead to a local pressure minimum. These events are caused by the inflectional velocity profile near the troughs, and are controlled by the net vorticity flux at the elastic surface. This phenomenon is central to understanding the statistical characteristics of the flow, including the surface deformation pressure correlation and enhanced stochastic turbulent shear stresses. The pressure work onto the fluid is positive at the surface, which increases the turbulent intensity and wall normal mixing, without any streamwise momentum gain. Finally, we discuss the influence of three dimensionality of the surface topography on the generation of streamwise vorticity, secondary motions, and lateral turbulent transport.


Permutation Entropy for Graph Signals. Entropy metrics (for example, permutation entropy) are nonlinear measures of irregularity in time series (one dimensional data). Some of these entropy metrics can be generalised to data on periodic structures such as a grid or lattice pattern (two dimensional data) using its symmetry, thus enabling their application to images. However, these metrics have not been developed for signals sampled on irregular domains, defined by a graph. Here, we define for the first time an entropy metric to analyse signals measured over irregular graphs by generalising permutation entropy, a well established nonlinear metric based on the comparison of neighbouring values within patterns in a time series. Our algorithm is based on comparing signal values on neighbouring nodes, using the adjacency matrix. We show that this generalisation preserves the properties of classical permutation for time series and the recent permutation entropy for images, and it can be applied to any graph structure with synthetic and real signals. We expect the present work to enable the extension of other nonlinear dynamic approaches to graph signals.


Double Perturbation On the Robustness of Robustness and Counterfactual Bias Evaluation. Robustness and counterfactual bias are usually evaluated on a test dataset. However, are these evaluations robust? If the test dataset is perturbed slightly, will the evaluation results keep the same? In this paper, we propose a "double perturbation" framework to uncover model weaknesses beyond the test dataset. The framework first perturbs the test dataset to construct abundant natural sentences similar to the test data, and then diagnoses the prediction change regarding a single word substitution. We apply this framework to study two perturbation based approaches that are used to analyze models' robustness and counterfactual bias in English. (1) For robustness, we focus on synonym substitutions and identify vulnerable examples where prediction can be altered. Our proposed attack attains high success rates (96.0 99.8 ) in finding vulnerable examples on both original and robustly trained CNNs and Transformers. (2) For counterfactual bias, we focus on substituting demographic tokens (e.g., gender, race) and measure the shift of the expected prediction among constructed sentences. Our method is able to reveal the hidden model biases not directly shown in the test dataset. Our code is available at https github.com chong z nlp second order attack.


Nonlinear Fractional Schr "odinger Equations coupled by power type nonlinearities. In this work we study the following class of systems of coupled nonlinear fractional nonlinear Schr "odinger equations, begin equation left begin array l ( Delta) s u 1 lambda 1 u 1 mu 1 u 1 2p 2 u 1 beta u 2 p u 1 p 2 u 1 quad text in mathbb R N, 3pt ( Delta) s u 2 lambda 2 u 2 mu 2 u 2 2p 2 u 2 beta u 1 p u 2 p 2 u 2 quad text in mathbb R N, end array right. end equation where u 1, , u 2 in W s,2 ( mathbb R N) , with N 1, , 2, , 3 lambda j, , mu j 0 , j 1,2 , beta in mathbb R , p geq 2 and displaystyle frac p 1 2p N s 1 . Precisely, we prove the existence of positive radial bound and ground state solutions provided the parameters beta, p, lambda j, mu j , ( j 1, , 2 ) satisfy appropriate conditions. We also study the previous system with m equations, ( Delta) s u j lambda j u j mu j u j 2p 2 u j sum substack k 1 k neq j m beta jk u k p u j p 2 u j, quad u j in W s,2 ( mathbb R N) j 1, ldots,m where lambda j, , mu j 0 for j 1, ldots ,m ge 3 , the coupling parameters beta jk beta kj in mathbb R for j,k 1, ldots,m , j neq k . For this system we prove similar results as for m 2 , depending on the values of the parameters beta jk , p, lambda j, mu j , (for j,k 1, ldots,m , j neq k ).


A new threshold model based on tropical mathematics reveals network backbones. Maxmin omega is a new threshold model, where each node in a network waits for the arrival of states from a fraction omega of neighborhood nodes before processing its own state, and subsequently transmitting it to downstream nodes. Repeating this sequence of events leads to periodic behavior. We show that maxmin omega reduces to a smaller, simpler, system represented by tropical mathematics, which forges a useful link between the nodal state update times and circuits in the network. Thus, the behavior of the system can be analyzed directly from the smaller network structure and is computationally faster. We further show that these reduced networks (i) are not unique they are dependent on the initialisation time, (ii) tend towards periodic orbits of networks "attractor networks." In light of these features, we vary the initial condition and omega to obtain statistics on types of attractor networks. The results suggest the case omega 0.5 to give the most stable system. We propose that the most prominent attractor networks of nodes and edges may be seen as a 'backbone' of the original network. We subsequently provide an algorithm to construct attractor networks, the main result being that they must necessarily contain circuits that are deemed critical and that can be identified without running the maxmin omega system. Finally, we apply this work to the C. elegans neuron network, giving insight into its function and similar networks. This novel area of application for tropical mathematics adds to its theory, and provides a new way to identify important edges and circuits of a network.


Understanding the Benefit of Being Patient in Payment Channel Networks. Scaling blockchain efficiency is crucial to its widespread usage in which the payment channel is one of the most prominent approaches. With payment channels and the network they construct, two users can move some transactions off chain in a predetermined duration to avoid expensive and time consuming on chain settlements. Existing work is devoted to designing high throughput payment channel networks (PCNs) or efficient PCN routing policies to reduce the fee. In this paper, we investigate the PCN routing from a different perspective by answering whether the routing fee of transactions can be saved by being a bit more patient. The key idea is to reorder the processing sequence of atomic transactions, other than to handle each of them separately and immediately. We present two mechanisms, one is periodic transaction processing assisted by a PCN broker and the other is purely strategic waiting. In the former, all the incoming transactions in a short time interval are processed collectively. We formulate an optimization model to minimize their total routing fee and derive the optimal permutation of processing transactions as well as the routing policy for each of them. A Shapley value based scheme is presented to redistribute the benefit of reordering among the transactions efficiently and fairly. In the latter, we model the waiting time of a strategic transaction on a single payment channel as the first passage time problem in queueing theory when the transaction value is higher than the edge capacity upon its arrival. By capturing the capacity dynamics, we are able to calculate the recursive expression of waiting for time distribution that is useful to gauge a user's cost of patience. Experimental results manifest that our cost redistribution mechanism can effectively save routing fees for all the transactions, and the waiting time distribution coincides with the model well.


Building Interpretable Models for Business Process Prediction using Shared and Specialised Attention Mechanisms. In this paper, we address the "black box" problem in predictive process analytics by building interpretable models that are capable to inform both what and why is a prediction. Predictive process analytics is a newly emerged discipline dedicated to providing business process intelligence in modern organisations. It uses event logs, which capture process execution traces in the form of multi dimensional sequence data, as the key input to train predictive models. These predictive models, often built upon deep learning techniques, can be used to make predictions about the future states of business process execution. We apply attention mechanism to achieve model interpretability. We propose i) two types of attentions event attention to capture the impact of specific process events on a prediction, and attribute attention to reveal which attribute(s) of an event influenced the prediction and ii) two attention mechanisms shared attention mechanism and specialised attention mechanism to reflect different design decisions in when to construct attribute attention on individual input features (specialised) or using the concatenated feature tensor of all input feature vectors (shared). These lead to two distinct attention based models, and both are interpretable models that incorporate interpretability directly into the structure of a process predictive model. We conduct experimental evaluation of the proposed models using real life dataset, and comparative analysis between the models for accuracy and interpretability, and draw insights from the evaluation and analysis results.


Wavelength Shifting Performance of Polyethylene Naphthalate Films in a Liquid Argon Environment. Liquid argon is commonly used as a detector medium for neutrino physics and dark matter experiments in part due to its copious scintillation light production in response to its excitation and ionization by charged particle interactions. As argon scintillation appears in the vacuum ultraviolet (VUV) regime and is difficult to detect, wavelength shifting materials are typically used to convert VUV light to visible wavelengths more easily detectable by conventional means. In this work, we examine the wavelength shifting and optical properties of poly(ethylene naphthalate) (PEN), a recently proposed alternative to tetraphenyl butadiene (TPB), the most widely used wavelength shifter in argon based experiments. In a custom cryostat system with well demonstrated geometric and response stability, we use 128 nm argon scintillation light to examine various PEN including reflective samples' light producing capabilities, and study the stability of PEN when immersed in liquid argon. The best performing PEN including test reflector was found to produce 34 as much visible light as a TPB including reference sample, with widely varying levels of light production between different PEN including test reflectors. Plausible origins for these variations, including differences in optical properties and molecular orientation, are then identified using additional measurements. Unlike TPB coated samples, PEN coated samples did not produce long timescale light collection increases associated with solvation or suspension of wavelength shifting material in bulk liquid argon.


On the simplicial volume and the Euler characteristic of (aspherical) manifolds. A well known question by Gromov asks whether the vanishing of the simplicial volume of oriented closed connected aspherical manifolds implies the vanishing of the Euler characteristic. We study various versions of Gromov's question and collect strategies towards affirmative answers and strategies towards negative answers to this problem. Moreover, we put Gromov's question into context with other open problems in low and high dimensional topology. A special emphasis is put on a comparative analysis of the additivity properties of the simplicial volume and the Euler characteristic for manifolds with boundary. We explain that the simplicial volume defines a symmetric monoidal functor (invertible TQFT) on the amenable cobordism category, but not on the whole cobordism category. In addition, using known computations of simplicial volumes, we conclude that the fundamental group of the 4 dimensional amenable cobordism category is not finitely generated. We also consider new variations of Gromov's question. Specifically, we show that counterexamples exist among aspherical spaces that are only homology equivalent to oriented closed connected manifolds.


Bilingual Language Modeling, A transfer learning technique for Roman Urdu. Pretrained language models are now of widespread use in Natural Language Processing. Despite their success, applying them to Low Resource languages is still a huge challenge. Although Multilingual models hold great promise, applying them to specific low resource languages e.g. Roman Urdu can be excessive. In this paper, we show how the code switching property of languages may be used to perform cross lingual transfer learning from a corresponding high resource language. We also show how this transfer learning technique termed Bilingual Language Modeling can be used to produce better performing models for Roman Urdu. To enable training and experimentation, we also present a collection of novel corpora for Roman Urdu extracted from various sources and social networking sites, e.g. Twitter. We train Monolingual, Multilingual, and Bilingual models of Roman Urdu the proposed bilingual model achieves 23 accuracy compared to the 2 and 11 of the monolingual and multilingual models respectively in the Masked Language Modeling (MLM) task.


GamePlan Game Theoretic Multi Agent Planning with Human Drivers at Intersections, Roundabouts, and Merging. We present a new method for multi agent planning involving human drivers and autonomous vehicles (AVs) in unsignaled intersections, roundabouts, and during merging. In multi agent planning, the main challenge is to predict the actions of other agents, especially human drivers, as their intentions are hidden from other agents. Our algorithm uses game theory to develop a new auction, called GamePlan, that directly determines the optimal action for each agent based on their driving style (which is observable via commonly available sensors). GamePlan assigns a higher priority to more aggressive or impatient drivers and a lower priority to more conservative or patient drivers we theoretically prove that such an approach is game theoretically optimal prevents collisions and deadlocks. We compare our approach with prior state of the art auction techniques including economic auctions, time based auctions (first in first out), and random bidding and show that each of these methods result in collisions among agents when taking into account driver behavior. We compare with methods based on DRL, deep learning, and game theory and present our benefits over these approaches. Finally, we show that our approach can be implemented in the real world with human drivers.


A Result based Portable Framework for Spoken Language Understanding. Spoken language understanding (SLU), which is a core component of the task oriented dialogue system, has made substantial progress in the research of single turn dialogue. However, the performance in multi turn dialogue is still not satisfactory in the sense that the existing multi turn SLU methods have low portability and compatibility for other single turn SLU models. Further, existing multi turn SLU methods do not exploit the historical predicted results when predicting the current utterance, which wastes helpful information. To gap those shortcomings, in this paper, we propose a novel Result based Portable Framework for SLU (RPFSLU). RPFSLU allows most existing single turn SLU models to obtain the contextual information from multi turn dialogues and takes full advantage of predicted results in the dialogue history during the current prediction. Experimental results on the public dataset KVRET have shown that all SLU models in baselines acquire enhancement by RPFSLU on multi turn SLU tasks.


On the Predictability of Utilizing Rank Percentile to Evaluate Scientific Impact. Bibliographic metrics are commonly utilized for evaluation purposes within academia, often in conjunction with other metrics. These metrics vary widely across fields and change with the seniority of the scholar consequently, the only way to interpret these values is by comparison with other academics within the same field who are of similar seniority. Among the field and time normalized indicators, rank percentile has grown in popularity, and it is preferred over other types of indicators. In this paper, we propose and justify a novel rank percentile indicator for scholars. Furthermore, we emphasize on the time factor that is built into the rank percentile, and we demonstrate that the rank percentile is highly predictable. The publication percentile is highly stable over time, while the scholar percentile exhibits short term stability and can be predicted via a simple linear regression model. More advanced models that utilize extensive lists of features offer slightly superior performance however, the simplicity and interpretability of the simple model impose significant advantages over the additional complexity of other models.


Recall and Learn A Memory augmented Solver for Math Word Problems. In this article, we tackle the math word problem, namely, automatically answering a mathematical problem according to its textual description. Although recent methods have demonstrated their promising results, most of these methods are based on template based generation scheme which results in limited generalization capability. To this end, we propose a novel human like analogical learning method in a recall and learn manner. Our proposed framework is composed of modules of memory, representation, analogy, and reasoning, which are designed to make a new exercise by referring to the exercises learned in the past. Specifically, given a math word problem, the model first retrieves similar questions by a memory module and then encodes the unsolved problem and each retrieved question using a representation module. Moreover, to solve the problem in a way of analogy, an analogy module and a reasoning module with a copy mechanism are proposed to model the interrelationship between the problem and each retrieved question. Extensive experiments on two well known datasets show the superiority of our proposed algorithm as compared to other state of the art competitors from both overall performance comparison and micro scope studies.


Classical orthogonal polynomials revisited. This manuscript contains a small portion of the algebraic theory of orthogonal polynomials developed by Maroni and their applicability to the study and characterization of the classical families, namely Hermite, Laguerre, Jacobi, and Bessel polynomials. It is presented a cyclical proof of some of the most relevant characterizations, particularly those due to Al Salam and Chihara, Bochner, Hahn, Maroni, and McCarthy. Two apparently new characterizations are also added. Moreover, it is proved through an equivalence relation that, up to constant factors and affine changes of variables, the four families of polynomials named above are the only families of classical orthogonal polynomials.


Simultaneous Neural Network Approximation for Smooth Functions. We establish in this work approximation results of deep neural networks for smooth functions measured in Sobolev norms, motivated by recent development of numerical solvers for partial differential equations using deep neural networks. Our approximation results are nonasymptotic in the sense that the error bounds are explicitly characterized in terms of both the width and depth of the networks simultaneously with all involved constants explicitly determined. Namely, for f in C s( 0,1 d) , we show that deep ReLU networks of width mathcal O (N log N ) and of depth mathcal O (L log L ) can achieve a nonasymptotic approximation rate of mathcal O (N 2(s 1) d L 2(s 1) d ) with respect to the mathcal W 1,p ( 0,1 d) norm for p in 1, infty) . If either the ReLU function or its square is applied as activation functions to construct deep neural networks of width mathcal O (N log N ) and of depth mathcal O (L log L ) to approximate f in C s( 0,1 d) , the approximation rate is mathcal O (N 2(s n) d L 2(s n) d ) with respect to the mathcal W n,p ( 0,1 d) norm for p in 1, infty) . An extension of similar approximation results is also provided for target functions in the H " o lder space.


Stable pi radical 2,2 diphenyl 1 picrylhydrazyl (DPPH) adsorbed at the elbows of 22 times sqrt 3 reconstructed Au(111). Stable organic radicals serve as model systems for investigating metal free magnetic phenomena at (sub)nanometer length scales. We have investigated at the single molecule level the stable pi radical 2,2 diphenyl 1 picrylhydrazyl (DPPH) adsorbed at the elbow sites of the 22 times sqrt 3 reconstructed Au(111) surface. Low temperature scanning tunneling microscopy (STM) and spectroscopy under ultrahigh vacuum conditions at 8 K reveal structural as well as frontier orbital related electronic details of DPPH Au(111). A Kondo like spectroscopic signature indicates preservation of the unpaired electron spin state.


Union closed Sets Conjecture Holds for Height No More Than 3 and Height No Less Than N 1. For each given union closed family F of n elements and m sets, we discuss the union closed sets conjecture from height number of the UC family, which is a natural parameter from lattice theory. In this paper, we call it height number of F(n, m), recorded as H(F). we prove that for any given union closed family F, union closed sets conjecture holds if its height number H(F) no more than 3 or no less than n 1. Since the height number H(F) is a positive integer which is bounded between 1 to n. As an attempted approach and framework, if we can prove union closed sets conjecture holds for all possible value of H(F), then union closed sets conjecture is true.


Continuous Entailment Patterns for Lexical Inference in Context. Combining a pretrained language model (PLM) with textual patterns has been shown to help in both zero and few shot settings. For zero shot performance, it makes sense to design patterns that closely resemble the text seen during self supervised pretraining because the model has never seen anything else. Supervised training allows for more flexibility. If we allow for tokens outside the PLM's vocabulary, patterns can be adapted more flexibly to a PLM's idiosyncrasies. Contrasting patterns where a "token" can be any continuous vector vs. those where a discrete choice between vocabulary elements has to be made, we call our method CONtinuous pAtterNs (CONAN). We evaluate CONAN on two established benchmarks for lexical inference in context (LIiC) a.k.a. predicate entailment, a challenging natural language understanding task with relatively small training sets. In a direct comparison with discrete patterns, CONAN consistently leads to improved performance, setting a new state of the art. Our experiments give valuable insights into the kind of pattern that enhances a PLM's performance on LIiC and raise important questions regarding our understanding of PLMs using text patterns.


A remark on ill posedness. Norm inflation implies certain discontinuous dependence of the solution on the initial value. The well posedness of the mild solution means the existence and uniqueness of the fixed points of the corresponding integral equation. For rm BMO 1 , Auscher Dubois Tchamitchian proved that Koch Tataru's solution is stable. In this paper, we construct a non Gauss flow function to show that, for classic Navier Stokes equations, wellposedness and norm inflation may have no conflict and stability may have meaning different to L infty (( rm BMO 1 ) n ) .


A Hardware Co design Workflow for Scientific Instruments at the Edge. As spatial and temporal resolutions of scientific instruments improve, the explosion in the volume of data produced is becoming a key challenge. It can be a critical bottleneck for integration between scientific instruments at the edge and high performance computers emerging accelerators. Placing data compression or reduction logic close to the data source is a possible approach to solve the bottleneck. However, the realization of such a solution requires the development of custom ASIC designs, which is still challenging in practice and tends to produce one off implementations unusable beyond the initial intended scope. Therefore, as a feasibility study, we have been investigating a design workflow that allows us to explore algorithmically complex hardware designs and develop reusable hardware libraries for the needs of scientific instruments at the edge. Our vision is to cultivate our hardware development capability for streaming dataflow hardware components that can be placed close to the data source to enable extreme data intensive scientific experiments or environmental sensing. Furthermore, reducing data movement is essential to improving computing performance in general. Therefore, our co design efforts on streaming hardware components can benefit computing applications other than scientific instruments. This vision paper discusses hardware specialization needs in scientific instruments and briefly reviews our progress leveraging the Chisel hardware description language and emerging open source hardware ecosystems, including a few design examples.


A Systematical Solution for Face De identification. With the identity information in face data more closely related to personal credit and property security, people pay increasing attention to the protection of face data privacy. In different tasks, people have various requirements for face de identification (De ID), so we propose a systematical solution compatible for these De ID operations. Firstly, an attribute disentanglement and generative network is constructed to encode two parts of the face, which are the identity (facial features like mouth, nose and eyes) and expression (including expression, pose and illumination). Through face swapping, we can remove the original ID completely. Secondly, we add an adversarial vector mapping network to perturb the latent code of the face image, different from previous traditional adversarial methods. Through this, we can construct unrestricted adversarial image to decrease ID similarity recognized by model. Our method can flexibly de identify the face data in various ways and the processed images have high image quality.


Coalition Formation Games for Improved Cell Edge User Service in Downlink NOMA and MU MIMO Small Cell Systems. In today's wireless communication systems, the exponentially growing needs of mobile users require the combination of new and existing techniques to meet the demands for reliable and high quality service provision. This may not always be possible, as the resources in wireless telecommunication systems are limited and a significant number of users, usually located at the cell edges, can suffer from severe interference. For this purpose, a new Joint Transmission Coordinated Multipoint (JT CoMP) scheme, in which the transmission points' clustering is based on a coalition formation game, is deployed alongside with Non Orthogonal Multiple Access (NOMA) in a Cloud Radio Access Network (C RAN) consisting of small cells. To further enhance the network's performance, Multiuser Multiple Input Multiple Output (MU MIMO) with Zero Forcing (ZF) beamforming is applied. The proposed scheme's performance, in terms of user throughput, is then compared to that of a scheme where JT CoMP with static clustering is selected, a JT CoMP scheme with clustering based on a greedy algorithm and a scenario where JT CoMP is not deployed. Simulation results confirm that the proposed scheme reliably improves the throughput of users with poor wireless channels while guaranteeing that the performance of the rest is not severely undermined.


Computer vision for liquid samples in hospitals and medical labs using hierarchical image segmentation and relations prediction. This work explores the use of computer vision for image segmentation and classification of medical fluid samples in transparent containers (for example, tubes, syringes, infusion bags). Handling fluids such as infusion fluids, blood, and urine samples is a significant part of the work carried out in medical labs and hospitals. The ability to accurately identify and segment the liquids and the vessels that contain them from images can help in automating such processes. Modern computer vision typically involves training deep neural nets on large datasets of annotated images. This work presents a new dataset containing 1,300 annotated images of medical samples involving vessels containing liquids and solid material. The images are annotated with the type of liquid (e.g., blood, urine), the phase of the material (e.g., liquid, solid, foam, suspension), the type of vessel (e.g., syringe, tube, cup, infusion bottle bag), and the properties of the vessel (transparent, opaque). In addition, vessel parts such as corks, labels, spikes, and valves are annotated. Relations and hierarchies between vessels and materials are also annotated, such as which vessel contains which material or which vessels are linked or contain each other. Three neural networks are trained on the dataset One network learns to detect vessels, a second net detects the materials and parts inside each vessel, and a third net identifies relationships and connectivity between vessels.


A Calculus for Flow Limited Authorization. Real world applications routinely make authorization decisions based on dynamic computation. Reasoning about dynamically computed authority is challenging. Integrity of the system might be compromised if attackers can improperly influence the authorizing computation. Confidentiality can also be compromised by authorization, since authorization decisions are often based on sensitive data such as membership lists and passwords. Previous formal models for authorization do not fully address the security implications of permitting trust relationships to change, which limits their ability to reason about authority that derives from dynamic computation. Our goal is an approach to constructing dynamic authorization mechanisms that do not violate confidentiality or integrity. The Flow Limited Authorization Calculus (FLAC) is a simple, expressive model for reasoning about dynamic authorization as well as an information flow control language for securely implementing various authorization mechanisms. FLAC combines the insights of two previous models it extends the Dependency Core Calculus with features made possible by the Flow Limited Authorization Model. FLAC provides strong end to end information security guarantees even for programs that incorporate and implement rich dynamic authorization mechanisms. These guarantees include noninterference and robust declassification, which prevent attackers from influencing information disclosures in unauthorized ways. We prove these security properties formally for all FLAC programs and explore the expressiveness of FLAC with several examples.


On Magic Distinct Labellings of Simple Graphs. A magic labelling of a graph G with magic sum s is a labelling of the edges of G by nonnegative integers such that for each vertex v in V , the sum of labels of all edges incident to v is equal to the same number s . Stanley gave remarkable results on magic labellings, but the distinct labelling case is much more complicated. We consider the complete construction of all magic labellings of a given graph G . The idea is illustrated in detail by dealing with three regular graphs. We give combinatorial proofs. The structure result was used to enumerate the corresponding magic distinct labellings.


Using Comics to Introduce and Reinforce Programming Concepts in CS1. Recent work investigated the potential of comics to support the teaching and learning of programming concepts and suggested several ways coding strips , a form of comic strip with its corresponding code, can be used. Building on this work, we tested the recommended use cases of coding strip in an undergraduate introductory computer science course at a large comprehensive university. At the end of the course, we surveyed students to assess their experience and found they benefited in various ways. Our work contributes a demonstration of the various ways comics can be used in introductory CS courses and an initial understanding of benefits and challenges with using comics in computing education gleaned from an analysis of students' survey responses and code submissions.


Optimal decay rate for the 2 D compressible Oldroyd B and Hall MHD model. In this paper, we are concerned with long time behavior of the strong solutions to the 2 D compressible Oldroyd B and Hall MHD model. By virtue of the Fourier splitting method and the time weighted energy estimate, we obtain the L 2 decay rate (1 t) frac 1 4 . According to the Littlewood Paley theory, we prove that the solutions belong to the critical Besov space with negative index. Finally, we show optimal decay rate in H 2 framework.


Second Order Finite Automata. Traditionally, finite automata theory has been used as a framework for the representation of possibly infinite sets of strings. In this work, we introduce the notion of second order finite automata, a formalism that combines finite automata with ordered decision diagrams, with the aim of representing possibly infinite em sets of sets of strings. Our main result states that second order finite automata can be canonized with respect to the second order languages they represent. Using this canonization result, we show that sets of sets of strings represented by second order finite automata are closed under the usual Boolean operations, such as union, intersection, difference and even under a suitable notion of complementation. Additionally, emptiness of intersection and inclusion are decidable. We provide two algorithmic applications for second order automata. First, we show that several width size minimization problems for deterministic and nondeterministic ODDs are solvable in fixed parameter tractable time when parameterized by the width of the input ODD. In particular, our results imply FPT algorithms for corresponding width size minimization problems for ordered binary decision diagrams (OBDDs) with a fixed variable ordering. Previously, only algorithms that take exponential time in the size of the input OBDD were known for width minimization, even for OBDDs of constant width. Second, we show that for each k and w one can count the number of distinct functions computable by ODDs of width at most w and length k in time h( Sigma ,w) cdot k O(1) , for a suitable h mathbb N times mathbb N rightarrow mathbb N . This improves exponentially on the time necessary to explicitly enumerate all such functions, which is exponential in both the width parameter w and in the length k of the ODDs.


Continuity of Topic, Interaction, and Query Learning to Quote in Online Conversations. Quotations are crucial for successful explanations and persuasions in interpersonal communications. However, finding what to quote in a conversation is challenging for both humans and machines. This work studies automatic quotation generation in an online conversation and explores how language consistency affects whether a quotation fits the given context. Here, we capture the contextual consistency of a quotation in terms of latent topics, interactions with the dialogue history, and coherence to the query turn's existing content. Further, an encoder decoder neural framework is employed to continue the context with a quotation via language generation. Experiment results on two large scale datasets in English and Chinese demonstrate that our quotation generation model outperforms the state of the art models. Further analysis shows that topic, interaction, and query consistency are all helpful to learn how to quote in online conversations.


Quantifying Cybersecurity Effectiveness of Dynamic Network Diversity. The deployment of monoculture software stacks can have devastating consequences because a single attack can compromise all of the vulnerable computers in cyberspace. This one vulnerability affects all phenomenon will continue until after software stacks are diversified, which is well recognized by the research community. However, existing studies mainly focused on investigating the effectiveness of software diversity at the building block level (e.g., whether two independent implementations indeed exhibit independent vulnerabilities) the effectiveness of enforcing network wide software diversity is little understood, despite its importance in possibly helping justify investment in software diversification. As a first step towards ultimately tackling this problem, we propose a systematic framework for modeling and quantifying the cybersecurity effectiveness of network diversity, including a suite of cybersecurity metrics. We also present an agent based simulation to empirically demonstrate the usefulness of the framework. We draw a number of insights, including the surprising result that proactive diversity is effective under very special circumstances, but reactive adaptive diversity is much more effective in most cases.


On Sobolev spaces of bounded subanalytic manifolds. We focus on the Sobolev spaces of bounded subanalytic submanifolds of mathbb R n . We prove that if M is such a manifold then the space mathscr C 0 infty(M) is dense in W 1,p (M, partial M) (the kernel of the trace operator) for all p le p M , where p M is the codimension in M of the singular locus of overline M setminus M . In the case where M is normal, i.e. when B(x 0, varepsilon) cap M is connected for every x 0 in overline M and varepsilon 0 small, we show that mathscr C infty( overline M ) is dense in W 1,p (M) for all such p . This yields some duality results between W 1,p ( Omega, partial Omega) and W 1,p' ( Omega) in the case where 1 p le p Omega and Omega is a bounded subanalytic open subset of mathbb R n , and consequently that W 1,p ( Omega, partial Omega) is reflexive for such p . As a byproduct, we deduce uniqueness of the (weak) solution of the Dirichlet problem associated with the Laplace equation. We then prove a version of Sobolev's Embedding Theorem for subanalytic bounded manifolds, show Gagliardo Nirenberg's inequality (for all p in 1, infty) ), and derive some versions of Poincar 'e Friedrichs' inequality. We finish with a generalization of Morrey's Embedding Theorem.


Towards an Online Empathetic Chatbot with Emotion Causes. Existing emotion aware conversational models usually focus on controlling the response contents to align with a specific emotion class, whereas empathy is the ability to understand and concern the feelings and experience of others. Hence, it is critical to learn the causes that evoke the users' emotion for empathetic responding, a.k.a. emotion causes. To gather emotion causes in online environments, we leverage counseling strategies and develop an empathetic chatbot to utilize the causal emotion information. On a real world online dataset, we verify the effectiveness of the proposed approach by comparing our chatbot with several SOTA methods using automatic metrics, expert based human judgements as well as user based online evaluation.


Accountability and Reconfiguration Self Healing Lattice Agreement. An accountable distributed system provides means to detect deviations of system components from their expected behavior. It is natural to complement fault detection with a reconfiguration mechanism, so that the system could heal itself, by replacing malfunctioning parts with new ones. In this paper, we describe a framework that can be used to implement a large class of accountable and reconfigurable replicated services. We build atop the fundamental lattice agreement abstraction lying at the core of storage systems and cryptocurrencies. Our asynchronous implementation of accountable lattice agreement ensures that every violation of consistency is followed by an undeniable evidence of misbehavior of a faulty replica. The system can then be seamlessly reconfigured by evicting faulty replicas, adding new ones and merging inconsistent states. We believe that this paper opens a direction towards asynchronous "self healing" systems that combine accountability and reconfiguration.


Multiplicative summations into algebraically closed fields. In this paper, extending our earlier program, we derive maximal canonical extensions for multiplicative summations into algebraically closed fields. We show that there is a well defined analogue to minimal polynomials for a series algebraic over a ring of series, the "scalar polynomial". When that ring is the domain of a summation mathfrak S , we derive the related concepts of the mathfrak S minimal polynomial for a series, which is mapped by mathfrak S to a scalar polynomial. When the scalar polynomial for a series has the form (t a) n , a is the unique value to which the series can be mapped by an extension of the original summation.


Recurrent Relations for Multiple of Triangular Numbers being Triangular Numbers. We search for triangular numbers that are multiples of other triangular numbers. It is found that for any positive non square integer multiplier, there is an infinity of multiples of triangular numbers that are triangular numbers and recurrent relations are deduced theoretically. If the multiplier is a squared integer, there is either one or no solution, depending on the multiplier value.


Two Metrics on Rooted Unordered Trees with Labels. The early development of a zygote can be mathematically described by a developmental tree. To compare developmental trees of different species, we need to define distances on trees. If children cells after a division are not distinguishable, developmental trees are represented by the space of rooted trees with possibly repeated labels, where all vertices are unordered. On this space, we define two metrics the best match metric and the left regular metric, which show some advantages over existing methods. If children cells after a division are partially distinguishable, developmental trees are represented by the space of rooted trees with possibly repeated labels, where vertices can be ordered or unordered. This space cannot have a metric. Instead, we define a semimetric, which is a variant of the best match metric. To compute the best match distance between two trees, the expected time complexity and worst case time complexity are both mathcal O (n 2) , where n is the tree size. To compute the left regular distance between two trees, the expected time complexity is mathcal O (n) , and the worst case time complexity is mathcal O (n log n) .


Silence is bliss in a Platonic relationship. We describe an effective active cloaking strategy for the scalar Helmholtz equation in three dimensions where multipole active sources are located at the vertices of the Platonic solids. A "silent zone" is created interior to the imaginary Platonic solid and only the incident field remains in a defined region exterior to the silent zone and active source configuration. This distribution of the sources ensures that the implementation of the cloaking strategy is extremely efficient. In particular, once the multipole source amplitudes required at a single source location are determined, the other source amplitudes can be calculated by simple post processing involving multiplication of the multipole source vector by a rotation matrix. The general nature of the problem means that the technique is relevant to any scalar wave field, including both acoustics and electromagnetism.


FLACK Counterexample Guided Fault Localization for Alloy Models. Fault localization is a practical research topic that helps developers identify code locations that might cause bugs in a program. Most existing fault localization techniques are designed for imperative programs (e.g., C and Java) and rely on analyzing correct and incorrect executions of the program to identify suspicious statements. In this work, we introduce a fault localization approach for models written in a declarative language, where the models are not "executed," but rather converted into a logical formula and solved using backend constraint solvers. We present FLACK, a tool that takes as input an Alloy model consisting of some violated assertion and returns a ranked list of suspicious expressions contributing to the assertion violation. The key idea is to analyze the differences between counterexamples, i.e., instances of the model that do not satisfy the assertion, and instances that do satisfy the assertion to find suspicious expressions in the input model. The experimental results show that FLACK is efficient (can handle complex, real world Alloy models with thousand lines of code within 5 seconds), accurate (can consistently rank buggy expressions in the top 1.9 of the suspicious list), and useful (can often narrow down the error to the exact location within the suspicious expressions).


Strongly Quasi local algebras and their K theories. In this paper, we introduce a notion of strongly quasi local algebras. They are defined for each discrete metric space with bounded geometry, and sit between the Roe algebra and the quasi local algebra. We show that strongly quasi local algebras are coarse invariants, hence encoding coarse geometric information of the underlying spaces. We prove that for a discrete metric space with bounded geometry which admits a coarse embedding into a Hilbert space, the inclusion of the Roe algebra into the strongly quasi local algebra induces an isomorphism in K theory.


HR NAS Searching Efficient High Resolution Neural Architectures with Lightweight Transformers. High resolution representations (HR) are essential for dense prediction tasks such as segmentation, detection, and pose estimation. Learning HR representations is typically ignored in previous Neural Architecture Search (NAS) methods that focus on image classification. This work proposes a novel NAS method, called HR NAS, which is able to find efficient and accurate networks for different tasks, by effectively encoding multiscale contextual information while maintaining high resolution representations. In HR NAS, we renovate the NAS search space as well as its searching strategy. To better encode multiscale image contexts in the search space of HR NAS, we first carefully design a lightweight transformer, whose computational complexity can be dynamically changed with respect to different objective functions and computation budgets. To maintain high resolution representations of the learned networks, HR NAS adopts a multi branch architecture that provides convolutional encoding of multiple feature resolutions, inspired by HRNet. Last, we proposed an efficient fine grained search strategy to train HR NAS, which effectively explores the search space, and finds optimal architectures given various tasks and computation resources. HR NAS is capable of achieving state of the art trade offs between performance and FLOPs for three dense prediction tasks and an image classification task, given only small computational budgets. For example, HR NAS surpasses SqueezeNAS that is specially designed for semantic segmentation while improving efficiency by 45.9 . Code is available at https github.com dingmyu HR NAS


Dyadic Carleson embedding and sparse domination of weighted composition operators on strictly pseudoconvex domains. In this paper, we study the behavior of the weighted composition operators acting on Bergman spaces defined on strictly pseudoconvex domains via the sparse domination technique from harmonic analysis. As a byproduct, we also prove a weighted type estimate for the weighted composition operators which is adapted to Sawyer testing conditions. Our results extend the work by the first author, Li, Shi and Wick under a much more general setting.


A Stylistic Analysis of Honest Deception The Case of Seinfeld TV Series Sitcom. Language is a powerful tool if used in the correct manner. It is the major mode of communication, and using the correct choice of words and styles can serve to have a long lasting impact. Stylistics is the study of the use of various language styles in communication to pass a message with a bigger impact or to communicate indirectly. Stylistic analysis, therefore, is the study of the use of linguistic styles in texts to determine how a style has been used, what is communicated and how it is communicated. Honest deception is the use of a choice of words to imply something different from the literal meaning. A person listening or reading a text where honest deception has been used and with a literal understanding may completely miss out on the point. This is because the issue of honesty and falsehood arises. However, it would be better to understand that honest deception is used with the intention of having a lasting impact rather than to deceive the readers, viewers or listeners. The major styles used in honest deception are hyperboles, litotes, irony and sarcasm. The Seinfeld Sitcom TV series was a situational TV comedy show aired from 1990 to 1998. the show attempts to bring to the understanding the daily life of a comedian and how comedian views life experiences and convert them into hilarious jokes. It also shows Jerry's struggle with getting the right partner from the many women who come into his life. Reflecting on honest deception in the Seinfeld sitcom TV series, this paper is going to investigate how honest deception has been used in the series, why it has been used and what is being communicated. The study is going to use a recapitulative form to give a better analysis and grouping of the different styles used in honest deception throughout the series.


Towards Shaping the Software Lifecycle with Methods and Practices. As software projects are very diverse, each software development process must be adjusted to the needs of the project and the corresponding development team. Frequently, we find different methods and practices combined in a so called hybrid development method. Research has shown that these hybrid methods evolve over time and are devised based on experience. However, when devising a hybrid method, the methods and practices used should cover the whole software project with its different phases including, among others, project management, requirements analysis, quality management, risk management, and implementation. In this paper, we analyze which methods and practices are used in which phase of a software project. Based on an initial survey with 27 practitioners, we provide a mapping of methods and practices to different project phases and vice versa. Despite the preliminary nature of our study and the small sample size, we observe three remarkable aspects (1) there are discrepancies between the intended use of methods and practices according to literature and the real use in practice, (2) practices are used more consistently than methods, and (3) parts of the software lifecycle such as maintenance and evolution are hardly covered by widely distributed methods and practices. Consequently, when devising a development process, it is worth a thought whether all phases of the software lifecycle are addressed or not.


Characterization of coextensive varieties of universal algebras II. A coextensive category can be defined as a category mathcal C with finite products such that for each pair X,Y of objects in mathcal C , the canonical functor times colon X mathcal C times Y mathcal C to (X times Y) mathcal C is an equivalence. We give a syntactical characterization of coextensive varieties of universal algebras. This paper is an updated version of the pre print arXiv 2008.03474


Onset of internal transport barriers in tokamaks. Barriers have been identified in magnetically confined plasmas reducing the particle transport and improving the confinement. One of them, the primary shearless barriers are associated to extrema of non monotonic plasma profiles. Previously, we identified these barriers in a model described by a map that allows the integration of charged particles motion in drift waves for a long time scale. In this work, we show how the existence of these robust barriers depends on the fluctuation amplitude and on the electric shear. Moreover, we also find control parameter intervals for which these primary barriers onset and break up are recurrent. Another noticeable feature, in these transitions, is the appearance of a layer of particle trajectory stickiness after the shearless barrier break up or before its onset. Besides the mentioned primary barriers, we also observe sequences of secondary shearless barriers, not reported before, created and destroyed by a sequence of bifurcations as the main control parameters, the fluctuation amplitude and electric shear, are varied. Furthermore, in these bifurcations, we also find hitherto unknown double and triple secondary shearless barriers which constitute a noticeable obstacle to the chaotic transport.


Hard Samples Rectification for Unsupervised Cross domain Person Re identification. Person re identification (re ID) has received great success with the supervised learning methods. However, the task of unsupervised cross domain re ID is still challenging. In this paper, we propose a Hard Samples Rectification (HSR) learning scheme which resolves the weakness of original clustering based methods being vulnerable to the hard positive and negative samples in the target unlabelled dataset. Our HSR contains two parts, an inter camera mining method that helps recognize a person under different views (hard positive) and a part based homogeneity technique that makes the model discriminate different persons but with similar appearance (hard negative). By rectifying those two hard cases, the re ID model can learn effectively and achieve promising results on two large scale benchmarks.


Marked relative invariants and GW PT correspondences. We introduce marked relative Pandharipande Thomas (PT) invariants for a pair (X,D) of a smooth projective threefold and a smooth divisor. These invariants are defined by integration over the moduli space of r marked stable pairs on (X,D) , and appear naturally when degenerating diagonal insertions via the Li Wu degeneration formula. We propose a Gromov Witten (GW) PT correspondence for marked relative invariants. We show compatibility of the conjecture with the degeneration formula and a splitting formula for relative diagonals. The results provide new tools to prove GW PT correspondences for varieties with vanishing cohomology. As an application we prove the GW PT correspondence for (i) all Fano complete intersections, and (ii) the reduced theories of (S times C, S times z 1, ldots, z N ) where S is a K3 surface and C is a curve, for all curve classes which have divisibility at most 2 over the K3 surface. In the appendix we introduce a notion of higher descendent invariants which can be seen as an analogue of the nodal Gromov Witten invariants defined by Arg "uz, Bousseau, Pandharipande and Zvonkine in cite ABPZ . We show that the higher descendent invariants reduce to marked relative invariants with diagonal insertions.


Chance constrained problems a bilevel convex optimization perspective. Chance constraints are a valuable tool for the design of safe decisions in uncertain environments they are used to model satisfaction of a constraint with a target probability. However, because of possible non convexity and non smoothness, optimizing over a chance constrained set is challenging. In this paper, we establish an exact reformulation of chance constrained problems as a bilevel problems with convex lower levels. We then derive a tractable penalty approach, where the penalized objective is a difference of convex function that we minimize with a suitable bundle algorithm. We release an easy to use open source python toolbox implementing the approach, with a special emphasis on fast computational subroutines.


Regular Calculi I Graphical Regular Logic. What is ergonomic syntax for relations? In this first paper in a series of two, to answer the question we define regular calculi a suitably structured functor from a category representing the syntax of regular logic to the category of posets, that takes each object to the poset of relations on that type. We introduce two major classes of examples, regular calculi corresponding to regular theories, and regular calculi corresponding to regular categories. For working in regular calculi, we present a graphical framework which takes as primitive the various moves of regular logic. Our main theorem for regular calculi is a syntax semantics 2 dimensional adjunction to regular categories.


Building Chinese Biomedical Language Models via Multi Level Text Discrimination. Pre trained language models (PLMs), such as BERT and GPT, have revolutionized the field of NLP, not only in the general domain but also in the biomedical domain. Most prior efforts in building biomedical PLMs have resorted simply to domain adaptation and focused mainly on English. In this work we introduce eHealth, a Chinese biomedical PLM built from scratch with a new pre training framework. This new framework pre trains eHealth as a discriminator through both token and sequence level discrimination. The former is to detect input tokens corrupted by a generator and recover their original identities from plausible candidates, while the latter is to further distinguish corruptions of a same original sequence from those of others. As such, eHealth can learn language semantics at both token and sequence levels. Extensive experiments on 11 Chinese biomedical language understanding tasks of various forms verify the effectiveness and superiority of our approach. We release the pre trained model at url https github.com PaddlePaddle Research tree master KG eHealth and will also release the code later.


Universality theorem for the iterated integrals of the logarithm of the Riemann zeta function. In this paper, we prove the universality theorem for the iterated integrals of the logarithm of the Riemann zeta function on some line parallel to the real axis.


Frequency robust preconditioning of boundary integral equations for acoustic transmission. The scattering and transmission of harmonic acoustic waves at a penetrable material are commonly modelled by a set of Helmholtz equations. This system of partial differential equations can be rewritten into boundary integral equations defined at the surface of the objects and solved with the boundary element method (BEM). High frequencies or geometrical details require a fine surface mesh, which increases the number of degrees of freedom in the weak formulation. Then, matrix compression techniques need to be combined with iterative linear solvers to limit the computational footprint. Moreover, the convergence of the iterative linear solvers often depends on the frequency of the wave field and the objects' characteristic size. Here, the robust PMCHWT formulation is used to solve the acoustic transmission problem. An operator preconditioner based on on surface radiation conditions (OSRC) is designed that yields frequency robust convergence characteristics. Computational benchmarks compare the performance of this novel preconditioned formulation with other preconditioners and boundary integral formulations. The OSRC preconditioned PMCHWT formulation effectively simulates large scale problems of engineering interest, such as focused ultrasound treatment of osteoid osteoma.


Expected uniform integration approximation under general equal measure partition. In this paper, we study bounds of expected L 2 discrepancy to give mean square error of uniform integration approximation for functions in Sobolev space mathcal H mathbf 1 (K) , where mathcal H is a reproducing Hilbert space with kernel K . Better order O(N 1 frac 1 d ) of approximation error is obtained, comparing with previously known rate O(N 1 ) using crude Monte Carlo method. Secondly, we use expected L p discrepancy bound( p ge 1 ) of stratified samples to give several upper bounds of p moment of integral approximation error in general Sobolev space F d,q .


Does intermittency affect the inertial transfer rate in stationary isotropic turbulence?. Direct numerical simulations of the forced Navier Stokes equations were performed, in which each shell averaged quantity evolved from a value appropriate to an initial Gaussian state, to fluctuate about a mean value. Once the transient had passed, mean values (and their associated statistics) were obtained by sampling the evolved time series at intervals of the order of an eddy turnover time. This was repeated for a range of Taylor Reynolds numbers from 10.6 to 335.2. With increasing Reynolds number, our results for energy spectra, transfer spectra and inertial flux supported the Kolmogorov Obukhov picture of turbulent energy transfer. In particular, we observed the onset of scale invariance of the inertial flux, accompanied by the onset of the 5 3 power law in the energy spectrum for the corresponding inertial range of wavenumbers. Detailed comparisons showed that our results were in agreement with those found in many other investigations. Flow visualization methods were used to study the internal intermittency. This phenomenon is seen in single realisations but was found to average out with increasing number of realisations under ensemble averaging. Following a critical review of the literature relating to the controversy about intermittency effects versus finite Reynolds number corrections, it was concluded that, for the case of stationary isotropic turbulence, internal intermittency cannot affect the Kolmogorov Obukhov picture, as this is constructed entirely in terms of ensemble averaged mean quantities.


A degenerate elliptic parabolic system arising in competitive contaminant transport. In this work we investigate a coupled system of degenerate and nonlinear partial differential equations governing the transport of reactive solutes in groundwater. We show that the system admits a unique weak solution provided the nonlinear adsorption isotherm associated with the reaction process satisfies certain physically reasonable structural conditions. We conclude, moreover, that the solute concentrations stay non negative if the source term is componentwise non negative and investigate numerically the finite speed of propagation of compactly supported initial concentrations, in a two component test case.


Enhancement of electromagnetically induced transparency based Rydberg atom electrometry through population repumping. We demonstrate improved sensitivity of Rydberg electrometry based on electromagnetically induced transparency (EIT) with a ground state repumping laser. Though there are many factors that limit the sensitivity of radio frequency field measurements, we show that repumping can enhance the interaction strength while avoiding additional Doppler or power broadening. Through this method, we nearly double the EIT amplitude without an increase in the width of the peak. A similar increase in amplitude without the repumping field is not possible through simple optimization.We also establish that one of the key limits to detection is the photon shot noise of the probe laser. We show an improvement on the sensitivity of the device by a factor of nearly 2 in the presence of the repump field.


XAI N Sensor based Robot Navigation using Expert Policies and Decision Trees. We present a novel sensor based learning navigation algorithm to compute a collision free trajectory for a robot in dense and dynamic environments with moving obstacles or targets. Our approach uses deep reinforcement learning based expert policy that is trained using a sim2real paradigm. In order to increase the reliability and handle the failure cases of the expert policy, we combine with a policy extraction technique to transform the resulting policy into a decision tree format. The resulting decision tree has properties which we use to analyze and modify the policy and improve performance on navigation metrics including smoothness, frequency of oscillation, frequency of immobilization, and obstruction of target. We are able to modify the policy to address these imperfections without retraining, combining the learning power of deep learning with the control of domain specific algorithms. We highlight the benefits of our algorithm in simulated environments and navigating a Clearpath Jackal robot among moving pedestrians. (Videos at this url https gamma.umd.edu researchdirections xrl navviper)


Shadowing as a Structural Property of the Space of Dynamical Systems. We demonstrate that there is a large class of compact metric spaces for which the shadowing property can be characterized as a structural property of the space of dynamical systems. We also demonstrate for this class of spaces, that in order to determine whether a system has shadowing, it is sufficient to check that continuously generated pseudo orbits can be shadowed.


A design of human like robust AI machines in object identification. This is a perspective paper inspired from the study of Turing Test proposed by A.M. Turing (23 June 1912 7 June 1954) in 1950. Following one important implication of Turing Test for enabling a machine with a human like behavior or performance, we define human like robustness (HLR) for AI machines. The objective of the new definition aims to enforce AI machines with HLR, including to evaluate them in terms of HLR. A specific task is discussed only on object identification, because it is the most common task for every person in daily life. Similar to the perspective, or design, position by Turing, we provide a solution of how to achieve HLR AI machines without constructing them and conducting real experiments. The solution should consists of three important features in the machines. The first feature of HLR machines is to utilize common sense from humans for realizing a causal inference. The second feature is to make a decision from a semantic space for having interpretations to the decision. The third feature is to include a "human in the loop" setting for advancing HLR machines. We show an "identification game" using proposed design of HLR machines. The present paper shows an attempt to learn and explore further from Turing Test towards the design of human like AI machines.


Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration. Registering point clouds of dressed humans to parametric human models is a challenging task in computer vision. Traditional approaches often rely on heavily engineered pipelines that require accurate manual initialization of human poses and tedious post processing. More recently, learning based methods are proposed in hope to automate this process. We observe that pose initialization is key to accurate registration but existing methods often fail to provide accurate pose initialization. One major obstacle is that, regressing joint rotations from point clouds or images of humans is still very challenging. To this end, we propose novel piecewise transformation fields (PTF), a set of functions that learn 3D translation vectors to map any query point in posed space to its correspond position in rest pose space. We combine PTF with multi class occupancy networks, obtaining a novel learning based framework that learns to simultaneously predict shape and per point correspondences between the posed space and the canonical space for clothed human. Our key insight is that the translation vector for each query point can be effectively estimated using the point aligned local features consequently, rigid per bone transformations and joint rotations can be obtained efficiently via a least square fitting given the estimated point correspondences, circumventing the challenging task of directly regressing joint rotations from neural networks. Furthermore, the proposed PTF facilitate canonicalized occupancy estimation, which greatly improves generalization capability and results in more accurate surface reconstruction with only half of the parameters compared with the state of the art. Both qualitative and quantitative studies show that fitting parametric models with poses initialized by our network results in much better registration quality, especially for extreme poses.


Compact representation for matrices of bounded twin width. For every fixed d in mathbb N , we design a data structure that represents a binary n times n matrix that is d twin ordered. The data structure occupies O d(n) bits, which is the least one could hope for, and can be queried for entries of the matrix in time O d( log log n) per query.


A Data Science Approach to Analyze the Association of Socioeconomic and Environmental Conditions With Disparities in Pediatric Surgery. Scientific evidence confirm that significant racial disparities exist in healthcare, including surgery outcomes. However, the causal pathway underlying disparities at preoperative physical condition of children is not well understood. This research aims to uncover the role of socioeconomic and environmental factors in racial disparities at the preoperative physical condition of children through multidimensional integration of several data sources at the patient and population level. After the data integration process an unsupervised k means algorithm on neighborhood quality metrics was developed to split 29 zip codes from Memphis, TN into good and poor quality neighborhoods. An unadjusted comparison of African Americans and white children showed that the prevalence of poor preoperative condition is significantly higher among African Americans compared to whites. No statistically significant difference in surgery outcome was present when adjusted by surgical severity and neighborhood quality. The socioenvironmental factors affect the preoperative clinical condition of children and their surgical outcomes.


Two typical collective behaviors of the heavy ions expanding in cold plasma with ambient magnetic field. We have numerically studied the evolution of the heavy ions that expand in a cold background plasma at a large scale. Two typical collective behaviors of the heavy ions are identified with the conditions where only the traversing heavy ion's initial total mass is different. Our work has demonstrated that a difference in the initial total mass of the moving heavy ions is able to induce completely different collective behaviors of the plasma. The simulation is performed via the hybrid model, in which the ions and electrons are treated as classical particles and mass less fluid, respectively. Due to the imbalance of the electric and magnetic force on the heavy ions, these particles will evolve into different collective patterns at the later time. These patterns manifest a rather different stopping behavior of the moving ions and an opposite drifting direction of the electron fluid at the rim of the expanding plasma. Further numerical and analytical calculations show that the imbalance depends not only on the number densities of the plasma ions, but also on the spatial variations of the magnetic fields. Our work reveals that the collective behavior of the heavy ions is highly non linear, and the non linearity is able to induce different phenomena in the evolution of the system at a large scale.