Glutathione conjugates of the mercapturic acid pathway and guanine adduct as biomarkers of exposure to CEES, a sulfur mustard analog. Sulfur mustard (SM), a chemical warfare agent, is a strong alkylating compound that readily reacts with numerous biomolecules. The goal of the present work was to define and validate new biomarkers of exposure to SM that could be easily accessible in urine or plasma. Because investigations using SM are prohibited by the Organization for the Prohibition of Chemical Weapons, we worked with 2 chloroethyl ethyl sulfide (CEES), a monofunctional analog of SM. We developed an ultra high pressure liquid chromatography tandem mass spectrometry approach (UHPLC MS MS) to the conjugate of CEES to glutathione and two of its metabolites, the cysteine and the N acetyl cysteine conjugates. The N7 guanine adduct of CEES (N7Gua CEES) was also targeted. After synthesizing the specific biomarkers, a solid phase extraction protocol and a UHPLC MS MS method with isotopic dilution were optimized. We were able to quantify N7Gua CEES in the DNA of HaCaT keratinocytes and of explants of human skin exposed to CEES. N7Gua CEES was also detected in the culture medium of these two models, together with the glutathione and the cysteine conjugates. In contrast, the N acetyl cysteine conjugate was not detected. The method was then applied to plasma from mice cutaneously exposed to CEES. All four markers could be detected. Our present results thus validate both the analytical technique and the biological relevance of new, easily quantifiable biomarkers of exposure to CEES. Because CEES behaves very similarly to SM, the results are promising for application to this toxic of interest.


On the square of the antipode in a connected filtered Hopf algebra. Marcelo Aguiar and Aaron Lauve have shown that if H is a connected graded Hopf algebra over a field, then its antipode S satisfies ( operatorname id S 2) n (H n) 0 for any positive integer n , where H n denotes the n th graded component of H . In later work, Aguiar improved this to ( operatorname id S) ( operatorname id S 2) n 1 (H n) 0 . For the Malvenuto Reutenauer Hopf algebra, Aguiar and Lauve have furthermore shown the stronger claim ( operatorname id S 2) n 1 (H n) 0 for n 1 . In this note, we generalize these results in several directions and reprove them using elementary manipulations of tensors. In particular, the connected graded Hopf algebra is replaced by a connected filtered coalgebra (with operatorname id and S 2 becoming coalgebra homomorphisms satisfying certain conditions).


A Unified Framework for Hopsets and Spanners. Given an undirected graph G (V,E) , an em ( alpha, beta) spanner H (V,E') is a subgraph that approximately preserves distances for every u,v in V , d H(u,v) le alpha cdot d G(u,v) beta . An ( alpha, beta) hopset is a graph H (V,E") , so that adding its edges to G guarantees every pair has an alpha approximate shortest path that has at most beta edges (hops), that is, d G(u,v) le d G cup H ( beta) (u,v) le alpha cdot d G(u,v) . Given the usefulness of spanners and hopsets for fundamental algorithmic tasks, several different algorithms and techniques were developed for their construction, for various regimes of the stretch parameter alpha . In this work we develop a single algorithm that can attain all state of the art spanners and hopsets for general graphs, by choosing the appropriate input parameters. In fact, in some cases it also improves upon the previous best results. We also show a lower bound on our algorithm. In cite BP20 , given a parameter k , a (O(k epsilon ),O(k 1 epsilon )) hopset of size tilde O (n 1 1 k ) was shown for any n vertex graph and parameter 0 epsilon 1 , and they asked whether this result is best possible. We resolve this open problem, showing that any ( alpha, beta) hopset of size O(n 1 1 k ) must have alpha cdot beta ge Omega(k) .


FLAT An Optimized Dataflow for Mitigating Attention Bottlenecks. Attention mechanisms, primarily designed to capture pairwise correlations between words, have become the backbone of machine learning, expanding beyond natural language processing into other domains. This growth in adaptation comes at the cost of prohibitively large memory requirements and computational complexity, especially at higher number of input elements. This limitation is due to inherently limited data reuse opportunities and quadratic growth in memory footprints, leading to severe memory boundedness and limited scalability of input elements. This work addresses these challenges by devising a tailored dataflow optimization, called FLAT, for attention mechanisms without altering their functionality. This dataflow processes costly attention operations through a unique fusion mechanism, transforming the memory footprint quadratic growth to merely a linear one. To realize the full potential of this bespoke mechanism, we propose a tiling approach to enhance the data reuse across attention operations. Our method both mitigates the off chip bandwidth bottleneck as well as reduces the on chip memory requirement. Across a diverse range of models, FLAT delivers 1.94x (1.76x) speedup and 49 and (42 ) of energy savings compared to the state of the art edge (cloud) accelerators with no customized dataflow optimization. Our evaluations demonstrate that state of the art DNN dataflows applied to attention operations reach the efficiency limit for inputs above 512 elements. In contrast, FLAT unblocks transformer models for inputs with up to 64 K elements in edge and cloud accelerators.


A Common Semantic Model of the GDPR Register of Processing Activities. The creation and maintenance of a Register of Processing Activities (ROPA) is an essential process for the demonstration of GDPR compliance. We analyse ROPA templates from six EU Data Protection Regulators and show that template scope and granularity vary widely between jurisdictions. We then propose a flexible, consolidated data model for consistent processing of ROPAs (CSM ROPA). We analyse the extent that the Data Privacy Vocabulary (DPV) can be used to express CSM ROPA. We find that it does not directly address modelling ROPAs, and so needs additional concept definitions. We provide a mapping of our CSM ROPA to an extension of the Data Privacy Vocabulary.


Le th 'eor eme d'Andr 'e Chudnovsky Katz. The subject of this Master 2 thesis is the study of the Andr 'e Chudnovsky Katz theorem on the structure of the solution of the nonzero differential equation of minimal order with coefficients in overline mathbb Q (z) satisfied by a G function. We begin by presenting the theory of globally nilpotent differential operators, of which the main result is the Katz theorem, which states that they are fuchsian with rational exponents. We then give a full proof of the Chudnovsky theorem implying that the minimal nonzero differential operator with coefficients in overline mathbb Q (z) of a G function satisfies a moderate growth condition on some denominators called the Galochkin condition. We finally outline the proof of the Andr 'e Bombieri theorem establishing the equivalence between the Galochkin condition and the Bombieri condition, which implies the global nilpotence. This allows us to prove the main point of the Andr 'e Chudnovsky Katz theorem.


Critical phenomena in the market of competing firms induced by state interventionism. We achieve two primary goals in this work. First, we propose a flexible algorithm that can simulate various scenarios of state government intervention. Secondly, we analyze the scenario exhibiting the critical behavior of the market of competing firms, which depends on the degree of government intervention and the activity level of the firms. Thus, we have analyzed the second order phase transition series, finding the levels of critical intervention and the critical exponent values. As a result, we have observed a sharp increase of fluctuations at a critical intervention level and the local breakdown of the average market technology concerning the frontier technology.


This looks more like that Enhancing Self Explaining Models by Prototypical Relevance Propagation. Current machine learning models have shown high efficiency in solving a wide variety of real world problems. However, their black box character poses a major challenge for the understanding and traceability of the underlying decision making strategies. As a remedy, many post hoc explanation and self explanatory methods have been developed to interpret the models' behavior. These methods, in addition, enable the identification of artifacts that can be learned by the model as class relevant features. In this work, we provide a detailed case study of the self explaining network, ProtoPNet, in the presence of a spectrum of artifacts. Accordingly, we identify the main drawbacks of ProtoPNet, especially, its coarse and spatially imprecise explanations. We address these limitations by introducing Prototypical Relevance Propagation (PRP), a novel method for generating more precise model aware explanations. Furthermore, in order to obtain a clean dataset, we propose to use multi view clustering strategies for segregating the artifact images using the PRP explanations, thereby suppressing the potential artifact learning in the models.


Supervising the Transfer of Reasoning Patterns in VQA. Methods for Visual Question Anwering (VQA) are notorious for leveraging dataset biases rather than performing reasoning, hindering generalization. It has been recently shown that better reasoning patterns emerge in attention layers of a state of the art VQA model when they are trained on perfect (oracle) visual inputs. This provides evidence that deep neural networks can learn to reason when training conditions are favorable enough. However, transferring this learned knowledge to deployable models is a challenge, as much of it is lost during the transfer. We propose a method for knowledge transfer based on a regularization term in our loss function, supervising the sequence of required reasoning operations. We provide a theoretical analysis based on PAC learning, showing that such program prediction can lead to decreased sample complexity under mild hypotheses. We also demonstrate the effectiveness of this approach experimentally on the GQA dataset and show its complementarity to BERT like self supervised pre training.


Not all users are the same Providing personalized explanations for sequential decision making problems. There is a growing interest in designing autonomous agents that can work alongside humans. Such agents will undoubtedly be expected to explain their behavior and decisions. While generating explanations is an actively researched topic, most works tend to focus on methods that generate explanations that are one size fits all. As in the specifics of the user model are completely ignored. The handful of works that look at tailoring their explanation to the user's background rely on having specific models of the users (either analytic models or learned labeling models). The goal of this work is thus to propose an end to end adaptive explanation generation system that begins by learning the different types of users that the agent could interact with. Then during the interaction with the target user, it is tasked with identifying the type on the fly and adjust its explanations accordingly. The former is achieved by a data driven clustering approach while for the latter, we compile our explanation generation problem into a POMDP. We demonstrate the usefulness of our system on two domains using state of the art POMDP solvers. We also report the results of a user study that investigates the benefits of providing personalized explanations in a human robot interaction setting.


Diffusiophoresis in a Near critical Binary Fluid Mixture. We suppose that a rigid spherical particle is put into a binary fluid mixture with the critical composition in the homogeneous phase near the demixing critical point. A short range interaction is assumed between each component and the particle surface, and one component is assumed to be attracted more than the other by the surface. The adsorption layer, where the preferred component is more concentrated, can be significantly thick owing to a large susceptibility. In this situation, an imposed composition gradient causes a particle motion, i.e., diffusiophoresis emerges from a mechanism not considered previously. We calculate how the mobility depends on the temperature and particle size.


Referring Transformer A One step Approach to Multi task Visual Grounding. As an important step towards visual reasoning, visual grounding (e.g., phrase localization, referring expression comprehension segmentation) has been widely explored Previous approaches to referring expression comprehension (REC) or segmentation (RES) either suffer from limited performance, due to a two stage setup, or require the designing of complex task specific one stage architectures. In this paper, we propose a simple one stage multi task framework for visual grounding tasks. Specifically, we leverage a transformer architecture, where two modalities are fused in a visual lingual encoder. In the decoder, the model learns to generate contextualized lingual queries which are then decoded and used to directly regress the bounding box and produce a segmentation mask for the corresponding referred regions. With this simple but highly contextualized model, we outperform state of the arts methods by a large margin on both REC and RES tasks. We also show that a simple pre training schedule (on an external dataset) further improves the performance. Extensive experiments and ablations illustrate that our model benefits greatly from contextualized information and multi task training.


Alexander modules, Mellin transformation and variations of mixed Hodge structures. To any complex algebraic variety endowed with a morphism to a complex affine torus we associate multivariable cohomological Alexander modules, and define natural mixed Hodge structures on their maximal Artinian submodules. The key ingredients of our construction are Gabber Loeser's Mellin transformation and Hain Zucker's work on unipotent variations of mixed Hodge structures. As applications, we prove the quasi unipotence of monodromy, we obtain upper bounds on the sizes of the Jordan blocks of monodromy, and we explore the change in the Alexander modules after removing fibers of the map. We also give an example of a variety whose Alexander module has non semisimple torsion.


Computer assisted proofs for some nonlinear diffusion problems. In the last three decades, powerful computer assisted techniques have been developed in order to validate a posteriori numerical solutions of semilinear elliptic problems of the form Delta u f(u, nabla u) 0 . By studying a well chosen fixed point problem defined around the numerical solution, these techniques make it possible to prove the existence of a solution in an explicit (and usually small) neighborhood the numerical solution. In this work, we develop a similar approach for a broader class of systems, including nonlinear diffusion terms of the form Delta Phi(u) . In particular, this enables us to obtain new results about steady states of a cross diffusion system from population dynamics the (non triangular) SKT model. We also revisit the idea of automatic differentiation in the context of computer assisted proof, and propose an alternative approach based on differential algebraic equations.


A fine property of Whitehead's algorithm. We develop a refinement of Whitehead's algorithm for primitive words in a free group. We generalize to subgroups, establishing a strengthened version of Whitehead's algorithm for free factors. We make use of these refinements in proving new results about primitive elements and free factors in a free group. These include a relative version of Whitehead's algorithm, and a criterion that tests whether a subgroup is a free factor just by looking at its primitive elements. We develop an algorithm to determine whether or not two vertices in the free factor complex have distance d for d 1,2,3 , as well as d 4 in a special case.


Effect of viscous shearing stresses on optimal material designs for flow of fluids through porous media. Topology optimization offers optimal material layouts, enabling automation in the design of devices. Given the recent advances in computer technology and additive manufacturing, topology optimization is increasingly being used to design complex porous structures, for example, microfluidic devices. For the flow of fluids in such miniature sized porous structures, viscous shearing stress will be significant. But the Darcy model the most popular mathematical model describing the flow of a single phase incompressible fluid in rigid porous media neglects the internal friction arising from viscous shearing stress. We will therefore develop a material design framework under the topology optimization based on the Darcy Brinkman model a mathematical model for the flow of fluids through porous media that accounts for internal friction besides the drag considered in the Darcy model. The proposed framework uses the total rate of mechanical dissipation a physical quantity for the objective function. To understand the effect of viscous shearing stress on the design, we will compare the optimal material layouts provided by the Darcy and Darcy Brinkman models under topology optimization. In particular, we show, using analytical solutions corroborated by numerical simulations, that the optimal material layouts are identical for the class of problems exhibiting axisymmetry, for which viscous shearing stress vanishes. These analytical solutions will be valuable to check the veracity of numerical simulators. For those problems with dominant viscous shearing stresses (e.g., flow in a backward facing step domain), we show, using numerical solutions, that the optimal material layouts under the Darcy and Darcy Brinkman models are very different. Also, the associated solution fields (i.e., velocity and pressure) are qualitatively different under their respective optimal layouts for these two models.


Word level Sign Language Recognition with Multi stream Neural Networks Focusing on Local Regions. In recent years, Word level Sign Language Recognition (WSLR) research has gained popularity in the computer vision community, and thus various approaches have been proposed. Among these approaches, the method using I3D network achieves the highest recognition accuracy on large public datasets for WSLR. However, the method with I3D only utilizes appearance information of the upper body of the signers to recognize sign language words. On the other hand, in WSLR, the information of local regions, such as the hand shape and facial expression, and the positional relationship among the body and both hands are important. Thus in this work, we utilized local region images of both hands and face, along with skeletal information to capture local information and the positions of both hands relative to the body, respectively. In other words, we propose a novel multi stream WSLR framework, in which a stream with local region images and a stream with skeletal information are introduced by extending I3D network to improve the recognition accuracy of WSLR. From the experimental results on WLASL dataset, it is evident that the proposed method has achieved about 15 improvement in the Top 1 accuracy than the existing conventional methods.


Ranks of linear matrix pencils separate simultaneous similarity orbits. This paper solves the two sided version and provides a counterexample to the general version of the 2003 conjecture by Hadwin and Larson. Consider evaluations of linear matrix pencils L T 0 x 1T 1 cdots x mT m on matrix tuples as L(X 1, dots,X m) I otimes T 0 X 1 otimes T 1 cdots X m otimes T m . It is shown that ranks of linear matrix pencils constitute a collection of separating invariants for simultaneous similarity of matrix tuples. That is, m tuples A and B of n times n matrices are simultaneously similar if and only if the ranks of L(A) and L(B) are equal for all linear matrix pencils L of size mn . Variants of this property are also established for symplectic, orthogonal, unitary similarity, and for the left right action of general linear groups. Furthermore, a polynomial time algorithm for orbit equivalence of matrix tuples under the left right action of special linear groups is deduced.


Learning Multiple Stock Trading Patterns with Temporal Routing Adaptor and Optimal Transport. Successful quantitative investment usually relies on precise predictions of the future movement of the stock price. Recently, machine learning based solutions have shown their capacity to give more accurate stock prediction and become indispensable components in modern quantitative investment systems. However, the i.i.d. assumption behind existing methods is inconsistent with the existence of diverse trading patterns in the stock market, which inevitably limits their ability to achieve better stock prediction performance. In this paper, we propose a novel architecture, Temporal Routing Adaptor (TRA), to empower existing stock prediction models with the ability to model multiple stock trading patterns. Essentially, TRA is a lightweight module that consists of a set of independent predictors for learning multiple patterns as well as a router to dispatch samples to different predictors. Nevertheless, the lack of explicit pattern identifiers makes it quite challenging to train an effective TRA based model. To tackle this challenge, we further design a learning algorithm based on Optimal Transport (OT) to obtain the optimal sample to predictor assignment and effectively optimize the router with such assignment through an auxiliary loss term. Experiments on the real world stock ranking task show that compared to the state of the art baselines, e.g., Attention LSTM and Transformer, the proposed method can improve information coefficient (IC) from 0.053 to 0.059 and 0.051 to 0.056 respectively. Our dataset and code used in this work are publicly available https github.com microsoft qlib tree main examples benchmarks TRA.


An extension of a theorem by Cimasoni and Conway. Taking the Levine Tristram signature of the closure of a braid defines a map from the braid group to the integers. A formula of Gambaudo and Ghys provides an evaluation of the homomorphism defect of this map in terms of the Burau representation and the Meyer cocycle. In 2017 Cimasoni and Conway generalized this formula to the multivariable signature of the closure of coloured tangles. In the present paper, we extend even further their result by using a different 4 dimensional interpretation of the signature. We obtain an evaluation of the additivity defect in terms of the Maslov index and the isotropic functor mathscr F omega . We also show that in the case of coloured braids this defect can be rewritten in terms of the Meyer cocycle and the coloured Gassner representation, making it a direct generalization of the formula of Gambaudo and Ghys.


Shadowing, recurrence, and rigidity in dynamical systems. In this paper we examine the interplay between recurrence properties and the shadowing property in dynamical systems on compact metric spaces. In particular, we demonstrate that if the dynamical system (X,f) has shadowing, then it is recurrent if and only if it is minimal. Furthermore, we show that a uniformly rigid system (X,f) has shadowing if and only if X is totally disconnected and use this to demonstrate the existence of a space X for which no surjective system (X,f) has shadowing. We further refine these results to discuss the dynamics that can occur in spaces with compact space of self maps.


Fluid Dynamics Beyond the Continuum A Physical Perspective on Large Eddy Simulation. In this work, we will present a physically consistent theory to derive the governing equations of the Large Eddy Simulation (LES) framework based on first principles rather than the motivation to conduct computationally affordable simulations of turbulent flows. Therefore, we assume that a coarse grained fluid element, subsequently called super fluid element, can be locally defined comprising a large number of smaller elementary fluid elements. Then, similar to non equilibrium molecular dynamics (NEMD), in which the transport equations of an elementary fluid element can be consistently reconstructed from the local, collective dynamics of molecules, the transport equations of a super fluid element can be derived from the local, collective dynamics of elementary fluid elements. Interestingly, we find (a) Favre filtering is a physical consistency condition, (b) why Boussinesq's hypothesis in conjunction with eddy viscosity models is commonly employed in LES and (c) that the LES framework might be more than a numerical turbulence model for computational fluid dynamics (CFD).


Adaptive Path Planning for UAV based Multi Resolution Semantic Segmentation. In this paper, we address the problem of adaptive path planning for accurate semantic segmentation of terrain using unmanned aerial vehicles (UAVs). The usage of UAVs for terrain monitoring and remote sensing is rapidly gaining momentum due to their high mobility, low cost, and flexible deployment. However, a key challenge is planning missions to maximize the value of acquired data in large environments given flight time limitations. To address this, we propose an online planning algorithm which adapts the UAV paths to obtain high resolution semantic segmentations necessary in areas on the terrain with fine details as they are detected in incoming images. This enables us to perform close inspections at low altitudes only where required, without wasting energy on exhaustive mapping at maximum resolution. A key feature of our approach is a new accuracy model for deep learning based architectures that captures the relationship between UAV altitude and semantic segmentation accuracy. We evaluate our approach on the application of crop weed segmentation in precision agriculture using real world field data.


Unraveling the Temporal Importance of Community scale Human Activity Features for Rapid Assessment of Flood Impacts. The objective of this research is to explore the temporal importance of community scale human activity features for rapid assessment of flood impacts. Ultimate flood impact data, such as flood inundation maps and insurance claims, becomes available only weeks and months after the floods have receded. Crisis response managers, however, need near real time data to prioritize emergency response. This time lag creates a need for rapid flood impact assessment. Some recent studies have shown promising results for using human activity fluctuations as indicators of flood impacts. Existing studies, however, used mainly a single community scale activity feature for the estimation of flood impacts and have not investigated their temporal importance for indicating flood impacts. Hence, in this study, we examined the importance of heterogeneous human activity features in different flood event stages. Using four community scale big data categories we derived ten features related to the variations in human activity and evaluated their temporal importance for rapid assessment of flood impacts. Using multiple random forest models, we examined the temporal importance of each feature in indicating the extent of flood impacts in the context of the 2017 Hurricane Harvey in Harris County, Texas. Our findings reveal that 1) fluctuations in human activity index and percentage of congested roads are the most important indicators for rapid flood impact assessment during response and recovery stages 2) variations in credit card transactions assumed a middle ranking and 3) patterns of geolocated social media posts (Twitter) were of low importance across flood stages. The results of this research could rapidly forge a multi tool enabling crisis managers to identify hotspots with severe flood impacts at various stages then to plan and prioritize effective response strategies.


Energy Band Structure of Multistream Quantum Electron System. In this paper, using the quantum multistream model, we develop a method to study the electronic band structure of plasmonic excitations in streaming electron gas with arbitrary degree of degeneracy. The multifluid quantum hydrodynamic model is used to obtain N coupled pseudoforce differential equation system from which the energy band structure of plasmonic excitations is calculated. It is shown that inevitable appearance of energy bands separated by gaps can be due to discrete velocity filaments and their electrostatic mode coupling in the electron gas. Current model also provides an alternative description of collisionless damping and phase mixing, i.e., collective scattering phenomenon within the energy band gaps due to mode coupling between wave like and particle like oscillations. The quantum multistream model is further generalized to include virtual streams which is used to calculate the electronic band structure of one dimensional plasmonic crystals. It is remarked that, unlike the empty lattice approximation in free electron model, energy band gaps exist in plasmon excitations due to the collective electrostatic interactions between electrons. It is also shown that the plasmonic band gap size at first Brillouin zone boundary maximizes at the reciprocal lattice vector, G , close to metallic densities. Furthermore, the electron lattice binding and electron phonon coupling strength effects on the electronic band structure are discussed. It is remarked that inevitable formation of energy band structure is a general characteristics of various electromagnetically and gravitationally coupled quantum multistream systems.


Reading and Acting while Blindfolded The Need for Semantics in Text Game Agents. Text based games simulate worlds and interact with players using natural language. Recent work has used them as a testbed for autonomous language understanding agents, with the motivation being that understanding the meanings of words or semantics is a key component of how humans understand, reason, and act in these worlds. However, it remains unclear to what extent artificial agents utilize semantic understanding of the text. To this end, we perform experiments to systematically reduce the amount of semantic information available to a learning agent. Surprisingly, we find that an agent is capable of achieving high scores even in the complete absence of language semantics, indicating that the currently popular experimental setup and models may be poorly designed to understand and leverage game texts. To remedy this deficiency, we propose an inverse dynamics decoder to regularize the representation space and encourage exploration, which shows improved performance on several games including Zork I. We discuss the implications of our findings for designing future agents with stronger semantic understanding.


Non conservative H frac 12 weak solutions of the incompressible 3D Euler equations. For any positive regularity parameter beta frac 12 , we construct non conservative weak solutions of the 3D incompressible Euler equations which lie in H beta uniformly in time. In particular, we construct solutions which have an L 2 based regularity index emph strictly larger than frac 13 , thus deviating from the H frac 1 3 regularity corresponding to the Kolmogorov Obhukov frac 53 power spectrum in the inertial range.


Variable metric backward forward dynamical systems for monotone inclusion problems. This paper investigates first order variable metric backward forward dynamical systems associated with monotone inclusion and convex minimization problems in real Hilbert space. The operators are chosen so that the backward forward dynamical system is closely related to the forward backward dynamical system and has the same computational complexity. We show existence, uniqueness, and weak asymptotic convergence of the generated trajectories and strong convergence if one of the operators is uniformly monotone. We also establish that an equilibrium point of the trajectory is globally exponentially stable and monotone attractor. As a particular case, we explore similar perspectives of the trajectories generated by a dynamical system related to the minimization of the sum of a nonsmooth convex and a smooth convex function. Numerical examples are given to illustrate the convergence of trajectories.


Greedy Algorithm for Multiway Matching with Bounded Regret. In this paper we prove the efficacy of a simple greedy algorithm for a finite horizon online resource allocation matching problem, when the corresponding static planning linear program (SPP) exhibits a non degeneracy condition called the general position gap (GPG). The key intuition that we formalize is that the solution of the reward maximizing SPP is the same as a feasibility LP restricted to the optimal basic activities, and under GPG this solution can be tracked with bounded regret by a greedy algorithm, i.e., without the commonly used technique of periodically resolving the SPP. The goal of the decision maker is to combine resources (from a finite set of resource types) into configurations (from a finite set of feasible configurations) where each configuration is specified by the number of resources consumed of each type and a reward. The resources are further subdivided into three types offline (whose quantity is known and available at time 0), online queueable (which arrive online and can be stored in a buffer), and online nonqueueable (which arrive online and must be matched on arrival or lost). Under GRG we prove that, (i) our greedy algorithm gets bounded any time regret of mathcal O (1 epsilon 0) for matching reward ( epsilon 0 is a measure of the GPG) when no configuration contains both an online queueable and an online nonqueueable resource, and (ii) mathcal O ( log t) expected any time regret otherwise (we also prove a matching lower bound). By considering the three types of resources, our matching framework encompasses several well studied problems such as dynamic multi sided matching, network revenue management, online stochastic packing, and multiclass queueing systems.


Classifying sections of del Pezzo fibrations, II. Let X be a del Pezzo surface over the function field of a complex curve. We study the behavior of rational points on X leading to bounds on the counting function in Geometric Manin's Conjecture. A key tool is the Movable Bend and Break Lemma which yields an inductive approach to classifying relatively free sections for a del Pezzo fibration over a curve. Using this lemma we prove Geometric Manin's Conjecture for certain split del Pezzo surfaces of degree geq 2 admitting a birational morphism to mathbb P 2 over the ground field.


Inertial Newton Algorithms Avoiding Strict Saddle Points. We study the asymptotic behavior of second order algorithms mixing Newton's method and inertial gradient descent in non convex landscapes. We show that, despite the Newtonian behavior of these methods, they almost always escape strict saddle points. We also evidence the role played by the hyper parameters of these methods in their qualitative behavior near critical points. The theoretical results are supported by numerical illustrations.


Relative orbifold Pandharipande Thomas theory and the degeneration formula. We construct relative moduli spaces of semistable pairs on a family of projective Deligne Mumford stacks. We define moduli stacks of stable orbifold Pandharipande Thomas pairs on stacks of expanded degenerations and pairs, and then show they are separated and proper Deligne Mumford stacks of finite type. As an application, we present the degeneration formula for the absolute and relative orbifold Pandharipande Thomas invariants.


Modeling and characterizing stochastic neurons based on in vitro voltage dependent spike probability functions. Neurons in the nervous system are submitted to distinct sources of noise, such as ionic channel and synaptic noise, which introduces variability in their responses to repeated presentations of identical stimuli. This motivates the use of stochastic models to describe neuronal behavior. In this work, we characterize an intrinsically stochastic neuron model based on a voltage dependent spike probability function. We determine the effect of the intrinsic noise in single neurons by measuring the spike time reliability and study the stochastic resonance phenomenon. The model was able to show increased reliability for non zero intrinsic noise values, according to what is known from the literature, and the addition of intrinsic stochasticity in it enhanced the region in which stochastic resonance is present. We proceeded to the study at the network level where we investigated the behavior of a random network composed of stochastic neurons. In this case, the addition of an extra dimension, represented by the intrinsic noise, revealed dynamic states of the system that could not be found otherwise. Finally, we propose a method to estimate the spike probability curve from in vitro electrophysiological data.


An investigation into Lie algebra representations obtained from regular holonomic D modules. Beilinson Bernstein localisation relates representations of a Lie algebra mathfrak g to certain mathcal D modules on the flag variety of mathfrak g . In arXiv 2002.01540 , examples of mathfrak sl 2 representations which correspond to mathcal D modules on mathbb CP 1 were computed. In this expository article, we give a topological description of these and extended examples via the Riemann Hilbert correspondence. We generalise this to a full characterisation of mathfrak sl 2 representations which correspond to holonomic mathcal D modules on mathbb CP 1 with at most 2 regular singularities. We construct further examples with more singularities and develop a computer program for the computation of this correspondence in more general cases.


Adversarial Attack by Limited Point Cloud Surface Modifications. Recent research has revealed that the security of deep neural networks that directly process 3D point clouds to classify objects can be threatened by adversarial samples. Although existing adversarial attack methods achieve high success rates, they do not restrict the point modifications enough to preserve the point cloud appearance. To overcome this shortcoming, two constraints are proposed. These include applying hard boundary constraints on the number of modified points and on the point perturbation norms. Due to the restrictive nature of the problem, the search space contains many local maxima. The proposed method addresses this issue by using a high step size at the beginning of the algorithm to search the main surface of the point cloud fast and effectively. Then, in order to converge to the desired output, the step size is gradually decreased. To evaluate the performance of the proposed method, it is run on the ModelNet40 and ScanObjectNN datasets by employing the state of the art point cloud classification models including PointNet, PointNet , and DGCNN. The obtained results show that it can perform successful attacks and achieve state of the art results by only a limited number of point modifications while preserving the appearance of the point cloud. Moreover, due to the effective search algorithm, it can perform successful attacks in just a few steps. Additionally, the proposed step size scheduling algorithm shows an improvement of up to 14.5 when adopted by other methods as well. The proposed method also performs effectively against popular defense methods.


Contrastively Learning Visual Attention as Affordance Cues from Demonstrations for Robotic Grasping. Conventional works that learn grasping affordance from demonstrations need to explicitly predict grasping configurations, such as gripper approaching angles or grasping preshapes. Classic motion planners could then sample trajectories by using such predicted configurations. In this work, our goal is instead to fill the gap between affordance discovery and affordance based policy learning by integrating the two objectives in an end to end imitation learning framework based on deep neural networks. From a psychological perspective, there is a close association between attention and affordance. Therefore, with an end to end neural network, we propose to learn affordance cues as visual attention that serves as a useful indicating signal of how a demonstrator accomplishes tasks, instead of explicitly modeling affordances. To achieve this, we propose a contrastive learning framework that consists of a Siamese encoder and a trajectory decoder. We further introduce a coupled triplet loss to encourage the discovered affordance cues to be more affordance relevant. Our experimental results demonstrate that our model with the coupled triplet loss achieves the highest grasping success rate in a simulated robot environment. Our project website can be accessed at https sites.google.com asu.edu affordance aware imitation project.


Convergence of a Human in the Loop Policy Gradient Algorithm With Eligibility Trace Under Reward, Policy, and Advantage Feedback. Fluid human agent communication is essential for the future of human in the loop reinforcement learning. An agent must respond appropriately to feedback from its human trainer even before they have significant experience working together. Therefore, it is important that learning agents respond well to various feedback schemes human trainers are likely to provide. This work analyzes the COnvergent Actor Critic by Humans (COACH) algorithm under three different types of feedback policy feedback, reward feedback, and advantage feedback. For these three feedback types, we find that COACH can behave sub optimally. We propose a variant of COACH, episodic COACH (E COACH), which we prove converges for all three types. We compare our COACH variant with two other reinforcement learning algorithms Q learning and TAMER.


On application of stochastic differential equations for simulation of nonlinear wave particle resonant interactions. Long term simulations of energetic electron fluxes in many space plasma systems require accounting for two groups of processes with well separated time scales microphysics of electron resonant scattering by electromagnetic waves and electron adiabatic heating transport by mesoscale plasma flows. Examples of such systems are Earth's radiation belts and Earth's bow shock, where ion scale plasma injections and cross shock electric fields determine the general electron energization, whereas electron scattering by waves relax anisotropy of electron distributions and produces small populations of high energy electrons. The applicability of stochastic differential equations is a promising approach for including effects of resonant wave particle interaction into codes of electron tracing in global models. This study is devoted to test of such equations for systems with nondiffusive wave particle interactions, i.e. systems with nonlinear effects of phase trapping and bunching. We consider electron resonances with intense electrostatic whistler mode waves often observed in the Earth's radiation belts. We demonstrate that nonlinear resonant effects can be described by stochastic differential equations with the non Gaussian probability distribution of random variations of electron energies.


Safe Exploration for Constrained Reinforcement Learning with Provable Guarantees. We consider the problem of learning an episodic safe control policy that minimizes an objective function, while satisfying necessary safety constraints both during learning and deployment. We formulate this safety constrained reinforcement learning (RL) problem using the framework of a finite horizon Constrained Markov Decision Process (CMDP) with an unknown transition probability function. Here, we model the safety requirements as constraints on the expected cumulative costs that must be satisfied during all episodes of learning. We propose a model based safe RL algorithm that we call the Optimistic Pessimistic Safe Reinforcement Learning (OPSRL) algorithm, and show that it achieves an tilde mathcal O (S 2 sqrt A H 7 K ( bar C bar C b )) cumulative regret without violating the safety constraints during learning, where S is the number of states, A is the number of actions, H is the horizon length, K is the number of learning episodes, and ( bar C bar C b ) is the safety gap, i.e., the difference between the constraint value and the cost of a known safe baseline policy. The scaling as tilde mathcal O ( sqrt K ) is the same as the traditional approach where constraints may be violated during learning, which means that our algorithm suffers no additional regret in spite of providing a safety guarantee. Our key idea is to use an optimistic exploration approach with pessimistic constraint enforcement for learning the policy. This approach simultaneously incentivizes the exploration of unknown states while imposing a penalty for visiting states that are likely to cause violation of safety constraints. We validate our algorithm by evaluating its performance on benchmark problems against conventional approaches.


Do Deep Neural Networks Forget Facial Action Units? Exploring the Effects of Transfer Learning in Health Related Facial Expression Recognition. In this paper, we present a process to investigate the effects of transfer learning for automatic facial expression recognition from emotions to pain. To this end, we first train a VGG16 convolutional neural network to automatically discern between eight categorical emotions. We then fine tune successively larger parts of this network to learn suitable representations for the task of automatic pain recognition. Subsequently, we apply those fine tuned representations again to the original task of emotion recognition to further investigate the differences in performance between the models. In the second step, we use Layer wise Relevance Propagation to analyze predictions of the model that have been predicted correctly previously but are now wrongly classified. Based on this analysis, we rely on the visual inspection of a human observer to generate hypotheses about what has been forgotten by the model. Finally, we test those hypotheses quantitatively utilizing concept embedding analysis methods. Our results show that the network, which was fully fine tuned for pain recognition, indeed payed less attention to two action units that are relevant for expression recognition but not for pain recognition.


Neural Path Hunter Reducing Hallucination in Dialogue Systems via Path Grounding. Dialogue systems powered by large pre trained language models (LM) exhibit an innate ability to deliver fluent and natural looking responses. Despite their impressive generation performance, these models can often generate factually incorrect statements impeding their widespread adoption. In this paper, we focus on the task of improving the faithfulness and thus reduce hallucination of Neural Dialogue Systems to known facts supplied by a Knowledge Graph (KG). We propose Neural Path Hunter which follows a generate then refine strategy whereby a generated response is amended using the k hop subgraph of a KG. Neural Path Hunter leverages a separate token level fact critic to identify plausible sources of hallucination followed by a refinement stage consisting of a chain of two neural LM's that retrieves correct entities by crafting a query signal that is propagated over the k hop subgraph. Our proposed model can easily be applied to any dialogue generated responses without retraining the model. We empirically validate our proposed approach on the OpenDialKG dataset against a suite of metrics and report a relative improvement of faithfulness over dialogue responses by 20.35 based on FeQA (Durmus et al., 2020).


Tiny Machine Learning for Concept Drift. Tiny Machine Learning (TML) is a new research area whose goal is to design machine and deep learning techniques able to operate in Embedded Systems and IoT units, hence satisfying the severe technological constraints on memory, computation, and energy characterizing these pervasive devices. Interestingly, the related literature mainly focused on reducing the computational and memory demand of the inference phase of machine and deep learning models. At the same time, the training is typically assumed to be carried out in Cloud or edge computing systems (due to the larger memory and computational requirements). This assumption results in TML solutions that might become obsolete when the process generating the data is affected by concept drift (e.g., due to periodicity or seasonality effect, faults or malfunctioning affecting sensors or actuators, or changes in the users' behavior), a common situation in real world application scenarios. For the first time in the literature, this paper introduces a Tiny Machine Learning for Concept Drift (TML CD) solution based on deep learning feature extractors and a k nearest neighbors classifier integrating a hybrid adaptation module able to deal with concept drift affecting the data generating process. This adaptation module continuously updates (in a passive way) the knowledge base of TML CD and, at the same time, employs a Change Detection Test to inspect for changes (in an active way) to quickly adapt to concept drift by removing the obsolete knowledge. Experimental results on both image and audio benchmarks show the effectiveness of the proposed solution, whilst the porting of TML CD on three off the shelf micro controller units shows the feasibility of what is proposed in real world pervasive systems.


Userfault Objects Transparent Programmable Memory. The Userfault Object (UFO) framework explores avenues of cooperating with the operating system to use memory in non traditional ways. We implement a framework that employs the Linux kernel's userfault mechanism to fill the contents of runtime objects on demand. When an object's memory is accessed the framework executes a user defined function that generates a slice of the object. The back end can generate data from thin air, calculate it from a formula, or retrieve it from persistent storage, the network, or other sources (with or without post processing). UFOs follow the memory layout of standard runtime objects, so they can be introspected and written to safely. The framework manages the loading and unloading of object segments to ensure that memory is reclaimed as needed and data is never lost. This allows the UFO framework to implement larger than memory data structures that never materialize into memory in full. Implementing objects as UFOs also impacts performance, since overhead of populating memory is amortized by loading entire pages of data at a time. The host runtime can also rely on direct memory accesses into userfault object obviating the need for a special dispatch mechanism. We provide a proof of concept implementation of the UFO framework for the R language.


Synchronizing Strongly Connected Partial DFAs. We study synchronizing partial DFAs, which extend the classical concept of synchronizing complete DFAs and are a special case of synchronizing unambiguous NFAs. A partial DFA is called synchronizing if it has a word (called a reset word) whose action brings a non empty subset of states to a unique state and is undefined for all other states. While in the general case the problem of checking whether a partial DFA is synchronizing is PSPACE complete, we show that in the strongly connected case this problem can be efficiently reduced to the same problem for a complete DFA. Using combinatorial, algebraic, and formal languages methods, we develop techniques that relate main synchronization problems for strongly connected partial DFAs with the same problems for complete DFAs. In particular, this includes the v C ern ' y and the rank conjectures, the problem of finding a reset word, and upper bounds on the length of the shortest reset words of literal automata of finite prefix codes. We conclude that solving fundamental synchronization problems is equally hard in both models, as an essential improvement of the results for one model implies an improvement for the other.


Visual Analysis of Electronic Densities and Transitions in Molecules. The study of electronic transitions within a molecule connected to the absorption or emission of light is a common task in the process of the design of new materials. The transitions are complex quantum mechanical processes and a detailed analysis requires a breakdown of these processes into components that can be interpreted via characteristic chemical properties. We approach these tasks by providing a detailed analysis of the electron density field. This entails methods to quantify and visualize electron localization and transfer from molecular subgroups combining spatial and abstract representations. The core of our method uses geometric segmentation of the electronic density field coupled with a graph theoretic formulation of charge transfer between molecular subgroups. The design of the methods has been guided by the goal of providing a generic and objective analysis following fundamental concepts. We illustrate the proposed approach using several case studies involving the study of electronic transitions in different molecular systems.


On the Robustness of Deep Reinforcement Learning in IRS Aided Wireless Communications Systems. We consider an Intelligent Reflecting Surface (IRS) aided multiple input single output (MISO) system for downlink transmission. We compare the performance of Deep Reinforcement Learning (DRL) and conventional optimization methods in finding optimal phase shifts of the IRS elements to maximize the user signal to noise (SNR) ratio. Furthermore, we evaluate the robustness of these methods to channel impairments and changes in the system. We demonstrate numerically that DRL solutions show more robustness to noisy channels and user mobility.


SecFL Confidential Federated Learning using TEEs. Federated Learning (FL) is an emerging machine learning paradigm that enables multiple clients to jointly train a model to take benefits from diverse datasets from the clients without sharing their local training datasets. FL helps reduce data privacy risks. Unfortunately, FL still exist several issues regarding privacy and security. First, it is possible to leak sensitive information from the shared training parameters. Second, malicious clients can collude with each other to steal data, models from regular clients or corrupt the global training model. To tackle these challenges, we propose SecFL a confidential federated learning framework that leverages Trusted Execution Environments (TEEs). SecFL performs the global and local training inside TEE enclaves to ensure the confidentiality and integrity of the computations against powerful adversaries with privileged access. SecFL provides a transparent remote attestation mechanism, relying on the remote attestation provided by TEEs, to allow clients to attest the global training computation as well as the local training computation of each other. Thus, all malicious clients can be detected using the remote attestation mechanisms.


A Proximal Algorithm for Sampling from Non smooth Potentials. In this work, we examine sampling problems with non smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non smooth potentials. We provide a non asymptotical analysis of our algorithm and establish a polynomial time complexity tilde cal O (d varepsilon 1 ) to obtain varepsilon total variation distance to the target density, better than most existing results under the same assumptions. Our method is based on the proximal bundle method and an alternating sampling framework. This framework requires the so called restricted Gaussian oracle, which can be viewed as a sampling counterpart of the proximal mapping in convex optimization. One key contribution of this work is a fast algorithm that realizes the restricted Gaussian oracle for any convex non smooth potential with bounded Lipschitz constant.


Simulating Self Avoiding Isometric Plate Bending. Inspired by recent results on self avoiding inextensible curves, we propose and experimentally investigate a numerical method for simulating isometric plate bending without self intersections. We consider a nonlinear two dimensional Kirchhoff plate model which is augmented via addition of a tangent point energy. The resulting continuous model energy is finite if and only if the corresponding deformation is injective, i.e. neither includes self intersections nor self contact. We propose a finite element method method based on discrete Kirchhoff triangles for the spatial discretization and employ a semi implicit gradient descent scheme for the minimization of the discretized energy functional. Practical properties of the proposed method are illustrated with numerous numerical simulations, exploring the model behavior in different settings and demonstrating that our method is capable of preventing non injective deformations.


Energy estimates and convergence of weak solutions of the porous medium equation. We study the convergence of the weak solution of the porous medium equation with a type of Robin boundary conditions, by tuning a parameter either to zero or to infinity. The convergence is in the strong sense, with respect to the L 2 norm, and the limiting function solves the same equation with Neumann (resp. Dirichlet) boundary conditions when the parameter is taken to zero (resp. infinity). Our approach is to consider an underlying microscopic dynamics whose space time evolution of the density is ruled by the solution of those equations and from this, we derive sufficiently strong energy estimates which are the keystone to the proof of our convergence result.


A Tale of Fairness Revisited Beyond Adversarial Learning for Deep Neural Network Fairness. Motivated by the need for fair algorithmic decision making in the age of automation and artificially intelligent technology, this technical report provides a theoretical insight into adversarial training for fairness in deep learning. We build upon previous work in adversarial fairness, show the persistent tradeoff between fair predictions and model performance, and explore further mechanisms that help in offsetting this tradeoff.


On the existence of moments of the exit time from the positive halfline for a random walk with negative drift. We consider the first exit time tau min n ge 1 S n le 0 from the positive halfline of a random walk S n sum 1 n xi i, n ge 1 with i.d.d. summands having a negative drift mathbb E xi a 0 . Let xi max (0, xi 1) . It is well known that, for any c 1 , the finiteness of mathbb E ( xi ) c implies the finiteness of mathbb E tau c and, for any c 0 , the finiteness of mathbb E exp( c xi ) implies that of mathbb E exp( c' tau ) where c' 0 is, in general, another constant that depends on c and on the distribution of xi 1 . We consider the intermediate case, assuming that mathbb E exp( g( xi ) ) infty for a positive increasing function g such that liminf x to infty g(x) log x infty and limsup x to infty g(x) x 0 , and that mathbb E exp( c xi ) infty , for all c 0 . Assuming a few further technical assumptions, we show that then mathbb E exp( (1 varepsilon) g ((1 varepsilon)a tau) ) infty , for any varepsilon in (0,1) .


Analysis of COVID 19 infection waves in Tokyo by Avrami equation. The purpose of this study was to simulate all COVID 19 infection waves in Tokyo, the capital of Japan, by phase transformation dynamics theory, and to quantitatively analyze the detailed structure of the waveform for estimating the cause. The whole infection wave in Tokyo was basically expressed by the superposition of the 5 major waves as in Japan as a whole. Among these waves, the detailed structure was seen in the 3rd and the 5th waves, where the number of infections increased remarkably due to the holidays. It was characterized as "New Year holiday effect" for New Year holidays, "Tokyo Olympics holiday effect" for Olympics holidays, and "Delta variant effect" for the replacement of the virus with Delta variant. Since this method had high simulation accuracy for the cumulative number of infections, it was effective in estimating the cause, the number of infections in the near future and the vaccination effect by quantitative analysis of the detailed structure of the waveform.


OSS effort estimation using software features similarity and developer activity based metrics. Software development effort estimation (SDEE) generally involves leveraging the information about the effort spent in developing similar software in the past. Most organizations do not have access to sufficient and reliable forms of such data from past projects. As such, the existing SDEE methods suffer from low usage and accuracy. We propose an efficient SDEE method for open source software, which provides accurate and fast effort estimates. The significant contributions of our paper are i) Novel SDEE software metrics derived from developer activity information of various software repositories, ii) SDEE dataset comprising the SDEE metrics' values derived from approx13,000 GitHub repositories from 150 different software categories, iii) an effort estimation tool based on SDEE metrics and a software description similarity model. Our software description similarity model is basically a machine learning model trained using the Paragraph Vectors algorithm on the software product descriptions of GitHub repositories. Given the software description of a newly envisioned software, our tool yields an effort estimate for developing it. Our method achieves the highest Standard Accuracy score of 87.26 (with cliff's delta 0.88 at 99.999 confidence level) and 42.7 with the Automatic Transformed Linear Baseline model. Our software artifacts are available at https doi.org 10.5281 zenodo.5095723.


Joint Depth and Normal Estimation from Real world Time of flight Raw Data. We present a novel approach to joint depth and normal estimation for time of flight (ToF) sensors. Our model learns to predict the high quality depth and normal maps jointly from ToF raw sensor data. To achieve this, we meticulously constructed the first large scale dataset (named ToF 100) with paired raw ToF data and ground truth high resolution depth maps provided by an industrial depth camera. In addition, we also design a simple but effective framework for joint depth and normal estimation, applying a robust Chamfer loss via jittering to improve the performance of our model. Our experiments demonstrate that our proposed method can efficiently reconstruct high resolution depth and normal maps and significantly outperforms state of the art approaches. Our code and data will be available at url https github.com hkustVisionRr JointlyDepthNormalEstimation


Fractional Ito calculus. We derive It o type change of variable formulas for smooth functionals of irregular paths with non zero p th variation along a sequence of partitions where p geq 1 is arbitrary, in terms of fractional derivative operators, extending the results of the F "ollmer Ito calculus to the general case of paths with 'fractional' regularity. In the case where p is not an integer, we show that the change of variable formula may sometimes contain a non zero a 'fractional' It o remainder term and provide a representation for this remainder term. These results are then extended to paths with non zero phi variation and multi dimensional paths. Finally, we derive an isometry property for the pathwise F "ollmer integral in terms of phi variation.


A dynamical proof of the van der Corput inequality. We provide a dynamical proof of the van der Corput inequality for sequences in Hilbert spaces that is based on the Furstenberg correspondence principle. This is done by reducing the inequality to the mean ergodic theorem for contractions on Hilbert spaces. The key difficulty therein is that the Furstenberg correspondence principle is, a priori, limited to scalar valued sequences. We therefore discuss how interpreting the Furstenberg correspondence principle via the Gelfand Naimark Segal construction for C algebras allows to study not just scalar but general Hilbert space valued sequences in terms of unitary operators. This yields a proof of the van der Corput inequality in the spirit of the Furstenberg correspondence principle and the flexibility of this method is discussed via new proofs for different variants of the inequality.


Finite Difference Weerakoon Fernando Method to solve nonlinear equations without using derivatives. This research was mainly conducted to explore the possibility of formulating an efficient algorithm to find roots of nonlinear equations without using the derivative of the function. The Weerakoon Fernando method had been taken as the base in this project to find a new method without the derivative since Weerakoon Fernando method gives 3rd order convergence. After several unsuccessful attempts we were able to formulate the Finite Difference Weerakoon Fernando Method (FDWFM) presented here. We noticed that the FDWFM approaches the root faster than any other existing method in the absence of the derivatives as an example, the popular nonlinear equation solver such as secant method (order of convergence is 1.618) in the absence of the derivative. And the FDWFM had three function evaluations and secant method had two function evaluations. By implementing FDWFM on nonlinear equations with complex roots and also on systems of nonlinear equations, we received very encouraging results. When applying the FDWFM to systems of nonlinear equations, we resolved the involvement of the Jacobian problem by following the procedure in the Broyden's method. The computational order of convergence of the FDWFM was close to 2.5 for all these cases. This will undoubtedly provide scientists the efficient numerical algorithm, that doesn't need the derivative of the function to solve nonlinear equations, that they were searching for over centuries.


A polynomial resultant approach to algebraic construction of extremal graphs. The Tur ' a n problem asks for the largest number of edges ex (n,H) in an n vertex graph not containing a fixed forbidden subgraph H , which is one of the most important problems in extremal graph theory. However the order of magnitude of ex (n,H) for bipartite graphs is known only in a handful of cases. In particular, giving explicit constructions of extremal graphs is very challenging in this field. In this paper, we develop a polynomail resultant approach to algebraic construction of explicit extremal graphs, which can efficiently decide whether a specified structure exists. A key insight in our approach is the multipolynomial resultant, which is a fundamental tool of computational algebraic geometry. Our main results include the matched lowers bounds for Tur ' a n number of 1 subdivision of K 3,t 1 and linear Tur ' a n number of Berge theta hyerpgraph Theta 3,t 2 B with t 1 25 and t 2 217 . Moreover, the constant t 1 improves the random algebraic construction of Bukh and Conlon Rational exponents in extremal graph theory, J. Eur. Math. Soc. 20 (2018), 1747 1757 and makes progress on the known estimation for the smallest value of t 1 concerning a problem posed by Conlon, Janzer and Lee More on the extremal number of subdivisions, Combinatorica, to appear , while the constant t 2 improves a result of He and Tait Hypergraphs with few berge paths of fixed length between vertices, SIAM J. Discrete Math., 33(3), 1472 1481 .


3D Human Pose Estimation for Free form Activity Using WiFi Signals. WiFi human sensing has become increasingly attractive in enabling emerging human computer interaction applications. The corresponding technique has gradually evolved from the classification of multiple activity types to more fine grained tracking of 3D human poses. However, existing WiFi based 3D human pose tracking is limited to a set of predefined activities. In this work, we present Winect, a 3D human pose tracking system for free form activity using commodity WiFi devices. Our system tracks free form activity by estimating a 3D skeleton pose that consists of a set of joints of the human body. In particular, we combine signal separation and joint movement modeling to achieve free form activity tracking. Our system first identifies the moving limbs by leveraging the two dimensional angle of arrival of the signals reflected off the human body and separates the entangled signals for each limb. Then, it tracks each limb and constructs a 3D skeleton of the body by modeling the inherent relationship between the movements of the limb and the corresponding joints. Our evaluation results show that Winect is environment independent and achieves centimeter level accuracy for free form activity tracking under various challenging environments including the none line of sight (NLoS) scenarios.


Robust Distributed and Localized Model Predictive Control. We present a robust Distributed and Localized Model Predictive Control (rDLMPC) framework for large scale structured linear systems. The proposed algorithm uses the System Level Synthesis to provide a distributed closed loop model predictive control scheme that is robust to exogenous disturbances. The resulting controllers require only local information exchange for both synthesis and implementation. We exploit the fact that for polytopic disturbance constraints, SLS based distributed control problems have been shown to have structure amenable for distributed optimization techniques. We show that similar to the disturbance free DLMPC algorithm, the computational complexity of rDLMPC is independent of the size of the global system. To the best of our knowledge, robust DLMPC is the first MPC algorithm that allows for the scalable distributed computation of distributed closed loop control policies in the presence of additive disturbances.


Algorithms for Difference of Convex (DC) Programs Based on Difference of Moreau Envelopes Smoothing. In this paper we consider minimization of a difference of convex (DC) function with and without linear constraints. We first study a smooth approximation of a generic DC function, termed difference of Moreau envelopes (DME) smoothing, where both components of the DC function are replaced by their respective Moreau envelopes. The resulting smooth approximation is shown to be Lipschitz differentiable, capture stationary points, local, and global minima of the original DC function, and enjoy some growth conditions, such as level boundedness and coercivity, for broad classes of DC functions. We then develop four algorithms for solving DC programs with and without linear constraints based on the DME smoothing. In particular, for a smoothed DC program without linear constraints, we show that the classic gradient descent method as well as an inexact variant can obtain a stationary solution in the limit with a convergence rate of mathcal O (K 1 2 ) , where K is the number of proximal evaluations of both components. Furthermore, when the DC program is explicitly constrained in an affine subspace, we combine the smoothing technique with the augmented Lagrangian function and derive two variants of the augmented Lagrangian method (ALM), named LCDC ALM and composite LCDC ALM, focusing on different structures of the DC objective function. We show that both algorithms find an epsilon approximate stationary solution of the original DC program in mathcal O ( epsilon 2 ) iterations. Comparing to existing methods designed for linearly constrained weakly convex minimization, the proposed ALM based algorithms can be applied to a broader class of problems, where the objective contains a nonsmooth concave component. Finally, numerical experiments are presented to demonstrate the performance of the proposed algorithms.


Gumble Softmax For User Behavior Modeling. Recently, sequential recommendation systems are important in solving the information overload in many online services. Current methods in sequential recommendation focus on learning a fixed number of representations for each user at any time, with a single representation or multi representations for the user. However, when a user is exploring items on an e commerce recommendation system, the number of this user's hobbies may change overtime (e.g. increase reduce one more interest), affected by the user's evolving self needs. Moreover, different users may have various number of interests. In this paper, we argue that it is meaningful to explore a personalized dynamic number of user interests, and learn a dynamic group of user interest representations accordingly. We propose a sequential model with dynamic number of representations for recommendation systems (RDRSR). Specifically, RDRSR is composed of a dynamic interest discriminator (DID) module and a dynamic interest allocator (DIA) module. The DID module explores the number of a user's interests by learning the overall sequential characteristics with bi directional self attention and Gumbel Softmax. The DIA module make the historical clicked items into a group of item groups and constructs user's dynamic interest representation. Additionally, experiments on the real world datasets demonstrates our model's effectiveness.


On the existence of optimizers for time frequency concentration problems. We consider the problem of the maximum concentration in a fixed measurable subset Omega subset mathbb R 2d of the time frequency space for functions f in L 2( mathbb R d ) . The notion of concentration can be made mathematically precise by considering the L p norm on Omega of some time frequency distribution of f such as the ambiguity function A(f) . We provide a positive answer to an open maximization problem, by showing that for every subset Omega subset mathbb R 2d of finite measure and every 1 leq p infty , there exists an optimizer for sup A(f) L p( Omega) f in L 2( mathbb R d ), f L 2 1 . The lack of weak upper semicontinuity and the invariance under time frequency shifts make the problem challenging. The proof is based on concentration compactness with time frequency shifts as dislocations, and certain integral bounds and asymptotic decoupling estimates for the ambiguity function. We also discuss the case p infty and related optimization problems for the time correlation function, the cross ambiguity function with a fixed window, and for functions in the modulation spaces M q( mathbb R d ) , 0 q 2 , equipped with continuous or discrete type (quasi )norms.


Improved Communication Efficiency for Distributed Mean Estimation with Side Information. In this paper, we consider the distributed mean estimation problem where the server has access to some side information, e.g., its local computed mean estimation or the received information sent by the distributed clients at the previous iterations. We propose a practical and efficient estimator based on an r bit Wynzer Ziv estimator proposed by Mayekar et al., which requires no probabilistic assumption on the data. Unlike Mayekar's work which only utilizes side information at the server, our scheme jointly exploits the correlation between clients' data and server' s side information, and also between data of different clients. We derive an upper bound of the estimation error of the proposed estimator. Based on this upper bound, we provide two algorithms on how to choose input parameters for the estimator. Finally, parameter regions in which our estimator is better than the previous one are characterized.


Temporal RoI Align for Video Object Recognition. Video object detection is challenging in the presence of appearance deterioration in certain video frames. Therefore, it is a natural choice to aggregate temporal information from other frames of the same video into the current frame. However, RoI Align, as one of the most core procedures of video detectors, still remains extracting features from a single frame feature map for proposals, making the extracted RoI features lack temporal information from videos. In this work, considering the features of the same object instance are highly similar among frames in a video, a novel Temporal RoI Align operator is proposed to extract features from other frames feature maps for current frame proposals by utilizing feature similarity. The proposed Temporal RoI Align operator can extract temporal information from the entire video for proposals. We integrate it into single frame video detectors and other state of the art video detectors, and conduct quantitative experiments to demonstrate that the proposed Temporal RoI Align operator can consistently and significantly boost the performance. Besides, the proposed Temporal RoI Align can also be applied into video instance segmentation. Codes are available at https github.com open mmlab mmtracking


QAIR Practical Query efficient Black Box Attacks for Image Retrieval. We study the query based attack against image retrieval to evaluate its robustness against adversarial examples under the black box setting, where the adversary only has query access to the top k ranked unlabeled images from the database. Compared with query attacks in image classification, which produce adversaries according to the returned labels or confidence score, the challenge becomes even more prominent due to the difficulty in quantifying the attack effectiveness on the partial retrieved list. In this paper, we make the first attempt in Query based Attack against Image Retrieval (QAIR), to completely subvert the top k retrieval results. Specifically, a new relevance based loss is designed to quantify the attack effects by measuring the set similarity on the top k retrieval results before and after attacks and guide the gradient optimization. To further boost the attack efficiency, a recursive model stealing method is proposed to acquire transferable priors on the target model and generate the prior guided gradients. Comprehensive experiments show that the proposed attack achieves a high attack success rate with few queries against the image retrieval systems under the black box setting. The attack evaluations on the real world visual search engine show that it successfully deceives a commercial system such as Bing Visual Search with 98 attack success rate by only 33 queries on average.


Improve High Level Classification with a More Sensitive metric and Optimization approach for Complex Network Building. Complex Networks are a good approach to find internal relationships and represent the structure of classes in a dataset then they are used for High Level Classification. Previous works use K Nearest Neighbors to build each Complex Network considering all the available samples. This paper introduces a different creation of Complex Networks, considering only sample which belongs to each class. And metric is used to analyze the structure of Complex Networks, besides an optimization approach to improve the performance is presented. Experiments are executed considering a cross validation process, the optimization approach is performed using grid search and Genetic Algorithm, this process can improve the results up to 10 .


Centrality of the congruence subgroup kernel of higher rank non uniform arithmetic groups. We give here a simple proof of the centrality of the congruence subgroup kernel in the higher rank isotropic case.


VID WIN Fast Video Event Matching with Query Aware Windowing at the Edge for the Internet of Multimedia Things. Efficient video processing is a critical component in many IoMT applications to detect events of interest. Presently, many window optimization techniques have been proposed in event processing with an underlying assumption that the incoming stream has a structured data model. Videos are highly complex due to the lack of any underlying structured data model. Video stream sources such as CCTV cameras and smartphones are resource constrained edge nodes. At the same time, video content extraction is expensive and requires computationally intensive Deep Neural Network (DNN) models that are primarily deployed at high end (or cloud) nodes. This paper presents VID WIN, an adaptive 2 stage allied windowing approach to accelerate video event analytics in an edge cloud paradigm. VID WIN runs parallelly across edge and cloud nodes and performs the query and resource aware optimization for state based complex event matching. VID WIN exploits the video content and DNN input knobs to accelerate the video inference process across nodes. The paper proposes a novel content driven micro batch resizing, queryaware caching and micro batch based utility filtering strategy of video frames under resource constrained edge nodes to improve the overall system throughput, latency, and network usage. Extensive evaluations are performed over five real world datasets. The experimental results show that VID WIN video event matching achieves 2.3X higher throughput with minimal latency and 99 bandwidth reduction compared to other baselines while maintaining query level accuracy and resource bounds.


Improving overlay maps of science combining overview and detail. Overlay maps of science are global base maps over which subsets of publications can be projected. Such maps can be used to monitor, explore, and study research through its publication output. Most maps of science, including overlay maps, are flat in the sense that they visualize research fields at one single level. Such maps generally fail to provide both overview and detail about the research being analyzed. The aim of this study is to improve overlay maps of science to provide both features in a single visualization. I created a map based on a hierarchical classification of publications, including broad disciplines for overview and more granular levels to incorporate detailed information. The classification was obtained by clustering articles in a citation network of about 17 million publication records in PubMed from 1995 onwards. The map emphasizes the hierarchical structure of the classification by visualizing both disciplines and the underlying specialties. To show how the visualization methodology can help getting both overview of research and detailed information about its topical structure, I projected two overlay maps onto the base map (1) open access publishing and (2) coronavirus Covid 19 research.


Intrinsic Propensity for Vulnerability in Computers? Arbitrary Code Execution in the Universal Turing Machine. The universal Turing machine is generally considered to be the simplest, most abstract model of a computer. This paper reports on the discovery of an accidental arbitrary code execution vulnerability in Marvin Minsky's 1967 implementation of the universal Turing machine. By submitting crafted data, the machine may be coerced into executing user provided code. The article presents the discovered vulnerability in detail and discusses its potential implications. To the best of our knowledge, an arbitrary code execution vulnerability has not previously been reported for such a simple system.


Learning to Recommend Items to Wikidata Editors. Wikidata is an open knowledge graph built by a global community of volunteers. As it advances in scale, it faces substantial challenges around editor engagement. These challenges are in terms of both attracting new editors to keep up with the sheer amount of work and retaining existing editors. Experience from other online communities and peer production systems, including Wikipedia, suggests that personalised recommendations could help, especially newcomers, who are sometimes unsure about how to contribute best to an ongoing effort. For this reason, we propose a recommender system WikidataRec for Wikidata items. The system uses a hybrid of content based and collaborative filtering techniques to rank items for editors relying on both item features and item editor previous interaction. A neural network, named a neural mixture of representations, is designed to learn fine weights for the combination of item based representations and optimize them with editor based representation by item editor interaction. To facilitate further research in this space, we also create two benchmark datasets, a general purpose one with 220,000 editors responsible for 14 million interactions with 4 million items and a second one focusing on the contributions of more than 8,000 more active editors. We perform an offline evaluation of the system on both datasets with promising results. Our code and datasets are available at https github.com WikidataRec developer Wikidata Recommender.


An Analysis of Speculative Type Confusion Vulnerabilities in the Wild. Spectre v1 attacks, which exploit conditional branch misprediction, are often identified with attacks that bypass array bounds checking to leak data from a victim's memory. Generally, however, Spectre v1 attacks can exploit any conditional branch misprediction that makes the victim execute code incorrectly. In this paper, we investigate speculative type confusion, a Spectre v1 attack vector in which branch mispredictions make the victim execute with variables holding values of the wrong type and thereby leak memory content. We observe that speculative type confusion can be inadvertently introduced by a compiler, making it extremely hard for programmers to reason about security and manually apply Spectre mitigations. We thus set out to determine the extent to which speculative type confusion affects the Linux kernel. Our analysis finds exploitable and potentially exploitable arbitrary memory disclosure vulnerabilities. We also find many latent vulnerabilities, which could become exploitable due to innocuous system changes, such as coding style changes. Our results suggest that Spectre mitigations which rely on statically manually identifying "bad" code patterns need to be rethought, and more comprehensive mitigations are needed.


Stochastic Modeling of an Infectious Disease Part II Simulation Experiments and Verification of the Analysis. In Part 1, we introduced a stochastic model of an infectious disease, based on the BDI (birth and death with immigration) process. We showed that random processes defined by this model can capture the essence of the stochastic, often erratic, behavior of the infection process. The most significant finding was that it is negative binomial distributed with small r, hence it is geometrically distributed with an exceedingly long tail. This leads to a much larger disparity in the epidemic patterns than has been known to the modeling community. In Part 2 we conduct simulation experiments by implementing an event driven simulator. Several independent runs are presented to verify the findings reported in Part 1. The enormous variations among the sample paths obtained from several consecutive and independent runs with statistically identical conditions confirm our analysis. Note that the epidemic pattern that we observe is merely one sample path taken out of infinitely many paths. Thus, one such path cannot represent the ensemble of the underlying random process. By plotting the simulation runs in the semi log scale, we can see that the probabilistic chances in the early phase of the infection process determine the behavior of the process. Once the process has reached a considerable number, the weak law of large numbers sets in, and the process behaves less erratically than in the early phase. One important implication of our findings is that it would be a futile effort to attempt to identify all plausible causes of the epidemic patterns. Mere luck may play a more significant role than most people believe. It would be worth remarking that the BDI process might be applicable to explain the disparity in wealth among individuals of similar earning power, expenditure, and investment portfolio.


On Meijer's G function G m,n p,p for m n p . The paper is devoted to the piece wise analytic case of Meijer's G function G m,n p,p . While the problem of its analytic continuation was solved in principle by Meijer and Braaksma we show that in the ''balanced'' case m n p the formulas take a particularly simple form. We derive explicit expressions for the values of these analytic continuations on the banks of the branch cuts. It is further demonstrated that particular cases of this type of G function having integer parameter differences satisfy identities similar to the Miller Paris transformations for the generalized hypergeometric function. Finally, we give a presumably new integral evaluation involving G m,n p,p function with m n and apply it for summing a series involving digamma function and related to the power series coefficients of the product of two generalized hypergeometric functions with shifted parameters.


Hardy Spaces Associated with Ball Quasi Banach Function Spaces on Spaces of Homogeneous Type Characterizations of Maximal Functions, Decompositions, and Dual Spaces. Let ( mathcal X , rho, mu) be a space of homogeneous type in the sense of Coifman and Weiss, and Y( mathcal X ) a ball quasi Banach function space on mathcal X , which supports a Fefferman Stein vector valued maximal inequality, and the boundedness of the powered Hardy Littlewood maximal operator on its associate space. The authors first introduce the Hardy space H Y ( mathcal X ) , associated with Y( mathcal X ) , via the grand maximal function, and then establish its various real variable characterizations, respectively, in terms of radial or non tangential maximal functions, atoms or finite atoms, and molecules. As an application, the authors give the dual space of H Y ( mathcal X ) , which proves to be a ball Campanato type function space associated with Y( mathcal X ) . All these results have a wide range of generality and, particularly, even when they are applied to variable Hardy spaces, the obtained results are also new. The major novelties of this article exist in that, to escape the reverse doubling condition of mu and the triangle inequality of rho , the authors cleverly construct admissible sequences of balls, and fully use the geometrical properties of mathcal X expressed by dyadic reference points or dyadic cubes and, to overcome the difficulty caused by the lack of the good dense subset of H Y ( mathcal X ) , the authors further prove that Y( mathcal X ) can be embedded into the weighted Lebesgue space with certain special weight, and then can fully use the known results of the weighted Lebesgue space.


L p theory for the exterior Stokes problem with Navier's type slip without friction boundary conditions. In this paper, we consider the stationary Stokes equations in an exterior domain three dimensional under a slip boundary condition without friction. We set the problem in weighted Sobolev spaces in order to control the behavior at infinity of the solutions. In this work, we try to investigate the existence and uniqueness of the weak solutions related to this problem in L P theory when p 3 . Our proof are based on obtaining inf sup conditions that play a fundamental role.


Hamiltonicity in infinite tournaments. We prove that for all countable tournaments D the recently discovered compactification D by their ends and limit edges contains a topological Hamilton path a topological arc that contains every vertex. If D is strongly connected, then D contains a topological Hamilton circle. These results extend well known theorems about finite tournaments, which we show do not extend to the infinite in a purely combinatorial setting.


Elysium Automagically Healing Vulnerable Smart Contracts Using Context Aware Patching. Smart contracts are programs that are deployed and executed on the blockchain. Typically, smart contracts govern assets popular smart contracts can govern assets worth millions. Just like traditional programs, smart contracts are subject to programming mistakes. However, a major difference is that smart contracts cannot be patched once deployed. Several approaches have been studied to improve smart contract security, by detecting bugs prior to deployment, allowing contracts to be updated, or modifying clients to prevent attacking transactions. The most elegant solution would be to automatically eliminate bugs prior to deployment. Merely identifying bugs is not enough. This became evident when the Parity wallet was hacked a second time after being manually patched following a security audit. Automatic pre deployment patching offers a powerful promise to strengthen smart contract defenses. Current approaches are limited in the types of vulnerabilities that can be patched, in the flexibility of the patching process, and in scalability. In this paper we propose Elysium, a scalable approach towards automatic smart contract repair, that combines template based patching with semantic patching by inferring context information from the bytecode. Elysium can currently automatically patch 7 known vulnerabilities in smart contracts using external bug finding tools, and it can easily be extended with new templates and new bug finding tools. We evaluate effectiveness and correctness of Elysium using 3 different datasets by replaying more than 500K transactions against patched contracts. We find that Elysium outperforms existing tools by patching at least 30 more contracts. Finally, we compare the overhead in terms of deployment and transaction cost increase. In comparison to other tools, Elysium minimizes transaction cost (up to a factor of 1.9), for only a marginally higher deployment cost.


Towards Intelligent RAN Slicing for B5G Opportunities and Challenges. To meet the diverse demands for wireless communication, fifth generation (5G) networks and beyond (B5G) embrace the concept of network slicing by forging virtual instances (slices) of its physical infrastructure. While network slicing constitutes dynamic allocation of core network and radio access network (RAN) resources, this article emphasizes RAN slicing (RAN S) design. Forming on demand RAN S that can be flexibly (re) configured while ensuring slice isolation is challenging. A variety of machine learning (ML) techniques have been recently introduced for traffic forecasting and classification, resource usage prediction, admission control, scheduling, and dynamic resource allocation in RAN S. Albeit these approaches grant opportunities towards intelligent RAN S design, they raise critical challenges that need to be examined. This article underlines the opportunities and the challenges of incorporating ML into RAN S by reviewing the cutting edge ML based techniques for RAN S. It also draws few directions for future research towards intelligent RAN S (iRAN S).


Predicting Gender by First Name Using Character level Machine Learning. Predicting gender by the first name is not a simple task. In many applications, especially in the natural language processing (NLP) field, this task may be necessary, mainly when considering foreign names. In this paper, we examined and implemented several machine learning algorithms, such as extra trees, KNN, Naive Bayes, SVM, random forest, gradient boosting, light GBM, logistic regression, ridge classifier, and deep neural network models, such as MLP, RNN, GRU, CNN, and BiLSTM, to classify gender through the first name. A dataset of Brazilian names is used to train and evaluate the models. We analyzed the accuracy, recall, precision, f1 score, and confusion matrix to measure the models' performances. The results indicate that the gender prediction can be performed from the feature extraction strategy looking at the names as a set of strings. Some models accurately predict gender in more than 95 of the cases. The recurrent models overcome the feedforward models in this binary classification problem.


Interpretable Trade offs Between Robot Task Accuracy and Compute Efficiency. A robot can invoke heterogeneous computation resources such as CPUs, cloud GPU servers, or even human computation for achieving a high level goal. The problem of invoking an appropriate computation model so that it will successfully complete a task while keeping its compute and energy costs within a budget is called a model selection problem. In this paper, we present an optimal solution to the model selection problem with two compute models, the first being fast but less accurate, and the second being slow but more accurate. The main insight behind our solution is that a robot should invoke the slower compute model only when the benefits from the gain in accuracy outweigh the computational costs. We show that such cost benefit analysis can be performed by leveraging the statistical correlation between the accuracy of fast and slow compute models. We demonstrate the broad applicability of our approach to diverse problems such as perception using neural networks and safe navigation of a simulated Mars rover.


A Central Upwind Scheme for Two layer Shallow water Flows with Friction and Entrainment along Channels. We present a new high resolution, non oscillatory semi discrete central upwind scheme for one dimensional two layer shallow water flows with friction and entrainment along channels with arbitrary cross sections and bottom topography. These flows are described by a conditionally hyperbolic balance law with non conservative products. A detailed description of the properties of the model is provided, including entropy inequalities and asymptotic approximations of the eigenvalues of the corresponding coefficient matrix. The scheme extends existing central upwind semi discrete numerical methods for hyperbolic conservation and balance laws and it satisfies two properties crucial for the accurate simulation of shallow water flows it it preserves the positivity of the water depth for each layer, and it is it well balanced , i.e., the source terms arising from the geometry of the channel are discretized so as to balance the non linear hyperbolic flux gradients. Along with the description of the scheme and proofs of these two properties, we present several numerical experiments that demonstrate the robustness of the numerical algorithm.


Dirichlet polynomials and entropy. A Dirichlet polynomial d in one variable mathcal y is a function of the form d( mathcal y ) a n n mathcal y cdots a 22 mathcal y a 11 mathcal y a 00 mathcal y for some n,a 0, ldots,a n in mathbb N . We will show how to think of a Dirichlet polynomial as a set theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy H(d) of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by L(d) 2 H(d) . On the other hand, we will define a rig homomorphism h colon mathsf Dir to mathsf Rect from the rig of Dirichlet polynomials to the so called rectangle rig, whose underlying set is mathbb R geq0 times mathbb R geq0 and whose additive structure involves the weighted geometric mean we write h(d) (A(d),W(d)) , and call the two components area and width (respectively). The main result of this paper is the following the rectangle area formula A(d) L(d)W(d) holds for any Dirichlet polynomial d . In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism h applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy.