Study of Block Diagonalization Precoding and Power Allocation for Multiple Antenna Systems with Coarsely Quantized Signals. In this work, we present block diagonalization and power allocation algorithms for large scale multiple antenna systems with coarsely quantized signals. In particular, we develop Coarse Quantization Aware Block Diagonalization scriptstyle mathrm left(CQA BD right) and Coarse Quantization Aware Regularized Block Diagonalization scriptstyle mathrm left(CQA RBD right) precoding algorithms that employ the Bussgang decomposition and can mitigate the effects of low resolution signals and interference. Moreover, we also devise the Coarse Quantization Aware Most Advantageous Allocation Strategy scriptstyle mathrm left(CQA MAAS right) power allocation algorithm to improve the sum rate of precoders that operate with low resolution signals. An analysis of the sum rate performance is carried out along with computational complexity and power consumption studies of the proposed and existing techniques. Simulation results illustrate the performance of the proposed scriptstyle mathrm CQA BD and scriptstyle mathrm CQA RBD precoding algorithms, and the proposed scriptstyle mathrm CQA MAAS power allocation strategy against existing approaches.


Normalizers in the non pointed context a weak case of extremal decomposition. The aim of this work is to point out a strong structural phenomenon hidden behind the existence of normalizers through the investigation of this property in the non pointed context given any category E, a certain property of the fibration of points Pt(E) E guarentees the existence of normalizers. This property becomes a characterization of this existence when E is quasi pointed and protomodular. This property is also showed to be equivalent to a property of the category GrdE of internal groupoids in E which is a kind of opposite, for the monomorphic internal functors, of the comprehensive factorization.


HVSRweb An Open Source, Web Based Application for Horizontal to Vertical Spectral Ratio Processing. The horizontal to vertical spectral ratio (HVSR) method has become an increasingly popular tool for developing a quick and reliable estimate of a site's fundamental natural frequency ( f 0 ). This paper presents HVSRweb, an open source, web based application for performing HVSR calculations in a convenient, reliable, and statistically consistent manner. HVSRweb allows the user to upload three component ambient noise records and perform the HVSR calculation in the cloud, with no installation required. The HVSR calculation can be performed using a single combined horizontal component (e.g., geometric mean, squared average) or multiple rotated horizontal components to investigate azimuthal variability. HVSRweb can reject spurious time windows using an automated frequency domain window rejection algorithm, removing the need for subjective and time consuming user interaction. It also facilitates the use of lognormal statistics for f 0 , allowing for a consistent statistical framework capable of quantifying measurement uncertainty in terms of either frequency or its reciprocal, period. In addition, HVSRweb presents the opportunity to rapidly incorporate new developments in processing and quantification of uncertainty as they emerge, and encourages standardization of HVSR processing across users while avoiding the challenges associated with traditional approaches that require the user to perform regular updates to keep pace with new developments.


A Survey of Stability Results for Redundancy Systems. Redundancy mechanisms consist in sending several copies of a same job to a subset of servers. It constitutes one of the most promising ways to exploit diversity in multiservers applications. However, its pros and cons are still not sufficiently understood in the context of realistic models with generic statistical properties of service times distributions and correlation structures of copies. We aim at giving a survey of recent results concerning the stability arguably the first benchmark of performance of systems with cancel oncompletion redundancy. We also point out open questions and conjectures.


HARPO Learning to Subvert Online Behavioral Advertising. Online behavioral advertising, and the associated tracking paraphernalia, poses a real privacy threat. Unfortunately, existing privacy enhancing tools are not always effective against online advertising and tracking. We propose Harpo, a principled learning based approach to subvert online behavioral advertising through obfuscation. Harpo uses reinforcement learning to adaptively interleave real page visits with fake pages to distort a tracker's view of a user's browsing profile. We evaluate Harpo against real world user profiling and ad targeting models used for online behavioral advertising. The results show that Harpo improves privacy by triggering more than 40 incorrect interest segments and 6x higher bid values. Harpo outperforms existing obfuscation tools by as much as 16x for the same overhead. Harpo is also able to achieve better stealthiness to adversarial detection than existing obfuscation tools. Harpo meaningfully advances the state of the art in leveraging obfuscation to subvert online behavioral advertising


Authentication and Access Control in 5G Device to Device Communication. Device to device (D2D) communication is one of the most recent advancements in wireless communication technology. It was introduced in cellular communication technology by the 3rd Generation Partnership Project (3GPP) to lay a foundation for the evolving 5G architecture. It has now emerged as a promising technology for proximate devices. It enables proximate devices to communicate directly without the involvement of a third party network infrastructure. Researchers are analysing various methods to facilitate the smooth integration of D2D communication technology into the existing network system architecture. This paper lists all the different possible modes of operation in D2D communication based on the varying use case scenarios and highlights the security and privacy requirements for D2D communication. Some of the recent authentication proposals for D2D communication technology are further reviewed, and their security and privacy capabilities are analysed. Apart from authentication, we also reviewed some recent proposals of access control in D2D and highlighted the security issues addressed. We then identified the open issues that prevail in implementing D2D technology in a real world scenario for future researchers, emphasising the existing authentication and access control techniques in D2D communication.


On the one dimensional Logarithmic diffusion equation with nonlinear Robin boundary conditions. In this paper we investigate the one dimensional (1D) logarithmic diffusion equation with nonlinear Robin boundary conditions, namely, left begin array l partial t u partial xx log u quad mbox in quad left l,l right times left(0, infty right) displaystyle partial x u left( pm l, t right) pm 2 gamma u p left( pm l, t right), end array right. where gamma is a constant. Let u 0 0 be a smooth function defined on left l,l right , and which satisfies the compatibility condition partial x log u 0 left( pm l right) pm 2 gamma u 0 p 1 left( pm l right). We show that for gamma 0 , p leq frac 3 2 solutions to the logarithmic diffusion equation above with initial data u 0 are global and blow up in infinite time, and for p 2 there is finite time blow up. Also, we show that in the case of gamma 0 , p geq frac 3 2 , solutions to the logarithmic diffusion equation with initial data u 0 are global and blow down in infinite time, but if p leq 1 there is finite time blow down. For some of the cases mentioned above, and some particular families of examples, we provide blow up and blow down rates. Our approach is partly based on studying the Ricci flow on a cylinder endowed with a mathbb S 1 symmetric metric. Then, we bring our ideas full circle by proving a new long time existence result for the Ricci flow on a cylinder without any symmetry assumption. Finally, we show a blow down result for the logarithmic diffusion equation on a disc.


Look Closer to Segment Better Boundary Patch Refinement for Instance Segmentation. Tremendous efforts have been made on instance segmentation but the mask quality is still not satisfactory. The boundaries of predicted instance masks are usually imprecise due to the low spatial resolution of feature maps and the imbalance problem caused by the extremely low proportion of boundary pixels. To address these issues, we propose a conceptually simple yet effective post processing refinement framework to improve the boundary quality based on the results of any instance segmentation model, termed BPR. Following the idea of looking closer to segment boundaries better, we extract and refine a series of small boundary patches along the predicted instance boundaries. The refinement is accomplished by a boundary patch refinement network at higher resolution. The proposed BPR framework yields significant improvements over the Mask R CNN baseline on Cityscapes benchmark, especially on the boundary aware metrics. Moreover, by applying the BPR framework to the PolyTransform SegFix baseline, we reached 1st place on the Cityscapes leaderboard.


Pointed Hopf actions on quantum generalized Weyl algebras. We study actions of pointed Hopf algebras in the ZZ graded setting. Our main result classifies inner faithful actions of generalized Taft algebras on quantum generalized Weyl algebras which respect the ZZ grading. We also show that generically the invariant rings of Taft actions on quantum generalized Weyl algebras are commutative Kleinian singularities.


Initialization Using Perlin Noise for Training Networks with a Limited Amount of Data. We propose a novel network initialization method using Perlin noise for training image classification networks with a limited amount of data. Our main idea is to initialize the network parameters by solving an artificial noise classification problem, where the aim is to classify Perlin noise samples into their noise categories. Specifically, the proposed method consists of two steps. First, it generates Perlin noise samples with category labels defined based on noise complexity. Second, it solves a classification problem, in which network parameters are optimized to classify the generated noise samples. This method produces a reasonable set of initial weights (filters) for image classification. To the best of our knowledge, this is the first work to initialize networks by solving an artificial optimization problem without using any real world images. Our experiments show that the proposed method outperforms conventional initialization methods on four image classification datasets.


Computa c c ao O vetor de transforma c c ao da sociedade. Society is changing, has always changed, and will keep changing. However, changes are becoming faster and what used to happen between generations, now happens in the same generation. Computing Science is one of the reasons for this speed and permeates, basically, every other knowledge area. This paper (written in Portugu es) describes, briefly, the worldwide initiatives to introduce Computing Science teaching in schools. As the paper's main conclusion, it is essential to introduce Computing Science and Computational Thinking for kids before they enter into a university.


Role of Water Model on Ion Dissociation at Ambient Conditions. We study ion pair dissociation in water at ambient conditions using a combination of classical and ab initio approaches. The goal of this study is to disentangle the sources of discrepancy observed in computed potentials of mean force. In particular we aim to understand why some models favor the stability of solvent separated ion pairs versus contact ion pairs. We found that some observed differences can be explained by non converged simulation parameters. However, we also unveil that for some models, small changes in the solution density can have significant effects on modifying the equilibrium balance between the two configurations. We conclude that the thermodynamic stability of contact and solvent separated ion pairs is very sensitive to the dielectric properties of the underlying simulation model. In general, classical models are very robust on providing a similar estimation of the contact ion pair stability, while this is much more variable in density functional theory based models. The barrier to transition from solvent separated to contact ion pair is fundamentally dependent on the balance between electrostatic potential energy and entropy. This reflects the importance of water intra and inter molecular polarizability in obtaining an accurate description of the screened ion ion interactions.


What makes us curious? analysis of a corpus of open domain questions. Every day people ask short questions through smart devices or online forums to seek answers to all kinds of queries. With the increasing number of questions collected it becomes difficult to provide answers to each of them, which is one of the reasons behind the growing interest in automated question answering. Some questions are similar to existing ones that have already been answered, while others could be answered by an external knowledge source such as Wikipedia. An important question is what can be revealed by analysing a large set of questions. In 2017, "We the Curious" science centre in Bristol started a project to capture the curiosity of Bristolians the project collected more than 10,000 questions on various topics. As no rules were given during collection, the questions are truly open domain, and ranged across a variety of topics. One important aim for the science centre was to understand what concerns its visitors had beyond science, particularly on societal and cultural issues. We addressed this question by developing an Artificial Intelligence tool that can be used to perform various processing tasks detection of equivalence between questions detection of topic and type and answering of the question. As we focused on the creation of a "generalist" tool, we trained it with labelled data from different datasets. We called the resulting model QBERT. This paper describes what information we extracted from the automated analysis of the WTC corpus of open domain questions.


Physics inspired structural representations for molecules and materials. The first step in the construction of a regression model or a data driven analysis, aiming to predict or elucidate the relationship between the atomic scale structure of matter and its properties, involves transforming the Cartesian coordinates of the atoms into a suitable representation. The development of atomic scale representations has played, and continues to play, a central role in the success of machine learning methods for chemistry and materials science. This review summarizes the current understanding of the nature and characteristics of the most commonly used structural and chemical descriptions of atomistic structures, highlighting the deep underlying connections between different frameworks, and the ideas that lead to computationally efficient and universally applicable models. It emphasizes the link between properties, structures, their physical chemistry and their mathematical description, provides examples of recent applications to a diverse set of chemical and materials science problems, and outlines the open questions and the most promising research directions in the field.


Lattice plasmon induced asymmetric transmission in two dimensional chiral arrays. Asymmetric transmission direction selective control of electromagnetic transmission between two ports is an important phenomenon typically exhibited by two dimensional chiral systems. Here, we study this phenomenon in chiral plasmonic metasurfaces supporting lattice plasmons modes. We show, both numerically and experimentally, that asymmetric transmission can be achieved through an unbalanced excitation of such lattice modes by circularly polarized light of opposite handedness. The excitation efficiencies of the lattice modes, and hence the strength of the asymmetric transmission, can be controlled by engineering the in plane scattering of the individual plasmonic nanoparticles such that the maximum scattering imbalance occurs along one of the in plane diffraction orders of the metasurface. Our study also shows that, contrary to the case of a non diffractive metasurface, the lattice plasmon enabled asymmetric transmission can occur at normal incidence for cases where the metasurface is composed of chiral or achiral nanoparticles possessing 4 fold rotational symmetry.


The alternating central extension of the q Onsager algebra. The q Onsager algebra O q is presented by two generators W 0 , W 1 and two relations, called the q Dolan Grady relations. Recently Baseilhac and Koizumi introduced a current algebra mathcal A q for O q . Soon afterwards, Baseilhac and Shigechi gave a presentation of mathcal A q by generators and relations. We show that these generators give a PBW basis for mathcal A q . Using this PBW basis, we show that the algebra mathcal A q is isomorphic to O q otimes mathbb F lbrack z 1, z 2, ldots rbrack , where mathbb F is the ground field and lbrace z n rbrace n 1 infty are mutually commuting indeterminates. Recall the positive part U q of the quantized enveloping algebra U q( widehat mathfrak sl 2) . Our results show that O q is related to mathcal A q in the same way that U q is related to the alternating central extension of U q . For this reason, we propose to call mathcal A q the alternating central extension of O q .


Proof of Cayley Hamilton theorem using polynomials over the algebra of module endomorphisms. If R is a commutative unital ring and M is a unital R module, then each element of operatorname End R(M) determines a left operatorname End R (M) X module structure on operatorname End R (M) , where operatorname End R (M) is the R algebra of endomorphisms of M and operatorname End R (M) X operatorname End R (M) otimes RR X . These structures provide a very short proof of the Cayley Hamilton theorem, which may be viewed as a reformulation of the proof in Algebra by Serge Lang. Some generalisations of the Cayley Hamilton theorem can be easily proved using the proposed method.


The Concurrent OLSA test A method for speech recognition in multi talker situations at fixed SNR. A multi talker paradigm is introduced that uses different attentional processes to adjust speech recognition scores with the goal to conduct measurements at high signal to noise ratios. The basic idea is to simulate a group conversation with three talkers and a participant. Talkers alternately speak sentences of the German matrix test OLSA. Each time a sentence begins with the name "Kerstin" (call sign), the participant is addressed and instructed to repeat the last words of all sentences from that talker, until another talker begins a sentence with "Kerstin". The alternation of the talkers is implemented with an adjustable overlap time that causes an overlap between the call sign "Kerstin" and the target words to be repeated. Thus, the two tasks of detecting "Kerstin" and repeating target words are to be processed at the same time as a dual task. The paradigm was tested with 22 young normal hearing participants for three overlap times (0.6 s, 0.8 s, 1.0 s). Results for these overlap times show significant differences with median target word recognition scores of 88 , 82 , and 77 , respectively (including call sign and dual task effects). A comparison of the dual task with the corresponding single tasks suggests that the observed effects reflect an increased cognitive load.


Memory Effects in Scattering from Accelerating Bodies. Interaction of electromagnetic, acoustic and even gravitational waves with accelerating bodies forms a class of nonstationary time variant processes. Scattered waves contain intrinsic signatures of motion, which manifest in a broad range of phenomena, including Sagnac interference, Doppler and micro Doppler frequency shifts. While general relativity is often required to account for motion, instantaneous rest frame approaches are frequently used to describe interactions with slowly accelerating objects. Here we investigate theoretically and experimentally an interaction regime, which is neither relativistic nor adiabatic. The test model considers an accelerating scatterer with a long lasting relaxation memory. The slow decay rates violate the instantaneous reaction assumption of quasi stationarity, introducing non Markovian contributions to the scattering process. Memory signatures in scattering from a rotating dipole are studied theoretically, showing symmetry breaking of micro Doppler combs. A quasi stationary numeric analysis of scattering in the short memory limit is proposed and validated experimentally with an example of electromagnetic pulses interacting with a rotating wire.


Reputation and Pricing Dynamics in Online Markets. We study the economic interactions among sellers and buyers in online markets. In such markets, buyers have limited information about the product quality, but can observe the sellers' reputations which depend on their past transaction histories and ratings from past buyers. Sellers compete in the same market through pricing, while considering the impact of their heterogeneous reputations. We consider sellers with limited as well as unlimited capacities, which correspond to different practical market scenarios. In the unlimited seller capacity scenario, buyers prefer the seller with the highest reputation price ratio. If the gap between the highest and second highest seller reputation levels is large enough, then the highest reputation seller dominates the market as a monopoly. If sellers' reputation levels are relatively close to each other, then those sellers with relatively high reputations will survive at the equilibrium, while the remaining relatively low reputation sellers will get zero market share. In the limited seller capacity scenario, we further consider two different cases. If each seller can only serve one buyer, then it is possible for sellers to set their monopoly prices at the equilibrium while all sellers gain positive market shares if each seller can serve multiple buyers, then it is possible for sellers to set maximum prices at the equilibrium. Simulation results show that the dynamics of reputations and prices in the longer term interactions will converge to stable states, and the initial buyer ratings of the sellers play the critical role in determining sellers' reputations and prices at the stable state.


Personalized Food Recommendation as Constrained Question Answering over a Large scale Food Knowledge Graph. Food recommendation has become an important means to help guide users to adopt healthy dietary habits. Previous works on food recommendation either i) fail to consider users' explicit requirements, ii) ignore crucial health factors (e.g., allergies and nutrition needs), or iii) do not utilize the rich food knowledge for recommending healthy recipes. To address these limitations, we propose a novel problem formulation for food recommendation, modeling this task as constrained question answering over a large scale food knowledge base graph (KBQA). Besides the requirements from the user query, personalized requirements from the user's dietary preferences and health guidelines are handled in a unified way as additional constraints to the QA system. To validate this idea, we create a QA style dataset for personalized food recommendation based on a large scale food knowledge graph and health guidelines. Furthermore, we propose a KBQA based personalized food recommendation framework which is equipped with novel techniques for handling negations and numerical comparisons in the queries. Experimental results on the benchmark show that our approach significantly outperforms non personalized counterparts (average 59.7 absolute improvement across various evaluation metrics), and is able to recommend more relevant and healthier recipes.


Utilizing Skipped Frames in Action Repeats via Pseudo Actions. In many deep reinforcement learning settings, when an agent takes an action, it repeats the same action a predefined number of times without observing the states until the next action decision point. This technique of action repetition has several merits in training the agent, but the data between action decision points (i.e., intermediate frames) are, in effect, discarded. Since the amount of training data is inversely proportional to the interval of action repeats, they can have a negative impact on the sample efficiency of training. In this paper, we propose a simple but effective approach to alleviate to this problem by introducing the concept of pseudo actions. The key idea of our method is making the transition between action decision points usable as training data by considering pseudo actions. Pseudo actions for continuous control tasks are obtained as the average of the action sequence straddling an action decision point. For discrete control tasks, pseudo actions are computed from learned action embeddings. This method can be combined with any model free reinforcement learning algorithm that involves the learning of Q functions. We demonstrate the effectiveness of our approach on both continuous and discrete control tasks in OpenAI Gym.


Hierarchical Optimization of Electric Vehicle Charging Infrastructure Design and Facility Logistics. This study proposes a bi level optimization program to represent the electric vehicle (EV) charging infrastructure design and utilization management problem with user equilibrium (UE) decisions. The upper level aims to minimize total facility deployment costs and maximize the revenue generated from EV charging collections, while the lower level aims to minimize the EV users' travel times and charging expenses. An iterative technique is implemented to solve the bi level mixed integer non linear program that generates theoretical lower and upper bounds to the bi level model and solves it to global optimality. A set of conditions are evaluated to show the convergence of the algorithm in a finite number of iterations. The numerical results, based on three demand levels, indicate that the proposed bi level model can effectively determine the optimal charging facility location, physical capacity, and demand responsive pricing scheme. The average charging price in medium demand level is increased by 38.21 compared to the lower level demand due to the surge in charging needs and highly utilized charging stations.


Fourth order Schr "odinger equation with mixed dispersion on Cartan Hadamard manifolds. We study the fourth order Schr "odinger equation with mixed dispersion on an N dimensional Cartan Hadamard manifold. At first, we focus on the case of the hyperbolic space. Using the fact that there exists a Fourier transform on this space, we prove the existence of a global solution to our equation as well as scattering for small initial data. Next, we obtain weighted Strichartz estimates for radial solutions on a large class of rotationally symmetric manifolds by adapting the method of Banica and Duyckaerts (Dyn. Partial Differ. Equ., 07). Finally, we give a blow up result for a rotationally symmetric manifold relying on a localized virial argument.


Training Algorithm Matters for the Performance of Neural Network Potential A Case Study of Adam and the Kalman Filter Optimizers. One hidden yet important issue for developing neural network potentials (NNPs) is the choice of training algorithm. Here we compare the performance of two popular training algorithms, the adaptive moment estimation algorithm (Adam) and the Extended Kalman Filter algorithm (EKF), using the Behler Parrinello neural network (BPNN) and two publicly accessible datasets of liquid water Proc. Natl. Acad. Sci. U.S.A. 2016, 113, 8368 8373 and Proc. Natl. Acad. Sci. U.S.A. 2019, 116, 1110 1115 . This is achieved by implementing EKF in TensorFlow. It is found that NNPs trained with EKF are more transferable and less sensitive to the value of the learning rate, as compared to Adam. In both cases, error metrics of the validation set do not always serve as a good indicator for the actual performance of NNPs. Instead, we show that their performance correlates well with a Fisher information based similarity measure.


Image Completion via Inference in Deep Generative Models. We consider image completion from the perspective of amortized inference in an image generative model. We leverage recent state of the art variational auto encoder architectures that have been shown to produce photo realistic natural images at non trivial resolutions. Through amortized inference in such a model we can train neural artifacts that produce diverse, realistic image completions even when the vast majority of an image is missing. We demonstrate superior sample quality and diversity compared to prior art on the CIFAR 10 and FFHQ 256 datasets. We conclude by describing and demonstrating an application that requires an in painting model with the capabilities ours exhibits the use of Bayesian optimal experimental design to select the most informative sequence of small field of view x rays for chest pathology detection.


Modelling and Verification of Reconfigurable Multi Agent Systems. We propose a formalism to model and reason about reconfigurable multi agent systems. In our formalism, agents interact and communicate in different modes so that they can pursue joint tasks agents may dynamically synchronize, exchange data, adapt their behaviour, and reconfigure their communication interfaces. Inspired by existing multi robot systems, we represent a system as a set of agents (each with local state), executing independently and only influence each other by means of message exchange. Agents are able to sense their local states and partially their surroundings. We extend LTL to be able to reason explicitly about the intentions of agents in the interaction and their communication protocols. We also study the complexity of satisfiability and model checking of this extension.


TENSILE A Tensor granularity dynamic GPU memory scheduling method towards multiple dynamic workloads system. Recently, deep learning has been an area of intense research. However, as a kind of computing intensive task, deep learning highly relies on the scale of GPU memory, which is usually prohibitive and scarce. Although there are some extensive works have been proposed for dynamic GPU memory management, they are hard to be applied to systems with multiple dynamic workloads, such as in database machine learning systems. In this paper, we demonstrated TENSILE, a method of managing GPU memory in tensor granularity to reduce the GPU memory peak, considering the multiple dynamic workloads. TENSILE tackled the cold starting and across iteration scheduling problem existing in previous works. We implement TENSILE on a deep learning framework built by ourselves and evaluated its performance. The experiment results show that TENSILE can save more GPU memory with less extra time overhead than prior works in both single and multiple dynamic workloads scenarios.


A Metropolis Monte Carlo Algorithm for Merging Single Particle Diffraction Intensities. Single particle imaging with X ray free electron lasers depends crucially on algorithms that merge large numbers of weak diffraction patterns despite missing measurements of parameters such as particle orientations. The Expand Maximize Compress (EMC) algorithm is highly effective at merging single particle diffraction patterns with missing orientation values, but most implementations exhaustively sample the space of missing parameters and may become computationally prohibitive as the number of degrees of freedom extend beyond orientation angles. Here we describe how the EMC algorithm can be modified to employ Metropolis Monte Carlo sampling rather than grid sampling, which may be favorable for cases with more than three missing parameters. Using simulated data, this variant is compared to the standard EMC algorithm. Higher dimensional cases of mixed target species and variable x ray fluence are also explored.


Subdivision and cellularity for weighted KLRW algebras. Weighted KLRW algebras are diagram algebras generalizing KLR algebras. This paper undertakes a systematic study of these algebras culminating in the construction of homogeneous affine cellular bases in infty finite or affine types A and C, which immediately gives cellular bases for the cyclotomic quotients of these algebras. In addition, we construct subdivision homomorphisms that relate weighted KLRW algebras for different quivers.


An Ample Approach to Data and Modeling. In the present work, we describe a framework for modeling how models can be built that integrates concepts and methods from a wide range of fields. The information schism between the real world and that which can be gathered and considered by any individual information processing agent is characterized and discussed, followed by the presentation of a series of the adopted requisites while developing the modeling approach. The issue of mapping from datasets into models is subsequently addressed, as well as some of the respectively implied difficulties and limitations. Based on these considerations, an approach to meta modeling how models are built is then progressively developed. First, the reference M meta model framework is presented, which relies critically in associating whole datasets and respective models in terms of a strict equivalence relation. Among the interesting features of this model are its ability to bridge the gap between data and modeling, as well as paving the way to an algebra of both data and models which can be employed to combine models into hierarchical manner. After illustrating the M model in terms of patterns derived from regular lattices, the reported modeling approach continues by discussing how sampling issues, error and overlooked data can be addressed, leading to the M epsilon variant, illustrated respectively to number theory. The situation in which the data needs to be represented in terms of respective probability densities is treated next, yielding the M sigma meta model, which is then illustrated respectively to a real world dataset (iris flowers data). Several considerations about how the developed framework can provide insights about data clustering, complexity, collaborative research, deep learning, and creativity are then presented, followed by overall conclusions.


UNIREX A Unified Learning Framework for Language Model Rationale Extraction. An extractive rationale explains a language model's (LM's) prediction on a given task instance by highlighting the text inputs that most influenced the prediction. Ideally, rationale extraction should be faithful (reflective of LM's actual behavior) and plausible (convincing to humans), without compromising the LM's (i.e., task model's) task performance. Although attribution algorithms and select predict pipelines are commonly used in rationale extraction, they both rely on certain heuristics that hinder them from satisfying all three desiderata. In light of this, we propose UNIREX, a flexible learning framework which generalizes rationale extractor optimization as follows (1) specify architecture for a learned rationale extractor (2) select explainability objectives (i.e., faithfulness and plausibility criteria) and (3) jointly the train task model and rationale extractor on the task using selected objectives. UNIREX enables replacing prior works' heuristic design choices with a generic learned rationale extractor in (1) and optimizing it for all three desiderata in (2) (3). To facilitate comparison between methods w.r.t. multiple desiderata, we introduce the Normalized Relative Gain (NRG) metric. Across five text classification datasets, our best UNIREX configuration outperforms baselines by an average of 32.9 NRG. Plus, we find that UNIREX trained rationale extractors can even generalize to unseen datasets and tasks.


An Algorithm for Limited Visibility Graph Searching. We study a graph search problem in which a team of searchers attempts to find a mobile target located in a graph. Assuming that (a) the visibility field of the searchers is limited, (b) the searchers have unit speed and (c) the target has infinite speed, we formulate the Limited Visibility Graph Search (LVGS) problem and present the LVGS algorithm, which produces a search schedule guaranteed to find the target in the minimum possible number of steps. Our LVGS algorithm is a conversion of Guibas and Lavalle's polygonal region search algorithm.


Gaussian fluctuation for spatial average of super Brownian motion. Let u(t ,, x) (t, x) in mathbb R times mathbb R be the density of one dimensional super Brownian motion starting from Lebesgue measure. Using the Laplace functional of super Brownian motion, we prove that as N to infty , the normalized spatial integral N 1 2 int 0 xN u(t ,, z) 1 rm d z converges jointly in (t, x) to Brownian sheet in distribution.


Collecting a Large Scale Gender Bias Dataset for Coreference Resolution and Machine Translation. Recent works have found evidence of gender bias in models of machine translation and coreference resolution using mostly synthetic diagnostic datasets. While these quantify bias in a controlled experiment, they often do so on a small scale and consist mostly of artificial, out of distribution sentences. In this work, we find grammatical patterns indicating stereotypical and non stereotypical gender role assignments (e.g., female nurses versus male dancers) in corpora from three domains, resulting in a first large scale gender bias dataset of 108K diverse real world English sentences. We manually verify the quality of our corpus and use it to evaluate gender bias in various coreference resolution and machine translation models. We find that all tested models tend to over rely on gender stereotypes when presented with natural inputs, which may be especially harmful when deployed in commercial systems. Finally, we show that our dataset lends itself to finetuning a coreference resolution model, finding it mitigates bias on a held out set. Our dataset and models are publicly available at www.github.com SLAB NLP BUG. We hope they will spur future research into gender bias evaluation mitigation techniques in realistic settings.


Complementary cycles of any length in regular bipartite tournaments. Let D be a k regular bipartite tournament on n vertices. We show that, for every p with 2 le p le n 2 2 , D has a cycle C of length 2p such that D setminus C is hamiltonian unless D is isomorphic to the special digraph F 4k . This statement was conjectured by Manoussakis, Song and Zhang K. Zhang, Y. Manoussakis, and Z. Song. Complementary cycles containing a fixed arc in diregular bipartite tournaments. Discrete Mathematics, 133(1 3) 325 328,1994 . In the same paper, the conjecture was proved for p 2 and more recently Bai, Li and He gave a proof for p 3 Y. Bai, H. Li, and W. He. Complementary cycles in regular bipartite tournaments. Discrete Mathematics, 333 14 27, 2014 .


Ultrafast Laser Ablation, Intrinsic Threshold, and Nanopatterning of Monolayer Molybdenum Disulfide. Laser direct writing is an attractive method for patterning 2D materials without contamination. Literature shows that the femtosecond ablation threshold of graphene across substrates varies by an order of magnitude. Some attribute it to the thermal coupling to the substrates, but it remains by and large an open question. For the first time the effect of substrates on femtosecond ablation of 2D materials is studied using MoS 2 as an example. We show unambiguously that femtosecond ablation of MoS 2 is an adiabatic process with negligible heat transfer to the substrates. The observed threshold variation is due to the etalon effect which was not identified before for the laser ablation of 2D materials. Subsequently, an intrinsic ablation threshold is proposed as a true threshold parameter for 2D materials. Additionally, we demonstrate for the first time femtosecond laser patterning of monolayer MoS 2 with sub micron resolution and mm s speed. Moreover, engineered substrates are shown to enhance the ablation efficiency, enabling patterning with low power femtosecond oscillators. Finally, a zero thickness approximation is introduced to predict the field enhancement with simple analytical expressions. Our work clarifies the role of substrates on ablation and firmly establishes femtosecond laser ablation as a viable route to pattern 2D materials.


Mean Variance Investment and Risk Control Strategies A Time Consistent Approach via A Forward Auxiliary Process. We consider an optimal investment and risk control problem for an insurer under the mean variance (MV) criterion. By introducing a deterministic auxiliary process defined forward in time, we formulate an alternative time consistent problem related to the original MV problem, and obtain the optimal strategy and the value function to the new problem in closed form. We compare our formulation and optimal strategy to those under the precommitment and game theoretic framework. Numerical studies show that, when the financial market is negatively correlated with the risk process, optimal investment may involve short selling the risky asset and, if that happens, a less risk averse insurer short sells more risky asset.


Insight from NLP Analysis COVID 19 Vaccines Sentiments on Social Media. Social media is an appropriate source for analyzing public attitudes towards the COVID 19 vaccine and various brands. Nevertheless, there are few relevant studies. In the research, we collected tweet posts by the UK and US residents from the Twitter API during the pandemic and designed experiments to answer three main questions concerning vaccination. To get the dominant sentiment of the civics, we performed sentiment analysis by VADER and proposed a new method that can count the individual's influence. This allows us to go a step further in sentiment analysis and explain some of the fluctuations in the data changing. The results indicated that celebrities could lead the opinion shift on social media in vaccination progress. Moreover, at the peak, nearly 40 of the population in both countries have a negative attitude towards COVID 19 vaccines. Besides, we investigated how people's opinions toward different vaccine brands are. We found that the Pfizer vaccine enjoys the most popular among people. By applying the sentiment analysis tool, we discovered most people hold positive views toward the COVID 19 vaccine manufactured by most brands. In the end, we carried out topic modelling by using the LDA model. We found residents in the two countries are willing to share their views and feelings concerning the vaccine. Several death cases have occurred after vaccination. Due to these negative events, US residents are more worried about the side effects and safety of the vaccine.


Generalization of Poincar 'e recurrence theorem for flows on surfaces and characterization of minimal flows on compact surfaces. Poincar 'e recurrence theorem implies the density of recurrent points for volume preserving dynamical systems on compact domains. The density of closed orbits in the non wandering set is one of the essential properties of Axiom A and chaos. The minimal flows are one of the most fundamental objects in topological dynamics. To analyze minimality, recurrence, and density in this paper, we introduce a strict limit circuit and a circuit with wandering holonomy. Using these concepts, we classify non recurrent non wandering orbits of flows on compact surfaces with finitely many singular points, characterize the minimality of flows on compact surfaces, and generalize the Poincar 'e recurrence theorem for flows on surfaces. Moreover, we characterize the density of closed orbits in the non wandering set under finiteness of singular points. Furthermore, we demonstrate the necessity of finiteness of singular points and compactness of surfaces. In addition, the analogous results hold for flows with finitely many connected components of the singular point set on non compact surfaces using the end compactification and collapsing singular points.


Explicit Numerical Approximations for McKean Vlasov Neutral Stochastic Differential Delay Equations. This paper studies the convergence of the tamed Euler Maruyama (EM) scheme for a class of McKean Vlasov neutral stochastic differential delay equations (MV NSDDEs) that the drift coefficients satisfy the super linear growth condition. We provide the existence and uniqueness of strong solutions to MV NSDDEs. Then, we use a stochastic particle method, which is based upon the theory of the propagation of chaos between particle system and the original MV NSDDE, to deal with the approximation of the law. Moreover, we obtain the convergence rate of tamed EM scheme with respect to the corresponding particle system. Combining the result of propagation of chaos and the convergence rate of the numerical solution to the particle system, we get a convergence error between the numerical solution and exact solution of the original MV NSDDE in the stepsize and number of particles.


Text Mining of Stocktwits Data for Predicting Stock Prices. Stock price prediction can be made more efficient by considering the price fluctuations and understanding the sentiments of people. A limited number of models understand financial jargon or have labelled datasets concerning stock price change. To overcome this challenge, we introduced FinALBERT, an ALBERT based model trained to handle financial domain text classification tasks by labelling Stocktwits text data based on stock price change. We collected Stocktwits data for over ten years for 25 different companies, including the major five FAANG (Facebook, Amazon, Apple, Netflix, Google). These datasets were labelled with three labelling techniques based on stock price changes. Our proposed model FinALBERT is fine tuned with these labels to achieve optimal results. We experimented with the labelled dataset by training it on traditional machine learning, BERT, and FinBERT models, which helped us understand how these labels behaved with different model architectures. Our labelling method competitive advantage is that it can help analyse the historical data effectively, and the mathematical function can be easily customised to predict stock movement.


On a family of C subalgebras of Cuntz Krieger algebras. In this paper, we study a family of C subalgebras defined by fixed points of generalized gauge actions of a Cuntz Krieger algebra, by introducing a family of 'etale groupoids whose associated C algebras are these C subalgebras. We know that topological conjugacy classes of one sided topological Markov shifts are characterized in terms of the isomorphism classes of these 'etale groupoids.


Mechanical Performance of 3D Printed Interpenetrating Phase Composites with Spinodal Topologies. The mechanical response of interpenetrating phase composites (IPCs) with stochastic spinodal topologies is investigated experimentally and numerically. Model polymeric systems are fabricated by Polyjet multi material printing, with the reinforcing phase taking the topology of a spinodal shell, and the remaining volume filled by a softer matrix. We show that spinodal shell IPCs have comparable compressive strength and stiffness to IPCs with two well established periodic reinforcements, the Schwarz P triply periodic minimal surface (TPMS) and the octet truss lattice, while exhibiting far less catastrophic failure and greater damage resistance, particularly at high volume fraction of reinforcing phase. The combination of high stiffness and strength and a long flat plateau after yielding makes spinodal shell IPCs a promising candidate for energy absorption and impact protection applications, where the lack of material softening upon large compressive strains can prevent sudden collapse. Importantly, in contrast with all IPCs with periodic reinforcements, spinodal shell IPCs are amenable to scalable manufacturing via self assembly techniques.


On the Implicit Bias of Initialization Shape Beyond Infinitesimal Mirror Descent. Recent work has highlighted the role of initialization scale in determining the structure of the solutions that gradient methods converge to. In particular, it was shown that large initialization leads to the neural tangent kernel regime solution, whereas small initialization leads to so called "rich regimes". However, the initialization structure is richer than the overall scale alone and involves relative magnitudes of different weights and layers in the network. Here we show that these relative scales, which we refer to as initialization shape, play an important role in determining the learned model. We develop a novel technique for deriving the inductive bias of gradient flow and use it to obtain closed form implicit regularizers for multiple cases of interest.


Privacy Policy Question Answering Assistant A Query Guided Extractive Summarization Approach. Existing work on making privacy policies accessible has explored new presentation forms such as color coding based on the risk factors or summarization to assist users with conscious agreement. To facilitate a more personalized interaction with the policies, in this work, we propose an automated privacy policy question answering assistant that extracts a summary in response to the input user query. This is a challenging task because users articulate their privacy related questions in a very different language than the legal language of the policy, making it difficult for the system to understand their inquiry. Moreover, existing annotated data in this domain are limited. We address these problems by paraphrasing to bring the style and language of the user's question closer to the language of privacy policies. Our content scoring module uses the existing in domain data to find relevant information in the policy and incorporates it in a summary. Our pipeline is able to find an answer for 89 of the user queries in the privacyQA dataset.


Random Conical Tilt Reconstruction without Particle Picking in Cryo electron Microscopy. We propose a method to reconstruct the 3 D molecular structure from micrographs collected at just one sample tilt angle in the random conical tilt scheme in cryo electron microscopy. Our method uses autocorrelation analysis on the micrographs to estimate features of the molecule which are invariant under certain nuisance parameters such as the positions of molecular projections in the micrographs. This enables us to reconstruct the molecular structure directly from micrographs, completely circumventing the need for particle picking. We demonstrate reconstructions with simulated data and investigate the effect of the missing cone region. These results show promise to reduce the size limit for single particle reconstruction in cryo electron microscopy.


Entropic regularisation of non gradient systems. The theory of Wasserstein gradient flows in the space of probability measures has made an enormous progress over the last twenty years. It constitutes a unified and powerful framework in the study of dissipative partial differential equations (PDEs) providing the means to prove well posedness, regularity, stability and quantitative convergence to the equilibrium. The recently developed entropic regularisation technique paves the way for fast and efficient numerical methods for solving these gradient flows. However, many PDEs of interest do not have a gradient flow structure and, a priori, the theory is not applicable. In this paper, we develop a time discrete entropy regularised variational scheme for a general class of such non gradient PDEs. We prove the convergence of the scheme and illustrate the breadth of the proposed framework with concrete examples including the non linear kinetic Fokker Planck (Kramers) equation and a non linear degenerate diffusion of Kolmogorov type. Numerical simulations are also provided.


Improving random walk rankings with feature selection and imputation. The Science4cast Competition consists of predicting new links in a semantic network, with each node representing a concept and each edge representing a link proposed by a paper relating two concepts. This network contains information from 1994 2017, with a discretization of days (which represents the publication date of the underlying papers). Team Hash Brown's final submission, emph ee5a , achieved a score of 0.92738 on the test set. Our team's score ranks emph second place , 0.01 below the winner's score. This paper details our model, its intuition, and the performance of its variations in the test set.


Autonomous Inversion of In Situ Deformation Measurement Data for CO2 Storage Decision Support. Current methods of estimating the change in stress caused by injecting fluid into subsurface formations require choosing the type of constitutive model and the model parameters based on core, log, and geophysical data during the characterization phase, with little feedback from operational observations to validate or refine these choices. It is shown that errors in the assumed constitutive response, even when informed by laboratory tests on core samples, are likely to be common, large, and underestimate the magnitude of stress change caused by injection. Recent advances in borehole based strain instruments and borehole and surface based tilt and displacement instruments have now enabled monitoring of the deformation of the storage system throughout its operational lifespan. This data can enable validation and refinement of the knowledge of the geomechanical properties and state of the system, but brings with it a challenge to transform the raw data into actionable knowledge. We demonstrate a method to perform a gradient based deterministic inversion of geomechanical monitoring data. This approach allows autonomous integration of the instrument data without the need for time consuming manual interpretation and selection of updated model parameters. The approach presented is very flexible as to what type of geomechanical constitutive response can be used. The approach is easily adaptable to nonlinear physics based constitutive models to account for common rock behaviors such as creep and plasticity. The approach also enables training of machine learning based constitutive models by allowing back propagation of errors through the finite element calculations. This enables strongly enforcing known physics, such as conservation of momentum and continuity, while allowing data driven models to learn the truly unknown physics such as the constitutive or petrophysical responses.


Understanding Fuchsia Security. Fuchsia is a new open source operating system created at Google that is currently under active development. The core architectural principles guiding the design and development of the OS include high system modularity and a specific focus on security and privacy. This paper analyzes the architecture and the software model of Fuchsia, giving a specific focus on the core security mechanisms of this new operating system.


A Privacy Preserving Platform for Recording COVID 19 Vaccine Passports. Digital vaccine passports are one of the main solutions which would allow the restart of travel in a post COVID 19 world. Trust, scalability and security are all key challenges one must overcome in implementing a vaccine passport. Initial approaches attempt to solve this problem by using centralised systems with trusted authorities. However, sharing vaccine passport data between different organisations, regions and countries has become a major challenge. This paper designs a new platform architecture for creating, storing and verifying digital COVID 19 vaccine certifications. The platform makes use of the InterPlanetary File System (IPFS) to guarantee there is no single point of failure and allow data to be securely distributed globally. Blockchain and smart contracts are also integrated into the platform to define policies and log access rights to vaccine passport data while ensuring all actions are audited and verifiably immutable. Our proposed platform realises General Data Protection Regulation (GDPR) requirements in terms of user consent, data encryption, data erasure and accountability obligations. We assess the scalability and performance of the platform using IPFS and Blockchain test networks.


Towards "Zero buffer" Datacenter Networks. In this paper, we investigate the possibility of building a data center network (DCN) with simplified zero buffer switches. It exposes a stringent requirement to the traffic control scheme to ensure perfect collision free between packets. We find it is infeasible, if not impossible, to make a large scale DCN completely zero buffering. We take a step back and propose Fastpod, a new data center architecture that enables zero buffering in pod scale, which can be expanded with buffered devices. With time synchronization, Fastpod avoids collisions by performing fine grained centralized control on data packets and coordination free scheduling on control packets. It leverages an optimistic sending mechanism to reduce the latency overhead induced by the centralized control. Our preliminary simulation results indicate that Fastpod successfully meets the requirement of collision free in the zero buffer pod and maintains similar performance with conventional buffered DCN. It follows the trend of simplifying the network by pushing the functionalities to the edge. Fastpod explores an extreme end of the design spectrum and can be treated as a thought experiment to raise discussion in the community of data center networks.


A strongly universal cellular automaton in the dodecagrid with five states. In this paper, we prove that there is a strongly universal cellular automaton in the dodecagrid, the tessellation 5,3,4 of the hyperbolic 3D space, with five states which is rotation invariant. This improves a previous paper of the author where the automaton required ten states.


Effect of soft and hard x rays on shock propagation, preheating and ablation characteristics in pure and doped Be ablators. In this paper, we analyze the performance of pure and doped Be ablators used for Inertial Confinement Fusion (ICF) pellets in terms of shock velocity, shock breakout temperature, preheat temperature and mass ablation rate through radiation hydrodynamic (RHD) simulations. For this study, we apply a constant radiation profile (drive temperatures varying from 120 200 eV) consisting of a low frequency Planck spectrum (soft x rays) and a high frequency Gaussian spectrum (hard x rays, commonly termed as "M band") on a planar foil of the ablator. The fraction of energy density in the hard x ray spectrum ( alpha ) has been varied from 0 to 0.25. The predominant effect of hard x rays is to preheat the ablator ahead of the shock front. Steady rise in preheat temperature and shock breakout temperature is observed on increasing the fraction of hard x rays. Preheating can be mitigated by doping Be with a mid Z element Cu as its opacity is much higher in the high frequency region. On doping Be with 1 Cu, the shock velocities decrease slightly compared to pure Be. However, higher shock velocities are observed on increasing the fraction of M band. We observe significant decrease in shock breakout and maximum preheat temperature in doped Be foil. Steady rise in these temperatures is observed on increasing alpha . We have proposed new scaling relations for shock velocity, shock breakout temperature, maximum preheat temperature and mass ablation rate with the radiation temperature and the fraction of M band energy density in both pure and doped Be ablators. In terms of ablator performance, Cu doped Be ablator is found to be superior to pure Be. Though doping significantly reduces preheating, the mass ablation rates are nearly unaffected.


Fusion of evidential CNN classifiers for image classification. We propose an information fusion approach based on belief functions to combine convolutional neural networks. In this approach, several pre trained DS based CNN architectures extract features from input images and convert them into mass functions on different frames of discernment. A fusion module then aggregates these mass functions using Dempster's rule. An end to end learning procedure allows us to fine tune the overall architecture using a learning set with soft labels, which further improves the classification performance. The effectiveness of this approach is demonstrated experimentally using three benchmark databases.


Strategic Information Revelation in Crowdsourcing Systems Without Verification. We study a crowdsourcing problem where the platform aims to incentivize distributed workers to provide high quality and truthful solutions without the ability to verify the solutions. While most prior work assumes that the platform and workers have symmetric information, we study an asymmetric information scenario where the platform has informational advantages. Specifically, the platform knows more information regarding worker average solution accuracy, and can strategically reveal such information to workers. Workers will utilize the announced information to determine the likelihood that they obtain a reward if exerting effort on the task. We study two types of workers, naive workers who fully trust the announcement, and strategic workers who update prior belief based on the announcement. For naive workers, we show that the platform should always announce a high average accuracy to maximize its payoff. However, this is not always optimal for strategic workers, as it may reduce the credibility of the platform announcement and hence reduce the platform payoff. Interestingly, the platform may have an incentive to even announce an average accuracy lower than the actual value when facing strategic workers. Another counterintuitive result is that the platform payoff may decrease in the number of high accuracy workers.


Vertical, Temporal, and Horizontal Scaling of Hierarchical Hypersparse GraphBLAS Matrices. Hypersparse matrices are a powerful enabler for a variety of network, health, finance, and social applications. Hierarchical hypersparse GraphBLAS matrices enable rapid streaming updates while preserving algebraic analytic power and convenience. In many contexts, the rate of these updates sets the bounds on performance. This paper explores hierarchical hypersparse update performance on a variety of hardware with identical software configurations. The high level language bindings of the GraphBLAS readily enable performance experiments on simultaneous diverse hardware. The best single process performance measured was 4,000,000 updates per second. The best single node performance measured was 170,000,000 updates per second. The hardware used spans nearly a decade and allows a direct comparison of hardware improvements for this computation over this time range showing a 2x increase in single core performance, a 3x increase in single process performance, and a 5x increase in single node performance. Running on nearly 2,000 MIT SuperCloud nodes simultaneously achieved a sustained update rate of over 200,000,000,000 updates per second. Hierarchical hypersparse GraphBLAS allows the MIT SuperCloud to analyze extremely large streaming network data sets.


Investigating Moral Foundations from Web Trending Topics. Moral foundations theory helps understand differences in morality across cultures. In this paper, we propose a model to predict moral foundations (MF) from social media trending topics. We also investigate whether differences in MF influence emotional traits. Our results are promising and leave room for future research avenues.


Higher Degree Davenport Constants over Finite Commutative Rings. We generalize the notion of Davenport constants to a higher degree' and obtain various lower and upper bounds, which are sometimes exact as is the case for certain finite commutative rings of prime power cardinality. Two simple examples that capture the essence of these higher degree Davenport constants are the following. 1) Suppose n 2 k , then every sequence of integers S of length 2n contains a subsequence S' of length at least two such that sum a i,a j in S' a ia j equiv 0 pmod n and the bound is sharp. 2) Suppose n equiv1 pmod 2 , then every sequence of integers S of length 2n 1 contains a subsequence S' of length at least two such that sum a i,a j in S' a ia j equiv 0 pmod n . These examples illustrate that if a sequence of elements from a finite commutative ring is long enough, certain symmetric expressions have to vanish on the elements of a subsequence.


Learning of feature points without additional supervision improves reinforcement learning from images. In many control problems that include vision, optimal controls can be inferred from the location of the objects in the scene. This information can be represented using feature points, which is a list of spatial locations in learned feature maps of an input image. Previous works show that feature points learned using unsupervised pre training or human supervision can provide good features for control tasks. In this paper, we show that it is possible to learn efficient feature point representations end to end, without the need for unsupervised pre training, decoders, or additional losses. Our proposed architecture consists of a differentiable feature point extractor that feeds the coordinates of the estimated feature points directly to a soft actor critic agent. The proposed algorithm yields performance competitive to the state of the art on DeepMind Control Suite tasks.


Transfer learning from High Resource to Low Resource Language Improves Speech Affect Recognition Classification Accuracy. Speech Affect Recognition is a problem of extracting emotional affects from audio data. Low resource languages corpora are rear and affect recognition is a difficult task in cross corpus settings. We present an approach in which the model is trained on high resource language and fine tune to recognize affects in low resource language. We train the model in same corpus setting on SAVEE, EMOVO, Urdu, and IEMOCAP by achieving baseline accuracy of 60.45, 68.05, 80.34, and 56.58 percent respectively. For capturing the diversity of affects in languages cross corpus evaluations are discussed in detail. We find that accuracy improves by adding the domain target data into the training data. Finally, we show that performance is improved for low resource language speech affect recognition by achieving the UAR OF 69.32 and 68.2 for Urdu and Italian speech affects.


AndroR2 A Dataset of Manually Reproduced Bug Reports for Android Applications. Software maintenance constitutes a large portion of the software development lifecycle. To carry out maintenance tasks, developers often need to understand and reproduce bug reports. As such, there has been increasing research activity coalescing around the notion of automating various activities related to bug reporting. A sizable portion of this research interest has focused on the domain of mobile apps. However, as research around mobile app bug reporting progresses, there is a clear need for a manually vetted and reproducible set of real world bug reports that can serve as a benchmark for future work. This paper presents ANDROR2 a dataset of 90 manually reproduced bug reports for Android apps listed on Google Play and hosted on GitHub, systematically collected via an in depth analysis of 459 reports extracted from the GitHub issue tracker. For each reproduced report, ANDROR2 includes the original bug report, an apk file for the buggy version of the app, an executable reproduction script, and metadata regarding the quality of the reproduction steps associated with the original report. We believe that the ANDROR2 dataset can be used to facilitate research in automatically analyzing, understanding, reproducing, localizing, and fixing bugs for mobile applications as well as other software maintenance activities more broadly.


SMU smooth activation function for deep networks using smoothing maximum technique. Deep learning researchers have a keen interest in proposing two new novel activation functions which can boost network performance. A good choice of activation function can have significant consequences in improving network performance. A handcrafted activation is the most common choice in neural network models. ReLU is the most common choice in the deep learning community due to its simplicity though ReLU has some serious drawbacks. In this paper, we have proposed a new novel activation function based on approximation of known activation functions like Leaky ReLU, and we call this function Smooth Maximum Unit (SMU). Replacing ReLU by SMU, we have got 6.22 improvement in the CIFAR100 dataset with the ShuffleNet V2 model.


Modelling brain based on canonical ensemble with functional MRI A thermodynamic exploration on neural system. Objective. Modelling is an important way to study the working mechanism of brain. While the characterization and understanding of brain are still inadequate. This study tried to build a model of brain from the perspective of thermodynamics at system level, which brought a new thinking to brain modelling. Approach. Regarding brain regions as systems, voxels as particles, and intensity of signals as energy of particles, the thermodynamic model of brain was built based on canonical ensemble theory. Two pairs of activated regions and two pairs of inactivated brain regions were selected for comparison in this study, and the analysis on thermodynamic properties based on the model proposed were performed. In addition, the thermodynamic properties were also extracted as input features for the detection of Alzheimer's disease. Main results. The experiment results verified the assumption that the brain also follows the thermodynamic laws. It demonstrated the feasibility and rationality of brain thermodynamic modelling method proposed, indicating that thermodynamic parameters could be applied to describe the state of neural system. Meanwhile, the brain thermodynamic model achieved much better accuracy in detection of Alzheimer's disease, suggesting the potential application of thermodynamic model in auxiliary diagnosis. Significance. (1) Instead of applying some thermodynamic parameters to analyze neural system, a brain model at system level was proposed from perspective of thermodynamics for the first time in this study. (2) The study discovered that the neural system also follows the laws of thermodynamics, which leads to increased internal energy, increased free energy and decreased entropy when system is activated. (3) The detection of neural disease was demonstrated to be benefit from thermodynamic model, implying the immense potential of thermodynamics in auxiliary diagnosis.


On a mathbb C 2 valued integral index transform and bilateral hypergeometric series. We discuss the spectral decomposition of the hypergeometric differential operators on the line mathrm Re , z 1 2 . Such operators arise in the problem of decomposition of tensor products of unitary representations of the universal covering of the group SL(2 , mathbb R . Our main purpose is a search of natural bases in generalized eigenspaces and variants of the inversion formula.


Examples of non effective rays at the boundary of the Mori cone of blow ups of the plane. In this paper we prove that no multiple of the linear system of plane curves of degree d geq 4 with a point of multiplicity d m (with 2 leq m leq d ) and m(2d m) simple general points is effective.


Bounds on bilinear sums of Kloosterman sums. We use some elementary arguments to obtain a new bound on bilinear sums with weighted Kloosterman sums which complements those recently obtained by E. Kowalski, P. Michel and W. Sawin (2020).


Nation wide Mood Large scale Estimation of People's Mood from Web Search Query and Mobile Sensor Data. The ability to estimate the current affective statuses of web users has considerable potential for the realization of user centric services in the society. However, in real world web services, it is difficult to determine the type of data to be used for such estimation, as well as collecting the ground truths of such affective statuses. We propose a novel method of such estimation based on the combined use of user web search queries and mobile sensor data. The system was deployed in our product server stack, and a large scale data analysis with more than 11,000,000 users was conducted. Interestingly, our proposed "Nation wide Mood Score," which bundles the mood values of users across the country, (1) shows the daily and weekly rhythm of people's moods, (2) explains the ups and downs of people's moods in the COVID 19 pandemic, which is inversely synchronized to the number of new COVID 19 cases, and (3) detects the linkage with big news, which may affect many user's mood states simultaneously, even in a fine grained time resolution, such as the order of hours.


Symmetric Monoidal Categories with Attributes. When designing plans in engineering, it is often necessary to consider attributes associated to objects, e.g. the location of a robot. Our aim in this paper is to incorporate attributes into existing categorical formalisms for planning, namely those based on symmetric monoidal categories and string diagrams. To accomplish this, we define a notion of a "symmetric monoidal category with attributes." This is a symmetric monoidal category in which objects are equipped with retrievable information and where the interactions between objects and information are governed by an "attribute structure." We discuss examples and semantics of such categories in the context of robotics to illustrate our definition.


Regularity of flat free boundaries for a p(x) Laplacian problem with right hand side. We consider viscosity solutions to a one phase free boundary problem for the p(x) Laplacian with non zero right hand side. We apply the tools developed in cite D to prove that flat free boundaries are C 1, alpha . Moreover, we obtain some new results for the operator under consideration that are of independent interest.


Multistep traffic speed prediction A deep learning based approach using latent space mapping considering spatio temporal dependencies. Traffic management in a city has become a major problem due to the increasing number of vehicles on roads. Intelligent Transportation System (ITS) can help the city traffic managers to tackle the problem by providing accurate traffic forecasts. For this, ITS requires a reliable traffic prediction algorithm that can provide accurate traffic prediction at multiple time steps based on past and current traffic data. In recent years, a number of different methods for traffic prediction have been proposed which have proved their effectiveness in terms of accuracy. However, most of these methods have either considered spatial information or temporal information only and overlooked the effect of other. In this paper, to address the above problem a deep learning based approach has been developed using both the spatial and temporal dependencies. To consider spatio temporal dependencies, nearby road sensors at a particular instant are selected based on the attributes like traffic similarity and distance. Two pre trained deep auto encoders were cross connected using the concept of latent space mapping and the resultant model was trained using the traffic data from the selected nearby sensors as input. The proposed deep learning based approach was trained using the real world traffic data collected from loop detector sensors installed on different highways of Los Angeles and Bay Area. The traffic data is freely available from the web portal of the California Department of Transportation Performance Measurement System (PeMS). The effectiveness of the proposed approach was verified by comparing it with a number of machine deep learning approaches. It has been found that the proposed approach provides accurate traffic prediction results even for 60 min ahead prediction with least error than other techniques.


Low Budget Active Learning via Wasserstein Distance An Integer Programming Approach. Active learning is the process of training a model with limited labeled data by selecting a core subset of an unlabeled data pool to label. The large scale of data sets used in deep learning forces most sample selection strategies to employ efficient heuristics. This paper introduces an integer optimization problem for selecting a core set that minimizes the discrete Wasserstein distance from the unlabeled pool. We demonstrate that this problem can be tractably solved with a Generalized Benders Decomposition algorithm. Our strategy uses high quality latent features that can be obtained by unsupervised learning on the unlabeled pool. Numerical results on several data sets show that our optimization approach is competitive with baselines and particularly outperforms them in the low budget regime where less than one percent of the data set is labeled.


Aerosol generation in public restrooms. Aerosolized droplets play a central role in the transmission of various infectious diseases, including Legionnaire's disease, gastroenteritis causing norovirus, and most recently COVID 19. Respiratory droplets are known to be the most prominent source of transmission for COVID 19, however, alternative routes may exist given the discovery of small numbers of viable viruses in urine and stool samples. Flushing biomatter can lead to the aerosolization of microorganisms, thus, there is a likelihood that bioaerosols generated in public restrooms may pose a concern for the transmission of COVID 19, especially since these areas are relatively confined, experience heavy foot traffic, and may suffer from inadequate ventilation. To quantify the extent of aerosolization, we measure the size and number of droplets generated by flushing toilets and urinals in a public restroom. The results indicate that the particular designs tested in the study generate a large number of droplets in the size range 0.3 mu m to 3 mu m , which can reach heights of at least 1.52m. Covering the toilet reduced aerosol levels but did not eliminate them completely, suggesting that aerosolized droplets escaped through small gaps between the cover and the seat. In addition to consistent increases in aerosol levels immediately after flushing, there was a notable rise in ambient aerosol levels due to the accumulation of droplets from multiple flushes conducted during the tests. This highlights the need for incorporating adequate ventilation in the design and operation of public spaces, which can help prevent aerosol accumulation in high occupancy areas and mitigate the risk of airborne disease transmission.


Some Recent Developments on the Geometry of Random Spherical Eigenfunctions. A lot of efforts have been devoted in the last decade to the investigation of the high frequency behaviour of geometric functionals for the excursion sets of random spherical harmonics, i.e., Gaussian eigenfunctions for the spherical Laplacian Delta mathbf S 2 . In this survey we shall review some of these results, with particular reference to the asymptotic behaviour of variances, phase transitions in the nodal case (the emph Berry's Cancellation Phenomenon ), the distribution of the fluctuations around the expected values, and the asymptotic correlation among different functionals. We shall also discuss some connections with the Gaussian Kinematic Formula, with Wiener Chaos expansions and with recent developments in the derivation of Quantitative Central Limit Theorems (the so called Stein Malliavin approach).


Query driven Segment Selection for Ranking Long Documents. Transformer based rankers have shown state of the art performance. However, their self attention operation is mostly unable to process long sequences. One of the common approaches to train these rankers is to heuristically select some segments of each document, such as the first segment, as training data. However, these segments may not contain the query related parts of documents. To address this problem, we propose query driven segment selection from long documents to build training data. The segment selector provides relevant samples with more accurate labels and non relevant samples which are harder to be predicted. The experimental results show that the basic BERT based ranker trained with the proposed segment selector significantly outperforms that trained by the heuristically selected segments, and performs equally to the state of the art model with localized self attention that can process longer input sequences. Our findings open up new direction to design efficient transformer based rankers.


The fragmentation equation with size diffusion Well posedness and long term behavior. The dynamics of the fragmentation equation with size diffusion is investigated when the size ranges in (0, infty ). The associated linear operator involves three terms and can be seen as a nonlocal perturbation of a Schr "o dinger operator. A Miyadera perturbation argument is used to prove that it is the generator of a positive, analytic semigroup on a weighted L 1 space. Moreover, if the overall fragmentation rate does not vanish at infinity, then there is a unique stationary solution with given mass. Assuming further that the overall fragmentation rate diverges to infinity for large sizes implies the immediate compactness of the semigroup and that it eventually stabilizes at an exponential rate to a one dimensional projection carrying the information of the mass of the initial value.


Khintchine's theorem for affine hyperplanes in positive charateristic. In this paper we establish the convergence case of Khintchine's theorem for affine hyperplanes in function field of positive characteristic. Along with that, we also prove a quantitative version of the same. The main technique used in the proof is a dynamical result called Quantitative nondivergence' due to D. Y. Kleinbock and G. A. Margulis 17 .


The Bohr type operator on analytic functions and sections. In this paper, firstly we prove two refined Bohr type inequalities associated with area for bounded analytic functions f(z) sum n 0 infty a n z n in the unit disk. Later, we establish the Bohr type operator on analytic functions and sections.


Energy bounds for biharmonic wave maps in low dimensions. For compact, isometrically embedded Riemannian manifolds N hookrightarrow mathbb R L , we introduce a fourth order version of the wave map equation. By energy estimates, we prove an priori estimate for smooth local solutions in the energy subcritical dimension n 1,2 . The estimate excludes blow up of a Sobolev norm in finite existence times. In particular, combining this with recent work of local well posedness of the Cauchy problem, it follows that for smooth initial data with compact support, there exists a (smooth) unique global solution in dimension n 1,2 . We also give a proof of the uniqueness of solutions that are bounded in these Sobolev norms.


Biharmonic distance of graphs. Lipman et al. ACM Transactions on Graphics 29 (3) (2010), 1 11 introduced the concept of biharmonic distance to measure the distances between pairs of points on a 3D surface. Biharmonic distance has some advantages over resistance distance and geodesic distance in some realistic contexts. Nevertheless, limited work has been done on the biharmonic distance in the discrete case. In this paper, we give some characterizations of the biharmonic distance of a graph and introduce the concept of biharmonic index as a graph invariant based on biharmonic distance. Some basic mathematical properties of biharmonic distance and biharmonic index are established.


Enabling Sustainable Clouds The Case for Virtualizing the Energy System. Cloud platforms' growing energy demand and carbon emissions are raising concern about their environmental sustainability. The current approach to enabling sustainable clouds focuses on improving energy efficiency and purchasing carbon offsets. These approaches have limits many cloud data centers already operate near peak efficiency, and carbon offsets cannot scale to near zero carbon where there is little carbon left to offset. Instead, enabling sustainable clouds will require applications to adapt to when and where unreliable low carbon energy is available. Applications cannot do this today because their energy use and carbon emissions are not visible to them, as the energy system provides the rigid abstraction of a continuous, reliable energy supply. This vision paper instead advocates for a carbon first'' approach to cloud design that elevates carbon efficiency to a first class metric. To do so, we argue that cloud platforms should virtualize the energy system by exposing visibility into, and software defined control of, it to applications, enabling them to define their own abstractions for managing energy and carbon emissions based on their own requirements.


Rydberg blockade in an ultracold strontium gas revealed by two photon excitation dynamics. We demonstrate the interaction induced blockade effect in an ultracold 88 Sr gas via studying the time dynamics of a two photon excitation to the triplet Rydberg series 5 mathrm s n mathrm s , 3 textrm S 1 for five different principle quantum numbers n ranging from 19 to 37. By using a multi pulse excitation sequence to increase the detection sensitivity we could identify Rydberg excitation induced atom losses as low as 1 . Based on an optical Bloch equation formalism, treating the Rydberg Rydberg interaction on a mean field level, the van der Waals coefficients are extracted from the observed dynamics, which agree fairly well with emph ab initio calculations.


Feature selection for intrusion detection systems. In this paper, we analyze existing feature selection methods to identify the key elements of network traffic data that allow intrusion detection. In addition, we propose a new feature selection method that addresses the challenge of considering continuous input features and discrete target values. We show that the proposed method performs well against the benchmark selection methods. We use our findings to develop a highly effective machine learning based detection systems that achieves 99.9 accuracy in distinguishing between DDoS and benign signals. We believe that our results can be useful to experts who are interested in designing and building automated intrusion detection systems.


A hybrid projection algorithm for stochastic differential equations on manifolds. Stochastic differential equations projected onto manifolds occur widely in physics, chemistry, biology, engineering, nanotechnology and optimization theory. In some problems one can use an intrinsic coordinate system on the manifold, but this is often computationally impractical. Numerical projections are preferable in many cases. We derive an algorithm to solve these, using adiabatic elimination and a constraining potential. We also review earlier proposed algorithms. Our hybrid midpoint projection algorithm uses a midpoint projection on a tangent manifold, combined with a normal projection to satisfy the constraints. We show from numerical examples on spheroidal and hyperboloidal surfaces that this has greatly reduced errors compared to earlier methods using either a hybrid Euler with tangential and normal projections or purely tangential derivative methods. Our technique can handle multiple constraints. This allows, for example, the treatment of manifolds that embody several conserved quantities. The resulting algorithm is accurate, relatively simple to implement and efficient.


Uniqueness and stability for inverse source problem for fractional diffusion wave equations. This paper is devoted to the inverse problem of determining the spatially dependent source in a time fractional diffusion wave equation, with the aid of extra measurement data at subboundary. Uniqueness result is obtained by using the analyticity and the new established unique continuation principle provided that the coefficients are all temporally independent. We also derive a Lipschitz stability of our inverse source problem under a suitable topology whose norm is given via the adjoint system of the fractional diffusion wave equation.


Toward Semantic Representation of Middleware Services. Middleware is middle tier software that supports communications between two or more different applications, and between applications and shared services. Managing the complexity and heterogeneity of distributed infrastructures is the important role of middleware so that it can provide the simple programing environment for the developer of distributed application Middleware supports communications, information exchange, objects management, sending messages, in addition to provides many functions to build distributed systems. Many classification and definition has been provided for middleware, there is a great need to give a global look to middleware and their factors. Ontology for Middleware services is proposed in this paper, whose intention is to make a global look to middleware and enrich middleware services description. Using this ontology, we can discover and classify incoming services to their appropriate types according to their specification and characteristics. The proposed ontology is helpful for users to find their suitable services according to their own preferences. Besides this is an example, a parser has been used to classify many middleware service files.


Error estimate of the Non Intrusive Reduced Basis method with finite volume schemes. The context of this paper is the simulation of parameter dependent partial differential equations (PDEs). When the aim is to solve such PDEs for a large number of parameter values, Reduced Basis Methods (RBM) are often used to reduce computational costs of a classical high fidelity code based on Finite Element Method (FEM), Finite Volume (FVM) or Spectral methods. The efficient implementation of most of these RBM requires to modify this high fidelity code, which cannot be done, for example in an industrial context if the high fidelity code is only accessible as a "black box" solver. The Non Intrusive Reduced Basis method (NIRB) has been introduced in the context of finite elements as a good alternative to reduce the implementation costs of these parameter dependent problems. The method is efficient in other contexts than the FEM one, like with finite volume schemes, which are more often used in an industrial environment. In this case, some adaptations need to be done as the degrees of freedom in FV methods have different meenings. At this time, error estimates have only been studied with FEM solvers. In this paper, we present a generalisation of the NIRB method to Finite Volume schemes and we show that estimates established for FEM solvers also hold in the FVM setting. We first prove our results for the hybrid Mimetic Finite Difference method (hMFD), which is part the Hybrid Mixed Mimetic methods (HMM) family. Then, we explain how these results apply more generally to other FV schemes. Some of them are specified, such as the Two Point Flux Approximation (TPFA).


Abelian differentials with prescribed singularities. The local invariants of a meromorphic Abelian differential on a Riemann surface of genus g are the orders of zeros and poles, and the residues at the poles. The main result of this paper is that with few exceptions, every pattern of orders and residues can be obtain by an Abelian differential. These exceptions are two families in genus zero when the orders of the poles are either all simple or all nonsimple. Moreover, we even show that the pattern can be realized in each connected component of strata. Finally we give consequences of these results in algebraic and flat geometry. The main ingredient of the proof is the flat representation of the Abelian differentials.


Towards Confident Machine Reading Comprehension. There has been considerable progress on academic benchmarks for the Reading Comprehension (RC) task with State of the Art models closing the gap with human performance on extractive question answering. Datasets such as SQuAD 2.0 NQ have also introduced an auxiliary task requiring models to predict when a question has no answer in the text. However, in production settings, it is also necessary to provide confidence estimates for the performance of the underlying RC model at both answer extraction and "answerability" detection. We propose a novel post prediction confidence estimation model, which we call Mr.C (short for Mr. Confident), that can be trained to improve a system's ability to refrain from making incorrect predictions with improvements of up to 4 points as measured by Area Under the Curve (AUC) scores. Mr.C can benefit from a novel white box feature that leverages the underlying RC model's gradients. Performance prediction is particularly important in cases of domain shift (as measured by training RC models on SQUAD 2.0 and evaluating on NQ), where Mr.C not only improves AUC, but also traditional answerability prediction (as measured by a 5 point improvement in F1).


Parallel Element based Algebraic Multigrid for H(curl) and H(div) Problems Using the ParELAG Library. This paper presents the use of element based algebraic multigrid (AMGe) hierarchies, implemented in the ParELAG (Parallel Element Agglomeration Algebraic Multigrid Upscaling and Solvers) library, to produce multilevel preconditioners and solvers for H(curl) and H(div) formulations. ParELAG constructs hierarchies of compatible nested spaces, forming an exact de Rham sequence on each level. This allows the application of hybrid smoothers on all levels and AMS (Auxiliary space Maxwell Solver) or ADS (Auxiliary space Divergence Solver) on the coarsest levels, obtaining complete multigrid cycles. Numerical results are presented, showing the parallel performance of the proposed methods. As a part of the exposition, this paper demonstrates some of the capabilities of ParELAG and outlines some of the components and procedures within the library.


LOT A Story Centric Benchmark for Evaluating Chinese Long Text Understanding and Generation. Standard multi task benchmarks are essential for developing pretraining models that can generalize to various downstream tasks. Existing benchmarks for natural language processing (NLP) usually focus only on understanding or generating short texts. However, long text modeling requires many distinct abilities in contrast to short texts, such as the modeling of long range discourse and commonsense relations, and the coherence and controllability of generation. The lack of standardized benchmarks makes it difficult to assess these abilities of a model and fairly compare different models, especially Chinese models. Therefore, we propose a story centric benchmark named LOT for evaluating Chinese long text modeling, which aggregates two understanding tasks and two generation tasks. We construct new datasets for these tasks based on human written Chinese stories with hundreds of words. Furthermore, we release an encoder decoder based Chinese long text pretraining model named LongLM with up to 1 billion parameters. We pretrain LongLM on 120G Chinese novels with two generative tasks including text infilling and conditional continuation. Extensive experiments show that LongLM outperforms similar sized pretraining models substantially on both the understanding and generation tasks in LOT.


Static Embeddings as Efficient Knowledge Bases?. Recent research investigates factual knowledge stored in large pretrained language models (PLMs). Instead of structural knowledge base (KB) queries, masked sentences such as "Paris is the capital of MASK " are used as probes. The good performance on this analysis task has been interpreted as PLMs becoming potential repositories of factual knowledge. In experiments across ten linguistically diverse languages, we study knowledge contained in static embeddings. We show that, when restricting the output space to a candidate set, simple nearest neighbor matching using static embeddings performs better than PLMs. E.g., static embeddings perform 1.6 points better than BERT while just using 0.3 of energy for training. One important factor in their good comparative performance is that static embeddings are standardly learned for a large vocabulary. In contrast, BERT exploits its more sophisticated, but expensive ability to compose meaningful representations from a much smaller subword vocabulary.


Policy Guided Heuristic Search with Guarantees. The use of a policy and a heuristic function for guiding search can be quite effective in adversarial problems, as demonstrated by AlphaGo and its successors, which are based on the PUCT search algorithm. While PUCT can also be used to solve single agent deterministic problems, it lacks guarantees on its search effort and it can be computationally inefficient in practice. Combining the A algorithm with a learned heuristic function tends to work better in these domains, but A and its variants do not use a policy. Moreover, the purpose of using A is to find solutions of minimum cost, while we seek instead to minimize the search loss (e.g., the number of search steps). LevinTS is guided by a policy and provides guarantees on the number of search steps that relate to the quality of the policy, but it does not make use of a heuristic function. In this work we introduce Policy guided Heuristic Search (PHS), a novel search algorithm that uses both a heuristic function and a policy and has theoretical guarantees on the search loss that relates to both the quality of the heuristic and of the policy. We show empirically on the sliding tile puzzle, Sokoban, and a puzzle from the commercial game The Witness' that PHS enables the rapid learning of both a policy and a heuristic function and compares favorably with A , Weighted A , Greedy Best First Search, LevinTS, and PUCT in terms of number of problems solved and search time in all three domains tested.