Where the Earth is flat and 9 11 is an inside job A comparative algorithm audit of conspiratorial information in web search results. Web search engines are important online information intermediaries that are frequently used and highly trusted by the public despite multiple evidence of their outputs being subjected to inaccuracies and biases. One form of such inaccuracy, which so far received little scholarly attention, is the presence of conspiratorial information, namely pages promoting conspiracy theories. We address this gap by conducting a comparative algorithm audit to examine the distribution of conspiratorial information in search results across five search engines Google, Bing, DuckDuckGo, Yahoo and Yandex. Using a virtual agent based infrastructure, we systematically collect search outputs for six conspiracy theory related queries (flat earth, new world order, qanon, 9 11, illuminati, george soros) across three locations (two in the US and one in the UK) and two observation periods (March and May 2021). We find that all search engines except Google consistently displayed conspiracy promoting results and returned links to conspiracy dedicated websites in their top results, although the share of such content varied across queries. Most conspiracy promoting results came from social media and conspiracy dedicated websites while conspiracy debunking information was shared by scientific websites and, to a lesser extent, legacy media. The fact that these observations are consistent across different locations and time periods highlight the possibility of some search engines systematically prioritizing conspiracy promoting content and, thus, amplifying their distribution in the online environments.


Orthogonal iterations on Structured Pencils. We present a class of fast subspace tracking algorithms based on orthogonal iterations for structured matrices pencils that can be represented as small rank perturbations of unitary matrices. The algorithms rely upon an updated data sparse factorization named LFR factorization using orthogonal Hessenberg matrices. These new subspace trackers reach a complexity of only O(nk 2) operations per time update, where n and k are the size of the matrix and of the small rank perturbation, respectively.


MutFormer A context dependent transformer based model to predict pathogenic missense mutations. A missense mutation is a point mutation that results in a substitution of an amino acid in a protein sequence. Currently, missense mutations account for over half of the known variants responsible for Mendelian diseases, but accurate prediction of the pathogenicity of missense variants remains challenging. Recent advances show transformer models a type of deep neural network to be particularly powerful at modeling sequence information with context dependence, such as language translation tasks. In this study, we introduce MutFormer, a transformer based model for the prediction of pathogenic missense mutations, using reference and mutated amino acid sequences from the human genome as the features. We first pre trained MutFormer on reference protein sequences and mutated protein sequences resulting from common genetic variants (assumed to be benign). We next tested different fine tuning methods for pathogenicity prediction, and determined that utilizing paired protein sequences (concatenation of the wildtype and mutated protein sequence) yields the most optimal results. Our results show that MutFormer outperforms a variety of existing tools in pathogenicity prediction, including those using conventional machine learning approaches (e.g., support vector machine, convolutional neural network, recurrent neural network, etc.), and may complement existing computational predictions and empirically generated functional scores to improve our understanding of disease variants. MutFormer and pre computed variant scores are publicly available on GitHub at https github.com WGLab mutformer.


How many roots of a system of random trigonometric polynomials are real?. The expected number of zeros of a random real polynomial of degree N asymptotically equals frac 2 pi log N . On the other hand, the average fraction of real zeros of a random trigonometric polynomial of increasing degree N converges to not 0 but to 1 sqrt 3 . An average number of roots of a system of random trigonometric polynomials in several variables is equal to the mixed volume of some ellipsoids depending on the degrees of polynomials. Comparing this formula with Theorem BKK we prove that the phenomenon of nonzero fraction of real roots remains valid.


Generalization of bibliographic coupling and co citation using the node split network. Bibliographic coupling (BC) and co citation (CC) are the two most common citation based coupling measures of similarity between scientific items. One can interpret these measures as second neighbor relations distinguished by the direction of the citation BC is a similarity between two citing items, whereas CC is that between two cited items. A previous study proposed a two layer node split network that can emulate clusters of coupling measures in a computationally efficient manner however, the lack of intralayer links makes it impossible to obtain exact similarities. Here, we propose novel methods to estimate intralayer similarity on a node split network using personalized PageRank and neural embedding. We demonstrate that the proposed measures are strongly correlated with the coupling measures. Moreover, our proposed method can yield precise similarities between items even if they are distant from each other. We also show that many links with high similarity are missing in the original BC CC network, which suggests that it is essential to consider long range similarities. Comparative experiments on global and local edge sampling suggest that local sampling is stable for both similarities in node split networks. This analysis offers valuable insights into the process of searching for significantly related items regarding each coupling measure.


Social Network Analysis of the Professional Community Interaction Movie Industry Case. With the rise of the competition in the movie production market, because of new players such as Netflix, Hulu, HBO Max, and Amazon Prime, whose primary goal is producing a large amount of exclusive content in order to gain a competitive advantage, it is extremely important to minimize the number of unsuccessful titles. This paper focuses on new approaches to predict film success, based on the movie industry community structure, and highlights the role of the casting director in movie success. Based on publicly available data we create an "actor" "casting director" "talent agent" "director" communication graph and show that usage of additional knowledge leads to better movie rating prediction.


URLB Unsupervised Reinforcement Learning Benchmark. Deep Reinforcement Learning (RL) has emerged as a powerful paradigm to solve a range of complex yet specific control tasks. Yet training generalist agents that can quickly adapt to new tasks remains an outstanding challenge. Recent advances in unsupervised RL have shown that pre training RL agents with self supervised intrinsic rewards can result in efficient adaptation. However, these algorithms have been hard to compare and develop due to the lack of a unified benchmark. To this end, we introduce the Unsupervised Reinforcement Learning Benchmark (URLB). URLB consists of two phases reward free pre training and downstream task adaptation with extrinsic rewards. Building on the DeepMind Control Suite, we provide twelve continuous control tasks from three domains for evaluation and open source code for eight leading unsupervised RL methods. We find that the implemented baselines make progress but are not able to solve URLB and propose directions for future research.


On sufficient density conditions for lattice orbits of relative discrete series. This note provides new criteria on a unimodular group G and a discrete series representation ( pi, mathcal H pi ) of formal degree d pi 0 under which any lattice Gamma leq G with text vol (G Gamma) d pi leq 1 (resp. text vol (G Gamma) d pi geq 1 ) admits g in mathcal H pi such that pi( Gamma) g is a frame (resp. Riesz sequence). The results apply to all projective discrete series of exponential Lie groups.


In line optical subtraction using a differential Faraday rotation spectrometer for 15NO 14NO isotopic analysis. We present a dual modulation Faraday rotation spectrometer with in line optical subtraction for differential measurement of nitric oxide (NO) isotopologues. In situ sample referencing is accomplished via differential dual cell measurements, with 3.1 ppbv rt(Hz) (15NO) sensitivity through 15 cm optical path length. Our system operates at 1.9x the shot noise limit, with a minimum fractional absorption of 1.8e 7 rt(Hz). Differential measurement of both 14NO and 15NO are shown, yielding 20 dB magneto optical suppression. Noise analysis demonstrates stability of the differential signal up to 500 s, with normalized ratiometric precision of 3.0 permil rt(Hz) using 1 ppmv 15NO (or 272 ppmv 14NO at natural abundance). We rigorously model our differential method and demonstrate the utility of in line calibration for precise isotopic ratiometry.


Hilbert genus fields of some number fields with high degrees. The aim of this paper is to give some properties of Hilbert genus fields and construct the Hilbert genus fields of the fields L m,d mathbb Q ( zeta 2 m , sqrt d ) , where m geq 3 is a positive integer and d is a square free integer whose prime divisors are congruent to pm 3 pmod 8 or 9 pmod 16 .


Proceedings 37th Conference on Mathematical Foundations of Programming Semantics. MFPS conferences are dedicated to the areas of mathematics, logic, and computer science that are related to models of computation in general, and to semantics of programming languages in particular. This is a forum where researchers in mathematics and computer science can meet and exchange ideas. The participation of researchers in neighbouring areas is strongly encouraged. Topics include, but are not limited to, the following bio computation concurrent qualitative and quantitative distributed systems process calculi probabilistic systems constructive mathematics domain theory and categorical models formal languages formal methods game semantics lambda calculus programming language theory quantum computation security topological models logic type systems type theory. We also welcome contributions that address applications of semantics to novel areas such as complex systems, markets, and networks, for example.


Rule based Adaptations to Control Cybersickness in Social Virtual Reality Learning Environments. Social virtual reality learning environments (VRLEs) provide immersive experience to users with increased accessibility to remote learning. Lack of maintaining high performance and secured data delivery in critical VRLE application domains (e.g., military training, manufacturing) can disrupt application functionality and induce cybersickness. In this paper, we present a novel rule based 3QS adaptation framework that performs risk and cost aware trade off analysis to control cybersickness due to performance security anomaly events during a VRLE session. Our framework implementation in a social VRLE viz., vSocial monitors performance security anomaly events in network session data. In the event of an anomaly, the framework features rule based adaptations that are triggered by using various decision metrics. Based on our experimental results, we demonstrate the effectiveness of our rule based 3QS adaptation framework in reducing cybersickness levels, while maintaining application functionality. Using our key findings, we enlist suitable practices for addressing performance and security issues towards a more high performing and robust social VRLE.


Procedural animations in interactive art experiences A state of the art review. The state of the art review broadly oversees the use of novel research utilized in the creation of virtual environments applied in interactive art experiences, with a specific focus on the application of procedural animation in spatially augmented reality (SAR) exhibitions. These art exhibitions frequently combine sensory displays that appeal, replace, and augment the visual, auditory and touch or haptic senses. We analyze and break down art technology related innovations in the last three years, and thoroughly identify the most recent and vibrant applications of interactive art experiences in the review of numerous installation applications, studies, and events. Display mediums such as virtual reality, augmented reality, mixed reality, and robotics are overviewed in the context of art experiences such as visual art museums, park or historic site tours, live concerts, and theatre. We explore research and extrapolate how recent innovations can lead to different applications that will be seen in the future.


Correspondenceless scan to map scan matching of homoriented 2D scans for mobile robot localisation. The objective of this study is improving the location estimate of a mobile robot capable of motion on a plane and mounted with a conventional 2D LIDAR sensor, given an initial guess for its location on a 2D map of its surroundings. Documented herein is the theoretical reasoning behind solving a matching problem between two homoriented 2D scans, one derived from the robot's physical sensor and one derived by simulating its operation within the map, in a manner that does not require the establishing of correspondences between their constituting rays. Two results are proved and subsequently shown through experiments. The first is that the true position of the sensor can be recovered with arbitrary precision when the physical sensor reports faultless measurements and there is no discrepancy between the environment the robot operates in and its perception of it by the robot. The second is that when either is affected by disturbance, the location estimate is bound in a neighbourhood of the true location whose radius is proportional to the affecting disturbance.


The relative Bruce Roberts number of a function on a hypersurface. We consider the relative Bruce Roberts number mu BR (f,X) of a function on an isolated hypersurface singularity (X,0) . We show that mu BR (f,X) is equal to the sum of the Milnor number of the fibre mu(f 1 (0) cap X,0) plus the difference mu(X,0) tau(X,0) between the Milnor and the Tjurina numbers of (X,0) . As an application, we show that the usual Bruce Roberts number mu BR (f,X) is equal to mu(f) mu BR (f,X) . We also deduce that the relative logarithmic characteristic variety LC(X) , obtained from the logarithmic characteristic variety LC(X) by eliminating the component corresponding to the complement of X in the ambient space, is Cohen Macaulay.


Decomposition of hypercubes into sunlet graphs. For any positive integer k geq 3, the sunlet graph of order 2k , denoted by L 2k , is the graph obtained by adding a pendant edge to each vertex of a cycle of length k. In this paper, we prove that the necessary and sufficient condition for the existence of an L 16 decomposition of the n dimensional hypercube Q n is n 4 or n geq 6. Also, we prove that for any integer m geq 2, Q mn has an L 2k decomposition if Q n has a C k decomposition.


Broadband time modulated absorber beyond the Bode Fano limit by energy trapping. Wide band absorption is a popular topic in microwave engineering to protect sensitive devices against broadband sources. However, the Bode Fano criterion defines the trade off between bandwidth and efficiency for all passive, linear, time invariant systems. In this letter, we propose a broadband absorber beyond the Bode Fano limit by creating an energy trap using time modulated switch diodes. This work starts with an ideal circuit model to prove the concept, followed by two EM realizations a freuqnecy selective surface (FSS) approach for general bandwidth broadening and a low profile PCB design. The prototype of the latter is built and measured, demonstrating a Bode Fano integral larger than one. This approach paves a way to many practical ultra wide band absorber designs.


Upward planar drawings with two slopes. In an upward planar 2 slope drawing of a digraph, edges are drawn as straight line segments in the upward direction without crossings using only two different slopes. We investigate whether a given upward planar digraph admits such a drawing and, if so, how to construct it. For the fixed embedding scenario, we give a simple characterisation and a linear time construction by adopting algorithms from orthogonal drawings. For the variable embedding scenario, we describe a linear time algorithm for single source digraphs, a quartic time algorithm for series parallel digraphs, and a fixed parameter tractable algorithm for general digraphs. For the latter two classes, we make use of SPQR trees and the notion of upward spirality. As an application of this drawing style, we show how to draw an upward planar phylogenetic network with two slopes such that all leaves lie on a horizontal line.


A Matrix Trickle Down Theorem on Simplicial Complexes and Applications to Sampling Colorings. We show that the natural Glauber dynamics mixes rapidly and generates a random proper edge coloring of a graph with maximum degree Delta whenever the number of colors is at least q geq ( frac 10 3 epsilon) Delta , where epsilon 0 is arbitrary and the maximum degree satisfies Delta geq C for a constant C C( epsilon) depending only on epsilon . For edge colorings, this improves upon prior work cite Vig99, CDMPP19 which show rapid mixing when q geq ( frac 11 3 epsilon 0 ) Delta , where epsilon 0 approx 10 5 is a small fixed constant. At the heart of our proof, we establish a matrix trickle down theorem, generalizing Oppenheim's influential result, as a new technique to prove that a high dimensional simplical complex is a local spectral expander.


On the minimal number of solutions of the equation phi(n k) M , phi (n) , M 1 , 2 . We fix a positive integer k and look for solutions of the equations phi(n k) phi(n) and phi(n k) 2 phi(n) . We prove that Fermat primes can be used to build five solutions for the first equation when k is even and five for the second one when k is odd. These results hold for k le 2 cdot 10 100 . We also show that for the second equation with even k there are at least three solutions for k le 4 cdot 10 58 . Our work increases the previous minimal number of known solutions for both equations.


Dyadic bi parameter repeated commutator and dyadic product BMO. Consider a tensor product of simple dyadic shifts defined below. We prove here that for dyadic bi parameter repeated commutator its norm can be estimated from below by Chang Fefferman BMO norm pertinent to its symbol. See Theorems in Section 8 at the end of this article. But this is done below under an extra assumption on the Haar Fourier side of the symbol. In Section 7 we carefully analyze what goes wrong in the absence of this extra assumption. At the end of this note we also list a counterexample to the existing proof of characterization of bi parameter repeated commutator with the Hilbert transforms. This is a counterexample to the proof, and it is not a counterexample to the statement of factorization result in bi disc, or to Nehari's theorem in bi disc. To the best of our knowledge Nehari's theorem on bi disc is still open. Moreover its dyadic bi parameter version considered in the present paper is also still open for general symbol without any extra restrictions.


The Evolution of Out of Distribution Robustness Throughout Fine Tuning. Although machine learning models typically experience a drop in performance on out of distribution data, accuracies on in versus out of distribution data are widely observed to follow a single linear trend when evaluated across a testbed of models. Models that are more accurate on the out of distribution data relative to this baseline exhibit "effective robustness" and are exceedingly rare. Identifying such models, and understanding their properties, is key to improving out of distribution performance. We conduct a thorough empirical investigation of effective robustness during fine tuning and surprisingly find that models pre trained on larger datasets exhibit effective robustness during training that vanishes at convergence. We study how properties of the data influence effective robustness, and we show that it increases with the larger size, more diversity, and higher example difficulty of the dataset. We also find that models that display effective robustness are able to correctly classify 10 of the examples that no other current testbed model gets correct. Finally, we discuss several strategies for scaling effective robustness to the high accuracy regime to improve the out of distribution accuracy of state of the art models.


A New Distributed Method for Training Generative Adversarial Networks. Generative adversarial networks (GANs) are emerging machine learning models for generating synthesized data similar to real data by jointly training a generator and a discriminator. In many applications, data and computational resources are distributed over many devices, so centralized computation with all data in one location is infeasible due to privacy and or communication constraints. This paper proposes a new framework for training GANs in a distributed fashion Each device computes a local discriminator using local data a single server aggregates their results and computes a global GAN. Specifically, in each iteration, the server sends the global GAN to the devices, which then update their local discriminators the devices send their results to the server, which then computes their average as the global discriminator and updates the global generator accordingly. Two different update schedules are designed with different levels of parallelism between the devices and the server. Numerical results obtained using three popular datasets demonstrate that the proposed framework can outperform a state of the art framework in terms of convergence speed.


The Value of Information When Deciding What to Learn. All sequential decision making agents explore so as to acquire knowledge about a particular target. It is often the responsibility of the agent designer to construct this target which, in rich and complex environments, constitutes a onerous burden without full knowledge of the environment itself, a designer may forge a sub optimal learning target that poorly balances the amount of information an agent must acquire to identify the target against the target's associated performance shortfall. While recent work has developed a connection between learning targets and rate distortion theory to address this challenge and empower agents that decide what to learn in an automated fashion, the proposed algorithm does not optimally tackle the equally important challenge of efficient information acquisition. In this work, building upon the seminal design principle of information directed sampling (Russo Van Roy, 2014), we address this shortcoming directly to couple optimal information acquisition with the optimal design of learning targets. Along the way, we offer new insights into learning targets from the literature on rate distortion theory before turning to empirical results that confirm the value of information when deciding what to learn.


Improving HRI through robot architecture transparency. In recent years, an increased effort has been invested to improve the capabilities of robots. Nevertheless, human robot interaction remains a complex field of application where errors occur frequently. The reasons for these errors can primarily be divided into two classes. Foremost, the recent increase in capabilities also widened possible sources of errors on the robot's side. This entails problems in the perception of the world, but also faulty behavior, based on errors in the system. Apart from that, non expert users frequently have incorrect assumptions about the functionality and limitations of a robotic system. This leads to incompatibilities between the user's behavior and the functioning of the robot's system, causing problems on the robot's side and in the human robot interaction. While engineers constantly improve the reliability of robots, the user's understanding about robots and their limitations have to be addressed as well. In this work, we investigate ways to improve the understanding about robots. For this, we employ FAMILIAR FunctionAl user Mental model by Increased LegIbility ARchitecture, a transparent robot architecture with regard to the robot behavior and decision making process. We conducted an online simulation user study to evaluate two complementary approaches to convey and increase the knowledge about this architecture to non expert users a dynamic visualization of the system's processes as well as a visual programming interface. The results of this study reveal that visual programming improves knowledge about the architecture. Furthermore, we show that with increased knowledge about the control architecture of the robot, users were significantly better in reaching the interaction goal. Furthermore, we showed that anthropomorphism may reduce interaction success.


Lattices in the four dimensional split oscillator group. Besides the oscillator group, there is another four dimensional non abelian solvable Lie group that admits a bi invariant pseudo Riemannian metric. It is called split oscillator group (sometimes also hyperbolic oscillator group or Boidol's group). We parametrise the set of lattices in this group and develop a method to classify these lattices up automorphisms of the ambient group. We show that their commensurability classes are in bijection with the set of real quadratic fields.


Meeting the SDGs Enabling the Goals by Cooperation with Crowd using a Conversational AI Platform. In this paper, we report about a large scale online discussion with 1099 citizens on the Afghanistan Sustainable Development Goals.


Deep Learning Algorithms for Hedging with Frictions. This work studies the deep learning based numerical algorithms for optimal hedging problems in markets with general convex transaction costs on the trading rates, focusing on their scalability of trading time horizon. We implement two popular deep learning algorithms, the FBSDE solver introduced in the spirit by Han, Jentzen, and E (2018) and the deep hedging algorithm pioneered by Buehler, Gonon, Teichmann, and Wood (2019), and compare their performances with the leading order approximations. In summary, the FBSDE solver only performs well under short trading horizons, whereas the deep hedging algorithm has stable and reliable performance for short and moderately long trading horizons. For long trading horizons, we propose a "pasting" algorithm to aggregate the leading order approximations and the deep learning based algorithms together, hence fully utilizing both of their advantages.


Shallow decision trees for explainable k means clustering. A number of recent works have employed decision trees for the construction of explainable partitions that aim to minimize the k means cost function. These works, however, largely ignore metrics related to the depths of the leaves in the resulting tree, which is perhaps surprising considering how the explainability of a decision tree depends on these depths. To fill this gap in the literature, we propose an efficient algorithm that takes into account these metrics. In experiments on 16 datasets, our algorithm yields better results than decision tree clustering algorithms such as the ones presented in cite dasgupta2020explainable , cite frost2020exkmc , cite laber2021price and cite DBLP conf icml MakarychevS21 , typically achieving lower or equivalent costs with considerably shallower trees. We also show, through a simple adaptation of existing techniques, that the problem of building explainable partitions induced by binary trees for the k means cost function does not admit an (1 epsilon) approximation in polynomial time unless P NP , which justifies the quest for approximation algorithms and or heuristics.


Towards Defensive Autonomous Driving Collecting and Probing Driving Demonstrations of Mixed Qualities. Designing or learning an autonomous driving policy is undoubtedly a challenging task as the policy has to maintain its safety in all corner cases. In order to secure safety in autonomous driving, the ability to detect hazardous situations, which can be seen as an out of distribution (OOD) detection problem, becomes crucial. However, most conventional datasets only provide expert driving demonstrations, although some non expert or uncommon driving behavior data are needed to implement a safety guaranteed autonomous driving platform. To this end, we present a novel dataset called the R3 Driving Dataset, composed of driving data with different qualities. The dataset categorizes abnormal driving behaviors into eight categories and 369 different detailed situations. The situations include dangerous lane changes and near collision situations. To further enlighten how these abnormal driving behaviors can be detected, we utilize different uncertainty estimation and anomaly detection methods to the proposed dataset. From the results of the proposed experiment, it can be inferred that by using both uncertainty estimation and anomaly detection, most of the abnormal cases in the proposed dataset can be discriminated. The dataset of this paper can be downloaded from https rllab snu.github.io projects R3 Driving Dataset doc.html.


Path Aware OMP Algorithms for Provenance Recovery in Wireless Networks. Low latency provenance embedding methods have received traction in vehicular networks for their ability to track the footprint of information flow. One such known method is based on Bloom filters wherein the nodes that forward the packets appropriately choose a certain number of hash functions to embed their signatures in a shared space in the packet. Although Bloom filter methods can achieve the required accuracy level in provenance recovery, they are known to incur higher processing delay since higher number of hash functions are needed to meet the accuracy level. Motivated by this behaviour, we identify a regime of delay constraints within which new provenance embedding methods must be proposed as Bloom filter methods are no longer applicable. To fill this research gap, we present network coded edge embedding (NCEE) protocols that facilitate low latency routing of packets in vehicular network applications. First, we show that the problem of designing provenance recovery methods for the NCEE protocol is equivalent to the celebrated problem of compressed sensing, however, with additional constraints of path formation on the solution. Subsequently, we present a family of path aware orthogonal matching pursuit algorithms that jointly incorporates the sparsity and path constraints. Through extensive simulation results, we show that our algorithms enjoy low complexity implementation, and also improve the path recovery performance when compared to path agnostic counterparts.


The influence of deflections on the static and dynamic behaviour of masonry columns. This paper studies the influence of bending deflections on the structural behaviour of masonry columns. Some explicit solutions are presented, and the combined effects of the constitutive and geometric nonlinearities are investigated through an iterative numerical procedure. The results show that considering second order effects affects both the collapse load and the dynamical properties of masonry beams significantly.


Ordinal Maximin Share Approximation for Goods. In fair division of indivisible goods, ell out of d maximin share (MMS) is the value that an agent can guarantee by partitioning the goods into d bundles and choosing the ell least preferred bundles. Most existing works aim to guarantee to all agents a constant fraction of their 1 out of n MMS. But this guarantee is sensitive to small perturbation in agents' cardinal valuations. We consider a more robust approximation notion, which depends only on the agents' emph ordinal rankings of bundles. We prove the existence of ell out of lfloor( ell frac 1 2 )n rfloor MMS allocations of goods for any integer ell geq 1 , and present a polynomial time algorithm that finds a 1 out of lceil frac 3n 2 rceil MMS allocation when ell 1 . We further develop an algorithm that provides a weaker ordinal approximation to MMS for any ell 1 .


A Visual Analytics System for Water Distribution System Optimization. The optimization of water distribution systems (WDSs) is vital to minimize energy costs required for their operations. A principal approach taken by researchers is identifying an optimal scheme for water pump controls through examining computational simulations of WDSs. However, due to a large number of possible control combinations and the complexity of WDS simulations, it remains non trivial to identify the best pump controls by reviewing the simulation results. To address this problem, we design a visual analytics system that helps understand relationships between simulation inputs and outputs towards better optimization. Our system incorporates interpretable machine learning as well as multiple linked visualizations to capture essential input output relationships from complex WDS simulations. We demonstrate our system's effectiveness through a practical case study and evaluate its usability through expert reviews. Our results show that our system can lessen the burden of analysis and assist in determining optimal operating schemes.


SSDNet State Space Decomposition Neural Network for Time Series Forecasting. In this paper, we present SSDNet, a novel deep learning approach for time series forecasting. SSDNet combines the Transformer architecture with state space models to provide probabilistic and interpretable forecasts, including trend and seasonality components and previous time steps important for the prediction. The Transformer architecture is used to learn the temporal patterns and estimate the parameters of the state space model directly and efficiently, without the need for Kalman filters. We comprehensively evaluate the performance of SSDNet on five data sets, showing that SSDNet is an effective method in terms of accuracy and speed, outperforming state of the art deep learning and statistical methods, and able to provide meaningful trend and seasonality components.


Predicting Credit Risk for Unsecured Lending A Machine Learning Approach. Since the 1990s, there have been significant advances in the technology space and the e Commerce area, leading to an exponential increase in demand for cashless payment solutions. This has led to increased demand for credit cards, bringing along with it the possibility of higher credit defaults and hence higher delinquency rates, over a period of time. The purpose of this research paper is to build a contemporary credit scoring model to forecast credit defaults for unsecured lending (credit cards), by employing machine learning techniques. As much of the customer payments data available to lenders, for forecasting Credit defaults, is imbalanced (skewed), on account of a limited subset of default instances, this poses a challenge for predictive modelling. In this research, this challenge is addressed by deploying Synthetic Minority Oversampling Technique (SMOTE), a proven technique to iron out such imbalances, from a given dataset. On running the research dataset through seven different machine learning models, the results indicate that the Light Gradient Boosting Machine (LGBM) Classifier model outperforms the other six classification techniques. Thus, our research indicates that the LGBM classifier model is better equipped to deliver higher learning speeds, better efficiencies and manage larger data volumes. We expect that deployment of this model will enable better and timely prediction of credit defaults for decision makers in commercial lending institutions and banks.


Random Euclidean embeddings in finite dimensional Lorentz spaces. Quantitative bounds for random embeddings of mathbb R k into Lorentz sequence spaces are given, with improved dependence on varepsilon .


Fake News Detection a comparison between available Deep Learning techniques in vector space. Fake News Detection is an essential problem in the field of Natural Language Processing. The benefits of an effective solution in this area are manifold for the goodwill of society. On a surface level, it broadly matches with the general problem of text classification. Researchers have proposed various approaches to tackle fake news using simple as well as some complex techniques. In this paper, we try to make a comparison between the present Deep Learning techniques by representing the news instances in some vector space using a combination of common mathematical operations with available vector space representations. We do a number of experiments using various combinations and permutations. Finally, we conclude with a sound analysis of the results and evaluate the reasons for such results.


On the Copying Behaviors of Pre Training for Neural Machine Translation. Previous studies have shown that initializing neural machine translation (NMT) models with the pre trained language models (LM) can speed up the model training and boost the model performance. In this work, we identify a critical side effect of pre training for NMT, which is due to the discrepancy between the training objectives of LM based pre training and NMT. Since the LM objective learns to reconstruct a few source tokens and copy most of them, the pre training initialization would affect the copying behaviors of NMT models. We provide a quantitative analysis of copying behaviors by introducing a metric called copying ratio, which empirically shows that pre training based NMT models have a larger copying ratio than the standard one. In response to this problem, we propose a simple and effective method named copying penalty to control the copying behaviors in decoding. Extensive experiments on both in domain and out of domain benchmarks show that the copying penalty method consistently improves translation performance by controlling copying behaviors for pre training based NMT models. Source code is freely available at https github.com SunbowLiu CopyingPenalty.


On Finitely Stable Additive Bases. The concept of additive basis has been investigated in the literature for several mathematicians which works with number theorem. Recently, the concept of finitely stable additive basis was introduced. In this note we provide a counterexample of the reciprocal of Theorem 2.2 shown in Ferreira, L.A. Finite Stable Additive Basis Bull. Aust. Math. Soc. . The idea of the construction of such a counterexample can possibly help the process of finding additive bases of some specific order.


Bias Loss for Mobile Neural Networks. Compact convolutional neural networks (CNNs) have witnessed exceptional improvements in performance in recent years. However, they still fail to provide the same predictive power as CNNs with a large number of parameters. The diverse and even abundant features captured by the layers is an important characteristic of these successful CNNs. However, differences in this characteristic between large CNNs and their compact counterparts have rarely been investigated. In compact CNNs, due to the limited number of parameters, abundant features are unlikely to be obtained, and feature diversity becomes an essential characteristic. Diverse features present in the activation maps derived from a data point during model inference may indicate the presence of a set of unique descriptors necessary to distinguish between objects of different classes. In contrast, data points with low feature diversity may not provide a sufficient amount of unique descriptors to make a valid prediction we refer to them as random predictions. Random predictions can negatively impact the optimization process and harm the final performance. This paper proposes addressing the problem raised by random predictions by reshaping the standard cross entropy to make it biased toward data points with a limited number of unique descriptive features. Our novel Bias Loss focuses the training on a set of valuable data points and prevents the vast number of samples with poor learning features from misleading the optimization process. Furthermore, to show the importance of diversity, we present a family of SkipNet models whose architectures are brought to boost the number of unique descriptors in the last layers. Our Skipnet M can achieve 1 higher classification accuracy than MobileNetV3 Large.


A high performance membraneless microfluidic microbial fuel cell for stable, long term benchtop operation under strong flow. Strong control over experimental conditions in microfluidic channels provides a unique opportunity to study and optimize membraneless microbial fuel cells (MFCs), particularly with respect to the role of flow. However, improved performance and transferability of results to the wider MFC community require improvements to device stability under all applied operational conditions. To address these challenges, we present an easy to fabricate membraneless MFC that combines (i) O2 elimination via a gas diffusion barrier, (ii) integrated graphite electrodes, and (iii) optimized electrode placement to avoid of cross contamination under all applied flow rates. Attention to all of these design features in the same platform resulted in operation of a MFC with a pure culture anaerobic Geobacter sulfurreducens biofilm for half a year, six times longer than previously reported, without the use of an oxygen scavenger. As a result of higher device stability under high flow rates, power densities were four times higher than reported previously for microfluidic MFCs with the same biofilm.


Fine grained Pseudo code Generation Method via Code Feature Extraction and Transformer. Pseudo code written by natural language is helpful for novice developers' program comprehension. However, writing such pseudo code is time consuming and laborious. Motivated by the research advancements of sequence to sequence learning and code semantic learning, we propose a novel deep pseudo code generation method DeepPseudo via code feature extraction and Transformer. In particular, DeepPseudo utilizes a Transformer encoder to perform encoding for source code and then use a code feature extractor to learn the knowledge of local features. Finally, it uses a pseudo code generator to perform decoding, which can generate the corresponding pseudo code. We choose two corpora (i.e., Django and SPoC) from real world large scale projects as our empirical subjects. We first compare DeepPseudo with seven state of the art baselines from pseudo code generation and neural machine translation domains in terms of four performance measures. Results show the competitiveness of DeepPseudo. Moreover, we also analyze the rationality of the component settings in DeepPseudo.


Information Extraction From Co Occurring Similar Entities. Knowledge about entities and their interrelations is a crucial factor of success for tasks like question answering or text summarization. Publicly available knowledge graphs like Wikidata or DBpedia are, however, far from being complete. In this paper, we explore how information extracted from similar entities that co occur in structures like tables or lists can help to increase the coverage of such knowledge graphs. In contrast to existing approaches, we do not focus on relationships within a listing (e.g., between two entities in a table row) but on the relationship between a listing's subject entities and the context of the listing. To that end, we propose a descriptive rule mining approach that uses distant supervision to derive rules for these relationships based on a listing's context. Extracted from a suitable data corpus, the rules can be used to extend a knowledge graph with novel entities and assertions. In our experiments we demonstrate that the approach is able to extract up to 3M novel entities and 30M additional assertions from listings in Wikipedia. We find that the extracted information is of high quality and thus suitable to extend Wikipedia based knowledge graphs like DBpedia, YAGO, and CaLiGraph. For the case of DBpedia, this would result in an increase of covered entities by roughly 50 .


Non Newtonian two phase thin film problem Local existence, uniqueness, and stability. We study the flow of two immiscible fluids located on a solid bottom, where the lower fluid is Newtonian and the upper fluid is a non Newtonian Ellis fluid. Neglecting gravitational effects, we consider the formal asymptotic limit of small film heights in the two phase Navier Stokes system. This leads to a strongly coupled system of two parabolic equations of fourth order with merely H "older continuous dependence on the coefficients. For the case of strictly positive initial film heights we prove local existence of strong solutions by abstract semigroup theory. Uniqueness is proved by energy methods. Under additional regularity assumptions, we investigate asymptotic stability of the unique equilibrium solution, which is given by constant film heights.


Equity and Privacy More Than Just a Tradeoff. While the entire field of privacy preserving data analytics is focused on the privacy utility tradeoff, recent work has shown that privacy preserving data publishing can introduce different levels of utility across different population groups. It is important to understand this new tradeoff between privacy and equity as privacy technology is being deployed in situations where the data products will be used for research and policy making. Will marginal populations see disproportionately less utility from privacy technology? If there is an inequity how can we address it?


Learning to Prompt for Vision Language Models. Large pre trained vision language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based mostly on discretized labels, vision language pre training aligns images and texts in a common feature space, which allows zero shot transfer to any downstream task via emph prompting , i.e., classification weights are synthesized from natural language describing classes of interest. In this work, we show that a major challenge for deploying such models in practice is prompt engineering, which requires domain expertise and is extremely time consuming one needs to spend a significant amount of time on words tuning since a slight change in wording could have a huge impact on performance. Inspired by recent advances in prompt learning research in natural language processing (NLP), we propose emph Context Optimization (CoOp) , a simple approach specifically for adapting CLIP like vision language models for downstream image recognition. Concretely, CoOp models a prompt's context words with learnable vectors while the entire pre trained parameters are kept fixed. To handle different image recognition tasks, we provide two implementations of CoOp unified context and class specific context. Through extensive experiments on 11 datasets, we demonstrate that CoOp requires as few as one or two shots to beat hand crafted prompts with a decent margin and is able to gain significant improvements when using more shots, e.g., with 16 shots the average gain is around 15 (with the highest reaching over 45 ). Despite being a learning based approach, CoOp achieves superb domain generalization performance compared with the zero shot model using hand crafted prompts.


CATE CAusality Tree Extractor from Natural Language Requirements. Causal relations (If A, then B) are prevalent in requirements artifacts. Automatically extracting causal relations from requirements holds great potential for various RE activities (e.g., automatic derivation of suitable test cases). However, we lack an approach capable of extracting causal relations from natural language with reasonable performance. In this paper, we present our tool CATE (CAusality Tree Extractor), which is able to parse the composition of a causal relation as a tree structure. CATE does not only provide an overview of causes and effects in a sentence, but also reveals their semantic coherence by translating the causal relation into a binary tree. We encourage fellow researchers and practitioners to use CATE at https causalitytreeextractor.com


Harnessing Incremental Answer Set Solving for Reasoning in Assumption Based Argumentation. Assumption based argumentation (ABA) is a central structured argumentation formalism. As shown recently, answer set programming (ASP) enables efficiently solving NP hard reasoning tasks of ABA in practice, in particular in the commonly studied logic programming fragment of ABA. In this work, we harness recent advances in incremental ASP solving for developing effective algorithms for reasoning tasks in the logic programming fragment of ABA that are presumably hard for the second level of the polynomial hierarchy, including skeptical reasoning under preferred semantics as well as preferential reasoning. In particular, we develop non trivial counterexample guided abstraction refinement procedures based on incremental ASP solving for these tasks. We also show empirically that the procedures are significantly more effective than previously proposed algorithms for the tasks. This paper is under consideration for acceptance in TPLP.


Schwarzians on the Heisenberg group. We study various notions of the Schwarzian derivative for contact mappings in the Heisenberg group mathbb H 1 and introduce two definitions (1) the CR Schwarzian derivative based on the conformal connection approach studied by Osgood and Stowe and, recently, by Son (2) the classical type Schwarzian refering to the well known complex analytic definition. In particular, we take into consideration the effect of conformal rigidity and the limitations it imposes. Moreover, we study the kernels of both Schwarzians and the cocycle conditions. Our auxiliary results include a characterization of the contact conformal vector fields. Inspired by ideas of Chuaqui Duren Osgood, Hern 'andez, Mart 'in and Venegas, we introduce the Preschwarzian for mappings in mathbb H 1 . Furthermore, we study results in the theory of subelliptic PDEs for the horizontal Jacobian and related differential expressions for harmonic mappings and the gradient harmonic mappings, the latter notion introduced here in the setting of mathbb H 1 .


Collaborative Recognition of Feasible Region with Aerial and Ground Robots through DPCN. Ground robots always get collision in that only if they get close to the obstacles, can they sense the danger and take actions, which is usually too late to avoid the crash, causing severe damage to the robots. To address this issue, we present collaboration of aerial and ground robots in recognition of feasible region. Taking the aerial robots' advantages of having large scale variance of view points of the same route which the ground robots is on, the collaboration work provides global information of road segmentation for the ground robot, thus enabling it to obtain feasible region and adjust its pose ahead of time. Under normal circumstance, the transformation between these two devices can be obtained by GPS yet with much error, directly causing inferior influence on recognition of feasible region. Thereby, we utilize the state of the art research achievements in matching heterogeneous sensor measurements called deep phase correlation network(DPCN), which has excellent performance on heterogeneous mapping, to refine the transformation. The network is light weighted and promising for better generalization. We use Aero Ground dataset which consists of heterogeneous sensor images and aerial road segmentation images. The results show that our collaborative system has great accuracy, speed and stability.


SUper Team at SemEval 2016 Task 3 Building a feature rich system for community question answering. We present the system we built for participating in SemEval 2016 Task 3 on Community Question Answering. We achieved the best results on subtask C, and strong results on subtasks A and B, by combining a rich set of various types of features semantic, lexical, metadata, and user related. The most important group turned out to be the metadata for the question and for the comment, semantic vectors trained on QatarLiving data and similarities between the question and the comment for subtasks A and C, and between the original and the related question for Subtask B.


Discrete neural representations for explainable anomaly detection. The aim of this work is to detect and automatically generate high level explanations of anomalous events in video. Understanding the cause of an anomalous event is crucial as the required response is dependant on its nature and severity. Recent works typically use object or action classifier to detect and provide labels for anomalous events. However, this constrains detection systems to a finite set of known classes and prevents generalisation to unknown objects or behaviours. Here we show how to robustly detect anomalies without the use of object or action classifiers yet still recover the high level reason behind the event. We make the following contributions (1) a method using saliency maps to decouple the explanation of anomalous events from object and action classifiers, (2) show how to improve the quality of saliency maps using a novel neural architecture for learning discrete representations of video by predicting future frames and (3) beat the state of the art anomaly explanation methods by 60 on a subset of the public benchmark X MAN dataset.


Lower bounds for artificial neural network approximations A proof that shallow neural networks fail to overcome the curse of dimensionality. Artificial neural networks (ANNs) have become a very powerful tool in the approximation of high dimensional functions. Especially, deep ANNs, consisting of a large number of hidden layers, have been very successfully used in a series of practical relevant computational problems involving high dimensional input data ranging from classification tasks in supervised learning to optimal decision problems in reinforcement learning. There are also a number of mathematical results in the scientific literature which study the approximation capacities of ANNs in the context of high dimensional target functions. In particular, there are a series of mathematical results in the scientific literature which show that sufficiently deep ANNs have the capacity to overcome the curse of dimensionality in the approximation of certain target function classes in the sense that the number of parameters of the approximating ANNs grows at most polynomially in the dimension d in mathbb N of the target functions under considerations. In the proofs of several of such high dimensional approximation results it is crucial that the involved ANNs are sufficiently deep and consist a sufficiently large number of hidden layers which grows in the dimension of the considered target functions. It is the topic of this work to look a bit more detailed to the deepness of the involved ANNs in the approximation of high dimensional target functions. In particular, the main result of this work proves that there exists a concretely specified sequence of functions which can be approximated without the curse of dimensionality by sufficiently deep ANNs but which cannot be approximated without the curse of dimensionality if the involved ANNs are shallow or not deep enough.


Time inconsistent view on a dividend problem with penalty. We consider the dividend maximization problem including a ruin penalty in a diffusion environment. The additional penalty term is motivated by a constraint on dividend strategies. Intentionally, we use different discount rates for the dividends and the penalty, which causes time inconsistency. This allows to study different types of constraints. For the diffusion approximation of the classical surplus process we derive an explicit equilibrium dividend strategy and the associated value function. Inspired by duality arguments, we can identify a particular equilibrium strategy such that for a given initial surplus the imposed constraint is fulfilled. Furthermore, we illustrate our findings with a numerical example.


Comparative Analysis of Machine Learning and Deep Learning Algorithms for Detection of Online Hate Speech. In the day and age of social media, users have become prone to online hate speech. Several attempts have been made to classify hate speech using machine learning but the state of the art models are not robust enough for practical applications. This is attributed to the use of primitive NLP feature engineering techniques. In this paper, we explored various feature engineering techniques ranging from different embeddings to conventional NLP algorithms. We also experimented with combinations of different features. From our experimentation, we realized that roBERTa (robustly optimized BERT approach) based sentence embeddings classified using decision trees gives the best results of 0.9998 F1 score. In our paper, we concluded that BERT based embeddings give the most useful features for this problem and have the capacity to be made into a practical robust model.


Min max solutions for super sinh Gordon equations on compact surfaces. In the present paper we initiate the variational analysis of a super sinh Gordon system on compact surfaces, yielding the first example of non trivial solution of min max type. The proof is based on a linking argument jointly with a suitably defined Nehari manifold and a careful analysis of Palais Smale sequences. We complement this study with a multiplicity result exploiting the symmetry of the problem.


POSSCORE A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labelling. Conversational search systems, such as Google Assistant and Microsoft Cortana, provide a new search paradigm where users are allowed, via natural language dialogues, to communicate with search systems. Evaluating such systems is very challenging since search results are presented in the format of natural language sentences. Given the unlimited number of possible responses, collecting relevance assessments for all the possible responses is infeasible. In this paper, we propose POSSCORE, a simple yet effective automatic evaluation method for conversational search. The proposed embedding based metric takes the influence of part of speech (POS) of the terms in the response into account. To the best knowledge, our work is the first to systematically demonstrate the importance of incorporating syntactic information, such as POS labels, for conversational search evaluation. Experimental results demonstrate that our metrics can correlate with human preference, achieving significant improvements over state of the art baseline metrics.


Optical phase modulation by natural eye movements application to time domain FF OCT image retrieval. Eye movements are commonly seen as an obstacle to high resolution ophthalmic imaging. In this context we study the natural axial movements of the in vivo human eye and show that they can be used to modulate the optical phase and retrieve tomographic images via time domain full field optical coherence tomography (TD FF OCT). This approach opens a path to a simplified ophthalmic TD FF OCT device, operating without the usual piezo motor camera synchronization. The device demonstrates in vivo human corneal images under the different image retrieval schemes (2 phase and 4 phase) and different exposure times (3.5 ms, 10 ms, 20 ms). Data on eye movements, acquired with a 100 kHz spectral domain OCT with axial eye tracking, are used to study the influence of ocular motion on the probability of capturing high signal tomographic images without phase washout. The optimal combinations of camera acquisition speed and amplitude of piezo modulation are proposed and discussed.


Normalization for Cubical Type Theory. We prove normalization for (univalent, Cartesian) cubical type theory, closing the last major open problem in the syntactic metatheory of cubical type theory. Our normalization result is reduction free, in the sense of yielding a bijection between equivalence classes of terms in context and a tractable language of beta eta normal forms. As corollaries we obtain both decidability of judgmental equality and the injectivity of type constructors.


Marketability of building energy efficiency systems based on behavioral change A case study of a novel micro moments based solution. In spite of the substantial advance in developing energy efficient buildings, power demand in the building sector is still remarkably growing due to teleworking and e learning triggered by the COVID 19 movement restrictions. This is highlighted by the inefficiency of energy saving measures that have recently been set owing to the the marketability failure and unsuccessful design integration of existing ICT based solutions. Specifically, the factors that affect energy efficiency comprise natural and socio economic restrictions, technological advances, and last but not least the human behavior. Energy efficiency based on behavioral change has attracted an increasing interest in the recent years, unfortunately, solutions in this area suffer from the lack of marketability because of the absence of both prospective studies and consumer awareness. This work, focuses on a key cost effective technology for monitoring power consumption and for contributing to the behavioral change through smart, personalized, and on the moment, action recommendations. In order to examine the marketability of the proposed solution, we begin with a market and research analysis of the domain of energy efficiency systems in the building sector that target behavioral change. Moving forward, various factors that affect the commercialization of the final product are considered before proceeding with recommended actions to ensure its successful marketability via conducting a Go No Go analysis. Finally, based on the comprehensive commercialization study, a GO decision is concluded for the subject technology.


Maneuvering Digital Watermarking In Face Recognition. The challenges faced in the digital world are many, which could be resolved with some biometric recognition methods. These biometric recognition methods are encompassed within watermarking technology, steganography, cryptography, and many other schemes of security. These methods assist in securing digital images with the authentication of their owner. This paper briefly contextualizes the digital watermarking technique, which is referred to as Natural Preserving Transform (NPT) and Hartley Transform, which is endeavored in the face recognition process. The non blind extraction and quasi blind extraction techniques are used for extracting the watermark from the image in the proposed system. This paper articulates the application of this watermarking technique employed in face recognition through watermarking of various face images to multiple backgrounds encompassing gray scale images. Natural Preserve Transform is employed as a part of the fuzzy logic watermarking. In the proposed system, NPT is employed for encoding a logo of grayscale watermarking text or logo image to a host image located anywhere. The robustness and performance of the proposed system are experimentally tested with the help of image processing operations like image compression, noise degradation, cropping. Due to its unique feature of uniform distribution of face images, this technique is selected among other methods in digital watermarking. The system is tested for its efficiency with experimental analyses, which could be confirmed with the results of the simulation. The above system is proposed for copyright protection, authentication, and security requirements.


Bad and good errors value weighted skill scores in deep ensemble learning. In this paper we propose a novel approach to realize forecast verification. Specifically, we introduce a strategy for assessing the severity of forecast errors based on the evidence that, on the one hand, a false alarm just anticipating an occurring event is better than one in the middle of consecutive non occurring events, and that, on the other hand, a miss of an isolated event has a worse impact than a miss of a single event, which is part of several consecutive occurrences. Relying on this idea, we introduce a novel definition of confusion matrix and skill scores giving greater importance to the value of the prediction rather than to its quality. Then, we introduce a deep ensemble learning procedure for binary classification, in which the probabilistic outcomes of a neural network are clustered via optimization of these value weighted skill scores. We finally show the performances of this approach in the case of three applications concerned with pollution, space weather and stock prize forecasting.


DOVE A Data Oblivious Virtual Environment. Users can improve the security of remote communications by using Trusted Execution Environments (TEEs) to protect against direct introspection and tampering of sensitive data. This can even be done with applications coded in high level languages with complex programming stacks such as R, Python, and Ruby. However, this creates a trade off between programming convenience versus the risk of attacks using microarchitectural side channels. In this paper, we argue that it is possible to address this problem for important applications by instrumenting a complex programming environment (like R) to produce a Data Oblivious Transcript (DOT) that is explicitly designed to support computation that excludes side channels. Such a transcript is then evaluated on a Trusted Execution Environment (TEE) containing the sensitive data using a small trusted computing base called the Data Oblivious Virtual Environment (DOVE). To motivate the problem, we demonstrate a number of subtle side channel vulnerabilities in the R language. We then provide an illustrative design and implementation of DOVE for R, creating the first side channel resistant R programming stack. We demonstrate that the two phase architecture provided by DOT generation and DOVE evaluation can provide practical support for complex programming languages with usable performance and high security assurances against side channels.


Machine Learning based Inter Beam Inter Cell Interference Mitigation in mmWave. In this paper, we address inter beam inter cell interference mitigation in 5G networks that employ millimeter wave (mmWave), beamforming and non orthogonal multiple access (NOMA) techniques. Those techniques play a key role in improving network capacity and spectral efficiency by multiplexing users on both spatial and power domains. In addition, the coverage area of multiple beams from different cells can intersect, allowing more flexibility in user cell association. However, the intersection of coverage areas also implies increased inter beam inter cell interference, i.e. interference among beams formed by nearby cells. Therefore, joint user cell association and inter beam power allocation stand as a promising solution to mitigate inter beam, inter cell interference. In this paper, we consider a 5G mmWave network and propose a reinforcement learning algorithm to perform joint user cell association and inter beam power allocation to maximize the sum rate of the network. The proposed algorithm is compared to a uniform power allocation that equally divides power among beams per cell. Simulation results present a performance enhancement of 13 30 in network's sum rate corresponding to the lowest and highest traffic loads, respectively.


Sample Efficient Safety Assurances using Conformal Prediction. When deploying machine learning models in high stakes robotics applications, the ability to detect unsafe situations is crucial. Early warning systems can provide alerts when an unsafe situation is imminent (in the absence of corrective action). To reliably improve safety, these warning systems should have a provable false negative rate i.e. of the situations that are unsafe, fewer than epsilon will occur without an alert. In this work, we present a framework that combines a statistical inference technique known as conformal prediction with a simulator of robot environment dynamics, in order to tune warning systems to provably achieve an epsilon false negative rate using as few as 1 epsilon data points. We apply our framework to a driver warning system and a robotic grasping application, and empirically demonstrate guaranteed false negative rate while also observing low false detection (positive) rate.


Disembodied Machine Learning On the Illusion of Objectivity in NLP. Machine Learning seeks to identify and encode bodies of knowledge within provided datasets. However, data encodes subjective content, which determines the possible outcomes of the models trained on it. Because such subjectivity enables marginalisation of parts of society, it is termed (social) bias' and sought to be removed. In this paper, we contextualise this discourse of bias in the ML community against the subjective choices in the development process. Through a consideration of how choices in data and model development construct subjectivity, or biases that are represented in a model, we argue that addressing and mitigating biases is near impossible. This is because both data and ML models are objects for which meaning is made in each step of the development pipeline, from data selection over annotation to model training and analysis. Accordingly, we find the prevalent discourse of bias limiting in its ability to address social marginalisation. We recommend to be conscientious of this, and to accept that de biasing methods only correct for a fraction of biases.


A Global Optimization Approach for Multi Marginal Optimal Transport Problems with Coulomb Cost. In this work, we construct a novel numerical method for solving the multi marginal optimal transport problems with Coulomb cost. This type of optimal transport problems arises in quantum physics and plays an important role in understanding the strongly correlated quantum systems. With a Monge like ansatz, the orginal high dimensional problems are transferred into mathematical programmings with generalized complementarity constraints, and thus the curse of dimensionality is surmounted. However, the latter ones are themselves hard to deal with from both theoretical and practical perspective. Moreover in the presence of nonconvexity, brute force searching for global solutions becomes prohibitive as the problem size grows large. To this end, we propose a global optimization approach for solving the nonconvex optimization problems, by exploiting an efficient proximal block coordinate descent local solver and an initialization subroutine based on hierarchical grid refinements. We provide numerical simulations on some typical physical systems to show the efficiency of our approach. The results match well with both theoretical predictions and physical intuitions, and give the first visualization of optimal transport maps for some two dimensional systems.


physics.flu-dyn math.DS physics.ao-ph physics.bio-ph

Detecting Lagrangian coherent structures from sparse and noisy trajectory data. Many complex flows such as those arising from ocean plastics in geophysics or moving cells in biology are characterized by sparse and noisy trajectory datasets. We introduce techniques for identifying Lagrangian Coherent Structures (LCSs) of hyperbolic and elliptic nature in such datasets. Hyperbolic LCSs, which represent surfaces with maximal attraction or repulsion over a finite amount of time, are computed through a regularized least squares approximation of the flow map gradient. Elliptic LCSs, which identify regions of coherent motion such as vortices and jets, are extracted using DBSCAN a popular data clustering algorithm combined with a systematic approach to choose parameters. We deploy these methods on various benchmark analytical flows and real life experimental datasets ranging from oceanography to biology and show that they yield accurate results, despite sparse and noisy data. We also provide a lightweight computational implementation of these techniques as a user friendly and straightforward Python code.


An unfitted radial basis function generated finite difference method applied to thoracic diaphragm simulations. The thoracic diaphragm is the muscle that drives the respiratory cycle of a human being. Using a system of partial differential equations (PDEs) that models linear elasticity we compute displacements and stresses in a two dimensional cross section of the diaphragm in its contracted state. The boundary data consists of a mix of displacement and traction conditions. If these are imposed as they are, and the conditions are not compatible, this leads to reduced smoothness of the solution. Therefore, the boundary data is first smoothed using the least squares radial basis function generated finite difference (RBF FD) framework. Then the boundary conditions are reformulated as a Robin boundary condition with smooth coefficients. The same framework is also used to approximate the boundary curve of the diaphragm cross section based on data obtained from a slice of a computed tomography (CT) scan. To solve the PDE we employ the unfitted least squares RBF FD method. This makes it easier to handle the geometry of the diaphragm, which is thin and non convex. We show numerically that our solution converges with high order towards a finite element solution evaluated on a fine grid. Through this simplified numerical model we also gain an insight into the challenges associated with the diaphragm geometry and the boundary conditions before approaching a more complex three dimensional model.


DiSECt A Differentiable Simulation Engine for Autonomous Robotic Cutting. Robotic cutting of soft materials is critical for applications such as food processing, household automation, and surgical manipulation. As in other areas of robotics, simulators can facilitate controller verification, policy learning, and dataset generation. Moreover, differentiable simulators can enable gradient based optimization, which is invaluable for calibrating simulation parameters and optimizing controllers. In this work, we present DiSECt the first differentiable simulator for cutting soft materials. The simulator augments the finite element method (FEM) with a continuous contact model based on signed distance fields (SDF), as well as a continuous damage model that inserts springs on opposite sides of the cutting plane and allows them to weaken until zero stiffness, enabling crack formation. Through various experiments, we evaluate the performance of the simulator. We first show that the simulator can be calibrated to match resultant forces and deformation fields from a state of the art commercial solver and real world cutting datasets, with generality across cutting velocities and object instances. We then show that Bayesian inference can be performed efficiently by leveraging the differentiability of the simulator, estimating posteriors over hundreds of parameters in a fraction of the time of derivative free methods. Finally, we illustrate that control parameters in the simulation can be optimized to minimize cutting forces via lateral slicing motions. We publish videos and additional results on our project website at https diff cutting sim.github.io.


Alaska A Flexible Benchmark for Data Integration Tasks. Data integration is a long standing interest of the data management community and has many disparate applications, including business, science and government. We have recently witnessed impressive results in specific data integration tasks, such as Entity Resolution, thanks to the increasing availability of benchmarks. A limitation of such benchmarks is that they typically come with their own task definition and it can be difficult to leverage them for complex integration pipelines. As a result, evaluating end to end pipelines for the entire data integration process is still an elusive goal. In this work, we present Alaska, the first benchmark based on real world dataset to support seamlessly multiple tasks (and their variants) of the data integration pipeline. The dataset consists of 70k heterogeneous product specifications from 71 e commerce websites with thousands of different product attributes. Our benchmark comes with profiling meta data, a set of pre defined use cases with diverse characteristics, and an extensive manually curated ground truth. We demonstrate the flexibility of our benchmark by focusing on several variants of two crucial data integration tasks, Schema Matching and Entity Resolution. Our experiments show that our benchmark enables the evaluation of a variety of methods that previously were difficult to compare, and can foster the design of more holistic data integration solutions.


A note on the asymptotics for incomplete Betafunctions. We determine the asymptotic behaviour of certain incomplete Betafunctions.


MOLEMAN Mention Only Linking of Entities with a Mention Annotation Network. We present an instance based nearest neighbor approach to entity linking. In contrast to most prior entity retrieval systems which represent each entity with a single vector, we build a contextualized mention encoder that learns to place similar mentions of the same entity closer in vector space than mentions of different entities. This approach allows all mentions of an entity to serve as "class prototypes" as inference involves retrieving from the full set of labeled entity mentions in the training set and applying the nearest mention neighbor's entity label. Our model is trained on a large multilingual corpus of mention pairs derived from Wikipedia hyperlinks, and performs nearest neighbor inference on an index of 700 million mentions. It is simpler to train, gives more interpretable predictions, and outperforms all other systems on two multilingual entity linking benchmarks.


EyePAD A Distillation based approach for joint Eye Authentication and Presentation Attack Detection using Periocular Images. A practical eye authentication (EA) system targeted for edge devices needs to perform authentication and be robust to presentation attacks, all while remaining compute and latency efficient. However, existing eye based frameworks a) perform authentication and Presentation Attack Detection (PAD) independently and b) involve significant pre processing steps to extract the iris region. Here, we introduce a joint framework for EA and PAD using periocular images. While a deep Multitask Learning (MTL) network can perform both the tasks, MTL suffers from the forgetting effect since the training datasets for EA and PAD are disjoint. To overcome this, we propose Eye Authentication with PAD (EyePAD), a distillation based method that trains a single network for EA and PAD while reducing the effect of forgetting. To further improve the EA performance, we introduce a novel approach called EyePAD that includes training an MTL network on both EA and PAD data, while distilling the versatility' of the EyePAD network through an additional distillation step. Our proposed methods outperform the SOTA in PAD and obtain near SOTA performance in eye to eye verification, without any pre processing. We also demonstrate the efficacy of EyePAD and EyePAD in user to user verification with PAD across network backbones and image quality.


The difference between the Hurwitz continued fraction expansions of a complex number and its rational approximations. For regular continued fraction, if a real number x and its rational approximation p q satisfying x p q 1 q 2 , then, after deleting the last integer of the partial quotients of p q , the sequence of the remaining partial quotients is a prefix of that of x . In this paper, we show that the situation is completely different if we consider the Hurwitz continued fraction expansions of a complex number and its rational approximations. More specifically, we consider the set E( psi) of complex numbers which are well approximated with the given bound psi and have quite different Hurwitz continued fraction expansions from that of their rational approximations. The Hausdorff and packing dimensions of such set are determined. It turns out that its packing dimension is always full for any given approximation bound psi and its Hausdorff dimension is equal to that of the psi approximable set W( psi) of complex numbers. As a consequence, we also obtain an analogue of the classical Jarn 'ik Theorem in real case.


Stochastic Relaxed Inertial Forward Backward Forward splitting for Monotone Inclusions in Hilbert spaces. We consider monotone inclusions defined on a Hilbert space where the operator is given by the sum of a maximal monotone operator T and a single valued monotone, Lipschitz continuous, and expectation valued operator V . We draw motivation from the seminal work by Attouch and Cabot on relaxed inertial methods for monotone inclusions and present a stochastic extension of the relaxed inertial forward backward forward (RISFBF) method. Facilitated by an online variance reduction strategy via a mini batch approach, we show that (RISFBF) produces a sequence that weakly converges to the solution set. Moreover, it is possible to estimate the rate at which the discrete velocity of the stochastic process vanishes. Under strong monotonicity, we demonstrate strong convergence, and give a detailed assessment of the iteration and oracle complexity of the scheme. When the mini batch is raised at a geometric (polynomial) rate, the rate statement can be strengthened to a linear (suitable polynomial) rate while the oracle complexity of computing an epsilon solution improves to O(1 epsilon) . Importantly, the latter claim allows for possibly biased oracles, a key theoretical advancement allowing for far broader applicability. By defining a restricted gap function based on the Fitzpatrick function, we prove that the expected gap of an averaged sequence diminishes at a sublinear rate of O(1 k) while the oracle complexity of computing a suitably defined epsilon solution is O(1 epsilon 1 a ) where a 1 . Numerical results on two stage games and an overlapping group Lasso problem illustrate the advantages of our method compared to stochastic forward backward forward (SFBF) and SA schemes.


Dynamic Ramping for Demand Response of Processes and Energy Systems based on Exact Linearization. The increasing share of volatile renewable electricity production motivates demand response. Substantial potential for demand response is offered by flexible processes and their local multi energy supply systems. Simultaneous optimization of their schedules can exploit the demand response potential, but leads to numerically challenging problems for nonlinear dynamic processes. In this paper, we propose to capture process dynamics using dynamic ramping constraints. In contrast to traditional static ramping constraints, dynamic ramping constraints are a function of the process state and can capture high order dynamics. We derive dynamic ramping constraints rigorously for the case of single input single output processes that are exactly input state linearizable. The resulting scheduling problem can be efficiently solved as a mixed integer linear program. In a case study, we study two flexible reactors and a multi energy system. The proper representation of process dynamics by dynamic ramping allows for faster transitions compared to static ramping constraints and thus higher economic benefits of demand response. The proposed dynamic ramping approach is sufficiently fast for application in online optimization.


Privacy Concerns in Chatbot Interactions When to Trust and When to Worry. Through advances in their conversational abilities, chatbots have started to request and process an increasing variety of sensitive personal information. The accurate disclosure of sensitive information is essential where it is used to provide advice and support to users in the healthcare and finance sectors. In this study, we explore users' concerns regarding factors associated with the use of sensitive data by chatbot providers. We surveyed a representative sample of 491 British citizens. Our results show that the user concerns focus on deleting personal information and concerns about their data's inappropriate use. We also identified that individuals were concerned about losing control over their data after a conversation with conversational agents. We found no effect from a user's gender or education but did find an effect from the user's age, with those over 45 being more concerned than those under 45. We also considered the factors that engender trust in a chatbot. Our respondents' primary focus was on the chatbot's technical elements, with factors such as the response quality being identified as the most critical factor. We again found no effect from the user's gender or education level however, when we considered some social factors (e.g. avatars or perceived 'friendliness'), we found those under 45 years old rated these as more important than those over 45. The paper concludes with a discussion of these results within the context of designing inclusive, digital systems that support a wide range of users.


On straightening for Segal spaces. We study cocartesian fibrations between ( infty, d) categories in terms of higher Segal spaces and prove a version of straightening for them. This follows from a repeated application of an explicit combinatorial result, relating two types of fibrations between double categories.


On the sum of digits of 1 M in mathbb F q x . For certain primes p , the average digit in the expansion of 1 p was found to have a deviation from random behaviour related to the class number of the imaginary quadratic field mathbb Q ( sqrt p ) (Girstmair 1994). In this short note, we observe that for the corresponding problem when we replace the integers by polynomials over a finite field, there is never any bias. The argument is elementary.


Holme type theorem for special linear groups. Let Z be an affine algebraic variety and ED(Z) max(2 dim Z 1, dim TZ). Let X be a smooth algebraic variety isomorphic to a semi simple linear algebraic group whose Lie algebra is a sum of special linear Lie algebras. We show that if dim X ED(Z) 1, then Z admits a closed embedding into X. We also show that for every smooth affine flexible variety Y there is a closed embedding of Z into the the product of Y and an affine n space provided that n dim Z 2 and dim Y n ED (Z) 1.


Skew Orthogonal Convolutions. Training convolutional neural networks with a Lipschitz constraint under the l 2 norm is useful for provable adversarial robustness, interpretable gradients, stable training, etc. While 1 Lipschitz networks can be designed by imposing a 1 Lipschitz constraint on each layer, training such networks requires each layer to be gradient norm preserving (GNP) to prevent gradients from vanishing. However, existing GNP convolutions suffer from slow training, lead to significant reduction in accuracy and provide no guarantees on their approximations. In this work, we propose a GNP convolution layer called Skew Orthogonal Convolution (SOC) that uses the following mathematical property when a matrix is it Skew Symmetric , its exponential function is an it orthogonal matrix. To use this property, we first construct a convolution filter whose Jacobian is Skew Symmetric. Then, we use the Taylor series expansion of the Jacobian exponential to construct the SOC layer that is orthogonal. To efficiently implement SOC, we keep a finite number of terms from the Taylor series and provide a provable guarantee on the approximation error. Our experiments on CIFAR 10 and CIFAR 100 show that SOC allows us to train provably Lipschitz, large convolutional neural networks significantly faster than prior works while achieving significant improvements for both standard and certified robust accuracies.


Towards Efficient Full 8 bit Integer DNN Online Training on Resource limited Devices without Batch Normalization. Huge computational costs brought by convolution and batch normalization (BN) have caused great challenges for the online training and corresponding applications of deep neural networks (DNNs), especially in resource limited devices. Existing works only focus on the convolution or BN acceleration and no solution can alleviate both problems with satisfactory performance. Online training has gradually become a trend in resource limited devices like mobile phones while there is still no complete technical scheme with acceptable model performance, processing speed, and computational cost. In this research, an efficient online training quantization framework termed EOQ is proposed by combining Fixup initialization and a novel quantization scheme for DNN model compression and acceleration. Based on the proposed framework, we have successfully realized full 8 bit integer network training and removed BN in large scale DNNs. Especially, weight updates are quantized to 8 bit integers for the first time. Theoretical analyses of EOQ utilizing Fixup initialization for removing BN have been further given using a novel Block Dynamical Isometry theory with weaker assumptions. Benefiting from rational quantization strategies and the absence of BN, the full 8 bit networks based on EOQ can achieve state of the art accuracy and immense advantages in computational cost and processing speed. What is more, the design of deep learning chips can be profoundly simplified for the absence of unfriendly square root operations in BN. Beyond this, EOQ has been evidenced to be more advantageous in small batch online training with fewer batch samples. In summary, the EOQ framework is specially designed for reducing the high cost of convolution and BN in network training, demonstrating a broad application prospect of online training in resource limited devices.


Periodic Orbit can be Evolutionarily Stable Case Study of Discrete Replicator Dynamics. In evolutionary game theory, it is customary to be partial to the dynamical models possessing fixed points so that they may be understood as the attainment of evolutionary stability, and hence, Nash equilibrium. Any show of periodic or chaotic solution is many a time perceived as a shortcoming of the corresponding game dynamic because (Nash) equilibrium play is supposed to be robust and persistent behaviour, and any other behaviour in nature is deemed transient. Consequently, there is a lack of attempt to connect the non fixed point solutions with the game theoretic concepts. Here we provide a way to render game theoretic meaning to periodic solutions. To this end, we consider a replicator map that models Darwinian selection mechanism in unstructured infinite sized population whose individuals reproduce asexually forming non overlapping generations. This is one of the simplest evolutionary game dynamic that exhibits periodic solutions giving way to chaotic solutions (as parameters related to reproductive fitness change) and also obeys the folk theorems connecting fixed point solutions with Nash equilibrium. Interestingly, we find that a modified Darwinian fitness termed heterogeneity payoff in the corresponding population game must be put forward as (conventional) fitness times the probability that two arbitrarily chosen individuals of the population adopt two different strategies. The evolutionary dynamics proceeds as if the individuals optimize the heterogeneity payoff to reach an evolutionarily stable orbit, should it exist. We rigorously prove that a locally asymptotically stable period orbit must be heterogeneity stable orbit a generalization of evolutionarily stable state.


Sexism Identification in Tweets and Gabs using Deep Neural Networks. Through anonymisation and accessibility, social media platforms have facilitated the proliferation of hate speech, prompting increased research in developing automatic methods to identify these texts. This paper explores the classification of sexism in text using a variety of deep neural network model architectures such as Long Short Term Memory (LSTMs) and Convolutional Neural Networks (CNNs). These networks are used in conjunction with transfer learning in the form of Bidirectional Encoder Representations from Transformers (BERT) and DistilBERT models, along with data augmentation, to perform binary and multiclass sexism classification on the dataset of tweets and gabs from the sEXism Identification in Social neTworks (EXIST) task in IberLEF 2021. The models are seen to perform comparatively to those from the competition, with the best performances seen using BERT and a multi filter CNN model. Data augmentation further improves these results for the multi class classification task. This paper also explores the errors made by the models and discusses the difficulty in automatically classifying sexism due to the subjectivity of the labels and the complexity of natural language used in social media.


Models of Computational Profiles to Study the Likelihood of DNN Metamorphic Test Cases. Neural network test cases are meant to exercise different reasoning paths in an architecture and used to validate the prediction outcomes. In this paper, we introduce "computational profiles" as vectors of neuron activation levels. We investigate the distribution of computational profile likelihood of metamorphic test cases with respect to the likelihood distributions of training, test and error control cases. We estimate the non parametric probability densities of neuron activation levels for each distinct output class. Probabilities are inferred using training cases only, without any additional knowledge about metamorphic test cases. Experiments are performed by training a network on the MNIST Fashion library of images and comparing prediction likelihoods with those obtained from error control data and from metamorphic test cases. Experimental results show that the distributions of computational profile likelihood for training and test cases are somehow similar, while the distribution of the random noise control data is always remarkably lower than the observed one for the training and testing sets. In contrast, metamorphic test cases show a prediction likelihood that lies in an extended range with respect to training, tests, and random noise. Moreover, the presented approach allows the independent assessment of different training classes and experiments to show that some of the classes are more sensitive to misclassifying metamorphic test cases than other classes. In conclusion, metamorphic test cases represent very aggressive tests for neural network architectures. Furthermore, since metamorphic test cases force a network to misclassify those inputs whose likelihood is similar to that of training cases, they could also be considered as adversarial attacks that evade defenses based on computational profile likelihood evaluation.


MiNet A Convolutional Neural Network for Identifying and Categorising Minerals. Identification of minerals in the field is a task that is wrought with many challenges. Traditional approaches are prone to errors where there is no enough experience and expertise. Several existing techniques mainly make use of features of the minerals under a microscope and tend to favour a manual feature extraction pipeline. Deep learning methods can help overcome some of these hurdles and provide simple and effective ways to identify minerals. In this paper, we present an algorithm for identifying minerals from hand specimen images. Using a Convolutional Neural Network (CNN), we develop a single label image classification model to identify and categorise seven classes of minerals. Experiments conducted using real world datasets show that the model achieves an accuracy of 90.75 .


Hypocoercivity and controllability in linear semi dissipative Hamiltonian ODEs and DAEs. For the classes of finite dimensional linear time invariant semi dissipative Hamiltonian ordinary differential equations and differential algebraic equations, stability and hypocoercivity are discussed and related to concepts from control theory. On the basis of staircase forms the solution behavior is characterized and connected to the hypocoercivity index of these evolution equations. The results are applied to two infinite dimensional flow problems.


Comprehensive analysis of spherical bubble oscillations and shock wave emission in laser induced cavitation. The dynamics of spherical laser induced cavitation bubbles in water is investigated by plasma photography, time resolved shadowgraphs, and single shot probe beam scattering enabling to portray the transition from initial nonlinear to late linear oscillations. The frequency of late oscillations yields the bubble's gas content. Simulations with the Gilmore model using plasma size as input and oscillation times as fit parameter provide insights into experimentally not accessible bubble parameters and shock wave emission. The model is extended by a term covering the initial shock driven acceleration of the bubble wall, an automated method determining shock front position and pressure decay, and an energy balance for the partitioning of absorbed laser energy into vaporization, bubble and shock wave energy, and dissipation through viscosity and condensation. These tools are used for analysing a scattering signal covering 102 oscillation cycles. The bubble was produced by a plasma with 1550 K average temperature and had 36 mu m maximum radius. Predicted bubble wall velocities during expansion agree well with experimental data. Upon first collapse, most energy was stored in the compressed liquid around the bubble and then radiated away acoustically. The collapsed bubble contained more vapour than gas, and its pressure was 13.5 GPa. The pressure of the rebound shock wave initially decayed propto r 1.8 , and energy dissipation at the shock front heated liquid near the bubble wall above the superheat limit. The shock induced temperature rise reduces damping during late bubble oscillations. Bubble dynamics changes significantly for small bubbles with less than 10 mu m radius.