Orthotree, orthoshapes and ortho integral surfaces. This paper describes a tree structure on the set of orthogeodesics leading to a combinatorial proof of Basmajian's identity in the case of surfaces. It is motivated by a number theoretic application of Bridgeman's identity, the combinatorial proof of McShane's identity by Bowditch and its generalized version by Labourie and Tan. We also introduce the notion of orthoshapes with associated identity relations and indicate connections to length equivalent orthogeodesics and a type of Cayley Menger determinant. As another application, dilogarithm identities following from Bridgeman's identity are computed recursively and their terms are indexed by the Farey sequence.


Democratic Source Coding An Optimal Fixed Length Quantization Scheme for Distributed Optimization Under Communication Constraints. The communication cost of distributed optimization algorithms is a major bottleneck in their scalability. This work considers a parameter server setting in which the worker is constrained to communicate information to the server using only R bits per dimension. We show that mathbf democratic mathbf embeddings from random matrix theory are significantly useful for designing efficient and optimal vector quantizers that respect this bit budget. The resulting polynomial complexity source coding schemes are used to design distributed optimization algorithms with convergence rates matching the minimax optimal lower bounds for (i) Smooth and Strongly Convex objectives with access to an Exact Gradient oracle, as well as (ii) General Convex and Non Smooth objectives with access to a Noisy Subgradient oracle. We further propose a relaxation of this coding scheme which is nearly minimax optimal. Numerical simulations validate our theoretical claims.


Spatial Object Recommendation with Hints When Spatial Granularity Matters. Existing spatial object recommendation algorithms generally treat objects identically when ranking them. However, spatial objects often cover different levels of spatial granularity and thereby are heterogeneous. For example, one user may prefer to be recommended a region (say Manhattan), while another user might prefer a venue (say a restaurant). Even for the same user, preferences can change at different stages of data exploration. In this paper, we study how to support top k spatial object recommendations at varying levels of spatial granularity, enabling spatial objects at varying granularity, such as a city, suburb, or building, as a Point of Interest (POI). To solve this problem, we propose the use of a POI tree, which captures spatial containment relationships between POIs. We design a novel multi task learning model called MPR (short for Multi level POI Recommendation), where each task aims to return the top k POIs at a certain spatial granularity level. Each task consists of two subtasks (i) attribute based representation learning (ii) interaction based representation learning. The first subtask learns the feature representations for both users and POIs, capturing attributes directly from their profiles. The second subtask incorporates user POI interactions into the model. Additionally, MPR can provide insights into why certain recommendations are being made to a user based on three types of hints user aspect, POI aspect, and interaction aspect. We empirically validate our approach using two real life datasets, and show promising performance improvements over several state of the art methods.


A generalized polar coordinate integration formula with applications to the study of convolution powers of complex valued functions on mathbb Z d . In this article, we consider a class of functions on mathbb R d , called positive homogeneous functions, which interact well with certain continuous one parameter groups of (generally anisotropic) dilations. Generalizing the Euclidean norm, positive homogeneous functions appear naturally in the study of convolution powers of complex valued functions on mathbb Z d . As the spherical measure is a Radon measure on the unit sphere which is invariant under the symmetry group of the Euclidean norm, to each positive homogeneous function P , we construct a Radon measure sigma P on S eta in mathbb R d P( eta) 1 which is invariant under the symmetry group of P . With this measure, we prove a generalization of the classical polar coordinate integration formula and deduce a number of corollaries in this setting. We then turn to the study of convolution powers of complex functions on mathbb Z d and certain oscillatory integrals which arise naturally in that context. Armed with our integration formula and the Van der Corput lemma, we establish sup norm type estimates for convolution powers this result is new and partially extends results of 20 and 21 .


Identification of Attack Specific Signatures in Adversarial Examples. The adversarial attack literature contains a myriad of algorithms for crafting perturbations which yield pathological behavior in neural networks. In many cases, multiple algorithms target the same tasks and even enforce the same constraints. In this work, we show that different attack algorithms produce adversarial examples which are distinct not only in their effectiveness but also in how they qualitatively affect their victims. We begin by demonstrating that one can determine the attack algorithm that crafted an adversarial example. Then, we leverage recent advances in parameter space saliency maps to show, both visually and quantitatively, that adversarial attack algorithms differ in which parts of the network and image they target. Our findings suggest that prospective adversarial attacks should be compared not only via their success rates at fooling models but also via deeper downstream effects they have on victims.


Noise Stability Regularization for Improving BERT Fine tuning. Fine tuning pre trained language models such as BERT has become a common practice dominating leaderboards across various NLP tasks. Despite its recent success and wide adoption, this process is unstable when there are only a small number of training samples available. The brittleness of this process is often reflected by the sensitivity to random seeds. In this paper, we propose to tackle this problem based on the noise stability property of deep nets, which is investigated in recent literature (Arora et al., 2018 Sanyal et al., 2020). Specifically, we introduce a novel and effective regularization method to improve fine tuning on NLP tasks, referred to as Layer wise Noise Stability Regularization (LNSR). We extend the theories about adding noise to the input and prove that our method gives a stabler regularization effect. We provide supportive evidence by experimentally confirming that well performing models show a low sensitivity to noise and fine tuning with LNSR exhibits clearly higher generalizability and stability. Furthermore, our method also demonstrates advantages over other state of the art algorithms including L2 SP (Li et al., 2018), Mixout (Lee et al., 2020) and SMART (Jiang et al., 2020).


On the Complexity of Dynamic Submodular Maximization. We study dynamic algorithms for the problem of maximizing a monotone submodular function over a stream of n insertions and deletions. We show that any algorithm that maintains a (0.5 epsilon) approximate solution under a cardinality constraint, for any constant epsilon 0 , must have an amortized query complexity that is mathit polynomial in n . Moreover, a linear amortized query complexity is needed in order to maintain a 0.584 approximate solution. This is in sharp contrast with recent dynamic algorithms of LMNF 20, Mon20 that achieve (0.5 epsilon) approximation with a mathsf poly log(n) amortized query complexity. On the positive side, when the stream is insertion only, we present efficient algorithms for the problem under a cardinality constraint and under a matroid constraint with approximation guarantee 1 1 e epsilon and amortized query complexities smash O( log (k epsilon) epsilon 2) and smash k tilde O (1 epsilon 2) log n , respectively, where k denotes the cardinality parameter or the rank of the matroid.


The Chern Ricci flow. We give a survey on the Chern Ricci flow, a parabolic flow of Hermitian metrics on complex manifolds. We emphasize open problems and new directions.


Networks of Ethereum Non Fungible Tokens A graph based analysis of the ERC 721 ecosystem. Non fungible tokens (NFTs) as a decentralized proof of ownership represent one of the main reasons why Ethereum is a disruptive technology. This paper presents the first systematic study of the interactions occurring in a number of NFT ecosystems. We illustrate how to retrieve transaction data available on the blockchain and structure it as a graph based model. Thanks to this methodology, we are able to study for the first time the topological structure of NFT networks and show that their properties (degree distribution and others) are similar to those of interaction graphs in social networks. Time dependent analysis metrics, useful to characterize market influencers and interactions between different wallets, are also introduced. Based on those, we identify across a number of NFT networks the widespread presence of both investors accumulating NFTs and individuals who make large profits.


Optical Spin Sorting Chain. Transverse spin angular momentum of light is a key concept in recent nanophotonics to realize unidirectional light transport in waveguides by spin momentum locking. Herein we theoretically propose subwavelength nanoparticle chain waveguides that efficiently sort optical spins with engineerable spin density distributions. By arranging high refractive index nanospheres of different sizes in a zigzag manner, directional optical spin propagation is realized. The origin of the efficient spin transport is revealed by analyzing the dispersion relation and spin angular momentum density distributions. In contrast to conventional waveguides, the proposed asymmetric waveguide can spatially separate up and down spins and locate one parity inside and the other outside the structure. Moreover, robustness against bending the waveguide and its application as an optical spin sorter are presented. Compared to previous reports on spatial engineering of local spins in photonic crystal waveguides, we achieved substantial miniaturization of the entire footprint down to subwavelength scale.


The Parameter Sensitivities of a Jump diffusion Process in Basic Credit Risk Analysis. We detect the parameter sensitivities of bond pricing which is driven by a Brownian motion and a compound Poisson process as the discontinuous case in credit risk research. The strict mathematical deductions are given theoretically due to the explicit call price formula. Furthermore, we illustrate Matlab simulation to verify these conclusions.


Boundary quotients of the right Toeplitz algebra of the affine semigroup over the natural numbers. We consider the semigroup crossed product of the additive natural numbers by the multiplicative natural numbers. We study its Toeplitz C algebra generated by the right regular representation, which we call the right Toeplitz algebra. We analyse its structure by studying three distinguished quotients. We show that the multiplicative boundary quotient is isomorphic to a crossed product of the Toeplitz algebra of the additive rationals by an action of the multiplicative rationals, and study its ideal structure. We identify the Crisp Laca boundary quotient as the C algebra of the corresponding group built from rational numbers. There is a natural dynamics on the right Toeplitz algebra and all its KMS states factor through the additive boundary quotient. We describe the KMS simplex for inverse temperatures greater than one.


A diachronic evaluation of gender asymmetry in euphemism. The use of euphemisms is a known driver of language change. It has been proposed that women use euphemisms more than men. Although there have been several studies investigating gender differences in language, the claim about euphemism usage has not been tested comprehensively through time. If women do use euphemisms more, this could mean that women also lead the formation of new euphemisms and language change over time. Using four large diachronic text corpora of English, we evaluate the claim that women use euphemisms more than men through a quantitative analysis. We assembled a list of 106 euphemism taboo pairs to analyze their relative use through time by each gender in the corpora. Contrary to the existing belief, our results show that women do not use euphemisms with a higher proportion than men. We repeated the analysis using different subsets of the euphemism taboo pairs list and found that our result was robust. Our study indicates that in a broad range of settings involving both speech and writing, and with varying degrees of formality, women do not use or form euphemisms more than men.


Shelling the m 1 amplituhedron. The amplituhedron mathcal A n,k,m was introduced by Arkani Hamed and Trnka (2014) in order to give a geometric basis for calculating scattering amplitudes in planar mathcal N 4 supersymmetric Yang Mills theory. It is a projection inside the Grassmannian Gr k,k m of the totally nonnegative part of Gr k,n . Karp and Williams (2019) studied the m 1 amplituhedron mathcal A n,k,1 , giving a regular CW decomposition of it. Its face poset R n,l (with l n k 1 ) consists of all projective sign vectors of length n with exactly l sign changes. We show that R n,l is EL shellable, resolving a problem posed by Karp and Williams. This gives a new proof that mathcal A n,k,1 is homeomorphic to a closed ball, which was originally proved by Karp and Williams. We also give explicit formulas for the f vector and h vector of R n,l , and show that it is rank log concave and strongly Sperner. Finally, we consider a related poset P n,l introduced by Machacek (2019), consisting of all projective sign vectors of length n with at most l sign changes. We show that it is rank log concave, and conjecture that it is Sperner.


Sample efficient Linguistic Generalizations through Program Synthesis Experiments with Phonology Problems. Neural models excel at extracting statistical patterns from large amounts of data, but struggle to learn patterns or reason about language from only a few examples. In this paper, we ask Can we learn explicit rules that generalize well from only a few examples? We explore this question using program synthesis. We develop a synthesis model to learn phonology rules as programs in a domain specific language. We test the ability of our models to generalize from few training examples using our new dataset of problems from the Linguistics Olympiad, a challenging set of tasks that require strong linguistic reasoning ability. In addition to being highly sample efficient, our approach generates human readable programs, and allows control over the generalizability of the learnt programs.


An autonomous compartmental model for accelerating epidemics. In Fall 2020, several European countries reported rapid increases in COVID 19 cases along with growing estimates of the effective reproduction rates. Such an acceleration in epidemic spread is usually attributed to time dependent effects, e.g. human travel, seasonal behavioral changes, mutations of the pathogen etc. In this case however the acceleration occurred when counter measures such as testing and contact tracing exceeded their capacity limit. Considering Austria as an example, here we show that this dynamics can be captured by a time independent, i.e. autonomous, compartmental model that incorporates these capacity limits. In this model, the epidemic acceleration coincides with the exhaustion of mitigation efforts, resulting in an increasing fraction of undetected cases that drive the effective reproduction rate progressively higher. We demonstrate that standard models which does not include this effect necessarily result in a systematic underestimation of the effective reproduction rate.


Detecting AutoAttack Perturbations in the Frequency Domain. Recently, adversarial attacks on image classification networks by the AutoAttack (Croce and Hein, 2020b) framework have drawn a lot of attention. While AutoAttack has shown a very high attack success rate, most defense approaches are focusing on network hardening and robustness enhancements, like adversarial training. This way, the currently best reported method can withstand about 66 of adversarial examples on CIFAR10. In this paper, we investigate the spatial and frequency domain properties of AutoAttack and propose an alternative defense. Instead of hardening a network, we detect adversarial attacks during inference, rejecting manipulated inputs. Based on a rather simple and fast analysis in the frequency domain, we introduce two different detection algorithms. First, a black box detector that only operates on the input images and achieves a detection accuracy of 100 on the AutoAttack CIFAR10 benchmark and 99.3 on ImageNet, for epsilon 8 255 in both cases. Second, a whitebox detector using an analysis of CNN feature maps, leading to a detection rate of also 100 and 98.7 on the same benchmarks.


NumGPT Improving Numeracy Ability of Generative Pre trained Models. Existing generative pre trained language models (e.g., GPT) focus on modeling the language structure and semantics of general texts. However, those models do not consider the numerical properties of numbers and cannot perform robustly on numerical reasoning tasks (e.g., math word problems and measurement estimation). In this paper, we propose NumGPT, a generative pre trained model that explicitly models the numerical properties of numbers in texts. Specifically, it leverages a prototype based numeral embedding to encode the mantissa of the number and an individual embedding to encode the exponent of the number. A numeral aware loss function is designed to integrate numerals into the pre training objective of NumGPT. We conduct extensive experiments on four different datasets to evaluate the numeracy ability of NumGPT. The experiment results show that NumGPT outperforms baseline models (e.g., GPT and GPT with DICE) on a range of numerical reasoning tasks such as measurement estimation, number comparison, math word problems, and magnitude classification. Ablation studies are also conducted to evaluate the impact of pre training and model hyperparameters on the performance.


Navigating the Mise en Page Interpretive Machine Learning Approaches to the Visual Layouts of Multi Ethnic Periodicals. This paper presents a computational method of analysis that draws from machine learning, library science, and literary studies to map the visual layouts of multi ethnic newspapers from the late 19th and early 20th century United States. This work departs from prior approaches to newspapers that focus on individual pieces of textual and visual content. Our method combines Chronicling America's MARC data and the Newspaper Navigator machine learning dataset to identify the visual patterns of newspaper page layouts. By analyzing high dimensional visual similarity, we aim to better understand how editors spoke and protested through the layout of their papers.


Detecting Layout Templates in Complex Multiregion Files. Spreadsheets are among the most commonly used file formats for data management, distribution, and analysis. Their widespread employment makes it easy to gather large collections of data, but their flexible canvas based structure makes automated analysis difficult without heavy preparation. One of the common problems that practitioners face is the presence of multiple, independent regions in a single spreadsheet, possibly separated by repeated empty cells. We define such files as "multiregion" files. In collections of various spreadsheets, we can observe that some share the same layout. We present the Mondrian approach to automatically identify layout templates across multiple files and systematically extract the corresponding regions. Our approach is composed of three phases first, each file is rendered as an image and inspected for elements that could form regions then, using a clustering algorithm, the identified elements are grouped to form regions finally, every file layout is represented as a graph and compared with others to find layout templates. We compare our method to state of the art table recognition algorithms on two corpora of real world enterprise spreadsheets. Our approach shows the best performances in detecting reliable region boundaries within each file and can correctly identify recurring layouts across files.


Interpretable agent communication from scratch (with a generic visual processor emerging on the side). As deep networks begin to be deployed as autonomous agents, the issue of how they can communicate with each other becomes important. Here, we train two deep nets from scratch to perform realistic referent identification through unsupervised emergent communication. We show that the largely interpretable emergent protocol allows the nets to successfully communicate even about object types they did not see at training time. The visual representations induced as a by product of our training regime, moreover, show comparable quality, when re used as generic visual features, to a recent self supervised learning model. Our results provide concrete evidence of the viability of (interpretable) emergent deep net communication in a more realistic scenario than previously considered, as well as establishing an intriguing link between this field and self supervised visual learning.


Rainbow Options under Bayesian MS VAR Process. This paper presents pricing and hedging methods for rainbow options and lookback options under Bayesian Markov Switching Vector Autoregressive (MS VAR) process. Here we assumed that a regime switching process is generated by a homogeneous Markov process. An advantage of our model is it depends on economic variables and simple as compared with previous existing papers.


Garmr Defending the gates of PKU based sandboxing. Memory Protection Keys for Userspace (PKU) is a recent hardware feature that allows programs to assign virtual memory pages to protection domains, and to change domain access permissions using inexpensive, unprivileged instructions. Several in process memory isolation approaches leverage this feature to prevent untrusted code from accessing sensitive program state and data. Typically, PKU based isolation schemes need to be used in conjunction with mitigations such as CFI because untrusted code, when compromised, can otherwise bypass the PKU access permissions using unprivileged instructions or operating system APIs. Recently, researchers proposed fully self contained PKUbased memory isolation schemes that do not rely on other mitigations. These systems use exploit proof call gates to transfer control between trusted and untrusted code, as well as a sandbox that prevents tampering with the PKU infrastructure from untrusted code. In this paper, we show that these solutions are not complete. We first develop two proof of concept attacks against a state of the art PKU based memory isolation scheme. We then present Garmr, a PKU based sandboxing framework that can overcome limitations of existing sandboxes. We apply Garmr to several memory isolation schemes and show that it is practical, efficient and secure.


Do RNN States Encode Abstract Phonological Processes?. Sequence to sequence models have delivered impressive results in word formation tasks such as morphological inflection, often learning to model subtle morphophonological details with limited training data. Despite the performance, the opacity of neural models makes it difficult to determine whether complex generalizations are learned, or whether a kind of separate rote memorization of each morphophonological process takes place. To investigate whether complex alternations are simply memorized or whether there is some level of generalization across related sound changes in a sequence to sequence model, we perform several experiments on Finnish consonant gradation a complex set of sound changes triggered in some words by certain suffixes. We find that our models often though not always encode 17 different consonant gradation processes in a handful of dimensions in the RNN. We also show that by scaling the activations in these dimensions we can control whether consonant gradation occurs and the direction of the gradation.


Multi agent Aerial Monitoring of Moving Convoys using Elliptical Orbits. We propose a novel scheme for surveillance of a dynamic ground convoy moving along a non linear trajectory, by aerial agents that maintain a uniformly spaced formation on a time varying elliptical orbit encompassing the convoy. Elliptical orbits are used as they are more economical than circular orbits for circumnavigating the group of targets in the moving convoy. The proposed scheme includes an algorithm for computing feasible elliptical orbits, a vector guidance law for agent motion along the desired orbit, and a cooperative strategy to control the speeds of the aerial agents in order to quickly achieve and maintain the desired formation. It achieves mission objectives while accounting for linear and angular speed constraints on the aerial agents. The scheme is validated through simulations and actual experiments with a convoy of ground robots and a team of quadrotors as the aerial agents, in a motion capture environment.


Enriching Transformers with Structured Tensor Product Representations for Abstractive Summarization. Abstractive summarization, the task of generating a concise summary of input documents, requires (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, and (2) composing a cohesive text by reconstructing these salient facts into a shorter summary that faithfully reflects the complex relations connecting these facts. In this paper, we adapt TP TRANSFORMER (Schlag et al., 2019), an architecture that enriches the original Transformer (Vaswani et al., 2017) with the explicitly compositional Tensor Product Representation (TPR), for the task of abstractive summarization. The key feature of our model is a structural bias that we introduce by encoding two separate representations for each token to represent the syntactic structure (with role vectors) and semantic content (with filler vectors) separately. The model then binds the role and filler vectors into the TPR as the layer output. We argue that the structured intermediate representations enable the model to take better control of the contents (salient facts) and structures (the syntax that connects the facts) when generating the summary. Empirically, we show that our TP TRANSFORMER outperforms the Transformer and the original TP TRANSFORMER significantly on several abstractive summarization datasets based on both automatic and human evaluations. On several syntactic and semantic probing tasks, we demonstrate the emergent structural information in the role vectors and improved syntactic interpretability in the TPR layer outputs. Code and models are available at https github.com jiangycTarheel TPT Summ.


Explaining Face Presentation Attack Detection Using Natural Language. A large number of deep neural network based techniques have been developed to address the challenging problem of face presentation attack detection (PAD). Whereas such techniques' focus has been on improving PAD performance in terms of classification accuracy and robustness against unseen attacks and environmental conditions, there exists little attention on the explainability of PAD predictions. In this paper, we tackle the problem of explaining PAD predictions through natural language. Our approach passes feature representations of a deep layer of the PAD model to a language model to generate text describing the reasoning behind the PAD prediction. Due to the limited amount of annotated data in our study, we apply a light weight LSTM network as our natural language generation model. We investigate how the quality of the generated explanations is affected by different loss functions, including the commonly used word wise cross entropy loss, a sentence discriminative loss, and a sentence semantic loss. We perform our experiments using face images from a dataset consisting of 1,105 bona fide and 924 presentation attack samples. Our quantitative and qualitative results show the effectiveness of our model for generating proper PAD explanations through text as well as the power of the sentence wise losses. To the best of our knowledge, this is the first introduction of a joint biometrics NLP task. Our dataset can be obtained through our GitHub page.


The Structure of Toxic Conversations on Twitter. Social media platforms promise to enable rich and vibrant conversations online however, their potential is often hindered by antisocial behaviors. In this paper, we study the relationship between structure and toxicity in conversations on Twitter. We collect 1.18M conversations (58.5M tweets, 4.4M users) prompted by tweets that are posted by or mention major news outlets over one year and candidates who ran in the 2018 US midterm elections over four months. We analyze the conversations at the individual, dyad, and group level. At the individual level, we find that toxicity is spread across many low to moderately toxic users. At the dyad level, we observe that toxic replies are more likely to come from users who do not have any social connection nor share many common friends with the poster. At the group level, we find that toxic conversations tend to have larger, wider, and deeper reply trees, but sparser follow graphs. To test the predictive power of the conversational structure, we consider two prediction tasks. In the first prediction task, we demonstrate that the structural features can be used to predict whether the conversation will become toxic as early as the first ten replies. In the second prediction task, we show that the structural characteristics of the conversation are also predictive of whether the next reply posted by a specific user will be toxic or not. We observe that the structural and linguistic characteristics of the conversations are complementary in both prediction tasks. Our findings inform the design of healthier social media platforms and demonstrate that models based on the structural characteristics of conversations can be used to detect early signs of toxicity and potentially steer conversations in a less toxic direction.


New Characterizations of S coherent rings. In this paper, we introduce and study the class S mathcal F ML of S Mittag Leffler modules with respect to all flat modules. We show that a ring R is S coherent if and only if S mathcal F ML is closed under submodules. As an application, we obtain the S version of Chase Theorem a ring R is S coherent if and only if any direct product of R is S flat if and only if any direct product of flat R modules is S flat. Consequently, we provide an answer to the open question proposed by D. Bennis and M. El Hajoui 3 .


Self Supervised Training Enhances Online Continual Learning. In continual learning, a system must incrementally learn from a non stationary data stream without catastrophic forgetting. Recently, multiple methods have been devised for incrementally learning classes on large scale image classification tasks, such as ImageNet. State of the art continual learning methods use an initial supervised pre training phase, in which the first 10 50 of the classes in a dataset are used to learn representations in an offline manner before continual learning of new classes begins. We hypothesize that self supervised pre training could yield features that generalize better than supervised learning, especially when the number of samples used for pre training is small. We test this hypothesis using the self supervised MoCo V2, Barlow Twins, and SwAV algorithms. On ImageNet, we find that these methods outperform supervised pre training considerably for online continual learning, and the gains are larger when fewer samples are available. Our findings are consistent across three online continual learning algorithms. Our best system achieves a 14.95 relative increase in top 1 accuracy on class incremental ImageNet over the prior state of the art for online continual learning.


On superrings of polynomials and algebraically closed multifields. The concept of multialgebraic structure an "algebraic like" structure but endowed with multiple valued operations has been studied since the 1930's in particular, the concept of hyperrings was introduced by Krasner in the 1950's. Some general algebraic study has been made on multialgebras see for instance cite golzio2018brief and cite pelea2006multialgebras . More recently the notion of multiring have obtained more attention a multiring is a lax hyperring, satisfying an weak distributive law, but hyperfields and multifields coincide. Multirings has been studied for applications in abstract quadratic forms theory ( cite marshall2006real , cite worytkiewiczwitt2020witt ) and tropical geometry ( cite jun2015algebraic ) a more detailed account of variants of concept of polynomials over hyperrings is even more recent ( cite jun2015algebraic , cite ameri2019superring ). In the present work we start a model theoretic oriented analysis of multialgebras introducing the class of algebraically closed and providing variant proof of quantifier elimination flavor, based on new results on superring of polynomials ( cite ameri2019superring ).


DEFT Distilling Entangled Factors by Preventing Information Diffusion. Disentanglement is a highly desirable property of representation owing to its similarity to human understanding and reasoning. Many works achieve disentanglement upon information bottlenecks (IB). Despite their elegant mathematical foundations, the IB branch usually exhibits lower performance. In order to provide an insight into the problem, we develop an annealing test to calculate the information freezing point (IFP), which is a transition state to freeze information into the latent variables. We also explore these clues or inductive biases for separating the entangled factors according to the differences in the IFP distributions. We found the existing approaches suffer from the information diffusion problem, according to which the increased information diffuses in all latent variables. Based on this insight, we propose a novel disentanglement framework, termed the distilling entangled factor (DEFT), to address the information diffusion problem by scaling backward information. DEFT applies a multistage training strategy, including multigroup encoders with different learning rates and piecewise disentanglement pressure, to disentangle the factors stage by stage. We evaluate DEFT on three variants of dSprite and SmallNORB, which show low variance and high level disentanglement scores. Furthermore, the experiment under the correlative factors shows incapable of TC based approaches. DEFT also exhibits a competitive performance in the unsupervised setting.


Exposing Previously Undetectable Faults in Deep Neural Networks. Existing methods for testing DNNs solve the oracle problem by constraining the raw features (e.g. image pixel values) to be within a small distance of a dataset example for which the desired DNN output is known. But this limits the kinds of faults these approaches are able to detect. In this paper, we introduce a novel DNN testing method that is able to find faults in DNNs that other methods cannot. The crux is that, by leveraging generative machine learning, we can generate fresh test inputs that vary in their high level features (for images, these include object shape, location, texture, and colour). We demonstrate that our approach is capable of detecting deliberately injected faults as well as new faults in state of the art DNNs, and that in both cases, existing methods are unable to find these faults.


Estimating Phase Aberration from Noisy Radiofrequency Data of a single frame of Synthetic Aperture Ultrasound Image. Phase aberration is one of the main contributors to image degradation in ultrasound imaging. Normalized Cross Correlation (NCC) is one of the most extensively studied techniques to estimate the arrival delay error and the aberration profile. textit However, the performance of NCC can be compromised when the data have a poor signal to noise ratio. Here we propose an iterative filtered NCC (f NCC) method to estimate phase aberration in speckle regions from the noisy radio frequency data of a single frame of synthetic transmit aperture (STA) image. First, two dimensional filters were applied in the aperture and temporal domains to suppress noise and off axis signals in the transmit beamformed data from an arbitrary speckle region. Second, an iterative method that included the phase aberration in both the transmission and receiving process was used to estimate the phase aberration. Third, the estimation were improved by correcting the edge effect with an iterative zero padding technique. Last, in the experimental study, we proposed and validated a formula to estimate the arrival time error caused by a sound speed error. The results from both the numerical simulations and experimental studies confirm that the proposed filtered NCC method can estimate the phase aberration profile correctly from noisy STA RF data in a speckle region. Image quality in terms of contrast, resolution and image signal to noise ratio was improved. Potential applications of the proposed method to map local speed of samples are also discussed.


An Efficient and Secure Location based Alert Protocol using Searchable Encryption and Huffman Codes. Location data are widely used in mobile apps, ranging from location based recommendations, to social media and navigation. A specific type of interaction is that of location based alerts, where mobile users subscribe to a service provider (SP) in order to be notified when a certain event occurs nearby. Consider, for instance, the ongoing COVID 19 pandemic, where contact tracing has been singled out as an effective means to control the virus spread. Users wish to be notified if they came in proximity to an infected individual. However, serious privacy concerns arise if the users share their location history with the SP in plaintext. To address privacy, recent work proposed several protocols that can securely implement location based alerts. The users upload their encrypted locations to the SP, and the evaluation of location predicates is done directly on ciphertexts. When a certain individual is reported as infected, all matching ciphertexts are found (e.g., according to a predicate such as "10 feet proximity to any of the locations visited by the infected patient in the last week"), and the corresponding users notified. However, there are significant performance issues associated with existing protocols. The underlying searchable encryption primitives required to perform the matching on ciphertexts are expensive, and without a proper encoding of locations and search predicates, the performance can degrade a lot. In this paper, we propose a novel method for variable length location encoding based on Huffman codes. By controlling the length required to represent encrypted locations and the corresponding matching predicates, we are able to significantly speed up performance. We provide a theoretical analysis of the gain achieved by using Huffman codes, and we show through extensive experiments that the improvement compared with fixed length encoding methods is substantial.


Improving Automated Visual Fault Detection by Combining a Biologically Plausible Model of Visual Attention with Deep Learning. It is a long term goal to transfer biological processing principles as well as the power of human recognition into machine vision and engineering systems. One of such principles is visual attention, a smart human concept which focuses processing on a part of a scene. In this contribution, we utilize attention to improve the automatic detection of defect patterns for wafers within the domain of semiconductor manufacturing. Previous works in the domain have often utilized classical machine learning approaches such as KNNs, SVMs, or MLPs, while a few have already used modern approaches like deep neural networks (DNNs). However, one problem in the domain is that the faults are often very small and have to be detected within a larger size of the chip or even the wafer. Therefore, small structures in the size of pixels have to be detected in a vast amount of image data. One interesting principle of the human brain for solving this problem is visual attention. Hence, we employ here a biologically plausible model of visual attention for automatic visual inspection. We propose a hybrid system of visual attention and a deep neural network. As demonstrated, our system achieves among other decisive advantages an improvement in accuracy from 81 to 92 , and an increase in accuracy for detecting faults from 67 to 88 . Hence, the error rates are reduced from 19 to 8 , and notably from 33 to 12 for detecting a fault in a chip. These results show that attention can greatly improve the performance of visual inspection systems. Furthermore, we conduct a broad evaluation, identifying specific advantages of the biological attention model in this application, and benchmarks standard deep learning approaches as an alternative with and without attention. This work is an extended arXiv version of the original conference article published in "IECON 2020", which has been extended regarding visual attention.


Motion and clustering of bonded particles in narrow solid liquid fluidized beds. This paper presents an experimental and numerical investigation of solid liquid fluidized beds consisting of bonded spheres in very narrow tubes, i.e., when the ratio between the tube and grain diameters is small. In narrow beds, high confinement effects have proved to induce crystallization, jamming and different patterns, which can be intensified or modified if some grains are bonded together. In order to investigate that, we produced duos and trios of bonded aluminum spheres with diameter of 4.8 mm, and formed beds consisting either of 150 300 duos or 100 200 trios in a 25.4 mm ID pipe, which were submitted to water velocities above those necessary for fluidization. For the experiments, we filmed the bed with high speed and conventional cameras and processed the images, obtaining measurements at both the bed and grain scales. For the numerical part, we computed the bed evolution for the same conditions with a CFD DEM (computational fluid dynamics discrete element method) code. Our results show distinct motions for individual duos and trios, and different structures within the bed. We also found that jamming may occur suddenly for trios, where even the microscopic motion (fluctuation at the grain scale) stops, calling into question the fluidization conditions for those cases.


Entropy stable discontinuous Galerkin difference methods for hyperbolic conservation laws. The paper describes the construction of entropy stable discontinuous Galerkin difference (DGD) discretizations for hyperbolic conservation laws on unstructured grids. The construction takes advantage of existing theory for entropy stable summation by parts (SBP) discretizations. In particular, the paper shows how DGD discretizations both linear and nonlinear can be constructed by defining the SBP trial and test functions in terms of interpolated DGD degrees of freedom. In the case of entropy stable discretizations, the entropy variables rather than the conservative variables must be interpolated to the SBP nodes. A fully discrete entropy stable scheme is obtained by adopting the relaxation Runge Kutta version of the midpoint method. In addition, DGD matrix operators for the first derivative are shown to be dense norm SBP operators. Numerical results are presented to verify the accuracy and entropy stability of the DGD discretization in the context of the Euler equations. The results suggest that DGD and SBP solution errors are similar for the same number of degrees of freedom. Finally, an investigation of the DGD spectra shows that spectral radius is relatively insensitive to discretization order however, the high order methods do suffer from the linear instability reported for other entropy stable discretizations.


Evolutionary Computation Assisted Brainwriting for Large Scale Online Ideation. Brainstorming is an effective technique for offline ideation although the number of participants able to join an ideation session and suggest ideas is limited. To increase the diversity and quality of the ideas suggested, many participants with various backgrounds should be able to join the session. We have devised an evolutionary computation assisted brainwriting method for large scale online ideation. In this method, participants not only suggest ideas but also evaluate ideas previously suggested by other participants. The evaluation results are used in the evolutionary computation to identify good ideas to which the participants can be exposed via a brainwriting like interface. We compared the performance of the proposed method with that of a simple online brainwriting method for large scale online ideation with more than 30 participants. The proposed method enhanced robustness of idea quality improvement due to preferentially exposing the participants to good ideas.


Higher spectral sequences. In this article we construct what we call a higher spectral sequence for any chain complex (or topological space) that is filtered in n compatible ways. For this we extend the previous spectral system construction of the author, and we show that it admits considerably more differentials than what was previously known. As a result, this endows the successive Leray Serre, Grothendieck, chromatic Adams Novikov, and Eilenberg Moore spectral sequences of the author with the structure of a higher spectral sequence. Another application is a universal coefficient theorem analog for spectral sequences.


An AGM Approach to Revising Preferences. We look at preference change arising out of an interaction between two elements the first is an initial preference ranking encoding a pre existing attitude the second element is new preference information signaling input from an authoritative source, which may come into conflict with the initial preference. The aim is to adjust the initial preference and bring it in line with the new preference, without having to give up more information than necessary. We model this process using the formal machinery of belief change, along the lines of the well known AGM approach. We propose a set of fundamental rationality postulates, and derive the main results of the paper a set of representation theorems showing that preference change according to these postulates can be rationalized as a choice function guided by a ranking on the comparisons in the initial preference order. We conclude by presenting operators satisfying our proposed postulates. Our approach thus allows us to situate preference revision within the larger family of belief change operators.


Human factors engineering research on single pilot operations for large commercial aircraft Status and prospect. The civil aviation community is actively exploring and developing the solutions of single pilot operations SPO for large commercial aircraft. Human factors engineering research for SPO has been launched, and the research mainly focuses on three research solutions flight deck airborne equipment upgrade, flight support from ground stations, and the combined SPO solution of "flight deck airborne equipment upgrade, flight support from ground stations". This paper reviews and analyzez the progress of human factors engineering research on SPO. The preliminary research outcome tends to support the combined SPO solution. However, the current human factors engineering research is not comprehensive and cannot provide a complete human factors engineering solution for SPO. For future human factors engineering research, this paper analyzes the key human factors issues on SPO and points out the gaps in the current research and the areas for future work. Finally, this paper puts forward an overall strategy and recommendations for future human factors engineering research on SPO.


Cross layer Navigation Convolutional Neural Network for Fine grained Visual Classification. Fine grained visual classification (FGVC) aims to classify sub classes of objects in the same super class (e.g., species of birds, models of cars). For the FGVC tasks, the essential solution is to find discriminative subtle information of the target from local regions. TraditionalFGVC models preferred to use the refined features,i.e., high level semantic information for recognition and rarely use low level in formation. However, it turns out that low level information which contains rich detail information also has effect on improving performance. Therefore, in this paper, we propose cross layer navigation convolutional neural network for feature fusion. First, the feature maps extracted by the backbone network are fed into a convolutional long short term memory model sequentially from high level to low level to perform feature aggregation. Then, attention mechanisms are used after feature fusion to extract spatial and channel information while linking the high level semantic information and the low level texture features, which can better locate the discriminative regions for the FGVC. In the experiments, three commonly used FGVC datasets, including CUB 200 2011, Stanford Cars, andFGVC Aircraft datasets, are used for evaluation and we demonstrate the superiority of the proposed method by comparing it with other referred FGVC methods to show that this method achieves superior results.


Birational classification for algebraic tori. We give a stably birational classification for algebraic tori of dimensions 3 and 4 over a field k . First, we define the weak stably equivalence of algebraic tori and show that there exist 13 (resp. 128 ) weak stably equivalent classes of algebraic tori T of dimension 3 (resp. 4 ) which are not stably rational by computing some cohomological stably birational invariants, e.g. the Brauer Grothendieck group of X where X is a smooth compactification of T , provided by Kunyavskii, Skorobogatov and Tsfasman. We make a procedure to compute such stably birational invariants effectively and the computations are done by using the computer algebra system GAP. Second, we define the p part of the flabby class hat T fl as a Z p Sy p(G) lattice and prove that they are faithful and indecomposable Z p Sy p(G) lattices unless it vanishes for p 2 (resp. p 2,3 ) in dimension 3 (resp. 4 ). The Z p ranks of them are also given. Third, we give a necessary and sufficient condition for which two not stably rational algebraic tori T and T prime of dimensions 3 (resp. 4 ) are stably birationally equivalent in terms of the splitting fields and the weak stably equivalent classes of T and T prime . In particular, the splitting fields of them should coincide if hat T and hat T prime are indecomposable. Forth, for each 7 cases of not stably but retract rational algebraic tori of dimension 4 , we find an algebraic torus T prime of dimension 4 which satisfies that T times k T prime is stably rational. Finally, we give a criteria to determine whether two algebraic tori T and T prime of general dimensions are stably birationally equivalent when T (resp. T prime ) is stably birationally equivalent to some algebraic torus of dimension up to 4 .


The Case for High Accuracy Classification Think Small, Think Many!. To facilitate implementation of high accuracy deep neural networks especially on resource constrained devices, maintaining low computation requirements is crucial. Using very deep models for classification purposes not only decreases the neural network training speed and increases the inference time, but also need more data for higher prediction accuracy and to mitigate false positives. In this paper, we propose an efficient and lightweight deep classification ensemble structure based on a combination of simple color features, which is particularly designed for "high accuracy" image classifications with low false positives. We designed, implemented, and evaluated our approach for explosion detection use case applied to images and videos. Our evaluation results based on a large test test show considerable improvements on the prediction accuracy compared to the popular ResNet 50 model, while benefiting from 7.64x faster inference and lower computation cost. While we applied our approach to explosion detection, our approach is general and can be applied to other similar classification use cases as well. Given the insight gained from our experiments, we hence propose a "think small, think many" philosophy in classification scenarios that transforming a single, large, monolithic deep model into a verification based step model ensemble of multiple small, simple, lightweight models with narrowed down color spaces can possibly lead to predictions with higher accuracy.


Node Proximity Is All You Need Unified Structural and Positional Node and Graph Embedding. While most network embedding techniques model the relative positions of nodes in a network, recently there has been significant interest in structural embeddings that model node role equivalences, irrespective of their distances to any specific nodes. We present PhUSION, a proximity based unified framework for computing structural and positional node embeddings, which leverages well established methods for calculating node proximity scores. Clarifying a point of contention in the literature, we show which step of PhUSION produces the different kinds of embeddings and what steps can be used by both. Moreover, by aggregating the PhUSION node embeddings, we obtain graph level features that model information lost by previous graph feature learning and kernel methods. In a comprehensive empirical study with over 10 datasets, 4 tasks, and 35 methods, we systematically reveal successful design choices for node and graph level machine learning with embeddings.


Tight Compression Compressing CNN Through Fine Grained Pruning and Weight Permutation for Efficient Implementation. The unstructured sparsity after pruning poses a challenge to the efficient implementation of deep learning models in existing regular architectures like systolic arrays. On the other hand, coarse grained structured pruning is suitable for implementation in regular architectures but tends to have higher accuracy loss than unstructured pruning when the pruned models are of the same size. In this work, we propose a model compression method based on a novel weight permutation scheme to fully exploit the fine grained weight sparsity in the hardware design. Through permutation, the optimal arrangement of the weight matrix is obtained, and the sparse weight matrix is further compressed to a small and dense format to make full use of the hardware resources. Two pruning granularities are explored. In addition to the unstructured weight pruning, we also propose a more fine grained subword level pruning to further improve the compression performance. Compared to the state of the art works, the matrix compression rate is significantly improved from 5.88x to 14.13x. As a result, the throughput and energy efficiency are improved by 2.75 and 1.86 times, respectively.


The equivariant inverse Kazhdan Lusztig polynomials of uniform matroids. Motivated by the concepts of the inverse Kazhdan Lusztig polynomial and the equivariant Kazhdan Lusztig polynomial, Proudfoot defined the equivariant inverse Kazhdan Lusztig polynomial for a matroid. In this paper, we show that the equivariant inverse Kazhdan Lusztig polynomial of a matroid is very useful for determining its equivariant Kazhdan Lusztig polynomials, and we determine the equivariant inverse Kazhdan Lusztig polynomials for Boolean matroids and uniform matroids. As an application, we give a new proof of Gedeon, Proudfoot and Young's formula for the equivariant Kazhdan Lusztig polynomials of uniform matroids. Inspired by Lee, Nasr and Radcliffe's combinatorial interpretation for the ordinary Kazhdan Lusztig polynomials of uniform matroids, we further present a new formula for the corresponding equivariant Kazhdan Lusztig polynomials.


The Chow rings of moduli spaces of elliptic surfaces over mathbb P 1 . Let E N denote the coarse moduli space of smooth elliptic surfaces over mathbb P 1 with fundamental invariant N . We compute the Chow ring A (E N) for N geq 2 . For each N geq 2 , A (E N) is Gorenstein with socle in codimension 16 , which is surprising in light of the fact that the dimension of E N is 10N 2 . As an application, we show that the maximal dimension of a complete subvariety of E N is 16 . When N 2 , the corresponding elliptic surfaces are K3 surfaces polarized by a hyperbolic lattice U . We show that the generators for A (E 2) are tautological classes on the moduli space mathcal F U of U polarized K3 surfaces, which provides evidence for a conjecture of Oprea and Pandharipande on the tautological rings of moduli spaces of lattice polarized K3 surfaces.


AcME Accelerated Model agnostic Explanations Fast Whitening of the Machine Learning Black Box. In the context of human in the loop Machine Learning applications, like Decision Support Systems, interpretability approaches should provide actionable insights without making the users wait. In this paper, we propose Accelerated Model agnostic Explanations (AcME), an interpretability approach that quickly provides feature importance scores both at the global and the local level. AcME can be applied a posteriori to each regression or classification model. Not only does AcME compute feature ranking, but it also provides a what if analysis tool to assess how changes in features values would affect model predictions. We evaluated the proposed approach on synthetic and real world datasets, also in comparison with SHapley Additive exPlanations (SHAP), the approach we drew inspiration from, which is currently one of the state of the art model agnostic interpretability approaches. We achieved comparable results in terms of quality of produced explanations while reducing dramatically the computational time and providing consistent visualization for global and local interpretations. To foster research in this field, and for the sake of reproducibility, we also provide a repository with the code used for the experiments.


Improved detection of small objects in road network sequences. The vast number of existing IP cameras in current road networks is an opportunity to take advantage of the captured data and analyze the video and detect any significant events. For this purpose, it is necessary to detect moving vehicles, a task that was carried out using classical artificial vision techniques until a few years ago. Nowadays, significant improvements have been obtained by deep learning networks. Still, object detection is considered one of the leading open issues within computer vision. The current scenario is constantly evolving, and new models and techniques are appearing trying to improve this field. In particular, new problems and drawbacks appear regarding detecting small objects, which correspond mainly to the vehicles that appear in the road scenes. All this means that new solutions that try to improve the low detection rate of small elements are essential. Among the different emerging research lines, this work focuses on the detection of small objects. In particular, our proposal aims to vehicle detection from images captured by video surveillance cameras. In this work, we propose a new procedure for detecting small scale objects by applying super resolution processes based on detections performed by convolutional neural networks emph (CNN) . The neural network is integrated with processes that are in charge of increasing the resolution of the images to improve the object detection performance. This solution has been tested for a set of traffic images containing elements of different scales to test the efficiency according to the detections obtained by the model, thus demonstrating that our proposal achieves good results in a wide range of situations.


Intraday trading strategy based on time series and machine learning for Chinese stock market. This article comes up with an intraday trading strategy under T 1 using Markowitz optimization and Multilayer Perceptron (MLP) with published stock data obtained from the Shenzhen Stock Exchange and Shanghai Stock Exchange. The empirical results reveal the profitability of Markowitz portfolio optimization and validate the intraday stock price prediction using MLP. The findings further combine the Markowitz optimization, an MLP with the trading strategy, to clarify this strategy's feasibility.


Exact solution of network flow models with strong relaxations. We address the solution of Mixed Integer Linear Programming (MILP) models with strong relaxations that are derived from Dantzig Wolfe decompositions and allow a pseudo polynomial pricing algorithm. We exploit their network flow characterization and provide a framework based on column generation, reduced cost variable fixing, and a highly asymmetric branching scheme that allows us to take advantage of the potential of the current MILP solvers. We apply our framework to a variety of cutting and packing problems from the literature. The efficiency of the framework is proved by extensive computational experiments, in which a significant number of open instances could be solved to proven optimality for the first time.


Process Extraction from Text state of the art and challenges for the future. Automatic Process Discovery aims at developing algorithmic methodologies for the extraction and elicitation of process models as described in data. While Process Discovery from event log data is a well established area, that has already moved from research to concrete adoption in a mature manner, Process Discovery from text is still a research area at an early stage of development, which rarely scales to real world documents. In this paper we analyze, in a comparative manner, reference state of the art literature, especially for what concerns the techniques used, the process elements extracted and the evaluations performed. As a result of the analysis we discuss important limitations that hamper the exploitation of recent Natural Language Processing techniques in this field and we discuss fundamental limitations and challenges for the future concerning the datasets, the techniques, the experimental evaluations, and the pipelines currently adopted and to be developed in the future.


Fast Barycentric Based Evaluation Over Spectral hp Elements. As the use of spectral hp element methods, and high order finite element methods in general, continues to spread, community efforts to create efficient, optimized algorithms associated with fundamental high order operations have grown. Core tasks such as solution expansion evaluation at quadrature points, stiffness and mass matrix generation, and matrix assembly have received tremendousattention. With the expansion of the types of problems to which high order methods are applied, and correspondingly the growth in types of numerical tasks accomplished through high order methods, the number and types of these core operations broaden. This work focuses on solution expansion evaluation at arbitrary points within an element. This operation is core to many postprocessing applications such as evaluation of streamlines and pathlines, as well as to field projection techniques such as mortaring. We expand barycentric interpolation techniques developed on an interval to 2D (triangles and quadrilaterals) and 3D (tetrahedra, prisms, pyramids, and hexahedra) spectral hp element methods. We provide efficient algorithms for their implementations, and demonstrate their effectiveness using the spectral hp element library Nektar .


BLE Beacons in the Smart City Applications, Challenges, and Research Opportunities. The Internet of Things helps to have every individual interconnected with their surroundings and to interact with them through smart devices. In recent years, Bluetooth Low Energy (BLE) technology has become very popular in smart infrastructures, the medical field, the retail industry, and many more areas due to its availability in a plethora of wireless devices. BLE is widely used in IoT devices, such as smartphones, smart watches, and BLE beacons. Beacons are small, low cost, and low power wireless transmitters that bring attention to their location by broadcasting a signal with a unique identifier at regular intervals. BLE beacons are a promising solution for many smart city applications, from proximity marketing to indoor navigation. However, they do pose security and privacy challenges. This work discusses the characteristics of BLE beacons, the applications that can benefit from them, and the challenges they pose while trying to identify research opportunities and future directions.


Some homological properties of Borel type ideals. We study ideals of Borel type, including k Borel ideals and t spread Veronese ideals. We determine their free resolutions and their homological shift ideals. The multiplicity and the analytic spread of equigenerated squarefree principal Borel ideals are computed. For the multiplicity, the result is given under an additional assumption which is always satisfied for squarefree principal Borel ideals. These results are used to analyze the behaviour of height, multiplicity and analytic spread of the homological shift ideals HS j(I) as functions of j , when I is an equigenerated squarefree Borel ideal.


Mirror Symmetry of Calabi Yau Manifolds Fibered by (1,8) Polarized Abelian Surfaces. We study mirror symmetry of a family of Calabi Yau manifolds fibered by (1,8) polarized abelian surfaces with Euler characteristic zero. By describing the parameter space globally, we find all expected boundary points (LCSLs), including those correspond to Fourier Mukai partners. Applying mirror symmetry at each boundary point, we calculate Gromov Witten invariants ( g leq2 ) and observe nice (quasi )modular properties in their potential functions. We also describe degenerations of Calabi Yau manifolds over each boundary point.


On the expressive power of Lukasiewicz's square operator. The aim of the paper is to analyze the expressive power of the square operator of Lukasiewicz logic ast x x odot x , where odot is the strong Lukasiewicz conjunction. In particular, we aim at understanding and characterizing those cases in which the square operator is enough to construct a finite MV chain from a finite totally ordered set endowed with an involutive negation. The first of our main results shows that, indeed, the whole structure of MV chain can be reconstructed from the involution and the Lukasiewicz square if and only if the obtained structure has only trivial subalgebras and, equivalently, if and only if the cardinality of the starting chain is of the form n 1 where n belongs to a class of prime numbers that we fully characterize. Secondly, we axiomatize the algebraizable matrix logic whose semantics is given by the variety generated by a finite totally ordered set endowed with an involutive negation and Lukasiewicz's square operator. Finally, we propose an alternative way to account for Lukasiewicz square operator on involutive G "odel chains. In this setting, we show that such an operator can be captured by a rather intuitive set of equations.


Semantic Segmentation of Remote Sensing Images with Sparse Annotations. Training Convolutional Neural Networks (CNNs) for very high resolution images requires a large quantity of high quality pixel level annotations, which is extremely labor and time consuming to produce. Moreover, professional photo interpreters might have to be involved for guaranteeing the correctness of annotations. To alleviate such a burden, we propose a framework for semantic segmentation of aerial images based on incomplete annotations, where annotators are asked to label a few pixels with easy to draw scribbles. To exploit these sparse scribbled annotations, we propose the FEature and Spatial relaTional regulArization (FESTA) method to complement the supervised task with an unsupervised learning signal that accounts for neighbourhood structures both in spatial and feature terms.


On the 3 colorable subgroup mathcal F and maximal subgroups of Thompson's group F . In his work on representations of Thompson's group F , Vaughan Jones defined and studied the 3 colorable subgroup mathcal F of F . Later, Ren showed that it is isomorphic with the Brown Thompson group F 4 . In this paper we continue with the study of the 3 colorable subgroup and prove that the quasi regular representation of F associated with the 3 colorable subgroup is irreducible. We show moreover that the preimage of mathcal F under a certain injective endomorphism of F is contained in three (explicit) maximal subgroups of F of infinite index. These subgroups are different from the previously known infinite index maximal subgroups of F , namely the parabolic subgroups that fix a point in (0,1) , (up to isomorphism) the Jones' oriented subgroup vec F , and the explicit examples found by Golan.


Graph Feature Gating Networks. Graph neural networks (GNNs) have received tremendous attention due to their power in learning effective representations for graphs. Most GNNs follow a message passing scheme where the node representations are updated by aggregating and transforming the information from the neighborhood. Meanwhile, they adopt the same strategy in aggregating the information from different feature dimensions. However, suggested by social dimension theory and spectral embedding, there are potential benefits to treat the dimensions differently during the aggregation process. In this work, we investigate to enable heterogeneous contributions of feature dimensions in GNNs. In particular, we propose a general graph feature gating network (GFGN) based on the graph signal denoising problem and then correspondingly introduce three graph filters under GFGN to allow different levels of contributions from feature dimensions. Extensive experiments on various real world datasets demonstrate the effectiveness and robustness of the proposed frameworks.


Identification of Biased Terms in News Articles by Comparison of Outlet specific Word Embeddings. Slanted news coverage, also called media bias, can heavily influence how news consumers interpret and react to the news. To automatically identify biased language, we present an exploratory approach that compares the context of related words. We train two word embedding models, one on texts of left wing, the other on right wing news outlets. Our hypothesis is that a word's representations in both word embedding spaces are more similar for non biased words than biased words. The underlying idea is that the context of biased words in different news outlets varies more strongly than the one of non biased words, since the perception of a word as being biased differs depending on its context. While we do not find statistical significance to accept the hypothesis, the results show the effectiveness of the approach. For example, after a linear mapping of both word embeddings spaces, 31 of the words with the largest distances potentially induce bias. To improve the results, we find that the dataset needs to be significantly larger, and we derive further methodology as future research direction. To our knowledge, this paper presents the first in depth look at the context of bias words measured by word embeddings.


Simulation Scenarios in One Dimensional Self Gravitating System. We study and compare different numerical differential equation solvers on the basis of numerical complexity, energy conservation, and stable solution in phase space for the Simple Harmonic Oscillation (SHM) problem. We conclude and show that the Leapfrog method is the best for our problem. We solve Poisson's equation in gravity on the computation grid by the finite difference method and Fourier method. We solve Poisson's equation for source not in a grid point by cloud in cell method. Finally, we simulate one dimensional self gravitating system and show the evolution of the system via phase space trajectories.


On families of cubic split Thue equations parametrised by linear recurrence sequences. We show that the split family of cubic Thue Equations X(X A nY)(X B nY) Y 3 pm 1, with linear recurrence sequences A n, B n satisfying a dominant root condition each, has but the trivial solutions when the parameter n is smaller than an effectively computable constant.


Towards an AI Coach to Infer Team Mental Model Alignment in Healthcare. Shared mental models are critical to team success however, in practice, team members may have misaligned models due to a variety of factors. In safety critical domains (e.g., aviation, healthcare), lack of shared mental models can lead to preventable errors and harm. Towards the goal of mitigating such preventable errors, here, we present a Bayesian approach to infer misalignment in team members' mental models during complex healthcare task execution. As an exemplary application, we demonstrate our approach using two simulated team based scenarios, derived from actual teamwork in cardiac surgery. In these simulated experiments, our approach inferred model misalignment with over 75 recall, thereby providing a building block for enabling computer assisted interventions to augment human cognition in the operating room and improve teamwork.


On the polyanalytic short time Fourier transform in the quaternionic setting. In this paper, we consider a quaternionic short time Fourier transform (QSTFT) with normalized Hermite functions as windows. It turns out that such a transform is based on the recent theory of slice polyanalytic functions on quaternions. Indeed, we will use the notions of true and full slice polyanalytic Fock spaces and Segal Bargmann transforms. We prove new properties of this QSTFT including a Moyal formula, a reconstruction formula and a Lieb's uncertainty principle. These results extend a recent paper of the authors which studies a QSTFT having a Gaussian function as a window.


Presentation Attack Detection Methods based on Gaze Tracking and Pupil Dynamic A Comprehensive Survey. Purpose of the research In the biometric community, visible human characteristics are popular and viable for verification and identification on mobile devices. However, imposters are able to spoof such characteristics by creating fake and artificial biometrics to fool the system. Visible biometric systems have suffered a high security risk of presentation attack. Methods In the meantime, challenge based methods, in particular, gaze tracking and pupil dynamic appear to be more secure methods than others for contactless biometric systems. We review the existing work that explores gaze tracking and pupil dynamic liveness detection. The principal results This research analyzes various aspects of gaze tracking and pupil dynamic presentation attacks, such as state of the art liveness detection algorithms, various kinds of artifacts, the accessibility of public databases, and a summary of standardization in this area. In addition, we discuss future work and the open challenges to creating a secure liveness detection based on challenge based systems.


Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updating. Vertical federated learning (VFL) attracts increasing attention due to the emerging demands of multi party collaborative modeling and concerns of privacy leakage. In the real VFL applications, usually only one or partial parties hold labels, which makes it challenging for all parties to collaboratively learn the model without privacy leakage. Meanwhile, most existing VFL algorithms are trapped in the synchronous computations, which leads to inefficiency in their real world applications. To address these challenging problems, we propose a novel bf VF L framework integrated with new bf b ackward updating mechanism and bf b ilevel asynchronous parallel architecture (VF textbf B 2 ), under which three new algorithms, including VF textbf B 2 SGD, SVRG, and SAGA, are proposed. We derive the theoretical results of the convergence rates of these three algorithms under both strongly convex and nonconvex conditions. We also prove the security of VF textbf B 2 under semi honest threat models. Extensive experiments on benchmark datasets demonstrate that our algorithms are efficient, scalable and lossless.


Optimal controller synthesis for timed systems. Weighted timed games are zero sum games played by two players on a timed automaton equipped with weights, where one player wants to minimise the cumulative weight while reaching a target. Used in a reactive synthesis perspective, this quantitative extension of timed games allows one to measure the quality of controllers in real time systems. Weighted timed games are notoriously difficult and quickly undecidable, even when restricted to non negative weights. For non negative weights, the largest class that can be analysed has been introduced by Bouyer, Jaziri and Markey in 2015. Though the value problem is undecidable, the authors show how to approximate the value by considering regions with a refined granularity. In this work, we extend this class to incorporate negative weights, allowing one to model energy for instance, and prove that the value can still be approximated, with the same complexity. A small restriction also allows us to obtain a class of decidable weighted timed games with negative weights and an arbitrary number of clocks. In addition, we show that a symbolic algorithm, relying on the paradigm of value iteration, can be used as an approximation computation schema over these classes. We also consider the special case of untimed weighted games, where the same fragments are solvable in polynomial time this contrasts with the pseudo polynomial complexity, known so far, for weighted games without restrictions.


An isomorphism theorem for models of Weak K "onig's Lemma without primitive recursion. We prove that if (M, mathcal X ) and (M, mathcal Y ) are countable models of the theory mathrm WKL 0 such that mathrm I Sigma 1(A) fails for some A in mathcal X cap mathcal Y , then (M, mathcal X ) and (M, mathcal Y ) are isomorphic. As a consequence, the analytic hierarchy collapses to Delta 1 1 provably in mathrm WKL 0 neg mathrm I Sigma 0 1 , and mathrm WKL is the strongest Pi 1 2 statement that is Pi 1 1 conservative over mathrm RCA 0 neg mathrm I Sigma 0 1 . Applying our results to the Delta 0 n definable sets in models of mathrm RCA 0 mathrm B Sigma 0 n neg mathrm I Sigma 0 n that also satisfy an appropriate relativization of Weak K "onig's Lemma, we prove that for each n ge 1 , the set of Pi 1 2 sentences that are Pi 1 1 conservative over mathrm RCA 0 mathrm B Sigma 0 n neg mathrm I Sigma 0 n is c.e. In contrast, we prove that the set of Pi 1 2 sentences that are Pi 1 1 conservative over mathrm RCA 0 mathrm B Sigma 0 n is Pi 2 complete. This answers a question of Towsner. We also show that mathrm RCA 0 mathrm RT 2 2 is Pi 1 1 conservative over mathrm B Sigma 0 2 if and only if it is conservative over mathrm B Sigma 0 2 with respect to forall Pi 0 5 sentences.


Complete characterization of the minimal ABC trees. The problem of characterizing trees with minimal atom bond connectivity index (minimal ABC trees) has a reputation as one of the most demanding recent open optimization problems in mathematical chemistry. Here firstly, we give an affirmative answer to the conjecture, which states that enough large minimal ABC trees are comprised solely of a root vertex and so called D z and D z 1 branches. Based on the presented theoretical results here and some already known results, we obtain enough constraints to reduce the search space and solve the optimization problem, and thus, determine exactly the minimal ABC trees of a given arbitrary order.


Prediction and Comparative Analysis of CTCF Binding Sites based on a First Principle Approach. We calculated the patterns for the CCCTC transcription factor (CTCF) binding sites across many genomes on a first principle approach. The validation of the first principle method was done on the human as well as on the mouse genome. The predicted human CTCF binding sites are consistent with the consensus sequence, ChIP seq data for the K562 cell, nucleosome positions for IMR90 cell as well as the CTCF binding sites in the mouse HOXA gene. The analysis of Homo sapiens, Mus musculus, Sus scrofa, Capra hircus and Drosophila melanogaster whole genomes shows binding sites are organized in cluster like groups, where two consecutive sites obey a power law with coefficient ranging from to 0.3292 pm0.0068 to 0.5409 pm0.0064 the distance between these groups varies from 18.08 pm0.52 kbp to 42.1 pm2.0 kbp. The genome of Aedes aegypti does not show a power law, but 19.9 of binding sites are 144 pm4 and 287 pm5 bp distant of each other. We run negative tests, confirming the under representation of CTCF binding sites in Caenorhabditis elegans, Plasmodium falciparum and Arabidopsis thaliana complete genomes.


Deconstructing Categorization in Visualization Recommendation A Taxonomy and Comparative Study. Visualization recommendation (VisRec) systems provide users with suggestions for potentially interesting and useful next steps during exploratory data analysis. These recommendations are typically organized into categories based on their analytical actions, i.e., operations employed to transition from the current exploration state to a recommended visualization. However, despite the emergence of a plethora of VisRec systems in recent work, the utility of the categories employed by these systems in analytical workflows has not been systematically investigated. Our paper explores the efficacy of recommendation categories by formalizing a taxonomy of common categories and developing a system, Frontier, that implements these categories. Using Frontier, we evaluate workflow strategies adopted by users and how categories influence those strategies. Participants found recommendations that add attributes to enhance the current visualization and recommendations that filter to sub populations to be comparatively most useful during data exploration. Our findings pave the way for next generation VisRec systems that are adaptive and personalized via carefully chosen, effective recommendation categories.


TempoQR Temporal Question Reasoning over Knowledge Graphs. Knowledge Graph Question Answering (KGQA) involves retrieving facts from a Knowledge Graph (KG) using natural language queries. A KG is a curated set of facts consisting of entities linked by relations. Certain facts include also temporal information forming a Temporal KG (TKG). Although many natural questions involve explicit or implicit time constraints, question answering (QA) over TKGs has been a relatively unexplored area. Existing solutions are mainly designed for simple temporal questions that can be answered directly by a single TKG fact. This paper puts forth a comprehensive embedding based framework for answering complex questions over TKGs. Our method termed temporal question reasoning (TempoQR) exploits TKG embeddings to ground the question to the specific entities and time scope it refers to. It does so by augmenting the question embeddings with context, entity and time aware information by employing three specialized modules. The first computes a textual representation of a given question, the second combines it with the entity embeddings for entities involved in the question, and the third generates question specific time embeddings. Finally, a transformer based encoder learns to fuse the generated temporal information with the question representation, which is used for answer predictions. Extensive experiments show that TempoQR improves accuracy by 25 45 percentage points on complex temporal questions over state of the art approaches and it generalizes better to unseen question types.


Holistic Semi Supervised Approaches for EEG Representation Learning. Recently, supervised methods, which often require substantial amounts of class labels, have achieved promising results for EEG representation learning. However, labeling EEG data is a challenging task. More recently, holistic semi supervised learning approaches, which only require few output labels, have shown promising results in the field of computer vision. These methods, however, have not yet been adapted for EEG learning. In this paper, we adapt three state of the art holistic semi supervised approaches, namely MixMatch, FixMatch, and AdaMatch, as well as five classical semi supervised methods for EEG learning. We perform rigorous experiments with all 8 methods on two public EEG based emotion recognition datasets, namely SEED and SEED IV. The experiments with different amounts of limited labeled samples show that the holistic approaches achieve strong results even when only 1 labeled sample is used per class. Further experiments show that in most cases, AdaMatch is the most effective method, followed by MixMatch and FixMatch.


Refinements to the prime number theorem for arithmetic progressions. We prove a version of the prime number theorem for arithmetic progressions that is uniform enough to deduce the Siegel Walfisz theorem, Hoheisel's asymptotic for intervals of length x 1 delta , a Brun Titchmarsh bound, and Linnik's bound on the least prime in an arithmetic progression as corollaries. Our proof uses the Vinogradov Korobov zero free region, a log free zero density estimate, and the Deuring Heilbronn zero repulsion phenomenon. Improvements exist when the modulus is sufficiently powerful.


On the Erd H o s P 'osa property for long holes in C 4 free graphs. We prove that there exists a function f(k) mathcal O (k 2 log k) such that for every C 4 free graph G and every k in mathbb N , G either contains k vertex disjoint holes of length at least 6 , or a set X of at most f(k) vertices such that G X has no hole of length at least 6 . This answers a question of Kim and Kwon Erd H o s P 'osa property of chordless cycles and its applications. JCTB 2020 .


Occupation Times for Time changed Processes with Applications to Parisian Options. Stochastic processes time changed by an inverse subordinator have been suggested as a way to model the price of assets in illiquid markets, where the jumps of the subordinator correspond to periods of time where one is unable to sell an asset. We develop an excursion theory for time changed reflected Brownian motion and use this to express the price of certain European options with Parisian barrier condition in terms of solutions of a time fractional PDE. We provide a general description of the occupation measures of time changed processes and use this to prove a Ray Knight theorem for the occupation measure of a time changed Brownian motion with negative drift. We also show that the duration of the excursions on finite time intervals obey a Poisson Dirichlet distribution when a reflected Brownian motion is time changed by an inverse stable subordinator.


How we browse Measurement and analysis of digital behavior. Accurately analyzing and modeling online browsing behavior play a key role in understanding users and technology interactions. In this work, we design and conduct a user study to collect browsing data from 31 participants continuously for 14 days and self reported browsing patterns. We combine self reports and observational data to provide an up to date measurement study of online browsing behavior. We use these data to empirically address the following questions (1) Do structural patterns of browsing differ across demographic groups and types of web use?, (2) Do people have correct perceptions of their behavior online?, and (3) Do people change their browsing behavior if they are aware of being observed? In response to these questions, we find significant differences in level of activity based on user age, but not based on race or gender. We also find that users have significantly different behavior on Security Concerns websites, which may enable new behavioral methods for automatic detection of security concerns online. We find that users significantly overestimate the time they spend online, but have relatively accurate perceptions of how they spend their time online. We find no significant changes in behavior over the course of the study, which may indicate that observation had no effect on behavior, or that users were consciously aware of being observed throughout the study


VDM DA Virtual Domain Modeling for Source Data free Domain Adaptation. Domain adaptation aims to leverage a label rich domain (the source domain) to help model learning in a label scarce domain (the target domain). Most domain adaptation methods require the co existence of source and target domain samples to reduce the distribution mismatch, however, access to the source domain samples may not always be feasible in the real world applications due to different problems (e.g., storage, transmission, and privacy issues). In this work, we deal with the source data free unsupervised domain adaptation problem, and propose a novel approach referred to as Virtual Domain Modeling (VDM DA). The virtual domain acts as a bridge between the source and target domains. On one hand, we generate virtual domain samples based on an approximated Gaussian Mixture Model (GMM) in the feature space with the pre trained source model, such that the virtual domain maintains a similar distribution with the source domain without accessing to the original source data. On the other hand, we also design an effective distribution alignment method to reduce the distribution divergence between the virtual domain and the target domain by gradually improving the compactness of the target domain distribution through model learning. In this way, we successfully achieve the goal of distribution alignment between the source and target domains by training deep networks without accessing to the source domain data. We conduct extensive experiments on benchmark datasets for both 2D image based and 3D point cloud based cross domain object recognition tasks, where the proposed method referred to Domain Adaptation with Virtual Domain Modeling (VDM DA) achieves the state of the art performances on all datasets.


Neural Clinical Event Sequence Prediction through Personalized Online Adaptive Learning. Clinical event sequences consist of thousands of clinical events that represent records of patient care in time. Developing accurate prediction models for such sequences is of a great importance for defining representations of a patient state and for improving patient care. One important challenge of learning a good predictive model of clinical sequences is patient specific variability. Based on underlying clinical complications, each patient's sequence may consist of different sets of clinical events. However, population based models learned from such sequences may not accurately predict patient specific dynamics of event sequences. To address the problem, we develop a new adaptive event sequence prediction framework that learns to adjust its prediction for individual patients through an online model update.


Value Based Distance Between Information Structures. We define the distance between two information structures as the largest possible difference in value across all zero sum games. We provide a tractable characterization of distance and use it to discuss the relation between the value of information in games versus single agent problems, the value of additional information, informational substitutes, complements, or joint information. The convergence to a countable information structure under value based distance is equivalent to the weak convergence of belief hierarchies, implying, among other things, that for zero sum games, approximate knowledge is equivalent to common knowledge. At the same time, the space of information structures under the value based distance is large there exists a sequence of information structures where players acquire increasingly more information, and epsilon 0 such that any two elements of the sequence have distance of at least epsilon . This result answers by the negative the second (and last unsolved) of the three problems posed by J.F. Mertens in his paper Repeated Games , ICM 1986.


Few Shot Partial Label Learning. Partial label learning (PLL) generally focuses on inducing a noise tolerant multi class classifier by training on overly annotated samples, each of which is annotated with a set of labels, but only one is the valid label. A basic promise of existing PLL solutions is that there are sufficient partial label (PL) samples for training. However, it is more common than not to have just few PL samples at hand when dealing with new tasks. Furthermore, existing few shot learning algorithms assume precise labels of the support set as such, irrelevant labels may seriously mislead the meta learner and thus lead to a compromised performance. How to enable PLL under a few shot learning setting is an important problem, but not yet well studied. In this paper, we introduce an approach called FsPLL (Few shot PLL). FsPLL first performs adaptive distance metric learning by an embedding network and rectifying prototypes on the tasks previously encountered. Next, it calculates the prototype of each class of a new task in the embedding network. An unseen example can then be classified via its distance to each prototype. Experimental results on widely used few shot datasets (Omniglot and miniImageNet) demonstrate that our FsPLL can achieve a superior performance than the state of the art methods across different settings, and it needs fewer samples for quickly adapting to new tasks.


InfAnFace Bridging the infant adult domain gap in facial landmark estimation in the wild. We lay the groundwork for research in the algorithmic comprehension of infant faces, in anticipation of applications from healthcare to psychology, especially in the early prediction of developmental disorders. Specifically, we introduce the first ever dataset of infant faces annotated with facial landmark coordinates and pose attributes, demonstrate the inadequacies of existing facial landmark estimation algorithms in the infant domain, and train new state of the art models that significantly improve upon those algorithms using domain adaptation techniques. We touch on the closely related task of facial detection for infants, and also on a challenging case study of infrared baby monitor images gathered by our lab as part of in field research into the aforementioned developmental issues.


Rate Splitting Multiple Access in Cache Aided Cloud Radio Access Networks. Rate splitting multiple access (RSMA) has been recognized as a promising physical layer strategy for 6G. Motivated by ever increasing popularity of cache enabled content delivery in wireless communications, this paper proposes an innovative multigroup multicast transmission scheme based on RSMA for cache aided cloud radio access networks (C RAN). Our proposed scheme not only exploits the properties of content centric communications and local caching at the base stations (BSs), but also incorporates RSMA to better manage interference in multigroup multicast transmission with statistical channel state information (CSI) known at the central processor (CP) and the BSs. At the RSMA enabled cloud CP, the message of each multicast group is split into a private and a common part with the former private part being decoded by all users in the respective group and the latter common part being decoded by multiple users from other multicast groups. Common message decoding is done for the purpose of mitigating the interference. In this work, we jointly optimize the clustering of BSs and the precoding with the aim of maximizing the minimum rate among all multicast groups to guarantee fairness serving all groups. The problem is a mixed integer non linear stochastic program (MINLSP), which is solved by a practical algorithm we proposed including a heuristic clustering algorithm for assigning a set of BSs to serve each user followed by an efficient iterative algorithm that combines the sample average approximation (SAA) and weighted minimum mean square error (WMMSE) to solve the stochastic non convex sub problem of precoder design. Numerical results show the explicit max min rate gain of our proposed transmission scheme compared to the state of the art trivial interference processing methods. Therefore, we conclude that RSMA is a promising technique for cache aided C RAN.


Named Entity Recognition in the Style of Object Detection. In this work, we propose a two stage method for named entity recognition (NER), especially for nested NER. We borrowed the idea from the two stage Object Detection in computer vision and the way how they construct the loss function. First, a region proposal network generates region candidates and then a second stage model discriminates and classifies the entity and makes the final prediction. We also designed a special loss function for the second stage training that predicts the entityness and entity type at the same time. The model is built on top of pretrained BERT encoders, and we tried both BERT base and BERT large models. For experiments, we first applied it to flat NER tasks such as CoNLL2003 and OntoNotes 5.0 and got comparable results with traditional NER models using sequence labeling methodology. We then tested the model on the nested named entity recognition task ACE2005 and Genia, and got F1 score of 85.6 and 76.8 respectively. In terms of the second stage training, we found that adding extra randomly selected regions plays an important role in improving the precision. We also did error profiling to better evaluate the performance of the model in different circumstances for potential improvements in the future.


More Real than Real A Study on Human Visual Perception of Synthetic Faces. Deep fakes became extremely popular in the last years, also thanks to their increasing realism. Therefore, there is the need to measures human's ability to distinguish between real and synthetic face images when confronted with cutting edge creation technologies. We describe the design and results of a perceptual experiment we have conducted, where a wide and diverse group of volunteers has been exposed to synthetic face images produced by state of the art Generative Adversarial Networks (namely, PG GAN, StyleGAN, StyleGAN2). The experiment outcomes reveal how strongly we should call into question our human ability to discriminate real faces from synthetic ones generated through modern AI.