Thinking Through and Writing About Research Ethics Beyond "Broader Impact". In March 2021, we held the first instalment of the tutorial on thinking through and writing about research ethics beyond 'Broader Impact' in conjunction with the ACM Conference on Fairness, Accountability, and Transparency (FAccT '21). The goal of this tutorial was to offer a conceptual and practical starting point for engineers and social scientists interested in thinking more expansively, holistically, and critically about research ethics. This report provides an outline of the tutorial, and contains our 'lifecourse checklist'. This was presented as part of the tutorial, and provides a practical starting point for researchers when thinking about research ethics before a project's start. We provide this to the research community, with the hope that researchers use it when considering the ethics of their research.


Points as Queries Weakly Semi supervised Object Detection by Points. We propose a novel point annotated setting for the weakly semi supervised object detection task, in which the dataset comprises small fully annotated images and large weakly annotated images by points. It achieves a balance between tremendous annotation burden and detection performance. Based on this setting, we analyze existing detectors and find that these detectors have difficulty in fully exploiting the power of the annotated points. To solve this, we introduce a new detector, Point DETR, which extends DETR by adding a point encoder. Extensive experiments conducted on MS COCO dataset in various data settings show the effectiveness of our method. In particular, when using 20 fully labeled data from COCO, our detector achieves a promising performance, 33.3 AP, which outperforms a strong baseline (FCOS) by 2.0 AP, and we demonstrate the point annotations bring over 10 points in various AR metrics.


Mixed Policy Gradient. Reinforcement learning (RL) has great potential in sequential decision making. At present, the mainstream RL algorithms are data driven, relying on millions of iterations and a large number of empirical data to learn a policy. Although data driven RL may have excellent asymptotic performance, it usually yields slow convergence speed. As a comparison, model driven RL employs a differentiable transition model to improve convergence speed, in which the policy gradient (PG) is calculated by using the backpropagation through time (BPTT) technique. However, such methods suffer from numerical instability, model error sensitivity and low computing efficiency, which may lead to poor policies. In this paper, a mixed policy gradient (MPG) method is proposed, which uses both empirical data and the transition model to construct the PG, so as to accelerate the convergence speed without losing the optimality guarantee. MPG contains two types of PG 1) data driven PG, which is obtained by directly calculating the derivative of the learned Q value function with respect to actions, and 2) model driven PG, which is calculated using BPTT based on the model predictive return. We unify them by revealing the correlation between the upper bound of the unified PG error and the predictive horizon, where the data driven PG is regraded as 0 step model predictive return. Relying on that, MPG employs a rule based method to adaptively adjust the weights of data driven and model driven PGs. In particular, to get a more accurate PG, the weight of the data driven PG is designed to grow along the learning process while the other to decrease. Besides, an asynchronous learning framework is proposed to reduce the wall clock time needed for each update iteration. Simulation results show that the MPG method achieves the best asymptotic performance and convergence speed compared with other baseline algorithms.


Simplified SFT moduli spaces for Legendrian links. We study moduli spaces mathcal M of holomorphic maps U from Riemann surfaces to mathbb R 4 with boundaries on the Lagrangian cylinder over a Legendrian link Lambda subset ( mathbb R 3 , xi std ) . We allow our domains, Sigma , to have non trivial topology in which case mathcal M is the zero locus of an obstruction function mathcal O , sending a moduli space of holomorphic maps in mathbb C to H 1 ( Sigma) . In general, mathcal O 1 (0) is not combinatorially computable. However after a Legendrian isotopy, Lambda can be made left right simple, implying that any U of index 1 is a disk with one or two positive punctures for which pi mathbb C circ U is an embedding. Moreover, any U of index 2 is either a disk or an annulus with pi mathbb C circ U simply covered and without interior critical points. Therefore any SFT invariant of Lambda is combinatorially computable using only disks with leq 2 positive punctures.


Distinguished categories and the Zilber Pink conjecture. We propose an axiomatic approach towards studying unlikely intersections by introducing the framework of distinguished categories. This includes commutative algebraic groups and mixed Shimura varieties. It allows us to define all basic concepts of the field and prove some fundamental facts about them, e.g. the defect condition. In some categories that we call very distinguished, we are able to show some implications between Zilber Pink statements with respect to base change. This yields unconditional results, i.e. the Zilber Pink conjecture for a complex curve in mathcal A 2 that cannot be defined over bar mathbb Q , a complex curve in the g th fibered power of the Legendre family, and a complex curve in the base change of a semiabelian variety over bar mathbb Q .


Route to Chaos in the Fluidic Pinball. The fluidic pinball has been recently proposed as an attractive and effective flow configuration for exploring machine learning fluid flow control. In this contribution, we focus on the route to chaos in this system without actuation, as the Reynolds number is smoothly increased. It was found to be of the Newhouse Ruelle Takens kind, with a secondary pitchfork bifurcation that breaks the symmetry of the mean flow field on the route to quasi periodicity.


Multiplicity one for the pair (GL(n,D),GL(n,E)). Let F be a local field of characteristic zero. Let D be a quaternion algebra over F. Let E be a quadratic field extension of F. Let mu be a character of GL(1,E). We study the distinction problem for the pair (GL(n,D), GL(n,E)) and we prove that any bi (GL(n,E), mu ) equivariant tempered generalized function on GL(n,D) is invariant with respect to an anti involution. Then it implies that dimHom( pi , mu ) is at most 1 by the generalized Gelfand Kazhdan criterion. Thus we give a new proof to the fact that (GL(2n,F),GL(n,E)) is a Gelfand pair when mu is trivial and D splits.


Remarks on rigidity properties of conics. Inspired by the recent results toward Birkhoff conjecture (a rigidity property of billiards in ellipses), we discuss two rigidity properties of conics. The first one concerns symmetries of an analog of polar duality associated with an oval, and the second concerns properties of the circle map associated with an oval and two pencils of lines.


Suspicious ARP Activity Detection and Clustering Based on Autoencoder Neural Networks. The rapidly increasing number of smart devices on the Internet necessitates an efficient inspection system for safeguarding our networks from suspicious activities such as Address Resolution Protocol (ARP) probes. In this research, we analyze sequence data of ARP traffic on LAN based on the numerical count and degree of its packets. Moreover, a dynamic threshold is employed to detect underlying suspicious activities, which are further converted into feature vectors to train an unsupervised autoencoder neural network. Then, we leverage K means clustering to separate the extracted latent features of suspicious activities from the autoencoder into various patterns. Besides, to evaluate the performance, we collect and adopt a real world network traffic dataset from five different LANs. At last, we successfully detect suspicious ARP patterns varying in scale, lifespan, and regularity on the LANs.


Zero shot Task Transfer for Invoice Extraction via Class aware QA Ensemble. We present VESPA, an intentionally simple yet novel zero shot system for layout, locale, and domain agnostic document extraction. In spite of the availability of large corpora of documents, the lack of labeled and validated datasets makes it a challenge to discriminatively train document extraction models for enterprises. We show that this problem can be addressed by simply transferring the information extraction (IE) task to a natural language Question Answering (QA) task without engineering task specific architectures. We demonstrate the effectiveness of our system by evaluating on a closed corpus of real world retail and tax invoices with multiple complex layouts, domains, and geographies. The empirical evaluation shows that our system outperforms 4 prominent commercial invoice solutions that use discriminatively trained models with architectures specifically crafted for invoice extraction. We extracted 6 fields with zero upfront human annotation or training with an Avg. F1 of 87.50.


DICE Deep Significance Clustering for Outcome Aware Stratification. We present deep significance clustering (DICE), a framework for jointly performing representation learning and clustering for "outcome aware" stratification. DICE is intended to generate cluster membership that may be used to categorize a population by individual risk level for a targeted outcome. Following the representation learning and clustering steps, we embed the objective function in DICE with a constraint which requires a statistically significant association between the outcome and cluster membership of learned representations. DICE further includes a neural architecture search step to maximize both the likelihood of representation learning and outcome classification accuracy with cluster membership as the predictor. To demonstrate its utility in medicine for patient risk stratification, the performance of DICE was evaluated using two datasets with different outcome ratios extracted from real world electronic health records. Outcomes are defined as acute kidney injury (30.4 ) among a cohort of COVID 19 patients, and discharge disposition (36.8 ) among a cohort of heart failure patients, respectively. Extensive results demonstrate that DICE has superior performance as measured by the difference in outcome distribution across clusters, Silhouette score, Calinski Harabasz index, and Davies Bouldin index for clustering, and Area under the ROC Curve (AUC) for outcome classification compared to several baseline approaches.


Decidability and NP completeness for some languages which extend Boolean Set Theory. We prove the decidability for a class of languages which extend BST and NP completeness for a subclass of them. The languages BST extended with unordered cartesian product, BST extended with ordered cartesian product and BST extended with powerset fall in this last subclass.


Value at Risk Optimization with Gaussian Processes. Value at risk (VaR) is an established measure to assess risks in critical real world applications with random environmental factors. This paper presents a novel VaR upper confidence bound (V UCB) algorithm for maximizing the VaR of a black box objective function with the first no regret guarantee. To realize this, we first derive a confidence bound of VaR and then prove the existence of values of the environmental random variable (to be selected to achieve no regret) such that the confidence bound of VaR lies within that of the objective function evaluated at such values. Our V UCB algorithm empirically demonstrates state of the art performance in optimizing synthetic benchmark functions, a portfolio optimization problem, and a simulated robot task.


Stable motivic trivial fibre decomposition over integers and framed motives. Using the trivial fiber topology we describe motivic infty loop spaces and fibrant replacements in the motivic stable homotopy category mathbf SH mathbb A 1, mathrm Nis (B) defined over one dimensional base schemes B .


Estimate The Efficiency Of Multiprocessor's Cash Memory Work Algorithms. Many computer systems for calculating the proper organization of memory are among the most critical issues. Using a tier cache memory (along with branching prediction) is an effective means of increasing modern multi core processors' performance. Designing high performance processors is a complex task and requires preliminary verification and analysis of the model level, usually used in analytical and simulation modeling. The refinement of extreme programming is an unfortunate challenge. Few experts disagree with the synthesis of access points. This article demonstrates that Internet QoS and 16 bit architectures are always incompatible, but it's the same situation for write back caches. The solution to this problem can be implemented by analyzing simulation models of different complexity in combination with the analytical evaluation of individual algorithms. This work is devoted to designing a multi parameter simulation model of a multi process for evaluating the performance of cache memory algorithms and the optimality of the structure. Optimization of the structures and algorithms of the cache memory allows you to accelerate the interaction of the memory process and improve the performance of the entire system.


Dynamic programming principle for classical and singular stochastic control with discretionary stopping. We prove the dynamic programming principle (DPP) in a class of problems where an agent controls a d dimensional diffusive dynamics via both classical and singular controls and, moreover, is able to terminate the optimisation at a time of her choosing, prior to a given maturity. The time horizon of the problem is random and it is the smallest between a fixed terminal time and the first exit time of the state dynamics from a Borel set. We consider both the cases in which the total available fuel for the singular control is either bounded or unbounded. We build upon existing proofs of DPP and extend results available in the traditional literature on singular control (e.g., Haussmann and Suo, SIAM J. Control Optim., 33, 1995) by relaxing some key assumptions and including the discretionary stopping feature. We also connect with more general versions of the DPP (e.g., Bouchard and Touzi, SIAM J. Control Optim., 49, 2011) by showing in detail how our class of problems meets the abstract requirements therein.


Structural backward stability in rational eigenvalue problems solved via block Kronecker linearizations. We study the backward stability of running a backward stable eigenstructure solver on a pencil S( lambda) that is a strong linearization of a rational matrix R( lambda) expressed in the form R( lambda) D( lambda) C( lambda I ell A) 1 B , where D( lambda) is a polynomial matrix and C( lambda I ell A) 1 B is a minimal state space realization. We consider the family of block Kronecker linearizations of R( lambda) , which are highly structured pencils. Backward stable eigenstructure solvers applied to S( lambda) will compute the exact eigenstructure of a perturbed pencil widehat S( lambda) S( lambda) Delta S( lambda) and the special structure of S( lambda) will be lost. In order to link this perturbed pencil with a nearby rational matrix, we construct a strictly equivalent pencil widetilde S( lambda) to widehat S( lambda) that restores the original structure, and hence is a block Kronecker linearization of a perturbed rational matrix widetilde R( lambda) widetilde D( lambda) widetilde C( lambda I ell widetilde A) 1 widetilde B , where widetilde D( lambda) is a polynomial matrix with the same degree as D( lambda) . Moreover, we bound appropriate norms of widetilde D( lambda) D( lambda) , widetilde C C , widetilde A A and widetilde B B in terms of an appropriate norm of Delta S( lambda) . These bounds may be inadmissibly large, but we also introduce a scaling that allows us to make them satisfactorily tiny. Thus, for this scaled representation, we prove that the staircase and the QZ algorithms compute the exact eigenstructure of a rational matrix widetilde R( lambda) that can be expressed in exactly the same form as R( lambda) with the parameters defining the representation very near to those of R( lambda) . This shows that this approach is backward stable in a structured sense.


On the Diophantine equation dx 2 p 2a q 2b 4y p . We investigate the solvability of the Diophantine equation in the title, where d 1 is a square free integer, p, q are distinct odd primes and x,y,a,b are unknown positive integers with gcd(x,y) 1 . We describe all the integer solutions of this equation, and then use the main finding to deduce some results concerning the integers solutions of some of its variants. The methods adopted here are elementary in nature and are primarily based on the existence of the primitive divisors of certain Lehmer numbers.


A pessimist's approach to one sided matching. Inspired by real world applications such as the assignment of pupils to schools or the allocation of social housing, the one sided matching problem studies how a set of agents can be assigned to a set of objects when the agents have preferences over the objects, but not vice versa. For fairness reasons, most mechanisms use randomness, and therefore result in a probabilistic assignment. We study the problem of decomposing these probabilistic assignments into a weighted sum of ex post (Pareto )efficient matchings, while maximizing the worst case number of assigned agents. This decomposition preserves all the assignments' desirable properties, most notably strategy proofness. For a specific class of probabilistic assignments, including the assignment by the Probabilistic Serial mechanism, we propose a polynomial time algorithm for this problem that obtains a decomposition in which all matchings assign at least the expected number of assigned agents by the probabilistic assignment, rounded down, thus achieving the theoretically best possible guarantee. For general probabilistic assignments, the problem becomes NP hard. For the Random Serial Dictatorship mechanism, we show that the worst case number of assigned agents is at least half of the optimal, and that this bound is asymptotically tight. Lastly, we propose a column generation framework for the introduced problem, which we evaluate both on randomly generated data, and on real world school choice data from the Belgian cities Antwerp and Ghent.


Adjacency List Oriented Relational Fact Extraction via Adaptive Multi task Learning. Relational fact extraction aims to extract semantic triplets from unstructured text. In this work, we show that all of the relational fact extraction models can be organized according to a graph oriented analytical perspective. An efficient model, aDjacency lIst oRiented rElational faCT (DIRECT), is proposed based on this analytical framework. To alleviate challenges of error propagation and sub task loss equilibrium, DIRECT employs a novel adaptive multi task learning strategy with dynamic sub task loss balancing. Extensive experiments are conducted on two benchmark datasets, and results prove that the proposed model outperforms a series of state of the art (SoTA) models for relational triplet extraction.


On nondeterminism in combinatorial filters. The problem of combinatorial filter reduction arises from questions of resource optimization in robots it is one specific way in which automation can help to achieve minimalism, to build better, simpler robots. This paper contributes a new definition of filter minimization that is broader than its antecedents, allowing filters (input, output, or both) to be nondeterministic. This changes the problem considerably. Nondeterministic filters are able to re use states to obtain, essentially, more 'behavior' per vertex. We show that the gap in size can be significant (larger than polynomial), suggesting such cases will generally be more challenging than deterministic problems. Indeed, this is supported by the core computational complexity result established in this paper producing nondeterministic minimizers is PSPACE hard. The hardness separation for minimization which exists between deterministic filter and deterministic automata, thus, does not hold for the nondeterministic case.


Perhaps PTLMs Should Go to School A Task to Assess Open Book and Closed Book QA. Our goal is to deliver a new task and leaderboard to stimulate research on question answering and pre trained language models (PTLMs) to understand a significant instructional document, e.g., an introductory college textbook or a manual. PTLMs have shown great success in many question answering tasks, given significant supervised training, but much less so in zero shot settings. We propose a new task that includes two college level introductory texts in the social sciences (American Government 2e) and humanities (U.S. History), hundreds of true false statements based on review questions written by the textbook authors, validation development tests based on the first eight chapters of the textbooks, blind tests based on the remaining textbook chapters, and baseline results given state of the art PTLMs. Since the questions are balanced, random performance should be 50 . T5, fine tuned with BoolQ achieves the same performance, suggesting that the textbook's content is not pre represented in the PTLM. Taking the exam closed book, but having read the textbook (i.e., adding the textbook to T5's pre training), yields at best minor improvement (56 ), suggesting that the PTLM may not have "understood" the textbook (or perhaps misunderstood the questions). Performance is better ( 60 ) when the exam is taken open book (i.e., allowing the machine to automatically retrieve a paragraph and use it to answer the question).


Anomaly Injected Deep Support Vector Data Description for Text Outlier Detection. Anomaly detection or outlier detection is a common task in various domains, which has attracted significant research efforts in recent years. Existing works mainly focus on structured data such as numerical or categorical data however, anomaly detection on unstructured textual data is less attended. In this work, we target the textual anomaly detection problem and propose a deep anomaly injected support vector data description (AI SVDD) framework. AI SVDD not only learns a more compact representation of the data hypersphere but also adopts a small number of known anomalies to increase the discriminative power. To tackle text input, we employ a multilayer perceptron (MLP) network in conjunction with BERT to obtain enriched text representations. We conduct experiments on three text anomaly detection applications with multiple datasets. Experimental results show that the proposed AI SVDD is promising and outperforms existing works.


Truly Concurrent Pi Calculi with Reversibility, Probabilism and Guards. The well known process algebras, such as CCS, ACP and pi calculus, capture the interleaving concurrency based on bisimilarity semantics. We did some work on truly concurrent process algebras, such as CTC, APTC and pi tc , capture the true concurrency based on truly concurrent bisimilarities, such as pomset bisimilarity, step bisimilarity, history preserving (hp ) bisimilarity and hereditary history preserving (hhp ) bisimilarity. Truly concurrent process algebras are generalizations of the corresponding traditional process algebras. In this book, we introduce reversibility, probabilism, and guards into truly concurrent calculus pi tc .


Maintaining a Reliable World Model using Action aware Perceptual Anchoring. Reliable perception is essential for robots that interact with the world. But sensors alone are often insufficient to provide this capability, and they are prone to errors due to various conditions in the environment. Furthermore, there is a need for robots to maintain a model of its surroundings even when objects go out of view and are no longer visible. This requires anchoring perceptual information onto symbols that represent the objects in the environment. In this paper, we present a model for action aware perceptual anchoring that enables robots to track objects in a persistent manner. Our rule based approach considers inductive biases to perform high level reasoning over the results from low level object detection, and it improves the robot's perceptual capability for complex tasks. We evaluate our model against existing baseline models for object permanence and show that it outperforms these on a snitch localisation task using a dataset of 1,371 videos. We also integrate our action aware perceptual anchoring in the context of a cognitive architecture and demonstrate its benefits in a realistic gearbox assembly task on a Universal Robot.


Untidy Data The Unreasonable Effectiveness of Tables. Working with data in table form is usually considered a preparatory and tedious step in the sensemaking pipeline a way of getting the data ready for more sophisticated visualization and analytical tools. But for many people, spreadsheets the quintessential table tool remain a critical part of their information ecosystem, allowing them to interact with their data in ways that are hidden or abstracted in more complex tools. This is particularly true for data workers people who work with data as part of their job but do not identify as professional analysts or data scientists. We report on a qualitative study of how these workers interact with and reason about their data. Our findings show that data tables serve a broader purpose beyond data cleanup at the initial stage of a linear analytic flow users want to see and "get their hands on" the underlying data throughout the analytics process, reshaping and augmenting it to support sensemaking. They reorganize, mark up, layer on levels of detail, and spawn alternatives within the context of the base data. These direct interactions and human readable table representations form a rich and cognitively important part of building understanding of what the data mean and what they can do with it. We argue that interactive tables are an important visualization idiom in their own right that the direct data interaction they afford offers a fertile design space for visual analytics and that sense making can be enriched by more flexible human data interaction than is currently supported in visual analytics tools.


Gaussian structure in coalescing stochastic flows. In the paper we consider the point measure that corresponds to Arratia flow. The central limit theorem of the multiple integrals with respect to this measure was obtained.


Multi Modal Image Captioning for the Visually Impaired. One of the ways blind people understand their surroundings is by clicking images and relying on descriptions generated by image captioning systems. Current work on captioning images for the visually impaired do not use the textual data present in the image when generating captions. This problem is critical as many visual scenes contain text. Moreover, up to 21 of the questions asked by blind people about the images they click pertain to the text present in them. In this work, we propose altering AoANet, a state of the art image captioning model, to leverage the text detected in the image as an input feature. In addition, we use a pointer generator mechanism to copy the detected text to the caption when tokens need to be reproduced accurately. Our model outperforms AoANet on the benchmark dataset VizWiz, giving a 35 and 16.2 performance improvement on CIDEr and SPICE scores, respectively.


Balanced imbalanced transitions in indirect reciprocity dynamics on networks. Here we investigate the dynamics of indirect reciprocity on networks, a type of social dynamics in which the attitude of individuals, either cooperative or antagonistic, toward other individuals changes over time by their actions and mutual monitoring. We observe an absorbing state phase transition as we change the network's link or edge density. When the edge density is either small or large enough, opinions quickly reach an absorbing state, from which opinions never change anymore once reached. In contrast, if the edge density is in the middle range the absorbing state is not reached and the state keeps changing thus being active. The result shows a novel effect of social networks on spontaneous group formation.


Unrealistic Feature Suppression for Generative Adversarial Networks. Due to the unstable nature of minimax game between generator and discriminator, improving the performance of GANs is a challenging task. Recent studies have shown that selected high quality samples in training improve the performance of GANs. However, sampling approaches which discard samples show limitations in some aspects such as the speed of training and optimality of the networks. In this paper we propose unrealistic feature suppression (UFS) module that keeps high quality features and suppresses unrealistic features. UFS module keeps the training stability of networks and improves the quality of generated images. We demonstrate the effectiveness of UFS module on various models such as WGAN GP, SNGAN, and BigGAN. By using UFS module, we achieved better Frechet inception distance and inception score compared to various baseline models. We also visualize how effectively our UFS module suppresses unrealistic features through class activation maps.


On Linear Damping Around Inhomogeneous Stationary States of the Vlasov HMF Model. We study the dynamics of perturbations around an inhomogeneous stationary state of the Vlasov HMF (Hamiltonian Mean Field) model, satisfying a linearized stability criterion (Penrose criterion). We consider solutions of the linearized equation around the steady state, and prove the algebraic decay in time of the Fourier modes of their density. We prove moreover that these solutions exhibit a scattering behavior to a modified state, implying a linear Landau damping effect with an algebraic rate of damping.


Mitigating Political Bias in Language Models Through Reinforced Calibration. Current large scale language models can be politically biased as a result of the data they are trained on, potentially causing serious problems when they are deployed in real world settings. In this paper, we describe metrics for measuring political bias in GPT 2 generation and propose a reinforcement learning (RL) framework for mitigating political biases in generated text. By using rewards from word embeddings or a classifier, our RL framework guides debiased generation without having access to the training data or requiring the model to be retrained. In empirical experiments on three attributes sensitive to political bias (gender, location, and topic), our methods reduced bias according to both our metrics and human evaluation, while maintaining readability and semantic coherence.


Yaglom limit for critical neutron transport. We consider the classical Yaglom limit theorem for a branching Markov process X (X t, t ge 0) , with non local branching mechanism in the setting that the mean semigroup is critical, i.e. its leading eigenvalue is zero. In particular, we show that there exists a constant c(f) such that rm Law left( frac langle f, X t rangle t bigg langle 1, X t rangle 0 right) to mathbf e c(f) , qquad t to infty, where mathbf e c(f) is an exponential random variable with rate c(f) and the convergence is in distribution. As part of the proof, we also show that the probability of survival decays inversely proportionally to time. Although Yaglom limit theorems have recently been handled in the setting of branching Brownian motion in a bounded domain and superprocesses, cite Ellen, Yanxia , these results do not allow for non local branching, which complicates the analysis. Our approach and the main novelty of this work is based around a precise result for the scaled asymptotics for the k th martingale moments of X (rather than the Yaglom limit itself). We then illustrate our results in the setting of neutron transport, for which the non locality is essential, complementing recent developments in this domain cite SNTE, SNTEII, SNTEIII, MCNTE, MultiNTE .


Random Euclidean coverage from within. Let X 1,X 2, ldots be independent random uniform points in a bounded domain A subset mathbb R d with smooth boundary. Define the coverage threshold R n to be the smallest r such that A is covered by the balls of radius r centred on X 1, ldots,X n . We obtain the limiting distribution of R n and also a strong law of large numbers for R n in the large n limit. For example, if A has volume 1 and perimeter partial A , if d 3 then Pr n pi R n 3 log n 2 log ( log n) leq x converges to exp( 2 4 pi 5 3 partial A e 2 x 3 ) and (n pi R n 3) ( log n) to 1 almost surely, and if d 2 then Pr n pi R n 2 log n log ( log n) leq x converges to exp( e x partial A pi 1 2 e x 2 ) . We give similar results for general d , and also for the case where A is a polytope. We also generalize to allow for multiple coverage. The analysis relies on classical results by Hall and by Janson, along with a careful treatment of boundary effects. For the strong laws of large numbers, we can relax the requirement that the underlying density on A be uniform.


Dynamic plasmonic color generation enabled by functional materials. Displays are an indispensable medium to visually convey information in our daily life. Although conventional dye based color displays have been rigorously advanced by world leading companies, critical issues still remain. For instance, color fading and wavelength limited resolution restrict further developments. Plasmonic colors emerging from resonant interactions between light and metallic nanostructures can overcome these restrictions. With dynamic characteristics enabled by functional materials, dynamic plasmonic coloration may find a variety of applications in display technologies. In this review, we elucidate basic concepts for dynamic plasmonic color generation and highlight recent advances. In particular, we devote our review to a selection of dynamic controls endowed by functional materials, including magnesium, liquid crystals, electrochromic polymers, and phase change materials. We also discuss their performance in view of potential applications in current display technologies.


DB4HLS A Database of High Level Synthesis Design Space Explorations. High Level Synthesis (HLS) frameworks allow to easily specify a large number of variants of the same hardware design by only acting on optimization directives. Nonetheless, the hardware synthesis of implementations for all possible combinations of directive values is impractical even for simple designs. Addressing this shortcoming, many HLS Design Space Exploration (DSE) strategies have been proposed to devise directive settings leading to high quality implementations while limiting the number of synthesis runs. All these works require considerable efforts to validate the proposed strategies and or to build the knowledge base employed to tune abstract models, as both tasks mandate the syntheses of large collections of implementations. Currently, such data gathering is performed ad hoc, a) leading to a lack of standardization, hampering comparisons between DSE alternatives, and b) posing a very high burden to researchers willing to develop novel DSE strategies. Against this backdrop, we here introduce DB4HLS, a database of exhaustive HLS explorations comprising more than 100000 design points collected over 4 years of synthesis time. The open structure of DB4HLS allows the incremental integration of new DSEs, which can be easily defined with a dedicated domain specific language. We think that of our database, available at https www.db4hls.inf.usi.ch , will be a valuable tool for the research community investigating automated strategies for the optimization of HLS based hardware designs.


Plasticity of the unit ball of c and c 0 . We prove the plasticity of the unit ball of c . That is, we show that every non expansive bijection from the unit ball of c onto itself is an isometry. We also demonstrate a slightly weaker property for the unit ball of c 0 we prove that a non expansive bijection is an isometry, provided that it has a continuous inverse.


On p adic uniformization of abelian varieties with good reduction. Let p be a rational prime, let F denote a finite, unramified extension of mathbb Q p , K the maximal unramified extension of mathbb Q p , overline K some fixed algebraic closure of K , and mathbb C p the completion of overline K . Let G F the absolute Galois group of F . Let A be an abelian variety defined over F , with good reduction. Classically, the Fontaine integral was seen as a Hodge Tate comparison morphism, i.e. as a map varphi A otimes 1 mathbb C p colon T p(A) otimes mathbb Z p mathbb C p to text Lie (A)(F) otimes F mathbb C p(1) , and as such it is surjective and has a large kernel. The present article starts with the observation that if we do not tensor T p(A) with mathbb C p , then the Fontaine integral is often injective. In particular, it is proved that if T p(A) G K 0 , then varphi A is injective. As an application, we extend the Fontaine integral to a perfectoid like universal cover of A and show that if T p(A) G K 0 , then A( overline K ) has a type of p adic uniformization, which resembles the classical complex uniformization.


Rediscovering Affordance A Reinforcement Learning Perspective. Affordance refers to the perception of possible actions allowed by an object. Despite its relevance to human computer interaction, no existing theory explains the mechanisms that underpin affordance formation that is, how affordances are discovered and adapted via interaction. We propose an integrative theory of affordance formation based on the theory of reinforcement learning in cognitive sciences. The key assumption is that users learn to associate promising motor actions to percepts via experience when reinforcement signals (success failure) are present. They also learn to categorize actions (e.g., "rotating" a dial), giving them the ability to name and reason about affordance. Upon encountering novel widgets, their ability to generalize these actions determines their ability to perceive affordances. We implement this theory in a virtual robot model, which demonstrates human like adaptation of affordance in interactive widgets tasks. While its predictions align with trends in human data, humans are able to adapt affordances faster, suggesting the existence of additional mechanisms.


Efficient Set Based Approaches for the Reliable Computation of Robot Capabilities. To reliably model real robot characteristics, interval linear systems of equations allow to describe families of problems that consider sets of values. This allows to easily account for typical complexities such as sets of joint states and design parameter uncertainties. Inner approximations of the solutions to the interval linear systems can be used to describe the common capabilities of a robotic manipulator corresponding to the considered sets of values. In this work, several classes of problems are considered. For each class, reliable and efficient polytope, n cube, and n ball inner approximations are presented. The interval approaches usually proposed are inefficient because they are too computationally heavy for certain applications, such as control. We propose efficient new inner approximation theorems for the considered classes of problems. This allows for usage with real time applications as well as rapid analysis of potential designs. Several applications are presented for a redundant planar manipulator including locally evaluating the manipulator's velocity, acceleration, and static force capabilities, and evaluating its future acceleration capabilities over a given time horizon.


Constraint based Knowledge Base Distillation in End to End Task Oriented Dialogs. End to End task oriented dialogue systems generate responses based on dialog history and an accompanying knowledge base (KB). Inferring those KB entities that are most relevant for an utterance is crucial for response generation. Existing state of the art scales to large KBs by softly filtering over irrelevant KB information. In this paper, we propose a novel filtering technique that consists of (1) a pairwise similarity based filter that identifies relevant information by respecting the n ary structure in a KB record. and, (2) an auxiliary loss that helps in separating contextually unrelated KB information. We also propose a new metric multiset entity F1 which fixes a correctness issue in the existing entity F1 metric. Experimental results on three publicly available task oriented dialog datasets show that our proposed approach outperforms existing state of the art models.


Reliability Disasters a follow up to Doganaksoy Meeker and Hahn. We discuss the use of the FMEA to address some of the root causes of the reliability disasters discussed in the article Reliability Disasters by Doganaksoy Meeker and Hahn, which appeared in Quality Progress in August 2020


Modelling Universal Order Book Dynamics in Bitcoin Market. Understanding the emergence of universal features such as the stylized facts in markets is a long standing challenge that has drawn much attention from economists and physicists. Most existing models, such as stochastic volatility models, focus mainly on price changes, neglecting the complex trading dynamics. Recently, there are increasing studies on order books, thanks to the availability of large scale trading datasets, aiming to understand the underlying mechanisms governing the market dynamics. In this paper, we collect order book datasets of Bitcoin platforms across three countries over millions of users and billions of daily turnovers. We find a 1 1D field theory, govern by a set of KPZ like stochastic equations, predicts precisely the order book dynamics observed in empirical data. Despite the microscopic difference of markets, we argue the proposed effective field theory captures the correct universality class of market dynamics. We also show that the model agrees with the existing stochastic volatility models at the long wavelength limit.


Agentization of Two Population Driven Models of Mathematical Biology. Single species population models and discrete stochastic gene frequency models are two standards of mathematical biology important for the evolution of populations. An agent based model is presented which reproduces these models and then explores where these models agree and disagree under relaxed specifications. For the population models, the requirement of homogeneous mixing prevents prediction of extinctions due to local resource depletion. These models also suggest equilibrium based on attainment of constant population levels though underlying population characteristics may be nowhere close to equilibrium. The discrete stochastic gene frequency models assume well mixed populations at constant levels. The models' predictions for non constant populations in strongly oscillating and chaotic regimes are surprisingly good, only diverging from the ABM at the most chaotic levels.


A Dataset of Stationary, Fixed wing Aircraft on a Collision Course for Vision Based Sense and Avoid. The emerging global market for unmanned aerial vehicle (UAV) services is anticipated to reach USD 58.4 billion by 2026, spurring significant efforts to safely integrate routine UAV operations into the national airspace in a manner that they do not compromise the existing safety levels. The commercial use of UAVs would be enhanced by an ability to sense and avoid potential mid air collision threats however research in this field is hindered by the lack of available datasets as they are expensive and technically complex to capture. In this paper we present a dataset for vision based aircraft detection. The dataset consists of 15 image sequences containing 55,521 images of a fixed wing aircraft approaching a stationary, grounded camera. Ground truth labels and a performance benchmark are also provided. To our knowledge, this is the first public dataset for studying medium sized, fixed wing aircraft on a collision course with the observer. The full dataset and ground truth labels are publicly available at https qcr.github.io dataset aircraft collision course .


The Inclusion Problem for Forest Languages under Substitutions. We consider algorithms and lower bounds for various problems over forest languages as input models we allow forest algebras, deterministic forest automata and nondeterministic forest automata. For the equivalence problem, we give an almost linear time algorithm for both forest algebras and deterministic forest automata this is complemented by a polynomial time hardness result. The emptiness problem is complete for polynomial time over each of the three models. Additionally, we consider the emptiness of intersection problem for forest algebras and deterministic forest automata this problem turns out to be complete for exponential time. It is well known that the corresponding problems for word languages are complete for nondeterministic logarithmic space and for polynomial space, respectively. Equipped with this toolbox of algorithms and lower bounds, we consider various inclusion problems for regular forest languages under substitutions. The substitutions in this paper replace leaf variables by forest languages. Depending on the direction of the inclusion, the problem for a given substitution is either complete for polynomial time or for exponential time in particular, the equivalence problem under substitutions is complete for exponential time and, hence, more difficult than the equivalence problem for forest languages without substitutions. If we ask whether there exists a substitution such that a given inclusion holds, then this problem is either complete for NP or exponential time, depending on whether we consider inclusion or equivalence moreover, the problem is undecidable if the substitution is applied on both sides.


Propagation of chaos for branching stochastic particles model with chemotaxis. A hybrid stochastic individual based model of proliferating cells with chemotaxis is presented. The model is expressed by a branching diffusion process coupled to a partial differential equation describing concentration of a chemotactic factor. It is shown that in the hydrodynamic limit when number of cells goes to infinity the model converges to the solution of nonconservative Patlak Keller Segel type system. A nonlinear mean field stochastic model is defined and it is proven that the movement of descendants of a single cell in the individual model converges to this mean field process.


Generalization bounds via distillation. This paper theoretically investigates the following empirical phenomenon given a high complexity network with poor generalization bounds, one can distill it into a network with nearly identical predictions but low complexity and vastly smaller generalization bounds. The main contribution is an analysis showing that the original network inherits this good generalization bound from its distillation, assuming the use of well behaved data augmentation. This bound is presented both in an abstract and in a concrete form, the latter complemented by a reduction technique to handle modern computation graphs featuring convolutional layers, fully connected layers, and skip connections, to name a few. To round out the story, a (looser) classical uniform convergence analysis of compression is also presented, as well as a variety of experiments on cifar and mnist demonstrating similar generalization performance between the original network and its distillation.


Building a consistent system for faculty appraisal using Data Envelopment Analysis. Data Envelopment Analysis (DEA) appears more than just an instrument of measurement. DEA models can be seen as a mathematical structure for democratic voicing within decisional contexts. Such an important aspect of DEA is enhanced through the performance evaluation of a group of professors in a virtual Business college. We show that the outcomes of the analysis can be very useful to support decision processes at many levels. There are three categories of professors Assistant professors, Associate professors, and Full professors. The evaluation process of these professors is investigated through two different cases. The first case handles each category of professors as a separate sample representing an independent population. The results show that the mean efficiency scores fall between 0.85 and 0.93 for all professors no matters their category. In spite of enabling more fairness, such an approach suffers from its exclusive character, which is contrary to the democratic spirit of DEA. The second case tries to cope with this deficiency through the assessment of the faculty members as a single sample drawn from the same population, i.e., Assistant professors, Associate professors, and Full professors are treated equally, only on the ground of their respective inputs and outputs, no matters their academic rank. A clear efficiency decline is reported, basically due to the very nature of DEA as a procedure that is more efficiency than output focused.


Improving Reproducibility and Performance of Radiomics in Low Dose CT using Cycle GANs. As a means to extract biomarkers from medical imaging, radiomics has attracted increased attention from researchers. However, reproducibility and performance of radiomics in low dose CT scans are still poor, mostly due to noise. Deep learning generative models can be used to denoise these images and in turn improve radiomics' reproducibility and performance. However, most generative models are trained on paired data, which can be difficult or impossible to collect. In this article, we investigate the possibility of denoising low dose CTs using cycle generative adversarial networks (GANs) to improve radiomics reproducibility and performance based on unpaired datasets. Two cycle GANs were trained 1) from paired data, by simulating low dose CTs (i.e., introducing noise) from high dose CTs and 2) from unpaired real low dose CTs. To accelerate convergence, during GAN training, a slice paired training strategy was introduced. The trained GANs were applied to three scenarios 1) improving radiomics reproducibility in simulated low dose CT images and 2) same day repeat low dose CTs (RIDER dataset) and 3) improving radiomics performance in survival prediction. Cycle GAN results were compared with a conditional GAN (CGAN) and an encoder decoder network (EDN) trained on simulated paired data.The cycle GAN trained on simulated data improved concordance correlation coefficients (CCC) of radiomic features from 0.87 to 0.93 on simulated noise CT and from 0.89 to 0.92 on RIDER dataset, as well improving the AUC of survival prediction from 0.52 to 0.59. The cycle GAN trained on real data increased the CCCs of features in RIDER to 0.95 and the AUC of survival prediction to 0.58. The results show that cycle GANs trained on both simulated and real data can improve radiomics' reproducibility and performance in low dose CT and achieve similar results compared to CGANs and EDNs.


Deep RBF Networks for Anomaly Detection in Automotive Cyber Physical Systems. Deep Neural Networks (DNNs) are popularly used for implementing autonomy related tasks in automotive Cyber Physical Systems (CPSs). However, these networks have been shown to make erroneous predictions to anomalous inputs, which manifests either due to Out of Distribution (OOD) data or adversarial attacks. To detect these anomalies, a separate DNN called assurance monitor is often trained and used in parallel to the controller DNN, increasing the resource burden and latency. We hypothesize that a single network that can perform controller predictions and anomaly detection is necessary to reduce the resource requirements. Deep Radial Basis Function (RBF) networks provide a rejection class alongside the class predictions, which can be utilized for detecting anomalies at runtime. However, the use of RBF activation functions limits the applicability of these networks to only classification tasks. In this paper, we show how the deep RBF network can be used for detecting anomalies in CPS regression tasks such as continuous steering predictions. Further, we design deep RBF networks using popular DNNs such as NVIDIA DAVE II, and ResNet20, and then use the resulting rejection class for detecting adversarial attacks such as a physical attack and data poison attack. Finally, we evaluate these attacks and the trained deep RBF networks using a hardware CPS testbed called DeepNNCar and a real world German Traffic Sign Benchmark (GTSB) dataset. Our results show that the deep RBF networks can robustly detect these attacks in a short time without additional resource requirements.


What Stops Learning based 3D Registration from Working in the Real World?. Much progress has been made on the task of learning based 3D point cloud registration, with existing methods yielding outstanding results on standard benchmarks, such as ModelNet40, even in the partial to partial matching scenario. Unfortunately, these methods still struggle in the presence of real data. In this work, we identify the sources of these failures, analyze the reasons behind them, and propose solutions to tackle them. We summarise our findings into a set of guidelines and demonstrate their effectiveness by applying them to different baseline methods, DCP and IDAM. In short, our guidelines improve both their training convergence and testing accuracy. Ultimately, this translates to a best practice 3D registration network (BPNet), constituting the first learning based method able to handle previously unseen objects in real world data. Despite being trained only on synthetic data, our model generalizes to real data without any fine tuning, reaching an accuracy of up to 67 on point clouds of unseen objects obtained with a commercial sensor.


When the Umpire is also a Player Bias in Private Label Product Recommendations on E commerce Marketplaces. Algorithmic recommendations mediate interactions between millions of customers and products (in turn, their producers and sellers) on large e commerce marketplaces like Amazon. In recent years, the producers and sellers have raised concerns about the fairness of black box recommendation algorithms deployed on these marketplaces. Many complaints are centered around marketplaces biasing the algorithms to preferentially favor their own private label' products over competitors. These concerns are exacerbated as marketplaces increasingly de emphasize or replace organic' recommendations with ad driven sponsored' recommendations, which include their own private labels. While these concerns have been covered in popular press and have spawned regulatory investigations, to our knowledge, there has not been any public audit of these marketplace algorithms. In this study, we bridge this gap by performing an end to end systematic audit of related item recommendations on Amazon. We propose a network centric framework to quantify and compare the biases across organic and sponsored related item recommendations. Along a number of our proposed bias measures, we find that the sponsored recommendations are significantly more biased toward Amazon private label products compared to organic recommendations. While our findings are primarily interesting to producers and sellers on Amazon, our proposed bias measures are generally useful for measuring link formation bias in any social or content networks.


A remark on Fine's arithmetic functions. In this note, we take another look at some arithmetic identities of N.J. Fine associated with divisor functions. We connect these functions with indefinite quadratic forms using a result due to Andrews. As a consequence, arithmetic theorems are extracted.


Does FLASH deplete Oxygen? Experimental Evaluation for Photons, Protons and Carbon Ions. Purpose To investigate experimentally, if FLASH irradiation depletes oxygen within water for different radiation types such as photons, protons and carbon ions. Methods This study presents measurements of the oxygen consumption in sealed, 3D printed water phantoms during irradiation with X rays, protons and carbon ions at varying dose rates up to 340 Gy s. The oxygen measurement was performed using an optical sensor allowing for non invasive measurements. Results Oxygen consumption in water only depends on dose, dose rate and linear energy transfer (LET) of the irradiation. The total amount of oxygen depleted per 10 Gy was found to be 0.04 0.18 atm for 225 kV photons, 0.04 0.25 atm for 224 MeV protons and 0.09 0.17 atm for carbon ions. consumption depends on dose rate by an inverse power law and saturates for higher dose rates because of self interactions of radicals. Higher dose rates yield lower oxygen consumption. No total depletion of oxygen was found for clinical doses. Conclusions FLASH irradiation does consume oxygen, but not enough to deplete all the oxygen present. For higher dose rates, less oxygen was consumed than at standard radiotherapy dose rates. No total depletion was found for any of the analyzed radiation types for 10 Gy dose delivery using FLASH.


Robust Market Equilibria under Uncertain Cost. This work studies equilibrium problems under uncertainty where firms maximize their profits in a robust way when selling their output. Robust optimization plays an increasingly important role when best guaranteed objective values are to be determined, independently of the specific distributional assumptions regarding uncertainty. In particular, solutions are to be determined that are feasible regardless of how the uncertainty manifests itself within some predefined uncertainty set. Our mathematical analysis adopts the robust optimization perspective in the context of equilibrium problems. First, we present structural insights for a single stage, nonadjustable robust setting. We then go one step further and study the more complex two stage or adjustable case where a part of the variables can adjust to the realization of the uncertainty. We compare equilibrium outcomes with the corresponding centralized robust optimization problem where thesum of all profits are maximized. As we find, the market equilibrium for the perfectly competitive firms differs from the solution of the robust central planner, which is in stark contrast to classical results regarding the efficiency of market equilibria with perfectly competitive firms. For the different scenarios considered, we furthermore are able to determine the resulting price of anarchy. In the case of non adjustable robustness, for fixed demand in every time step the price of anarchy is bounded whereas it is unbounded if the buyers are modeled by elastic demand functions. For the two stage adjustable setting, we show how to compute subsidies for the firms that lead to robust welfareoptimal equilibria.


Fertilitopes. We introduce tools from discrete convexity theory and polyhedral geometry into the theory of West's stack sorting map s . Associated to each permutation pi is a particular set mathcal V( pi) of integer compositions that appears in a formula for the fertility of pi , which is defined to be s 1 ( pi) . These compositions also feature prominently in more general formulas involving families of colored binary plane trees called troupes and in a formula that converts from free to classical cumulants in noncommutative probability theory. We show that mathcal V( pi) is a transversal discrete polymatroid when it is nonempty. We define the fertilitope of pi to be the convex hull of mathcal V( pi) , and we prove a surprisingly simple characterization of fertilitopes as nestohedra arising from full binary plane trees. Using known facts about nestohedra, we provide a procedure for describing the structure of the fertilitope of pi directly from pi using Bousquet M 'elou's notion of the canonical tree of pi . As a byproduct, we obtain a new combinatorial cumulant conversion formula in terms of generalizations of canonical trees that we call quasicanonical trees. We also apply our results on fertilitopes to study combinatorial properties of the stack sorting map. In particular, we show that the set of fertility numbers has density 1 , and we determine all infertility numbers of size at most 126 . Finally, we reformulate the conjecture that sum sigma in s 1 ( pi) x text des ( sigma) 1 is always real rooted in terms of nestohedra, and we propose natural ways in which this new version of the conjecture could be extended.


Multi objective Optimisation of Digital Circuits based on Cell Mapping in an Industrial EDA Flow. Modern electronic design automation (EDA) tools can handle the complexity of state of the art electronic systems by decomposing them into smaller blocks or cells, introducing different levels of abstraction and staged design flows. However, throughout each independent optimised design step, overhead and inefficiency can accumulate in the resulting overall design. Performing design specific optimisation from a more global viewpoint requires more time due to the larger search space, but has the potential to provide solutions with improved performance. In this work, a fully automated, multi objective (MO) EDA flow is introduced to address this issue. It specifically tunes drive strength mapping, preceding physical implementation, through multi objective population based search algorithms. Designs are evaluated with respect to their power, performance and area (PPA). The proposed approach is capable of expanding the design space, offering a set of Pareto optimised trade off solutions for different case specific utilisation. We have applied the proposed MOEDA framework to ISCAS 85 benchmark circuits using a commercial 65nm standard cell library. The experimental results demonstrate how the MOEDA flow enhances the solutions initially generated by the standard digital flow, and how simultaneously a significant improvement in PPA metrics is achieved.


A Fine Grained Analysis on Distribution Shift. Robustness to distribution shifts is critical for deploying machine learning models in the real world. Despite this necessity, there has been little work in defining the underlying mechanisms that cause these shifts and evaluating the robustness of algorithms across multiple, different distribution shifts. To this end, we introduce a framework that enables fine grained analysis of various distribution shifts. We provide a holistic analysis of current state of the art methods by evaluating 19 distinct methods grouped into five categories across both synthetic and real world datasets. Overall, we train more than 85K models. Our experimental framework can be easily extended to include new methods, shifts, and datasets. We find, unlike previous work citep Gulrajani20 , that progress has been made over a standard ERM baseline in particular, pretraining and augmentations (learned or heuristic) offer large gains in many cases. However, the best methods are not consistent over different datasets and shifts.


Eulerian polynomials, Stirling permutations and increasing trees. We study two generalizations of the gamma expansion of Eulerian polynomials from the viewpoint of the decompositions of statistics. We first present an expansion formula of the trivariate Eulerian polynomials, which are the enumerators for the joint distribution of descents, big ascents and successions of permutations. And then, inspired by the work of Chen and Fu on the trivariate second order Eulerian polynomials, we show the e positivity of the multivariate k th order Eulerian polynomials, which are the enumerators for the joint distribution of ascents, descents and j plateaux of k Stirling permutations. We provide combinatorial interpretations for the coefficients of these two expansions in terms of increasing trees.


On the finite element approximation of a semicoercive Stokes variational inequality arising in glaciology. Stokes variational inequalities arise in the formulation of glaciological problems involving contact. Two important examples of such problems are that of the grounding line of a marine ice sheet and the evolution of a subglacial cavity. In general, rigid modes are present in the velocity space, rendering the variational inequality semicoercive. In this work, we consider a mixed formulation of this variational inequality involving a Lagrange multiplier and provide an analysis of its finite element approximation. Error estimates in the presence of rigid modes are obtained by means of a novel technique involving metric projections onto closed convex cones. Numerical results are reported to validate the error estimates and demonstrate the advantages of using a mixed formulation in a glaciological application.


The Quantum Field Theory on Which the Everyday World Supervenes. Effective Field Theory (EFT) is the successful paradigm underlying modern theoretical physics, including the "Core Theory" of the Standard Model of particle physics plus Einstein's general relativity. I will argue that EFT grants us a unique insight each EFT model comes with a built in specification of its domain of applicability. Hence, once a model is tested within some domain (of energies and interaction strengths), we can be confident that it will continue to be accurate within that domain. Currently, the Core Theory has been tested in regimes that include all of the energy scales relevant to the physics of everyday life (biology, chemistry, technology, etc.). Therefore, we have reason to be confident that the laws of physics underlying the phenomena of everyday life are completely known.


Handcrafted Backdoors in Deep Neural Networks. Deep neural networks (DNNs), while accurate, are expensive to train. Many practitioners, therefore, outsource the training process to third parties or use pre trained DNNs. This practice makes DNNs vulnerable to backdoor attacks the third party who trains the model may act maliciously to inject hidden behaviors into the otherwise accurate model. Until now, the mechanism to inject backdoors has been limited to poisoning . We argue that such a supply chain attacker has more attack techniques available. To study this hypothesis, we introduce a handcrafted attack that directly manipulates the parameters of a pre trained model to inject backdoors. Our handcrafted attacker has more degrees of freedom in manipulating model parameters than poisoning. This makes it difficult for a defender to identify or remove the manipulations with straightforward methods, such as statistical analysis, adding random noises to model parameters, or clipping their values within a certain range. Further, our attacker can combine the handcrafting process with additional techniques, e.g. , jointly optimizing a trigger pattern, to inject backdoors into complex networks effectively the meet in the middle attack. In evaluations, our handcrafted backdoors remain effective across four datasets and four network architectures with a success rate above 96 . Our backdoored models are resilient to both parameter level backdoor removal techniques and can evade existing defenses by slightly changing the backdoor attack configurations. Moreover, we demonstrate the feasibility of suppressing unwanted behaviors otherwise caused by poisoning. Our results suggest that further research is needed for understanding the complete space of supply chain backdoor attacks.


Bounds for Multiple Packing and List Decoding Error Exponents. We revisit the problem of high dimensional multiple packing in Euclidean space. Multiple packing is a natural generalization of sphere packing and is defined as follows. Let N 0 and L in mathbb Z ge2 . A multiple packing is a set mathcal C of points in mathbb R n such that any point in mathbb R n lies in the intersection of at most L 1 balls of radius sqrt nN around points in mathcal C . We study the multiple packing problem for both bounded point sets whose points have norm at most sqrt nP for some constant P 0 and unbounded point sets whose points are allowed to be anywhere in mathbb R n . Given a well known connection with coding theory, multiple packings can be viewed as the Euclidean analog of list decodable codes, which are well studied for finite fields. In this paper, we derive various bounds on the largest possible density of a multiple packing in both bounded and unbounded settings. A related notion called average radius multiple packing is also studied. Some of our lower bounds exactly pin down the asymptotics of certain ensembles of average radius list decodable codes, e.g., (expurgated) Gaussian codes and (expurgated) Poisson Point Processes. To this end, we apply tools from high dimensional geometry and large deviation theory. Some of our lower bounds on the optimal multiple packing density are the best known lower bounds. These bounds are obtained via a proxy known as error exponent. The latter quantity is the best exponent of the probability of list decoding error when the code is corrupted by a Gaussian noise. We establish a curious inequality which relates the error exponent, a quantity of average case nature, to the list decoding radius, a quantity of worst case nature. We derive various bounds on the error exponent in both bounded and unbounded settings which are of independent interest beyond multiple packing.


Fully probabilistic design for knowledge fusion between Bayesian filters under uniform disturbances. This paper considers the problem of Bayesian transfer learning based knowledge fusion between linear state space processes driven by uniform state and observation noise processes. The target task conditions on probabilistic state predictor(s) supplied by the source filtering task(s) to improve its own state estimate. A joint model of the target and source(s) is not required and is not elicited. The resulting decision making problem for choosing the optimal conditional target filtering distribution under incomplete modelling is solved via fully probabilistic design (FPD), i.e. via appropriate minimization of Kullback Leibler divergence (KLD). The resulting FPD optimal target learner is robust, in the sense that it can reject poor quality source knowledge. In addition, the fact that this Bayesian transfer learning (BTL) scheme does not depend on a model of interaction between the source and target tasks ensures robustness to the misspecification of such a model. The latter is a problem that affects conventional transfer learning methods. The properties of the proposed BTL scheme are demonstrated via extensive simulations, and in comparison with two contemporary alternatives.


A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Pose. Existing deep learning based human mesh reconstruction approaches have a tendency to build larger networks in order to achieve higher accuracy. Computational complexity and model size are often neglected, despite being key characteristics for practical use of human mesh reconstruction models (e.g. virtual try on systems). In this paper, we present GTRS, a lightweight pose based method that can reconstruct human mesh from 2D human pose. We propose a pose analysis module that uses graph transformers to exploit structured and implicit joint correlations, and a mesh regression module that combines the extracted pose feature with the mesh template to reconstruct the final human mesh. We demonstrate the efficiency and generalization of GTRS by extensive evaluations on the Human3.6M and 3DPW datasets. In particular, GTRS achieves better accuracy than the SOTA pose based method Pose2Mesh while only using 10.2 of the parameters (Params) and 2.5 of the FLOPs on the challenging in the wild 3DPW dataset. Code will be publicly available.


Families of singular Chern Ricci flat metrics. We prove uniform a priori estimates for degenerate complex Monge Amp ere equations on a family of hermitian varieties. This generalizes a theorem of Di Nezza Guedj Guenancia to hermitian contexts. The main result can be applied to study the uniform boundedness of Chern Ricci flat potentials in conifold transitions.


A Deep Learning Based Ternary Task Classification System Using Gramian Angular Summation Field in fNIRS Neuroimaging Data. Functional near infrared spectroscopy (fNIRS) is a non invasive, economical method used to study its blood flow pattern. These patterns can be used to classify tasks a subject is performing. Currently, most of the classification systems use simple machine learning solutions for the classification of tasks. These conventional machine learning methods, which are easier to implement and interpret, usually suffer from low accuracy and undergo a complex preprocessing phase before network training. The proposed method converts the raw fNIRS time series data into an image using Gramian Angular Summation Field. A Deep Convolutional Neural Network (CNN) based architecture is then used for task classification, including mental arithmetic, motor imagery, and idle state. Further, this method can eliminate the feature selection stage, which affects the traditional classifiers' performance. This system obtained 87.14 average classification accuracy higher than any other method for the dataset.


Revisiting Analog Over the Air Machine Learning The Blessing and Curse of Interference. We study a distributed machine learning problem carried out by an edge server and multiple agents in a wireless network. The objective is to minimize a global function that is a sum of the agents' local loss functions. And the optimization is conducted by analog over the air model training. Specifically, each agent modulates its local gradient onto a set of waveforms and transmits to the edge server simultaneously. From the received analog signal the edge server extracts a noisy aggregated gradient which is distorted by the channel fading and interference, and uses it to update the global model and feedbacks to all the agents for another round of local computing. Since the electromagnetic interference generally exhibits a heavy tailed intrinsic, we use the alpha stable distribution to model its statistic. In consequence, the global gradient has an infinite variance that hinders the use of conventional techniques for convergence analysis that rely on second order moments' existence. To circumvent this challenge, we take a new route to establish the analysis of convergence rate, as well as generalization error, of the algorithm. Our analyses reveal a two sided effect of the interference on the overall training procedure. On the negative side, heavy tail noise slows down the convergence rate of the model training the heavier the tail in the distribution of interference, the slower the algorithm converges. On the positive side, heavy tail noise has the potential to increase the generalization power of the trained model the heavier the tail, the better the model generalizes. This perhaps counterintuitive conclusion implies that the prevailing thinking on interference that it is only detrimental to the edge learning system is outdated and we shall seek new techniques that exploit, rather than simply mitigate, the interference for better machine learning in wireless networks.


Generalised Howe dualityand injectivity of induction the symplectic case. We study the symplectic Howe duality using two new and independent combinatorial methods via determinantal formulae on the one hand, and via (bi)crystals on the other hand. The first approach allows us to establish a generalised version where weight multiplicities are replaced by branching coefficients. In turn, this generalised Howe duality is used to prove the injectivity of induction for Levi branchings as previously conjectured by the last two authors.


Simple closed geodesics in cusped hyperbolic 3 manifolds. We show that cusped finite volume hyperbolic 3 manifolds contain infinitely many simple closed geodesics.


Universal sequences of composition operators. Let G and Omega be two planar domains. We give necessary and sufficient conditions on a sequence ( phi n) of eventually injective holomorphic mappings from G to Omega for the existence of a function f in H( Omega) whose orbit under the composition by ( phi n) is dense in H(G) . This extends a result of the same nature obtained by Grosse Erdmann and Mortini when G Omega . An interconnexion between the topological properties of G and Omega appears. Further, in order to exhibit in a natural way holomorphic functions with wild boundary behaviour on planar domains, we study a certain type of universality for sequences of continuous mappings from a union of Jordan curves to a domain.


Triangular Bidword Generation for Sponsored Search Auction. Sponsored search auction is a crucial component of modern search engines. It requires a set of candidate bidwords that advertisers can place bids on. Existing methods generate bidwords from search queries or advertisement content. However, they suffer from the data noise in query, bidword and advertisement, bidword pairs. In this paper, we propose a triangular bidword generation model (TRIDENT), which takes the high quality data of paired query, advertisement as a supervision signal to indirectly guide the bidword generation process. Our proposed model is simple yet effective by using bidword as the bridge between search query and advertisement, the generation of search query, advertisement and bidword can be jointly learned in the triangular training framework. This alleviates the problem that the training data of bidword may be noisy. Experimental results, including automatic and human evaluations, show that our proposed TRIDENT can generate relevant and diverse bidwords for both search queries and advertisements. Our evaluation on online real data validates the effectiveness of the TRIDENT's generated bidwords for product search.


Bounds for spectral projectors on tori. We investigate norms of spectral projectors on thin spherical shells for the Laplacian on tori. This is closely related to the boundedness of resolvents of the Laplacian, and to the boundedness of L p norms of eigenfunctions of the Laplacian. We formulate a conjecture, and partially prove it.


DBC Forest Deep forest with binning confidence screening. As a deep learning model, deep confidence screening forest (gcForestcs) has achieved great success in various applications. Compared with the traditional deep forest approach, gcForestcs effectively reduces the high time cost by passing some instances in the high confidence region directly to the final stage. However, there is a group of instances with low accuracy in the high confidence region, which are called mis partitioned instances. To find these mis partitioned instances, this paper proposes a deep binning confidence screening forest (DBC Forest) model, which packs all instances into bins based on their confidences. In this way, more accurate instances can be passed to the final stage, and the performance is improved. Experimental results show that DBC Forest achieves highly accurate predictions for the same hyperparameters and is faster than other similar models to achieve the same accuracy.


Annihilators and associated varieties of Harish Chandra modules for SO (2n) . Given a simple Harish Chandra module for this group of trivial infinitesimal character, parametrized by a signed involution, we produce combinatorial recipes for attaching to it a pair of tableaux from which its annihilator and associated variety can be read off.


Purcell enhancement of a cavity coupled emitter in hexagonal boron nitride. Integration of solid state quantum emitters into nanophotonic circuits is a critical step towards fully on chip quantum photonic based technologies. Among potential materials platforms, quantum emitters in hexagonal boron nitride have emerged over the last years as viable candidate. While the fundamental physical properties have been intensively studied over the last years, only few works have focused on the emitter integration into photonic resonators. Yet, for a potential quantum photonic material platform, the integration with nanophotonic cavities is an important cornerstone, as it enables the deliberate tuning of the spontaneous emission and the improved readout of distinct transitions for that quantum emitter. In this work, we demonstrate the resonant tuning of an integrated monolithic hBN quantum emitter in a photonic crystal cavity through gas condensation at cryogenic temperature. We resonantly coupled the zero phonon line of the emitter to a cavity mode and demonstrate emission enhancement and lifetime reduction, with an estimation for the Purcell factor of 15.


Matrix H "older's inequality and divergence formulation of optimal transport of vector measures. We characterise equality cases in matrix H "older's inequality and develop a divergence formulation of optimal transport of vector measures. As an application, we reprove the representation formula for measures in the polar cone to monotone maps. We generalise the last result to a wide class of polar cones, including polar cones to tangent cones to the unit ball in the space of differentiable functions and in the Sobolev spaces.


Large data equicontinuity for the derivative NLS. We consider the derivative NLS equation in one spatial dimension, which is known to be completely integrable. We prove that the orbits of L 2 bounded and equicontinuous sets of initial data remain bounded and equicontinuous, not only under this flow, but under the entire hierarchy. This allows us to remove the small data restriction from prior conservation laws and global well posedness results.


Transfer function asymmetry in Fabry P 'erot based optical pressure sensors. Optical resonators are one of the most promising optical devices for manufacturing high performance pressure sensors for photoacoustic imaging. Among these, Fabry P 'erot (FP) based pressure sensors have been successfully used for a multitude of applications. However, critical performance aspects of FP based pressure sensors have not been extensively studied, including the effects system parameters such as beam diameter and cavity misalignment have on transfer function shape. Here, we discuss the possible origins of the transfer function asymmetry, the impact it has on measurement sensitivity as well as ways to correctly estimate the FP pressure sensitivity under practical experimental conditions.


HIH Towards More Accurate Face Alignment via Heatmap in Heatmap. Heatmap based regression overcomes the lack of spatial and contextual information of direct coordinate regression, and has revolutionized the task of face alignment. Yet it suffers from quantization errors caused by neglecting subpixel coordinates in image resizing and network downsampling. In this paper, we first quantitatively analyze the quantization error on benchmarks, which accounts for more than 1 3 of the whole prediction errors for state of the art methods. To tackle this problem, we propose a novel Heatmap In Heatmap(HIH) representation and a coordinate soft classification (CSC) method, which are seamlessly integrated into the classic hourglass network. The HIH representation utilizes nested heatmaps to jointly represent the coordinate label one heatmap called integer heatmap stands for the integer coordinate, and the other heatmap named decimal heatmap represents the subpixel coordinate. The range of a decimal heatmap makes up one pixel in the corresponding integer heatmap. Besides, we transfer the offset regression problem to an interval classification task, and CSC regards the confidence of the pixel as the probability of the interval. Meanwhile, CSC applying the distribution loss leverage the soft labels generated from the Gaussian distribution function to guide the offset heatmap training, which makes it easier to learn the distribution of coordinate offsets. Extensive experiments on challenging benchmark datasets demonstrate that our HIH can achieve state of the art results. In particular, our HIH reaches 4.08 NME (Normalized Mean Error) on WFLW, and 3.21 on COFW, which exceeds previous methods by a significant margin.


Weakly nonlinear multiphase geometric optics for hyperbolic quasilinear boundary value problems Construction of a leading profile. We investigate in this paper the existence of the leading profile of a WKB expansion for quasilinear initial boundary value problems with a highly oscillating forcing boundary term. The framework is weakly nonlinear, as the boundary term is of order O( epsilon ) where the frequencies are of order O(1 epsilon ). We consider here multiple phases on the boundary, generating a countable infinite number of phases inside the domain, and we therefore use an almost periodic functional framework. The major difficulties of this work are the lack of symmetry in the leading profile equation and the occurrence of infinitely many resonances (opposite to the simple phase case studied earlier) The leading profile is constructed as the solution of a quasilinear problem, which is solved using a priori estimates without loss of derivatives. The assumptions of this work are illustrated with the example of isentropic Euler equations in space dimension two.


Brownian bridge expansions for L 'evy area approximations and particular values of the Riemann zeta function. We study approximations for the L 'evy area of Brownian motion which are based on the Fourier series expansion and a polynomial expansion of the associated Brownian bridge. Comparing the asymptotic convergence rates of the L 'evy area approximations, we see that the approximation resulting from the polynomial expansion of the Brownian bridge is more accurate than the Kloeden Platen Wright approximation, whilst still only using independent normal random vectors. We then link the asymptotic convergence rates of these approximations to the limiting fluctuations for the corresponding series expansions of the Brownian bridge. Moreover, and of interest in its own right, the analysis we use to identify the fluctuation processes for the Karhunen Lo eve and Fourier series expansions of the Brownian bridge is extended to give a stand alone derivation of the values of the Riemann zeta function at even positive integers.


Practitioners' Perceptions of the Goals and Visual Explanations of Defect Prediction Models. Software defect prediction models are classifiers that are constructed from historical software data. Such software defect prediction models have been proposed to help developers optimize the limited Software Quality Assurance (SQA) resources and help managers develop SQA plans. Prior studies have different goals for their defect prediction models and use different techniques for generating visual explanations of their models. Yet, it is unclear what are the practitioners' perceptions of (1) these defect prediction model goals, and (2) the model agnostic techniques used to visualize these models. We conducted a qualitative survey to investigate practitioners' perceptions of the goals of defect prediction models and the model agnostic techniques used to generate visual explanations of defect prediction models. We found that (1) 82 84 of the respondents perceived that the three goals of defect prediction models are useful (2) LIME is the most preferred technique for understanding the most important characteristics that contributed to a prediction of a file, while ANOVA VarImp is the second most preferred technique for understanding the characteristics that are associated with software defects in the past. Our findings highlight the significance of investigating how to improve the understanding of defect prediction models and their predictions. Hence, model agnostic techniques from explainable AI domain may help practitioners to understand defect prediction models and their predictions.


High order Tensor Pooling with Attention for Action Recognition. We aim at capturing high order statistics of feature vectors formed by a neural network, and propose end to end second and higher order pooling to form a tensor descriptor. Tensor descriptors require a robust similarity measure due to low numbers of aggregated vectors and the burstiness phenomenon, when a given feature appears more less frequently than statistically expected. We show that the Heat Diffusion Process (HDP) on a graph Laplacian is closely related to the Eigenvalue Power Normalization (EPN) of the covariance auto correlation matrix, whose inverse forms a loopy graph Laplacian. We show that the HDP and the EPN play the same role, i.e., to boost or dampen the magnitude of the eigenspectrum thus preventing the burstiness. Finally, we equip higher order tensors with EPN which acts as a spectral detector of higher order occurrences to prevent burstiness. We prove that for a tensor of order r built from d dimensional feature descriptors, such a detector gives the likelihood if at least one higher order occurrence is projected' into one of binom(d,r) subspaces represented by the tensor thus forming a tensor power normalization metric endowed with binom(d,r) such detectors'.


PatchX Explaining Deep Models by Intelligible Pattern Patches for Time series Classification. The classification of time series data is pivotal for streaming data and comes with many challenges. Although the amount of publicly available datasets increases rapidly, deep neural models are only exploited in a few areas. Traditional methods are still used very often compared to deep neural models. These methods get preferred in safety critical, financial, or medical fields because of their interpretable results. However, their performance and scale ability are limited, and finding suitable explanations for time series classification tasks is challenging due to the concepts hidden in the numerical time series data. Visualizing complete time series results in a cognitive overload concerning our perception and leads to confusion. Therefore, we believe that patch wise processing of the data results in a more interpretable representation. We propose a novel hybrid approach that utilizes deep neural networks and traditional machine learning algorithms to introduce an interpretable and scale able time series classification approach. Our method first performs a fine grained classification for the patches followed by sample level classification.


Multimodal Classification Current Landscape, Taxonomy and Future Directions. Multimodal classification research has been gaining popularity in many domains that collect more data from multiple sources including satellite imagery, biometrics, and medicine. However, the lack of consistent terminology and architectural descriptions makes it difficult to compare different existing solutions. We address these challenges by proposing a new taxonomy for describing such systems based on trends found in recent publications on multimodal classification. Many of the most difficult aspects of unimodal classification have not yet been fully addressed for multimodal datasets including big data, class imbalance, and instance level difficulty. We also provide a discussion of these challenges and future directions.


Predominance of pressure transport in spatial energy budget for a mixing layer approaching absolute instability. In this letter, we report the outcome of a spatial energy budget performed for the linear convective instability of the plane incompressible mixing layer within the inviscid framework. We find that, as the critical condition for the onset of absolute instability is approached, the integrated pressure transport term becomes increasingly more prominent as compared to the integrated production term and it dominates the energy budget completely at the critical condition. This implies that, near the threshold of absolute instability, the growth of disturbances is almost entirely due to the pressure transport mechanism (rather than the production mechanism), which is a striking result. The part of the pressure transport term that represents the work done by the fluctuating pressure forces is seen to be primarily responsible for the observed shift in the energy balance. These results can help us better understand the physical processes causing absolute instability in a mixing layer. In particular, the redistribution of disturbance energy in streamwise direction by fluctuating pressure, which is "non local" in character for incompressible flows, seems to play a key role in this respect.


Machine learning custom made basis functions for partial differential equations. Spectral methods are an important part of scientific computing's arsenal for solving partial differential equations (PDEs). However, their applicability and effectiveness depend crucially on the choice of basis functions used to expand the solution of a PDE. The last decade has seen the emergence of deep learning as a strong contender in providing efficient representations of complex functions. In the current work, we present an approach for combining deep neural networks with spectral methods to solve PDEs. In particular, we use a deep learning technique known as the Deep Operator Network (DeepONet), to identify candidate functions on which to expand the solution of PDEs. We have devised an approach which uses the candidate functions provided by the DeepONet as a starting point to construct a set of functions which have the following properties i) they constitute a basis, 2) they are orthonormal, and 3) they are hierarchical i.e., akin to Fourier series or orthogonal polynomials. We have exploited the favorable properties of our custom made basis functions to both study their approximation capability and use them to expand the solution of linear and nonlinear time dependent PDEs.


Generalized Schreier sets, linear recurrence relation, Tur ' a n graphs. We prove a linear recurrence relation for a large family of generalized Schreier sets, which generalizes the Fibonacci recurrence proved by Bird and higher order Fibonacci recurrence proved by the second author et al. Furthermore, we show a relationship between Schreier type sets and Tur ' a n graphs.


Bayesian and Dempster Shafer models for combining multiple sources of evidence in a fraud detection system. Combining evidence from different sources can be achieved with Bayesian or Dempster Shafer methods. The first requires an estimate of the priors and likelihoods while the second only needs an estimate of the posterior probabilities and enables reasoning with uncertain information due to imprecision of the sources and with the degree of conflict between them. This paper describes the two methods and how they can be applied to the estimation of a global score in the context of fraud detection.


Exploiting Rich Syntax for Better Knowledge Base Question Answering. Recent studies on Knowledge Base Question Answering (KBQA) have shown great progress on this task via better question understanding. Previous works for encoding questions mainly focus on the word sequences, but seldom consider the information from syntactic trees.In this paper, we propose an approach to learn syntax based representations for KBQA. First, we encode path based syntax by considering the shortest dependency paths between keywords. Then, we propose two encoding strategies to mode the information of whole syntactic trees to obtain tree based syntax. Finally, we combine both path based and tree based syntax representations for KBQA. We conduct extensive experiments on a widely used benchmark dataset and the experimental results show that our syntax aware systems can make full use of syntax information in different settings and achieve state of the art performance of KBQA.


A Pivot Gray Code Listing for the Spanning Trees of the Fan Graph. We use a greedy strategy to list the spanning trees of the fan graph, F n , such that successive trees differ by pivoting a single edge around a vertex. It is the first greedy algorithm for exhaustively generating spanning trees using such a minimal change operation. The resulting listing is then studied to find a recursive algorithm that produces the same listing in O(1) amortized time using O(n) space. Additionally, we present O(n) time algorithms for ranking and unranking the spanning trees for our listing an improvement over the generic O(n 3) time algorithm for ranking and unranking spanning trees of an arbitrary graph.


Commonsense Knowledge Aware Concept Selection For Diverse and Informative Visual Storytelling. Visual storytelling is a task of generating relevant and interesting stories for given image sequences. In this work we aim at increasing the diversity of the generated stories while preserving the informative content from the images. We propose to foster the diversity and informativeness of a generated story by using a concept selection module that suggests a set of concept candidates. Then, we utilize a large scale pre trained model to convert concepts and images into full stories. To enrich the candidate concepts, a commonsense knowledge graph is created for each image sequence from which the concept candidates are proposed. To obtain appropriate concepts from the graph, we propose two novel modules that consider the correlation among candidate concepts and the image concept correlation. Extensive automatic and human evaluation results demonstrate that our model can produce reasonable concepts. This enables our model to outperform the previous models by a large margin on the diversity and informativeness of the story, while retaining the relevance of the story to the image sequence.