Electric field dependent g factor for the ground state of lead monofluoride, PbF. The electric field dependent g factor and the electron electric dipole moment (eEDM) induced Stark splittings for the lowest rotational levels of 207,208 PbF are calculated. Observed and calculated Zeeman shifts for 207 PbF are found to be in very good agreement. It is shown that the 207 PbF hyperfine sublevels provide a promising system for the eEDM search and related experiments.


Two Disjoint Alternating Paths in Bipartite Graphs. A bipartite graph B is called a brace if it is connected and every matching of size at most two in B is contained in some perfect matching of B and a cycle C in B is called conformal if B V(C) has a perfect matching. We show that there do not exist two disjoint alternating paths that form a cross over a conformal cycle C in a brace B if and only if one can reduce B, by an application of a matching theoretic analogue of small clique sums, to a planar brace H in which C bounds a face. We then utilise this result and provide a polynomial time algorithm which solves the 2 linkage problem for alternating paths in bipartite graphs with perfect matchings.


Landis type conjecture for the half Laplacian. In this paper, we study the Landis type conjecture, i.e., unique continuation property from infinity, of the fractional Schr " o dinger equation with drift and potential terms. We show that if any solution of the equation decays at a certain exponential rate, then it must be trivial. The main ingredients of our proof are the Caffarelli Silvestre extension and Armitage's Liouville type theorem.


Graceful Degradation and Related Fields. When machine learning models encounter data which is out of the distribution on which they were trained they have a tendency to behave poorly, most prominently over confidence in erroneous predictions. Such behaviours will have disastrous effects on real world machine learning systems. In this field graceful degradation refers to the optimisation of model performance as it encounters this out of distribution data. This work presents a definition and discussion of graceful degradation and where it can be applied in deployed visual systems. Following this a survey of relevant areas is undertaken, novelly splitting the graceful degradation problem into active and passive approaches. In passive approaches, graceful degradation is handled and achieved by the model in a self contained manner, in active approaches the model is updated upon encountering epistemic uncertainties. This work communicates the importance of the problem and aims to prompt the development of machine learning strategies that are aware of graceful degradation.


Temporal Spatial Causal Interpretations for Vision Based Reinforcement Learning. Deep reinforcement learning (RL) agents are becoming increasingly proficient in a range of complex control tasks. However, the agent's behavior is usually difficult to interpret due to the introduction of black box function, making it difficult to acquire the trust of users. Although there have been some interesting interpretation methods for vision based RL, most of them cannot uncover temporal causal information, raising questions about their reliability. To address this problem, we present a temporal spatial causal interpretation (TSCI) model to understand the agent's long term behavior, which is essential for sequential decision making. TSCI model builds on the formulation of temporal causality, which reflects the temporal causal relations between sequential observations and decisions of RL agent. Then a separate causal discovery network is employed to identify temporal spatial causal features, which are constrained to satisfy the temporal causality. TSCI model is applicable to recurrent agents and can be used to discover causal features with high efficiency once trained. The empirical results show that TSCI model can produce high resolution and sharp attention masks to highlight task relevant temporal spatial information that constitutes most evidence about how vision based RL agents make sequential decisions. In addition, we further demonstrate that our method is able to provide valuable causal interpretations for vision based RL agents from the temporal perspective.


Morse theory for loop free categories. We extend discrete Morse Bott theory to the setting of loop free (or acyclic) categories. First of all, we state a homological version of Quillen's Theorem A in this context and introduce the notion of cellular categories. Second, we present a notion of vector field for loop free categories. Third, we prove a homological collapsing theorem in the absence of critical objects in order to obtain the Morse inequalities. Examples are provided through the exposition. This answers partially a question by T. John whether there is a Morse theory for loop free (or acyclic) categories? 14 .


Mechanistic Interpretation of Machine Learning Inference A Fuzzy Feature Importance Fusion Approach. With the widespread use of machine learning to support decision making, it is increasingly important to verify and understand the reasons why a particular output is produced. Although post training feature importance approaches assist this interpretation, there is an overall lack of consensus regarding how feature importance should be quantified, making explanations of model predictions unreliable. In addition, many of these explanations depend on the specific machine learning approach employed and on the subset of data used when calculating feature importance. A possible solution to improve the reliability of explanations is to combine results from multiple feature importance quantifiers from different machine learning approaches coupled with re sampling. Current state of the art ensemble feature importance fusion uses crisp techniques to fuse results from different approaches. There is, however, significant loss of information as these approaches are not context aware and reduce several quantifiers to a single crisp output. More importantly, their representation of 'importance' as coefficients is misleading and incomprehensible to end users and decision makers. Here we show how the use of fuzzy data fusion methods can overcome some of the important limitations of crisp fusion methods.


A secure home automation prototype built on raspberry pi. With the development of sensors, wireless mobile communication, embedded system, the technologies of the Internet of Things have been widely used in SmartMeter, public security, intelligent building and so on. Because of its huge market prospects, the Internet of Things has been paid close attention by several governments all over the world. IoT facilitates the seamless integration of wireless sensor networks. In this paper, we present an IoT prototype that is built on Raspberry Pi and uses SMTP (simple mail transfer protocol) for communication. Through this device, we have proposed a communication system that is less complex and more secure. It integrates with any "thing" and makes it electronically communicable. We give an implementation of the prototyping system and system validation.


Language Models are Few shot Multilingual Learners. General purpose language models have demonstrated impressive capabilities, performing on par with state of the art approaches on a range of downstream natural language processing (NLP) tasks and benchmarks when inferring instructions from very few examples. Here, we evaluate the multilingual skills of the GPT and T5 models in conducting multi class classification on non English languages without any parameter updates. We show that, given a few English examples as context, pre trained language models can predict not only English test samples but also non English ones. Finally, we find the in context few shot cross lingual prediction results of language models are significantly better than random prediction, and they are competitive compared to the existing state of the art cross lingual models.


Adaptive packet transmission in response to anomaly detection in software defined smart meter networks. In this paper, we examine a basic smart meter network topology in mininet and address the issue of congestion over a commodity network, proposing an adaptive algorithm to cope with varying grid data delivery latencies.


Improved computation of fundamental domains for arithmetic Fuchsian groups. The fundamental domain of an arithmetic Fuchsian group Gamma reveals a lot of interesting information about the group. An algorithm to efficiently compute this fundamental domain in practice was given by Voight, and it was later expanded by Page to the case of arithmetic Kleinian groups. Page's version featured a probabilistic enumeration of group elements, which performed significantly better than Voight's deterministic enumeration. In this paper, we improve on the geometric algorithms described by Voight, and specialize Page's enumeration down to Fuchsian groups, to produce a final algorithm that is much more efficient. Optimal choices of constants in the enumeration are given by heuristics, which are supported by large amounts of data. This algorithm has been implemented in PARI GP, and we demonstrate its practicality by comparing running times versus the live Magma implementation of Voight's algorithm.


How the University Portal Inspired Changes in the Academic Assessment Culture. Information retrieval (IR) is known facilitator of changes ongoing in human society and vice versa. This is due to the fact that IR is a key component of the digital ecosystems, where both information providers and information consumers collaboratively address their problems with the use of technologies. Organization and design of such ecosystems drives particular social impact for all the players involved. In this paper, we study the impact made by a particular IR ecosystem (semantic portal) used for management of academic information resources and processes within the Ukrainian higher education. We show how this portal is changing a collective mindset of the academic community of its users. We argue that such impact becomes possible due to specific organization of the ecosystem, where all the information resources, IR services and related analytics (search, assessment, ranking, etc.) and IR users inhabit the same semantic space under umbrella of the corresponding ontologies. Personal values and preferences of the users configure on the fly the corresponding IR analytics and enable personalized value driven IR services, making everyone feel involved into the organizational decision making processes. Four years of active use of this portal in university environment has been reported and related impact is evaluated in this study.


Weakly Supervised Temporal Action Localization Through Learning Explicit Subspaces for Action and Context. Weakly supervised Temporal Action Localization (WS TAL) methods learn to localize temporal starts and ends of action instances in a video under only video level supervision. Existing WS TAL methods rely on deep features learned for action recognition. However, due to the mismatch between classification and localization, these features cannot distinguish the frequently co occurring contextual background, i.e., the context, and the actual action instances. We term this challenge action context confusion, and it will adversely affect the action localization accuracy. To address this challenge, we introduce a framework that learns two feature subspaces respectively for actions and their context. By explicitly accounting for action visual elements, the action instances can be localized more precisely without the distraction from the context. To facilitate the learning of these two feature subspaces with only video level categorical labels, we leverage the predictions from both spatial and temporal streams for snippets grouping. In addition, an unsupervised learning task is introduced to make the proposed module focus on mining temporal information. The proposed approach outperforms state of the art WS TAL methods on three benchmarks, i.e., THUMOS14, ActivityNet v1.2 and v1.3 datasets.


A Session Subtyping Tool (Extended Version). Session types are becoming popular and have been integrated in several mainstream programming languages. Nevertheless, while many programming languages consider asynchronous fifo channel communication, the notion of subtyping used in session type implementations is the one defined by Gay and Hole for synchronous communication. This might be because there are several notions of asynchronous session subtyping, these notions are usually undecidable, and only recently sound (but not complete) algorithmic characterizations for these subtypings have been proposed. But the fact that the definition of asynchronous session subtyping and the theory behind related algorithms are not easily accessible to non experts may also prevent further integration. The aim of this paper, and of the tool presented therein, is to make the growing body of knowledge about asynchronous session subtyping more accessible, thus promoting its integration in practical applications of session types.


Liouville theorem and a priori estimates of radial solutions for a non cooperative elliptic system. Liouville theorems for scaling invariant nonlinear elliptic systems (saying that the system does not possess nontrivial entire solutions) guarantee a priori estimates of solutions of related, more general systems. Assume that p 2q 3 1 is Sobolev subritical, n le3 and beta in mathbb R . We first prove a Liouville theorem for the system left. begin aligned Delta u u 2q 2 u beta v q 2 u q u, Delta v v 2q 2 v beta u q 2 v q v, end aligned right quad hbox in quad mathbb R n, in the class of radial functions (u,v) such that the number of nodal domains of u,v,u v,u v is finite. Then we use this theorem to obtain a priori estimates of solutions to related elliptic systems. In the cubic case q 0 , those solutions correspond to the solitary waves of a system of Schr "odinger equations, and their existence and multiplicity have been intensively studied by various methods. One of those methods is based on a priori estimates of suitable global solutions of corresponding parabolic systems. Unlike the previous studies, our Liouville theorem yields those estimates for all q geq0 which are Sobolev subcritical.


TBN ViT Temporal Bilateral Network with Vision Transformer for Video Scene Parsing. Video scene parsing in the wild with diverse scenarios is a challenging and great significance task, especially with the rapid development of automatic driving technique. The dataset Video Scene Parsing in the Wild(VSPW) contains well trimmed long temporal, dense annotation and high resolution clips. Based on VSPW, we design a Temporal Bilateral Network with Vision Transformer. We first design a spatial path with convolutions to generate low level features which can preserve the spatial information. Meanwhile, a context path with vision transformer is employed to obtain sufficient context information. Furthermore, a temporal context module is designed to harness the inter frames contextual information. Finally, the proposed method can achieve the mean intersection over union(mIoU) of 49.85 for the VSPW2021 Challenge test dataset.


A Low Power In Memory Multiplication andAccumulation Array with Modified Radix 4 Inputand Canonical Signed Digit Weights. A mass of data transfer between the processing and storage units has been the leading bottleneck in modern Von Neuman computing systems, especially when used for Artificial Intelligence (AI) tasks. Computing in Memory (CIM) has shown great potential to reduce both latency and power consumption. However, the conventional analog CIM schemes are suffering from reliability issues, which may significantly degenerate the accuracy of the computation. Recently, CIM schemes with digitized input data and weights have been proposed for high reliable computing. However, the properties of the digital memory and input data are not fully utilized. This paper presents a novel low power CIM scheme to further reduce the power consumption by using a Modified Radix 4 (M RD4) booth algorithm at the input and a Modified Canonical Signed Digit (M CSD) for the network weights. The simulation results show that M Rd4 and M CSD reduce the ratio of 1 times1 by 78.5 on LeNet and 80.2 on AlexNet, and improve the computing efficiency by 41.6 in average. The computing power rate at the fixed point 8 bit is 60.68 TOPS s W.


Neural Architecture Search of Deep Priors Towards Continual Learning without Catastrophic Interference. In this paper we analyze the classification performance of neural network structures without parametric inference. Making use of neural architecture search, we empirically demonstrate that it is possible to find random weight architectures, a deep prior, that enables a linear classification to perform on par with fully trained deep counterparts. Through ablation experiments, we exclude the possibility of winning a weight initialization lottery and confirm that suitable deep priors do not require additional inference. In an extension to continual learning, we investigate the possibility of catastrophic interference free incremental learning. Under the assumption of classes originating from the same data distribution, a deep prior found on only a subset of classes is shown to allow discrimination of further classes through training of a simple linear classifier.


On Anytime Learning at Macroscale. In many practical applications of machine learning data arrives sequentially over time in large chunks. Practitioners have then to decide how to allocate their computational budget in order to obtain the best performance at any point in time. Online learning theory for convex optimization suggests that the best strategy is to use data as soon as it arrives. However, this might not be the best strategy when using deep non linear networks, particularly when these perform multiple passes over each chunk of data rendering the overall distribution non i.i.d.. In this paper, we formalize this learning setting in the simplest scenario in which each data chunk is drawn from the same underlying distribution, and make a first attempt at empirically answering the following questions How long should the learner wait before training on the newly arrived chunks? What architecture should the learner adopt? Should the learner increase capacity over time as more data is observed? We probe this learning setting using convolutional neural networks trained on classic computer vision benchmarks as well as a large transformer model trained on a large scale language modeling task. Code is available at url www.github.com facebookresearch ALMA .


Emergent Communication under Competition. The literature in modern machine learning has only negative results for learning to communicate between competitive agents using standard RL. We introduce a modified sender receiver game to study the spectrum of partially competitive scenarios and show communication can indeed emerge in a competitive setting. We empirically demonstrate three key takeaways for future research. First, we show that communication is proportional to cooperation, and it can occur for partially competitive scenarios using standard learning algorithms. Second, we highlight the difference between communication and manipulation and extend previous metrics of communication to the competitive case. Third, we investigate the negotiation game where previous work failed to learn communication between independent agents (Cao et al., 2018). We show that, in this setting, both agents must benefit from communication for it to emerge and, with a slight modification to the game, we demonstrate successful communication between competitive agents. We hope this work overturns misconceptions and inspires more research in competitive emergent communication.


The JDDC 2.0 Corpus A Large Scale Multimodal Multi Turn Chinese Dialogue Dataset for E commerce Customer Service. With the development of the Internet, more and more people get accustomed to online shopping. When communicating with customer service, users may express their requirements by means of text, images, and videos, which precipitates the need for understanding these multimodal information for automatic customer service systems. Images usually act as discriminators for product models, or indicators of product failures, which play important roles in the E commerce scenario. On the other hand, detailed information provided by the images is limited, and typically, customer service systems cannot understand the intents of users without the input text. Thus, bridging the gap of the image and text is crucial for the multimodal dialogue task. To handle this problem, we construct JDDC 2.0, a large scale multimodal multi turn dialogue dataset collected from a mainstream Chinese E commerce platform (JD.com), containing about 246 thousand dialogue sessions, 3 million utterances, and 507 thousand images, along with product knowledge bases and image category annotations. We present the solutions of top 5 teams participating in the JDDC multimodal dialogue challenge based on this dataset, which provides valuable insights for further researches on the multimodal dialogue task.


The Maximal Subgroups of the Exceptional Groups F 4(q) , E 6(q) and 2E 6(q) and Related Almost Simple Groups. This article produces a complete list of all maximal subgroups of the finite simple groups of type F 4 , E 6 and twisted E 6 over all finite fields. Along the way, we determine the collection of Lie primitive almost simple subgroups of the corresponding algebraic groups. We give the stabilizers under the actions of outer automorphisms, from which one can obtain complete information about the maximal subgroups of all almost simple groups with socle one of these groups. We also provide a new maximal subgroup of 2 !F 4(8) , correcting the maximal subgroups for that group from the list of Malle. This provides the first new exceptional groups of Lie type to have their maximal subgroups enumerated for three decades. The techniques are a mixture of algebraic groups, representation theory, computational algebra, and use of the trilinear form on the 27 dimensional minimal module for E 6 . We provide a collection of auxiliary Magma files that prove the author's computational claims, yielding existence and the number of conjugacy classes of all maximal subgroups mentioned in the text.


Perfect Sampling in Infinite Spin Systems via Strong Spatial Mixing. We present a simple algorithm that perfectly samples configurations from the unique Gibbs measure of a spin system on a potentially infinite graph G . The sampling algorithm assumes strong spatial mixing together with subexponential growth of G . It produces a finite window onto a perfect sample from the Gibbs distribution. The run time is linear in the size of the window.


PathEnum Towards Real Time Hop Constrained s t Path Enumeration. We study the hop constrained s t path enumeration (HcPE) problem, which takes a graph G , two distinct vertices s,t and a hop constraint k as input, and outputs all paths from s to t whose length is at most k . The state of the art algorithms suffer from severe performance issues caused by the costly pruning operations during enumeration for the workloads with the large search space. Consequently, these algorithms hardly meet the real time constraints of many online applications. In this paper, we propose PathEnum, an efficient index based algorithm towards real time HcPE. For an input query, PathEnum first builds a light weight index aiming to reduce the number of edges involved in the enumeration, and develops efficient index based approaches for enumeration, one based on depth first search and the other based on joins. We further develop a query optimizer based on a join based cost model to optimize the search order. We conduct experiments with 15 real world graphs. Our experiment results show that PathEnum outperforms the state of the art approaches by orders of magnitude in terms of the query time, throughput and response time.


Families of extensions of the Kantorovich Rubinstein and Lipschitz norms. We propose a family of extensions of the Kantorovich Rubinstein norm from the space of zero charge countably additive measures on a compact metric space to the space of all countably additive measures, and a family of extensions of the Lipschitz norm from the quotient space of Lipschitz functions on a compact metric space to the space of all Lipschitz functions. These families are parameterized by p,q in 1, infty , and if p,q are H "older conjugates, then the dual of the resulting p Kantorovich space is isometrically isomorphic to the resulting q Lipschitz space.


Active Face Frontalization using Commodity Unmanned Aerial Vehicles. This paper describes a system by which Unmanned Aerial Vehicles (UAVs) can gather high quality face images that can be used in biometric identification tasks. Success in face based identification depends in large part on the image quality, and a major factor is how frontal the view is. Face recognition software pipelines can improve identification rates by synthesizing frontal views from non frontal views by a process call em frontalization . Here we exploit the high mobility of UAVs to actively gather frontal images using components of a synthetic frontalization pipeline. We define a frontalization error and show that it can be used to guide an UAVs to capture frontal views. Further, we show that the resulting image stream improves matching quality of a typical face recognition similarity metric. The system is implemented using an off the shelf hardware and software components and can be easily transfered to any ROS enabled UAVs.


Adversarial Robustness by Design through Analog Computing and Synthetic Gradients. We propose a new defense mechanism against adversarial attacks inspired by an optical co processor, providing robustness without compromising natural accuracy in both white box and black box settings. This hardware co processor performs a nonlinear fixed random transformation, where the parameters are unknown and impossible to retrieve with sufficient precision for large enough dimensions. In the white box setting, our defense works by obfuscating the parameters of the random projection. Unlike other defenses relying on obfuscated gradients, we find we are unable to build a reliable backward differentiable approximation for obfuscated parameters. Moreover, while our model reaches a good natural accuracy with a hybrid backpropagation synthetic gradient method, the same approach is suboptimal if employed to generate adversarial examples. We find the combination of a random projection and binarization in the optical system also improves robustness against various types of black box attacks. Finally, our hybrid training method builds robust features against transfer attacks. We demonstrate our approach on a VGG like architecture, placing the defense on top of the convolutional features, on CIFAR 10 and CIFAR 100. Code is available at https github.com lightonai adversarial robustness by design.


On connections between Morita semigroups and strong Morita equivalence. A surjective Morita context connecting semigroups S and T yields a Morita semigroup and a strict local isomorphism from it onto S along which idempotents lift. We describe strong Morita equivalence of firm semigroups in terms of Morita semigroups and isomorphisms. We also generalize some of Hotzel's theorems to semigroups with weak local units. In particular, the Morita semigroup induced by a dual pair beta over a semigroup with weak local units is isomorphic to Sigma beta .


Linear Differential Equation with Formal Power Series Non Homogeneity Over a Ring with a Non Archimedean Valuation. Consider the linear differential equation of m th order with constant coefficients from the valuation ring K of a non Archimedean field. We get sufficient conditions of uniqueness and existence for the solution of this equation from K x . Also the fundamental solution from frac 1 x K frac 1 x of the equation is obtained and it is shown that the convolution of the fundamental solution and a non homogeneity is a unique solution of the equation.


Ideals and Strong Axioms of Determinacy. We show that the following two theories are equiconsistent (T) ZFC, CH and "There is a dense ideal on the first uncountable cardinal such that if j is the generic embedding associated with it then its restriction on ordinals is independent of the generic object is". (S) ZF, ADR and "Theta is a regular cardinal." The main result of this paper is that T implies that the minimal model of S exists. Woodin, in unpublished work, showed that the consistency of S implies the consistency of T. We will also give a proof of this result, which, together with our main theorem, establishes the equiconsistency of T and S. Our main result partially resolves a well known conjecture of Woodin, and completely solves one of the main Core Model Induction problems dating back to 90s.


Automated Climate Analyses Using Knowledge Graph. The FAIR (Findable, Accessible, Interoperable, Reusable) data principles are fundamental for climate researchers and all stakeholders in the current digital ecosystem. In this paper, we demonstrate how relational climate data can be "FAIR" and modeled using RDF, in line with Semantic Web technologies and our Climate Analysis ontology. Thus, heterogeneous climate data can be stored in graph databases and offered as Linked Data on the Web. As a result, climate researchers will be able to use the standard SPARQL query language to query these sources directly on the Web. In this paper, we demonstrate the usefulness of our SPARQL endpoint for automated climate analytics. We illustrate two sample use cases that establish the advantage of representing climate data as knowledge graphs.


Dynamics of generic endomorphisms of Oka Stein manifolds. We study the dynamics of a generic endomorphism f of an Oka Stein manifold X . Such manifolds include all connected linear algebraic groups and, more generally, all Stein homogeneous spaces of complex Lie groups. We give several descriptions of the Fatou set and the Julia set of f . In particular, we show that the Julia set is the derived set of the set of attracting periodic points of f and that it is also the closure of the set of repelling periodic points of f . Among other results, we prove that f is chaotic on the Julia set and that every periodic point of f is hyperbolic. We also give an explicit description of the "Conley decomposition" of X induced by f into chain recurrence classes and basins of attractors. For X mathbb C , we prove that every Fatou component is a disc and that every point in the Fatou set is attracted to an attracting cycle or lies in a dynamically bounded wandering domain (whether such domains exist is an open question).


Cluster algebras of finite mutation type with coefficients. We classify mutation finite cluster algebras with arbitrary coefficients of geometric type.


Improving Distantly Supervised Named Entity Recognition with Self Collaborative Denoising Learning. Distantly supervised named entity recognition (DS NER) efficiently reduces labor costs but meanwhile intrinsically suffers from the label noise due to the strong assumption of distant supervision. Typically, the wrongly labeled instances comprise numbers of incomplete and inaccurate annotation noise, while most prior denoising works are only concerned with one kind of noise and fail to fully explore useful information in the whole training set. To address this issue, we propose a robust learning paradigm named Self Collaborative Denoising Learning (SCDL), which jointly trains two teacher student networks in a mutually beneficial manner to iteratively perform noisy label refinery. Each network is designed to exploit reliable labels via self denoising, and two networks communicate with each other to explore unreliable annotations by collaborative denoising. Extensive experimental results on five real world datasets demonstrate that SCDL is superior to state of the art DS NER denoising methods.


A Study of Fake News Reading and Annotating in Social Media Context. The online spreading of fake news is a major issue threatening entire societies. Much of this spreading is enabled by new media formats, namely social networks and online media sites. Researchers and practitioners have been trying to answer this by characterizing the fake news and devising automated methods for detecting them. The detection methods had so far only limited success, mostly due to the complexity of the news content and context and lack of properly annotated datasets. One possible way to boost the efficiency of automated misinformation detection methods, is to imitate the detection work of humans. It is also important to understand the news consumption behavior of online users. In this paper, we present an eye tracking study, in which we let 44 lay participants to casually read through a social media feed containing posts with news articles, some of which were fake. In a second run, we asked the participants to decide on the truthfulness of these articles. We also describe a follow up qualitative study with a similar scenario but this time with 7 expert fake news annotators. We present the description of both studies, characteristics of the resulting dataset (which we hereby publish) and several findings.


Elementary proof for the bounds of the complexity of a planar multigraph and the size of a prime rectangular squaring. Two results (together with their relatively elementary proofs) are presented. The first one presents the upper boundary on the number of spanning trees in a finite planar multigraph, proving that the complexity (the number of spanning trees) of a planar multigraph with n edges does not exceed tau n , where tau approx 1.8637 . This result is, quite possibly, already known and or published my quick web search did not turn up anything but that does not really prove much. It also seems plausible that this inequality is actually true for the "best possible" value of tau approx 1.7916 . The second result uses the above theorem to improve on the well known Conway's inequality for the number of tiles in a prime rectangular squaring.


OntoGUM Evaluating Contextualized SOTA Coreference Resolution on 12 More Genres. SOTA coreference resolution produces increasingly impressive scores on the OntoNotes benchmark. However lack of comparable data following the same scheme for more genres makes it difficult to evaluate generalizability to open domain data. This paper provides a dataset and comprehensive evaluation showing that the latest neural LM based end to end systems degrade very substantially out of domain. We make an OntoNotes like coreference dataset called OntoGUM publicly available, converted from GUM, an English corpus covering 12 genres, using deterministic rules, which we evaluate. Thanks to the rich syntactic and discourse annotations in GUM, we are able to create the largest human annotated coreference corpus following the OntoNotes guidelines, and the first to be evaluated for consistency with the OntoNotes scheme. Out of domain evaluation across 12 genres shows nearly 15 20 degradation for both deterministic and deep learning systems, indicating a lack of generalizability or covert overfitting in existing coreference resolution models.


Data Criticality in Multi Threaded Applications An Insight for Many Core Systems. Multi threaded applications are capable of exploiting the full potential of many core systems. However, Network on Chip (NoC) based inter core communication in many core systems is responsible for 60 75 of the miss latency experienced by multi threaded applications. Delay in the arrival of critical data at the requesting core severely hampers performance. This brief presents some interesting insights about how critical data is requested from the memory by multi threaded applications. Then it investigates the cause of delay in NoC and how it affects the performance. Finally, this brief shows how NoC aware memory access optimisations can significantly improve performance. Our experimental evaluation considers early restart memory access optimisation and demonstrates that by exploiting NoC resources, critical data can be prioritised to reduce miss penalty by 10 12 and improve system performance by 7 11 .


Effect of Na(I) on Bioavailability for Cr(VI) and Cr(III) Arthrobacter species. The biosorption of Cr(VI) and Cr(III) of Arthrobacter species (Arthrobacter globiformis and Arthrobacter oxidas) was studied application dialysis and atomic absorption analysis at various Na(I) concentrations. Is was shown significant difference between the binding constants as for Cr(VI) and Cr(III) Arthrobacter oxidas, as well as Cr(VI) and Cr(III) Arthrobacter globiformis at various Na(I) concentrations. It was shown, that bioavailability increases in both cases with decreases Na(I) concentration.


Social Media Monitoring for IoT Cyber Threats. The rapid development of IoT applications and their use in various fields of everyday life has resulted in an escalated number of different possible cyber threats, and has consequently raised the need of securing IoT devices. Collecting Cyber Threat Intelligence (e.g., zero day vulnerabilities or trending exploits) from various online sources and utilizing it to proactively secure IoT systems or prepare mitigation scenarios has proven to be a promising direction. In this work, we focus on social media monitoring and investigate real time Cyber Threat Intelligence detection from the Twitter stream. Initially, we compare and extensively evaluate six different machine learning based classification alternatives trained with vulnerability descriptions and tested with real world data from the Twitter stream to identify the best fitting solution. Subsequently, based on our findings, we propose a novel social media monitoring system tailored to the IoT domain the system allows users to identify recent trending vulnerabilities and exploits on IoT devices. Finally, to aid research on the field and support the reproducibility of our results we publicly release all annotated datasets created during this process.


Implicit gradients based novel finite volume scheme for compressible single and multi component flows. This paper introduces a novel approach to compute the numerical fluxes at the cell boundaries in the finite volume approach. Explicit gradients used in deriving the reconstruction polynomials are replaced by high order gradients computed by compact finite differences, referred to as implicit gradients in this paper. The new finite volume scheme has superior dispersion and dissipation properties in comparison to the compact reconstruction approach. These implicit gradients are re used in viscous flux computation and post processing, which further improves efficiency. A problem independent shock capturing approach via Boundary Variation Diminishing (BVD) algorithm is used to suppress oscillations for the simulation of flows with shocks and material interfaces. Several numerical test cases are carried out to verify the proposed finite volume method's capability using the implicit gradient method for single and multicomponent flows. Significant improvements are observed by computing the gradients implicitly for the viscous flows.


An Empirical Exploration in Quality Filtering of Text Data. While conventional wisdom suggests that more aggressively filtering data from low quality sources like Common Crawl always monotonically improves the quality of training data, we find that aggressive filtering can in fact lead to a decrease in model quality on a wide array of downstream tasks for a GPT like language model. We speculate that this is because optimizing sufficiently strongly for a proxy metric harms performance on the true objective, suggesting a need for more robust filtering objectives when attempting to filter more aggressively. We hope this work leads to detailed analysis of the effects of dataset filtering design choices on downstream model performance in future work.


Analysis of Executional and Procedural Errors in Dry lab Robotic Surgery Experiments. Background Analyzing kinematic and video data can help identify potentially erroneous motions that lead to sub optimal surgeon performance and safety critical events in robot assisted surgery. Methods We develop a rubric for identifying task and gesture specific Executional and Procedural errors and evaluate dry lab demonstrations of Suturing and Needle Passing tasks from the JIGSAWS dataset. We characterize erroneous parts of demonstrations by labeling video data, and use distribution similarity analysis and trajectory averaging on kinematic data to identify parameters that distinguish erroneous gestures. Results Executional error frequency varies by task and gesture, and correlates with skill level. Some predominant error modes in each gesture are distinguishable by analyzing error specific kinematic parameters. Procedural errors could lead to lower performance scores and increased demonstration times but also depend on surgical style. Conclusions This study provides insights into context dependent errors that can be used to design automated error detection mechanisms and improve training and skill assessment.


Assessing the performance of smart grid communication networks under both time and budget constraints. The smart grid concept has emerged to address the existing problems in the traditional electric grid, which has been functioning for more than a hundred years. The most crucial difference between traditional grids and smart grids is the communication infrastructure applied to the latter. However, coupling between these networks can increase the risk of significant failures. Hence, assessing the performance of the smart grid communication networks is of great importance and thus is considered here. As transmission time and cost play essential roles in many real world communication networks, both time and budget constraints are considered in this work. To evaluate the performance of communication networks, we assume that the data is transmitted from a source to a destination through a single path. We propose an algorithm that computes the exact probability of transmitting d units of data from the source to the destination within T units of time and the budget of b. The algorithm is illustrated through a benchmark network example. The complexity results are also provided. A rather large size benchmark, that is, Pan European topology, along with one thousand randomly generated test problems are used to generate the experimental results which show clearly the superiority of our proposed algorithms to some existing algorithm in the literature.


A general framework for tropical differential equations. We construct a general framework for tropical differential equations based on idempotent semirings and an idempotent version of differential algebra. Over a differential ring equipped with a non archimedean norm enhanced with additional differential information, we define tropicalization of differential equations and tropicalization of their solution sets. This framework includes rings of interest in the theory of p adic differential equations rings of convergent power series over a non archimedean normed field. The tropicalization records the norms of the coefficients. This gives a significant refinement of Grigoriev's framework for tropical differential equations. We then prove a differential analogue of Payne's inverse limit theorem the limit of all tropicalizations of a system of differential equations is isomorphic to a differential variant of the Berkovich analytification.


physics.comp-ph cs.CE cs.NA math.AP math.NA

Homogenization of the vibro acoustic transmission on periodically perforated elastic plates with arrays of resonators. Based on our previous work, we propose a homogenized model of acoustic waves propagating through periodically perforated elastic plates with metamaterial properties due to embedded arrays of soft elastic inclusions serving for resonators. Such structures enable to suppress the acoustic transmission for selected frequency bands. Homogenization of the vibro acoustic fluid structure interaction problem in a 3D complex geometry of the transmission layer leads to effective transmission conditions prescribed on the acoustic meta surface associated with the mid plane of the Reissner Mindlin plate. Asymptotic analysis with respect to the layer thickness, proportional to the plate thickness and to the perforation period, yields an implicit Dirichlet to Neumann operator defined on the homogenized metasurface. An efficient method is proposed for computing frequency dependent effective parameters involved in the homogenized model of the layer. These can change their signs, thus modifying the acoustic impedance and the effective mass of the metasurface. The global problem of the acoustic wave propagation in a waveguide fitted with the plate is solved using the finite element method. The homogenized interface allows for a significant reduction of the computational model. Numerical illustrations are presented.


Counting Phylogenetic Networks with Few Reticulation Vertices A Second Approach. Tree child networks, one of the prominent network classes in phylogenetics, have been introduced for the purpose of modeling reticulate evolution. Recently, the first author together with Gittenberger and Mansouri (2019) showed that the number rm TC ell,k of tree child networks with ell leaves and k reticulation vertices has the first order asymptotics rm TC ell,k sim c k left( frac 2 e right) ell ell ell 2k 1 , qquad ( ell rightarrow infty). Moreover, they also computed c k for k 1,2, and 3 . In this short note, we give a second approach to the above result which is based on a recent (algorithmic) approach for the counting of tree child networks due to Cardona and Zhang (2020). This second approach is also capable of giving a simple, closed form expression for c k , namely, c k 2 k 1 sqrt 2 k! for all k geq 0 .


Remarks on the homotopy type of intersections of two real Bruhat cells. In a companion manuscript, we introduce a stratification of intersections of a top dimensional real Bruhat cells with another arbitrary cell. This intersection is naturally identified with a subset of the lower triangular group these subsets are labeled by elements of a finite group, the lift to the spin group of the intersection of a Coxeter group with the special orthogonal group. The stratification allows us to determine the homotopy type of the intersection. In this work we give more examples, particularly detailing the computation of the intersection of two open Bruhat cells in general position for n 4 . It turns out that all connected components are contractible.


The Power of Subsampling in Submodular Maximization. We propose subsampling as a unified algorithmic technique for submodular maximization in centralized and online settings. The idea is simple independently sample elements from the ground set, and use simple combinatorial techniques (such as greedy or local search) on these sampled elements. We show that this approach leads to optimal state of the art results despite being much simpler than existing methods. In the usual offline setting, we present SampleGreedy, which obtains a (p 2 o(1)) approximation for maximizing a submodular function subject to a p extendible system using O(n nk p) evaluation and feasibility queries, where k is the size of the largest feasible set. The approximation ratio improves to p 1 and p for monotone submodular and linear objectives, respectively. In the streaming setting, we present SampleStreaming, which obtains a (4p 2 o(1)) approximation for maximizing a submodular function subject to a p matchoid using O(k) memory and O(km p) evaluation and feasibility queries per element, where m is the number of matroids defining the p matchoid. The approximation ratio improves to 4p for monotone submodular objectives. We empirically demonstrate the effectiveness of our algorithms on video summarization, location summarization, and movie recommendation tasks.


A brief discussion on the tensile creep deformation behaviour of wrought single phase gamma TiAl. Creep deformation behaviour in single phase gamma TiAl alloy has been an extensively studied topic since the late 1970s. A lot of literatures have reported creep behaviour of gamma TiAl alloys, manufactured using different processing techniques. The present discussion revisits the original work on understanding the tensile creep deformation behaviour of wrought single phase gamma TiAl alloy by Hayes et al and is aimed to develop an understanding of steady state creep, through strain vs strain rate and strain vs ln(strain rate) plots. Besides, it also attempts to study the variation of stress exponent with temperature between 760 and 900C and also, to determine activation energies using the two most common approaches, namely Zener Hollomon and Sherby Dorn for stress levels of 69.4 and 103.4 MPa between 760 and 900C.


Optimizing Probabilities in Probabilistic Logic Programs. Probabilistic Logic Programming is an effective formalism for encoding problems characterized by uncertainty. Some of these problems may require the optimization of probability values subject to constraints among probability distributions of random variables. Here, we introduce a new class of probabilistic logic programs, namely Probabilistic Optimizable Logic Programs, and we provide an effective algorithm to find the best assignment to probabilities of random variables, such that a set of constraints is satisfied and an objective function is optimized. This paper is under consideration for acceptance in Theory and Practice of Logic Programming.


Numerical investigation of the nonlinear interaction between the sinusoidal motion induced and gust induced forces acting on bridge decks. With the increasing spans and complex deck shapes, aerodynamic nonlinearity becomes a crucial concern in the design of long span bridges. This paper investigates the nonlinear interaction between the gust induced and motion induced forces acting on bridge decks using the Vortex Particle Method (VPM) as a Computational Fluid Dynamics (CFD) method. This nonlinear interaction is complex and intractable by the conventional linear semi analytical models that employ the superposition principle. To excite such interaction, a sinusoidally oscillating bridge deck is subjected to sinusoidal vertical gusts. Two distinct aspects are studied The influence of large scale sinusoidal vertical gusts on the shear layer of a moving body and the nonlinear dependence of the aerodynamic forces on the effective angle of attack. For the latter, the resultant aerodynamic forces based on a linear semi analytical and a CFD model are compared for the same effective angle of attack due to sinusoidal gust and motion. The methodology is first employed to verify the linear behavior of a flat plate and then study the nonlinear behavior of two bridge decks. The results show that the linear superposition principle holds for streamlined bridge decks with minimal shear layer instability. However, this principle may not be valid for bluff bridge decks due to strong separation vortices that dictate the shear layer, which induces nonlinearity in the aerodynamic forces manifested through amplitude difference in the first harmonic and emergence of higher order harmonics. The outcome of this study aims to provide a deeper understanding of the complex nonlinear fluid structure interaction occurring for bluff bodies subjected to motion and free stream gusts.


Combinatorial and number theoretic properties of generic reals. We discuss some properties of Cohen and random reals. We show that they belong to any definable partition regular family, and hence they satisfy most "largeness" properties studied in Ramsey theory. We determine their position in the Mahler's classification of the reals and using it, we get some information about Liouville numbers. We also show that they are wild in the sense of o minimality, i.e., they define the set of integers.


On Ricci flows with closed and smooth tangent flows. In this paper, we consider Ricci flows admitting closed and smooth tangent flows in the sense of Bamler Bam20c . The tangent flow in question can be either a tangent flow at infinity for an ancient Ricci flow, or a tangent flow at a singular point for a Ricci flow developing a finite time singularity. Among other things, we prove (1) that in these cases the tangent flow must be unique, (2) that if a Ricci flow with finite time singularity has a closed singularity model, then the singularity is of Type I and the singularity model is the tangent flow at the singular point this answers a question proposed in CCGGIIKLLN10 , (3) a dichotomy theorem that characterizes ancient Ricci flows admitting a closed and smooth backward sequential limit.


Understanding the Role of Scene Graphs in Visual Question Answering. Visual Question Answering (VQA) is of tremendous interest to the research community with important applications such as aiding visually impaired users and image based search. In this work, we explore the use of scene graphs for solving the VQA task. We conduct experiments on the GQA dataset which presents a challenging set of questions requiring counting, compositionality and advanced reasoning capability, and provides scene graphs for a large number of images. We adopt image question architectures for use with scene graphs, evaluate various scene graph generation techniques for unseen images, propose a training curriculum to leverage human annotated and auto generated scene graphs, and build late fusion architectures to learn from multiple image representations. We present a multi faceted study into the use of scene graphs for VQA, making this work the first of its kind.


Towards Aggregated Asynchronous Checkpointing. High Performance Computing (HPC) applications need to checkpoint massive amounts of data at scale. Multi level asynchronous checkpoint runtimes like VELOC (Very Low Overhead Checkpoint Strategy) are gaining popularity among application scientists for their ability to leverage fast node local storage and flush independently to stable, external storage (e.g., parallel file systems) in the background. Currently, VELOC adopts a one file per process flush strategy, which results in a large number of files being written to external storage, thereby overwhelming metadata servers and making it difficult to transfer and access checkpoints as a whole. This paper discusses the viability and challenges of designing aggregation techniques for asynchronous multi level checkpointing. To this end we implement and study two aggregation strategies, their limitations, and propose a new aggregation strategy specifically for asynchronous multi level checkpointing.


Inductive logic programming at 30. Inductive logic programming (ILP) is a form of logic based machine learning. The goal is to induce a hypothesis (a logic program) that generalises given training examples. As ILP turns 30, we review the last decade of research. We focus on (i) new meta level search methods, (ii) techniques for learning recursive programs, (iii) new approaches for predicate invention, and (iv) the use of different technologies. We conclude by discussing current limitations of ILP and directions for future research.


Slip Based Autonomous ZUPT through Gaussian Process to Improve Planetary Rover Localization. The zero velocity update (ZUPT) algorithm provides valuable state information to maintain the inertial navigation system (INS) reliability when stationary conditions are satisfied. Employing ZUPT along with leveraging non holonomic constraints can greatly benefit wheeled mobile robot dead reckoning localization accuracy. However, determining how often they should be employed requires consideration to balance localization accuracy and traversal rate for planetary rovers. To address this, we investigate when to autonomously initiate stops to improve wheel inertial odometry (WIO) localization performance with ZUPT. To do this, we propose a 3D dead reckoning approach that predicts wheel slippage while the rover is in motion and forecasts the appropriate time to stop without changing any rover hardware or major rover operations. We validate with field tests that our approach is viable on different terrain types and achieves a 3D localization accuracy of more than 97 over 650 m drives on rough terrain.


The harmonic theory on a vector bundle with singular Hermitian metrics and positivity. Let E be a holomorphic vector bundle endowed with a singular Hermitian metric H . In this paper, we develop the harmonic theory on (E,H) . Then we extend several canonical results of J. Koll ' a r and K. Takegoshi to this situation. In the end, we generalise Nakano's vanishing theorem.


On deficiency problems for graphs. Motivated by analogous questions in the setting of Steiner triple systems and Latin squares, Nenadov, Sudakov and Wagner Completion and deficiency problems, Journal of Combinatorial Theory Series B, 2020 recently introduced the notion of graph deficiency. Given a global spanning property mathcal P and a graph G , the deficiency text def (G) of the graph G with respect to the property mathcal P is the smallest non negative integer t such that the join G K t has property mathcal P . In particular, Nenadov, Sudakov and Wagner raised the question of determining how many edges an n vertex graph G needs to ensure G K t contains a K r factor (for any fixed r geq 3 ). In this paper we resolve their problem fully. We also give an analogous result which forces G K t to contain any fixed bipartite (n t) vertex graph of bounded degree and small bandwidth.


On a characterization of convergence in Banach spaces with a Schauder basis. We extend the well known characterizations of convergence in the spaces l p ( 1 le p infty ) of p summable sequence and c 0 of vanishing sequences to a general characterization of convergence in a Banach space with a Schauder basis and obtain as instant corollaries characterizations of convergence in an infinite dimensional separable Hilbert space and the space c of convergent sequences.


Predictive Replica Placement for Mobile Users in Distributed Fog Data Stores with Client Side Markov Models. Mobile clients that consume and produce data are abundant in fog environments and low latency access to this data can only be achieved by storing it in their close physical proximity. To adapt data replication in fog data stores in an efficient manner and make client data available at the fog node that is closest to the client, the systems need to predict both client movement and pauses in data consumption. In this paper, we present variations of Markov model algorithms that can run on clients to increase the data availability while minimizing excess data. In a simulation, we find the availability of data at the closest node can be improved by 35 without incurring the storage and communication overheads of global replication.


Evolution of Transthyretin. Evolution of the amino acid sequences of transthyretin (TTR) can provide additional information about its dynamics that both complements and extends the already extensive static structural data. Protein dynamics is largely driven by interactions between the protein itself and the thin water film that covers it. Here those interactions are connected to profiles of water waves connecting domain pivots (hydrophobic extrema), as well as a broad hydrophilic central hinge region that has evolved to provide human TTR with greater flexibility and stability. This central region has a density of single mutations related to amyloid polyneuropathy that is three times higher than other regions.


Finding Backdoors to Integer Programs A Monte Carlo Tree Search Framework. In Mixed Integer Linear Programming (MIP), a (strong) backdoor is a "small" subset of an instance's integer variables with the following property in a branch and bound procedure, the instance can be solved to global optimality by branching only on the variables in the backdoor. Constructing datasets of pre computed backdoors for widely used MIP benchmark sets or particular problem families can enable new questions around novel structural properties of a MIP, or explain why a problem that is hard in theory can be solved efficiently in practice. Existing algorithms for finding backdoors rely on sampling candidate variable subsets in various ways, an approach which has demonstrated the existence of backdoors for some instances from MIPLIB2003 and MIPLIB2010. However, these algorithms fall short of consistently succeeding at the task due to an imbalance between exploration and exploitation. We propose BaMCTS, a Monte Carlo Tree Search framework for finding backdoors to MIPs. Extensive algorithmic engineering, hybridization with traditional MIP concepts, and close integration with the CPLEX solver have enabled our method to outperform baselines on MIPLIB2017 instances, finding backdoors more frequently and more efficiently.


Combining expert knowledge and neural networks to model environmental stresses in agriculture. In this work we combine representation learning capabilities of neural network with agricultural knowledge from experts to model environmental heat and drought stresses. We first design deterministic expert models which serve as a benchmark and inform the design of flexible neural network architectures. Finally, a sensitivity analysis of the latter allows a clustering of hybrids into susceptible and resistant ones.


Isotuning With Applications To Scale Free Online Learning. We extend and combine several tools of the literature to design fast, adaptive, anytime and scale free online learning algorithms. Scale free regret bounds must scale linearly with the maximum loss, both toward large losses and toward very small losses. Adaptive regret bounds demonstrate that an algorithm can take advantage of easy data and potentially have constant regret. We seek to develop fast algorithms that depend on as few parameters as possible, in particular they should be anytime and thus not depend on the time horizon. Our first and main tool, isotuning, is a generalization of the idea of balancing the trade off of the regret. We develop a set of tools to design and analyze such learning rates easily and show that they adapts automatically to the rate of the regret (whether constant, O( log T) , O( sqrt T ) , etc.) within a factor 2 of the optimal learning rate in hindsight for the same observed quantities. The second tool is an online correction, which allows us to obtain centered bounds for many algorithms, to prevent the regret bounds from being vacuous when the domain is overly large or only partially constrained. The last tool, null updates, prevents the algorithm from performing overly large updates, which could result in unbounded regret, or even invalid updates. We develop a general theory using these tools and apply it to several standard algorithms. In particular, we (almost entirely) restore the adaptivity to small losses of FTRL for unbounded domains, design and prove scale free adaptive guarantees for a variant of Mirror Descent (at least when the Bregman divergence is convex in its second argument), extend Adapt ML Prod to scale free guarantees, and provide several other minor contributions about Prod, AdaHedge, BOA and Soft Bayes.


Topological speedups of mathbb Z d actions. We study minimal mathbb Z d Cantor systems and the relationship between their speedups, their collections of invariant Borel measures, their associated unital dimension groups, and their orbit equivalence classes. In the particular case of minimal mathbb Z d odometers, we show that their bounded speedups must again be odometers but, contrary to the 1 dimensional case, they need not be conjugate, or even isomorphic, to the original.


Autonomous Reinforcement Learning Formalism and Benchmarking. Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills through experience. However, real world embodied learning, such as that performed by humans and animals, is situated in a continual, non episodic world, whereas common benchmark tasks in RL are episodic, with the environment resetting between trials to provide the agent with multiple attempts. This discrepancy presents a major challenge when attempting to take RL algorithms developed for episodic simulated environments and run them on real world platforms, such as robots. In this paper, we aim to address this discrepancy by laying out a framework for Autonomous Reinforcement Learning (ARL) reinforcement learning where the agent not only learns through its own experience, but also contends with lack of human supervision to reset between trials. We introduce a simulated benchmark EARL around this framework, containing a set of diverse and challenging simulated tasks reflective of the hurdles introduced to learning when only a minimal reliance on extrinsic intervention can be assumed. We show that standard approaches to episodic RL and existing approaches struggle as interventions are minimized, underscoring the need for developing new algorithms for reinforcement learning with a greater focus on autonomy.


Global Existence of a Strong Solution to a Fourth Order Exponential PDE Modelling Crystal Surface Growth With Metropolis Type Rates. In this article we prove the global existence of a unique strong solution to the initial boundary value problem for a fourth order exponential PDE modeling crystal surface growth. The model we study is derived as the limit of a microscopic Markov jump process with Metropolis type transition rates. Our investigation reveals that, in opposition to the models with Arrhenius rates, where the exponent may contain a singular part, the exponent in our model is a W 1,2 function.


A survey on multi objective hyperparameter optimization algorithms for Machine Learning. Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO most of these are focused on optimizing one performance measure (usually an error based measure), and the literature on such single objective HPO problems is vast. Recently, though, algorithms have appeared which focus on optimizing multiple conflicting objectives simultaneously. This article presents a systematic survey of the literature published between 2014 and 2020 on multi objective HPO algorithms, distinguishing between metaheuristic based algorithms, metamodel based algorithms, and approaches using a mixture of both. We also discuss the quality metrics used to compare multi objective HPO procedures and present future research directions.


SegmentMeIfYouCan A Benchmark for Anomaly Segmentation. State of the art semantic or instance segmentation deep neural networks (DNNs) are usually trained on a closed set of semantic classes. As such, they are ill equipped to handle previously unseen objects. However, detecting and localizing such objects is crucial for safety critical applications such as perception for automated driving, especially if they appear on the road ahead. While some methods have tackled the tasks of anomalous or out of distribution object segmentation, progress remains slow, in large part due to the lack of solid benchmarks existing datasets either consist of synthetic data, or suffer from label inconsistencies. In this paper, we bridge this gap by introducing the "SegmentMeIfYouCan" benchmark. Our benchmark addresses two tasks Anomalous object segmentation, which considers any previously unseen object category and road obstacle segmentation, which focuses on any object on the road, may it be known or unknown. We provide two corresponding datasets together with a test suite performing an in depth method analysis, considering both established pixel wise performance metrics and recent component wise ones, which are insensitive to object sizes. We empirically evaluate multiple state of the art baseline methods, including several models specifically designed for anomaly obstacle segmentation, on our datasets and on public ones, using our test suite. The anomaly and obstacle segmentation results show that our datasets contribute to the diversity and difficulty of both data landscapes.


A systematic review of physical digital play technology and developmentally relevant child behaviour. New interactive physical digital play technologies are shaping the way children plan. These technologies refer to digital play technologies that engage children in analogue forms of behaviour, either alone or with others. Current interactive physical digital play technologies include robots, digital agents, mixed or augmented reality devices, and smart eye based gaming. Little is known, however, about the ways in which these technologies could promote or damage child development. This systematic review was aimed at understanding if and how these physical digital play technologies promoted developmentally relevant behaviour in typically developing 0 to 12 year olds. Psychology, Education, and Computer Science databases were searched producing 635 paper. A total of 31 papers met the inclusion criteria, of which 17 were of high enough quality to be included for synthesis. Results indicate that these new interactive play technologies could have a positive effect on children's developmentally relevant behaviour. The review indicated specific ways in which different behaviour were promoted. Providing information about own performance promoted self monitoring. Slowing interactivity, play interdependency, and joint object accessibility promoted collaboration. Offering delimited choices promoted decision making. Problem solving and physical activity were promoted by requiring children to engage in them to keep playing. Four principles underpinned the ways in which physical digital play technologies afforded child behaviour. These included social expectations framing play situations, the directiveness of action regulations (inviting, guiding or forcing behaviours), the technical features of play technologies (digital play mechanics and physical characteristics), and the alignment between play goals, play technology and the play behaviours promoted.


Deep Animation Video Interpolation in the Wild. In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time consuming. Therefore, it is desirable to develop computational models that can automatically interpolate the in between animation frames. However, existing video interpolation methods fail to produce satisfying results on animation data. Compared to natural videos, animation videos possess two unique characteristics that make frame interpolation difficult 1) cartoons comprise lines and smooth color pieces. The smooth areas lack textures and make it difficult to estimate accurate motions on animation videos. 2) cartoons express stories via exaggeration. Some of the motions are non linear and extremely large. In this work, we formally define and study the animation video interpolation problem for the first time. To address the aforementioned challenges, we propose an effective framework, AnimeInterp, with two dedicated modules in a coarse to fine manner. Specifically, 1) Segment Guided Matching resolves the "lack of textures" challenge by exploiting global matching among color pieces that are piece wise coherent. 2) Recurrent Flow Refinement resolves the "non linear and extremely large motion" challenge by recurrent predictions using a transformer like architecture. To facilitate comprehensive training and evaluations, we build a large scale animation triplet dataset, ATD 12K, which comprises 12,000 triplets with rich annotations. Extensive experiments demonstrate that our approach outperforms existing state of the art interpolation methods for animation videos. Notably, AnimeInterp shows favorable perceptual quality and robustness for animation scenarios in the wild. The proposed dataset and code are available at https github.com lisiyao21 AnimeInterp .


SIGN Spatial information Incorporated Generative Network for Generalized Zero shot Semantic Segmentation. Unlike conventional zero shot classification, zero shot semantic segmentation predicts a class label at the pixel level instead of the image level. When solving zero shot semantic segmentation problems, the need for pixel level prediction with surrounding context motivates us to incorporate spatial information using positional encoding. We improve standard positional encoding by introducing the concept of Relative Positional Encoding, which integrates spatial information at the feature level and can handle arbitrary image sizes. Furthermore, while self training is widely used in zero shot semantic segmentation to generate pseudo labels, we propose a new knowledge distillation inspired self training strategy, namely Annealed Self Training, which can automatically assign different importance to pseudo labels to improve performance. We systematically study the proposed Relative Positional Encoding and Annealed Self Training in a comprehensive experimental evaluation, and our empirical results confirm the effectiveness of our method on three benchmark datasets.


Low Regret Active learning. We develop an online learning algorithm for identifying unlabeled data points that are most informative for training (i.e., active learning). By formulating the active learning problem as the prediction with sleeping experts problem, we provide a regret minimization framework for identifying relevant data with respect to any given definition of informativeness. Motivated by the successes of ensembles in active learning, we define regret with respect to an omnipotent algorithm that has access to an infinity large ensemble. At the core of our work is an efficient algorithm for sleeping experts that is tailored to achieve low regret on easy instances while remaining resilient to adversarial ones. Low regret implies that we can be provably competitive with an ensemble method emph without the computational burden of having to train an ensemble . This stands in contrast to state of the art active learning methods that are overwhelmingly based on greedy selection, and hence cannot ensure good performance across problem instances with high amounts of noise. We present empirical results demonstrating that our method (i) instantiated with an informativeness measure consistently outperforms its greedy counterpart and (ii) reliably outperforms uniform sampling on real world scenarios.


Privacy preserving Object Detection. Privacy considerations and bias in datasets are quickly becoming high priority issues that the computer vision community needs to face. So far, little attention has been given to practical solutions that do not involve collection of new datasets. In this work, we show that for object detection on COCO, both anonymizing the dataset by blurring faces, as well as swapping faces in a balanced manner along the gender and skin tone dimension, can retain object detection performances while preserving privacy and partially balancing bias.


FFT based free space Poisson solvers why Vico Greengard Ferrando should replace Hockney Eastwood. Many problems in beam physics and plasma physics require the solution of Poisson's equation with free space boundary conditions. The algorithm proposed by Hockney and Eastwood is a popular scheme to solve this problem numerically, used by many cutting edge codes, because of its speed and its simplicity. However, the potential and its gradient obtained with this method have low accuracy, and the numerical error converges slowly with the number of grid points. We demonstrate that the closely related algorithm recently proposed by Vico, Greengard, and Ferrando is just as easy to implement, just as efficient computationally, and has much higher accuracy, with a rapidly converging error.


Laser Spectroscopy of the y 7 P J circ states of Cr I. Here we report measured and calculated values of decay rates of the 3d 4 ( 5 D)4s4p( 3 P rm o ) y 7 P rm o 2,3,4 states of Cr I. The decay rates are measured using time correlated single photon counting with roughly 1 total uncertainty. In addition, the isotope shifts for these transitions are measured by laser induced fluorescence to roughly 0.5 uncertainty. The decay rate calculations are carried out by a hybrid approach that combines configuration interaction and the linearized coupled cluster method (CI all order method). The measurements provide a much needed precision benchmark for testing the accuracy of the CI all order approach for such complicated systems with six valence electrons, allowing to significantly expand its applicability. These measurements also demonstrate operation of a cryogenic buffer gas beam source for future experiments with MgF molecules toward quantum blackbody thermometry.


SGoLAM Simultaneous Goal Localization and Mapping for Multi Object Goal Navigation. We present SGoLAM, short for simultaneous goal localization and mapping, which is a simple and efficient algorithm for Multi Object Goal navigation. Given an agent equipped with an RGB D camera and a GPS Compass sensor, our objective is to have the agent navigate to a sequence of target objects in realistic 3D environments. Our pipeline fully leverages the strength of classical approaches for visual navigation, by decomposing the problem into two key components mapping and goal localization. The mapping module converts the depth observations into an occupancy map, and the goal localization module marks the locations of goal objects. The agent's policy is determined using the information provided by the two modules if a current goal is found, plan towards the goal and otherwise, perform exploration. As our approach does not require any training of neural networks, it could be used in an off the shelf manner, and amenable for fast generalization in new, unseen environments. Nonetheless, our approach performs on par with the state of the art learning based approaches. SGoLAM is ranked 2nd in the CVPR 2021 MultiON (Multi Object Goal Navigation) challenge. We have made our code publicly available at emph https github.com eunsunlee SGoLAM .


Keep CALM and Improve Visual Feature Attribution. The class activation mapping, or CAM, has been the cornerstone of feature attribution methods for multiple vision tasks. Its simplicity and effectiveness have led to wide applications in the explanation of visual predictions and weakly supervised localization tasks. However, CAM has its own shortcomings. The computation of attribution maps relies on ad hoc calibration steps that are not part of the training computational graph, making it difficult for us to understand the real meaning of the attribution values. In this paper, we improve CAM by explicitly incorporating a latent variable encoding the location of the cue for recognition in the formulation, thereby subsuming the attribution map into the training computational graph. The resulting model, class activation latent mapping, or CALM, is trained with the expectation maximization algorithm. Our experiments show that CALM identifies discriminative attributes for image classifiers more accurately than CAM and other visual attribution baselines. CALM also shows performance improvements over prior arts on the weakly supervised object localization benchmarks. Our code is available at https github.com naver ai calm.


AI Techniques for Software Requirements Prioritization. Aspects such as limited resources, frequently changing market demands, and different technical restrictions regarding the implementation of software requirements (features) often demand for the prioritization of requirements. The task of prioritization is the ranking and selection of requirements that should be included in future software releases. In this context, an intelligent prioritization decision support is extremely important. The prioritization approaches discussed in this paper are based on different Artificial Intelligence (AI) techniques that can help to improve the overall quality of requirements prioritization processes


On the distribution of prime divisors in Krull monoid algebras. In the present work, we prove that every class of the divisor class group of a Krull monoid algebra contains infinitely many prime divisors. Several attempts to this result have been made in the literature so far, unfortunately with open gaps. We present a complete proof of this fact.


Parameterized Complexity of Logic Based Argumentation in Schaefer's Framework. Logic based argumentation is a well established formalism modelling nonmonotonic reasoning. It has been playing a major role in AI for decades, now. Informally, a set of formulas is the support for a given claim if it is consistent, subset minimal, and implies the claim. In such a case, the pair of the support and the claim together is called an argument. In this paper, we study the propositional variants of the following three computational tasks studied in argumentation ARG (exists a support for a given claim with respect to a given set of formulas), ARG Check (is a given set a support for a given claim), and ARG Rel (similarly as ARG plus requiring an additionally given formula to be contained in the support). ARG Check is complete for the complexity class DP, and the other two problems are known to be complete for the second level of the polynomial hierarchy (Parson et al., J. Log. Comput., 2003) and, accordingly, are highly intractable. Analyzing the reason for this intractability, we perform a two dimensional classification first, we consider all possible propositional fragments of the problem within Schaefer's framework (STOC 1978), and then study different parameterizations for each of the fragment. We identify a list of reasonable structural parameters (size of the claim, support, knowledge base) that are connected to the aforementioned decision problems. Eventually, we thoroughly draw a fine border of parameterized intractability for each of the problems showing where the problems are fixed parameter tractable and when this exactly stops. Surprisingly, several cases are of very high intractability (paraNP and beyond).


A Direct Construction of GCP and Binary CCC of Length Non Power of Two. Golay complementary pairs (GCPs) and complete complementary codes (CCCs) have found a wide range of practical applications in coding, signal processing and wireless communication due to their ideal correlation properties. In fact, binary CCCs have special advantages in spread spectrum communication due to their simple modulo 2 arithmetic operation, modulation and correlation simplicity, but they are limited in length. In this paper, we present a direct construction of GCPs, mutually orthogonal complementary sets (MOCSs) and binary CCCs of non power of two lengths to widen their application in the recent field. First, a generalised Boolean function (GBF) based truncation technique has been used to construct GCPs of non power of two lengths. Then Complementary sets (CSs) and MOCSs of lengths of the form 2 m 1 2 m 3 ( m geq 5 ) and 2 m 1 2 m 2 2 m 4 ( m geq 6 ) are generated by GBFs. Finally, binary CCCs with desired lengths are constructed using the union of MOCSs. The row and column sequence peak to mean envelope power ratio (PMEPR) has been investigated and compared with existing work. The column sequence PMEPR of resultant CCCs can be effectively upper bounded by 2 .


Universal and Tight Online Algorithms for Generalized Mean Welfare. We study fair and efficient allocation of divisible goods, in an online manner, among n agents. The goods arrive online in a sequence of T time periods. The agents' values for a good are revealed only after its arrival, and the online algorithm needs to fractionally allocate the good, immediately and irrevocably, among the agents. Towards a unifying treatment of fairness and economic efficiency objectives, we develop an algorithmic framework for finding online allocations to maximize the generalized mean of the values received by the agents. In particular, working with the assumption that each agent's value for the grand bundle of goods is appropriately scaled, we address online maximization of p mean welfare. Parameterized by an exponent term p in ( infty, 1 , these means encapsulate a range of welfare functions, including social welfare ( p 1 ), egalitarian welfare ( p to infty ), and Nash social welfare ( p to 0 ). We present a simple algorithmic template that takes a threshold as input and, with judicious choices for this threshold, leads to both universal and tailored competitive guarantees. First, we show that one can compute online a single allocation that O ( sqrt n log n) approximates the optimal p mean welfare for all p le 1 . The existence of such a universal allocation is interesting in and of itself. Moreover, this universal guarantee achieves essentially tight competitive ratios for specific values of p . Next, we obtain improved competitive ratios for different ranges of p by executing our algorithm with p specific thresholds, e.g., we provide O( log 3 n) competitive ratio for all p in ( frac 1 log 2n ,1) . We complement our positive results by establishing lower bounds to show that our guarantees are essentially tight for a wide range of the exponent parameter.


Generalized smoothed particle hydrodynamics with overset methods in total Lagrangian formulations. This study proposes a generalized coordinates based smoothed particle hydrodynamics (GSPH) method with overset methods using a Total Lagrangian (TL) formulation for large deformation and crack propagation problems. In the proposed GSPH, the physical space is decomposed into multiple domains, each of which is mapped to a local coordinate space (generalized space) to avoid coordinate singularities as well as to flexibly change the spatial resolution. The smoothed particle hydrodynamics (SPH) particles are then non uniformly, e.g., typically in the boundary conforming way, distributed in the physical space while they are defined uniformly in each generalized space similarly to the normal SPH method, which are numerically related by a coordinate transformation matrix. By solving a governing equation in each generalized space, the shape and size of the SPH kernel can be spatially changed in the physical space so that a spatial resolution is adaptively varied a priori depending on the deformation characteristics, and thus, a low cost calculation with the less number of particles is achieved in complex shape structures.


A proactive malicious software identification approach for digital forensic examiners. Digital investigators often get involved with cases, which seemingly point the responsibility to the person to which the computer belongs, but after a thorough examination malware is proven to be the cause, causing loss of precious time. Whilst Anti Virus (AV) software can assist the investigator in identifying the presence of malware, with the increase in zero day attacks and errors that exist in AV tools, this is something that cannot be relied upon. The aim of this paper is to investigate the behaviour of malware upon various Windows operating system versions in order to determine and correlate the relationship between malicious software and OS artifacts. This will enable an investigator to be more efficient in identifying the presence of new malware and provide a starting point for further investigation.


Dynamic Neural Networks A Survey. Dynamic neural network is an emerging research topic in deep learning. Compared to static models which have fixed computational graphs and parameters at the inference stage, dynamic networks can adapt their structures or parameters to different inputs, leading to notable advantages in terms of accuracy, computational efficiency, adaptiveness, etc. In this survey, we comprehensively review this rapidly developing area by dividing dynamic networks into three main categories 1) instance wise dynamic models that process each instance with data dependent architectures or parameters 2) spatial wise dynamic networks that conduct adaptive computation with respect to different spatial locations of image data and 3) temporal wise dynamic models that perform adaptive inference along the temporal dimension for sequential data such as videos and texts. The important research problems of dynamic networks, e.g., architecture design, decision making scheme, optimization technique and applications, are reviewed systematically. Finally, we discuss the open problems in this field together with interesting future research directions.


Automatic winning shifts. To each one dimensional subshift X , we may associate a winning shift W(X) which arises from a combinatorial game played on the language of X . Previously it has been studied what properties of X does W(X) inherit. For example, X and W(X) have the same factor complexity and if X is a sofic subshift, then W(X) is also sofic. In this paper, we develop a notion of automaticity for W(X) , that is, we propose what it means that a vector representation of W(X) is accepted by a finite automaton. Let S be an abstract numeration system such that addition with respect to S is a rational relation. Let X be a subshift generated by an S automatic word. We prove that as long as there is a bound on the number of nonzero symbols in configurations of W(X) (which follows from X having sublinear factor complexity), then W(X) is accepted by a finite automaton, which can be effectively constructed from the description of X . We provide an explicit automaton when X is generated by certain automatic words such as the Thue Morse word.


Test elements, excellent rings, and content functions. Broadening existing results in the literature to much wider classes of rings, we prove among other things 1. Reduced quotients of excellent regular rings of characteristic p admit big test elements, 2. The set of F jumping numbers of a principal ideal in a locally excellent regular ring is a discrete subset of mathbb Q , and 3. If R is a quotient of a locally excellent regular ring of prime characteristic, then there is a uniform upper bound on the Hartshorne Speiser Lyubeznik numbers of the injective hulls of the residue fields of R . To do so, we develop the parallel theories of Ohm Rush and intersection flat algebras. We show that both properties can be checked locally in flat maps of Noetherian rings. We show that intersection flatness admits a content theory parallel to that of Ohm Rush content for Ohm Rush algebras. We develop descent results for these properties. Using the descent result for intersection flatness, we obtain a local condition under which a faithfully flat map of Noetherian rings must be intersection flat. The local condition for intersection flatness allows us to conclude that finitely generated faithfully flat algebras over a Noetherian ring are intersection flat. Combining the local condition for intersection flatness with results of Kunz and Radu yields the conclusion that the Frobenius endomorphism associated to a locally excellent regular ring of prime characteristic is intersection flat, thus answering a question of Sharp. Applications of the latter result include the three enumerated results above. We also get applications to tight closure and parameter test ideals.


Risk Conditioned Distributional Soft Actor Critic for Risk Sensitive Navigation. Modern navigation algorithms based on deep reinforcement learning (RL) show promising efficiency and robustness. However, most deep RL algorithms operate in a risk neutral manner, making no special attempt to shield users from relatively rare but serious outcomes, even if such shielding might cause little loss of performance. Furthermore, such algorithms typically make no provisions to ensure safety in the presence of inaccuracies in the models on which they were trained, beyond adding a cost of collision and some domain randomization while training, in spite of the formidable complexity of the environments in which they operate. In this paper, we present a novel distributional RL algorithm that not only learns an uncertainty aware policy, but can also change its risk measure without expensive fine tuning or retraining. Our method shows superior performance and safety over baselines in partially observed navigation tasks. We also demonstrate that agents trained using our method can adapt their policies to a wide range of risk measures at run time.


A first look into the carbon footprint of federated learning. Despite impressive results, deep learning based technologies also raise severe privacy and environmental concerns induced by the training procedure often conducted in datacenters. In response, alternatives to centralized training such as Federated Learning (FL) have emerged. Perhaps unexpectedly, FL, in particular, is starting to be deployed at a global scale by companies that must adhere to new legal demands and policies originating from governments and civil society for privacy protection. However, the potential environmental impact related to FL remains unclear and unexplored. This paper offers the first ever systematic study of the carbon footprint of FL. First, we propose a rigorous model to quantify the carbon footprint, hence facilitating the investigation of the relationship between FL design and carbon emissions. Then, we compare the carbon footprint of FL to traditional centralized learning. Our findings show that FL, despite being slower to converge in some cases, may result in a comparatively greener impact than a centralized equivalent setup. We performed extensive experiments across different types of datasets, settings, and various deep learning models with FL. Finally, we highlight and connect the reported results to the future challenges and trends in FL to reduce its environmental impact, including algorithms efficiency, hardware capabilities, and stronger industry transparency.


Towards Cost Optimal Policies for DAGs to Utilize IaaS Clouds with Online Learning. Premier cloud service providers (CSPs) offer two types of purchase options, namely on demand and spot instances, with time varying features in availability and price. Users like startups have to operate on a limited budget and similarly others hope to reduce their costs. While interacting with a CSP, central to their concerns is the process of cost effectively utilizing different purchase options possibly in addition to self owned instances. A job in data intensive applications is typically represented by a directed acyclic graph which can further be transformed into a chain of tasks. The key to achieving cost efficiency is determining the allocation of a specific deadline to each task, as well as the allocation of different types of instances to the task. In this paper, we propose a framework that determines the optimal allocation of deadlines to tasks. The framework also features an optimal policy to determine the allocation of spot and on demand instances in a predefined time window, and a near optimal policy for allocating self owned instances. The policies are designed to be parametric to support the usage of online learning to infer the optimal values against the dynamics of cloud markets. Finally, several intuitive heuristics are used as baselines to validate the cost improvement brought by the proposed solutions. We show that the cost improvement over the state of the art is up to 24.87 when spot and on demand instances are considered and up to 59.05 when self owned instances are considered.


A Distributed Virtual Network Function Placement Approach in Satellite Edge and Cloud Computing. Satellite edge computing has become a promising way to provide computing services for Internet of Things (IoT) devices in remote areas, which are out of the coverage of terrestrial networks, nevertheless, it is not suitable for large scale IoT devices due to the resource limitation of satellites. Cloud computing can provide sufficient available resources for IoT devices but it does not meet the service requirements of delay sensitive users as high network latency. Collaborative edge and cloud computing is to facilitate flexible service provisioning for numerous IoT devices by incorporating the advantages of edge and cloud computing. In this paper, we investigate the virtual network function (VNF) placement problem in collaborative satellite edge and cloud computing to minimize the satellite network bandwidth usage and the service end to end delay. We formulate the VNF placement problem as an integer non linear programming problem and propose a distributed VNF placement (D VNFP) algorithm to address it, as the VNF placement problem is NP hard. The experiments are conducted to evaluate the effectiveness of the proposed D VNFP algorithm. The results show that the proposed D VNFP algorithm outperforms the existing baseline algorithms of Greedy and Viterbi for solving the VNF placement problem in satellite edge and cloud computing.


I2C2W Image to Character to Word Transformers for Accurate Scene Text Recognition. Leveraging the advances of natural language processing, most recent scene text recognizers adopt an encoder decoder architecture where text images are first converted to representative features and then a sequence of characters via sequential decoding'. However, scene text images suffer from rich noises of different sources such as complex background and geometric distortions which often confuse the decoder and lead to incorrect alignment of visual features at noisy decoding time steps. This paper presents I2C2W, a novel scene text recognition technique that is tolerant to geometric and photometric degradation by decomposing scene text recognition into two inter connected tasks. The first task focuses on image to character (I2C) mapping which detects a set of character candidates from images based on different alignments of visual features in an non sequential way. The second task tackles character to word (C2W) mapping which recognizes scene text by decoding words from the detected character candidates. The direct learning from character semantics (instead of noisy image features) corrects falsely detected character candidates effectively which improves the final text recognition accuracy greatly. Extensive experiments over nine public datasets show that the proposed I2C2W outperforms the state of the art by large margins for challenging scene text datasets with various curvature and perspective distortions. It also achieves very competitive recognition performance over multiple normal scene text datasets.