A Deep Learning based Penetration Testing Framework for Vulnerability Identification in Internet of Things Environments. The Internet of Things (IoT) paradigm has displayed tremendous growth in recent years, resulting in innovations like Industry 4.0 and smart environments that provide improvements to efficiency, management of assets and facilitate intelligent decision making. However, these benefits are offset by considerable cybersecurity concerns that arise due to inherent vulnerabilities, which hinder IoT based systems' Confidentiality, Integrity, and Availability. Security vulnerabilities can be detected through the application of penetration testing, and specifically, a subset of the information gathering stage, known as vulnerability identification. Yet, existing penetration testing solutions can not discover zero day vulnerabilities from IoT environments, due to the diversity of generated data, hardware constraints, and environmental complexity. Thus, it is imperative to develop effective penetration testing solutions for the detection of vulnerabilities in smart IoT environments. In this paper, we propose a deep learning based penetration testing framework, namely Long Short Term Memory Recurrent Neural Network Enabled Vulnerability Identification (LSTM EVI). We utilize this framework through a novel cybersecurity oriented testbed, which is a smart airport based testbed comprised of both physical and virtual elements. The framework was evaluated using this testbed and on real time data sources. Our results revealed that the proposed framework achieves about 99 detection accuracy for scanning attacks, outperforming other four peer techniques.


Explicit formulas for the inverses of Toeplitz matrices, with applications. We derive novel explicit formulas for the inverses of truncated block Toeplitz matrices that correspond to a multivariate minimal stationary process. The main ingredients of the formulas are the Fourier coefficients of the phase function attached to the spectral density of the process. The derivation of the formulas is based on a recently developed finite prediction theory applied to the dual process of the stationary process. We illustrate the usefulness of the formulas by two applications. The first one is a strong convergence result for solutions of general block Toeplitz systems for a multivariate short memory process. The second application is closed form formulas for the inverses of truncated block Toeplitz matrices corresponding to a multivariate ARMA process. The significance of the latter is that they provide us with a linear time algorithm to compute the solutions of corresponding block Toeplitz systems.


A matrix formula for Schur complements of nonnegative selfadjoint linear relations. If a nonnegative selfadjoint linear relation A in a Hilbert space and a closed subspace mathcal S are assumed to satisfy that the domain of A is invariant under the orthogonal projector onto mathcal S , then A admits a particular matrix representation with respect to the decomposition mathcal S oplus mathcal S perp . This matrix representation of A is used to give explicit formulae for the Schur complement of A on mathcal S as well as the mathcal S compression of A .


Generating Symbolic Reasoning Problems with Transformer GANs. Constructing training data for symbolic reasoning domains is challenging Existing instances are typically hand crafted and too few to be trained on directly and synthetically generated instances are often hard to evaluate in terms of their meaningfulness. We study the capabilities of GANs and Wasserstein GANs equipped with Transformer encoders to generate sensible and challenging training data for symbolic reasoning domains. We conduct experiments on two problem domains where Transformers have been successfully applied recently symbolic mathematics and temporal specifications in verification. Even without autoregression, our GAN models produce syntactically correct instances. We show that the generated data can be used as a substitute for real training data when training a classifier, and, especially, that training data can be generated from a real dataset that is too small to be trained on directly. Using a GAN setting also allows us to alter the target distribution We show that by adding a classifier uncertainty part to the generator objective, we obtain a dataset that is even harder to solve for a classifier than our original dataset.


Optical resonances in graded index spheres A resonant state expansion study and analytic approximations. Recent improvements in the resonant state expansion (RSE), focusing on the static mode contribution, have made it possible to treat transverse magnetic (TM) modes of a spherically symmetric system with the same efficiency as their transverse electric (TE) counterparts. We demonstrate here that the efficient inclusion of static modes in the RSE results in its quick convergence to the exact solution regardless of the static mode set used. We then apply the RSE to spherically symmetric systems with continuous radial variations of the permittivity. We show that in TM polarization, the spectral transition from whispering gallery to Fabry Perot modes is characterized by a peak in the mode losses and an additional mode as compared to TE polarization. Both features are explained quantitatively by the Brewster angle of the surface reflection which occurs in this frequency range. Eliminating the discontinuity at the sphere surface by using linear or quadratic profiles of the permittivity modifies this peak and increases the Fabry Perot mode losses, in qualitative agreement with a reduced surface reflectivity. These profiles also provide a nearly parabolic confinement for the whispering gallery modes, for which an analytical approximation using the Morse potential is presented. Both profiles result in a reduced TE TM splitting, which is shown to be further suppressed by choosing a profile radially extending the mode fields. Based on the concepts of ray optics, phase analysis of the secular equation, and effective quantum mechanical potential for a wave equation, we have further developed a number of useful approximations which shed light on the physical phenomena observed in the spectra of graded index systems.


Numerical Modeling of Kondratyev's Long Waves Taking into Account Heredity. The paper proposes a new mathematical model of economic cycles and crises, which generalizes the well known model of Dubovsky S.V. The novelty of the proposed model lies in taking into account the effect of heredity (memory), as well as the introduction of harmonic functions responsible for the arrival of investments in fixed assets and new management technologies in innovation. The mathematical description is given using the Gerasimov Caputo fractional derivatives, which are studied within the framework of the theory of fractional calculus. The mathematical model was investigated using the numerical method of Adams Bashforth Moulton (ABM), phase trajectories were constructed. It is shown that the proposed mathematical model can have both regular and chaotic regimes.


What makes you popular beauty, personality or intelligence?. This study explores the determinants of popularity within friendship and advice networks. We involved almost 200 college students in an experiment to predict how personality traits, self monitoring, creativity, intelligence, energy, and beauty influence the development of friendship and advice networks. Our results indicate that physical attractiveness is a key to develop both friendship and task related interactions, whereas perceived intelligence and creativity play an important role in the advice network. Our findings seem to support the idea that there might be a kernel of truth in the stereotype that attractiveness correlates with positive social traits and successful outcomes.


Grothendieck enriched categories. In this paper, we introduce the notion of Grothendieck enriched categories for categories enriched over a sufficiently nice Grothendieck monoidal category mathcal V , generalizing the classical notion of Grothendieck categories. Then we establish the Gabriel Popescu type theorem for Grothendieck enriched categories. We also prove that the property of being Grothendieck enriched categories is preserved under the change of the base monoidal categories by a monoidal right adjoint functor. In particular, if we take as mathcal V the monoidal category of complexes of abelian groups, we obtain the notion of Grothendieck dg categories. As an application of the main results, we see that the dg category of complexes of quasi coherent sheaves on a quasi compact and quasi separated scheme is an example of Grothendieck dg categories.


The effect of pressure fluctuations on the shapes of thinning liquid curtains. We consider the time dependent response of a gravitationally thinning inviscid liquid sheet (a coating curtain) leaving a vertical slot to sinusoidal ambient pressure disturbances. The theoretical investigation employs the hyperbolic partial differential equation developed by cite weinp1 . The response of the curtain is characterized by the slot Weber number, W e 0 rho q V 2 sigma , where V is the speed of the curtain at the slot, q is the volumetric flow rate per unit width, sigma is the surface tension, and rho is the fluid density. Flow disturbances travel along characteristics with speeds relative to the curtain of pm sqrt uV W e 0 , where u sqrt V 2 2gx is the curtain speed at a distance x downstream from the slot. When the flow is subcritical ( W e 0 1 ), upstream traveling disturbances near the slot affect the curtain centerline, and the slope of the curtain centerline at the slot oscillates with an amplitude that is a function of W e 0 . In contrast, all disturbances travel downstream in supercritical curtains ( W e 0 1 ) and the slope of the curtain at the slot is vertical. Here, we specifically examine the curtain response under supercritical and subcritical flow conditions near W e 0 1 to deduce whether there is a substantial change in the overall shape and magnitude of the curtain responses. Despite the local differences in the curtain solution near the slot, we find that subcritical and supercritical curtains have similar responses for all imposed sinusoidal frequencies.


Room Acoustics (lecture notes). Room acoustics is commonly regarded and studied as an applied subdiscipline of engineering acoustics. It is likely for this reason that many textbooks and lecture notes on the topic provide a too brief, unsystematic, and incomplete physical basics of the theory, while focusing on the practical aspects of calculation, measurement, assessment, and optimization of sound fields in rooms, such as lecture halls, control rooms, concert halls, and opera houses. While such approach may be satisfactory for a broad community of acoustic engineers, it leaves many important physical concepts and mechanisms obscure and their understanding superficial and unsolid, especially among inexperienced practitioners and students. The main purpose of this text is to provide a brief yet self contained introduction to the physics of room acoustics or, more generally, acoustics of closed spaces, starting with the governing equations of fluid dynamics. While covering all essential topics and concepts in the field, such as modal analysis, geometrical and statistical theory, room impulse response, subjective criteria and descriptors of sound fields in rooms, acoustic design and simulations, and acoustic elements (reflectors, absorbers, and diffusers), it does so in a systematic and, arguably, didactically more appropriate way. The rigorous derivations of many important theoretical results rely on well established methods of modern mathematical physics, but require only basic mathematical skills of the reader, since all mathematical tools are introduced and explained in sufficient detail. On the other hand, the thorough derivations expose the underlying assumptions and limitations of the obtained results, the proper understanding of which is crucial for the correct use of the results in practice.


Transition from fishbone mode to beta induced Alfv 'en eigenmode on HL 2A tokamak. In the presence of energetic particles (EPs) from auxiliary heating and burning plasmas, fishbone instability and Alfv 'en modes can be excited and their transition can take place in certain overlapping regimes. Using the hybrid kinetic magnetohydrodynamic model in the NIMROD code, we have identified such a transition between the fishbone instability and the beta induced Alfv 'en Eigenmode (BAE) for the NBI heated plasmas on HL 2A. When the safety factor at magnetic axis is well below one, typical kink fishbone transition occurs as the EP fraction increases. When q 0 is raised to approaching one, the fishbone mode is replaced with BAE for sufficient amount of EPs. When q 0 is slightly above one, the toroidicity induced Alfv 'en eigenmode (TAE) dominates at lower EP pressure, whereas BAE dominates at higher EP pressure.


Learning to Amend Facial Expression Representation via De albino and Affinity. Facial Expression Recognition (FER) is a classification task that points to face variants. Hence, there are certain affinity features between facial expressions, receiving little attention in the FER literature. Convolution padding, despite helping capture the edge information, causes erosion of the feature map simultaneously. After multi layer filling convolution, the output feature map named albino feature definitely weakens the representation of the expression. To tackle these challenges, we propose a novel architecture named Amending Representation Module (ARM). ARM is a substitute for the pooling layer. Theoretically, it can be embedded in the back end of any network to deal with the Padding Erosion. ARM efficiently enhances facial expression representation from two different directions 1) reducing the weight of eroded features to offset the side effect of padding, and 2) decomposing facial features to simplify representation learning. Experiments on public benchmarks prove that our ARM boosts the performance of FER remarkably. The validation accuracies are respectively 90.42 on RAF DB, 65.2 on Affect Net, and 58.71 on SFEW, exceeding current state of the art methods. Our implementation and trained models are available at https github.com JiaweiShiCV Amend Representation Module.


A Parallel Algorithm for Minimum Cost Submodular Cover. In a minimum cost submodular cover problem (MinSMC), given a monotone non decreasing submodular function f colon 2 V rightarrow mathbb Z , a cost function c V rightarrow mathbb R , an integer k leq f(V) , the goal is to find a subset A subseteq V with the minimum cost such that f(A) geq k . MinSMC has a lot of applications in machine learning and data mining. In this paper, we design a parallel algorithm for MinSMC which obtains a solution with approximation ratio at most frac H( min Delta,k ) 1 5 varepsilon with probability 1 3 varepsilon in O( frac log m log n log 2 mn varepsilon 4 ) rounds, where Delta max v in V f(v) , H( cdot) is the Hamornic number, n f(V) , m V and varepsilon is a constant in (0, frac 1 5 ) . This is the first paper obtaining a parallel algorithm for the weighted version of the MinSMC problem with an approximation ratio arbitrarily close to H( min Delta,k ) .


Forced Variational Integrator Networks for Prediction and Control of Mechanical Systems. As deep learning becomes more prevalent for prediction and control of real physical systems, it is important that these overparameterized models are consistent with physically plausible dynamics. This elicits a problem with how much inductive bias to impose on the model through known physical parameters and principles to reduce complexity of the learning problem to give us more reliable predictions. Recent work employs discrete variational integrators parameterized as a neural network architecture to learn conservative Lagrangian systems. The learned model captures and enforces global energy preserving properties of the system from very few trajectories. However, most real systems are inherently non conservative and, in practice, we would also like to apply actuation. In this paper we extend this paradigm to account for general forcing (e.g. control input and damping) via discrete d'Alembert's principle which may ultimately be used for control applications. We show that this forced variational integrator networks (FVIN) architecture allows us to accurately account for energy dissipation and external forcing while still capturing the true underlying energy based passive dynamics. We show that in application this can result in highly data efficient model based control and can predict on real non conservative systems.


Defining Gaze Patterns for Process Model Literacy Exploring Visual Routines in Process Models with Diverse Mappings. Process models depict crucial artifacts for organizations regarding documentation, communication, and collaboration. The proper comprehension of such models is essential for an effective application. An important aspect in process model literacy constitutes the question how the information presented in process models is extracted and processed by the human visual system? For such visuospatial tasks, the visual system deploys a set of elemental operations, from whose compositions different visual routines are produced. This paper provides insights from an exploratory eye tracking study, in which visual routines during process model comprehension were contemplated. More specifically, n 29 participants were asked to comprehend n 18 process models expressed in the Business Process Model and Notation 2.0 reflecting diverse mappings (i.e., straight, upward, downward) and complexity levels. The performance measures indicated that even less complex process models pose a challenge regarding their comprehension. The upward mapping confronted participants' attention with more challenges, whereas the downward mapping was comprehended more effectively. Based on recorded eye movements, three gaze patterns applied during model comprehension were derived. Thereupon, we defined a general model which identifies visual routines and corresponding elemental operations during process model comprehension. Finally, implications for practice as well as research and directions for future work are discussed in this paper.


Furtherance of Numerical radius inequalities of Hilbert space operators. If A,B are bounded linear operators on a complex Hilbert space, then w(A) leq frac 1 2 left( A sqrt r left( A A right) right) and w(AB pm BA) leq 2 sqrt 2 B sqrt w 2(A) frac c 2( Re (A)) c 2( Im (A)) 2 , begin eqnarray w(A) leq frac 1 2 left( A sqrt r left( A A right) right), w(AB pm BA) leq 2 sqrt 2 B sqrt w 2(A) frac c 2( Re (A)) c 2( Im (A)) 2 , end eqnarray where w(.), . ,c(.) and r(.) are the numerical radius, the operator norm, the Crawford number and the spectral radius respectively, and Re (A) , Im (A) are the real part, the imaginary part of A respectively. The inequalities obtained here generalize and improve on the existing well known inequalities.


Playing with Food Learning Food Item Representations through Interactive Exploration. A key challenge in robotic food manipulation is modeling the material properties of diverse and deformable food items. We propose using a multimodal sensory approach to interact and play with food that facilitates the ability to distinguish these properties across food items. First, we use a robotic arm and an array of sensors, which are synchronized using ROS, to collect a diverse dataset consisting of 21 unique food items with varying slices and properties. Afterwards, we learn visual embedding networks that utilize a combination of proprioceptive, audio, and visual data to encode similarities among food items using a triplet loss formulation. Our evaluations show that embeddings learned through interactions can successfully increase performance in a wide range of material and shape classification tasks. We envision that these learned embeddings can be utilized as a basis for planning and selecting optimal parameters for more material aware robotic food manipulation skills. Furthermore, we hope to stimulate further innovations in the field of food robotics by sharing this food playing dataset with the research community.


Necessary conditions for the existence of Morita Contexts in the bicategory of Landau Ginzburg Models. We use a matrix approach to study the concept of Morita context in the bicategory mathcal LG K of Landau Ginzburg models on a particular class of objects. In fact, we first use properties of matrix factorizations to state and prove two necessary conditions to obtain a Morita context between two objects of mathcal LG K . Next, we use a celebrated result (due to Schur) on determinants of block matrices to show that these necessary conditions are not sufficient. Finally, we state a trivial sufficient condition.


On constraints for knots to admit chirally cosmetic surgeries and their calculations. We discuss various constraints for knots in S 3 to admit chirally cosmetic surgeries, derived from invariants of 3 manifolds, such as, the quantum SO(3) invariant, the rank of the Heegaard Floer homology, and finite type invariants. We apply them to show that a large portion (roughly 75 ) of knots which are neither amphicheiral nor (2,p) torus knots with less than or equal to 10 crossings admits no chirally cosmetic surgeries.


A Survey on Optimal Transport for Machine Learning Theory and Applications. Optimal Transport (OT) theory has seen an increasing amount of attention from the computer science community due to its potency and relevance in modeling and machine learning. It introduces means that serve as powerful ways to compare probability distributions with each other, as well as producing optimal mappings to minimize cost functions. In this survey, we present a brief introduction and history, a survey of previous work and propose directions of future study. We will begin by looking at the history of optimal transport and introducing the founders of this field. We then give a brief glance into the algorithms related to OT. Then, we will follow up with a mathematical formulation and the prerequisites to understand OT. These include Kantorovich duality, entropic regularization, KL Divergence, and Wassertein barycenters. Since OT is a computationally expensive problem, we then introduce the entropy regularized version of computing optimal mappings, which allowed OT problems to become applicable in a wide range of machine learning problems. In fact, the methods generated from OT theory are competitive with the current state of the art methods. We follow this up by breaking down research papers that focus on image processing, graph learning, neural architecture search, document representation, and domain adaptation. We close the paper with a small section on future research. Of the recommendations presented, three main problems are fundamental to allow OT to become widely applicable but rely strongly on its mathematical formulation and thus are hardest to answer. Since OT is a novel method, there is plenty of space for new research, and with more and more competitive methods (either on an accuracy level or computational speed level) being created, the future of applied optimal transport is bright as it has become pervasive in machine learning.


Occlusion Handling in Generic Object Detection A Review. The significant power of deep learning networks has led to enormous development in object detection. Over the last few years, object detector frameworks have achieved tremendous success in both accuracy and efficiency. However, their ability is far from that of human beings due to several factors, occlusion being one of them. Since occlusion can happen in various locations, scale, and ratio, it is very difficult to handle. In this paper, we address the challenges in occlusion handling in generic object detection in both outdoor and indoor scenes, then we refer to the recent works that have been carried out to overcome these challenges. Finally, we discuss some possible future directions of research.


Bridgeland stability conditions and the tangent bundle of surfaces of general type. Let X be a smooth compact complex surface with the canonical divisor K X ample and let Theta X be its holomorphic tangent bundle. Bridgeland stability conditions are used to study the space H 1 ( Theta X) of infinitesimal deformations of complex structures of X and its relation to the geometry topology of X . The main observation is that for X with H 1 ( Theta X) nonzero and the Chern numbers (c 2 (X), K 2 X) subject to tau X 2ch 2 ( Theta X) K 2 X 2c 2(X) 0 the object Theta X 1 of the derived category of bounded complexes of coherent sheaves on X is Bridgeland unstable in a certain part of the space of Bridgeland stability conditions. The Harder Narasimhan filtrations of Theta X 1 for those stability conditions are expected to provide new insights into geometry of surfaces of general type and the study of their moduli. The paper provides a certain body of evidence that this is indeed the case.


MarS FL Enabling Competitors to Collaborate in Federated Learning. Federated learning (FL) is rapidly gaining popularity and enables multiple data owners ( em a.k.a. FL participants) to collaboratively train machine learning models in a privacy preserving way. A key unaddressed scenario is that these FL participants are in a competitive market, where market shares represent their competitiveness. Although they are interested to enhance the performance of their respective models through FL, market leaders (who are often data owners who can contribute significantly to building high performance FL models) want to avoid losing their market shares by enhancing their competitors' models. Currently, there is no modeling tool to analyze such scenarios and support informed decision making. In this paper, we bridge this gap by proposing the underline mar ket underline s hare based decision support framework for participation in underline FL (MarS FL). We introduce em two notions of delta stable market and em friendliness to measure the viability of FL and the market acceptability of FL. The FL participants' behaviours can then be predicted using game theoretic tools (i.e., their optimal strategies concerning participation in FL). If the market delta stability is achievable, the final model performance improvement of each FL PT shall be bounded, which relates to the market conditions of FL applications. We provide tight bounds and quantify the friendliness, kappa , of given market conditions to FL. Experimental results show the viability of FL in a wide range of market conditions. Our results are useful for identifying the market conditions under which collaborative FL model training is viable among competitors, and the requirements that have to be imposed while applying FL under these conditions.


Enhancing interval observers for state estimation using constraints. This work considers the problem of calculating an interval valued state estimate for a nonlinear system subject to bounded inputs and measurement errors. Such state estimators are often called interval observers. Interval observers can be constructed using methods from reachability theory. Recent advances in the construction of interval enclosures of reachable sets for nonlinear systems inspire the present work. These advances can incorporate constraints on the states to produce tighter interval enclosures. When applied to the state estimation problem, bounded error measurements may be used as state constraints in these new theories. The result is a method that is easily implementable and which generally produces better, tighter interval state estimates. Furthermore, a novel linear programming based method is proposed for calculating the observer gain, which must be tuned in practice. In contrast with previous approaches, this method does not rely on special system structure. The new approaches are demonstrated with numerical examples.


LightningDOT Pre training Visual Semantic Embeddings for Real Time Image Text Retrieval. Multimodal pre training has propelled great advancement in vision and language research. These large scale pre trained models, although successful, fatefully suffer from slow inference speed due to enormous computation cost mainly from cross modal attention in Transformer architecture. When applied to real life applications, such latency and computation demand severely deter the practical use of pre trained models. In this paper, we study Image text retrieval (ITR), the most mature scenario of V L application, which has been widely studied even prior to the emergence of recent pre trained models. We propose a simple yet highly effective approach, LightningDOT that accelerates the inference time of ITR by thousands of times, without sacrificing accuracy. LightningDOT removes the time consuming cross modal attention by pre training on three novel learning objectives, extracting feature indexes offline, and employing instant dot product matching with further re ranking, which significantly speeds up retrieval process. In fact, LightningDOT achieves new state of the art across multiple ITR benchmarks such as Flickr30k, COCO and Multi30K, outperforming existing pre trained models that consume 1000x magnitude of computational hours. Code and pre training checkpoints are available at https github.com intersun LightningDOT.


Normal subgroups of iterated wreath products of symmetric groups and alternating with symmetric groups. Normal subgroups and there properties for finite and infinite iterated wreath products S n 1 wr ldots wr S n m , n, m in mathbb N are founded. The special classes of normal subgroups and there orders are investigated. Special classes of normal subgroups are investigated and their generators are found and presented in the form of Kaloujnine tables. Inverse limit of wreath product of permutation groups is found.


Q Pain A Question Answering Dataset to Measure Social Bias in Pain Management. Recent advances in Natural Language Processing (NLP), and specifically automated Question Answering (QA) systems, have demonstrated both impressive linguistic fluency and a pernicious tendency to reflect social biases. In this study, we introduce Q Pain, a dataset for assessing bias in medical QA in the context of pain management, one of the most challenging forms of clinical decision making. Along with the dataset, we propose a new, rigorous framework, including a sample experimental design, to measure the potential biases present when making treatment decisions. We demonstrate its use by assessing two reference Question Answering systems, GPT 2 and GPT 3, and find statistically significant differences in treatment between intersectional race gender subgroups, thus reaffirming the risks posed by AI in medical settings, and the need for datasets like ours to ensure safety before medical AI applications are deployed.


Flow Loss Learning Cardinality Estimates That Matter. Previous approaches to learned cardinality estimation have focused on improving average estimation error, but not all estimates matter equally. Since learned models inevitably make mistakes, the goal should be to improve the estimates that make the biggest difference to an optimizer. We introduce a new loss function, Flow Loss, that explicitly optimizes for better query plans by approximating the optimizer's cost model and dynamic programming search algorithm with analytical functions. At the heart of Flow Loss is a reduction of query optimization to a flow routing problem on a certain plan graph in which paths correspond to different query plans. To evaluate our approach, we introduce the Cardinality Estimation Benchmark, which contains the ground truth cardinalities for sub plans of over 16K queries from 21 templates with up to 15 joins. We show that across different architectures and databases, a model trained with Flow Loss improves the cost of plans (using the PostgreSQL cost model) and query runtimes despite having worse estimation accuracy than a model trained with Q Error. When the test set queries closely match the training queries, both models improve performance significantly over PostgreSQL and are close to the optimal performance (using true cardinalities). However, the Q Error trained model degrades significantly when evaluated on queries that are slightly different (e.g., similar but not identical query templates), while the Flow Loss trained model generalizes better to such situations. For example, the Flow Loss model achieves up to 1.5x better runtimes on unseen templates compared to the Q Error model, despite leveraging the same model architecture and training data.


Weakly Durable High Performance Transactions. Existing disk based database systems largely fall into two categories they either provide very high performance but few guarantees, or expose the transaction abstraction satisfying the full ACID guarantees at the cost of lower performance. In this paper, we present an alternative that achieves the best of both worlds, namely good performance and transactional properties. Our key observation is that, because of the frequent use of synchronization primitives, systems with strong durability can hardly utilize the extremely high parallelism granted by modern storage devices. Thus, we explore the notion of weakly durable transactions, and discuss how to safely relax durability without compromising other transactional properties. We present AciKV, a transactional system whose design is centered around weak durability. AciKV exposes to users the normal transactional interface, but what sets it apart from others is a new "persist" primitive that decouples durability from commit. AciKV is a middle ground between systems that perform fast atomic operations, and ones that support transactions this middle ground is useful as it provides similar performance to the former, while prevents isolation and consistency anomalies like the latter. Our evaluation using the YCSB benchmark shows that AciKV, under workloads that involve write requests, exhibits more than two orders of magnitude higher throughput than existing strongly durable systems.


Scaling optical computing in synthetic frequency dimension using integrated cavity acousto optics. Optical computing with integrated photonics brings a pivotal paradigm shift to data intensive computing technologies. However, the scaling of on chip photonic architectures using spatially distributed schemes faces the challenge imposed by the fundamental limit of integration density. Synthetic dimensions of light offer the opportunity to extend the length of operand vectors within a single photonic component. Here, we show that large scale, complex valued matrix vector multiplications on synthetic frequency lattices can be performed using an ultra efficient, silicon based nanophotonic cavity acousto optic modulator. By harnessing the resonantly enhanced strong electro optomechanical coupling, we achieve, in a single such modulator, the full range phase coherent frequency conversions across the entire synthetic lattice, which constitute a fully connected linear computing layer. Our demonstrations open up the route towards the experimental realizations of frequency domain integrated optical computing systems simultaneously featuring very large scale data processing and small device footprints.


Approximations with deep neural networks in Sobolev time space. Solutions of evolution equation generally lies in certain Bochner Sobolev spaces, in which the solution may has regularity and integrability properties for the time variable that can be different for the space variables. Therefore, in this paper, we develop a framework shows that deep neural networks can approximate Sobolev regular functions with respect to Bochner Sobolev spaces. In our work we use the so called Rectified Cubic Unit (ReCU) as an activation function in our networks, which allows us to deduce approximation results of the neural networks while avoiding issues caused by the non regularity of the most commonly used Rectivied Linear Unit (ReLU) activation function.


A Comparative Study of the Aerodynamic Performance of Box wings and Mono wings at Low Reynolds Number. With technological advancements in autonomous aerial systems, Micro Aerial Vehicles (MAVs) have increased applications due to their small size, better maneuverability, and remote operability. Non conventional designs, such as closed box wing structures, have reduced induced drag, enabling a higher payload capacity, endurance, and aerodynamic efficiency. Current studies have widely studied the applicability of box wing for large commercial aircraft, general aviation, and medium to large UAVs. Despite the increased work on non conventional wing aircraft, little has been studied about the applicability of box wing design over a monoplane in the MAV scale and the choice of parameters that enable the box wing to be best suited. This work presents numerical simulation results for box wing configurations in contrast with the conventional monowing design, considering operations at lower Reynolds numbers and aspect ratios suitable for small UAV operations. We study the effects of lift, skin friction, and induced drag along with aerodynamic efficiency for six structures. It is intuitive to expect that the decreased induced drag would prove the box wing design outperformed the conventional design. However, the additional parasitic drag generated makes the monowing model a slightly better choice. The simulations reveal that the box wing lowers induced drag by 2 to 12 compared to a monowing aircraft but produces a lesser total lift to drag ratio by 10 at equal lift requirement. Our analysis also addresses the effect of varying aspect ratios and Reynolds numbers on the simulation results for the box wing and monowing designs and discusses the suitability of choosing a particular structure based on mission requirements.


Towards the fabrication of a morphing plasma source for biomedical applications. A new design of plasma source that merges the main features of capacitive dielectric barrier discharge (DBD) and cold atmospheric plasma jet (CAPJ) is discussed. The DBD system consists of a flexible, porous matrix consisting of silica aerogel, which is comprised between two planar parallel electrodes. The supply of helium flow submitted to a sinusoidal voltage of 5 9 kV in amplitude and 15 kHz in frequency provides a 2D distribution of plasma jets that propagate around 1 cm beyond the active DBD region. The plasma multi jet system is aimed at surface treatment of 3D objects and large areas. CAPJ performance as a hypothetical morphing source in flat and bent configurations is discussed. Optical emission spectroscopy (OES) diagnostics has provided the composition of the CAPJ through the aerogel layer. This novel source is promising for situations requiring thorough adaptation of plasma parameters to delicate samples, as for example wound healing and treatment of surgical margins in plasma based cancer surgery.


EdiBERT, a generative model for image editing. Advances in computer vision are pushing the limits of im age manipulation, with generative models sampling detailed images on various tasks. However, a specialized model is often developed and trained for each specific task, even though many image edition tasks share similarities. In denoising, inpainting, or image compositing, one always aims at generating a realistic image from a low quality one. In this paper, we aim at making a step towards a unified approach for image editing. To do so, we propose EdiBERT, a bi directional transformer trained in the discrete latent space built by a vector quantized auto encoder. We argue that such a bidirectional model is suited for image manipulation since any patch can be re sampled conditionally to the whole image. Using this unique and straightforward training objective, we show that the resulting model matches state of the art performances on a wide variety of tasks image denoising, image completion, and image composition.


Salamander lemma for non abelian group like structures. It is well known that the classical diagram lemmas of homological algebra for abelian groups can be generalized to non abelian group like structures, such as groups, rings, algebras, loops, etc. In this paper we establish such a generalization of the "salamander lemma" due to G. M. Bergman, in a self dual axiomatic context (developed originally by Z. Janelidze), which applies to all usual non abelian group like structures and also covers axiomatic contexts such as semi abelian categories in the sense of G. Janelidze, L. Marki and W. Tholen and exact categories in the sense of M. Grandis.


Accelerated Policy Evaluation Learning Adversarial Environments with Adaptive Importance Sampling. The evaluation of rare but high stakes events remains one of the main difficulties in obtaining reliable policies from intelligent agents, especially in large or continuous state action spaces where limited scalability enforces the use of a prohibitively large number of testing iterations. On the other hand, a biased or inaccurate policy evaluation in a safety critical system could potentially cause unexpected catastrophic failures during deployment. In this paper, we propose the Accelerated Policy Evaluation (APE) method, which simultaneously uncovers rare events and estimates the rare event probability in Markov decision processes. The APE method treats the environment nature as an adversarial agent and learns towards, through adaptive importance sampling, the zero variance sampling distribution for the policy evaluation. Moreover, APE is scalable to large discrete or continuous spaces by incorporating function approximators. We investigate the convergence properties of proposed algorithms under suitable regularity conditions. Our empirical studies show that APE estimates rare event probability with a smaller variance while only using orders of magnitude fewer samples compared to baseline methods in both multi agent and single agent environments.


Uncertainty Aware Deep Co training for Semi supervised Medical Image Segmentation. Semi supervised learning has made significant strides in the medical domain since it alleviates the heavy burden of collecting abundant pixel wise annotated data for semantic segmentation tasks. Existing semi supervised approaches enhance the ability to extract features from unlabeled data with prior knowledge obtained from limited labeled data. However, due to the scarcity of labeled data, the features extracted by the models are limited in supervised learning, and the quality of predictions for unlabeled data also cannot be guaranteed. Both will impede consistency training. To this end, we proposed a novel uncertainty aware scheme to make models learn regions purposefully. Specifically, we employ Monte Carlo Sampling as an estimation method to attain an uncertainty map, which can serve as a weight for losses to force the models to focus on the valuable region according to the characteristics of supervised learning and unsupervised learning. Simultaneously, in the backward process, we joint unsupervised and supervised losses to accelerate the convergence of the network via enhancing the gradient flow between different tasks. Quantitatively, we conduct extensive experiments on three challenging medical datasets. Experimental results show desirable improvements to state of the art counterparts.


Does syntax matter? A strong baseline for Aspect based Sentiment Analysis with RoBERTa. Aspect based Sentiment Analysis (ABSA), aiming at predicting the polarities for aspects, is a fine grained task in the field of sentiment analysis. Previous work showed syntactic information, e.g. dependency trees, can effectively improve the ABSA performance. Recently, pre trained models (PTMs) also have shown their effectiveness on ABSA. Therefore, the question naturally arises whether PTMs contain sufficient syntactic information for ABSA so that we can obtain a good ABSA model only based on PTMs. In this paper, we firstly compare the induced trees from PTMs and the dependency parsing trees on several popular models for the ABSA task, showing that the induced tree from fine tuned RoBERTa (FT RoBERTa) outperforms the parser provided tree. The further analysis experiments reveal that the FT RoBERTa Induced Tree is more sentiment word oriented and could benefit the ABSA task. The experiments also show that the pure RoBERTa based model can outperform or approximate to the previous SOTA performances on six datasets across four languages since it implicitly incorporates the task oriented syntactic information.


From Deterioration to Acceleration A Calibration Approach to Rehabilitating Step Asynchronism in Federated Optimization. In the setting of federated optimization, where a global model is aggregated periodically, step asynchronism occurs when participants conduct model training with fully utilizing their computational resources. It is well acknowledged that step asynchronism leads to objective inconsistency under non i.i.d. data, which degrades the model accuracy. To address this issue, we propose a new algorithm texttt FedaGrac , which calibrates the local direction to a predictive global orientation. Taking the advantage of estimated orientation, we guarantee that the aggregated model does not excessively deviate from the expected orientation while fully utilizing the local updates of faster nodes. We theoretically prove that texttt FedaGrac holds an improved order of convergence rate than the state of the art approaches and eliminates the negative effect of step asynchronism. Empirical results show that our algorithm accelerates the training and enhances the final accuracy.


A Generalised Inverse Reinforcement Learning Framework. The gloabal objective of inverse Reinforcement Learning (IRL) is to estimate the unknown cost function of some MDP base on observed trajectories generated by (approximate) optimal policies. The classical approach consists in tuning this cost function so that associated optimal trajectories (that minimise the cumulative discounted cost, i.e. the classical RL loss) are 'similar' to the observed ones. Prior contributions focused on penalising degenerate solutions and improving algorithmic scalability. Quite orthogonally to them, we question the pertinence of characterising optimality with respect to the cumulative discounted cost as it induces an implicit bias against policies with longer mixing times. State of the art value based RL algorithms circumvent this issue by solving for the fixed point of the Bellman optimality operator, a stronger criterion that is not well defined for the inverse problem. To alleviate this bias in IRL, we introduce an alternative training loss that puts more weights on future states which yields a reformulation of the (maximum entropy) IRL problem. The algorithms we devised exhibit enhanced performances (and similar tractability) than off the shelf ones in multiple OpenAI gym environments.


MILP, pseudo boolean, and OMT solvers for optimal fault tolerant placements of relay nodes in mission critical wireless networks. In critical infrastructures like airports, much care has to be devoted in protecting radio communication networks from external electromagnetic interference. Protection of such mission critical radio communication networks is usually tackled by exploiting radiogoniometers at least three suitably deployed radiogoniometers, and a gateway gathering information from them, permit to monitor and localise sources of electromagnetic emissions that are not supposed to be present in the monitored area. Typically, radiogoniometers are connected to the gateway through relay nodes. As a result, some degree of fault tolerance for the network of relay nodes is essential in order to offer a reliable monitoring. On the other hand, deployment of relay nodes is typically quite expensive. As a result, we have two conflicting requirements minimise costs while guaranteeing a given fault tolerance. In this paper, we address the problem of computing a deployment for relay nodes that minimises the relay node network cost while at the same time guaranteeing proper working of the network even when some of the relay nodes (up to a given maximum number) become faulty (fault tolerance). We show that, by means of a computation intensive pre processing on a HPC infrastructure, the above optimisation problem can be encoded as a 0 1 Linear Program, becoming suitable to be approached with standard Artificial Intelligence reasoners like MILP, PB SAT, and SMT OMT solvers. Our problem formulation enables us to present experimental results comparing the performance of these three solving technologies on a real case study of a relay node network deployment in areas of the Leonardo da Vinci Airport in Rome, Italy.


Manin Mumford in arithmetic pencils. We obtain a refinement of Manin Mumford (Raynaud's Theorem) for abelian schemes over some ring of integers. Torsion points are replaced by special 0 cycles, that is reductions modulo some, possibly varying, prime of Galois orbits of torsion points. There is a flat horizontal part and a vertical one. The irreducible components of the flat part are given by the Zariski closure, over the integers, of torsion cosets of the generic fibre of the abelian scheme. The vertical components are given by translates of abelian subvarieties, which 'come from characteristic zero'.


Federated Deep Learning with Bayesian Privacy. Federated learning (FL) aims to protect data privacy by cooperatively learning a model without sharing private data among users. For Federated Learning of Deep Neural Network with billions of model parameters, existing privacy preserving solutions are unsatisfactory. Homomorphic encryption (HE) based methods provide secure privacy protections but suffer from extremely high computational and communication overheads rendering it almost useless in practice . Deep learning with Differential Privacy (DP) was implemented as a practical learning algorithm at a manageable cost in complexity. However, DP is vulnerable to aggressive Bayesian restoration attacks as disclosed in the literature and demonstrated in experimental results of this work. To address the aforementioned perplexity, we propose a novel Bayesian Privacy (BP) framework which enables Bayesian restoration attacks to be formulated as the probability of reconstructing private data from observed public information. Specifically, the proposed BP framework accurately quantifies privacy loss by Kullback Leibler (KL) Divergence between the prior distribution about the privacy data and the posterior distribution of restoration private data conditioning on exposed information . To our best knowledge, this Bayesian Privacy analysis is the first to provides theoretical justification of secure privacy preserving capabilities against Bayesian restoration attacks. As a concrete use case, we demonstrate that a novel federated deep learning method using private passport layers is able to simultaneously achieve high model performance, privacy preserving capability and low computational complexity. Theoretical analysis is in accordance with empirical measurements of information leakage extensively experimented with a variety of DNN networks on image classification MNIST, CIFAR10, and CIFAR100 datasets.


Partitions of an Integer into Powers. In this paper, we use a simple discrete dynamical model to study partitions of integers into powers of another integer. We extend and generalize some known results about their enumeration and counting, and we give new structural results. In particular, we show that the set of these partitions can be ordered in a natural way which gives the distributive lattice structure to this set. We also give a tree structure which allow efficient and simple enumeration of the partitions of an integer.


Quality at a Glance An Audit of Web Crawled Multilingual Datasets. With the success of large scale pre training and multilingual modeling in Natural Language Processing (NLP), recent years have seen a proliferation of large, web mined text datasets covering hundreds of languages. We manually audit the quality of 205 language specific corpora released with five major public datasets (CCAligned, ParaCrawl, WikiMatrix, OSCAR, mC4). Lower resource corpora have systematic issues At least 15 corpora have no usable text, and a significant fraction contains less than 50 sentences of acceptable quality. In addition, many are mislabeled or use nonstandard ambiguous language codes. We demonstrate that these issues are easy to detect even for non proficient speakers, and supplement the human audit with automatic analyses. Finally, we recommend techniques to evaluate and improve multilingual corpora and discuss potential risks that come with low quality data releases.


A New Algorithm for Euclidean Shortest Paths in the Plane. Given a set of pairwise disjoint polygonal obstacles in the plane, finding an obstacle avoiding Euclidean shortest path between two points is a classical problem in computational geometry and has been studied extensively. Previously, Hershberger and Suri SIAM J. Comput. 1999 gave an algorithm of O(n log n) time and O(n log n) space, where n is the total number of vertices of all obstacles. Recently, by modifying Hershberger and Suri's algorithm, Wang SODA 2021 reduced the space to O(n) while the runtime of the algorithm is still O(n log n) . In this paper, we present a new algorithm of O(n h log h) time and O(n) space, provided that a triangulation of the free space is given, where h is the number of obstacles. The algorithm, which improves the previous work when h o(n) , is optimal in both time and space as Omega(n h log h) is a lower bound on the runtime. Our algorithm builds a shortest path map for a source point s , so that given any query point t , the shortest path length from s to t can be computed in O( log n) time and a shortest s t path can be produced in additional time linear in the number of edges of the path.


Arithmetic Statistics and noncommutative Iwasawa Theory. Let p be an odd prime. Associated to a pair (E, mathcal F infty) consisting of a rational elliptic curve E and a p adic Lie extension mathcal F infty of mathbb Q , is the p primary Selmer group Sel p infty (E mathcal F infty) of E over mathcal F infty . In this paper, we study the arithmetic statistics for the algebraic structure of this Selmer group. The results provide insights into the asymptotics for the growth of Mordell Weil ranks of elliptic curves in noncommutative towers.


Continuity of the roots of a nonmonic polynomial and applications in multivariate stability theory. We study continuity of the roots of nonmonic polynomials as a function of their coefficients using only the most elementary results from an introductory course in real analysis and the theory of single variable polynomials. Our approach gives both qualitative and quantitative results in the case that the degree of the unperturbed polynomial can change under a perturbation of its coefficients, a case that naturally occurs, for instance, in stability theory of polynomials, singular perturbation theory, or in the perturbation theory for generalized eigenvalue problems. An application of our results in multivariate stability theory is provided which is important in, for example, the study of hyperbolic polynomials or realizability and synthesis problems in passive electrical network theory, and will be of general interest to mathematicians as well as physicists and engineers.


Intelligent Network Layer for Cyber Physical Systems Security. Cyber Physical System (CPS) has made a tremendous progress in recent years and also disrupted many technical fields such as smart industries, smart health, smart transportation etc. to flourish the nations economy. However, CPS Security is still one of the concerns for wide adoption owing to high number of devices connecting to the internet and the traditional security solutions may not be suitable to protect the advanced, application specific attacks. This paper presents a programmable device network layer architecture to combat attacks and efficient network monitoring in heterogeneous environment CPS applications. We leverage Industrial control systems (ICS) to discuss the existing issues, highlighting the importance of advanced network layer for CPS. The programmable data plane language (P4) is introduced to detect well known HELLO Flood attack with minimal efforts in the network level and also used to featuring the potential solutions for security.


VIPPrint A Large Scale Dataset of Printed and Scanned Images for Synthetic Face Images Detection and Source Linking. The possibility of carrying out a meaningful forensics analysis on printed and scanned images plays a major role in many applications. First of all, printed documents are often associated with criminal activities, such as terrorist plans, child pornography pictures, and even fake packages. Additionally, printing and scanning can be used to hide the traces of image manipulation or the synthetic nature of images, since the artifacts commonly found in manipulated and synthetic images are gone after the images are printed and scanned. A problem hindering research in this area is the lack of large scale reference datasets to be used for algorithm development and benchmarking. Motivated by this issue, we present a new dataset composed of a large number of synthetic and natural printed face images. To highlight the difficulties associated with the analysis of the images of the dataset, we carried out an extensive set of experiments comparing several printer attribution methods. We also verified that state of the art methods to distinguish natural and synthetic face images fail when applied to print and scanned images. We envision that the availability of the new dataset and the preliminary experiments we carried out will motivate and facilitate further research in this area.


Optimising optical tweezers experiments for magnetic resonance sensing with nanodiamonds. In this article we explore the requirements for enabling high quality optically detected magnetic resonance (ODMR) spectroscopy in a conventional gradient force optical tweezers using nanodiamonds containing nitrogen vacancy (NV ) centres. We find that modulation of the infrared (1064 nm) trapping laser during spectroscopic measurements substantially improves the ODMR contrast compared with continuous wave trapping. The work is significant as it allows trapping and quantum sensing protocols to be performed in conditions where signal contrast is substantially reduced. We demonstrate the utility of the technique by resolving NV spin projections within the ODMR spectrum. Manipulating the orientation of the nanodiamond via the trapping laser polarisation, we observe changes in spectral features. Theoretical modelling then allows us to infer the crystallographic orientation of the NV . This is an essential capability for future magnetic sensing applications of optically trapped nanodiamonds.


Memorability An image computable measure of information utility. The pixels in an image, and the objects, scenes, and actions that they compose, determine whether an image will be memorable or forgettable. While memorability varies by image, it is largely independent of an individual observer. Observer independence is what makes memorability an image computable measure of information, and eligible for automatic prediction. In this chapter, we zoom into memorability with a computational lens, detailing the state of the art algorithms that accurately predict image memorability relative to human behavioral data, using image features at different scales from raw pixels to semantic labels. We discuss the design of algorithms and visualizations for face, object, and scene memorability, as well as algorithms that generalize beyond static scenes to actions and videos. We cover the state of the art deep learning approaches that are the current front runners in the memorability prediction space. Beyond prediction, we show how recent A.I. approaches can be used to create and modify visual memorability. Finally, we preview the computational applications that memorability can power, from filtering visual streams to enhancing augmented reality interfaces.


Hereditary classes of ordered sets coverable by two chains. We describe all well quasi ordered hereditary classes of countable or finite ordered sets coverable by two chains. This yields a similar description of the classes of associated bichains and incomparability graphs. In particular, we show that there are only countably many w.q.o. classes made of those finite structures. This includes previous results of Korpelainen, Lozin and Mayhill.


Comparison of approximation algorithms for the travelling salesperson problem on semimetric graphs. The aim of the paper is to compare different approximation algorithms for the travelling salesperson problem. We pick the most popular and widespread methods known in the literature and contrast them with a novel approach (the polygonal Christofides algorithm) described in our previous work. The paper contains a brief summary of theory behind the algorithms and culminates in a series of numerical simulations (or "experiments"), whose purpose is to determine "the best" approximation algorithm for the travelling salesperson problem.


Hard Encoding of Physics for Learning Spatiotemporal Dynamics. Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and epidemiology, remains uncertain or partially unknown, where very limited measurement data is yet available. To tackle this challenge, we propose a novel deep learning architecture that forcibly encodes known physics knowledge to facilitate learning in a data driven manner. The coercive encoding mechanism of physics, which is fundamentally different from the penalty based physics informed learning, ensures the network to rigorously obey given physics. Instead of using nonlinear activation functions, we propose a novel elementwise product operation to achieve the nonlinearity of the model. Numerical experiment demonstrates that the resulting physics encoded learning paradigm possesses remarkable robustness against data noise scarcity and generalizability compared with some state of the art models for data driven modeling.


Bug Prediction Using Source Code Embedding Based on Doc2Vec. Bug prediction is a resource demanding task that is hard to automate using static source code analysis. In many fields of computer science, machine learning has proven to be extremely useful in tasks like this, however, for it to work we need a way to use source code as input. We propose a simple, but meaningful representation for source code based on its abstract syntax tree and the Doc2Vec embedding algorithm. This representation maps the source code to a fixed length vector which can be used for various upstream tasks one of which is bug prediction. We measured this approach's validity by itself and its effectiveness compared to bug prediction based solely on code metrics. We also experimented on numerous machine learning approaches to check the connection between different embedding parameters with different machine learning models. Our results show that this representation provides meaningful information as it improves the bug prediction accuracy in most cases, and is always at least as good as only using code metrics as features.


Which will be your firm's next technology? Comparison between machine learning and network based algorithms. We reconstruct the innovation dynamics of about two hundred thousand companies by following their patenting activity for about ten years. We define the technological portfolios of these companies as the set of the technological sectors present in the patents they submit. By assuming that companies move more frequently towards related sectors, we leverage on their past activity to build network based and machine learning algorithms to forecast the future submission of patents in new sectors. We compare different evaluation metrics and prediction methodologies, showing that tree based machine learning algorithms overperform the standard methods based on networks of co occurrences. This methodology can be applied by firms and policymakers to disentangle, given the present innovation activity, the feasible technological sectors from those that are out of reach, given their present innovation activity.


Maximum Sum Rank Distance Codes over Finite Chain Rings. In this work, maximum sum rank distance (MSRD) codes and linearized Reed Solomon codes are extended to finite chain rings. It is proven that linearized Reed Solomon codes are MSRD over finite chain rings, extending the known result for finite fields. For the proof, several results on the roots of skew polynomials are extended to finite chain rings. These include the existence and uniqueness of minimum degree annihilator skew polynomials and Lagrange interpolator skew polynomials. An efficient Welch Berlekamp decoder with respect to the sum rank metric is then provided for finite chain rings. Finally, applications in Space Time Coding with multiple fading blocks and physical layer multishot Network Coding are discussed.


Informal Science Education and Career Advancement. This document supports a proposed APS statement that encourages academic, research, and other institutions to add the participation in informal science education activities to the criteria they use for hiring and career advancement decisions. There is a prevalent attitude that the time spent by a researcher on these activities takes time away from research efforts that are more valued by their peers and their institution. To change this mindset, we enumerate the many benefits of informal science education activities to the public, to researchers, to their institutions, and to the field of physics. We also suggest aspects of these activities that may be considered by institutions in evaluating informal educational efforts for recruitment and career advancement decisions.


Heuristic and Metaheuristic Methods for the Unrelated Machines Scheduling Problem A Survey. Today scheduling problems have an immense effect on various areas of human lives, be it from their application in manufacturing and production industry, transportation, or workforce allocation. The unrelated parallel machines scheduling problem (UPMSP), which is only one of the many different problem types that exist, found its application in many areas like production industries or distributed computing. Due to the complexity of the problem, heuristic and metaheuristic methods are gaining more attention for solving it. Although this problem variant did not receive much attention as other models, recent years saw the increase of research dealing with this problem. During that time, many different problem variants, solution methods, or other interesting research directions were considered. However, no study has until now tried to systematise the research in which heuristic methods are applied for the UPMSP. The goal of this study is to provide an extensive literature review on the application of heuristic and metaheuristic methods for solving the UPMSP. The research was systematised and classified into several categories to enable an easy overview of the different problem and solution variants. Additionally, current trends and possible future research directions are also shortly outlined.


Simple But Effective Redundant Odometry for Autonomous Vehicles. Robust and reliable ego motion is a key component of most autonomous mobile systems. Many odometry estimation methods have been developed using different sensors such as cameras or LiDARs. In this work, we present a resilient approach that exploits the redundancy of multiple odometry algorithms using a 3D LiDAR scanner and a monocular camera to provide reliable state estimation for autonomous vehicles. Our system utilizes a stack of odometry algorithms that run in parallel. It chooses from them the most promising pose estimation considering sanity checks using dynamic and kinematic constraints of the vehicle as well as a score computed between the current LiDAR scan and a locally built point cloud map. In this way, our method can exploit the advantages of different existing ego motion estimating approaches. We evaluate our method on the KITTI Odometry dataset. The experimental results suggest that our approach is resilient to failure cases and achieves an overall better performance than individual odometry methods employed by our system.


Subresultants and the Shape Lemma. In nice cases, a zero dimensional complete intersection ideal over a field of characteristic zero has a Shape Lemma. There are also cases where the ideal is generated by the resultant and first subresultant polynomials of the generators. This paper explores the relation between these representations and studies when the resultant generates the elimination ideal. We also prove a Poisson formula for resultants arising from the hidden variable method.


On Products of Strong Skolem Starters. In 1991, Shalaby conjectured that any mathbb Z n , where n equiv 1 or 3 pmod 8 , n ge 11 , admits a strong Skolem starter. In 2018, the authors explicitly constructed some infinite "cardioidal" families of strong Skolem starters. No other infinite families of these combinatorial designs were known to date. Statements regarding the products of starters, proven in this paper give a new way of generating strong or skew Skolem starters of composite orders. This approach extends our previous result by generating new infinite families that are not cardioidal. The products that we introduce in this paper are multi valued binary operations which produce 2 partitions of the set mathbb Z nm of integers modulo nm without zero, from a pair of 2 partitions of mathbb Z n and mathbb Z m , where n, m ge 3 are odd integers. We prove several remarkable properties of these operations applied to starters in mathbb Z n and to some other combinatorial objects that are 2 partitions of mathbb Z n with additional restrictions, such as strong, skew, Skolem and cardioidal 2 partitions.


Upper bounds on chromatic number of mathbb E n in low dimensions. Let chi( mathbb E n) denote the chromatic number of the Euclidean space mathbb E n , i.e., the smallest number of colors that can be used to color mathbb E n so that no two points unit distance apart are of the same color. We present explicit constructions of colorings of mathbb E n based on sublattice coloring schemes that establish the following new bounds chi( mathbb E 5) le 140 , chi( mathbb E n) le 7 n 2 for n in 6,8,24 , chi( mathbb E 7) le 1372 , chi( mathbb E 9 ) leq 17253 , and chi( mathbb E n) le 3 n for all n le 38 and n 48,49 .


ViralFP A webserver of viral fusion proteins. Viral fusion proteins are attached to the membrane of enveloped viruses (a group that includes Coronaviruses, Dengue, HIV and Influenza) and catalyze fusion between the viral and host membranes, enabling the virus to insert its genetic material into the host cell. Given the importance of these biomolecules, this work presents a centralized database containing the most relevant information on viral fusion proteins, available through a free to use web server accessible through the URL https viralfp.bio.di.uminho.pt . This web application contains several bioinformatic tools, such as Clustal sequence alignment and Weblogo, including as well a machine learning based tool capable of predicting the location of fusion peptides (the component of fusion proteins that inserts into the host's cell membrane) within the fusion protein sequence. Given the crucial role of these proteins in viral infection, their importance as natural targets of our immune system and their potential as therapeutic targets, this web application aims to foster our ability to fight pathogenic viruses.


The Optimal Size of an Epistemic Congress. We analyze the optimal size of a congress in a representative democracy. We take an epistemic view where voters decide on a binary issue with one ground truth outcome, and each voter votes correctly according to their competence levels in 0, 1 . Assuming that we can sample the best experts to form an epistemic congress, we find that the optimal congress size should be linear in the population size. This result is striking because it holds even when allowing the top representatives to be accurate with arbitrarily high probabilities. We then analyze real world data, finding that the actual sizes of congresses are much smaller than the optimal size our theoretical results suggest. We conclude by analyzing under what conditions congresses of sub optimal sizes would still outperform direct democracy, in which all voters vote.


Indecomposable objects in the derived category of a skew gentle algebra using orbifolds. Skew gentle algebras are skew group algebras of certain gentle algebras endowed with a Z 2 action. Using the topological description of Opper, Plamondon and Schroll in OPS for the indecomposable objects of the derived category of any gentle algebra, one obtains here a complete description of indecomposable objects in the derived category of any skew gentle algebras in terms of curves on an orbifold surface.The results presented here are complementary to the ones in LSV . First, we obtain a complete classification of indecomposable objects and not of ''homotopy strings'' and ''homotopy bands'' which are not always indecomposable. Second, the classification obtained here does not use the combinatorial description of BMM03 , but topological arguments coming from the double cover of the orbifold surface constructed in AB .


Using the WOWA criterion for two stage decision making problems. The weighted OWA (WOWA) is a function that aggregates a set of values with weights assigned based on the rank and relative importance of each value. The weighted OWA of uncertain objective functions can generalize many of the criteria that is used in decision making under uncertainty. In this paper, we apply the WOWA criterion to two stage decision making problems, and present decomposition algorithms to solve them. The algorithms are applied to location transportation problem with uncertain demands and computational results are presented.


Error Compensated Loopless SVRG, Quartz, and SDCA for Distributed Optimization. The communication of gradients is a key bottleneck in distributed training of large scale machine learning models. In order to reduce the communication cost, gradient compression (e.g., sparsification and quantization) and error compensation techniques are often used. In this paper, we propose and study three new efficient methods in this space error compensated loopless SVRG method (EC LSVRG), error compensated Quartz (EC Quartz), and error compensated SDCA (EC SDCA). Our method is capable of working with any contraction compressor (e.g., TopK compressor), and we perform analysis for convex optimization problems in the composite case and smooth case for EC LSVRG. We prove linear convergence rates for both cases and show that in the smooth case the rate has a better dependence on the parameter associated with the contraction compressor. Further, we show that in the smooth case, and under some certain conditions, error compensated loopless SVRG has the same convergence rate as the vanilla loopless SVRG method. Then we show that the convergence rates of EC Quartz and EC SDCA in the composite case are as good as EC LSVRG in the smooth case. Finally, numerical experiments are presented to illustrate the efficiency of our methods.


Grounding Predicates through Actions. Symbols representing abstract states such as "dish in dishwasher" or "cup on table" allow robots to reason over long horizons by hiding details unnecessary for high level planning. Current methods for learning to identify symbolic states in visual data require large amounts of labeled training data, but manually annotating such datasets is prohibitively expensive due to the combinatorial number of predicates in images. We propose a novel method for automatically labeling symbolic states in large scale video activity datasets by exploiting known pre and post conditions of actions. This automatic labeling scheme only requires weak supervision in the form of an action label that describes which action is demonstrated in each video. We use our framework to train predicate classifiers to identify symbolic relationships between objects when prompted with object bounding boxes, and demonstrate that such predicate classifiers can match the performance of those trained with full supervision at a fraction of the labeling cost. We also apply our framework to an existing large scale human activity dataset, and demonstrate the ability of these predicate classifiers trained on human data to enable closed loop task planning in the real world.


Monocular Depth Estimation with Sharp Boundary. Monocular depth estimation is the base task in computer vision. It has a tremendous development in the decade with the development of deep learning. But the boundary blur of the depth map is still a serious problem. Research finds the boundary blur problem is mainly caused by two factors, first, the low level features containing boundary and structure information may loss in deeper networks during the convolution process., second, the model ignores the errors introduced by the boundary area due to the few portions of the boundary in the whole areas during the backpropagation. In order to mitigate the boundary blur problem, we focus on the above two impact factors. Firstly, we design a scene understanding module to learn the global information with low and high level features, and then to transform the global information to different scales with our proposed scale transform module according to the different phases in the decoder. Secondly, we propose a boundary aware depth loss function to pay attention to the effects of the boundary's depth value. The extensive experiments show that our method can predict the depth maps with clearer boundaries, and the performance of the depth accuracy base on NYU depth v2 and SUN RGB D is competitive.


A Low Rank Tensor Representation of Linear Transport and Nonlinear Vlasov Solutions and Their Associated Flow Maps. We propose a low rank tensor approach to approximate linear transport and nonlinear Vlasov solutions and their associated flow maps. The approach takes advantage of the fact that the differential operators in the Vlasov equation is tensor friendly, based on which we propose a novel way to dynamically and adaptively build up low rank solution basis by adding new basis functions from discretization of the PDE, and removing basis from an SVD type truncation procedure. For the discretization, we adopt a high order finite difference spatial discretization and a second order strong stability preserving multi step time discretization. We apply the same procedure to evolve the dynamics of the flow map in a low rank fashion, which proves to be advantageous when the flow map enjoys the low rank structure, while the solution suffers from high rank or displays filamentation structures. Hierarchical Tucker decomposition is adopted for high dimensional problems. An extensive set of linear and nonlinear Vlasov test examples are performed to show the high order spatial and temporal convergence of the algorithm with mesh refinement up to SVD type truncation, the significant computational savings of the proposed low rank approach especially for high dimensional problems, the improved performance of the flow map approach for solutions with filamentations.


Broadband super resolution Terahertz Time domain spectroscopy applied to Gas analysis. Terahertz (THz) Time domain spectroscopy (THz TDS) is a broadband spectroscopic technique spreading its uses in multiple fields in science from material science to biology, in industry where it measures the thickness of a paint layer during the painting operation. Using such practical commercial apparatus with broad spectrum for gas spectroscopy could be a major asset for air quality monitoring and tracking of atmospheric composition. However, gas spectroscopy needs high resolution and the usual approach in THz TDS, where the recorded time trace is Fourier transform, suffers from resolution limitation due to the size of the delay line in the system. In this letter, we introduce the concept of constraint reconstruction for super resolution spectroscopy based on the modeling of the spectroscopic lines in a sparse spectrum. Light molecule gas typically shows sparse and narrow lines on a broad spectrum and we propose an algorithm reconstructing these lines with a resolution improvement of 10 the ultimate resolution reachable by the apparatus. We envision the proposed technique to lead to broadband, selective, rapid and cheap gas monitoring applications.


When Does Contrastive Visual Representation Learning Work?. Recent self supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well understood, the field still lacks widely accepted best practices for replicating this success on other datasets. As a first step in this direction, we study contrastive self supervised learning on four diverse large scale datasets. By looking through the lenses of data quantity, data domain, data quality, and task granularity, we provide new insights into the necessary conditions for successful self supervised learning. Our key findings include observations such as (i) the benefit of additional pretraining data beyond 500k images is modest, (ii) adding pretraining images from another domain does not lead to more general representations, (iii) corrupted pretraining images have a disparate impact on supervised and self supervised pretraining, and (iv) contrastive learning lags far behind supervised learning on fine grained visual classification tasks.


Near Optimal Randomized Exploration for Tabular MDP. We study exploration using randomized value functions in Thompson Sampling (TS) like algorithms in reinforcement learning. This type of algorithms enjoys appealing empirical performance. We show that when we use 1) a single random seed in each episode, and 2) a Bernstein type magnitude of noise, we obtain a worst case widetilde O left(H sqrt SAT right) regret bound for episodic time inhomogeneous Markov Decision Process where S is the size of state space, A is the size of action space, H is the planning horizon and T is the number of interactions. This bound polynomially improves all existing bounds for TS like algorithms based on randomized value functions, and for the first time, matches the Omega left(H sqrt SAT right) lower bound up to logarithmic factors. Our result highlights that randomized exploration can be near optimal, which was previously only achieved by optimistic algorithms. To achieve the desired result, we develop 1) a new clipping operation to ensure both the probability being optimistic and the probability being pessimistic are lower bounded by a constant, and 2) a new recursion formula for the absolute value of estimations errors to analyze the regret.


Feedback vertex sets in (directed) graphs of bounded degeneracy or treewidth. We study the minimum size f of a feedback vertex set in directed and undirected n vertex graphs of given degeneracy or treewidth. In the undirected setting the bound frac k 1 k 1 n is known to be tight for graphs with bounded treewidth k or bounded odd degeneracy k . We show that neither of the easy upper and lower bounds frac k 1 k 1 n and frac k k 2 n can be exact for the case of even degeneracy. More precisely, for even degeneracy k we prove that frac 3k 2 3k 4 n leq f frac k k 2 n . For directed graphs of bounded degeneracy k , we prove that f leq frac k 1 k 1 n and that this inequality is strict when k is odd. For directed graphs of bounded treewidth k geq 2 , we show that frac k 2 lfloor log 2(k) rfloor k 1 n leq f leq frac k k 3 n . Further, we provide several constructions of low degeneracy or treewidth and large f .


The application of mixed use measures at the pedestrian scale. Mixed use urbanism affords access to diverse assortments of land uses within a pedestrian accessible context. It confers advantages such as reductions to driving, air pollution, and Body Mass Index with associated increases in active transportation and improvements to health. However, whereas mixed use urbanism is clearly beneficial, methods for measuring and assessing the presence of mixed uses at a granular level of analysis remain murkier. This work demonstrates techniques for gauging mixed uses in more spatially precise terms concurring more readily with an urbanist's conception of pedestrian accessible mixed uses. It does so through the use of the cityseer api Python package, which facilitates the use of spatially granular land use classification data assigned to adjacent street edges and then aggregated dynamically, with distances measured from each point of analysis to each accessible land use while taking the direction of approach into account. It is argued that Hill Numbers is a suitable measure of diversity because it can mirror the intent of traditional indices while behaving more intuitively. Further, distance weighted formulations of Hill diversity can be applied with spatial impedances, thus conferring a particularly spatially nuanced gauge of local access to mixed uses. These methods and indices are demonstrated for Greater London with observations correlated to Principal Component Analysis derived from a range of land use accessibilities measured from the same locations and for the same point of interest dataset. The Hill diversity measures, particularly the distance weighted formulations, offer the most robust correlations for both expansive mixed use districts and more local 'high street' mixes of uses while yielding the most intuitive and spatially precise behaviour in the accompanying plots.


On closed manifolds admitting an Anosov diffeomorphism but no expanding map. A few years ago, the first example of a closed manifold admitting an Anosov diffeomorphism but no expanding map was given. Unfortunately, this example is not explicit and is high dimensional, although its exact dimension is unknown due to the type of construction. In this paper, we present a family of concrete 12 dimensional nilmanifolds with an Anosov diffeomorphism but no expanding map, where nilmanifolds are defined as the quotient of a 1 connected nilpotent Lie group by a cocompact lattice. We show that this family has the smallest possible dimension in the class of infra nilmanifolds, which is conjectured to be the only type of manifolds admitting Anosov diffeomorphisms up to homeomorphism. The proof shows how to construct positive gradings from the eigenvalues of the Anosov diffeomorphism under some additional assumptions related to the rank, using the action of the Galois group on these algebraic units.


Onset of space charge effects in strong field photocurrents from nanometric needle tips. Strong field photoemission from nanostructures and the associated temporally modulated currents play a key role in the development of ultrafast vacuum optoelectronics. Optical light fields could push their operation bandwidth into the petahertz domain. A critical aspect for their functionality in the context of applications is the role of charge interactions, including space charge effects. Here, we investigated the photoemission and photocurrents from nanometric tungsten needle tips exposed to carrier envelope phase controlled few cycle laser fields. We report a characteristic step wise increase in the intensity rescaled cutoff energies of emitted electrons beyond a certain intensity value. By comparison with simulations, we identify this feature as the onset of charge interaction dominated photoemission dynamics. Our results are anticipated to be relevant also for the strong field photoemission from other nanostructures, including photoemission from plasmonic nano bowtie antennas used in carrier envelope phase detection and for PHz scale devices.


BubbleNet Inferring micro bubble dynamics with semi physics informed deep learning. Micro bubbles and bubbly flows are widely observed and applied in chemical engineering, medicine, involves deformation, rupture, and collision of bubbles, phase mixture, etc. We study bubble dynamics by setting up two numerical simulation cases bubbly flow with a single bubble and multiple bubbles, both confined in the microchannel, with parameters corresponding to their medical backgrounds. Both the cases have their medical background applications. Multiphase flow simulation requires high computation accuracy due to possible component losses that may be caused by sparse meshing during the computation. Hence, data driven methods can be adopted as an useful tool. Based on physics informed neural networks (PINNs), we propose a novel deep learning framework BubbleNet, which entails three main parts deep neural networks (DNN) with sub nets for predicting different physics fields the semi physics informed part, with only the fluid continuum condition and the pressure Poisson equation mathcal P encoded within the time discretized normalizer (TDN), an algorithm to normalize field data per time step before training. We apply the traditional DNN and our BubbleNet to train the coarsened simulation data and predict the physics fields of both the two bubbly flow cases. The BubbleNets are trained for both with and without mathcal P , from which we conclude that the 'physics informed' part can serve as inner supervision. Results indicate our framework can predict the physics fields more accurately, estimating the prediction absolute errors. Our deep learning predictions outperform traditional numerical methods computed with similar data density meshing. The proposed network can potentially be applied to many other engineering fields.


Coulomb explosion imaging of carbon monoxide dimers. We report on experimental results obtained from collisions of slow highly charged Ar9 ions with a carbon monoxide dimer (CO)2 target. A COLTRIMS setup and a Coulomb explosion imaging approach are used to reconstruct the structure of the CO dimers. The three dimensional structure is deduced from the 2 body and 3 body dissociation channels from which both the intermolecular bond length and the relative orientation of the two molecules are determined. For the 3 body channels, the experimental data are interpreted with the help of a classical model in which the trajectories of the three emitted fragments are numerically integrated. We measured the equilibrium intermolecular distance to be Re 4.2 A. The orientation of both CO molecules with respect to the dimer axis is found to be quasi isotropic due to the large vibrational temperature of the gas jet.


Convolutions for Spatial Interaction Modeling. In many different fields interactions between objects play a critical role in determining their behavior. Graph neural networks (GNNs) have emerged as a powerful tool for modeling interactions, although often at the cost of adding considerable complexity and latency. In this paper, we consider the problem of spatial interaction modeling in the context of predicting the motion of actors around autonomous vehicles, and investigate alternative approaches to GNNs. We revisit convolutions and show that they can demonstrate comparable performance to graph networks in modeling spatial interactions with lower latency, thus providing an effective and efficient alternative in time critical systems. Moreover, we propose a novel interaction loss to further improve the interaction modeling of the considered methods.


Non cumulative measures of researcher citation impact. The most commonly used publication metrics for individual researchers are the the total number of publications, the total number of citations, and Hirsch's h index. Each of these is cumulative, and hence increases throughout a researcher's career, making it less suitable for evaluation of junior researchers or assessing recent impact. Most other author level measures in the literature share this cumulative property. By contrast, we aim to study non cumulative measures that answer the question "in terms of citation impact, what have you done lately?" We single out six measures from the rather sparse literature, including Hirsch's m index, a time scaled version of the h index. We introduce new measures based on the idea of "citation acceleration". After presenting several axioms for non cumulative measures, we conclude that one of our new measures has much better theoretical justification. We present a small scale study of its performance on real data and conclude that it shows substantial promise for future use.


Explaining Algorithmic Fairness Through Fairness Aware Causal Path Decomposition. Algorithmic fairness has aroused considerable interests in data mining and machine learning communities recently. So far the existing research has been mostly focusing on the development of quantitative metrics to measure algorithm disparities across different protected groups, and approaches for adjusting the algorithm output to reduce such disparities. In this paper, we propose to study the problem of identification of the source of model disparities. Unlike existing interpretation methods which typically learn feature importance, we consider the causal relationships among feature variables and propose a novel framework to decompose the disparity into the sum of contributions from fairness aware causal paths, which are paths linking the sensitive attribute and the final predictions, on the graph. We also consider the scenario when the directions on certain edges within those paths cannot be determined. Our framework is also model agnostic and applicable to a variety of quantitative disparity measures. Empirical evaluations on both synthetic and real world data sets are provided to show that our method can provide precise and comprehensive explanations to the model disparities.


Finiteness of fppf cohomology. Let R be a Henselian DVR with finite residue field. Let G be a finite type, flat R group scheme (not necessarily commutative) with smooth generic fiber. We show that H 1 mathrm fppf ( mathrm Spec R,G) is finite. We then give an application of the global analogue of this finiteness result to PEL type integral models of Shimura varieties.


Misspelling Correction with Pre trained Contextual Language Model. Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context. Unlike humans, computer systems do not possess the convenient auto complete functionality of which human brains are capable. While many programs provide spelling correction functionality, many systems do not take context into account. Moreover, Artificial Intelligence systems function in the way they are trained on. With many current Natural Language Processing (NLP) systems trained on grammatically correct text data, many are vulnerable against adversarial examples, yet correctly spelled text processing is crucial for learning. In this paper, we investigate how spelling errors can be corrected in context, with a pre trained language model BERT. We present two experiments, based on BERT and the edit distance algorithm, for ranking and selecting candidate corrections. The results of our experiments demonstrated that when combined properly, contextual word embeddings of BERT and edit distance are capable of effectively correcting spelling errors.


A Tale of Three Datasets Towards Characterizing Mobile Broadband Access in the United States. Understanding and improving mobile broadband deployment is critical to bridging the digital divide and targeting future investments. Yet accurately mapping mobile coverage is challenging. In 2019, the Federal Communications Commission (FCC) released a report on the progress of mobile broadband deployment in the United States. This report received a significant amount of criticism with claims that the cellular coverage, mainly available through Long Term Evolution (LTE), was over reported in some areas, especially those that are rural and or tribal 12 . We evaluate the validity of this criticism using a quantitative analysis of both the dataset from which the FCC based its report and a crowdsourced LTE coverage dataset. Our analysis is focused on the state of New Mexico, a region characterized by diverse mix of demographics geography and poor broadband access. We then performed a controlled measurement campaign in northern New Mexico during May 2019. Our findings reveal significant disagreement between the crowdsourced dataset and the FCC dataset regarding the presence of LTE coverage in rural and tribal census blocks, with the FCC dataset reporting higher coverage than the crowdsourced dataset. Interestingly, both the FCC and the crowdsourced data report higher coverage compared to our on the ground measurements. Based on these findings, we discuss our recommendations for improved LTE coverage measurements, whose importance has only increased in the COVID 19 era of performing work and school from home, especially in rural and tribal areas.