Fair and Differentially Private Distributed Frequency Estimation. In order to remain competitive, Internet companies collect and analyse user data for the purpose of improving user experiences. Frequency estimation is a widely used statistical tool which could potentially conflict with the relevant privacy regulations. Privacy preserving analytic methods based on differential privacy have been proposed, which either require a large user base or a trusted server hence may give big companies an unfair advantage while handicapping smaller organizations in their growth opportunity. To address this issue, this paper proposes a fair privacy preserving sampling based frequency estimation method and provides a relation between its privacy guarantee, output accuracy, and number of participants. We designed decentralized privacy preserving aggregation mechanisms using multi party computation technique and established that, for a limited number of participants and a fixed privacy level, our mechanisms perform better than those that are based on traditional perturbation methods hence, provide smaller companies a fair growth opportunity. We further propose an architectural model to support weighted aggregation in order to achieve higher accuracy estimate to cater for users with different privacy requirements. Compared to the unweighted aggregation, our method provides a more accurate estimate. Extensive experiments are conducted to show the effectiveness of the proposed methods.


Evaluating Tooling and Methodology when Analysing Bitcoin Mixing Services After Forensic Seizure. Little or no research has been directed to analysis and researching forensic analysis of the Bitcoin mixing or 'tumbling' service themselves. This work is intended to examine effective tooling and methodology for recovering forensic artifacts from two privacy focused mixing services namely Obscuro which uses the secure enclave on intel chips to provide enhanced confidentiality and Wasabi wallet which uses CoinJoin to mix and obfuscate crypto currencies. These wallets were set up on VMs and then several forensic tools used to examine these VM images for relevant forensic artifacts. These forensic tools were able to recover a broad range of forensic artifacts and found both network forensics and logging files to be a useful source of artifacts to deanonymize these mixing services.


Perceptual Loss for Robust Unsupervised Homography Estimation. Homography estimation is often an indispensable step in many computer vision tasks. The existing approaches, however, are not robust to illumination and or larger viewpoint changes. In this paper, we propose bidirectional implicit Homography Estimation (biHomE) loss for unsupervised homography estimation. biHomE minimizes the distance in the feature space between the warped image from the source viewpoint and the corresponding image from the target viewpoint. Since we use a fixed pre trained feature extractor and the only learnable component of our framework is the homography network, we effectively decouple the homography estimation from representation learning. We use an additional photometric distortion step in the synthetic COCO dataset generation to better represent the illumination variation of the real world scenarios. We show that biHomE achieves state of the art performance on synthetic COCO dataset, which is also comparable or better compared to supervised approaches. Furthermore, the empirical results demonstrate the robustness of our approach to illumination variation compared to existing methods.


Duals of finite quantum permutation groups. We work out axioms for the duals G subset U N of the finite quantum permutation groups, F subset S N with F infty , and we discuss how the basic theory of such quantum permutation groups partly simplifies in the dual setting. We discuss as well some potential extensions to the infinite case, in connection with the well known question of axiomatizing the discrete quantum group actions on the infinite graphs.


A Bytecode based Approach for Smart Contract Classification. With the development of blockchain technologies, the number of smart contracts deployed on blockchain platforms is growing exponentially, which makes it difficult for users to find desired services by manual screening. The automatic classification of smart contracts can provide blockchain users with keyword based contract searching and helps to manage smart contracts effectively. Current research on smart contract classification focuses on Natural Language Processing (NLP) solutions which are based on contract source code. However, more than 94 of smart contracts are not open source, so the application scenarios of NLP methods are very limited. Meanwhile, NLP models are vulnerable to adversarial attacks. This paper proposes a classification model based on features from contract bytecode instead of source code to solve these problems. We also use feature selection and ensemble learning to optimize the model. Our experimental studies on over 3,300 real world Ethereum smart contracts show that our model can classify smart contracts without source code and has better performance than baseline models. Our model also has good resistance to adversarial attacks compared with NLP based models. In addition, our analysis reveals that account features used in many smart contract classification models have little effect on classification and can be excluded.


An Intelligent Self driving Truck System For Highway Transportation. Recently, there have been many advances in autonomous driving society, attracting a lot of attention from academia and industry. However, existing works mainly focus on cars, extra development is still required for self driving truck algorithms and models. In this paper, we introduce an intelligent self driving truck system. Our presented system consists of three main components, 1) a realistic traffic simulation module for generating realistic traffic flow in testing scenarios, 2) a high fidelity truck model which is designed and evaluated for mimicking real truck response in real world deployment, 3) an intelligent planning module with learning based decision making algorithm and multi mode trajectory planner, taking into account the truck's constraints, road slope changes, and the surrounding traffic flow. We provide quantitative evaluations for each component individually to demonstrate the fidelity and performance of each part. We also deploy our proposed system on a real truck and conduct real world experiments which shows our system's capacity of mitigating sim to real gap. Our code is available at https github.com InceptioResearch IITS


Click Through Rate Prediction Using Graph Neural Networks and Online Learning. Recommendation systems have been extensively studied by many literature in the past and are ubiquitous in online advertisement, shopping industry e commerce, query suggestions in search engines, and friend recommendation in social networks. Moreover, restaurant music product movie news app recommendations are only a few of the applications of a recommender system. A small percent improvement on the CTR prediction accuracy has been mentioned to add millions of dollars of revenue to the advertisement industry. Click Through Rate (CTR) prediction is a special version of recommender system in which the goal is predicting whether or not a user is going to click on a recommended item. A content based recommendation approach takes into account the past history of the user's behavior, i.e. the recommended products and the users reaction to them. So, a personalized model that recommends the right item to the right user at the right time is the key to building such a model. On the other hand, the so called collaborative filtering approach incorporates the click history of the users who are very similar to a particular user, thereby helping the recommender to come up with a more confident prediction for that particular user by leveraging the wider knowledge of users who share their taste in a connected network of users. In this project, we are interested in building a CTR predictor using Graph Neural Networks complemented by an online learning algorithm that models such dynamic interactions. By framing the problem as a binary classification task, we have evaluated this system both on the offline models (GNN, Deep Factorization Machines) with test AUC of 0.7417 and on the online learning model with test AUC of 0.7585 using a sub sampled version of Criteo public dataset consisting of 10,000 data points.


A structure preserving doubling algorithm for solving a class of quadratic matrix equation with M matrix. Consider the problem of finding the maximal nonpositive solvent Phi of the quadratic matrix equation (QME) X 2 BX C 0 with B being a nonsingular M matrix and C an M matrix such that B 1 C ge 0 , and B C I a nonsingular M matrix. Such QME arises from an overdamped vibrating system. Recently, Yu et al. ( em Appl. Math. Comput. , 218 3303 3310, 2011) proved that rho( Phi) le 1 for this QME. In this paper, we slightly improve their result and prove rho( Phi) 1 , which is important for the quadratic convergence of the structure preserving doubling algorithm. Then, a new globally monotonically and quadratically convergent structure preserving doubling algorithm to solve the QME is developed. Numerical examples are presented to demonstrate the feasibility and effectiveness of our method.


How Lexical Gold Standards Have Effects On The Usefulness Of Text Analysis Tools For Digital Scholarship. This paper describes how the current lexical similarity and analogy gold standards are built to conform to certain ideas about what the models they are designed to evaluate are used for. Topical relevance has always been the most important target notion for information access tools and related language technology technologies, and while this has proven a useful starting point for much of what information technology is used for, it does not always align well with other uses to which technologies are being put, most notably use cases from digital scholarship in the humanities or social sciences. This paper argues for more systematic formulation of requirements from the digital humanities and social sciences and more explicit description of the assumptions underlying model design.


Correlations between Panoramic Imagery and Gamma Ray Background in an Urban Area. When searching for radiological sources in an urban area, a vehicle borne detector system will often measure complex, varying backgrounds primarily from natural gamma ray sources. Much work has been focused on developing spectral algorithms that retain sensitivity and minimize the false positive rate even in the presence of such spectral and temporal variability. However, information about the environment surrounding the detector system might also provide useful clues about the expected background, which if incorporated into an algorithm, could improve performance. Recent work has focused on extensive measuring and modeling of urban areas with the goal of understanding how these complex backgrounds arise. This work presents an analysis of panoramic video images and gamma ray background data collected in Oakland, California by the Radiological Multi sensor Analysis Platform (RadMAP) vehicle. Features were extracted from the panoramic images by semantically labeling the images and then convolving the labeled regions with the detector response. A linear model was used to relate the image derived features to gamma ray spectral features obtained using Non negative Matrix Factorization (NMF) under different regularizations. We find some gamma ray background features correlate strongly with image derived features that measure the response adjusted solid angle subtended by sky and buildings, and we discuss the implications for the development of future, contextually aware detection algorithms.


Equality of ultradifferentiable classes by means of indices of mixed O regular variation. We characterize the equality between ultradifferentiable function classes defined in terms of abstractly given weight matrices and in terms of the corresponding matrix of associated weight functions by using new growth indices. These indices, defined by means of weight sequences and (associated) weight functions, are extending the notion of O regular variation to a mixed setting. Hence we are extending the known comparison results concerning classes defined in terms of a single weight sequence and of a single weight function and give also these statements an interpretation expressed in O regular variation.


Lacunary Polynomial Compositions. This work is a study of polynomial compositions having a fixed number of terms. We outline a recursive method to describe these characterizations, give some particular results and discuss the general case. In the final sections, some applications to Universal Hilbert Sets generated by closed forms of linear recurrence relations and to integer perfect powers having few digits in their representation in a given scale x ge 2 are provided.


Efficient Tensor Robust PCA under Hybrid Model of Tucker and Tensor Train. Tensor robust principal component analysis (TRPCA) is a fundamental model in machine learning and computer vision. Recently, tensor train (TT) decomposition has been verified effective to capture the global low rank correlation for tensor recovery tasks. However, due to the large scale tensor data in real world applications, previous TRPCA models often suffer from high computational complexity. In this letter, we propose an efficient TRPCA under hybrid model of Tucker and TT. Specifically, in theory we reveal that TT nuclear norm (TTNN) of the original big tensor can be equivalently converted to that of a much smaller tensor via a Tucker compression format, thereby significantly reducing the computational cost of singular value decomposition (SVD). Numerical experiments on both synthetic and real world tensor data verify the superiority of the proposed model.


Long time behavior of SSEP with slow boundary. We consider the symmetric simple exclusion process with slow boundary first introduced in Baldasso it et al. , Journal of Statistical Physics, 167(5), 2017 . We prove a law of large number for the empirical measure of the process under a longer time scaling instead of the usual diffusive time scaling.


Differentially Private Histograms in the Shuffle Model from Fake Users. There has been much recent work in the shuffle model of differential privacy, particularly for approximate d bin histograms. While these protocols achieve low error, the number of messages sent by each user the message complexity has so far scaled with d or the privacy parameters. The message complexity is an informative predictor of a shuffle protocol's resource consumption. We present a protocol whose message complexity is two when there are sufficiently many users. The protocol essentially pairs each row in the dataset with a fake row and performs a simple randomization on all rows. We show that the error introduced by the protocol is small, using rigorous analysis as well as experiments on real world data. We also prove that corrupt users have a relatively low impact on our protocol's estimates.


Applications of Artificial Intelligence, Machine Learning and related techniques for Computer Networking Systems. This article presents a primer overview of applications of Artificial Intelligence and Machine Learning (AI ML) techniques to address problems in the domain of computer networking. In particular, the techniques have been used to support efficient and accurate traffic prediction, traffic classification, anomaly detection, network management, network security, network resource allocation and optimization, network scheduling algorithms, fault diagnosis and many more such applications. The article first summarizes some of the key networking concepts and a few representative machine learning techniques and algorithms. The article then presents details regarding the availability of data sets for networking applications and machine learning software and toolkits for processing these data sets. Highlights of some of the standards activities, pursued by ITU T and ETSI, which are related to AI ML for networking, are also presented. Finally, the article discusses a small set of representative networking problems where AI ML techniques have been successfully applied.


Regret optimal Estimation and Control. We consider estimation and control in linear time varying dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing causal estimators and controllers which compete against a clairvoyant noncausal policy, instead of the best policy selected in hindsight from some fixed parametric class. We show that the regret optimal estimator and regret optimal controller can be derived in state space form using operator theoretic techniques from robust control and present tight,data dependent bounds on the regret incurred by our algorithms in terms of the energy of the disturbances. Our results can be viewed as extending traditional robust estimation and control, which focuses on minimizing worst case cost, to minimizing worst case regret. We propose regret optimal analogs of Model Predictive Control (MPC) and the Extended KalmanFilter (EKF) for systems with nonlinear dynamics and present numerical experiments which show that our regret optimal algorithms can significantly outperform standard approaches to estimation and control.


Modelling Strategic Deceptive Planning in Adversarial Multi Agent Systems. Deception is virtually ubiquitous in warfare, and should be a central consideration for military operations research. However, studies of agent behaviour in simulated operations have typically neglected to include explicit models of deception. This paper proposes that a computational model that approximates the human deceptive planning process would enable the authentic representation of strategic deception in multi agent systems. The proposed deceptive planning model provides a framework for studying, explaining, and discovering deceptive behaviours, enabling the generation of novel solutions to adversarial planning problems.


The EIHW GLAM Deep Attentive Multi model Fusion System for Cough based COVID 19 Recognition in the DiCOVA 2021 Challenge. Aiming to automatically detect COVID 19 from cough sounds, we propose a deep attentive multi model fusion system evaluated on the Track 1 dataset of the DiCOVA 2021 challenge. Three kinds of representations are extracted, including hand crafted features, image from audio based deep representations, and audio based deep representations. Afterwards, the best models on the three types of features are fused at both the feature level and the decision level. The experimental results demonstrate that the proposed attention based fusion at the feature level achieves the best performance (AUC 77.96 ) on the test set, resulting in an 8.05 improvement over the official baseline.


Branching Time Active Inference with Bayesian Filtering. Branching Time Active Inference (Champion et al., 2021b,a) is a framework proposing to look at planning as a form of Bayesian model expansion. Its root can be found in Active Inference (Friston et al., 2016 Da Costa et al., 2020 Champion et al., 2021c), a neuroscientific framework widely used for brain modelling, as well as in Monte Carlo Tree Search (Browne et al., 2012), a method broadly applied in the Reinforcement Learning literature. Up to now, the inference of the latent variables was carried out by taking advantage of the flexibility offered by Variational Message Passing (Winn and Bishop, 2005), an iterative process that can be understood as sending messages along the edges of a factor graph (Forney, 2001). In this paper, we harness the efficiency of an alternative method for inference called Bayesian Filtering (Fox et al., 2003), which does not require the iteration of the update equations until convergence of the Variational Free Energy. Instead, this scheme alternates between two phases integration of evidence and prediction of future states. Both of those phases can be performed efficiently and this provides a seventy times speed up over the state of the art.


Dynamic Sample Complexity for Exact Sparse Recovery using Sequential Iterative Hard Thresholding. In this paper we consider the problem of exact recovery of a fixed sparse vector with the measurement matrices sequentially arriving along with corresponding measurements. We propose an extension of the iterative hard thresholding (IHT) algorithm, termed as sequential IHT (SIHT) which breaks the total time horizon into several phases such that IHT is executed in each of these phases using a fixed measurement matrix obtained at the beginning of that phase. We consider a stochastic setting where the measurement matrices obtained at each phase are independent samples of a sub Gaussian random matrix. We prove that if a certain dynamic sample complexity that depends on the sizes of the measurement matrices at each phase, along with their duration and the number of phases, satisfy certain lower bound, the estimation error of SIHT over a fixed time horizon decays rapidly. Interestingly, this bound reveals that the probability of decay of estimation error is hardly affected even if very small number measurements are sporadically used in different phases. This theoretical observation is also corroborated using numerical experiments demonstrating that SIHT enjoys improved probability of recovery compared to offline IHT.


Non essential arcs in phylogenetic networks. In the study of rooted phylogenetic networks, analyzing the set of rooted phylogenetic trees that are embedded in such a network is a recurring task. From an algorithmic viewpoint, this analysis almost always requires an exhaustive search of a particular multiset S of rooted phylogenetic trees that are embedded in a rooted phylogenetic network mathcal N . Since the size of S is exponential in the number of reticulations of mathcal N , it is consequently of interest to keep this number as small as possible but without loosing any element of S . In this paper, we take a first step towards this goal by introducing the notion of a non essential arc of mathcal N , which is an arc whose deletion from mathcal N results in a rooted phylogenetic network mathcal N ' such that the sets of rooted phylogenetic trees that are embedded in mathcal N and mathcal N ' are the same. We investigate the popular class of tree child networks and characterize which arcs are non essential. This characterization is based on a family of directed graphs. Using this novel characterization, we show that identifying and deleting all non essential arcs in a tree child network takes time that is cubic in the number of leaves of the network. Moreover, we show that deciding if a given arc of an arbitrary phylogenetic network is non essential is Pi 2 P complete.


On tau tilting finiteness of tensor products between simply connected algebras. The main aim of this paper is to discuss the finiteness of tau tilting modules over the tensor product of two simply connected algebras. In this paper, we completely determine tau tilting finite tensor products between path algebras. In addition, we determine the boundary of tau tilting finiteness of tensor products between simply connected algebras in most cases.


ErfAct and Pserf Non monotonic Smooth Trainable Activation Functions. An activation function is a crucial component of a neural network that introduces non linearity in the network. The state of the art performance of a neural network depends also on the perfect choice of an activation function. We propose two novel non monotonic smooth trainable activation functions, called ErfAct and Pserf. Experiments suggest that the proposed functions improve the network performance significantly compared to the widely used activations like ReLU, Swish, and Mish. Replacing ReLU by ErfAct and Pserf, we have 5.68 and 5.42 improvement for top 1 accuracy on Shufflenet V2 (2.0x) network in CIFAR100 dataset, 2.11 and 1.96 improvement for top 1 accuracy on Shufflenet V2 (2.0x) network in CIFAR10 dataset, 1.0 , and 1.0 improvement on mean average precision (mAP) on SSD300 model in Pascal VOC dataset.


Towards the evaluation of automatic simultaneous speech translation from a communicative perspective. In recent years, automatic speech to speech and speech to text translation has gained momentum thanks to advances in artificial intelligence, especially in the domains of speech recognition and machine translation. The quality of such applications is commonly tested with automatic metrics, such as BLEU, primarily with the goal of assessing improvements of releases or in the context of evaluation campaigns. However, little is known about how the output of such systems is perceived by end users or how they compare to human performances in similar communicative tasks. In this paper, we present the results of an experiment aimed at evaluating the quality of a real time speech translation engine by comparing it to the performance of professional simultaneous interpreters. To do so, we adopt a framework developed for the assessment of human interpreters and use it to perform a manual evaluation on both human and machine performances. In our sample, we found better performance for the human interpreters in terms of intelligibility, while the machine performs slightly better in terms of informativeness. The limitations of the study and the possible enhancements of the chosen framework are discussed. Despite its intrinsic limitations, the use of this framework represents a first step towards a user centric and communication oriented methodology for evaluating real time automatic speech translation.


Projection scheme for polynomial diffusions on the unit ball. In this article, we consider numerical schemes for polynomial diffusions on the unit ball mathscr B d , which are solutions of stochastic differential equations with a diffusion coefficient of the form sqrt 1 x 2 . We introduce a projection scheme on the unit ball mathscr B d based on a backward Euler Maruyama scheme and provide the L 2 rate of convergence. The main idea to consider the numerical scheme is the transformation argument introduced by Swart 29 for proving the pathwise uniqueness for some stochastic differential equation with a non Lipschitz diffusion coefficient.


Convergence of persistence diagram in the sparse regime. The objective of this paper is to examine the asymptotic behavior of persistence diagrams associated with v C ech filtration. A persistence diagram is a graphical descriptor of a topological and algebraic structure of geometric objects. We consider v C ech filtration over a scaled random sample r n 1 mathcal X n r n 1 X 1, dots, r n 1 X n , such that r n to 0 as n to infty . We treat persistence diagrams as a point process and establish their limit theorems in the sparse regime nr n d to0 , n to infty . In this setting, we show that the asymptotics of the k th persistence diagram depends on the limit value of the sequence n k 2 r n d(k 1) . If n k 2 r n d(k 1) to infty , the scaled persistence diagram converges to a deterministic Radon measure almost surely in the vague metric. If r n decays faster so that n k 2 r n d(k 1) to c in (0, infty) , the persistence diagram weakly converges to a limiting point process without normalization. Finally, if n k 2 r n d(k 1) to 0 , the sequence of probability distributions of a persistence diagram should be normalized, and the resulting convergence will be treated in terms of the mathcal M 0 topology.


Space Time Memory Network for Sounding Object Localization in Videos. Leveraging temporal synchronization and association within sight and sound is an essential step towards robust localization of sounding objects. To this end, we propose a space time memory network for sounding object localization in videos. It can simultaneously learn spatio temporal attention over both uni modal and cross modal representations from audio and visual modalities. We show and analyze both quantitatively and qualitatively the effectiveness of incorporating spatio temporal learning in localizing audio visual objects. We demonstrate that our approach generalizes over various complex audio visual scenes and outperforms recent state of the art methods.


The University of Texas at Dallas HLTRI's Participation in EPIC QA Searching for Entailed Questions Revealing Novel Answer Nuggets. The Epidemic Question Answering (EPIC QA) track at the Text Analysis Conference (TAC) is an evaluation of methodologies for answering ad hoc questions about the COVID 19 disease. This paper describes our participation in both tasks of EPIC QA, targeting (1) Expert QA and (2) Consumer QA. Our methods used a multi phase neural Information Retrieval (IR) system based on combining BM25, BERT, and T5 as well as the idea of considering entailment relations between the original question and questions automatically generated from answer candidate sentences. Moreover, because entailment relations were also considered between all generated questions, we were able to re rank the answer sentences based on the number of novel answer nuggets they contained, as indicated by the processing of a question entailment graph. Our system, called SEaRching for Entailed QUestions revealing NOVel nuggets of Answers (SER4EQUNOVA), produced promising results in both EPIC QA tasks, excelling in the Expert QA task.


Towards Structured Dynamic Sparse Pre Training of BERT. Identifying algorithms for computational efficient unsupervised training of large language models is an important and active area of research. In this work, we develop and study a straightforward, dynamic always sparse pre training approach for BERT language modeling task, which leverages periodic compression steps based on magnitude pruning followed by random parameter re allocation. This approach enables us to achieve Pareto improvements in terms of the number of floating point operations (FLOPs) over statically sparse and dense models across a broad spectrum of network sizes. Furthermore, we demonstrate that training remains FLOP efficient when using coarse grained block sparsity, making it particularly promising for efficient execution on modern hardware accelerators.


Adaptive Deconvolution based stereo matching Net for Local Stereo Matching. In deep learning based local stereo matching methods, larger image patches usually bring better stereo matching accuracy. However, it is unrealistic to increase the size of the image patch size without restriction. Arbitrarily extending the patch size will change the local stereo matching method into the global stereo matching method, and the matching accuracy will be saturated. We simplified the existing Siamese convolutional network by reducing the number of network parameters and propose an efficient CNN based structure, namely Adaptive Deconvolution based disparity matching Net (ADSM net) by adding deconvolution layers to learn how to enlarge the size of input feature map for the following convolution layers. Experimental results on the KITTI 2012 and 2015 datasets demonstrate that the proposed method can achieve a good trade off between accuracy and complexity.


Agent Based Campus Novel Coronavirus Infection and Control Simulation. Corona Virus Disease 2019 (COVID 19), due to its extremely high infectivity, has been spreading rapidly around the world and bringing huge influence to socioeconomic development as well as people's daily life. Taking for example the virus transmission that may occur after college students return to school, we analyze the quantitative influence of the key factors on the virus spread, including crowd density and self protection. One Campus Virus Infection and Control Simulation model (CVICS) of the novel coronavirus is proposed in this paper, fully considering the characteristics of repeated contact and strong mobility of crowd in the closed environment. Specifically, we build an agent based infection model, introduce the mean field theory to calculate the probability of virus transmission, and micro simulate the daily prevalence of infection among individuals. The experimental results show that the proposed model in this paper efficiently simulate how the virus spread in the dense crowd in frequent contact under closed environment. Furthermore, preventive and control measures such as self protection, crowd decentralization and isolation during the epidemic can effectively delay the arrival of infection peak and reduce the prevalence, and finally lower the risk of COVID 19 transmission after the students return to school.


A note on the existence of U cyclic elements in periodic Floer homology. Edtmair Hutchings have recently defined, using periodic Floer homology, a U cycle property for Hamiltonian isotopy classes of area preserving diffeomorphisms of closed surfaces. They show that every Hamiltonian isotopy class satisfying the U cycle property satisfies the smooth closing lemma and also satisfies a kind of Weyl law involving the actions of certain periodic points they show that every rational isotopy class on the two torus satisfies the U cycle property. It seems that in general, not much is known about the U module structure on PFH. Here we consider a version of Seiberg Witten Floer cohomology which is known by the work of Lee Taubes to be isomorphic, as a U module, to the periodic Floer homology in sufficiently high degree. We show that the analogous U cycle property holds for every rational Hamiltonian isotopy class on any closed surface and, more generally, for any non torsion spin c structure. On the other hand, we also show that a rational isotopy class may contain elements that are not U cyclic. By the Lee Taubes isomorphism, the same results hold for PFH. Our results are some of the first computations concerning the U module structure on these theories.


Contrast enhanced spectral mammography with a photon counting detector. Purpose Spectral imaging is a method in medical x ray imaging to extract information about the object constituents by the material specific energy dependence of x ray attenuation. The authors have investigated a photon counting spectral imaging system with two energy bins for contrast enhanced mammography. System optimization and the potential benefit compared to conventional non energy resolved absorption imaging was studied. Methods A framework for system characterization was set up that included quantum and anatomical noise and a theoretical model of the system was benchmarked to phantom measurements. Results Optimal combination of the energy resolved images corresponded approximately to minimization of the anatomical noise, which is commonly referred to as energy subtraction. In that case, an ideal observer detectability index could be improved close to 50 compared to absorption imaging in the phantom study. Optimization with respect to the signal to quantum noise ratio, commonly referred to as energy weighting, yielded only a minute improvement. In a simulation of a clinically more realistic case, spectral imaging was predicted to perform approximately 30 better than absorption imaging for an average glandularity breast with an average level of anatomical noise. For dense breast tissue and a high level of anatomical noise, however, a rise in detectability by a factor of 6 was predicted. Another 70 90 improvement was found to be within reach for an optimized system. Conclusions Contrast enhanced spectral mammography is feasible and beneficial with the current system, and there is room for additional improvements. Inclusion of anatomical noise is essential for optimizing spectral imaging systems.


Converse Lyapunov theorems for control systems with unbounded controls. In this paper, we extend well known relationships between global asymptotic controllability, sample stabilizability, and the existence of a control Lyapunov function to a wide class of control systems with unbounded controls, which includes control polynomial systems. In particular, we consider open loop controls and discontinuous stabilizing feedbacks, which may be unbounded approaching the target, so that the corresponding trajectories may present a chattering behavior. A key point of our results is to prove that global asymptotic controllability, sample stabilizability, and existence of a control Lyapunov function for these systems or for an em impulsive extension of them are equivalent.


Semantic Image Fusion. Image fusion methods and metrics for their evaluation have conventionally used pixel based or low level features. However, for many applications, the aim of image fusion is to effectively combine the semantic content of the input images. This paper proposes a novel system for the semantic combination of visual content using pre trained CNN network architectures. Our proposed semantic fusion is initiated through the fusion of the top layer feature map outputs (for each input image)through gradient updating of the fused image input (so called image optimisation). Simple "choose maximum" and "local majority" filter based fusion rules are utilised for feature map fusion. This provides a simple method to combine layer outputs and thus a unique framework to fuse single channel and colour images within a decomposition pre trained for classification and therefore aligned with semantic fusion. Furthermore, class activation mappings of each input image are used to combine semantic information at a higher level. The developed methods are able to give equivalent low level fusion performance to state of the art methods while providing a unique architecture to combine semantic information from multiple images.


Think you have Solved Direct Answer Question Answering? Try ARC DA, the Direct Answer AI2 Reasoning Challenge. We present the ARC DA dataset, a direct answer ("open response", "freeform") version of the ARC (AI2 Reasoning Challenge) multiple choice dataset. While ARC has been influential in the community, its multiple choice format is unrepresentative of real world questions, and multiple choice formats can be particularly susceptible to artifacts. The ARC DA dataset addresses these concerns by converting questions to direct answer format using a combination of crowdsourcing and expert review. The resulting dataset contains 2985 questions with a total of 8436 valid answers (questions typically have more than one valid answer). ARC DA is one of the first DA datasets of natural questions that often require reasoning, and where appropriate question decompositions are not evident from the questions themselves. We describe the conversion approach taken, appropriate evaluation metrics, and several strong models. Although high, the best scores (81 GENIE, 61.4 F1, 63.2 ROUGE L) still leave considerable room for improvement. In addition, the dataset provides a natural setting for new research on explanation, as many questions require reasoning to construct answers. We hope the dataset spurs further advances in complex question answering by the community. ARC DA is available at https allenai.org data arc da


Effective contraction of skinning maps. Using elementary hyperbolic geometry, we give an explicit formula for the contraction constant of the skinning map over moduli spaces of relatively acylindrical hyperbolic manifolds.


Data Analytics and Machine Learning Methods, Techniques and Tool for Model Driven Engineering of Smart IoT Services. This doctoral dissertation proposes a novel approach to enhance the development of smart services for the Internet of Things (IoT) and smart Cyber Physical Systems (CPS). The proposed approach offers abstraction and automation to the software engineering processes, as well as the Data Analytics (DA) and Machine Learning (ML) practices. This is realized in an integrated and seamless manner. We implement and validate the proposed approach by extending an open source modeling tool, called ThingML. ThingML is a domain specific language and modeling tool with code generation for the IoT CPS domain. Neither ThingML nor any other IoT CPS modeling tool supports DA ML at the modeling level. Therefore, as the primary contribution of the doctoral dissertation, we add the necessary syntax and semantics concerning DA ML methods and techniques to the modeling language of ThingML. Moreover, we support the APIs of several ML libraries and frameworks for the automated generation of the source code of the target software in Python and Java. Our approach enables platform independent, as well as platform specific models. Further, we assist in carrying out semiautomated DA ML tasks by offering Automated ML (AutoML), in the background (in expert mode), and through model checking constraints and hints at design time. Finally, we consider three use case scenarios from the domains of network security, smart energy systems and energy exchange markets.


Maximally distance unbalanced trees. For a graph G , and two distinct vertices u and v of G , let n G(u,v) be the number of vertices of G that are closer in G to u than to v . Miklavi v c and v S parl (arXiv 2011.01635v1) define the distance unbalancedness rm uB (G) of G as the sum of n G(u,v) n G(v,u) over all unordered pairs of distinct vertices u and v of G . For positive integers n up to 15 , they determine the trees T of fixed order n with the smallest and the largest values of rm uB (T) , respectively. While the smallest value is achieved by the star K 1,n 1 for these n , which we then proved for general n (Minimum distance unbalancedness of trees, Journal of Mathematical Chemistry, DOI 10.1007 s10910 021 01228 4), the structure of the trees maximizing the distance unbalancedness remained unclear. For n up to 15 at least, all these trees were subdivided stars. Contributing to problems posed by Miklavi v c and v S parl, we show max Big rm uB (T) T mbox is a tree of order n Big frac n 3 2 o(n 3) and max Big rm uB (S(n 1, ldots,n k)) 1 n 1 cdots n k n Big left( frac 1 2 frac 5 6k frac 1 3k 2 right)n 3 O(kn 2), where S(n 1, ldots,n k) is the subdivided star such that removing its center vertex leaves paths of orders n 1, ldots,n k .


The Phantom Alignment Strength Conjecture Practical use of graph matching alignment strength to indicate a meaningful graph match. The alignment strength of a graph matching is a quantity that gives the practitioner a measure of the correlation of the two graphs, and it can also give the practitioner a sense for whether the graph matching algorithm found the true matching. Unfortunately, when a graph matching algorithm fails to find the truth because of weak signal, there may be "phantom alignment strength" from meaningless matchings that, by random noise, have fewer disagreements than average (sometimes substantially fewer) this alignment strength may give the misleading appearance of significance. A practitioner needs to know what level of alignment strength may be phantom alignment strength and what level indicates that the graph matching algorithm obtained the true matching and is a meaningful measure of the graph correlation. The it Phantom Alignment Strength Conjecture introduced here provides a principled and practical means to approach this issue. We provide empirical evidence for the conjecture, and explore its consequences.


On optimal relay placement in directional networks. In this paper, we study the problem of optimal topology design in wireless networks equipped with highly directional transmission antennas. We use the 1 2 1 network model to characterize the optimal placement of two relays that assist the communication between a source destination pair. We analytically show that under some conditions on the distance between the source destination pair, the optimal topology in terms of maximizing the network throughput is to place the relays as close as possible to the source and the destination.


Two sided Singular Control of an Inventory with Unknown Demand Trend. We study the problem of optimally managing an inventory with unknown demand trend. Our formulation leads to a stochastic control problem under partial observation, in which a Brownian motion with non observable drift can be singularly controlled in both an upward and downward direction. We first derive the equivalent separated problem under full information with state space components given by the Brownian motion and the filtering estimate of its unknown drift, and we then completely solve the latter. Our approach uses the transition amongst three different but equivalent problem formulations, links between two dimensional bounded variation stochastic control problems and games of optimal stopping, and probabilistic methods in combination with refined viscosity theory arguments. We show substantial regularity of (a transformed version of) the value function, we construct an optimal control rule, and we show that the free boundaries delineating (transformed) action and inaction regions are bounded globally Lipschitz continuous functions. To our knowledge this is the first time that such a problem has been solved in the literature.


Quantile Encoder Tackling High Cardinality Categorical Features in Regression Problems. Regression problems have been widely studied in machinelearning literature resulting in a plethora of regression models and performance measures. However, there are few techniques specially dedicated to solve the problem of how to incorporate categorical features to regression problems. Usually, categorical feature encoders are general enough to cover both classification and regression problems. This lack of specificity results in underperforming regression models. In this paper,we provide an in depth analysis of how to tackle high cardinality categor ical features with the quantile. Our proposal outperforms state of the encoders, including the traditional statistical mean target encoder, when considering the Mean Absolute Error, especially in the presence of long tailed or skewed distributions. Besides, to deal with possible overfitting when there are categories with small support, our encoder benefits from additive smoothing. Finally, we describe how to expand the encoded values by creating a set of features with different quantiles. This expanded encoder provides a more informative output about the categorical feature in question, further boosting the performance of the regression model.


Contrastive Learning for Mitochondria Segmentation. Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise, artifacts and other sub cellular structures, mitochondria segmentation is very challenging. In this paper, we propose a novel and effective contrastive learning framework to learn a better feature representation from hard examples to improve segmentation. Specifically, we adopt a point sampling strategy to pick out representative pixels from hard examples in the training phase. Based on these sampled pixels, we introduce a pixel wise label based contrastive loss which consists of a similarity loss term and a consistency loss term. The similarity term can increase the similarity of pixels from the same class and the separability of pixels from different classes in feature space, while the consistency term is able to enhance the sensitivity of the 3D model to changes in image content from frame to frame. We demonstrate the effectiveness of our method on MitoEM dataset as well as FIB SEM dataset and show better or on par with state of the art results.


Sums of squares and Diagonal quadratic form on real bi quadratic fields. Let K mathbb Q ( sqrt m , sqrt n ) be a real bi quadratic field with distinct square free integers m 1 and n 1 , and mathcal O K the set of all totally positive integers in K . We prove that for every integer s 0 there exist K mathbb Q ( sqrt m , sqrt n ) such that all the elements of s mathcal O K can not be written as sum of integral squares. We also prove that there exist an integer s 0 depending on m and n such that for any s geq s 0 every element of s mathcal O K can be written as diagonal quadratic form with coefficients 1 or 1 . Furthermore, we establish a necessary and sufficient criteria under which a totally positive integer in K can be written as a product of two totally positive integers in its quadratic sub fields. We then apply this criteria to find a positive integer s 0 depending on m and n such that for any s 1, s 2 geq s 0 , and for any alpha satisfying the criteria, s 1s 2 alpha can be written as sum of six integer squares.


FedPrune Towards Inclusive Federated Learning. Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in terms of computational and memory resources (system heterogeneity) and (ii) non IID data distribution across clients (statistical heterogeneity). For example, slow clients get dropped in FL schemes, such as Federated Averaging (FedAvg), which not only limits overall learning but also biases results towards fast clients. We propose FedPrune a system that tackles this challenge by pruning the global model for slow clients based on their device characteristics. By doing so, slow clients can train a small model quickly and participate in FL which increases test accuracy as well as fairness. By using insights from Central Limit Theorem, FedPrune incorporates a new aggregation technique that achieves robust performance over non IID data. Experimental evaluation shows that Fed Prune provides robust convergence and better fairness compared to Federated Averaging.


Ranking Structured Objects with Graph Neural Networks. Graph neural networks (GNNs) have been successfully applied in many structured data domains, with applications ranging from molecular property prediction to the analysis of social networks. Motivated by the broad applicability of GNNs, we propose the family of so called RankGNNs, a combination of neural Learning to Rank (LtR) methods and GNNs. RankGNNs are trained with a set of pair wise preferences between graphs, suggesting that one of them is preferred over the other. One practical application of this problem is drug screening, where an expert wants to find the most promising molecules in a large collection of drug candidates. We empirically demonstrate that our proposed pair wise RankGNN approach either significantly outperforms or at least matches the ranking performance of the naive point wise baseline approach, in which the LtR problem is solved via GNN based graph regression.


Performance Comparison between Reconfigurable Intelligent Surface and Relays Theoretical Methods and a Perspective from Operator. Reconfigurable intelligent surface (RIS) is an emerging technique employing metasurface to reflect the signal from the source node to the destination node without consuming any energy. Not only the spectral efficiency but also the energy efficiency can be improved through RIS. Essentially, RIS can be considered as a passive relay between the source and destination node. On the other hand, a relay node in a traditional relay network has to be active, which indicates that it will consume energy when it is relaying the signal or information between the source and destination nodes. In this paper, we compare the performances between RIS and active relay for a general multiple input multiple output (MIMO) system. To make the comparison fair and comprehensive, both the performances of RIS and active relay are optimized with best effort. In terms of the RIS, transmit beamforming and reflecting coefficient at the RIS are jointly optimized so as to maximize the end to end throughput. Although the optimization problem is non convex, it is transformed equivalently to a weighted mean square error (MSE) minimization problem and an alternating optimization problem is proposed, which can ensure the convergence to a stationary point. In terms of active relay, both half duplex relay (HDR) and full duplex relay (FDR) are considered. End to end throughput is maximized via an alternating optimization method. Numerical results are presented to demonstrate the effectiveness of the proposed algorithm. Finally, comparisons between RIS and relays are investigated from the perspective of system model, performance, deployment and controlling method.


Hierarchical Planning for Dynamic Resource Allocation in Smart and Connected Communities. Resource allocation under uncertainty is a classical problem in city scale cyber physical systems. Consider emergency response as an example urban planners and first responders optimize the location of ambulances to minimize expected response times to incidents such as road accidents. Typically, such problems deal with sequential decision making under uncertainty and can be modeled as Markov (or semi Markov) decision processes. The goal of the decision maker is to learn a mapping from states to actions that can maximize expected rewards. While online, offline, and decentralized approaches have been proposed to tackle such problems, scalability remains a challenge for real world use cases. We present a general approach to hierarchical planning that leverages structure in city level CPS problems for resource allocation. We use emergency response as a case study and show how a large resource allocation problem can be split into smaller problems. We then use Monte Carlo planning for solving the smaller problems and managing the interaction between them. Finally, we use data from Nashville, Tennessee, a major metropolitan area in the United States, to validate our approach. Our experiments show that the proposed approach outperforms state of the art approaches used in the field of emergency response.


End to end Adaptive Distributed Training on PaddlePaddle. Distributed training has become a pervasive and effective approach for training a large neural network (NN) model with processing massive data. However, it is very challenging to satisfy requirements from various NN models, diverse computing resources, and their dynamic changes during a training job. In this study, we design our distributed training framework in a systematic end to end view to provide the built in adaptive ability for different scenarios, especially for industrial applications and production environments, by fully considering resource allocation, model partition, task placement, and distributed execution. Based on the unified distributed graph and the unified cluster object, our adaptive framework is equipped with a global cost model and a global planner, which can enable arbitrary parallelism, resource aware placement, multi mode execution, fault tolerant, and elastic distributed training. The experiments demonstrate that our framework can satisfy various requirements from the diversity of applications and the heterogeneity of resources with highly competitive performance. The ERNIE language model with 260 billion parameters is efficiently trained on thousands of AI processors with 91.7 weak scalability. The throughput of the model from the recommender system by employing the heterogeneous pipeline asynchronous execution can be increased up to 2.1 times and 3.3 times that of the GPU only and CPU only training respectively. Moreover, the fault tolerant and elastic distributed training have been successfully applied to the online industrial applications, which give a reduction of 34.49 in the number of failed long term training jobs and an increase of 33.91 for the global scheduling efficiency in the production environment.


Nucleosome sliding can influence the spreading of histone modifications. Nucleosomes are the fundamental building blocks of chromatin that not only help in the folding of chromatin but also in carrying epigenetic information. It is known that nucleosome sliding is responsible for dynamically organizing chromatin structure and the resulting gene regulation. Since sliding can move two neighboring nucleosomes physically close or away, can it play a role in the spreading of histone modifications? We investigate this by simulating a stochastic model that couples nucleosome dynamics with the kinetics of histone modifications. We show that the sliding of nucleosomes can affect the modification pattern as well as the time it takes to modify a given region of chromatin. Exploring different nucleosome densities and modification kinetic parameters, we show that nucleosome sliding can be important for creating histone modification domains. Our model predicts that nucleosome density coupled with sliding dynamics can create an asymmetric histone modification profile around regulatory regions. We also compute the probability distribution of modified nucleosomes and relaxation kinetics of modifications. Our predictions are comparable with known experimental results.


Block Convolution Towards Memory Efficient Inference of Large Scale CNNs on FPGA. Deep convolutional neural networks have achieved remarkable progress in recent years. However, the large volume of intermediate results generated during inference poses a significant challenge to the accelerator design for resource constraint FPGA. Due to the limited on chip storage, partial results of intermediate layers are frequently transferred back and forth between on chip memory and off chip DRAM, leading to a non negligible increase in latency and energy consumption. In this paper, we propose block convolution, a hardware friendly, simple, yet efficient convolution operation that can completely avoid the off chip transfer of intermediate feature maps at run time. The fundamental idea of block convolution is to eliminate the dependency of feature map tiles in the spatial dimension when spatial tiling is used, which is realized by splitting a feature map into independent blocks so that convolution can be performed separately on individual blocks. We conduct extensive experiments to demonstrate the efficacy of the proposed block convolution on both the algorithm side and the hardware side. Specifically, we evaluate block convolution on 1) VGG 16, ResNet 18, ResNet 50, and MobileNet V1 for ImageNet classification task 2) SSD, FPN for COCO object detection task, and 3) VDSR for Set5 single image super resolution task. Experimental results demonstrate that comparable or higher accuracy can be achieved with block convolution. We also showcase two CNN accelerators via algorithm hardware co design based on block convolution on memory limited FPGAs, and evaluation shows that both accelerators substantially outperform the baseline without off chip transfer of intermediate feature maps.


Performance Evaluation of Machine Learning Techniques for DoS Detection in Wireless Sensor Network. The nature of Wireless Sensor Networks (WSN) and the widespread of using WSN introduce many security threats and attacks. An effective Intrusion Detection System (IDS) should be used to detect attacks. Detecting such an attack is challenging, especially the detection of Denial of Service (DoS) attacks. Machine learning classification techniques have been used as an approach for DoS detection. This paper conducted an experiment using Waikato Environment for Knowledge Analysis (WEKA)to evaluate the efficiency of five machine learning algorithms for detecting flooding, grayhole, blackhole, and scheduling at DoS attacks in WSNs. The evaluation is based on a dataset, called WSN DS. The results showed that the random forest classifier outperforms the other classifiers with an accuracy of 99.72 .


Temporal Difference Value Estimation via Uncertainty Guided Soft Updates. Temporal Difference (TD) learning methods, such as Q Learning, have proven effective at learning a policy to perform control tasks. One issue with methods like Q Learning is that the value update introduces bias when predicting the TD target of a unfamiliar state. Estimation noise becomes a bias after the max operator in the policy improvement step, and carries over to value estimations of other states, causing Q Learning to overestimate the Q value. Algorithms like Soft Q Learning (SQL) introduce the notion of a soft greedy policy, which reduces the estimation bias via soft updates in early stages of training. However, the inverse temperature beta that controls the softness of an update is usually set by a hand designed heuristic, which can be inaccurate at capturing the uncertainty in the target estimate. Under the belief that beta is closely related to the (state dependent) model uncertainty, Entropy Regularized Q Learning (EQL) further introduces a principled scheduling of beta by maintaining a collection of the model parameters that characterizes model uncertainty. In this paper, we present Unbiased Soft Q Learning (UQL), which extends the work of EQL from two action, finite state spaces to multi action, infinite state space Markov Decision Processes. We also provide a principled numerical scheduling of beta , extended from SQL and using model uncertainty, during the optimization process. We show the theoretical guarantees and the effectiveness of this update method in experiments on several discrete control environments.


TVDIM Enhancing Image Self Supervised Pretraining via Noisy Text Data. Among ubiquitous multimodal data in the real world, text is the modality generated by human, while image reflects the physical world honestly. In a visual understanding application, machines are expected to understand images like human. Inspired by this, we propose a novel self supervised learning method, named Text enhanced Visual Deep InfoMax (TVDIM), to learn better visual representations by fully utilizing the naturally existing multimodal data. Our core idea of self supervised learning is to maximize the mutual information between features extracted from multiple views of a shared context to a rational degree. Different from previous methods which only consider multiple views from a single modality, our work produces multiple views from different modalities, and jointly optimizes the mutual information for features pairs of intra modality and inter modality. Considering the information gap between inter modality features pairs from data noise, we adopt a emph ranking based contrastive learning to optimize the mutual information. During evaluation, we directly use the pre trained visual representations to complete various image classification tasks. Experimental results show that, TVDIM significantly outperforms previous visual self supervised methods when processing the same set of images.


LightSAL Lightweight Sign Agnostic Learning for Implicit Surface Representation. Recently, several works have addressed modeling of 3D shapes using deep neural networks to learn implicit surface representations. Up to now, the majority of works have concentrated on reconstruction quality, paying little or no attention to model size or training time. This work proposes LightSAL, a novel deep convolutional architecture for learning 3D shapes the proposed work concentrates on efficiency both in network training time and resulting model size. We build on the recent concept of Sign Agnostic Learning for training the proposed network, relying on signed distance fields, with unsigned distance as ground truth. In the experimental section of the paper, we demonstrate that the proposed architecture outperforms previous work in model size and number of required training iterations, while achieving equivalent accuracy. Experiments are based on the D Faust dataset that contains 41k 3D scans of human shapes. The proposed model has been implemented in PyTorch.


On Generalized Carmichael Numbers. Given an integer k , define C k as the set of integers n max(k,0) such that a n k 1 equiv a pmod n holds for all integers a . We establish various multiplicative properties of the elements in C k and give a sufficient condition for the infinitude of C k . Moreover, we prove that there are finitely many elements in C k with one and two prime factors if and only if k 0 and k is prime. In addition, if all but two prime factors of n in C k are fixed, then there are finitely many elements in C k , excluding certain infinite families of n . We also give conjectures about the growth rate of C k with numerical evidence. We explore a similar question when both a and k are fixed and prove that for fixed integers a geq 2 and k , there are infinitely many integers n such that a n k equiv 1 pmod n if and only if (k,a) neq (0,2) by building off the work of Kiss and Phong. Finally, we discuss the multiplicative properties of positive integers n such that Carmichael function lambda(n) divides n k .


A Few More Examples May Be Worth Billions of Parameters. We investigate the dynamics of increasing the number of model parameters versus the number of labeled examples across a wide variety of tasks. Our exploration reveals that while scaling parameters consistently yields performance improvements, the contribution of additional examples highly depends on the task's format. Specifically, in open question answering tasks, enlarging the training set does not improve performance. In contrast, classification, extractive question answering, and multiple choice tasks benefit so much from additional examples that collecting a few hundred examples is often "worth" billions of parameters. We hypothesize that unlike open question answering, which involves recalling specific information, solving strategies for tasks with a more restricted output space transfer across examples, and can therefore be learned with small amounts of labeled data.


Generalized b symbol weights of Linear Codes and b symbol MDS Codes. Generalized pair weights of linear codes are generalizations of minimum symbol pair weights, which were introduced by Liu and Pan cite LP recently. Generalized pair weights can be used to characterize the ability of protecting information in the symbol pair read wire tap channels of type II. In this paper, we introduce the notion of generalized b symbol weights of linear codes over finite fields, which is a generalization of generalized Hamming weights and generalized pair weights. We obtain some basic properties and bounds of generalized b symbol weights which are called Singleton like bounds for generalized b symbol weights. As examples, we calculate generalized weight matrices for simplex codes and Hamming codes. We provide a necessary and sufficient condition for a linear code to be a b symbol MDS code by using the generator matrix and the parity check matrix of this linear code. Finally, a necessary and sufficient condition of a linear isomorphism preserving b symbol weights between two linear codes is obtained. As a corollary, we get the classical MacWilliams extension theorem when b 1 .


Preconditioning Richards Equations spectral analysis and parallel solution at very large scale. We consider here a cell centered finite difference approximation of the Richards equation in three dimensions, averaging for interface values the hydraulic conductivity K K(p) , a highly nonlinear function, by arithmetic, upstream, and harmonic means. The nonlinearities in the equation can lead to changes in soil conductivity over several orders of magnitude and discretizations with respect to space variables often produce stiff systems of differential equations. Fully implicit time discretization is provided by backward Euler one step formula the resulting nonlinear algebraic system is solved by an inexact Newton Armijo Goldstein algorithm, requiring the solution of a sequence of linear systems involving Jacobian matrices. We prove some new results concerning the distribution of the Jacobians eigenvalues and the explicit expression of their entries. Moreover, we explore some connections between the saturation of the soil and the ill conditioning of the Jacobians. The information on eigenvalues justifies the effectiveness of some preconditioner approaches which are widely used in the solution of the Richards equation. We propose a new software framework to experiment with scalable and robust preconditioners suitable for efficient parallel simulations at very large scales. Performance results on a literature test case show that our framework is very promising in the advance towards realistic simulations at extreme scale.


Towards Sustainable Energy Efficient Data Centers in Africa. Developing nations are particularly susceptible to the adverse effects of global warming. By 2040, 14 percent of global emissions will come from data centers. This paper presents early findings in the use AI and digital twins to model and optimize data center operations.


Shortest Beer Path Queries in Outerplanar Graphs. A emph beer graph is an undirected graph G , in which each edge has a positive weight and some vertices have a beer store. A emph beer path between two vertices u and v in G is any path in G between u and v that visits at least one beer store. We show that any outerplanar beer graph G with n vertices can be preprocessed in O(n) time into a data structure of size O(n) , such that for any two query vertices u and v , (i) the weight of the shortest beer path between u and v can be reported in O( alpha(n)) time (where alpha(n) is the inverse Ackermann function), and (ii) the shortest beer path between u and v can be reported in O(L) time, where L is the number of vertices on this path. Both results are optimal, even when G is a beer tree (i.e., a beer graph whose underlying graph is a tree).


"From What I see, this makes sense" Seeing meaning in algorithmic results. In this workshop paper, we use an empirical example from our ongoing fieldwork, to showcase the complexity and situatedness of the process of making sense of algorithmic results i.e. how to evaluate, validate, and contextualize algorithmic outputs. So far, in our research work, we have focused on such sense making processes in data analytic learning environments such as classrooms and training workshops. Multiple moments in our fieldwork suggest that meaning, in data analytics, is constructed through an iterative and reflexive dialogue between data, code, assumptions, prior knowledge, and algorithmic results. A data analytic result is nothing short of a sociotechnical accomplishment one in which it is extremely difficult, if not at times impossible, to clearly distinguish between 'human' and 'technical' forms of data analytic work. We conclude this paper with a set of questions that we would like to explore further in this workshop.


Motivic Milnor Fibres in Families of Real Singularities. In this article we prove two results concerning the motivic Milnor fibres S epsilon (f) associated to a map germ f ( mathbb R n,0) to( mathbb R ,0) , defined by G. Comte and G. Fichou. Firstly, we prove that if f,g ( mathbb R n,0) to( mathbb R ,0) are arc analytically equivalent germs of Nash functions then the virtual Poincar 'e polynomial of the corresponding motivic Milnor fibres are equal. This extends (and provides a new proof) of a result of G. Fichou. Secondly, let T subset mathbb R m be a real algebraic set and f T times( mathbb R n,0) to mathbb R a polynomial function of polynomial map germs such that f(t,0) 0 for any t in T . Then we prove that there exists a locally finite real analytic stratification mathcal S of T such that if S in mathcal S is a stratum then f t sim a f t' are arc analytically equivalent, for any t,t' in S . Furthermore, if T is compact then the stratification mathcal S can be taken to be finite. These two results imply in particular that the virtual Poincar 'e polynomials of the respective zeta functions are equal i.e beta(S epsilon (f t)) beta(S epsilon (f t' )) .


libEnsemble A Library to Coordinate the Concurrent Evaluation of Dynamic Ensembles of Calculations. Almost all applications stop scaling at some point those that don't are seldom performant when considering time to solution on anything but aspirational unicorn resources. Recognizing these tradeoffs as well as greater user functionality in a near term exascale computing era, we present libEnsemble, a library aimed at particular scalability and capability stretching uses. libEnsemble enables running concurrent instances of an application in dynamically allocated ensembles through an extensible Python library. We highlight the structure, execution, and capabilities of the library on leading pre exascale environments as well as advanced capabilities for exascale environments and beyond.


Temporal characterization of electron dynamics in attosecond XUV and infrared laser fields. We use a Wigner distribution like function based on the strong field approximation theory to obtain the time energy distributions and the ionization time distributions of electrons ionized by an XUV pulse alone and in the presence of an infrared (IR) pulse. In the case of a single XUV pulse, although the overall shape of the ionization time distribution resembles the XUV envelope, its detail shows dependence on the emission direction of the electron and the carrier envelope phase of the pulse, which mainly results from the low energy interference structure. It is further found that the electron from the counter rotating term plays an important role in the interference. In the case of the two color pulse, both the time energy distributions and the ionization time distributions change with varying IR field. Our analysis demonstrates that the IR field not only modifies the final electron kinetic energy but also changes the electron's emission time, which results from the change of the electric field induced by the IR pulse. Moreover, the ionization time distributions of the photoelectrons emitted from atoms with higher ionization energy are also given, which show less impact of the IR field on the electron dynamics.


Entropy of induced maps of regular curves homeomorphisms. Let f X to X be a self homeomorphism of a continuum X , we show that the topological entropy of the induced system (2 X,2 f) is infinite provided that X setminus Omega(f) is not empty. If furthermore X is a regular curve then it is shown that (2 X,2 f) has infinite topological entropy if and only if X setminus Omega(f) is not empty. Moreover we prove for the induced system (C(X),C(f)) the equivalence between the following properties (i) zero topological entropy (ii) there is no Li Yorke pair and (iii) for any periodic subcontinnum A of X and any connected component C of X setminus Omega(f) , C subset A if A cap C neq emptyset . In particular, the topological entropy of either (2 X,2 f) or (C(X),C(f)) has only two possible values 0 or infty . At the end, we give an example of a pointwise periodic rational curve homeomorphism F Y to Y with infinite topological entropy induced map C(F) .


Notes on Generalizing the Maximum Entropy Principle to Uncertain Data. The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible while commonly constrained to match empirically estimated feature expectations. We seek to generalize this principle to scenarios where the empirical feature expectations cannot be computed because the model variables are only partially observed, which introduces a dependency on the learned model. Extending and generalizing the principle of latent maximum entropy, we introduce uncertain maximum entropy and describe an expectation maximization based solution to approximately solve these problems. We show that our technique generalizes the principle of maximum entropy and latent maximum entropy and discuss a generally applicable regularization technique for adding error terms to feature expectation constraints in the event of limited data.


On the Dirichlet to Neumann operator for the Connection Laplacian. We study the relationship between the symbol of the Dirichlet to Neumann operator associated with a connection Laplacian, and the geometry on and near the boundary. As a consequence, we show that the geometric data on the boundary, and when the dimension of the base is greater than two all corresponding normal derivatives, are determined by the symbol.


Vertex Fault Tolerant Emulators. A k spanner of a graph G is a sparse subgraph that preserves its shortest path distances up to a multiplicative stretch factor of k , and a k emulator is similar but not required to be a subgraph of G . A classic theorem by Thorup and Zwick JACM '05 shows that, despite the extra flexibility available to emulators, the size stretch tradeoffs for spanners and emulators are equivalent. Our main result is that this equivalence in tradeoffs no longer holds in the commonly studied setting of graphs with vertex failures. That is we introduce a natural definition of vertex fault tolerant emulators, and then we show a three way tradeoff between size, stretch, and fault tolerance for these emulators that polynomially surpasses the tradeoff known to be optimal for spanners. We complement our emulator upper bound with a lower bound construction that is essentially tight (within log n factors of the upper bound) when the stretch is 2k 1 and k is either a fixed odd integer or 2 . We also show constructions of fault tolerant emulators with additive error, demonstrating that these also enjoy significantly improved tradeoffs over those available for fault tolerant additive spanners.


Mixing colourings in 2K 2 free graphs. The reconfiguration graph for the k colourings of a graph G , denoted R k (G) , is the graph whose vertices are the k colourings of G and two colourings are joined by an edge if they differ in colour on exactly one vertex. For any k colourable P 4 free graph G , Bonamy and Bousquet proved that R k 1 (G) is connected. In this short note, we complete the classification of the connectedness of R k 1 (G) for a k colourable graph G excluding a fixed path, by constructing a 7 chromatic 2K 2 free (and hence P 5 free) graph admitting a frozen 8 colouring. This settles a question of the second author.


Maximum principle for stochastic control of SDEs with measurable drifts. In this paper, we consider stochastic optimal control of systems driven by stochastic differential equations with irregular drift coefficient. We establish a necessary and sufficient stochastic maximum principle. To achieve this, we first derive an explicit representation of the first variation process (in Sobolev sense ) of the controlled diffusion. Since the drift coefficient is not smooth, the representation is given in terms of the local time of the state process. Then we construct a sequence of optimal control problems with smooth coefficients by an approximation argument. Finally, we use Ekeland's variational principle to obtain an approximating adjoint process from which we derive the maximum principle by passing to the limit.


PerfSim A Performance Simulator for Cloud Native Microservice Chains. Cloud native computing paradigm allows microservice based applications to take advantage of cloud infrastructure in a scalable, reusable, and interoperable way. However, in a cloud native system, the vast number of configuration parameters and highly granular resource allocation policies can significantly impact the performance and deployment cost. For understanding and analyzing these implications in an easy, quick, and cost effective way, we present PerfSim, a discrete event simulator for approximating and predicting the performance of cloud native service chains in user defined scenarios. To this end, we proposed a systematic approach for modeling the performance of microservices endpoint functions by collecting and analyzing their performance and network traces. With a combination of the extracted models and user defined scenarios, PerfSim can then simulate the performance behavior of all services over a given period and provide an approximation for system KPIs, such as requests' average response time. Using the processing power of a single laptop, we evaluated both simulation accuracy and speed of PerfSim in 104 prevalent scenarios and compared the simulation results with the identical deployment in a real Kubernetes cluster. We achieved 81 99 simulation accuracy in approximating the average response time of incoming requests and 16 1200 times speed up factor for the simulation.


Conifer Seedling Detection in UAV Imagery with RGB Depth Information. Monitoring of reforestation is currently being considerably streamlined through the use of drones and image recognition algorithms, which have already proven to be effective on colour imagery. In addition to colour imagery, elevation data is often also available. The primary aim of this work was to improve the performance of the faster RCNN object detection algorithm by integrating this height information, which showed itself to notably improve performance. Interestingly, the structure of the network played a key role, with direct addition of the height information as a fourth image channel showing no improvement, while integration after the backbone network and before the region proposal network led to marked improvements. This effect persisted with very long training regimes. Increasing the resolution of this height information also showed little effect.


A note on sigma point and nontangential convergence. In this article, we generalize a theorem of Victor L. Shapiro concerning nontangential convergence of the Poisson integral of a L p function. We introduce the notion of sigma points of a locally finite measure and consider a wide class of convolution kernels. We show that convolution integrals of a measure have nontangential limits at sigma points of the measure. We also investigate the relationship between sigma point and the notion of the strong derivative introduced by Ramey and Ullrich. In one dimension, these two notions are the same.


Gradient expansions for the large coupling strength limit of the M o ller Plesset adiabatic connection. The adiabatic connection that has as weak interaction expansion the M o ller Plesset perturbation series has been recently shown to have a large coupling strength expansion in terms of functionals of the Hartree Fock density with a clear physical meaning. In this work we accurately evaluate these density functionals and we extract second order gradient coefficients from the data for neutral atoms, following ideas similar to the ones used in the literature for exchange, with some modifications. These new gradient expansions will be the key ingredient for performing interpolations that have already been shown to reduce dramatically MP2 errors for large non covalent complexes. As a byproduct, our investigation of neutral atoms with large number of electrons N indicates that the second order gradient expansion for exchange grows as N log(N) rather than as N as often reported in the literature.


FacialGAN Style Transfer and Attribute Manipulation on Synthetic Faces. Facial image manipulation is a generation task where the output face is shifted towards an intended target direction in terms of facial attribute and styles. Recent works have achieved great success in various editing techniques such as style transfer and attribute translation. However, current approaches are either focusing on pure style transfer, or on the translation of predefined sets of attributes with restricted interactivity. To address this issue, we propose FacialGAN, a novel framework enabling simultaneous rich style transfers and interactive facial attributes manipulation. While preserving the identity of a source image, we transfer the diverse styles of a target image to the source image. We then incorporate the geometry information of a segmentation mask to provide a fine grained manipulation of facial attributes. Finally, a multi objective learning strategy is introduced to optimize the loss of each specific tasks. Experiments on the CelebA HQ dataset, with CelebAMask HQ as semantic mask labels, show our model's capacity in producing visually compelling results in style transfer, attribute manipulation, diversity and face verification. For reproducibility, we provide an interactive open source tool to perform facial manipulations, and the Pytorch implementation of the model.


Pairwise Margin Maximization for Deep Neural Networks. The weight decay regularization term is widely used during training to constrain expressivity, avoid overfitting, and improve generalization. Historically, this concept was borrowed from the SVM maximum margin principle and extended to multi class deep networks. Carefully inspecting this principle reveals that it is not optimal for multi class classification in general, and in particular when using deep neural networks. In this paper, we explain why this commonly used principle is not optimal and propose a new regularization scheme, called em Pairwise Margin Maximization (PMM), which measures the minimal amount of displacement an instance should take until its predicted classification is switched. In deep neural networks, PMM can be implemented in the vector space before the network's output layer, i.e., in the deep feature space, where we add an additional normalization term to avoid convergence to a trivial solution. We demonstrate empirically a substantial improvement when training a deep neural network with PMM compared to the standard regularization terms.


Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrection. Recent studies on learning with noisy labels have shown remarkable performance by exploiting a small clean dataset. In particular, model agnostic meta learning based label correction methods further improve performance by correcting noisy labels on the fly. However, there is no safeguard on the label miscorrection, resulting in unavoidable performance degradation. Moreover, every training step requires at least three back propagations, significantly slowing down the training speed. To mitigate these issues, we propose a robust and efficient method that learns a label transition matrix on the fly. Employing the transition matrix makes the classifier skeptical about all the corrected samples, which alleviates the miscorrection issue. We also introduce a two head architecture to efficiently estimate the label transition matrix every iteration within a single back propagation, so that the estimated matrix closely follows the shifting noise distribution induced by label correction. Extensive experiments demonstrate that our approach shows the best performance in training efficiency while having comparable or better accuracy than existing methods.


Novel View Synthesis from a Single Image via Unsupervised learning. View synthesis aims to generate novel views from one or more given source views. Although existing methods have achieved promising performance, they usually require paired views of different poses to learn a pixel transformation. This paper proposes an unsupervised network to learn such a pixel transformation from a single source viewpoint. In particular, the network consists of a token transformation module (TTM) that facilities the transformation of the features extracted from a source viewpoint image into an intrinsic representation with respect to a pre defined reference pose and a view generation module (VGM) that synthesizes an arbitrary view from the representation. The learned transformation allows us to synthesize a novel view from any single source viewpoint image of unknown pose. Experiments on the widely used view synthesis datasets have demonstrated that the proposed network is able to produce comparable results to the state of the art methods despite the fact that learning is unsupervised and only a single source viewpoint image is required for generating a novel view. The code will be available soon.


Maxima of a Random Model of the Riemann Zeta Function over Intervals of Varying Length. We consider a model of the Riemann zeta function on the critical axis and study its maximum over intervals of length ( log T) theta , where theta is either fixed or tends to zero at a suitable rate. It is shown that the deterministic level of the maximum interpolates smoothly between the ones of log correlated variables and of i.i.d. random variables, exhibiting a smooth transition 'from frac34 to frac14 ' in the second order. This provides a natural context where extreme value statistics of log correlated variables with time dependent variance and rate occur. A key ingredient of the proof is a precise upper tail tightness estimate for the maximum of the model on intervals of size one, that includes a Gaussian correction. This correction is expected to be present for the Riemann zeta function and pertains to the question of the correct order of the maximum of the zeta function in large intervals.


Toward Diverse Precondition Generation. Language understanding must identify the logical connections between events in a discourse, but core events are often unstated due to their commonsense nature. This paper fills in these missing events by generating precondition events. Precondition generation can be framed as a sequence to sequence problem given a target event, generate a possible precondition. However, in most real world scenarios, an event can have several preconditions, requiring diverse generation a challenge for standard seq2seq approaches. We propose DiP, a Diverse Precondition generation system that can generate unique and diverse preconditions. DiP uses a generative process with three components an event sampler, a candidate generator, and a post processor. The event sampler provides control codes (precondition triggers) which the candidate generator uses to focus its generation. Unlike other conditional generation systems, DiP automatically generates control codes without training on diverse examples. Analysis against baselines reveals that DiP improves the diversity of preconditions significantly while also generating more preconditions.


Continual World A Robotic Benchmark For Continual Reinforcement Learning. Continual learning (CL) the ability to continuously learn, building on previously acquired knowledge is a natural requirement for long lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to balance opposing desiderata, such as constraints on capacity and compute, the ability to not catastrophically forget, and to exhibit positive transfer on new tasks. Understanding the right trade off is conceptually and computationally challenging, which we argue has led the community to overly focus on catastrophic forgetting. In response to these issues, we advocate for the need to prioritize forward transfer and propose Continual World, a benchmark consisting of realistic and meaningfully diverse robotic tasks built on top of Meta World as a testbed. Following an in depth empirical evaluation of existing CL methods, we pinpoint their limitations and highlight unique algorithmic challenges in the RL setting. Our benchmark aims to provide a meaningful and computationally inexpensive challenge for the community and thus help better understand the performance of existing and future solutions. Information about the benchmark, including the open source code, is available at https sites.google.com view continualworld.


Attention based model for predicting question relatedness on Stack Overflow. Stack Overflow is one of the most popular Programming Community based Question Answering (PCQA) websites that has attracted more and more users in recent years. When users raise or inquire questions in Stack Overflow, providing related questions can help them solve problems. Although there are many approaches based on deep learning that can automatically predict the relatedness between questions, those approaches are limited since interaction information between two questions may be lost. In this paper, we adopt the deep learning technique, propose an Attention based Sentence pair Interaction Model (ASIM) to predict the relatedness between questions on Stack Overflow automatically. We adopt the attention mechanism to capture the semantic interaction information between the questions. Besides, we have pre trained and released word embeddings specific to the software engineering domain for this task, which may also help other related tasks. The experiment results demonstrate that ASIM has made significant improvement over the baseline approaches in Precision, Recall, and Micro F1 evaluation metrics, achieving state of the art performance in this task. Our model also performs well in the duplicate question detection task of AskUbuntu, which is a similar but different task, proving its generalization and robustness.


Self consistent simulation of resistive kink instabilities with runaway electrons. A new fluid model for runaway electron simulation based on fluid description is introduced and implemented in the magnetohydrodynamics code M3D C1, which includes self consistent interactions between plasma and runaway electrons. The model utilizes the method of characteristics to solve the continuity equation for the runaway electron density with large convection speed, and uses a modified Boris algorithm for pseudo particle pushing. The model was employed to simulate magnetohydrodynamics instabilities happening in a runaway electron final loss event in the DIII D tokamak. Nonlinear simulation reveals that a large fraction of runaway electrons get lost to the wall when kink instabilities are excited and form stochastic field lines in the outer region of the plasma. Plasma current converts from runaway electron current to Ohmic current, and get pinched at the magnetic axis. Given the good agreement with experiment, the simulation model provides a reliable tool to study macroscopic plasma instabilities in existence of runaway electron current, and can be used to support future studies of runaway electron mitigation strategies in ITER.


On the Tutte and matching polynomials for complete graphs. Let T(G X,Y) be the Tutte polynomial for graphs. We study the sequence t a,b (n) T(K n a,b) where a,b are integers, and show that for every mu in N the sequence t a,b (n) is ultimately periodic modulo mu provided a neq 1 mod mu and b neq 1 mod mu . This result is related to a conjecture by A. Mani and R. Stones from 2016. The theorem is a consequence of a more general theorem which holds for a wide class of graph polynomials definable in Monadic Second Order Logic. This gives also similar results for the various substitution instances of the bivariate matching polynomial and the trivariate edge elimination polynomial xi(G X,Y,Z) introduced by I. Averbouch, B. Godlin and the second author in 2008. the independence polynomial, the clique polynomial, etc. All our results depend on the Specker Blatter Theorem from 1981, which studies modular recurrence relations of combinatorial sequences which count the number of labeled graphs.


Automating Cryptographic Protocol Language Generation from Structured Specifications. Security of cryptographic protocols can be analysed by creating a model in a formal language and verifying the model in a tool. All such tools focus on the last part of the analysis, verification, and the interpretation of the specification is only explained in papers. Rather, we focus on the interpretation and modelling part by presenting a tool to aid the cryptographer throughout the process and automatically generating code in a target language. We adopt a data centric approach where the protocol design is stored in a structured way rather than as textual specifications. Previous work shows how this approach facilitates the interpretation to a single language (for Tamarin) which required aftermath modifications. By improving the expressiveness of the specification data structure we extend the tool to export to an additional formal language, ProVerif, as well as a C fully running implementation. Furthermore, we extend the plugins to verify correctness in ProVerif and executability lemmas in Tamarin. In this paper we model the Diffie Hellman key exchange, which is traditionally used as a case study a demo is also provided for other commonly studied protocols, Needham Schroeder and Needham Schroeder Lowe.


Surface Form Competition Why the Highest Probability Answer Isn't Always Right. Large language models have shown promising results in zero shot settings (Brown et al.,2020 Radford et al., 2019). For example, they can perform multiple choice tasks simply by conditioning on a question and selecting the answer with the highest probability. However, ranking by string probability can be problematic due to surface form competition wherein different surface forms compete for probability mass, even if they represent the same underlying concept, e.g. "computer" and "PC." Since probability mass is finite, this lowers the probability of the correct answer, due to competition from other strings that are valid answers (but not one of the multiple choice options). We introduce Domain Conditional Pointwise Mutual Information, an alternative scoring function that directly compensates for surface form competition by simply reweighing each option according to a term that is proportional to its a priori likelihood within the context of the specific zero shot task. It achieves consistent gains in zero shot performance over both calibrated (Zhao et al., 2021) and uncalibrated scoring functions on all GPT 2 and GPT 3 models over a variety of multiple choice datasets.


Computing with Infinite Objects the Gray Code Case. Infinite Gray code has been introduced by Tsuiki cite ts as a redundancy free representation of the reals. In applications the signed digit representation is mostly used which has maximal redundancy. Tsuiki presented a functional program converting signed digit code into infinite Gray code. Moreover, he showed that infinite Gray code can effectively be converted into signed digit code, but the program needs to have some non deterministic features (see also cite tsug ). Berger and Tsuiki cite btifp,bt reproved the result in a system of formal first order intuitionistic logic extended by inductive and co inductive definitions, as well as some new logical connectives capturing concurrent behaviour. The programs extracted from the proofs are exactly the ones given by Tsuiki. In order to do so, co inductive predicates bS and bG are defined and the inclusion bS subseteq bG is derived. For the converse inclusion the new logical connectives are used to introduce a concurrent version S 2 of S and bG subseteq bS 2 is shown. What one is looking for, however, is an equivalence proof of the involved concepts. One of the main aims of the present paper is to close the gap. A concurrent version bG of bG and a modification bS of bS 2 are presented such that bS bG . A crucial tool in cite btifp is a formulation of the Archimedean property of the real numbers as an induction principle. We introduce a concurrent version of this principle which allows us to prove that bS and bG coincide. A further central contribution is the extension of the above results to the hyperspace of non empty compact subsets of the reals.