On common index divisors and monogenity of certain number fields defined by x 5 ax 2 b . Let K Q( alpha) be a number field generated by a complex root alpha of a monic irreducible trinomial F(x) x 5 ax 2 b in Z x . In this paper, for every prime integer p , we give necessary and sufficient conditions on a and b so that p is a common index divisor of K . In particular, when these conditions hold, then K is not monogenic.


From Prescriptive to Predictive an Interdisciplinary Perspective on the Future of Computational Chemistry. Reliable predictions of the behaviour of chemical systems are essential across many industries, from nanoscale engineering over validation of advanced materials to nanotoxicity assessment in health and medicine. For the future we therefore envision a paradigm shift for the design of chemical simulations across all length scales from a prescriptive to a predictive and quantitative science. This paper presents an integrative perspective about the state of the art of modelling in computational and theoretical chemistry with examples from data and equation based models. Extension to include reliable risk assessments and quality control are discussed. To specify and broaden the concept of chemical accuracy in the design cycle of reliable and robust molecular simulations the fields of computational chemistry, physics, mathematics, visualisation science, and engineering are bridged. Methods from electronic structure calculations serve as examples to explain how uncertainties arise through assumed mechanisms in form of equations, model parameters, algorithms, and numerical implementations. We provide a full classification of uncertainties throughout the chemical modelling cycle and discuss how the associated risks can be mitigated. Further, we apply our statements to molecular dynamics and partial differential equations based approaches. An overview of methods from numerical mathematics and statistics provides strategies to analyse risks and potential errors in the design of new materials and compounds. We also touch on methods for validation and verification. In the conclusion we address cross disciplinary open challenges. In future the quantitative analysis of where simulations and their prognosis fail will open doors towards predictive materials engineering and chemical modelling.


VT ADL A Vision Transformer Network for Image Anomaly Detection and Localization. We present a transformer based image anomaly detection and localization network. Our proposed model is a combination of a reconstruction based approach and patch embedding. The use of transformer networks helps to preserve the spatial information of the embedded patches, which are later processed by a Gaussian mixture density network to localize the anomalous areas. In addition, we also publish BTAD, a real world industrial anomaly dataset. Our results are compared with other state of the art algorithms using publicly available datasets like MNIST and MVTec.


Designing AI based Conversational Agent for Diabetes Care in a Multilingual Context. Conversational agents (CAs) represent an emerging research field in health information systems, where there are great potentials in empowering patients with timely information and natural language interfaces. Nevertheless, there have been limited attempts in establishing prescriptive knowledge on designing CAs in the healthcare domain in general, and diabetes care specifically. In this paper, we conducted a Design Science Research project and proposed three design principles for designing health related CAs that embark on artificial intelligence (AI) to address the limitations of existing solutions. Further, we instantiated the proposed design and developed AMANDA an AI based multilingual CA in diabetes care with state of the art technologies for natural sounding localised accent. We employed mean opinion scores and system usability scale to evaluate AMANDA's speech quality and usability, respectively. This paper provides practitioners with a blueprint for designing CAs in diabetes care with concrete design guidelines that can be extended into other healthcare domains.


Fusformer A Transformer based Fusion Approach for Hyperspectral Image Super resolution. Hyperspectral image has become increasingly crucial due to its abundant spectral information. However, It has poor spatial resolution with the limitation of the current imaging mechanism. Nowadays, many convolutional neural networks have been proposed for the hyperspectral image super resolution problem. However, convolutional neural network (CNN) based methods only consider the local information instead of the global one with the limited kernel size of receptive field in the convolution operation. In this paper, we design a network based on the transformer for fusing the low resolution hyperspectral images and high resolution multispectral images to obtain the high resolution hyperspectral images. Thanks to the representing ability of the transformer, our approach is able to explore the intrinsic relationships of features globally. Furthermore, considering the LR HSIs hold the main spectral structure, the network focuses on the spatial detail estimation releasing from the burden of reconstructing the whole data. It reduces the mapping space of the proposed network, which enhances the final performance. Various experiments and quality indexes show our approach's superiority compared with other state of the art methods.


On Psychometric Instruments in Software Engineering Research An Ongoing Study. Context Although software development is an inherently human activity, research in software engineering (SE) has long focused mostly on processes and tools, failing to recall about the human factors behind. Even when explored, researchers typically do not properly use psychology background to better understand human factors in SE, such as the psychometric instruments, which aim to measure human factors. Objective Our goal is to provide a critical review on the use of psychometric instruments in SE research regarding personality. Method We present a two step study. First, a systematic mapping of the literature in order to generate a catalog of the psychometric instruments used second, a preliminary survey to be conducted with social sciences researchers to assess their adoption in SE research. Results and Conclusion The results so far are quite initial. The next steps direct us to finish the data extraction to finalize the catalog (systematic mapping) and to refine the survey design and apply it with social sciences researchers.


Learning Explicit User Interest Boundary for Recommendation. The core objective of modelling recommender systems from implicit feedback is to maximize the positive sample score s p and minimize the negative sample score s n , which can usually be summarized into two paradigms the pointwise and the pairwise. The pointwise approaches fit each sample with its label individually, which is flexible in weighting and sampling on instance level but ignores the inherent ranking property. By qualitatively minimizing the relative score s n s p , the pairwise approaches capture the ranking of samples naturally but suffer from training efficiency. Additionally, both approaches are hard to explicitly provide a personalized decision boundary to determine if users are interested in items unseen. To address those issues, we innovatively introduce an auxiliary score b u for each user to represent the User Interest Boundary(UIB) and individually penalize samples that cross the boundary with pairwise paradigms, i.e., the positive samples whose score is lower than b u and the negative samples whose score is higher than b u . In this way, our approach successfully achieves a hybrid loss of the pointwise and the pairwise to combine the advantages of both. Analytically, we show that our approach can provide a personalized decision boundary and significantly improve the training efficiency without any special sampling strategy. Extensive results show that our approach achieves significant improvements on not only the classical pointwise or pairwise models but also state of the art models with complex loss function and complicated feature encoding.


How Much Data Analytics is Enough? The ROI of Machine Learning Classification and its Application to Requirements Dependency Classification. Machine Learning (ML) can substantially improve the efficiency and effectiveness of organizations and is widely used for different purposes within Software Engineering. However, the selection and implementation of ML techniques rely almost exclusively on accuracy criteria. Thus, for organizations wishing to realize the benefits of ML investments, this narrow approach ignores crucial considerations around the anticipated costs of the ML activities across the ML lifecycle, while failing to account for the benefits that are likely to accrue from the proposed activity. We present findings for an approach that addresses this gap by enhancing the accuracy criterion with return on investment (ROI) considerations. Specifically, we analyze the performance of the two state of the art ML techniques Random Forest and Bidirectional Encoder Representations from Transformers (BERT), based on accuracy and ROI for two publicly available data sets. Specifically, we compare decision making on requirements dependency extraction (i) exclusively based on accuracy and (ii) extended to include ROI analysis. As a result, we propose recommendations for selecting ML classification techniques based on the degree of training data used. Our findings indicate that considering ROI as additional criteria can drastically influence ML selection when compared to decisions based on accuracy as the sole criterion


Compactness within the space of complete, constant Q curvature metrics on the sphere with isolated singularities. In this paper we consider the moduli space of complete, conformally flat metrics on a sphere with k punctures having constant positive Q curvature and positive scalar curvature. Previous work has shown that such metrics admit an asymptotic expansion near each puncture, allowing one to define an asymptotic necksize of each singular point. We prove that any set in the moduli space such that the distances between distinct punctures and the asymptotic necksizes all remain bounded away from zero is sequentially compact, mirroring a theorem of D. Pollack about singular Yamabe metrics. Along the way we define a radial Pohozaev invariant at each puncture and refine some a priori bounds of the conformal factor, which may be of independent interest.


Center Manifolds for Rough Partial Differential Equations. We prove a center manifold theorem for rough partial differential equations (rough PDEs). The class of rough PDEs we consider contains as a key subclass reaction diffusion equations driven by nonlinear multiplicative noise, where the stochastic forcing is given by a gamma H "older rough path, for gamma in(1 3,1 2 . Our proof technique relies upon the theory of rough paths and analytic semigroups in combination with a discretized Lyapunov Perron type method in a suitable scale of interpolation spaces. The resulting center manifold is a random manifold in the sense of the theory of random dynamical systems (RDS). We also illustrate our main theorem for reaction diffusion equations as well as for the Swift Hohenberg equation.


Elliptic problems with rough boundary data in Nikolskii spaces. We investigate a general elliptic problem given in a bounded Euclidean domain with boundary data in Nikolskii spaces of low, specifically, negative order. The right hand side of the elliptic differential equation is supposed to be an integrable function. We establish the Fredholm property of the problem, the maximal regularity and a priori estimate of its generalized solutions in the spaces indicated. We give an application of these results to some elliptic problems with boundary conditions induced by a Gaussian white noise.


Computing Graph Descriptors on Edge Streams. Graph feature extraction is a fundamental task in graphs analytics. Using feature vectors (graph descriptors) in tandem with data mining algorithms that operate on Euclidean data, one can solve problems such as classification, clustering, and anomaly detection on graph structured data. This idea has proved fruitful in the past, with spectral based graph descriptors providing state of the art classification accuracy on benchmark datasets. However, these algorithms do not scale to large graphs since 1) they require storing the entire graph in memory, and 2) the end user has no control over the algorithm's runtime. In this paper, we present single pass streaming algorithms to approximate structural features of graphs (counts of subgraphs of order k geq 4 ). Operating on edge streams allows us to avoid keeping the entire graph in memory, and controlling the sample size enables us to control the time taken by the algorithm. We demonstrate the efficacy of our descriptors by analyzing the approximation error, classification accuracy, and scalability to massive graphs. Our experiments showcase the effect of the sample size on approximation error and predictive accuracy. The proposed descriptors are applicable on graphs with millions of edges within minutes and outperform the state of the art descriptors in classification accuracy.


Open and Programmable 5G Network in a Box Technology Demonstration and Evaluation Results. The fifth generation (5G) mobile cellular technology is a game changer for industrial systems. Private 5G deployments are promising to address the challenges faced by industrial networks. Programmability and open source are two key aspects which bring unprecedented flexibility and customizability to private 5G networks. Recent regulatory initiatives are removing barriers for industrial stakeholders to deploy their own local 5G networks with dedicated equipment. To this end, this demonstration showcases an open and programmable 5G network in a box solution for private deployments. The network in a box provides an integrated solution, based on open source software stack and general purpose hardware, for operation in 5G non standalone (NSA) as well as 4G long term evolution (LTE) modes. The demonstration also shows the capability of operation in different sub 6 GHz frequency bands, some of which are specifically available for private networks. Performance results, in terms of end to end latency and data rates, with a commercial off the shelf (COTS) 5G device are shown as well.


Application of Failure Modes and Effects Analysis in the Engineering Design Process. Failure modes and effects analysis (FMEA) is one of the most practical design tools implemented in the product design to analyze the possible failures and to improve the design. The use of FMEA is diversified, and different approaches are proposed by various organizations and researchers from one application to another. The question is how to use the features of FMEA along with the design process. This research focuses on different types of FMEA in the design process, which is considered as the mapping between customer requirements, design components, and product functions. These three elements of design are the foundation of the integration model proposed in this research. The objective of this research is to understand an integrated approach of FMEA in the design process. Significantly, an integration framework is developed to integrate the design process and FMEA. Then, a step by step FMEA facilitated design process is proposed to apply FMEA along with the design process.


A Fine Grained Dataset and its Efficient Semantic Segmentation for Unstructured Driving Scenarios. Research in autonomous driving for unstructured environments suffers from a lack of semantically labeled datasets compared to its urban counterpart. Urban and unstructured outdoor environments are challenging due to the varying lighting and weather conditions during a day and across seasons. In this paper, we introduce TAS500, a novel semantic segmentation dataset for autonomous driving in unstructured environments. TAS500 offers fine grained vegetation and terrain classes to learn drivable surfaces and natural obstacles in outdoor scenes effectively. We evaluate the performance of modern semantic segmentation models with an additional focus on their efficiency. Our experiments demonstrate the advantages of fine grained semantic classes to improve the overall prediction accuracy, especially along the class boundaries. The dataset and pretrained model are available at mucar3.de icpr2020 tas500.


High Dimensional Gaussian Process Inference with Derivatives. Although it is widely known that Gaussian processes can be conditioned on observations of the gradient, this functionality is of limited use due to the prohibitive computational cost of mathcal O (N 3 D 3) in data points N and dimension D . The dilemma of gradient observations is that a single one of them comes at the same cost as D independent function evaluations, so the latter are often preferred. Careful scrutiny reveals, however, that derivative observations give rise to highly structured kernel Gram matrices for very general classes of kernels (inter alia, stationary kernels). We show that in the low data regime N D , the Gram matrix can be decomposed in a manner that reduces the cost of inference to mathcal O (N 2D (N 2) 3) (i.e., linear in the number of dimensions) and, in special cases, to mathcal O (N 2D N 3) . This reduction in complexity opens up new use cases for inference with gradients especially in the high dimensional regime, where the information to cost ratio of gradient observations significantly increases. We demonstrate this potential in a variety of tasks relevant for machine learning, such as optimization and Hamiltonian Monte Carlo with predictive gradients.


Billion Scale Pretraining with Vision Transformers for Multi Task Visual Representations. Large scale pretraining of visual representations has led to state of the art performance on a range of benchmark computer vision tasks, yet the benefits of these techniques at extreme scale in complex production systems has been relatively unexplored. We consider the case of a popular visual discovery product, where these representations are trained with multi task learning, from use case specific visual understanding (e.g. skin tone classification) to general representation learning for all visual content (e.g. embeddings for retrieval). In this work, we describe how we (1) generate a dataset with over a billion images via large weakly supervised pretraining to improve the performance of these visual representations, and (2) leverage Transformers to replace the traditional convolutional backbone, with insights into both system and performance improvements, especially at 1B image scale. To support this backbone model, we detail a systematic approach to deriving weakly supervised image annotations from heterogenous text signals, demonstrating the benefits of clustering techniques to handle the long tail distribution of image labels. Through a comprehensive study of offline and online evaluation, we show that large scale Transformer based pretraining provides significant benefits to industry computer vision applications. The model is deployed in a production visual shopping system, with 36 improvement in top 1 relevance and 23 improvement in click through volume. We conduct extensive experiments to better understand the empirical relationships between Transformer based architectures, dataset scale, and the performance of production vision systems.


Gumbel convergence of the maximum of convoluted half normally distributed random variables. In this note, we establish the convergence in distribution of the maxima of i.i.d. random variables to the Gumbel distribution with the associated normalizing sequences for several examples that are related to the normal distribution. Motivated by tests for jumps in high frequency data, our main interest is in the half normal distribution and the sum or difference of two independent half normally distributed random variables. Since the half normal distribution is neither stable nor symmetric, these examples are non obvious generalizations. It is shown that the sum and difference of two independent half normally distributed random variables and other examples yield distributions with tail behaviours that relate to the normal case. It turns out that the Gumbel convergence for all such distributions can be proved following similar steps. We illustrate the results in Monte Carlo simulations.


Nanoparticle Radiosensitization from extended local effect modeling to a survival modificationframework of compound Poisson additive killing and its carbon dots validation. Objective To construct an analytical model instead of local effect modeling for the prediction of the biological effectiveness of nanoparticle radiosensitization. Approach An extended local effects model is first proposed with a more comprehensive description of the nanoparticles mediated local killing enhancements, but meanwhile puts forward challenging issues that remain difficult and need to be further studied. As a novel method instead of local effect modeling, a survival modification framework of compound Poisson additive killing is proposed, as the consequence of an independent additive killing by the assumed equivalent uniform doses of individual nanoparticles per cell under the LQ model. A compound Poisson killing (CPK)model based on the framework is thus derived, giving a general expression of nanoparticle mediated LQ parameter modification. For practical use, a simplified form of the model is also derived, as a concentration dependent correction only to the alpha parameter, with the relative correction (alpha" alpha)) dominated by the mean number, and affected by the agglomeration of nanoparticles per cell. For different agglomeration state, a monodispersion model of the dispersity factor eta 1, and an agglomeration model of 2 3 eta 1,are provided for practical prediction of (alpha" alpha) value respectively. Main results Initial validation by the radiosensitization ofHepG2 cells by carbon dots showed a high accuracy of the CPK model. In a safe range of concentration (0.003 0.03 mu g mu L)of the carbon dots, the prediction errors of the monodispersion and agglomeration models were both within 2 , relative to the clonogenic survival data of the sensitized HepG2 cells.


Evaluating Team Skill Aggregation in Online Competitive Games. One of the main goals of online competitive games is increasing player engagement by ensuring fair matches. These games use rating systems for creating balanced match ups. Rating systems leverage statistical estimation to rate players' skills and use skill ratings to predict rank before matching players. Skill ratings of individual players can be aggregated to compute the skill level of a team. While research often aims to improve the accuracy of skill estimation and fairness of match ups, less attention has been given to how the skill level of a team is calculated from the skill level of its members. In this paper, we propose two new aggregation methods and compare them with a standard approach extensively used in the research literature. We present an exhaustive analysis of the impact of these methods on the predictive performance of rating systems. We perform our experiments using three popular rating systems, Elo, Glicko, and TrueSkill, on three real world datasets including over 100,000 battle royale and head to head matches. Our evaluations show the superiority of the MAX method over the other two methods in the majority of the tested cases, implying that the overall performance of a team is best determined by the performance of its most skilled member. The results of this study highlight the necessity of devising more elaborated methods for calculating a team's performance methods covering different aspects of players' behavior such as skills, strategy, or goals.


Meta model application for consistency management of models for avionic systems design. This paper presents the application of a meta model and single underlying model on an applied avionics system design use case. System models, safety assurance cases and safety requirements are maintained in a central repository. This enables to link these data which are originally developed in unrelated tools. By having such a central repository, traceability can be established, and consistency can be ensured, which leads to less errors and a shorter development time. A meta model was constructed which matches the central repository to enable bidirectional synchronization with an external authoring tool.


Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection. The rise of language models such as BERT allows for high quality text paraphrasing. This is a problem to academic integrity, as it is difficult to differentiate between original and machine generated content. We propose a benchmark consisting of paraphrased articles using recent language models relying on the Transformer architecture. Our contribution fosters future research of paraphrase detection systems as it offers a large collection of aligned original and paraphrased documents, a study regarding its structure, classification experiments with state of the art systems, and we make our findings publicly available.


Integer complexity, stability, and self similarity. Define n to be the complexity of n , the smallest number of ones needed to write n using an arbitrary combination of addition and multiplication. The set mathscr D of defects, differences delta(n) n 3 log 3 n , is known to be a well ordered subset of 0, infty) , with order type omega omega . This is proved by showing that, for any r , there is a finite set mathcal S s of certain multilinear polynomials, called low defect polynomials, such that delta(n) le s if and only if one can write n f(3 k 1 , ldots,3 k r )3 k r 1 . In this paper we show that, in addition to it being true that mathscr D (and thus overline mathscr D ) has order type omega omega , it satisifies a sort of self similarity property with overline mathscr D ' overline mathscr D 1 . This is proven by restricting attention to substantial low defect polynomials, ones that can be themselves written efficiently in a certain sense, and showing that in a certain sense the values of these polynomials at powers of 3 have complexity equal to the na "ive upper bound most of the time. As a result, we also prove that, under appropriate conditions on a and b , numbers of the form b(a3 k 1)3 ell will, for all sufficiently large k , have complexity equal to the na "ive upper bound. These results resolve various earlier conjectures of the second author.


Aerial Ground Interference Mitigation for Cellular Connected UAV. To support large scale deployment of unmanned aerial vehicles (UAVs) in future, a new wireless communication paradigm, namely, cellular connected UAV, has recently received an upsurge of interests in both academia and industry. Specifically, cellular base stations (BSs) and spectrum are reused to serve UAVs as new aerial user equipments (UEs) for meeting their communication requirements. However, compared to traditional terrestrial UEs, the high altitude of UAVs results in more frequent line of sight (LoS) channels with both their associated and non associated BSs in a much wider area, which causes stronger aerial ground interference to both UAVs and terrestrial UEs. As such, conventional techniques designed for mitigating the terrestrial interference become ineffective in coping with the new and more severe UAV terrestrial interference. To tackle this challenge, we propose in this article new interference mitigation solutions for achieving spectral efficient operation of the cellular network with co existing UAVs and terrestrial UEs. In particular, we exploit the powerful sensing capability of UAVs and inactive BSs in the network for interference mitigation cancellation. Numerical results are presented to verify the efficacy of the proposed solutions and show their significant spectrum efficiency gains over terrestrial interference mitigation techniques.


Adaptive Multi Resolution Attention with Linear Complexity. Transformers have improved the state of the art across numerous tasks in sequence modeling. Besides the quadratic computational and memory complexity w.r.t the sequence length, the self attention mechanism only processes information at the same scale, i.e., all attention heads are in the same resolution, resulting in the limited power of the Transformer. To remedy this, we propose a novel and efficient structure named Adaptive Multi Resolution Attention (AdaMRA for short), which scales linearly to sequence length in terms of time and space. Specifically, we leverage a multi resolution multi head attention mechanism, enabling attention heads to capture long range contextual information in a coarse to fine fashion. Moreover, to capture the potential relations between query representation and clues of different attention granularities, we leave the decision of which resolution of attention to use to query, which further improves the model's capacity compared to vanilla Transformer. In an effort to reduce complexity, we adopt kernel attention without degrading the performance. Extensive experiments on several benchmarks demonstrate the effectiveness and efficiency of our model by achieving a state of the art performance efficiency memory trade off. To facilitate AdaMRA utilization by the scientific community, the code implementation will be made publicly available.


Unsupervised Identification of Relevant Prior Cases. Document retrieval has taken its role in almost all domains of knowledge understanding, including the legal domain. Precedent refers to a court decision that is considered as authority for deciding subsequent cases involving identical or similar facts or similar legal issues. In this work, we propose different unsupervised approaches to solve the task of identifying relevant precedents to a given query case. Our proposed approaches are using word embeddings like word2vec, doc2vec, and sent2vec, finding cosine similarity using TF IDF, retrieving relevant documents using BM25 scores, using the pre trained model and SBERT to find the most similar document, and using the product of BM25 and TF IDF scores to find the most relevant document for a given query. We compared all the methods based on precision 10, recall 10, and MRR. Based on the comparative analysis, we found that the TF IDF score multiplied by the BM25 score gives the best result. In this paper, we have also presented the analysis that we did to improve the BM25 score.


Asymptotic stability for a class of viscoelastic equations with general relaxation functions and the time delay. The goal of the present paper is to study the viscoelastic wave equation with the time delay u t rho u tt Delta u Delta u tt int 0 tg(t s) Delta u(s)ds mu 1u t(x,t) mu 2 u t(x,t tau) b u p 2 u under initial boundary value conditions, where rho, b, mu 1 are positive constants, mu 2 is a real number, tau 0 represents the time delay. By using the multiplier method together with some properties of the convex functions, the explicit and general stability results of energy are proved under the general assumption on the relaxation function g . This work generalizes and improves earlier results on the stability of the viscoelastic equations with the time delay in the literature.


Landmark Regularization Ranking Guided Super Net Training in Neural Architecture Search. Weight sharing has become a de facto standard in neural architecture search because it enables the search to be done on commodity hardware. However, recent works have empirically shown a ranking disorder between the performance of stand alone architectures and that of the corresponding shared weight networks. This violates the main assumption of weight sharing NAS algorithms, thus limiting their effectiveness. We tackle this issue by proposing a regularization term that aims to maximize the correlation between the performance rankings of the shared weight network and that of the standalone architectures using a small set of landmark architectures. We incorporate our regularization term into three different NAS algorithms and show that it consistently improves performance across algorithms, search spaces, and tasks.


GOLD Improving Out of Scope Detection in Dialogues using Data Augmentation. Practical dialogue systems require robust methods of detecting out of scope (OOS) utterances to avoid conversational breakdowns and related failure modes. Directly training a model with labeled OOS examples yields reasonable performance, but obtaining such data is a resource intensive process. To tackle this limited data problem, previous methods focus on better modeling the distribution of in scope (INS) examples. We introduce GOLD as an orthogonal technique that augments existing data to train better OOS detectors operating in low data regimes. GOLD generates pseudo labeled candidates using samples from an auxiliary dataset and keeps only the most beneficial candidates for training through a novel filtering mechanism. In experiments across three target benchmarks, the top GOLD model outperforms all existing methods on all key metrics, achieving relative gains of 52.4 , 48.9 and 50.3 against median baseline performance. We also analyze the unique properties of OOS data to identify key factors for optimally applying our proposed method.


Mixed Finite Differences Scheme for Gradient Approximation. In this paper we focus on the linear functionals defining an approximate version of the gradient of a function. These functionals are often used when dealing with optimization problems where the computation of the gradient of the objective function is costly or the objective function values are affected by some noise. These functionals have been considered to estimate the gradient of the objective function by the expected value of the function variations in the space of directions. The expected value is then approximated by a sample average over a proper (random) choice of sample directions in the domain of integration. In this way the approximation error is characterized by statistical properties of the sample average estimate, typically its variance. This work instead is aimed at deriving a new approximation scheme, where linear functionals are no longer considered as expected values over the space of directions, but rather as the filtered derivative of the objective function by a gaussian kernel. By using this new approach, a gradient estimation based on a suitable linear combination of central finite differences at different step sizes is proposed, allowing to characterize the error of approximation in a deterministic way. Numerical experiments on a set of test functions are encouraging, showing good performances compared to those of the methods commonly used in the literature, both in the noisy and in the non noisy setting.


An Extended Jump Functions Benchmark for the Analysis of Randomized Search Heuristics. Jump functions are the most studied non unimodal benchmark in the theory of randomized search heuristics, in particular, evolutionary algorithms (EAs). They have significantly improved our understanding of how EAs escape from local optima. However, their particular structure to leave the local optimum one can only jump directly to the global optimum raises the question of how representative such results are. For this reason, we propose an extended class textsc Jump k, delta of jump functions that contain a valley of low fitness of width delta starting at distance k from the global optimum. We prove that several previous results extend to this more general class for all k le frac n 1 3 ln n and delta k , the optimal mutation rate for the (1 1) EA is frac delta n , and the fast (1 1) EA runs faster than the classical (1 1) EA by a factor super exponential in delta . However, we also observe that some known results do not generalize the randomized local search algorithm with stagnation detection, which is faster than the fast (1 1) EA by a factor polynomial in k on textsc Jump k , is slower by a factor polynomial in n on some textsc Jump k, delta instances. Computationally, the new class allows experiments with wider fitness valleys, especially when they lie further away from the global optimum.


Determination of compact Lie groups with the Borsuk Ulam property. In this paper, we shall discuss the classical question of which compact Lie groups have the Borsuk Ulam property and in particular we shall show that every extension group of a n torus by a cyclic group of prime order does not have the Borsuk Ulam property. This leads us that the only compact Lie groups with the Borsuk Ulam property are an elementary abelian p group and an n torus, which is a final answer to the question.


Towards Optimal Use of Exception Handling Information for Function Detection. Function entry detection is critical for security of binary code. Conventional methods heavily rely on patterns, inevitably missing true functions and introducing errors. Recently, call frames have been used in exception handling for function start detection. However, existing methods have two problems. First, they combine call frames with heuristic based approaches, which often brings error and uncertain benefits. Second, they trust the fidelity of call frames, without handling the errors that are introduced by call frames. In this paper, we first study the coverage and accuracy of existing approaches in detecting function starts using call frames. We found that recursive disassembly with call frames can maximize coverage, and using extra heuristic based approaches does not improve coverage and actually hurts accuracy. Second, we unveil call frame errors and develop the first approach to fix them, making their use more reliable.


Intent based Network Management and Orchestration for Smart Distribution Grids. 5G technology complements the enabling of communication services for different vertical industries such as smart distribution grids. Automation is an integral and necessary part of the power distribution grid operation and management. This paper postulates a framework by which the smart distribution grid can obtain service oriented communication services using 5G network slicing and intent based networking (IBN). IBN provides an interface to service users and network stakeholders to cooperate through a high level abstraction model of service provisioning in a network agnostic manner. The automation and adaptability of the distribution grid are facilitated by using the dynamic and closed loop mechanism of IBN together with network slicing and network function virtualization for network management and orchestration. We identify the automation parts of the power distribution grid and illustrate the intent processing and its inclusion in the definition of network slice instances, service and network configuration models.


A Fresh Look at FAIR for Research Software. This document captures the discussion and deliberation of the FAIR for Research Software (FAIR4RS) subgroup that took a fresh look at the applicability of the FAIR Guiding Principles for scientific data management and stewardship for research software. We discuss the vision of research software as ideally reproducible, open, usable, recognized, sustained and robust, and then review both the characteristic and practiced differences of research software and data. This vision and understanding of initial conditions serves as a backdrop for an attempt at translating and interpreting the guiding principles to more fully align with research software. We have found that many of the principles remained relatively intact as written, as long as considerable interpretation was provided. This was particularly the case for the "Findable" and "Accessible" foundational principles. We found that "Interoperability" and "Reusability" are particularly prone to a broad and sometimes opposing set of interpretations as written. We propose two new principles modeled on existing ones, and provide modified guiding text for these principles to help clarify our final interpretation. A series of gaps in translation were captured during this process, and these remain to be addressed. We finish with a consideration of where these translated principles fall short of the vision laid out in the opening.


AC DC Alternating Compressed DeCompressed Training of Deep Neural Networks. The increasing computational requirements of deep neural networks (DNNs) have led to significant interest in obtaining DNN models that are sparse, yet accurate. Recent work has investigated the even harder case of sparse training, where the DNN weights are, for as much as possible, already sparse to reduce computational costs during training. Existing sparse training methods are often empirical and can have lower accuracy relative to the dense baseline. In this paper, we present a general approach called Alternating Compressed DeCompressed (AC DC) training of DNNs, demonstrate convergence for a variant of the algorithm, and show that AC DC outperforms existing sparse training methods in accuracy at similar computational budgets at high sparsity levels, AC DC even outperforms existing methods that rely on accurate pre trained dense models. An important property of AC DC is that it allows co training of dense and sparse models, yielding accurate sparse dense model pairs at the end of the training process. This is useful in practice, where compressed variants may be desirable for deployment in resource constrained settings without re doing the entire training flow, and also provides us with insights into the accuracy gap between dense and compressed models. The code is available at https github.com IST DASLab ACDC .


Re identification of Individuals in Genomic Datasets Using Public Face Images. DNA sequencing is becoming increasingly commonplace, both in medical and direct to consumer settings. To promote discovery, collected genomic data is often de identified and shared, either in public repositories, such as OpenSNP, or with researchers through access controlled repositories. However, recent studies have suggested that genomic data can be effectively matched to high resolution three dimensional face images, which raises a concern that the increasingly ubiquitous public face images can be linked to shared genomic data, thereby re identifying individuals in the genomic data. While these investigations illustrate the possibility of such an attack, they assume that those performing the linkage have access to extremely well curated data. Given that this is unlikely to be the case in practice, it calls into question the pragmatic nature of the attack. As such, we systematically study this re identification risk from two perspectives first, we investigate how successful such linkage attacks can be when real face images are used, and second, we consider how we can empower individuals to have better control over the associated re identification risk. We observe that the true risk of re identification is likely substantially smaller for most individuals than prior literature suggests. In addition, we demonstrate that the addition of a small amount of carefully crafted noise to images can enable a controlled trade off between re identification success and the quality of shared images, with risk typically significantly lowered even with noise that is imperceptible to humans.


A high performance fingerprint liveness detection method based on quality related features. A new software based liveness detection approach using a novel fingerprint parameterization based on quality related features is proposed. The system is tested on a highly challenging database comprising over 10,500 real and fake images acquired with five sensors of different technologies and covering a wide range of direct attack scenarios in terms of materials and procedures followed to generate the gummy fingers. The proposed solution proves to be robust to the multi scenario dataset, and presents an overall rate of 90 correctly classified samples. Furthermore, the liveness detection method presented has the added advantage over previously studied techniques of needing just one image from a finger to decide whether it is real or fake. This last characteristic provides the method with very valuable features as it makes it less intrusive, more user friendly, faster and reduces its implementation costs.


Scalar curvature lower bound under integral convergence. In this work, we consider sequences of C 2 metrics which converge to a C 2 metric in C 0 sense. We show that if the scalar curvature of the sequence is almost non negative in the integral sense, then the limiting metric has scalar curvature lower bound in point wise sense.


Generalizations of Alladi's formula for arithmetical semigroups. In this article, we prove that a general version of Alladi's formula with Dirichlet convolution holds for arithmetical semigroups satisfying Axiom A or Axiom A . As applications, we apply our main results to certain semigroups coming from algebraic number theory, arithmetical geometry and graph theory, particularly generalizing the results of Wang 2021, Kural et al. 2020 and Duan et al. 2020.


Principal frequency of an ultrashort laser pulse. We introduce an alternative definition of the main frequency of an ultrashort laser pulse, the principal frequency omega P . This parameter is complementary to the most accepted and widely used carrier frequency omega 0 . Given the fact that these ultrashort pulses, also known as transients, have a temporal width comprising only few cycles of the carrier wave, corresponding to a spectral bandwidth Delta omega covering several octaves, omega P describes, in a more precise way, the dynamics driven by these sources. We present examples where, for instance, omega P is able to correctly predict the high order harmonic cutoff independently of the carrier envelope phase. This is confirmed by solving the time dependent Schr "odinger equation in reduced dimensions, supplemented with the time analysis of the quantum spectra, where it is possible to observe how the sub cycle electron dynamics is better described using omega P . The concept of omega P , however, can be applied to a large variety of scenarios, not only within the strong field physics domain.


'Etale triviality of finite equivariant vector bundles. Let H be a complex Lie group acting holomorphically on a complex analytic space X such that the restriction to X mathrm red of every H invariant regular function on X is constant. We prove that an H equivariant holomorphic vector bundle E over X is H finite, meaning f 1(E) f 2(E) as H equivariant bundles for two distinct polynomials f 1 and f 2 whose coefficients are nonnegative integers, if and only if the pullback of E along some H equivariant finite 'etale covering of X is trivial as an H equivariant bundle.


Resonance Raman optical cycling for high fidelity fluorescence detection of molecules. We propose and demonstrate a novel technique that combines Raman scattering and optical cycling in molecules with diagonal Franck Condon factors. This resonance Raman optical cycling manipulates molecules to behave like efficient fluorophores with discrete absorption and emission profiles that are readily separated for sensitive fluorescence detection in high background light environments. Using a molecular beam of our test species, SrF, we realize up to an average of approx20 spontaneously emitted photons per molecule, limited by the interaction time, while using a bandpass filter to suppress detected scattered laser light by sim10 6 . This general technique represents a powerful tool for high fidelity fluorescence detection of molecules in any setting and is particularly well suited to molecular laser cooling and trapping experiments.


Which graphs can be counted in C 4 free graphs?. For which graphs F is there a sparse F counting lemma in C 4 free graphs? We are interested in identifying graphs F with the property that, roughly speaking, if G is an n vertex C 4 free graph with on the order of n 3 2 edges, then the density of F in G , after a suitable normalization, is approximately at least the density of F in an epsilon regular approximation of G . In recent work, motivated by applications in extremal and additive combinatorics, we showed that C 5 has this property. Here we construct a family of graphs with the property.


Average Outward Flux Skeletons for Environment Mapping and Topology Matching. We consider how to directly extract a road map (also known as a topological representation) of an initially unknown 2 dimensional environment via an online procedure that robustly computes a retraction of its boundaries. In this article, we first present the online construction of a topological map and the implementation of a control law for guiding the robot to the nearest unexplored area, first presented in 1 . The proposed method operates by allowing the robot to localize itself on a partially constructed map, calculate a path to unexplored parts of the environment (frontiers), compute a robust terminating condition when the robot has fully explored the environment, and achieve loop closure detection. The proposed algorithm results in smooth safe paths for the robot's navigation needs. The presented approach is any time algorithm that has the advantage that it allows for the active creation of topological maps from laser scan data, as it is being acquired. We also propose a navigation strategy based on a heuristic where the robot is directed towards nodes in the topological map that open to empty space. We then extend the work in 1 by presenting a topology matching algorithm that leverages the strengths of a particular spectral correspondence method 2 , to match the mapped environments generated from our topology making algorithm. Here, we concentrated on implementing a system that could be used to match the topologies of the mapped environment by using AOF Skeletons. In topology matching between two given maps and their AOF skeletons, we first find correspondences between points on the AOF skeletons of two different environments. We then align the (2D) points of the environments themselves. We also compute a distance measure between two given environments, based on their extracted AOF skeletons and their topology, as the sum of the matching errors between corresponding points.


Existence and uniqueness of local regular solution to the Schr " o dinger flow from a bounded domain in mathbb R 3 into mathbb S 2 . In this paper, we show the existence and uniqueness of local regular solutions to the initial Neumann boundary value problem of Schr " o dinger flow from a smooth bounded domain Omega subset mathbb R 3 into mathbb S 2 (namely Landau Lifshitz equation without dissipation). The proof is built on a parabolic perturbation method, an intrinsic geometric energy argument and some observations on the behaviors of some geometric quantities on the boundary of the domain manifold. It is based on methods from Ding and Wang (one of the authors of this paper) for the Schr "odinger flows of maps from a closed Riemannian manifold into a K "ahler manifold as well as on methods by Carbou and Jizzini for solutions of the Landau Lifshitz equation.


Global Smoothing for the Davey Stewartson System on mathbb R 2 . In this paper we study the regularity properties of solutions to the Davey Stewartson system. It is shown that for initial data in a Sobolev space, the nonlinear part of the solution flow resides in a smoother space than the initial data for all times. We also obtain that the Sobolev norm of the nonlinear part of the evolution grows at most polynomially. As an application of the smoothing estimate, we study the long term dynamics of the forced and weakly damped Davey Stewartson system. In this regard we give a new proof for the existence and smoothness of the global attractors in the energy space.


Auslander Reiten conjecture and finite injective dimension of Hom. For a finitely generated module M over a commutative Noetherian ring R , we settle the Auslander Reiten conjecture when at least one of rm Hom R(M,R) and rm Hom R(M,M) has finite injective dimension. A number of new characterizations of Gorenstein local rings are also obtained in terms of vanishing of certain Ext and finite injective dimension of Hom.


Direct Construction of Program Alignment Automata for Equivalence Checking. The problem of checking whether two programs are semantically equivalent or not has a diverse range of applications, and is consequently of substantial importance. There are several techniques that address this problem, chiefly by constructing a product program that makes it easier to derive useful invariants. A novel addition to these is a technique that uses alignment predicates to align traces of the two programs, in order to construct a program alignment automaton. Being guided by predicates is not just beneficial in dealing with syntactic dissimilarities, but also in staying relevant to the property. However, there are also drawbacks of a trace based technique. Obtaining traces that cover all program behaviors is difficult, and any under approximation may lead to an incomplete product program. Moreover, an indirect construction of this kind is unaware of the missing behaviors, and has no control over the aforesaid incompleteness. This paper, addressing these concerns, presents an algorithm to construct the program alignment automaton directly instead of relying on traces.


A reproduction of Apple's bi directional LSTM models for language identification in short strings. Language Identification is the task of identifying a document's language. For applications like automatic spell checker selection, language identification must use very short strings such as text message fragments. In this work, we reproduce a language identification architecture that Apple briefly sketched in a blog post. We confirm the bi LSTM model's performance and find that it outperforms current open source language identifiers. We further find that its language identification mistakes are due to confusion between related languages.


Learning and Generalization in RNNs. Simple recurrent neural networks (RNNs) and their more advanced cousins LSTMs etc. have been very successful in sequence modeling. Their theoretical understanding, however, is lacking and has not kept pace with the progress for feedforward networks, where a reasonably complete understanding in the special case of highly overparametrized one hidden layer networks has emerged. In this paper, we make progress towards remedying this situation by proving that RNNs can learn functions of sequences. In contrast to the previous work that could only deal with functions of sequences that are sums of functions of individual tokens in the sequence, we allow general functions. Conceptually and technically, we introduce new ideas which enable us to extract information from the hidden state of the RNN in our proofs addressing a crucial weakness in previous work. We illustrate our results on some regular language recognition problems.


Adversarial Example Detection for DNN Models A Review and Experimental Comparison. Deep learning (DL) has shown great success in many human related tasks, which has led to its adoption in many computer vision based applications, such as security surveillance systems, autonomous vehicles and healthcare. Such safety critical applications have to draw their path to success deployment once they have the capability to overcome safety critical challenges. Among these challenges are the defense against or and the detection of the adversarial examples (AEs). Adversaries can carefully craft small, often imperceptible, noise called perturbations to be added to the clean image to generate the AE. The aim of AE is to fool the DL model which makes it a potential risk for DL applications. Many test time evasion attacks and countermeasures,i.e., defense or detection methods, are proposed in the literature. Moreover, few reviews and surveys were published and theoretically showed the taxonomy of the threats and the countermeasure methods with little focus in AE detection methods. In this paper, we focus on image classification task and attempt to provide a survey for detection methods of test time evasion attacks on neural network classifiers. A detailed discussion for such methods is provided with experimental results for eight state of the art detectors under different scenarios on four datasets. We also provide potential challenges and future perspectives for this research direction.


LAViTeR Learning Aligned Visual and Textual Representations Assisted by Image and Caption Generation. Pre training visual and textual representations from large scale image text pairs is becoming a standard approach for many downstream vision language tasks. The transformer based models learn inter and intra modal attention through a list of self supervised learning tasks. This paper proposes LAViTeR, a novel architecture for visual and textual representation learning. The main module, Visual Textual Alignment (VTA) will be assisted by two auxiliary tasks, GAN based image synthesis and Image Captioning. We also propose a new evaluation metric measuring the similarity between the learnt visual and textual embedding. The experimental results on two public datasets, CUB and MS COCO, demonstrate superior visual and textual representation alignment in the joint feature embedding space


Homogeneous Plurisubharmonic Polynomials in Higher Dimensions. We prove several results on homogeneous plurisubharmonic polynomials on mathbb C n , n in mathbb Z geq 2 . Said results are relevant to the problem of constructing local bumpings at boundary points of pseudoconvex domains of finite D'Angelo 1 type in mathbb C n 1 .


Lamb type solution and properties of unsteady Stokes equations. In this paper, we derive the general solution of the unsteady Stokes equations for an unbounded fluid in spherical polar coordinates, in both time and frequency domains. The solution is an expansion in vector spherical harmonics and given as a sum of a particular solution, proportional to pressure gradient exhibiting power law spatial dependence, and a solution of vector Helmholtz equation decaying exponentially in far field. The proposed solution representation resembles the classical Lamb's decomposition of the steady Stokes equations solution the series coefficients are projections of radial component, divergence and curl of the boundary velocity on scalar spherical harmonics. The proposed general representation solution can be applied to construct the transient flow induced by an arbitrary velocity distribution at the spherical boundary, such as arising in the squirmer model for microswimmers. We further show that the general representation reduces to the well known solutions for unsteady flow around a sphere undergoing oscillatory rigid body (translation and rotation) motion. The proposed solution representation provides an explicit form of the velocity potential far from an oscillating body ("generalized" Darcy's law) and high and low frequency expansions. The leading order high frequency expansion yields the well known ideal (inviscid) flow approximation. We derive the higher order corrections to that approximation and discuss d'Alembert paradox. Continuation of the general solution to imaginary frequency yields the general solution of the Brinkman equations describing viscous flow in porous medium.


Large Scale GPU Based Simulations of Turbulent Bubbly Flow in a Square Duct. In this paper, we present the results of a numerical study of air water turbulent bubbly flow in a periodic vertical square duct. The study is conducted using a novel numerical technique which leverages Volume of Fluid method for interface capturing and Sharp Surface Force method for accurate representation of the surface tension forces. A three dimensional geometry construction method is employed during solution of interface equation which gives absolute conservation of mass and sharp interface between gas and liquid phases. The entire algorithm has been implemented on a data parallel mode on multiple graphics processing units (GPU) taking advantage of the large number of available cores. We have studied the dynamics of a swarm of spherical bubbles co flowing with the upward turbulent flow and compared results with an unladen turbulent flow. The frictional Reynolds number of the unladen Re tau is 360, which is sufficient to sustain a turbulent flow. We observe the turbulence driven secondary flows in the mean flow, with complex instantaneous turbulent vortical structures. The interaction of these secondary flows with the upwards rising bubbles is very complex and leads to significant changes in the instantaneous and time averaged flow field. We present the results of mean void fraction distribution, mean velocities, longitudinal and transverse turbulence intensities along the wall, corner bisector, and wall bisector. A peak in the void fraction distribution near the walls is observed representing the migration of bubbles to a preferred section of the duct. The effects of turbulence driven secondary flows and instantaneous large eddies on preferential concentration of the bubbles are discussed. The dispersed bubbles are seen to break the long elongated turbulent structures commonly observed in the unladen turbulent flow.


Asynchronous Stochastic Optimization Robust to Arbitrary Delays. We consider stochastic optimization with delayed gradients where, at each time step t , the algorithm makes an update using a stale stochastic gradient from step t d t for some arbitrary delay d t . This setting abstracts asynchronous distributed optimization where a central server receives gradient updates computed by worker machines. These machines can experience computation and communication loads that might vary significantly over time. In the general non convex smooth optimization setting, we give a simple and efficient algorithm that requires O( sigma 2 epsilon 4 tau epsilon 2 ) steps for finding an epsilon stationary point x , where tau is the emph average delay smash frac 1 T sum t 1 T d t and sigma 2 is the variance of the stochastic gradients. This improves over previous work, which showed that stochastic gradient decent achieves the same rate but with respect to the emph maximal delay max t d t , that can be significantly larger than the average delay especially in heterogeneous distributed systems. Our experiments demonstrate the efficacy and robustness of our algorithm in cases where the delay distribution is skewed or heavy tailed.


The secretary problem with non uniform arrivals via a left to right minimum exponentially tilted distribution. We solve the secretary problem in the case that the ranked items arrive in a statistically biased order rather than in uniformly random order. The bias is given by a left to right minimum exponentially tilted distribution with parameter q in(0, infty) . For q in(0,1) , higher ranked items tend to arrive earlier than in the case of the uniform distribution, and for q in(1, infty) , they tend to arrive later. In the classical problem, the asymptotically optimal strategy is to reject the first M n items, where M n sim frac ne , and then to select the first item ranked higher than any of the first M n items (if such an item exists). This yields e 1 as the limiting probability of success. With the above bias on arrivals, we calculate the asymptotic behavior of the optimal strategy M n and the corresponding limiting probability of success, for all regimes of q n n 1 infty .


Assessing bikeability with street view imagery and computer vision. Studies evaluating bikeability usually compute spatial indicators shaping cycling conditions and conflate them in a quantitative index. Much research involves site visits or conventional geospatial approaches, and few studies have leveraged street view imagery (SVI) for conducting virtual audits. These have assessed a limited range of aspects, and not all have been automated using computer vision (CV). Furthermore, studies have not yet zeroed in on gauging the usability of these technologies thoroughly. We investigate, with experiments at a fine spatial scale and across multiple geographies (Singapore and Tokyo), whether we can use SVI and CV to assess bikeability comprehensively. Extending related work, we develop an exhaustive index of bikeability composed of 34 indicators. The results suggest that SVI and CV are adequate to evaluate bikeability in cities comprehensively. As they outperformed non SVI counterparts by a wide margin, SVI indicators are also found to be superior in assessing urban bikeability, and potentially can be used independently, replacing traditional techniques. However, the paper exposes some limitations, suggesting that the best way forward is combining both SVI and non SVI approaches. The new bikeability index presents a contribution in transportation and urban analytics, and it is scalable to assess cycling appeal widely.


Convergence of sequences a survey. Convergent sequences of real numbers play a fundamental role in many different problems in system theory, e.g., in Lyapunov stability analysis, as well as in optimization theory and computational game theory. In this survey, we provide an overview of the literature on convergence theorems and their connection with Fejer monotonicity in the deterministic and stochastic settings, and we show how to exploit these results.


Diagonal double Kodaira fibrations with minimal signature. We study some special systems of generators on finite groups, introduced in previous work by the first author and called "diagonal double Kodaira structures", in order to investigate non abelian, finite quotients of the pure braid group on two strands mathsf P 2( Sigma b) , where Sigma b is a closed Riemann surface of genus b . In particular, we prove that, if a finite group G admits a diagonal double Kodaira structure, then G geq 32 , and equality holds if and only if G is extra special. In the last section, as a geometrical application of our algebraic results, we construct two 3 dimensional families of double Kodaira fibrations having signature 16 .


Rates of convergence for asymptotically weakly contractive mappings in normed spaces. We study Krasnoselskii Mann style iterative algorithms for approximating fixpoints of asymptotically weakly contractive mappings, with a focus on providing generalised convergence proofs along with explicit rates of convergence. More specifically, we define a new notion of being asymptotically psi weakly contractive with modulus, and present a series of abstract convergence theorems which both generalise and unify known results from the literature. Rates of convergence are formulated in terms of our modulus of contractivity, in conjunction with other moduli and functions which form quantitative analogues of additional assumptions that are required in each case. Our approach makes use of ideas from proof theory, in particular our emphasis on abstraction and on formulating our main results in a quantitative manner. As such, the paper can be seen as a contribution to the proof mining program.


Automatic Post Editing for Vietnamese. Automatic post editing (APE) is an important remedy for reducing errors of raw translated texts that are produced by machine translation (MT) systems or software aided translation. In this paper, we present a systematic approach to tackle the APE task for Vietnamese. Specifically, we construct the first large scale dataset of 5M Vietnamese translated and corrected sentence pairs. We then apply strong neural MT models to handle the APE task, using our constructed dataset. Experimental results from both automatic and human evaluations show the effectiveness of the neural MT models in handling the Vietnamese APE task.


Radial symmetry of solutions to anisotropic and weighted diffusion equations with discontinuous nonlinearities. We prove radial symmetry for bounded nonnegative solutions of a weighted anisotropic problem. Given the anisotropic setting that we deal with, the term "radial" is understood in the Finsler framework. In the whole space, J. Serra obtained the symmetry result in the isotropic unweighted setting. In this case we provide the extension of his result to the anisotropic setting. This provides a generalization to the anisotropic setting of a celebrated result due to Gidas Ni Nirenberg and such a generalization is new even for in the case of linear operators whenever the dimension is greater than 2. In proper cones, the results presented are new even in the isotropic and unweighted setting for suitable nonlinear cases. Even for the previously known case of unweighted isotropic setting, the present paper provides an approach to the problem by exploiting integral (in)equalities which is new for N 2 this complements the corresponding symmetry result obtained via the moving planes method by Berestycki Pacella.


A RISC V Simulator and Benchmark Suite for Designing and Evaluating Vector Architectures. Vector architectures lack tools for research. Consider the gem5 simulator, which is possibly the leading platform for computer system architecture research. Unfortunately, gem5 does not have an available distribution that includes a flexible and customizable vector architecture model. In consequence, researchers have to develop their own simulation platform to test their ideas, which consume much research time. However, once the base simulator platform is developed, another question is the following Which applications should be tested to perform the experiments? The lack of Vectorized Benchmark Suites is another limitation. To face these problems, this work presents a set of tools for designing and evaluating vector architectures. First, the gem5 simulator was extended to support the execution of RISC V Vector instructions by adding a parameterizable Vector Architecture model for designers to evaluate different approaches according to the target they pursue. Second, a novel Vectorized Benchmark Suite is presented a collection composed of seven data parallel applications from different domains that can be classified according to the modules that are stressed in the vector architecture. Finally, a study of the Vectorized Benchmark Suite executing on the gem5 based Vector Architecture model is highlighted. This suite is the first in its category that covers the different possible usage scenarios that may occur within different vector architecture designs such as embedded systems, mainly focused on short vectors, or High Performance Computing (HPC), usually designed for large vectors.


Sharp Weak Type Estimates for a Family of Zygmund Bases. Let mathcal B be a collection of rectangular parallelepipeds in mathbb R 3 whose sides are parallel to the coordinate axes and such that mathcal B consists of parallelepipeds with side lengths of the form s, 2 j s, t , where s, t 0 and j lies in a nonempty subset S of the integers. In this paper, we prove the following If S is a finite set, then the associated geometric maximal operator M mathcal B satisfies the weak type estimate of the form left left x in mathbb R 3 M mathcal B f(x) alpha right right leq C int mathbb R 3 frac f alpha left(1 log frac f alpha right) but does not satisfy an estimate of the form left left x in mathbb R 3 M mathcal B f(x) alpha right right leq C int mathbb R 3 phi left( frac f alpha right) for any convex increasing function phi mathbb 0, infty) rightarrow 0, infty) satisfying the condition lim x rightarrow infty frac phi(x) x ( log(1 x)) 0 . On the other hand, if S is an infinite set, then the associated geometric maximal operator M mathcal B satisfies the weak type estimate left left x in mathbb R 3 M mathcal B f(x) alpha right right leq C int mathbb R 3 frac f alpha left(1 log frac f alpha right) 2 but does not satisfy an estimate of the form left left x in mathbb R 3 M mathcal B f(x) alpha right right leq C int mathbb R 3 phi left( frac f alpha right) for any convex increasing function phi mathbb 0, infty) rightarrow 0, infty) satisfying the condition lim x rightarrow infty frac phi(x) x ( log(1 x)) 2 0 .


Toward SMT Based Refinement Types in Agda. Dependent types offer great versatility and power, but developing proofs with them can be tedious and requires considerable human guidance. We propose to integrate Satisfiability Modulo Theories (SMT) based refinement types into the dependently typed language Agda in an effort to ease some of the burden of programming with dependent types and combine the strengths of the two approaches to mechanized theorem proving.


Federated Learning with Buffered Asynchronous Aggregation. Scalability and privacy are two critical concerns for cross device federated learning (FL) systems. In this work, we identify that synchronous FL synchronized aggregation of client updates in FL cannot scale efficiently beyond a few hundred clients training in parallel. It leads to diminishing returns in model performance and training speed, analogous to large batch training. On the other hand, asynchronous aggregation of client updates in FL (i.e., asynchronous FL) alleviates the scalability issue. However, aggregating individual client updates is incompatible with Secure Aggregation, which could result in an undesirable level of privacy for the system. To address these concerns, we propose a novel buffered asynchronous aggregation method, FedBuff, that is agnostic to the choice of optimizer, and combines the best properties of synchronous and asynchronous FL. We empirically demonstrate that FedBuff is 3.3x more efficient than synchronous FL and up to 2.5x more efficient than asynchronous FL, while being compatible with privacy preserving technologies such as Secure Aggregation and differential privacy. We provide theoretical convergence guarantees in a smooth non convex setting. Finally, we show that under differentially private training, FedBuff can outperform FedAvgM at low privacy settings and achieve the same utility for higher privacy settings.


A rank adaptive higher order orthogonal iteration algorithm for truncated Tucker decomposition. We propose a novel rank adaptive higher order orthogonal iteration (HOOI) algorithm to compute the truncated Tucker decomposition of higher order tensors with a given error tolerance, and prove that the method is locally optimal and monotonically convergent. A series of numerical experiments related to both synthetic and real world tensors are carried out to show that the proposed rank adaptive HOOI algorithm is advantageous in terms of both accuracy and efficiency. Some further analysis on the HOOI algorithm and the classical alternating least squares method are presented to further understand why rank adaptivity can be introduced into the HOOI algorithm and how it works.


Domain Adaptive Semantic Segmentation with Self Supervised Depth Estimation. Domain adaptation for semantic segmentation aims to improve the model performance in the presence of a distribution shift between source and target domain. Leveraging the supervision from auxiliary tasks (such as depth estimation) has the potential to heal this shift because many visual tasks are closely related to each other. However, such a supervision is not always available. In this work, we leverage the guidance from self supervised depth estimation, which is available on both domains, to bridge the domain gap. On the one hand, we propose to explicitly learn the task feature correlation to strengthen the target semantic predictions with the help of target depth estimation. On the other hand, we use the depth prediction discrepancy from source and target depth decoders to approximate the pixel wise adaptation difficulty. The adaptation difficulty, inferred from depth, is then used to refine the target semantic segmentation pseudo labels. The proposed method can be easily implemented into existing segmentation frameworks. We demonstrate the effectiveness of our approach on the benchmark tasks SYNTHIA to Cityscapes and GTA to Cityscapes, on which we achieve the new state of the art performance of 55.0 and 56.6 , respectively. Our code is available at url https qin.ee corda .


Unsupervised Domain Specific Deblurring using Scale Specific Attention. In the literature, coarse to fine or scale recurrent approach i.e. progressively restoring a clean image from its low resolution versions has been successfully employed for single image deblurring. However, a major disadvantage of existing methods is the need for paired data i.e. sharpblur image pairs of the same scene, which is a complicated and cumbersome acquisition procedure. Additionally, due to strong supervision on loss functions, pre trained models of such networks are strongly biased towards the blur experienced during training and tend to give sub optimal performance when confronted by new blur kernels during inference time. To address the above issues, we propose unsupervised domain specific deblurring using a scale adaptive attention module (SAAM). Our network does not require supervised pairs for training, and the deblurring mechanism is primarily guided by adversarial loss, thus making our network suitable for a distribution of blur functions. Given a blurred input image, different resolutions of the same image are used in our model during training and SAAM allows for effective flow of information across the resolutions. For network training at a specific scale, SAAM attends to lower scale features as a function of the current scale. Different ablation studies show that our coarse to fine mechanism outperforms end to end unsupervised models and SAAM is able to attend better compared to attention models used in literature. Qualitative and quantitative comparisons (on no reference metrics) show that our method outperforms prior unsupervised methods.


Saxl graphs of primitive affine groups with sporadic point stabilisers. Let G be a permutation group on a set Omega . A base for G is a subset of Omega whose pointwise stabiliser is trivial, and the base size of G is the minimal cardinality of a base. If G has base size 2 , then the corresponding Saxl graph Sigma(G) has vertex set Omega and two vertices are adjacent if they form a base for G . A recent conjecture of Burness and Giudici states that if G is a finite primitive permutation group with base size 2 , then Sigma(G) has the property that every two vertices have a common neighbour. We investigate this conjecture when G is an affine group and a point stabiliser is an almost quasisimple group whose unique quasisimple subnormal subgroup is a covering group of a sporadic simple group. We verify the conjecture under this assumption, in all but ten cases.


Planar Reachability Under Single Vertex or Edge Failures. In this paper we present an efficient reachability oracle under single edge or single vertex failures for planar directed graphs. Specifically, we show that a planar digraph G can be preprocessed in O(n log 2 n log log n ) time, producing an O(n log n ) space data structure that can answer in O( log n ) time whether u can reach v in G if the vertex x (the edge f ) is removed from G , for any query vertices u,v and failed vertex x (failed edge f ). To the best of our knowledge, this is the first data structure for planar directed graphs with nearly optimal preprocessing time that answers all pairs queries under any kind of failures in polylogarithmic time. We also consider 2 reachability problems, where we are given a planar digraph G and we wish to determine if there are two vertex disjoint (edge disjoint) paths from u to v , for query vertices u,v . In this setting we provide a nearly optimal 2 reachability oracle, which is the existential variant of the reachability oracle under single failures, with the following bounds. We can construct in O(n log O(1) n ) time an O(n log 3 o(1) n ) space data structure that can check in O( log 2 o(1) n ) time for any query vertices u,v whether v is 2 reachable from u , or otherwise find some separating vertex (edge) x lying on all paths from u to v in G . To obtain our results, we follow the general recursive approach of Thorup for reachability in planar graphs J. ACM '04 and we present new data structures which generalize dominator trees and previous data structures for strong connectivity under failures Georgiadis et al., SODA '17 . Our new data structures work also for general digraphs and may be of independent interest.


Tolerance Guided Policy Learning for Adaptable and Transferrable Delicate Industrial Insertion. Policy learning for delicate industrial insertion tasks (e.g., PC board assembly) is challenging. This paper considers two major problems how to learn a diversified policy (instead of just one average policy) that can efficiently handle different workpieces with minimum amount of training data, and how to handle defects of workpieces during insertion. To address the problems, we propose tolerance guided policy learning. To encourage transferability of the learned policy to different workpieces, we add a task embedding to the policy's input space using the insertion tolerance. Then we train the policy using generative adversarial imitation learning with reward shaping (RS GAIL) on a variety of representative situations. To encourage adaptability of the learned policy to handle defects, we build a probabilistic inference model that can output the best inserting pose based on failed insertions using the tolerance model. The best inserting pose is then used as a reference to the learned policy. This proposed method is validated on a sequence of IC socket insertion tasks in simulation. The results show that 1) RS GAIL can efficiently learn optimal policies under sparse rewards 2) the tolerance embedding can enhance the transferability of the learned policy 3) the probabilistic inference makes the policy robust to defects on the workpieces.


Generalizing Syndrome Decoding problem to the totally Non negative Grassmannian. The syndrome decoding problem has been proposed as a computational hardness assumption for code based cryptosystem that are safe against quantum computing. The problem has been reduced to finding the codeword with the smallest non zero columns that would satisfy a linear check equation. Variants of Information set decoding algorithms has been developed as cryptanalytic tools to solve the problem. In this paper, we study and generalize the solution to codes associated with the totally non negative Grassmannian in the Grassmann metric. This is achieved by reducing it to an instance of finding a subset of the plucker coordinates with the smallest number of columns. Subsequently, the theory of the totally non negative Grassmann is extended to connect the concept of boundary measurement map to Tanner graph like code construction while deriving new analytical bounds on its parameters. The derived bounds shows that the complexity scales up on the size of the plucker coordinates. Finally, experimental results on decoding failure probability and complexity based on row operations are presented and compared to Low Density parity check codes in the Hamming metric.


Coarse grained decomposition and fine grained interaction for multi hop question answering. Recent advances regarding question answering and reading comprehension have resulted in models that surpass human performance when the answer is contained in a single, continuous passage of text, requiring only single hop reasoning. However, in actual scenarios, lots of complex queries require multi hop reasoning. The key to the Question Answering task is semantic feature interaction between documents and questions, which is widely processed by Bi directional Attention Flow (Bi DAF), but Bi DAF generally captures only the surface semantics of words in complex questions and fails to capture implied semantic feature of intermediate answers. As a result, Bi DAF partially ignores part of the contexts related to the question and cannot extract the most important parts of multiple documents. In this paper we propose a new model architecture for multi hop question answering, by applying two completion strategies (1) Coarse Grain complex question Decomposition (CGDe) strategy are introduced to decompose complex question into simple ones under the condition of without any additional annotations (2) Fine Grained Interaction (FGIn) strategy are introduced to better represent each word in the document and extract more comprehensive and accurate sentences related to the inference path. The above two strategies are combined and tested on the SQuAD and HotpotQA datasets, and the experimental results show that our method outperforms state of the art baselines.


Characterizing Abhorrent, Misinformative, and Mistargeted Content on YouTube. YouTube has revolutionized the way people discover and consume video. Although YouTube facilitates easy access to hundreds of well produced and trustworthy videos, abhorrent, misinformative, and mistargeted content is also common. The platform is plagued by various types of problematic content 1) disturbing videos targeting young children 2) hateful and misogynistic content and 3) pseudoscientific misinformation. While YouTube's recommendation algorithm plays a vital role in increasing user engagement and YouTube's monetization, its role in unwittingly promoting problematic content is not entirely understood. In this thesis, we shed some light on the degree of problematic content on YouTube and the role of the recommendation algorithm in the dissemination of such content. Following a data driven quantitative approach, we analyze thousands of videos on YouTube, to shed light on 1) the risks of YouTube media consumption by young children 2) the role of the recommendation algorithm in the dissemination of misogynistic content, by focusing on the Involuntary Celibates (Incels) community and 3) user exposure to pseudoscientific content on various parts of the platform and how this exposure changes based on the user's watch history. Our analysis reveals that young children are likely to encounter disturbing content when they randomly browse the platform. By analyzing the Incel community on YouTube, we find that Incel activity is increasing over time and that platforms may play an active role in steering users towards extreme content. Finally, when studying pseudoscientific misinformation, we find that YouTube suggests more pseudoscientific content regarding traditional pseudoscientific topics (e.g., flat earth) than for emerging ones (like COVID 19) and that these recommendations are more common on the search results page than on a user's homepage or the video recommendations section.


Multi stage Clarification in Conversational AI The case of Question Answering Dialogue Systems. Clarification resolution plays an important role in various information retrieval tasks such as interactive question answering and conversational search. In such context, the user often formulates their information needs as short and ambiguous queries, some popular search interfaces then prompt the user to confirm her intent (e.g. "Did you mean ... ?") or to rephrase if needed. When it comes to dialogue systems, having fluid user bot exchanges is key to good user experience. In the absence of such clarification mechanism, one of the following responses is given to the user 1) A direct answer, which can potentially be non relevant if the intent was not clear, 2) a generic fallback message informing the user that the retrieval tool is incapable of handling the query. Both scenarios might raise frustration and degrade the user experience. To this end, we propose a multi stage clarification mechanism for prompting clarification and query selection in the context of a question answering dialogue system. We show that our proposed mechanism improves the overall user experience and outperforms competitive baselines with two datasets, namely the public in scope out of scope dataset and a commercial dataset based on real user logs.


SDN Based Intrusion Detection System for Early Detection and Mitigation of DDoS Attacks. The current paper addresses relevant network security vulnerabilities introduced by network devices within the emerging paradigm of Internet of Things (IoT) as well as the urgent need to mitigate the negative effects of some types of Distributed Denial of Service (DDoS) attacks that try to explore those security weaknesses. We design and implement a Software Defined Intrusion Detection System (IDS) that reactively impairs the attacks at its origin, ensuring the normal operation of the network infrastructure. Our proposal includes an IDS that automatically detects several DDoS attacks, and then as an attack is detected, it notifies a Software Defined Networking (SDN) controller. The current proposal also downloads some convenient traffic forwarding decisions from the SDN controller to network devices. The evaluation results suggest that our proposal timely detects several types of cyber attacks based on DDoS, mitigates their negative impacts on the network performance, and ensures the correct data delivery of normal traffic. Our work sheds light on the programming relevance over an abstracted view of the network infrastructure to timely detect a Botnet exploitation, mitigate malicious traffic at its source, and protect benign traffic.


Online Hyperparameter Meta Learning with Hypergradient Distillation. Many gradient based meta learning methods assume a set of parameters that do not participate in inner optimization, which can be considered as hyperparameters. Although such hyperparameters can be optimized using the existing gradient based hyperparameter optimization (HO) methods, they suffer from the following issues. Unrolled differentiation methods do not scale well to high dimensional hyperparameters or horizon length, Implicit Function Theorem (IFT) based methods are restrictive for online optimization, and short horizon approximations suffer from short horizon bias. In this work, we propose a novel HO method that can overcome these limitations, by approximating the second order term with knowledge distillation. Specifically, we parameterize a single Jacobian vector product (JVP) for each HO step and minimize the distance from the true second order term. Our method allows online optimization and also is scalable to the hyperparameter dimension and the horizon length. We demonstrate the effectiveness of our method on two different meta learning methods and three benchmark datasets.


Degeneration of Riemann theta functions and of the Zhang Kawazumi invariant with applications to a uniform Bogomolov conjecture. In this paper we study the degeneration behavior of the norm of the Riemann theta function in a family of principally polarized abelian varieties over the punctured complex unit disc in terms of the associated polarized real torus. As an application, we obtain the degeneration behavior of the Zhang Kawazumi invariant varphi(M t) of a family of Riemann surfaces M t in terms of Zhang's invariant varphi( Gamma) of the associated metrized reduction graph Gamma . This allows us to deduce a uniform lower bound for the essential minimum of the N 'eron Tate height on the tautological cycles of any Jacobian variety over a number field.


A Loss Curvature Perspective on Training Instability in Deep Learning. In this work, we study the evolution of the loss Hessian across many classification tasks in order to understand the effect the curvature of the loss has on the training dynamics. Whereas prior work has focused on how different learning rates affect the loss Hessian observed during training, we also analyze the effects of model initialization, architectural choices, and common training heuristics such as gradient clipping and learning rate warmup. Our results demonstrate that successful model and hyperparameter choices allow the early optimization trajectory to either avoid or navigate out of regions of high curvature and into flatter regions that tolerate a higher learning rate. Our results suggest a unifying perspective on how disparate mitigation strategies for training instability ultimately address the same underlying failure mode of neural network optimization, namely poor conditioning. Inspired by the conditioning perspective, we show that learning rate warmup can improve training stability just as much as batch normalization, layer normalization, MetaInit, GradInit, and Fixup initialization.


Benchmarking Feature based Algorithm Selection Systems for Black box Numerical Optimization. Feature based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature based algorithm selection has recently received attention in the research field of black box numerical optimization. However, there is still room for analysis of algorithm selection for black box optimization. Most previous studies have focused only on whether an algorithm selection system can outperform the single best solver in a portfolio. In addition, a benchmarking methodology for algorithm selection systems has not been well investigated in the literature. In this context, this paper analyzes algorithm selection systems on the 24 noiseless black box optimization benchmarking functions. First, we demonstrate that the first successful performance measure is more reliable than the expected runtime measure for benchmarking algorithm selection systems. Then, we examine the influence of randomness on the performance of algorithm selection systems. We also show that the performance of algorithm selection systems can be significantly improved by using sequential least squares programming as a pre solver. We point out that the difficulty of outperforming the single best solver depends on algorithm portfolios, cross validation methods, and dimensions. Finally, we demonstrate that the effectiveness of algorithm portfolios depends on various factors. These findings provide fundamental insights for algorithm selection for black box optimization.


On facets of the Newton polytope for the discriminant of the polynomial system. We study normal directions to facets of the Newton polytope of the discriminant of the Laurent polynomial system via the tropical approach. We use the combinatorial construction proposed by Dickenstein, Feichtner and Sturmfels for the tropicalization of algebraic varieties admitting a parametrization by a linear map followed by a monomial map.


Monotone cumulant moment formula and Schr "oder trees. We prove a formula to express multivariate monotone cumulants of random variables in terms of their moments by using a Hopf algebra of decorated Schr "oder trees.


TrackerSift Untangling Mixed Tracking and Functional Web Resources. Trackers have recently started to mix tracking and functional resources to circumvent privacy enhancing content blocking tools. Such mixed web resources put content blockers in a bind risk breaking legitimate functionality if they act and risk missing privacy invasive advertising and tracking if they do not. In this paper, we propose TrackerSift to progressively classify and untangle mixed web resources (that combine tracking and legitimate functionality) at multiple granularities of analysis (domain, hostname, script, and method). Using TrackerSift, we conduct a large scale measurement study of such mixed resources on 100K websites. We find that more than 17 domains, 48 hostnames, 6 scripts, and 9 methods observed in our crawls combine tracking and legitimate functionality. While mixed web resources are prevalent across all granularities, TrackerSift is able to attribute 98 of the script initiated network requests to either tracking or functional resources at the finest method level granularity. Our analysis shows that mixed resources at different granularities are typically served from CDNs or as inlined and bundled scripts, and that blocking them indeed results in breakage of legitimate functionality. Our results highlight opportunities for finer grained content blocking to remove mixed resources without breaking legitimate functionality.


SIMUS an open source simulator for ultrasound imaging. Part II comparison with three popular simulators. Computational ultrasound imaging has become a well established methodology in the ultrasound community. In the accompanying paper (part I), we described a new ultrasound simulator (SIMUS) for Matlab, which belongs to the Matlab UltraSound Toolbox (MUST). SIMUS can generate pressure fields and radiofrequency RF signals for simulations in medical ultrasound imaging. It works in a harmonic domain and uses linear equations derived from far field and paraxial approximations. In this article (part II), we illustrate how SIMUS compares with three popular ultrasound simulators (Field II, k Wave, and Verasonics) for a homogeneous medium. We designed different transmit sequences (focused, planar, and diverging wavefronts) and calculated the corresponding 2 D and 3 D (with elevation focusing) RMS pressure fields. SIMUS produced pressure fields similar to those of Field II and k Wave. The acoustic fields provided by the Verasonics simulator were significantly different from those of SIMUS and k Wave, although the overall appearance remained consistent. Our simulations tend to demonstrate that SIMUS is reliable and can be used on a par with Field II and k Wave for realistic ultrasound simulations.


Global solutions of aggregation equations and other flows with random diffusion. Aggregation equations, such as the parabolic elliptic Patlak Keller Segel model, are known to have an optimal threshold for global existence vs. finite time blow up. In particular, if the diffusion is absent, then all smooth solutions with finite second moment can exist only locally in time. Nevertheless, one can ask whether global existence can be restored by adding a suitable noise to the equation, so that the dynamics are now stochastic. Inspired by the work of Buckmaster et al. arXiv 1806.03734 showing that, with high probability, the inviscid SQG equation with random diffusion has global classical solutions, we investigate whether suitable random diffusion can restore global existence for a large class of active scalar equations in arbitrary dimension with possibly singular velocity fields. This class includes Hamiltonian flows, such as the SQG equation and its generalizations, and gradient flows, such as those arising in aggregation models. For this class, we show global existence of solutions in Gevrey type Fourier Lebesgue spaces with quantifiable high probability.


The 2 category of 2 term complexes. We describe some of the basic properties of the 2 category of 2 term complexes in an abelian category, using butterflies as morphisms.


Backward stochastic differential equations with time delayed generators and integrable parameters. In this note, we derive an existence and uniqueness results for delayed backward stochastic differential equation with only integrable data.