COREATTACK Breaking Up the Core Structure of Graphs. The concept of k core in complex networks plays a key role in many applications, e.g., understanding the global structure, or identifying central critical nodes, of a network. A malicious attacker with jamming ability can exploit the vulnerability of the k core structure to attack the network and invalidate the network analysis methods, e.g., reducing the k shell values of nodes can deceive graph algorithms, leading to the wrong decisions. In this paper, we investigate the robustness of the k core structure under adversarial attacks by deleting edges, for the first time. Firstly, we give the general definition of targeted k core attack, map it to the set cover problem which is NP hard, and further introduce a series of evaluation metrics to measure the performance of attack methods. Then, we propose Q index theoretically as the probability that the terminal node of an edge does not belong to the innermost core, which is further used to guide the design of our heuristic attack methods, namely COREATTACK and GreedyCOREATTACK. The experiments on a variety of real world networks demonstrate that our methods behave much better than a series of baselines, in terms of much smaller Edge Change Rate (ECR) and False Attack Rate (FAR), achieving state of the art attack performance. More impressively, for certain real world networks, only deleting one edge from the k core may lead to the collapse of the innermost core, even if this core contains dozens of nodes. Such a phenomenon indicates that the k core structure could be extremely vulnerable under adversarial attacks, and its robustness thus should be carefully addressed to ensure the security of many graph algorithms.


6D Object Pose Estimation using Keypoints and Part Affinity Fields. The task of 6D object pose estimation from RGB images is an important requirement for autonomous service robots to be able to interact with the real world. In this work, we present a two step pipeline for estimating the 6 DoF translation and orientation of known objects. Keypoints and Part Affinity Fields (PAFs) are predicted from the input image adopting the OpenPose CNN architecture from human pose estimation. Object poses are then calculated from 2D 3D correspondences between detected and model keypoints via the PnP RANSAC algorithm. The proposed approach is evaluated on the YCB Video dataset and achieves accuracy on par with recent methods from the literature. Using PAFs to assemble detected keypoints into object instances proves advantageous over only using heatmaps. Models trained to predict keypoints of a single object class perform significantly better than models trained for several classes.


Extracting Pasture Phenotype and Biomass Percentages using Weakly Supervised Multi target Deep Learning on a Small Dataset. The dairy industry uses clover and grass as fodder for cows. Accurate estimation of grass and clover biomass yield enables smart decisions in optimizing fertilization and seeding density, resulting in increased productivity and positive environmental impact. Grass and clover are usually planted together, since clover is a nitrogen fixing plant that brings nutrients to the soil. Adjusting the right percentages of clover and grass in a field reduces the need for external fertilization. Existing approaches for estimating the grass clover composition of a field are expensive and time consuming random samples of the pasture are clipped and then the components are physically separated to weigh and calculate percentages of dry grass, clover and weeds in each sample. There is growing interest in developing novel deep learning based approaches to non destructively extract pasture phenotype indicators and biomass yield predictions of different plant species from agricultural imagery collected from the field. Providing these indicators and predictions from images alone remains a significant challenge. Heavy occlusions in the dense mixture of grass, clover and weeds make it difficult to estimate each component accurately. Moreover, although supervised deep learning models perform well with large datasets, it is tedious to acquire large and diverse collections of field images with precise ground truth for different biomass yields. In this paper, we demonstrate that applying data augmentation and transfer learning is effective in predicting multi target biomass percentages of different plant species, even with a small training dataset. The scheme proposed in this paper used a training set of only 261 images and provided predictions of biomass percentages of grass, clover, white clover, red clover, and weeds with mean absolute error of 6.77 , 6.92 , 6.21 , 6.89 , and 4.80 respectively.


A route to engineered high aspect ratio silicon nanostructures through regenerative secondary mask lithography. Silicon nanostructuring imparts unique material properties including antireflectivity, antifogging, anti icing, self cleaning, and or antimicrobial activity. To tune these properties however, a good control over features size and shape is essential. Here, a versatile fabrication process is presented to achieve tailored silicon nanostructures (thin thick pillars, sharp truncated re entrant cones), of pitch down to 50 nm, and high aspect ratio ( 10). The approach relies on pre assembled block copolymer (BCP) micelles and their direct transfer into a glass hard mask of an arbitrary thickness, now enabled by our recently reported regenerative secondary mask lithography. During this pattern transfer, not only the mask diameter can be decreased but also uniquely increased constituting the first method to achieve such tunability without necessitating a different molecular weight BCP. Consequently, the hard mask modulation (height, diameter) advances the flexibility in attainable inter pillar spacing, aspect ratios, and re entrant profiles ( glass on silicon). Combined with adjusted silicon etch conditions, the morphology of nanopatterns can be highly customized. The process control and scalability enable uniform patterning of a 6 inch wafer which is verified through cross wafer excellent antireflectivity ( 5 ) and water repellency (advancing contact angle 158 deg hysteresis 1 deg ). It is envisioned the implementation of this approach to silicon nanostructuring to be far reaching, facilitating fundamental studies and targeting applications spanning solar panels, antifogging antibacterial surfaces, sensing, amongst many others.


Analysis of stability and instability for standing waves of the double power one dimensional nonlinear Schr "o dinger equation. For the double power one dimensional nonlinear Schr "o dinger equation, we establish a complete classification of the stability or instability of standing waves with positive frequencies. In particular, we fill out the gaps left open by previous studies. Stability or instability follows from the analysis of the slope criterion of Grillakis, Shatah and Strauss. The main new ingredients in our approach are a reformulation of the slope and the explicit calculation of the slope value in the zero frequency case. Our theoretical results are complemented with numerical experiments.


Tightness of (H, H RW ) Gibbsian line ensembles. We develop a black box theory, which can be used to show that a sequence of Gibbsian line ensembles is tight, provided that the one point marginals of the lowest labeled curves of the ensembles are tight and globally approximate an inverted parabola. Our theory is applicable under certain technical assumptions on the nature of the Gibbs property and the underlying random walk measure. As a particular application of our general framework we show that a certain sequence of Gibbsian line ensembles, which naturally arises in the log gamma polymer, is tight in the ubiquitous KPZ class 1 3 2 3 scaling, and also that all subsequential limits satisfy the Brownian Gibbs property, introduced by Corwin and Hammond in (Invent. Math. 195, 441 508, 2014). One of the core results proved in the paper, which underlies many of our arguments, is the construction of a continuous grand monotone coupling of Gibbsian line ensembles with respect to their boundary data (entrance and exit values, and bounding curves). Continuous means that the Gibbsian line ensemble measure varies continuously as one varies the boundary data, grand means that all uncountably many measures (one for each boundary data) are coupled to the same probability space, and monotone means that raising the values of the boundary data likewise raises the associated measure. Our continuous grand monotone coupling generalizes an analogous construction, which was recently implemented by Barraquand, Corwin and Dimitrov in (arXiv 2101.03045), from line ensembles with a single curve to ones with an arbitrary finite number of curves.


Physical Unclonable Functions using speckle patterns of perfect optical vortices. Encryption techniques demonstrate a great deal of security when implemented in an optical system (such as holography) due to the inherent physical properties of light and the precision it demands. However, such systems have shown to be vulnerable during digital implementations under various crypt analysis attacks. One of the primary reasons for this is the predictable nature of the security keys (i.e., simulated random keys) used in the encryption process. To alleviate, in this work, we are presenting a Physically Unclonable Functions (PUFs) for producing a robust security key for digital encryption systems. To note, a correlation function of the scattered perfect optical vortex (POV) beams is utilized to generate the encryption keys. To the best of our knowledge, this is the first report on properly utilizing the scattered POV in optical encryption system. To validate the generated key, one of the standard optical encryption systems i.e., Double Random Phase Encoding, is opted. Experimental and simulation results validate that the proposed key generation method is an effective alternative to the digital keys.


Argo Scholar Interactive Visual Exploration of Literature in Browsers. Discovering and making sense of relevant research literature is fundamental to becoming knowledgeable in any scientific discipline. Visualization can aid this process however, existing tools' adoption and impact have often been constrained, such as by their reliance on small curated paper datasets that quickly become outdated or a lack of support for personalized exploration. We introduce Argo Scholar, an open source, web based visualization tool for interactive exploration of literature and easy sharing of exploration results. Argo Scholar queries and visualizes Semantic Scholar's live data of almost 200 million papers, enabling users to generate personalized literature exploration results in real time through flexible, incremental exploration, a common and effective method for researchers to discover relevant work. Our tool allows users to easily share their literature exploration results as a URL or web embedded IFrame application. Argo Scholar is open sourced and available at https poloclub.github.io argo scholar .


Neural Architecture Search via Bregman Iterations. We propose a novel strategy for Neural Architecture Search (NAS) based on Bregman iterations. Starting from a sparse neural network our gradient based one shot algorithm gradually adds relevant parameters in an inverse scale space manner. This allows the network to choose the best architecture in the search space which makes it well designed for a given task, e.g., by adding neurons or skip connections. We demonstrate that using our approach one can unveil, for instance, residual autoencoders for denoising, deblurring, and classification tasks. Code is available at https github.com TimRoith BregmanLearning.


Beyond Monocular Deraining Parallel Stereo Deraining Network Via Semantic Prior. Rain is a common natural phenomenon. Taking images in the rain however often results in degraded quality of images, thus compromises the performance of many computer vision systems. Most existing de rain algorithms use only one single input image and aim to recover a clean image. Few work has exploited stereo images. Moreover, even for single image based monocular deraining, many current methods fail to complete the task satisfactorily because they mostly rely on per pixel loss functions and ignore semantic information. In this paper, we present a Paired Rain Removal Network (PRRNet), which exploits both stereo images and semantic information. Specifically, we develop a Semantic Aware Deraining Module (SADM) which solves both tasks of semantic segmentation and deraining of scenes, and a Semantic Fusion Network (SFNet) and a View Fusion Network (VFNet) which fuse semantic information and multi view information respectively. In addition, we also introduce an Enhanced Paired Rain Removal Network (EPRRNet) which exploits semantic prior to remove rain streaks from stereo images. We first use a coarse deraining network to reduce the rain streaks on the input images, and then adopt a pre trained semantic segmentation network to extract semantic features from the coarse derained image. Finally, a parallel stereo deraining network fuses semantic and multi view information to restore finer results. We also propose new stereo based rainy datasets for benchmarking. Experiments on both monocular and the newly proposed stereo rainy datasets demonstrate that the proposed method achieves the state of the art performance.


SINA BERT A pre trained Language Model for Analysis of Medical Texts in Persian. We have released Sina BERT, a language model pre trained on BERT (Devlin et al., 2018) to address the lack of a high quality Persian language model in the medical domain. SINA BERT utilizes pre training on a large scale corpus of medical contents including formal and informal texts collected from a variety of online resources in order to improve the performance on health care related tasks. We employ SINA BERT to complete following representative tasks categorization of medical questions, medical sentiment analysis, and medical question retrieval. For each task, we have developed Persian annotated data sets for training and evaluation and learnt a representation for the data of each task especially complex and long medical questions. With the same architecture being used across tasks, SINA BERT outperforms BERT based models that were previously made available in the Persian language.


No Regret Caching via Online Mirror Descent. We study an online caching problem in which requests can be served by a local cache to avoid retrieval costs from a remote server. The cache can update its state after a batch of requests and store an arbitrarily small fraction of each file. We study no regret algorithms based on Online Mirror Descent (OMD) strategies. We show that the optimal OMD strategy depends on the request diversity present in a batch. We also prove that, when the cache must store the entire file, rather than a fraction, OMD strategies can be coupled with a randomized rounding scheme that preserves regret guarantees.


Full duplex Reflective Beamsteering Metasurface Featuring Magnetless Nonreciprocal Amplification. Nonreciprocal radiation refers to electromagnetic wave radiation in which a structure provides different responses under the change of the direction of the incident field. Modern wireless telecommunication systems demand versatile apparatuses which are capable of full duplex nonreciprocal wave processing and amplification, especially in the reflective state. To realize such a unique, extraordinary and versatile functionality, we propose an architecture in which a chain of series cascaded radiating patches are integrated with nonreciprocal phase shifters, providing an original and efficient apparatus for full duplex reflective beamsteering. Such an ultrathin reflective metasurface can provide directive and diverse radiation beams, large wave amplification, steerable beams by simply changing the bias of the gradient active nonmagnetic nonreciprocal phase shifters, and is immune to undesired time harmonics. Having accomplished all these functionalities in the reflective state, the metasurface represents a conspicuous apparatus for efficient, controllable and programmable wave engineering.


Towards Energy Efficient and Secure Edge AI A Cross Layer Framework. The security and privacy concerns along with the amount of data that is required to be processed on regular basis has pushed processing to the edge of the computing systems. Deploying advanced Neural Networks (NN), such as deep neural networks (DNNs) and spiking neural networks (SNNs), that offer state of the art results on resource constrained edge devices is challenging due to the stringent memory and power energy constraints. Moreover, these systems are required to maintain correct functionality under diverse security and reliability threats. This paper first discusses existing approaches to address energy efficiency, reliability, and security issues at different system layers, i.e., hardware (HW) and software (SW). Afterward, we discuss how to further improve the performance (latency) and the energy efficiency of Edge AI systems through HW SW level optimizations, such as pruning, quantization, and approximation. To address reliability threats (like permanent and transient faults), we highlight cost effective mitigation techniques, like fault aware training and mapping. Moreover, we briefly discuss effective detection and protection techniques to address security threats (like model and data corruption). Towards the end, we discuss how these techniques can be combined in an integrated cross layer framework for realizing robust and energy efficient Edge AI systems.


Interpretable Clustering via Multi Polytope Machines. Clustering is a popular unsupervised learning tool often used to discover groups within a larger population such as customer segments, or patient subtypes. However, despite its use as a tool for subgroup discovery and description few state of the art algorithms provide any rationale or description behind the clusters found. We propose a novel approach for interpretable clustering that both clusters data points and constructs polytopes around the discovered clusters to explain them. Our framework allows for additional constraints on the polytopes including ensuring that the hyperplanes constructing the polytope are axis parallel or sparse with integer coefficients. We formulate the problem of constructing clusters via polytopes as a Mixed Integer Non Linear Program (MINLP). To solve our formulation we propose a two phase approach where we first initialize clusters and polytopes using alternating minimization, and then use coordinate descent to boost clustering performance. We benchmark our approach on a suite of synthetic and real world clustering problems, where our algorithm outperforms state of the art interpretable and non interpretable clustering algorithms.


Equivalent conditions of complete convergence for weighted sums of sequences of i. i. d. random variables under sublinear expectations. The complete convergence for weighted sums of sequences of independent, identically distributed random variables under sublinear expectations space was studied. By moment inequality and truncation methods, we establish the equivalent conditions of complete convergence for weighted sums of sequences of independent, identically distributed random variables under sublinear expectations space. The results extend the corresponding results obtained by Guo (2012) to those for sequences of independent, identically distributed random variables under sublinear expectations space.


Collision Avoidance Maneuver Optimization with a Multiple Impulse Convex Formulation. A method to compute optimal collision avoidance maneuvers for short term encounters is presented. The maneuvers are modeled as multiple impulses to handle impulsive cases and to approximate finite burn arcs associated either with short alert times or the use of low thrust propulsion. The maneuver design is formulated as a sequence of convex optimization problems solved in polynomial time by state of the art primal dual interior point algorithms. The proposed approach calculates optimal solutions without assumptions about the thrust arc structure and thrust direction. The execution time is fraction of a second for an optimization problem with hundreds of variables and constraints, making it suitable for autonomous calculations.


The Feldman Moore, Glimm Effros, and Lusin Novikov theorems over quotients. We establish generalizations of the Feldman Moore theorem, the Glimm Effros dichotomy, and the Lusin Novikov uniformization theorem from Polish spaces to their quotients by Borel orbit equivalence relations.


A stochastic first order trust region method with inexact restoration for finite sum minimization. We propose a stochastic first order trust region method with inexact function and gradient evaluations for solving finite sum minimization problems. At each iteration, the function and the gradient are approximated by sampling. The sample size in gradient approximations is smaller than the sample size in function approximations and the latter is determined using a deterministic rule inspired by the inexact restoration method, which allows the decrease of the sample size at some iterations. The trust region step is then either accepted or rejected using a suitable merit function, which combines the function estimate with a measure of accuracy in the evaluation. We show that the proposed method eventually reaches full precision in evaluating the objective function and we provide a worst case complexity result on the number of iterations required to achieve full precision. We validate the proposed algorithm on nonconvex binary classification problems showing good performance in terms of cost and accuracy and the important feature that a burdensome tuning of the parameters involved is not required.


Fixed points theorems for unsaturated and saturated classes of contractive mappings in Banach spaces. Based on the technique of enriching contractive type mappings, a technique that has been used successfully in some recent papers, we introduce the concept of it saturated class of contractive mappings. We show that, from this perspective, the contractive type mappings in the metric fixed point theory can be separated into two distinct classes, unsaturated and saturated, and that, for any unsaturated class of mappings, the technique of enriching contractive type mappings provides genuine new fixed point results. We illustrate the concept by surveying some significant fixed point results obtained recently for five remarkable unsaturated classes of contractive mappings. In the second part of the paper, we also identify some classes of saturated classes of contractive mappings, whose main feature is that they cannot be enlarged by means of the technique of enriching the contractive mappings.


Methods for segmenting cracks in 3d images of concrete A comparison based on semi synthetic images. Concrete is the standard construction material for buildings, bridges, and roads. As safety plays a central role in the design, monitoring, and maintenance of such constructions, it is important to understand the cracking behavior of concrete. Computed tomography captures the microstructure of building materials and allows to study crack initiation and propagation. Manual segmentation of crack surfaces in large 3d images is not feasible. In this paper, automatic crack segmentation methods for 3d images are reviewed and compared. Classical image processing methods (edge detection filters, template matching, minimal path and region growing algorithms) and learning methods (convolutional neural networks, random forests) are considered and tested on semi synthetic 3d images. Their performance strongly depends on parameter selection which should be adapted to the grayvalue distribution of the images and the geometric properties of the concrete. In general, the learning methods perform best, in particular for thin cracks and low grayvalue contrast.


Finding faults A scoping study of fault diagnostics for Industrial Cyber Physical Systems. Context As Industrial Cyber Physical Systems (ICPS) become more connected and widely distributed, often operating in safety critical environments, we require innovative approaches to detect and diagnose the faults that occur in them. Objective We profile fault identification and diagnosis techniques employed in the aerospace, automotive, and industrial control domains. By examining both theoretical presentations as well as case studies from production environments, we present a profile of the current approaches being employed and identify gaps. Methodology A scoping study was used to identify and compare fault detection and diagnosis methodologies that are presented in the current literature. Results Fault identification and analysis studies from 127 papers published from 2004 to 2019 reveal a wide diversity of promising techniques, both emerging and in use. These range from traditional Physics based Models to Data Driven Artificial Intelligence (AI) and Knowledge Based approaches. Predictive diagnostics or prognostics featured prominently across all sectors, along with discussions of techniques including Fault trees, Petri nets and Markov approaches. We also profile some of the techniques that have reached the highest Technology Readiness Levels, showing how those methods are being applied in real world environments beyond the laboratory. Conclusions Our results suggest that the continuing wide use of both Model Based and Data Driven AI techniques across all domains, especially when they are used together in hybrid configuration, reflects the complexity of the current ICPS application space. While creating sufficiently complete models is labor intensive, Model free AI techniques were evidenced as a viable way of addressing aspects of this challenge, demonstrating the increasing sophistication of current machine learning systems.(Abridged)


Bijection between Increasing Binary Trees and Rook Placements on Double Staircases. In this paper, we shall construct a bijection between rook placements on double staircases (introduced by Josuat Verg es in 2017) and increasing binary trees. We introduce two subclasses of rook placements on double staircases, which we call left and right aligned rook placements. We show that their enumeration, while keeping track of a certain statistic, gives the gamma vectors of the Eulerian polynomials. We conclude with a discussion on a different bijection that fits in very well with our main bijection, and another discussion on generalising our main bijection. Our main bijection is a special case of a bijection due to Tewari (2019).


Heterogeneous Data Fusion Considering Spatial Correlations using Graph Convolutional Networks and its Application in Air Quality Prediction. Heterogeneous data are commonly adopted as the inputs for some models that predict the future trends of some observations. Existing predictive models typically ignore the inconsistencies and imperfections in heterogeneous data while also failing to consider the (1) spatial correlations among monitoring points or (2) predictions for the entire study area. To address the above problems, this paper proposes a deep learning method for fusing heterogeneous data collected from multiple monitoring points using graph convolutional networks (GCNs) to predict the future trends of some observations and evaluates its effectiveness by applying it in an air quality predictions scenario. The essential idea behind the proposed method is to (1) fuse the collected heterogeneous data based on the locations of the monitoring points with regard to their spatial correlations and (2) perform prediction based on global information rather than local information. In the proposed method, first, we assemble a fusion matrix using the proposed RBF based fusion approach second, based on the fused data, we construct spatially and temporally correlated data as inputs for the predictive model finally, we employ the spatiotemporal graph convolutional network (STGCN) to predict the future trends of some observations. In the application scenario of air quality prediction, it is observed that (1) the fused data derived from the RBF based fusion approach achieve satisfactory consistency (2) the performances of the prediction models based on fused data are better than those based on raw data and (3) the STGCN model achieves the best performance when compared to those of all baseline models. The proposed method is applicable for similar scenarios where continuous heterogeneous data are collected from multiple monitoring points scattered across a study area.


Uniform Roe algebras of uniformly locally finite metric spaces are rigid. We show that if X and Y are uniformly locally finite metric spaces whose uniform Roe algebras, mathrm C u(X) and mathrm C u(Y) , are isomorphic as mathrm C algebras, then X and Y are coarsely equivalent metric spaces. Moreover, we show that coarse equivalence between X and Y is equivalent to Morita equivalence between mathrm C u(X) and mathrm C u(Y) . As an application, we obtain that if Gamma and Lambda are finitely generated groups, then the crossed products ell infty( Gamma) rtimes r Gamma and ell infty( Lambda) rtimes r Lambda are isomorphic if and only if Gamma and Lambda are bi Lipshitz equivalent.


Knots in S g times S 1 and winding parities. A virtual knot, which is one of generalizations of knots in mathbb R 3 (or S 3 ), is, roughly speaking, an embedded circle in thickened surface S g times I . In this paper we will discuss about knots in 3 dimensional S g times S 1 . We introduce basic notions for knots in S g times S 1 , for example, diagrams, moves for diagrams and so on. For knots in S g times S 1 technically we lose over under information, but we have information "how many times a half of the crossing of the knot in S g times S 1 rotates along S 1 ", we call it labels of crossings. In the end of the present paper we extend this notion more generally and discuss its geometrical meaning. This paper follows from cite Kim .


Manifold Interpolation for Large Scale Multi Objective Optimization via Generative Adversarial Networks. Large scale multiobjective optimization problems (LSMOPs) are characterized as involving hundreds or even thousands of decision variables and multiple conflicting objectives. An excellent algorithm for solving LSMOPs should find Pareto optimal solutions with diversity and escape from local optima in the large scale search space. Previous research has shown that these optimal solutions are uniformly distributed on the manifold structure in the low dimensional space. However, traditional evolutionary algorithms for solving LSMOPs have some deficiencies in dealing with this structural manifold, resulting in poor diversity, local optima, and inefficient searches. In this work, a generative adversarial network (GAN) based manifold interpolation framework is proposed to learn the manifold and generate high quality solutions on this manifold, thereby improving the performance of evolutionary algorithms. We compare the proposed algorithm with several state of the art algorithms on large scale multiobjective benchmark functions. Experimental results have demonstrated the significant improvements achieved by this framework in solving LSMOPs.


Potential Applications of Artificial Intelligence and Machine Learning in Radiochemistry and Radiochemical Engineering. Artificial intelligence and machine learning are poised to disrupt PET imaging from bench to clinic. In this perspective we offer insights into how the technology could be applied to improve the design and synthesis of new radiopharmaceuticals for PET imaging, including identification of an optimal labeling approach as well as strategies for radiolabeling reaction optimization.


Long Document Summarization in a Low Resource Setting using Pretrained Language Models. Abstractive summarization is the task of compressing a long document into a coherent short document while retaining salient information. Modern abstractive summarization methods are based on deep neural networks which often require large training datasets. Since collecting summarization datasets is an expensive and time consuming task, practical industrial settings are usually low resource. In this paper, we study a challenging low resource setting of summarizing long legal briefs with an average source document length of 4268 words and only 120 available (document, summary) pairs. To account for data scarcity, we used a modern pretrained abstractive summarizer BART (Lewis et al., 2020), which only achieves 17.9 ROUGE L as it struggles with long documents. We thus attempt to compress these long documents by identifying salient sentences in the source which best ground the summary, using a novel algorithm based on GPT 2 (Radford et al., 2019) language model perplexity scores, that operates within the low resource regime. On feeding the compressed documents to BART, we observe a 6.0 ROUGE L improvement. Our method also beats several competitive salience detection baselines. Furthermore, the identified salient sentences tend to agree with an independent human labeling by domain experts.


Industry 4.0 and Prospects of Circular Economy A Survey of Robotic Assembly and Disassembly. Despite their contributions to the financial efficiency and environmental sustainability of industrial processes, robotic assembly and disassembly have been understudied in the existing literature. This is in contradiction to their importance in realizing the Fourth Industrial Revolution. More specifically, although most of the literature has extensively discussed how to optimally assemble or disassemble given products, the role of other factors has been overlooked. For example, the types of robots involved in implementing the sequence plans, which should ideally be taken into account throughout the whole chain consisting of design, assembly, disassembly and reassembly. Isolating the foregoing operations from the rest of the components of the relevant ecosystems may lead to erroneous inferences toward both the necessity and efficiency of the underlying procedures. In this paper we try to alleviate these shortcomings by comprehensively investigating the state of the art in robotic assembly and disassembly. We consider and review various aspects of manufacturing and remanufacturing frameworks while particularly focusing on their desirability for supporting a circular economy.


Entropy of irregular points that are not uniformly hyperbolic. In this article we prove that for a C 1 alpha diffeomorphism on a compact Riemannian manifold, if there is a hyperbolic ergodic measure whose support is not uniformly hyperbolic, then the topological entropy of the set of irregular points that are not uniformly hyperbolic is larger than or equal to the metric entropy of the hyperbolic ergodic measure. In the process of proof, we give an abstract general mechanism to study topological entropy of irregular points provided that the system has a sequence of nondecreasing invariant compact subsets such that every subsystem has shadowing property and is transitive.


Strongly scale invariant virtually polycyclic groups. A finitely generated group Gamma is called strongly scale invariant if there exists an injective endomorphism varphi Gamma to Gamma with the image varphi( Gamma) of finite index in Gamma and the subgroup displaystyle bigcap n 0 varphi n( Gamma) finite. The only known examples of such groups are virtually nilpotent, or equivalently, all examples have polynomial growth. A question by Nekrashevych and Pete asks whether these groups are the only possibilities for such endomorphisms, motivated by the positive answer due to Gromov in the special case of expanding group morphisms. In this paper, we study this question for the class of virtually polycyclic groups, i.e. the virtually solvable groups for which every subgroup is finitely generated. Using the mathbb Q algebraic hull, which allows us to extend the injective endomorphisms of certain virtually polycyclic groups to a linear algebraic group, we show that the existence of such an endomorphism implies that the group is virtually nilpotent. Moreover, we fully characterize which virtually nilpotent groups have a morphism satisfying the condition above, related to the existence of a positive grading on the corresponding radicable nilpotent group. As another application of the methods, we generalize a result of Fel'shtyn and Lee about which maps on infra solvmanifolds can have finite Reidemeister number for all iterates.


Model Adaptation Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Data. Unsupervised domain adaptation aims to align a labeled source domain and an unlabeled target domain, but it requires to access the source data which often raises concerns in data privacy, data portability and data transmission efficiency. We study unsupervised model adaptation (UMA), or called Unsupervised Domain Adaptation without Source Data, an alternative setting that aims to adapt source trained models towards target distributions without accessing source data. To this end, we design an innovative historical contrastive learning (HCL) technique that exploits historical source hypothesis to make up for the absence of source data in UMA. HCL addresses the UMA challenge from two perspectives. First, it introduces historical contrastive instance discrimination (HCID) that learns from target samples by contrasting their embeddings which are generated by the currently adapted model and the historical models. With the historical models, HCID encourages UMA to learn instance discriminative target representations while preserving the source hypothesis. Second, it introduces historical contrastive category discrimination (HCCD) that pseudo labels target samples to learn category discriminative target representations. Specifically, HCCD re weights pseudo labels according to their prediction consistency across the current and historical models. Extensive experiments show that HCL outperforms and state of the art methods consistently across a variety of visual tasks and setups.


A Batched GPU Methodology for Numerical Solutions of Partial Differential Equations. In this paper we present a methodology for data accesses when solving batches of Tridiagonal and Pentadiagonal matrices that all share the same left hand side (LHS) matrix. The intended application is to the numerical solution of Partial Differential Equations via the finite difference method, although the methodology is applicable more broadly. By only storing one copy of this matrix, a significant reduction in storage overheads is obtained, together with a corresponding decrease in compute time. Taken together, these two performance enhancements lead to an overall more efficient implementation over the current state of the art algorithms cuThomasBatch and cuPentBatch, allowing for a greater number of systems to be solved on a single GPU. We demonstrate the methodology in the case of the Diffusion Equation, Hyperdiffusion Equation, and the Cahn Hilliard Equation, all in one spatial dimension. In this last example, we demonstrate how the method can be used to perform 2 20 independent simulations of phase separation in one dimension. In this way, we build up a robust statistical description of the coarsening phenomenon which is the defining behavior of phase separation. We anticipate that the method will be of further use in other similar contexts requiring statistical simulation of physical systems.


UniNet A Unified Scene Understanding Network and Exploring Multi Task Relationships through the Lens of Adversarial Attacks. Scene understanding is crucial for autonomous systems which intend to operate in the real world. Single task vision networks extract information only based on some aspects of the scene. In multi task learning (MTL), on the other hand, these single tasks are jointly learned, thereby providing an opportunity for tasks to share information and obtain a more comprehensive understanding. To this end, we develop UniNet, a unified scene understanding network that accurately and efficiently infers vital vision tasks including object detection, semantic segmentation, instance segmentation, monocular depth estimation, and monocular instance depth prediction. As these tasks look at different semantic and geometric information, they can either complement or conflict with each other. Therefore, understanding inter task relationships can provide useful cues to enable complementary information sharing. We evaluate the task relationships in UniNet through the lens of adversarial attacks based on the notion that they can exploit learned biases and task interactions in the neural network. Extensive experiments on the Cityscapes dataset, using untargeted and targeted attacks reveal that semantic tasks strongly interact amongst themselves, and the same holds for geometric tasks. Additionally, we show that the relationship between semantic and geometric tasks is asymmetric and their interaction becomes weaker as we move towards higher level representations.


Automatic Recognition of Abdominal Organs in Ultrasound Images based on Deep Neural Networks and K Nearest Neighbor Classification. Abdominal ultrasound imaging has been widely used to assist in the diagnosis and treatment of various abdominal organs. In order to shorten the examination time and reduce the cognitive burden on the sonographers, we present a classification method that combines the deep learning techniques and k Nearest Neighbor (k NN) classification to automatically recognize various abdominal organs in the ultrasound images in real time. Fine tuned deep neural networks are used in combination with PCA dimension reduction to extract high level features from raw ultrasound images, and a k NN classifier is employed to predict the abdominal organ in the image. We demonstrate the effectiveness of our method in the task of ultrasound image classification to automatically recognize six abdominal organs. A comprehensive comparison of different configurations is conducted to study the influence of different feature extractors and classifiers on the classification accuracy. Both quantitative and qualitative results show that with minimal training effort, our method can "lazily" recognize the abdominal organs in the ultrasound images in real time with an accuracy of 96.67 . Our implementation code is publicly available at https github.com LeeKeyu abdominal ultrasound classification.


Structure theorem for projective klt pairs with nef anti canonical divisor. In this paper, we establish a structure theorem for projective klt pairs (X, Delta) with nef anti log canonical divisor specifically, we prove that, up to replacing X with a finite quasi 'etale cover, X admits a locally trivial rationally connected fibration onto a projective klt variety with numerically trivial canonical divisor. This structure theorem generalizes previous works for smooth projective varieties and reduces several structure problems to the singular Beauville Bogomolov decomposition for Calabi Yau varieties. As an application, projective varieties of klt Calabi Yau type, which naturally appear as an outcome of the Log Minimal Model Program, are decomposed into building block varieties rationally connected varieties and Calabi Yau varieties.


On a polynomial positivity question of Collins, Dykema, and Torres Ayala related to the Bessis Moussa Villani Conjecture. We construct sum of squares certificates of non negativity for two families of polynomials appearing as a variant by Collins, Dykema, and Torres Ayala to H "aegele's reformulation of a conjecture by Bessis, Moussa, and Villani.


White paper The Helix Pathogenicity Prediction Platform. In this white paper we introduce Helix, an AI based solution for missense pathogenicity prediction. With recent advances in the sequencing of human genomes, massive amounts of genetic data have become available. This has shifted the burden of labor for genetic diagnostics and research from the gathering of data to its interpretation. Helix presents a state of the art platform for the prediction of pathogenicity in human missense variants. In addition to offering best in class predictive performance, Helix offers a platform that allows researchers to analyze and interpret variants in depth that can be accessed at helixlabs.ai.


Coprime Mappings and Lonely Runners. For x real, let x be the fractional part of x (i.e. x x lfloor x rfloor ). The lonely runner conjecture can be stated as follows for any n positive integers v 1 v 2 dots v n there exists a real number t such that 1 (n 1) le v i t le n (n 1) for i 1, dots, n . In this paper we prove that if epsilon 0 and n is sufficiently large (relative to epsilon ) then such a t exists for any collection of positive integers v 1 v 2 dots v n such that v n (2 epsilon)n . This is an approximate version of a natural next step for the study of the lonely runner conjecture suggested by Tao. The key ingredient in our proof is a result on coprime mappings. Let A and B be sets of integers. A bijection f A to B is a coprime mapping if a and f(a) are coprime for every a in A . We show that if A,B subset n are intervals of length 2m where m e Omega( ( log log n) 2) then there exists a coprime mapping from A to B . We do not believe that this result is sharp.


Toroidal compactifications and Borel Serre compactifications. We discuss connections of toroidal compactifications and Borel Serre compactifications in view of the fundamental diagram of extended period domains. We give a complement to a work of Goresky Tai.


Talbot effect for the Schr "odinger equation. We study fractal properties of the solution to the periodic Schr "odinger equation with singular potentials and bounded variation initial data. The solution turns out to have fractal behavior at irrational times, whereas it resembles the initial data in regularity at rational times. This extends the results of Oskolkov cite O and Rodnianski cite R2 on the free Schr "odinger equation to general cases having potentials. For the purpose, we employ the Bourgain space and obtain smoothing estimates for the Duhamel part involving singular potentials.


Reciprocal Feature Learning via Explicit and Implicit Tasks in Scene Text Recognition. Text recognition is a popular topic for its broad applications. In this work, we excavate the implicit task, character counting within the traditional text recognition, without additional labor annotation cost. The implicit task plays as an auxiliary branch for complementing the sequential recognition. We design a two branch reciprocal feature learning framework in order to adequately utilize the features from both the tasks. Through exploiting the complementary effect between explicit and implicit tasks, the feature is reliably enhanced. Extensive experiments on 7 benchmarks show the advantages of the proposed methods in both text recognition and the new built character counting tasks. In addition, it is convenient yet effective to equip with variable networks and tasks. We offer abundant ablation studies, generalizing experiments with deeper understanding on the tasks. Code is available.


Conductance and Social Capital Modeling and Empirically Measuring Online Social Influence. Social influence pervades our everyday lives and lays the foundation for complex social phenomena. In a crisis like the COVID 19 pandemic, social influence can determine whether life saving information is adopted. Existing literature studying online social influence suffers from several drawbacks. First, a disconnect appears between psychology approaches, which are generally performed and tested in controlled lab experiments, and the quantitative methods, which are usually data driven and rely on network and event analysis. The former are slow, expensive to deploy, and typically do not generalize well to topical issues (such as an ongoing pandemic) the latter often oversimplify the complexities of social influence and ignore psychosocial literature. This work bridges this gap and presents three contributions towards modeling and empirically quantifying online influence. The first contribution is a data driven Generalized Influence Model that incorporates two novel psychosocial inspired mechanisms the conductance of the diffusion network and the social capital distribution. The second contribution is a framework to empirically rank users' social influence using a human in the loop active learning method combined with crowdsourced pairwise influence comparisons. We build a human labeled ground truth, calibrate our generalized influence model and perform a large scale evaluation of influence. We find that our generalized model outperforms the current state of the art approaches and corrects the inherent biases introduced by the widely used follower count. As the third contribution, we apply the influence model to discussions around COVID 19. We quantify users' influence, and we tabulate it against their professions. We find that the executives, media, and military are more influential than pandemic related experts such as life scientists and healthcare professionals.


Combinatorial approach to spreading processes on networks. Stochastic spreading models defined on complex network topologies are used to mimic the diffusion of diseases, information, and opinions in real world systems. Existing theoretical approaches to the characterization of the models in terms of microscopic configurations rely on some approximation of independence among dynamical variables, thus introducing a systematic bias in the prediction of the ground truth dynamics. Here, we develop a combinatorial framework based on the approximation that spreading may occur only along the shortest paths connecting pairs of nodes. The approximation overestimates dynamical correlations among node states and leads to biased predictions. Systematic bias is, however, pointing in the opposite direction of existing approximations. We show that the combination of the two biased approaches generates predictions of the ground truth dynamics that are more accurate than the ones given by the two approximations if used in isolation. We further take advantage of the combinatorial approximation to characterize theoretical properties of some inference problems, and show that the reconstruction of microscopic configurations is very sensitive to both the place where and the time when partial knowledge of the system is acquired.


p adic quotient sets Cubic forms. For A subseteq 1, 2, ldots , we consider R(A) a b a, b in A . It is an open problem to study the denseness of R(A) in the p adic numbers when A is the set of nonzero values assumed by a cubic form. We study this problem for the cubic forms ax 3 by 3 , where a and b are integers. We also prove that if A is the set of nonzero values assumed by a non degenerate, integral and primitive cubic form with more than 9 variables, then R(A) is dense in mathbb Q p .


Ultra fast GHz range swept tuned spectrum analyzer with 20 ns temporal resolution based on a spin torque nano oscillator with a uniformly magnetized 'free' layer. The advantage of an ultra fast frequency tunability of spin torque nano oscillators (STNOs) that have large ( 100MHz) relaxation frequency of amplitude fluctuations is exploited to realize ultra fast wide band time resolved spectral analysis at nanosecond time scale with the frequency resolution limited only by the 'bandwidth' theorem. The demonstration is performed with an STNO generating in the 9 GHz frequency range, and comprised of a perpendicular polarizer and a perpendicularly and uniformly magnetized 'free' layer. It is shown that such a uniform state STNO based spectrum analyzer can efficiently perform spectral analysis of frequency agile signals with rapidly varying frequency components.


On the Noise Stability and Robustness of Adversarially Trained Networks on NVM Crossbars. Applications based on Deep Neural Networks (DNNs) have grown exponentially in the past decade. To match their increasing computational needs, several Non Volatile Memory (NVM) crossbar based accelerators have been proposed. Apart from improved energy efficiency and performance, these approximate hardware also possess intrinsic robustness for defense against Adversarial Attacks, which is an important security concern for DNNs. Prior works have focused on quantifying this intrinsic robustness for vanilla networks, that is DNNs trained on unperturbed inputs. However, adversarial training of DNNs is the benchmark technique for robustness, and sole reliance on intrinsic robustness of the hardware may not be sufficient. In this work, we explore the design of robust DNNs through the amalgamation of adversarial training and the intrinsic robustness offered by NVM crossbar based analog hardware. First, we study the noise stability of such networks on unperturbed inputs and observe that internal activations of adversarially trained networks have lower Signal to Noise Ratio (SNR), and are sensitive to noise than vanilla networks. As a result, they suffer significantly higher performance degradation due to the non ideal computations on an average 2x accuracy drop. On the other hand, for adversarial images generated using Projected Gradient Descent (PGD) White Box attacks, ResNet 10 20 adversarially trained on CIFAR 10 100 display a 5 10 gain in robust accuracy due to the underlying NVM crossbar when the attack epsilon ( epsilon attack , the degree of input perturbations) is greater than the epsilon of the adversarial training ( epsilon train ). Our results indicate that implementing adversarially trained networks on analog hardware requires careful calibration between hardware non idealities and epsilon train to achieve optimum robustness and performance.


Collaborative Semantic Aggregation and Calibration for Separated Domain Generalization. Domain generalization (DG) aims to learn from multiple known source domains a model that can generalize well to unknown target domains. The existing DG methods usually exploit the fusion of shared multi source data for capturing domain invariance and training a generalizable model. However, tremendous data is distributed across lots of places nowadays that can not be shared due to strict privacy policies. A dilemma is thus raised between the generalization learning with shared multi source data and the privacy protection of real world sensitive data. In this paper, we introduce a separated domain generalization task with separated source datasets that can only be accessed locally for data privacy protection. We propose a novel solution called Collaborative Semantic Aggregation and Calibration (CSAC) to enable this challenging task. To fully absorb multi source semantic information while avoiding unsafe data fusion, we conduct data free semantic aggregation by fusing the models trained on the separated domains layer by layer. To address the semantic dislocation problem caused by domain shift, we further design cross layer semantic calibration with an elaborate attention mechanism to align each semantic level and enhance domain invariance. We unify multi source semantic learning and alignment in a collaborative way by repeating the semantic aggregation and calibration alternately, keeping each dataset localized, and the data privacy is thus carefully protected. Extensive experiments show the significant performance of our method in addressing this challenging task, which is even comparable to the previous DG methods with shared source data.


A generalization of Esteves Homma's example of tangentially degenerate curves. This paper presents a method of a construction of tangentially degenerate curves with a birational Gauss map, focusing on the non classicality of automorphisms. This method describes a generalization of Esteves Homma's example of this kind. In addition, this paper presents a smooth projective curve with a birational Gauss map such that a general tangent line contains three or more points of the curve, which answers a question raised by Kaji in the affirmative.


On Homotopy of Walks and Spherical Maps in Homotopy Type Theory. We work with combinatorial maps to represent graph embeddings into surfaces up to isotopy. The surface in which the graph is embedded is left implicit in this approach. The constructions herein are proof relevant and stated with a subset of the language of homotopy type theory. This article presents a refinement of one characterisation of embeddings in the sphere, called spherical maps, of connected and directed multigraphs with discrete node sets. A combinatorial notion of homotopy for walks and the normal form of walks under a reduction relation is introduced. The first characterisation of spherical maps states that a graph can be embedded in the sphere if any pair of walks with the same endpoints are merely walk homotopic. The refinement of this definition filters out any walk with inner cycles. As we prove in one of the lemmas, if a spherical map is given for a graph with a discrete node set, then any walk in the graph is merely walk homotopic to a normal form. The proof assistant Agda contributed to formalising the results recorded in this article.


Arena Independent Finite Memory Determinacy in Stochastic Games. We study stochastic zero sum games on graphs, which are prevalent tools to model decision making in presence of an antagonistic opponent in a random environment. In this setting, an important question is the one of strategy complexity what kinds of strategies are sufficient or required to play optimally (e.g., randomization or memory requirements)? Our contributions further the understanding of arena independent finite memory (AIFM) determinacy, i.e., the study of objectives for which memory is needed, but in a way that only depends on limited parameters of the game graphs. First, we show that objectives for which pure AIFM strategies suffice to play optimally also admit pure AIFM subgame perfect strategies. Second, we show that we can reduce the study of objectives for which pure AIFM strategies suffice in two player stochastic games to the easier study of one player stochastic games (i.e., Markov decision processes). Third, we characterize the sufficiency of AIFM strategies through two intuitive properties of objectives. This work extends a line of research started on deterministic games to stochastic ones.


Kudu An Efficient and Scalable Distributed Graph Pattern Mining Engine. This paper proposes Kudu, a general distributed execution engine with a well defined abstraction that can be integrated with various existing single machine graph pattern mining (GPM) systems. With this approach, the programming interfaces and codes based on existing GPM systems do not change and Kudu can transparently enable the distributed execution. The key novelty is extendable embedding which can express pattern enumeration algorithm and enable fine grained task scheduling. To enable efficient scheduling, we propose a novel BFS DFS hybrid exploration method that generates sufficient concurrent tasks without incurring high memory consumption. The computation and communication of Kudu can be further optimized with several effective techniques. We implemented two scalable distributed GPM systems by porting Automine and GraphPi on Kudu. Our evaluation shows that Kudu based systems significantly outperform state of the art graph partition based GPM systems by up to three orders of magnitude, achieve similar or even better performance compared with the fastest graph replication based systems, and scale to large datasets with graph partitioning.


On equivariant index of a generalized Bott manifold. In this paper, we consider the equivariant index of a generalized Bott manifold. We show the multiplicity function of the equivariant index is given by the density function of a generalized twisted cube. In addition, we give a Demazure type character formula of this representation.


On the Broadcast Independence Number of Circulant Graphs. An independent broadcast on a graph G is a function f V longrightarrow 0, ldots, rm diam (G) such that (i) f(v) leq e(v) for every vertex v in V(G) , where operatorname diam (G) denotes the diameter of G and e(v) the eccentricity of vertex v , and (ii) d(u,v) max f(u), f(v) for every two distinct vertices u and v with f(u)f(v) 0 . The broadcast independence number beta b(G) of G is then the maximum value of sum v in V f(v) , taken over all independent broadcasts on G . We prove that every circulant graph of the form C(n 1,a) , 3 le a le lfloor frac n 2 rfloor , admits an optimal 2 bounded independent broadcast, that is, an independent broadcast f satisfying f(v) le 2 for every vertex v , except when n 2a 1 , or n 2a and a is even. We then determine the broadcast independence number of various classes of such circulant graphs, and prove that, for most of these classes, the equality beta b(C(n 1,a)) alpha(C(n 1,a)) holds, where alpha(C(n 1,a)) denotes the independence number of C(n 1,a) .


Classification of COVID 19 anomalous diffusion driven by mean squared displacement. In this study, we classify the COVID 19 anomalous diffusion in two categories of countries based on the mean squared displacement (MSD) of daily new cases, which includes the top four countries and four randomly selected countries in terms of the total cases. The COVID 19 diffusion is a stochastic process, and the daily new cases are regarded as the displacements of diffusive particles. The diffusion environment of COVID 19 in each country is heterogeneous, in which the underlying dynamic process is anomalous diffusion. The calculated MSD is a power law function of time, and the power law exponent is not a constant but varies with time. The power law exponents are estimated by using the bi exponential model and the long short term memory network (LSTM). The bi exponential model frequently use in magnetic resonance imaging (MRI) can quantify the power law exponent and make an easy prediction. The LSTM network has much better accuracy than the bi exponential model in predicting the power law exponent. The LSTM network is more flexible and preferred to predict the power law exponent, which is independent on the unique mathematical formula. The diffusion process of COVID 19 can be classified based on the power law exponent. More specific evaluation and suggestion can be proposed and submitted to the government in order to control the COVID 19 diffusion.


PPFL Privacy preserving Federated Learning with Trusted Execution Environments. We propose and implement a Privacy preserving Federated Learning ( PPFL ) framework for mobile systems to limit privacy leakages in federated learning. Leveraging the widespread presence of Trusted Execution Environments (TEEs) in high end and mobile devices, we utilize TEEs on clients for local training, and on servers for secure aggregation, so that model gradient updates are hidden from adversaries. Challenged by the limited memory size of current TEEs, we leverage greedy layer wise training to train each model's layer inside the trusted area until its convergence. The performance evaluation of our implementation shows that PPFL can significantly improve privacy while incurring small system overheads at the client side. In particular, PPFL can successfully defend the trained model against data reconstruction, property inference, and membership inference attacks. Furthermore, it can achieve comparable model utility with fewer communication rounds (0.54 times ) and a similar amount of network traffic (1.002 times ) compared to the standard federated learning of a complete model. This is achieved while only introducing up to 15 CPU time, 18 memory usage, and 21 energy consumption overhead in PPFL 's client side.


A Color Image Steganography Based on Frequency Sub band Selection. Color image steganography based on deep learning is the art of hiding information in the color image. Among them, image hiding steganography(hiding image with image) has attracted much attention in recent years because of its great steganographic capacity. However, images generated by image hiding steganography may show some obvious color distortion or artificial texture traces. We propose a color image steganographic model based on frequency sub band selection to solve the above problems. Firstly, we discuss the relationship between the characteristics of different color spaces frequency sub bands and the generated image quality. Then, we select the B channel of the RGB image as the embedding channel and the high frequency sub band as the embedding domain. DWT(discrete wavelet transformation) transforms B channel information and secret gray image into frequency domain information, and then the secret image is embedded and extracted in the frequency domain. Comprehensive experiments demonstrate that images generated by our model have better image quality, and the imperceptibility is significantly increased.


Printed tapered leaky wave antennas for W band frequencies. Despite their great potential in communication and sensing applications, printed leaky wave antennas have rarely been reported at mm wave frequencies. In this paper, tapered leaky wave antennas operating at 80 GHz are designed, fabricated and experimentally characterized. While most continuous leaky wave antennas use subwavelength strips or other comparably small elements, in this work, the surface impedance is discretized very coarsely using only three square patches per period. With this architecture, a wide range of surface reactance can be achieved while maintaining a minimum feature size of the metallic pattern that is feasible for printed circuit fabrication. As the analytical solution for the bandstructure of sinusoidally modulated reactance surfaces is inaccurate for coarse discretization, we find it using full wave simulation. In order to control side lobes effectively, we use a tapered aperture illumination according to the Taylor one parameter distribution. A comprehensive experimental demonstration is presented, including near field and far field measurements. Therewith, we verify the designed aperture illumination and we reveal the origin of spurious far field features. Side lobes are effectively suppressed and spurious radiation is reduced to 18 dB compared to the main lobe.


Using Relative Lines of Code to Guide Automated Test Generation for Python. Raw lines of code (LOC) is a metric that does not, at first glance, seem extremely useful for automated test generation. It is both highly language dependent and not extremely meaningful, semantically, within a language one coder can produce the same effect with many fewer lines than another. However, relative LOC, between components of the same project, turns out to be a highly useful metric for automated testing. In this paper, we make use of a heuristic based on LOC counts for tested functions to dramatically improve the effectiveness of automated test generation. This approach is particularly valuable in languages where collecting code coverage data to guide testing has a very high overhead.We apply the heuristic to property based Python testing using the TSTL (Template Scripting Testing Language) tool. In our experiments, the simple LOC heuristic can improve branch and statement coverage by large margins (often more than 20 , up to 40 or more), and improve fault detection by an even larger margin (usually more than 75 , and up to 400 or more). The LOC heuristic is also easy to combine with other approaches, and is comparable to, and possibly more effective than, two well established approaches for guiding random testing.


Characterizations of Matrix Valued Asymmetric Truncated Toeplitz Operators. Matrix valued asymmetric truncated Toeplitz operators are compressions of multiplication operators acting between two possibly different model spaces. In this paper, we characterize matrix valued asymmetric truncated Toeplitz operators by using compressed shifts.


NATURE Natural Auxiliary Text Utterances for Realistic Spoken Language Evaluation. Slot filling and intent detection are the backbone of conversational agents such as voice assistants, and are active areas of research. Even though state of the art techniques on publicly available benchmarks show impressive performance, their ability to generalize to realistic scenarios is yet to be demonstrated. In this work, we present NATURE, a set of simple spoken language oriented transformations, applied to the evaluation set of datasets, to introduce human spoken language variations while preserving the semantics of an utterance. We apply NATURE to common slot filling and intent detection benchmarks and demonstrate that simple perturbations from the standard evaluation set by NATURE can deteriorate model performance significantly. Through our experiments we demonstrate that when NATURE operators are applied to evaluation set of popular benchmarks the model accuracy can drop by up to 40 .


Timing and energy stability of resonant dispersive wave emission in gas filled hollow core waveguides. We numerically investigate the energy and arrival time noise of ultrashort laser pulses produced via resonant dispersive wave emission in gas filled hollow core waveguides under the influence of pump laser instability. We find that for low pump energy, fluctuations in the pump energy are strongly amplified. However, when the generation process is saturated, the energy of the resonant dispersive wave can be significantly less noisy than that of the pump pulse. This holds for a variety of generation conditions and while still producing few femtosecond pulses. We further find that the arrival time jitter of the generated pulse remains well below one femtosecond even for a conservative estimate of the pump pulse energy noise, and that photoionisation and plasma dynamics can lead to exceptional stability for some generation conditions. By applying our analysis to a scaled down system, we demonstrate that our results hold for frequency conversion schemes based on both small core microstructured fibre and large core hollow capillary fibre.


The Cassels Tate pairing for finite Galois modules. Given a global field F with absolute Galois group G F , we define a category SMod F whose objects are finite G F modules decorated with local conditions. We define this category so that taking the Selmer group' defines a functor Sel from SMod F to Ab . After defining a duality functor vee on SMod F , we show that every short exact sequence 0 to M 1 to M to M 2 to 0 in SMod F gives rise to a natural bilinear pairing Sel (M 2) times Sel (M 1 vee ) to mathbb Q mathbb Z whose left and right kernels are the images of Sel (M) and Sel (M vee ) , respectively. This construction generalizes the Cassels Tate pairing defined on Shafarevich Tate groups of abelian varieties over global fields. Our main results generalize the fact that the classical pairing is antisymmetric for principally polarized abelian varieties but, by work of Poonen and Stoll, not necessarily alternating. We can express many previously defined class field theoretic pairings as instances of this construction, giving the study of these pairings access to our general results for SMod F . As one application, we reprove and extend recent results about the class groups of number fields containing many roots of unity.


Network structure and disease risk for an endemic infectious disease. The structure of contact networks affects the likelihood of disease spread at the population scale and the risk of infection at any given node. Though this has been well characterized for both theoretical and empirical networks for the spread of epidemics on completely susceptible networks, the long term impact of network structure on risk of infection with an endemic pathogen has been less well characterized. Here, we analyze detailed records of the transportation of cattle between farms in Turkey to characterize the global and local attributes of the shipments network between 2007 2012, building an aggregated static directed weighted network. We study the correlation between network properties and the likelihood of infection with, or exposure to, foot and mouth (FMD) disease over the same time period using recorded outbreaks. The shipments network shows properties of small worldness and scale freeness (intermediate degrees), with an exponential cut off for high degrees. The shipments network illustrates strong modularity and lack of assortativity. The shipments network shows signs of spatial constraints, with few long distance connections, and a strong similarity to other spatially constrained networks. We find that farms that were either infected or at high risk of infection with FMD (within one link from an infected farm) had higher values of centrality farms that were never less than 2 links from an infected farm had disproportionately low centrality. However, the correlation of the rankings of farms shows that central farms (high eigenvector centrality) are not necessarily those with more connections to from it (in out degree). Several central farms serve as bridges of densely connected farms (high betweenness centrality). These results suggest that to detect FMD spread, surveillance efforts could be focused preferentially on farms with centralities greater than the mean.


Theory of wakefields excited by an off axis drive bunch in a plasma dielectric waveguide. A linear theory of a wakefield excitation in a plasma dielectric accelerating structure by a drive electron bunch in the case of an off axis bunch injection has been constructed. The structure under investigation is a round dielectric loaded metal waveguide with a channel for the charged particles, filled with homogeneous cold plasma. Derived theory was used to investigate numerically the spatial distribution of the bunch excited wakefield components, which act on both the drive and witness bunches.


The complete separation of the two finer asymptotic ell p structures for 1 le p infty . For 1 le p infty , we present a reflexive Banach space mathfrak X (p) text awi , with an unconditional basis, that admits ell p as a unique asymptotic model and does not contain any Asymptotic ell p subspaces. D. Freeman, E. Odell, B. Sari and B. Zheng have shown that whenever a Banach space not containing ell 1 , in particular a reflexive Banach space, admits c 0 as a unique asymptotic model then it is Asymptotic c 0 . These results provide a complete answer to a problem posed by L. Halbeisen and E. Odell and also complete a line of inquiry of the relation between specific asymptotic structures in Banach spaces, initiated in a previous paper by the first and fourth authors. For the definition of mathfrak X (p) text awi we use saturation with asymptotically weakly incomparable constraints, a new method for defining a norm that remains small on a well founded tree of vectors which penetrates any infinite dimensional closed subspace.


Rectilinear approximation and volume estimates for hereditary bodies via 0,1 decorated containers. We use the hypergraph container theory of Balogh Morris Samotij and Saxton Thomason to obtain general rectilinear approximations and volume estimates for sequences of bodies closed under certain families of projections. We give a number of applications of our results, including a multicolour generalisation of a theorem of Hatami, Janson and Szegedy on the entropy of graph limits. Finally, we raise a number of questions on geometric and analytic approaches to containers.


Failure Modes of Domain Generalization Algorithms. Domain generalization algorithms use training data from multiple domains to learn models that generalize well to unseen domains. While recently proposed benchmarks demonstrate that most of the existing algorithms do not outperform simple baselines, the established evaluation methods fail to expose the impact of various factors that contribute to the poor performance. In this paper we propose an evaluation framework for domain generalization algorithms that allows decomposition of the error into components capturing distinct aspects of generalization. Inspired by the prevalence of algorithms based on the idea of domain invariant representation learning, we extend the evaluation framework to capture various types of failures in achieving invariance. We show that the largest contributor to the generalization error varies across methods, datasets, regularization strengths and even training lengths. We observe two problems associated with the strategy of learning domain invariant representations. On Colored MNIST, most domain generalization algorithms fail because they reach domain invariance only on the training domains. On Camelyon 17, domain invariance degrades the quality of representations on unseen domains. We hypothesize that focusing instead on tuning the classifier on top of a rich representation can be a promising direction.


Uncertainty aware Clustering for Unsupervised Domain Adaptive Object Re identification. Unsupervised Domain Adaptive (UDA) object re identification (Re ID) aims at adapting a model trained on a labeled source domain to an unlabeled target domain. State of the art object Re ID approaches adopt clustering algorithms to generate pseudo labels for the unlabeled target domain. However, the inevitable label noise caused by the clustering procedure significantly degrades the discriminative power of Re ID model. To address this problem, we propose an uncertainty aware clustering framework (UCF) for UDA tasks. First, a novel hierarchical clustering scheme is proposed to promote clustering quality. Second, an uncertainty aware collaborative instance selection method is introduced to select images with reliable labels for model training. Combining both techniques effectively reduces the impact of noisy labels. In addition, we introduce a strong baseline that features a compact contrastive loss. Our UCF method consistently achieves state of the art performance in multiple UDA tasks for object Re ID, and significantly reduces the gap between unsupervised and supervised Re ID performance. In particular, the performance of our unsupervised UCF method in the MSMT17 to Market1501 task is better than that of the fully supervised setting on Market1501. The code of UCF is available at https github.com Wang pengfei UCF.


On Galois representations with large image. For every prime number p geq 3 and every integer m geq 1 , we prove the existence of a continuous Galois representation rho G mathbb Q rightarrow Gl m( mathbb Z p) which has open image and is unramified outside p, infty (resp. outside 2,p, infty ) when p equiv 3 mod 4 (resp. p equiv 1 mod 4 ).


Engineered Near and Far Field Optical Response of Dielectric Nanostuctures using Focused Cylindrical Vector Beams. Near and far field optical properties of silicon nanostructures under linear polarization (Gaussian beam), and azimuthally or radially focused cylindrical vector beams are investigated by finite difference time domain method (FDTD) in Meep open source software. A python toolkit allowing FDTD simulations in Meep for using those excitation sources is provided. In addition to the preferential excitation of specific electric or magnetic resonance modes as function of the excitation beam polarization, it is shown in the case of spheroids that shape anisotropy affects the resonance wavelength and the dipole orientation of the magnetic or electric dipole mode. For radial or linear polarization, the electric dipole resonance is split by an anapole mode depending on the spheroid symmetry axis with respect to the electric field orientation. Finally, the optical properties in both far field (scattering pattern) and near field (electric and magnetic field hot spots) can be tuned by changing the excitation polarization at a fixed wavelength and selecting properly the spheroid shape and dimensions. These numerical simulations can be extended to more complex shapes, or fabrication friendly nanostructures such as nanocylinders with circular or elliptic sections.


A semigroup method for high dimensional elliptic PDEs and eigenvalue problems based on neural networks. In this paper, we propose a semigroup method for solving high dimensional elliptic partial differential equations (PDEs) and the associated eigenvalue problems based on neural networks. For the PDE problems, we reformulate the original equations as variational problems with the help of semigroup operators and then solve the variational problems with neural network (NN) parameterization. The main advantages are that no mixed second order derivative computation is needed during the stochastic gradient descent training and that the boundary conditions are taken into account automatically by the semigroup operator. Unlike popular methods like PINN cite raissi2019physics and Deep Ritz cite weinan2018deep where the Dirichlet boundary condition is enforced solely through penalty functions and thus changes the true solution, the proposed method is able to address the boundary conditions without penalty functions and it gives the correct true solution even when penalty functions are added, thanks to the semigroup operator. For eigenvalue problems, a primal dual method is proposed, efficiently resolving the constraint with a simple scalar dual variable and resulting in a faster algorithm compared with the BSDE solver cite han2020solving in certain problems such as the eigenvalue problem associated with the linear Schr "odinger operator. Numerical results are provided to demonstrate the performance of the proposed methods.


On combinatorics of Voronoi polytopes for perturbations of the dual root lattices. The Voronoi conjecture on parallelohedra claims that for every convex polytope P that tiles Euclidean d dimensional space with translations there exists a d dimensional lattice such that P and the Voronoi polytope of this lattice are affinely equivalent. The Voronoi conjecture is still open for the general case but it is known that some combinatorial restriction for the face structure of P ensure that the Voronoi conjecture holds for P . In this paper we prove that if P is the Voronoi polytope of one of the dual root lattices mathsf D d , mathsf E 6 , mathsf E 7 or mathsf E 8 mathsf E 8 or their small perturbations, then every parallelohedron combinatorially equivalent to P in strong sense satisfies the Voronoi conjecture.


Surgical Instruction Generation with Transformers. Automatic surgical instruction generation is a prerequisite towards intra operative context aware surgical assistance. However, generating instructions from surgical scenes is challenging, as it requires jointly understanding the surgical activity of current view and modelling relationships between visual information and textual description. Inspired by the neural machine translation and imaging captioning tasks in open domain, we introduce a transformer backboned encoder decoder network with self critical reinforcement learning to generate instructions from surgical images. We evaluate the effectiveness of our method on DAISI dataset, which includes 290 procedures from various medical disciplines. Our approach outperforms the existing baseline over all caption evaluation metrics. The results demonstrate the benefits of the encoder decoder structure backboned by transformer in handling multimodal context.


PluGeN Multi Label Conditional Generation From Pre Trained Models. Modern generative models achieve excellent quality in a variety of tasks including image or text generation and chemical molecule modeling. However, existing methods often lack the essential ability to generate examples with requested properties, such as the age of the person in the photo or the weight of the generated molecule. Incorporating such additional conditioning factors would require rebuilding the entire architecture and optimizing the parameters from scratch. Moreover, it is difficult to disentangle selected attributes so that to perform edits of only one attribute while leaving the others unchanged. To overcome these limitations we propose PluGeN (Plugin Generative Network), a simple yet effective generative technique that can be used as a plugin to pre trained generative models. The idea behind our approach is to transform the entangled latent representation using a flow based module into a multi dimensional space where the values of each attribute are modeled as an independent one dimensional distribution. In consequence, PluGeN can generate new samples with desired attributes as well as manipulate labeled attributes of existing examples. Due to the disentangling of the latent representation, we are even able to generate samples with rare or unseen combinations of attributes in the dataset, such as a young person with gray hair, men with make up, or women with beards. We combined PluGeN with GAN and VAE models and applied it to conditional generation and manipulation of images and chemical molecule modeling. Experiments demonstrate that PluGeN preserves the quality of backbone models while adding the ability to control the values of labeled attributes.


Hospital management in the COVID 19 emergency Abelian Sandpile paradigm and beyond. In this article, we propose a mathematical model based on a cellular automaton for the redistribution of patients within a network of hospitals with limited available resources, in order to reduce the risks of a local global collapse of the healthcare system. We attempt at developing a conceptual tool to support making rational decisions relevant to the optimisation of the allocation of patients into accessible medical facilities. The strategy is based on a version of the Abelian Sandpile model for the Self Organised Criticality, with the idea of testing the paradigm for the management of patients among the COVID 19 hospitals in Italian regions. In particular, we compare the novel proposal to the standard management of connections between hospitals, showing a number of advantages at a local and global level, by means of a reliable indicator function introduced for measuring the effectiveness of the allocation strategies.


SASRA Semantically aware Spatio temporal Reasoning Agent for Vision and Language Navigation in Continuous Environments. This paper presents a novel approach for the Vision and Language Navigation (VLN) task in continuous 3D environments, which requires an autonomous agent to follow natural language instructions in unseen environments. Existing end to end learning based VLN methods struggle at this task as they focus mostly on utilizing raw visual observations and lack the semantic spatio temporal reasoning capabilities which is crucial in generalizing to new environments. In this regard, we present a hybrid transformer recurrence model which focuses on combining classical semantic mapping techniques with a learning based method. Our method creates a temporal semantic memory by building a top down local ego centric semantic map and performs cross modal grounding to align map and language modalities to enable effective learning of VLN policy. Empirical results in a photo realistic long horizon simulation environment show that the proposed approach outperforms a variety of state of the art methods and baselines with over 22 relative improvement in SPL in prior unseen environments.


Surface activity of cancer cells the fusion of two cell aggregates. Although a good comprehension of how cancer cells collectively migrate by following molecular rules which influence the state of cell cell adhesion contacts has been generated, the impact of collective migration on cellular rearrangement from subcellular to supracellular level remains less understood. Thus, considering collective cell migration (CCM) of cancer mesenchymal cells on one side and healthy epithelial cells on the other during the fusion of two cell aggregates could result in a powerful tool in order to address the contribution of structural changes at subcellular level which influence the cellular rearrangements and help to understand this important, but still controversial topic. While healthy epithelial cells undergo volumetric cell rearrangement driven by the tissue surface tension, which results in a collision of opposite directed velocity front near the contact point between two cell aggregates, mesenchymal cells follow quite different scenario. These cells are capable of reducing the surface tension and undergo surface cell rearrangement. The main goal of this contribution is to discuss the origin of surface activity of cancer cells by accounting for the crosstalk between cell cell and cell ECM adhesion contacts influenced by the cell contractility.


Pricing and Hedging Prepayment Risk in a Mortgage Portfolio. Understanding mortgage prepayment is crucial for any financial institution providing mortgages, and it is important for hedging the risk resulting from such unexpected cash flows. Here, in the setting of a Dutch mortgage provider, we propose to include non linear financial instruments in the hedge portfolio when dealing with mortgages with the option to prepay part of the notional early. Based on the assumption that there is a correlation between prepayment and the interest rates in the market, a model is proposed which is based on a specific refinancing incentive. The linear and non linear risks are addressed by a set of tradeable instruments in a static hedge strategy. We will show that a stochastic model for the notional of a mortgage unveils non linear risk embedded in a prepayment option. Based on a calibration of the refinancing incentive on a data set of more than thirty million observations, a functional form of the prepayments is defined, which accurately reflects the borrowers' behaviour. We compare this functional form with a fully rational model, where the option to prepay is assumed to be exercised rationally.


Automatic Diversity in the Software Supply Chain. Despite its obvious benefits, the increased adoption of package managers to automate the reuse of libraries has opened the door to a new class of hazards supply chain attacks. By injecting malicious code in one library, an attacker may compromise all instances of all applications that depend on the library. To mitigate the impact of supply chain attacks, we propose the concept of Library Substitution Framework. This novel concept leverages one key observation when an application depends on a library, it is very likely that there exists other libraries that provide similar features. The key objective of Library Substitution Framework is to enable the developers of an application to harness this diversity of libraries in their supply chain. The framework lets them generate a population of application variants, each depending on a different alternative library that provides similar functionalities. To investigate the relevance of this concept, we develop ARGO, a proof of concept implementation of this framework that harnesses the diversity of JSON suppliers. We study the feasibility of library substitution and its impact on a set of 368 clients. Our empirical results show that for 195 of the 368 java applications tested, we can substitute the original JSON library used by the client by at least 15 other JSON libraries without modifying the client's code. These results show the capacity of a Library Substitution Framework to diversify the supply chain of the client applications of the libraries it targets.


A Mocktail of Source Code Representations. Efficient representation of source code is essential for various software engineering tasks such as code classification and code clone detection. Existing approaches for representing source code primarily use AST, and many do not focus on semantic graphs such as CFG and PDG, which contain essential information about source code that AST does not have. Even though some works tried to utilize multiple representations, they use hand crafted program features to solve a specific task and have limited use cases. The primary goal of this paper is to discuss the implications of utilizing multiple code representations, specifically AST, CFG, and PDG, and how each of them affects the performance of a task. In this process, we propose an approach that can extract and use program features from multiple code graphs while not specifically coupling this approach to a specific task or a programming language. Our approach stems from the idea of modeling AST as a set of paths and using a learning model to capture program properties. Code2vec is one such path based approach that uses an attention based neural network to learn code embeddings. Even though code2vec has an advantage in not hand crafting features for a task, it uses only AST. However, leveraging semantic graphs such as CFG and PDG may improve this approach by extracting program features not captured in AST. Hence, we extend this path based approach to include the semantic graphs CFG and PDG while also benefitting code2vec's advantages. We evaluate our approach on three tasks Method Naming, Program Classification, and Code Clone Detection. Our approach increases the performance on these three tasks by 11.4 (F1), 15.7 (Accuracy), and 9 (F1), respectively, over the baseline. We also discuss how the semantic features from the CFG and PDG paths affect the performance and the additional overheads incurred through our approach.


Upper Bounds on Resolvent Degree via Sylvester's Obliteration Algorithm. For each n , let RD (n) denote the minimum d for which there exists a formula for the general polynomial of degree n in algebraic functions of at most d variables. In this paper, we recover an algorithm of Sylvester for determining non zero solutions of systems of homogeneous polynomials, which we present from a modern algebro geometric perspective. We then use this geometric algorithm to determine improved thresholds for upper bounds on RD (n) .


Reference Tracking AND Observer Design for Space Fractional Partial Differential Equation Modeling Gas Pressures in Fractured Media. This paper considers a class of space fractional partial differential equations (FPDEs) that describe gas pressures in fractured media. First, the well posedness, uniqueness, and the stability in L ( infty R ) of the considered FPDEs are investigated. Then, the reference tracking problem is studied to track the pressure gradient at a downstream location of a channel. This requires manipulation of gas pressure at the downstream location and the use of pressure measurements at an upstream location. To achiever this, the backstepping approach is adapted to the space FPDEs. The key challenge in this adaptation is the non applicability of the Lyapunov theory which is typically used to prove the stability of the target system as, the obtained target system is fractional in space. In addition, a backstepping adaptive observer is designed to jointly estimate both the system's state and the disturbance. The stability of the closed loop (reference tracking controller observer) is also investigated. Finally, numerical simulations are given to evaluate the efficiency of the proposed method.


On the distribution of additive twists of the divisor function and Hecke eigenvalues. We obtain asymptotics with a power saving error term for int 0 1 sum n le X d(n)e(n alpha) sd alpha for s 2 , where d(n) sum d n 1 is the divisor function. We also obtain such asymptotics for int 0 1 sum n le X lambda f(n)e(n alpha) sd alpha for all s 0 . Our proof an iterative method with repeated applications of Jutila's variant of the circle method and Voronoi summation.


Morphogenesis of street networks. A reaction diffusion system for self organized cities. Urban morphogenesis is the process of formation of its elements and the specialization of its suburbs. Street networks are the structural part of the system. Understand their formation reveals crucial information about urban transformation and dynamics behind its functioning. In this work we focus on the morphogenesis of street networks and we study it through a spatial network generator model. This latter is composed by three layers (a reaction diffusion layer, a dynamic vector field and a spatial network) surrounded by an environment. The emerging network feeds back to its morphogenetic elements, driving the model to an unexpected behaviour. We applied the model in a real urban context (F 'ecamp town, Normandy, France) and we measure properties of obtained networks.


Approximation Algorithms for Orthogonal Non negative Matrix Factorization. In the non negative matrix factorization (NMF) problem, the input is an m times n matrix M with non negative entries and the goal is to factorize it as M approx AW . The m times k matrix A and the k times n matrix W are both constrained to have non negative entries. This is in contrast to singular value decomposition, where the matrices A and W can have negative entries but must satisfy the orthogonality constraint the columns of A are orthogonal and the rows of W are also orthogonal. The orthogonal non negative matrix factorization (ONMF) problem imposes both the non negativity and the orthogonality constraints, and previous work showed that it leads to better performances than NMF on many clustering tasks. We give the first constant factor approximation algorithm for ONMF when one or both of A and W are subject to the orthogonality constraint. We also show an interesting connection to the correlation clustering problem on bipartite graphs. Our experiments on synthetic and real world data show that our algorithm achieves similar or smaller errors compared to previous ONMF algorithms while ensuring perfect orthogonality (many previous algorithms do not satisfy the hard orthogonality constraint).