On data lake architectures and metadata management. Over the past two decades, we have witnessed an exponential increase of data production in the world. So called big data generally come from transactional systems, and even more so from the Internet of Things and social media. They are mainly characterized by volume, velocity, variety and veracity issues. Big data related issues strongly challenge traditional data management and analysis systems. The concept of data lake was introduced to address them. A data lake is a large, raw data repository that stores and manages all company data bearing any format. However, the data lake concept remains ambiguous or fuzzy for many researchers and practitioners, who often confuse it with the Hadoop technology. Thus, we provide in this paper a comprehensive state of the art of the different approaches to data lake design. We particularly focus on data lake architectures and metadata management, which are key issues in successful data lakes. We also discuss the pros and cons of data lakes and their design alternatives.


Commutative Monoid Formalism for Weighted Coupled Cell Networks and Invariant Synchrony Patterns. This paper presents a framework based on matrices of monoids for the study of coupled cell networks. We formally prove within the proposed framework, that the set of results about invariant synchrony patterns for unweighted networks also holds for the weighted case. Moreover, the approach described allows us to reason about any multiedge and multiedge type network as if it was single edge and single edge type. Several examples illustrate the concepts described. Additionally, an improvement of the coarsest invariant refinement algorithm to find balanced partitions is presented that exhibits a worst case complexity of mathbf O ( vert mathcal C vert 3) , where mathcal C denotes the set of cells.


CNN vs ELM for Image Based Malware Classification. Research in the field of malware classification often relies on machine learning models that are trained on high level features, such as opcodes, function calls, and control flow graphs. Extracting such features is costly, since disassembly or code execution is generally required. In this paper, we conduct experiments to train and evaluate machine learning models for malware classification, based on features that can be obtained without disassembly or execution of code. Specifically, we visualize malware samples as images and employ image analysis techniques. In this context, we focus on two machine learning models, namely, Convolutional Neural Networks (CNN) and Extreme Learning Machines (ELM). Surprisingly, we find that ELMs can achieve accuracies on par with CNNs, yet ELM training requires less than 2 of the time needed to train a comparable CNN.


Automatic Resource Allocation in Business Processes A Systematic Literature Survey. For delivering products or services to their clients, organizations execute manifold business processes. During such execution, upcoming process tasks need to be allocated to internal resources. Resource allocation is a complex decision making problem with high impact on the effectiveness and efficiency of processes. A wide range of approaches was developed to support research allocation automatically. This systematic literature survey provides an overview of approaches and categorizes them regarding their resource allocation goals and capabilities, their use of models and data, their algorithmic solutions, and their maturity. Rule based approaches were identified as dominant, but heuristics and learning approaches also play a relevant role.


Fast Parallel Algorithms for Euclidean Minimum Spanning Tree and Hierarchical Spatial Clustering. This paper presents new parallel algorithms for generating Euclidean minimum spanning trees and spatial clustering hierarchies (known as HDBSCAN ). Our approach is based on generating a well separated pair decomposition followed by using Kruskal's minimum spanning tree algorithm and bichromatic closest pair computations. We introduce a new notion of well separation to reduce the work and space of our algorithm for HDBSCAN . We also present a parallel approximate algorithm for OPTICS based on a recent sequential algorithm by Gan and Tao. Finally, we give a new parallel divide and conquer algorithm for computing the dendrogram and reachability plots, which are used in visualizing clusters of different scale that arise for both EMST and HDBSCAN . We show that our algorithms are theoretically efficient they have work (number of operations) matching their sequential counterparts, and polylogarithmic depth (parallel time). We implement our algorithms and propose a memory optimization that requires only a subset of well separated pairs to be computed and materialized, leading to savings in both space (up to 10x) and time (up to 8x). Our experiments on large real world and synthetic data sets using a 48 core machine show that our fastest algorithms outperform the best serial algorithms for the problems by 11.13 55.89x, and existing parallel algorithms by at least an order of magnitude.


Outdoor sub THz Position Location and Tracking using Field Measurements at 142 GHz. Future sub THz cellular deployments may be utilized to complement the coverage of the global positioning system (GPS) and provide centimeter level accuracy. In this work, we use measurement data at 142 GHz to test a map based position location algorithm in an outdoor urban microcell (UMi) environment. We utilize an extended Kalman filter (EKF) to track the position of the user equipment (UE) along a rectangular track, with the transmitter receiver separation distances varying from 24.3 m to 52.8 m. The position and velocity of the UE are tracked by the EKF, with measurements of the angle of arrival and time of flight information obtained along an outdoor track, to provide a mean accuracy of 24.8 cm at 142 GHz, over 34 UE locations, using a single base station in line of sight and non line of sight.


File fragment recognition based on content and statistical features. Nowadays, the speed up development and use of digital devices such as smartphones have put people at risk of internet crimes. The evidence of present crimes in a computer file can be easily unreachable by changing the prefix of a file or other algorithms. In more complex cases, either file divided into different parts or the parts of a file that has information about the file type are deleted, where the file fragment recognition issue is discussed. The known files are divided into different fragments, and different classification algorithms are used to solve the problems of file fragment recognition. The issue of identifying the type of file fragment due to its importance in cybercrime issues as well as antivirus has been highly emphasized and has been addressed in many articles. Increasing the accuracy in this field on the types of widely used files due to the sensitivity of the subject of recognizing the type of file under study is the main goal of researchers in this field. Failure to identify the correct type of file will lead to deviations of the results and evidence from the main issue or failure to conclude. In this paper, first, the file is divided into different fragments. Then, the file fragment features, which are obtained from Binary Frequency Distribution, are reduced by 2 feature reduction algorithms Sequential Forward Selection algorithm as well as Sequential Floating Forward Selection algorithm to delete sparse features that result in increased accuracy and speed. Finally, the reduced features are given to 3 Multiclass classifier algorithms, Multilayer Perceptron, Support Vector Machines, and K Nearest Neighbor for classification and comparison of the results. The proposed recognition algorithm can recognize 6 types of useful files and may distinguish a type of file fragments with higher accuracy than the similar works done.


Hecke triangle Groups and Bipartite q boid Graph. In this work we will construct bipartite graphs corresponding to finite index subgroups of Hecke triangle groups (2, q, infty ) . Then using a results of cite ll we shall show the correspondences among the special polygons, the bi partite graphs, and the tree diagrams for a finite index subgroups of the Hecke triangle groups (2, q, infty ) .


Higher Yoneda product structures and Iwasawa algebras modulo p . We give answers to three questions posed by Sorensen. These concern the relationship between the modulo p Iwasawa algebra of a torsionfree pro p group and A infty algebra structures on its Yoneda algebra.


A General Counterexample to Any Decision Theory and Some Responses. In this paper I present an argument and a general schema which can be used to construct a problem case for any decision theory, in a way that could be taken to show that one cannot formulate a decision theory that is never outperformed by any other decision theory. I also present and discuss a number of possible responses to this argument. One of these responses raises the question of what it means for two decision problems to be "equivalent" in the relevant sense, and gives an answer to this question which would invalidate the first argument. However, this position would have further consequences for how we compare different decision theories in decision problems already discussed in the literature (including e.g. Newcomb's problem).


Optimal Distribution Design for Irregular Repetition Slotted ALOHA with Multi Packet Reception. Associated with multi packet reception at the access point, irregular repetition slotted ALOHA (IRSA) holds a great potential in improving the access capacity of massive machine type communication systems. Considering the time frequency resource efficiency, K 2 (multi packet reception capability) may be the most suitable scheme for scenarios that allow smaller resource efficiency in exchange for greater throughput. In this paper, we analytically derive an optimal transmission probability distribution for IRSA with K 2, which achieves a significant higher load threshold than the existing benchmark distributions. In addition, the energy efficiency optimization in terms of the maximum repetition rate is also presented.


Delayed Asynchronous Iterative Graph Algorithms. Iterative graph algorithms often compute intermediate values and update them as computation progresses. Updated output values are used as inputs for computations in current or subsequent iterations hence the number of iterations required for values to converge can potentially reduce if the newest values are asynchronously made available to other updates computed in the same iteration. In a multi threaded shared memory system, the immediate propagation of updated values can cause memory contention that may offset the benefit of propagating updates sooner. In some cases, the benefit of a smaller number of iterations may be diminished by each iteration taking longer. Our key idea is to combine the low memory contention that synchronous approaches have with the faster information sharing of asynchronous approaches. Our hybrid approach buffers updates from threads locally before committing them to the global store to control how often threads may cause conflicts for others while still sharing data within one iteration and hence speeding convergence. On a 112 thread CPU system, our hybrid approach attains up to 4.5 19.4 speedup over an asynchronous approach for Pagerank and up to 1.9 17 speedup over asynchronous Bellman Ford SSSP. Further, our hybrid approach attains 2.56x better performance than the synchronous approach. Finally, we provide insights as to why delaying updates is not helpful on certain graphs where connectivity is clustered on the main diagonal of the adjacency matrix.


Adaptive Regularized Submodular Maximization. In this paper, we study the problem of maximizing the difference between an adaptive submodular (revenue) function and an non negative modular (cost) function under the adaptive setting. The input of our problem is a set of n items, where each item has a particular state drawn from some known prior distribution p . The revenue function g is defined over items and states, and the cost function c is defined over items, i.e., each item has a fixed cost. The state of each item is unknown initially, one must select an item in order to observe its realized state. A policy pi specifies which item to pick next based on the observations made so far. Denote by g avg ( pi) the expected revenue of pi and let c avg ( pi) denote the expected cost of pi . Our objective is to identify the best policy pi o in arg max pi g avg ( pi) c avg ( pi) under a k cardinality constraint. Since our objective function can take on both negative and positive values, the existing results of submodular maximization may not be applicable. To overcome this challenge, we develop a series of effective solutions with performance grantees. Let pi o denote the optimal policy. For the case when g is adaptive monotone and adaptive submodular, we develop an effective policy pi l such that g avg ( pi l) c avg ( pi l) geq (1 frac 1 e epsilon)g avg ( pi o) c avg ( pi o) , using only O(n epsilon 2 log epsilon 1 ) value oracle queries. For the case when g is adaptive submodular, we present a randomized policy pi r such that g avg ( pi r) c avg ( pi r) geq frac 1 e g avg ( pi o) c avg ( pi o) .


Spatial shifts in productivity of the coastal ocean over the past two decades induced by migration of the Pacific Anticyclone and Bakun effect in the Humboldt Upwelling Ecosystem. Intensification and poleward expansion of upwelling favourable winds have been predicted as a response to anthropogenic global climate change and have recently been documented in most Eastern Boundary Upwelling Ecosystems of the world. To identify how these processes are impacting nearshore oceanographic habitats and, especially, long term trends of primary productivity in the Humboldt Upwelling Ecosystem (HUE), we analysed time series of sea level pressure, wind stress, sea surface and atmospheric surface temperatures, and Chlorophyll a, as a proxy for primary productivity, along 26 deg 36 deg S. We show that climate induced trends in primary productivity are highly heterogeneous across the region. On the one hand, the well documented poleward migration of the South Pacific Anticyclone (SPA) has led to decreased spring upwelling winds in the region between ca. 30 deg and 34 deg S, and to their intensification to the south. Decreased winds have produced slight increases in sea surface temperature and a pronounced and meridionally extensive decrease in surface Chlorophyll a in this region of central Chile. To the north of 30 deg S, significant increases in upwelling winds, decreased SST, and enhanced Chlorophyll a concentration are observed in the nearshore. We show that this increased in upwelling driven coastal productivity is probably produced by the increased land sea pressure gradients (Bakun's effect) that have occurred over the past two decades north of 30 deg S. Thus, climate drivers along the HUE are inducing contrasting trends in oceanographic conditions and primary productivity, which can have far reaching consequences for coastal pelagic and benthic ecosystems and lead to geographic displacements of the major fisheries.


SmoothI Smooth Rank Indicators for Differentiable IR Metrics. Information retrieval (IR) systems traditionally aim to maximize metrics built on rankings, such as precision or NDCG. However, the non differentiability of the ranking operation prevents direct optimization of such metrics in state of the art neural IR models, which rely entirely on the ability to compute meaningful gradients. To address this shortcoming, we propose SmoothI, a smooth approximation of rank indicators that serves as a basic building block to devise differentiable approximations of IR metrics. We further provide theoretical guarantees on SmoothI and derived approximations, showing in particular that the approximation errors decrease exponentially with an inverse temperature like hyperparameter that controls the quality of the approximations. Extensive experiments conducted on four standard learning to rank datasets validate the efficacy of the listwise losses based on SmoothI, in comparison to previously proposed ones. Additional experiments with a vanilla BERT ranking model on a text based IR task also confirm the benefits of our listwise approach.


Translational Equivariance in Kernelizable Attention. While Transformer architectures have show remarkable success, they are bound to the computation of all pairwise interactions of input element and thus suffer from limited scalability. Recent work has been successful by avoiding the computation of the complete attention matrix, yet leads to problems down the line. The absence of an explicit attention matrix makes the inclusion of inductive biases relying on relative interactions between elements more challenging. An extremely powerful inductive bias is translational equivariance, which has been conjectured to be responsible for much of the success of Convolutional Neural Networks on image recognition tasks. In this work we show how translational equivariance can be implemented in efficient Transformers based on kernelizable attention Performers. Our experiments highlight that the devised approach significantly improves robustness of Performers to shifts of input images compared to their naive application. This represents an important step on the path of replacing Convolutional Neural Networks with more expressive Transformer architectures and will help to improve sample efficiency and robustness in this realm.


CompOFA Compound Once For All Networks for Faster Multi Platform Deployment. The emergence of CNNs in mainstream deployment has necessitated methods to design and train efficient architectures tailored to maximize the accuracy under diverse hardware latency constraints. To scale these resource intensive tasks with an increasing number of deployment targets, Once For All (OFA) proposed an approach to jointly train several models at once with a constant training cost. However, this cost remains as high as 40 50 GPU days and also suffers from a combinatorial explosion of sub optimal model configurations. We seek to reduce this search space and hence the training budget by constraining search to models close to the accuracy latency Pareto frontier. We incorporate insights of compound relationships between model dimensions to build CompOFA, a design space smaller by several orders of magnitude. Through experiments on ImageNet, we demonstrate that even with simple heuristics we can achieve a 2x reduction in training time and 216x speedup in model search extraction time compared to the state of the art, without loss of Pareto optimality! We also show that this smaller design space is dense enough to support equally accurate models for a similar diversity of hardware and latency targets, while also reducing the complexity of the training and subsequent extraction algorithms.


Hurdles for Developers in Cryptography. Prior research has shown that cryptography is hard to use for developers. We aim to understand what cryptography issues developers face in practice. We clustered 91954 cryptography related questions on the Stack Overflow website, and manually analyzed a significant sample (i.e., 383) of the questions to comprehend the crypto challenges developers commonly face in this domain. We found that either developers have a distinct lack of knowledge in understanding the fundamental concepts, eg OpenSSL, public key cryptography or password hashing, or the usability of crypto libraries undermined developer performance to correctly realize a crypto scenario. This is alarming and indicates the need for dedicated research to improve the design of crypto APIs.


Entropy optimized semi supervised decomposed vector quantized variational autoencoder model based on transfer learning for multiclass text classification and generation. Semisupervised text classification has become a major focus of research over the past few years. Hitherto, most of the research has been based on supervised learning, but its main drawback is the unavailability of labeled data samples in practical applications. It is still a key challenge to train the deep generative models and learn comprehensive representations without supervision. Even though continuous latent variables are employed primarily in deep latent variable models, discrete latent variables, with their enhanced understandability and better compressed representations, are effectively used by researchers. In this paper, we propose a semisupervised discrete latent variable model for multi class text classification and text generation. The proposed model employs the concept of transfer learning for training a quantized transformer model, which is able to learn competently using fewer labeled instances. The model applies decomposed vector quantization technique to overcome problems like posterior collapse and index collapse. Shannon entropy is used for the decomposed sub encoders, on which a variable DropConnect is applied, to retain maximum information. Moreover, gradients of the Loss function are adaptively modified during backpropagation from decoder to encoder to enhance the performance of the model. Three conventional datasets of diversified range have been used for validating the proposed model on a variable number of labeled instances. Experimental results indicate that the proposed model has surpassed the state of the art models remarkably.


When a Computer Cracks a Joke Automated Generation of Humorous Headlines. Automated news generation has become a major interest for new agencies in the past. Oftentimes headlines for such automatically generated news articles are unimaginative as they have been generated with ready made templates. We present a computationally creative approach for headline generation that can generate humorous versions of existing headlines. We evaluate our system with human judges and compare the results to human authored humorous titles. The headlines produced by the system are considered funny 36 of the time by human evaluators.


Satellite data for the offshore renewable energy sector synergies and innovation opportunities. Can satellite data be used to address challenges currently faced by the Offshore Renewable Energy (ORE) sector? What benefit can satellite observations bring to resource assessment and maintenance of ORE farms? Can satellite observations be used to assess the environmental impact of offshore renewables leading towards a more sustainable ORE sector? This review paper faces these questions presenting a holistic view of the current interactions between satellite and ORE sectors, and future needs to make this partnerships grow. The aim of the work is to start the conversation between these sectors by establishing a common ground. We present offshore needs and satellite technology limitations, as well as potential opportunities and areas of growth. To better understand this, the reader is guided through the history, current developments, challenges and future of offshore wind, tidal and wave energy technologies. Then, an overview on satellite observations for ocean applications is given, covering types of instruments and how they are used to provide different metocean variables, satellite performance, and data processing and integration. Past, present and future satellite missions are also discussed. Finally, the paper focuses on innovation opportunities and the potential of synergies between the ORE and satellite sectors. Specifically, we pay attention to improvements that satellite observations could bring to standard measurement techniques assessing uncertainty, wind, tidal and wave conditions forecast, as well as environmental monitoring from space. Satellite enabled measurement of ocean physical processes and applications for fisheries, mammals and birds, and habitat change, are also discussed in depth.


Understanding Pre Editing for Black Box Neural Machine Translation. Pre editing is the process of modifying the source text (ST) so that it can be translated by machine translation (MT) in a better quality. Despite the unpredictability of black box neural MT (NMT), pre editing has been deployed in various practical MT use cases. Although many studies have demonstrated the effectiveness of pre editing methods for particular settings, thus far, a deep understanding of what pre editing is and how it works for black box NMT is lacking. To elicit such understanding, we extensively investigated human pre editing practices. We first implemented a protocol to incrementally record the minimum edits for each ST and collected 6,652 instances of pre editing across three translation directions, two MT systems, and four text domains. We then analysed the instances from three perspectives the characteristics of the pre edited ST, the diversity of pre editing operations, and the impact of the pre editing operations on NMT outputs. Our findings include the following (1) enhancing the explicitness of the meaning of an ST and its syntactic structure is more important for obtaining better translations than making the ST shorter and simpler, and (2) although the impact of pre editing on NMT is generally unpredictable, there are some tendencies of changes in the NMT outputs depending on the editing operation types.


Systems of fully nonlinear parabolic obstacle problems with Neumann boundary conditions. We prove the existence of a unique viscosity solution to certain systems of fully nonlinear parabolic partial differential equations with interconnected obstacles in the setting of Neumann boundary conditions. The method of proof builds on the classical viscosity solution technique adapted to the setting of interconnected obstacles and construction of explicit viscosity sub and supersolutions as bounds for Perron's method. Our motivation stems from so called optimal switching problems on bounded domains.


High Resolution Image Synthesis with Latent Diffusion Models. By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state of the art synthesis results on image data and beyond. Additionally, their formulation allows for a guiding mechanism to control the image generation process without retraining. However, since these models typically operate directly in pixel space, optimization of powerful DMs often consumes hundreds of GPU days and inference is expensive due to sequential evaluations. To enable DM training on limited computational resources while retaining their quality and flexibility, we apply them in the latent space of powerful pretrained autoencoders. In contrast to previous work, training diffusion models on such a representation allows for the first time to reach a near optimal point between complexity reduction and detail preservation, greatly boosting visual fidelity. By introducing cross attention layers into the model architecture, we turn diffusion models into powerful and flexible generators for general conditioning inputs such as text or bounding boxes and high resolution synthesis becomes possible in a convolutional manner. Our latent diffusion models (LDMs) achieve a new state of the art for image inpainting and highly competitive performance on various tasks, including unconditional image generation, semantic scene synthesis, and super resolution, while significantly reducing computational requirements compared to pixel based DMs. Code is available at https github.com CompVis latent diffusion .


Some results on r truncated degenerate Poisson Random Variables. The zero truncated Poisson distributions are certain discrete probability distributions whose supports are the set of positive integers, which are also known as the conditional Poisson distributions or the positive Poisson distributions. In this paper, we introduce the r truncated degenerate Poisson random variable with parameter a and investigate various properties of this random variable


A Monte Carlo Based Construction of Polarization Adjusted Convolutional (PAC) Codes. This paper proposes a rate profile construction method for polarization adjusted convolutional (PAC) codes of any code length and rate, which is capable of maintaining trade off between the error correction performance and decoding complexity of PAC code. The proposed method can improve the error correction performance of PAC codes while guaranteeing a low mean sequential decoding complexity for signal to noise ratio (SNR) values beyond a target SNR value.


Balanced Operators and Operator Domains. We shall say that a densely defined closed operator T on a Hilbert space is balanced if cD(T) cD(T ) . Balanced operators are described in terms of their phase operators abnd their moduli. Examples of balanced operators are developed. A characterization of the domain equality cD(A) cD(B) for positive self adjoint operators A and B with bounded inverses is given in terms of their spectral measures.


Infrared super resolution wide field microscopy using sum frequency generation. Super resolution microscopy in the visible is an established powerful tool in several disciplines. In the infrared (IR) spectral range, however, no comparable schemes have been demonstrated to date. In this work, we experimentally demonstrate super resolution microscopy in the IR range ( lambda IR approx 10 12 , mu m) using IR visible sum frequency generation. We operate our microscope in a wide field scheme and image localized surface phonon polaritons in 4H SiC nanostructures as a proof of concept. With this technique, we demonstrate an enhanced spatial resolution of sim lambda IR 9 , enabling to resolve the polariton resonances in individual sub diffractional nanostructures with sub wavelength spacing. Furthermore we show, that this resolution allows to differentiate between spatial patterns associated with different polariton modes within individual nanostructures.


A Mental Trespass? Unveiling Truth, Exposing Thoughts and Threatening Civil Liberties with Non Invasive AI Lie Detection. Imagine an app on your phone or computer that can tell if you are being dishonest, just by processing affective features of your facial expressions, body movements, and voice. People could ask about your political preferences, your sexual orientation, and immediately determine which of your responses are honest and which are not. In this paper we argue why artificial intelligence based, non invasive lie detection technologies are likely to experience a rapid advancement in the coming years, and that it would be irresponsible to wait any longer before discussing its implications. Legal and popular perspectives are reviewed to evaluate the potential for these technologies to cause societal harm. To understand the perspective of a reasonable person, we conducted a survey of 129 individuals, and identified consent and accuracy as the major factors in their decision making process regarding the use of these technologies. In our analysis, we distinguish two types of lie detection technology, accurate truth metering and accurate thought exposing. We generally find that truth metering is already largely within the scope of existing US federal and state laws, albeit with some notable exceptions. In contrast, we find that current regulation of thought exposing technologies is ambiguous and inadequate to safeguard civil liberties. In order to rectify these shortcomings, we introduce the legal concept of mental trespass and use this concept as the basis for proposed regulation.


Entropy Based Uncertainty Calibration for Generalized Zero Shot Learning. Compared to conventional zero shot learning (ZSL) where recognising unseen classes is the primary or only aim, the goal of generalized zero shot learning (GZSL) is to recognise both seen and unseen classes. Most GZSL methods typically learn to synthesise visual representations from semantic information on the unseen classes. However, these types of models are prone to overfitting the seen classes, resulting in distribution overlap between the generated features of the seen and unseen classes. The overlapping region is filled with uncertainty as the model struggles to determine whether a test case from within the overlap is seen or unseen. Further, these generative methods suffer in scenarios with sparse training samples. The models struggle to learn the distribution of high dimensional visual features and, therefore, fail to capture the most discriminative inter class features. To address these issues, in this paper, we propose a novel framework that leverages dual variational autoencoders with a triplet loss to learn discriminative latent features and applies the entropy based calibration to minimize the uncertainty in the overlapped area between the seen and unseen classes. Specifically, the dual generative model with the triplet loss synthesises inter class discriminative latent features that can be mapped from either visual or semantic space. To calibrate the uncertainty for seen classes, we calculate the entropy over the softmax probability distribution from a general classifier. With this approach, recognising the seen samples within the seen classes is relatively straightforward, and there is less risk that a seen sample will be misclassified into an unseen class in the overlapped region. Extensive experiments on six benchmark datasets demonstrate that the proposed method outperforms state of the art approaches.


Motion Planning of a Spin Rolling Sphere on a Plane. The paper deals with motion planning for a spin rolling sphere when the sphere follows a straight path on a plane. Since the motion of the sphere is constrained by the straight line, the control of the sphere's spin motion is essential to converge to a desired configuration of the sphere. In this paper, we show a new geometric based planning approach that is based on a full state description of this nonlinear system. First, the problem statement of the motion planning is posed. Next, we develop a geometric controller implemented as a virtual surface by using the Darboux frame kinematics. This virtual surface generates arc length based inputs for controlling the trajectories of the sphere. Then, an iterative algorithm is designed to tune these inputs for the desired configurations. The feasibility of the proposed approach is verified by simulations.


SO Pose Exploiting Self Occlusion for Direct 6D Pose Estimation. Directly regressing all 6 degrees of freedom (6DoF) for the object pose (e.g. the 3D rotation and translation) in a cluttered environment from a single RGB image is a challenging problem. While end to end methods have recently demonstrated promising results at high efficiency, they are still inferior when compared with elaborate P n P RANSAC based approaches in terms of pose accuracy. In this work, we address this shortcoming by means of a novel reasoning about self occlusion, in order to establish a two layer representation for 3D objects which considerably enhances the accuracy of end to end 6D pose estimation. Our framework, named SO Pose, takes a single RGB image as input and respectively generates 2D 3D correspondences as well as self occlusion information harnessing a shared encoder and two separate decoders. Both outputs are then fused to directly regress the 6DoF pose parameters. Incorporating cross layer consistencies that align correspondences, self occlusion and 6D pose, we can further improve accuracy and robustness, surpassing or rivaling all other state of the art approaches on various challenging datasets.


Time Matters Exploring the Effects of Urgency and Reaction Speed in Automated Traders. We consider issues of time in automated trading strategies in simulated financial markets containing a single exchange with public limit order book and continuous double auction matching. In particular, we explore two effects (i) reaction speed the time taken for trading strategies to calculate a response to market events and (ii) trading urgency the sensitivity of trading strategies to approaching deadlines. Much of the literature on trading agents focuses on optimising pricing strategies only and ignores the effects of time, while real world markets continue to experience a race to zero latency, as automated trading systems compete to quickly access information and act in the market ahead of others. We demonstrate that modelling reaction speed can significantly alter previously published results, with simple strategies such as SHVR outperforming more complex adaptive algorithms such as AA. We also show that adding a pace parameter to ZIP traders (ZIP Pace, or ZIPP) can create a sense of urgency that significantly improves profitability.


From Robot Self Localization to Global Localization An RSSI Based Approach. Localization is a crucial task for autonomous mobile robots in order to successfully move to goal locations in their environment. Usually this is done in a robot centric manner, where the robot maintains a map with its body in the center. In swarm robotics applications, where a group of robots need to coordinate in order to achieve their common goals, robot centric localization will not suffice as each member of the swarm has its own frame of reference. One way to deal with this problem is to create, maintain and share a common map (global coordinate system), among the members of the swarm. This paper presents an approach to global localization for a group of robots in unknown, GPS and landmark free environments that extends the localization scheme of the LadyBug algorithm. The main idea relies on members of the swarm stay still and act as beacons, emitting electromagnetic signals. These stationary robots form a global frame of reference and the rest of the group localize themselves in it using the received signal strength indicator (RSSI). The proposed method is evaluated, and the results obtained from the experiments are promising.


Heterogeneous Facility Location with Limited Resources. We initiate the study of the heterogeneous facility location problem with limited resources. We mainly focus on the fundamental case where a set of agents are positioned in the line segment 0,1 and have approval preferences over two available facilities. A mechanism takes as input the positions and the preferences of the agents, and chooses to locate a single facility based on this information. We study mechanisms that aim to maximize the social welfare (the total utility the agents derive from facilities they approve), under the constraint of incentivizing the agents to truthfully report their positions and preferences. We consider three different settings depending on the level of agent related information that is public or private. For each setting, we design deterministic and randomized strategyproof mechanisms that achieve a good approximation of the optimal social welfare, and complement these with nearly tight impossibility results.


Nonlinear conditions for ultradifferentiability a uniform approach. Recent work showed that a theorem of Joris (that a function f is smooth if two coprime powers of f are smooth) is valid in a wide variety of ultradifferentiable classes mathcal C . The core of the proof was essentially 1 dimensional. In certain cases a multidimensional version resulted from subtle reduction arguments, but general validity, notably in the quasianalytic setting, remained open. In this paper we give a uniform proof which works in all cases and dimensions. It yields the result even on infinite dimensional Banach spaces and convenient vector spaces. We also consider more general nonlinear conditions, namely general analytic germs Phi instead of the powers, and characterize when Phi circ f in mathcal C implies f in mathcal C .


A Closer Look at the Adversarial Robustness of Information Bottleneck Models. We study the adversarial robustness of information bottleneck models for classification. Previous works showed that the robustness of models trained with information bottlenecks can improve upon adversarial training. Our evaluation under a diverse range of white box l infty attacks suggests that information bottlenecks alone are not a strong defense strategy, and that previous results were likely influenced by gradient obfuscation.


Unsupervised Outlier Detection using Memory and Contrastive Learning. Outlier detection is one of the most important processes taken to create good, reliable data in machine learning. The most methods of outlier detection leverage an auxiliary reconstruction task by assuming that outliers are more difficult to be recovered than normal samples (inliers). However, it is not always true, especially for auto encoder (AE) based models. They may recover certain outliers even outliers are not in the training data, because they do not constrain the feature learning. Instead, we think outlier detection can be done in the feature space by measuring the feature distance between outliers and inliers. We then propose a framework, MCOD, using a memory module and a contrastive learning module. The memory module constrains the consistency of features, which represent the normal data. The contrastive learning module learns more discriminating features, which boosts the distinction between outliers and inliers. Extensive experiments on four benchmark datasets show that our proposed MCOD achieves a considerable performance and outperforms nine state of the art methods.


Planning with Learned Entity Prompts for Abstractive Summarization. We introduce a simple but flexible mechanism to learn an intermediate plan to ground the generation of abstractive summaries. Specifically, we prepend (or prompt) target summaries with entity chains ordered sequences of entities mentioned in the summary. Transformer based sequence to sequence models are then trained to generate the entity chain and then continue generating the summary conditioned on the entity chain and the input. We experimented with both pretraining and finetuning with this content planning objective. When evaluated on CNN DailyMail, XSum, SAMSum and BillSum, we demonstrate empirically that the grounded generation with the planning objective improves entity specificity and planning in summaries for all datasets, and achieves state of the art performance on XSum and SAMSum in terms of Rouge. Moreover, we demonstrate empirically that planning with entity chains provides a mechanism to control hallucinations in abstractive summaries. By prompting the decoder with a modified content plan that drops hallucinated entities, we outperform state of the art approaches for faithfulness when evaluated automatically and by humans.


On quantitative uniqueness for parabolic equations. We consider the quantitative uniqueness properties for a parabolic type equation u t Delta u w(x,t) nabla u v(x,t) u , when v in L p 2 t L p 1 x and w in L q 2 t L q 1 x , with a suitable range for exponents p 1 , p 2 , q 1 , and q 2 . We prove a strong unique continuation property and provide a pointwise in time observability estimate.


Computationally Efficient Climate Predictions using Multi Fidelity Surrogate Modelling. Accurately modelling the Earth's climate has widespread applications ranging from forecasting local weather to understanding global climate change. Low fidelity simulations of climate phenomena are readily available, but high fidelity simulations are expensive to obtain. We therefore investigate the potential of Gaussian process based multi fidelity surrogate modelling as a way to produce high fidelity climate predictions at low cost. Specifically, our model combines the predictions of a low fidelity Global Climate Model (GCM) and those of a high fidelity Regional Climate Model (RCM) to produce high fidelity temperature predictions for a mountainous region on the coastline of Peru. We are able to produce high fidelity temperature predictions at significantly lower computational cost compared to the high fidelity model alone our predictions have an average error of 15.62 circ text C 2 yet our approach only evaluates the high fidelity model on 6 of the region of interest.


Extending Partial Representations of Circular Arc Graphs. The partial representation extension problem generalizes the recognition problem for classes of graphs defined in terms of vertex representations. We exhibit circular arc graphs as the first example of a graph class where the recognition is polynomially solvable while the representation extension problem is NP complete. In this setting, several arcs are predrawn and we ask whether this partial representation can be completed. We complement this hardness argument with tractability results of the representation extension problem on various subclasses of circular arc graphs, most notably on all variants of Helly circular arc graphs. In particular, we give linear time algorithms for extending normal proper Helly and proper Helly representations. For normal Helly circular arc representations we give an O(n 3) time algorithm. Surprisingly, for Helly representations, the complexity hinges on the seemingly irrelevant detail of whether the predrawn arcs have distinct or non distinct endpoints In the former case the previous algorithm can be extended, whereas the latter case turns out to be NP complete. We also prove that representation extension problem of unit circular arc graphs is NP complete.


ComFormer Code Comment Generation via Transformer and Fusion Method based Hybrid Code Representation. Developers often write low quality code comments due to the lack of programming experience, which can reduce the efficiency of developers program comprehension. Therefore, developers hope that code comment generation tools can be developed to illustrate the functionality and purpose of the code. Recently, researchers mainly model this problem as the neural machine translation problem and tend to use deep learning based methods. In this study, we propose a novel method ComFormer based on Transformer and fusion method based hybrid code presentation. Moreover, to alleviate OOV (out of vocabulary) problem and speed up model training, we further utilize the Byte BPE algorithm to split identifiers and Sim SBT method to perform AST Traversal. We compare ComFormer with seven state of the art baselines from code comment generation and neural machine translation domains. Comparison results show the competitiveness of ComFormer in terms of three performance measures. Moreover, we perform a human study to verify that ComFormer can generate high quality comments.


GCCAD Graph Contrastive Coding for Anomaly Detection. Graph based anomaly detection has been widely used for detecting malicious activities in real world applications. Existing attempts to address this problem have thus far focused on structural feature engineering or learning in the binary classification regime. In this work, we propose to leverage graph contrastive coding and present the supervised GCCAD model for contrasting abnormal nodes with normal ones in terms of their distances to the global context (e.g., the average of all nodes). To handle scenarios with scarce labels, we further enable GCCAD as a self supervised framework by designing a graph corrupting strategy for generating synthetic node labels. To achieve the contrastive objective, we design a graph neural network encoder that can infer and further remove suspicious links during message passing, as well as learn the global context of the input graph. We conduct extensive experiments on four public datasets, demonstrating that 1) GCCAD significantly and consistently outperforms various advanced baselines and 2) its self supervised version without fine tuning can achieve comparable performance with its fully supervised version.


Low lying zeros in families of elliptic curve L functions over function fields. We investigate the low lying zeros in families of L functions attached to quadratic and cubic twists of elliptic curves defined over mathbb F q(T) . In particular, we present precise expressions for the expected values of traces of high powers of the Frobenius class in these families with a focus on the lower order behavior. As an application we obtain results on one level densities and we verify that these elliptic curve families have orthogonal symmetry type. In the quadratic twist families our results refine previous work of Comeau Lapointe. Moreover, in this case we find a lower order term in the one level density reminiscent of the deviation term found by Rudnick in the hyperelliptic ensemble. On the other hand, our investigation is the first to treat these questions in families of cubic twists of elliptic curves and in this case it turns out to be more complicated to isolate lower order terms due to a larger degree of cancellation among lower order contributions.


Mini batch stochastic Nesterov's smoothing method for constrained convex stochastic composite optimization. This paper considers a class of constrained convex stochastic composite optimization problems whose objective function is given by the summation of a differentiable convex component, together with a nonsmooth but convex component. The nonsmooth component has an explicit max structure that may not easy to compute its proximal mapping. In order to solve these problems, we propose a mini batch stochastic Nesterov's smoothing (MSNS) method. Convergence and the optimal iteration complexity of the method are established. Numerical results are provided to illustrate the efficiency of the proposed MSNS method for a support vector machine (SVM) model.


Homology of the completion of a Lie algebra. We prove that the second homology group of the completion of an infinite dimensional free Lie algebra is uncountable.


Affect2MM Affective Analysis of Multimedia Content Using Emotion Causality. We present Affect2MM, a learning method for time series emotion prediction for multimedia content. Our goal is to automatically capture the varying emotions depicted by characters in real life human centric situations and behaviors. We use the ideas from emotion causation theories to computationally model and determine the emotional state evoked in clips of movies. Affect2MM explicitly models the temporal causality using attention based methods and Granger causality. We use a variety of components like facial features of actors involved, scene understanding, visual aesthetics, action situation description, and movie script to obtain an affective rich representation to understand and perceive the scene. We use an LSTM based learning model for emotion perception. To evaluate our method, we analyze and compare our performance on three datasets, SENDv1, MovieGraphs, and the LIRIS ACCEDE dataset, and observe an average of 10 15 increase in the performance over SOTA methods for all three datasets.


A review of systematic selection of clustering algorithms and their evaluation. Data analysis plays an indispensable role for value creation in industry. Cluster analysis in this context is able to explore given datasets with little or no prior knowledge and to identify unknown patterns. As (big) data complexity increases in the dimensions volume, variety, and velocity, this becomes even more important. Many tools for cluster analysis have been developed from early on and the variety of different clustering algorithms is huge. As the selection of the right clustering procedure is crucial to the results of the data analysis, users are in need for support on their journey of extracting knowledge from raw data. Thus, the objective of this paper lies in the identification of a systematic selection logic for clustering algorithms and corresponding validation concepts. The goal is to enable potential users to choose an algorithm that fits best to their needs and the properties of their underlying data clustering problem. Moreover, users are supported in selecting the right validation concepts to make sense of the clustering results. Based on a comprehensive literature review, this paper provides assessment criteria for clustering method evaluation and validation concept selection. The criteria are applied to several common algorithms and the selection process of an algorithm is supported by the introduction of pseudocode based routines that consider the underlying data structure.


Dg manifolds, formal exponential maps and homotopy Lie algebras. This paper is devoted to the study of the relation between formal exponential maps,' the Atiyah class, and Kapranov L infty 1 algebras associated with dg manifolds in the C infty context. Given a dg manifold, we prove that a formal exponential map' exists if and only if the Atiyah class vanishes. Inspired by Kapranov's construction of a homotopy Lie algebra associated with the holomorphic tangent bundle of a complex manifold, we prove that the space of vector fields on a dg manifold admits an L infty 1 algebra structure, unique up to isomorphism, whose unary bracket is the Lie derivative w.r.t. the homological vector field, whose binary bracket is a 1 cocycle representative of the Atiyah class, and whose higher multibrackets can be computed by a recursive formula. For the dg manifold (T X 0,1 1 , bar partial ) arising from a complex manifold X , we prove that this L infty 1 algebra structure is quasi isomorphic to the standard L infty 1 algebra structure on the Dolbeault complex Omega 0, bullet (T 1,0 X) .


Reinforcement Learning based Collective Entity Alignment with Adaptive Features. Entity alignment (EA) is the task of identifying the entities that refer to the same real world object but are located in different knowledge graphs (KGs). For entities to be aligned, existing EA solutions treat them separately and generate alignment results as ranked lists of entities on the other side. Nevertheless, this decision making paradigm fails to take into account the interdependence among entities. Although some recent efforts mitigate this issue by imposing the 1 to 1 constraint on the alignment process, they still cannot adequately model the underlying interdependence and the results tend to be sub optimal. To fill in this gap, in this work, we delve into the dynamics of the decision making process, and offer a reinforcement learning (RL) based model to align entities collectively. Under the RL framework, we devise the coherence and exclusiveness constraints to characterize the interdependence and restrict collective alignment. Additionally, to generate more precise inputs to the RL framework, we employ representative features to capture different aspects of the similarity between entities in heterogeneous KGs, which are integrated by an adaptive feature fusion strategy. Our proposal is evaluated on both cross lingual and mono lingual EA benchmarks and compared against state of the art solutions. The empirical results verify its effectiveness and superiority.


Photon counting spectral phase contrast mammography. Phase contrast imaging is an emerging technology that may increase the signal difference to noise ratio in medical imaging. One of the most promising phase contrast techniques is Talbot interferometry, which, combined with energy sensitive photon counting detectors, enables spectral differential phase contrast mammography. We have evaluated a realistic system based on this technique by cascaded systems analysis and with a task dependent ideal observer detectability index as a figure of merit. Beam propagation simulations were used for validation and illustration of the analytical framework. Differential phase contrast improved detectability compared to absorption contrast, in particular for fine tumor structures. This result was supported by images of human mastectomy samples that were acquired with a conventional detector. The optimal incident energy was higher in differential phase contrast than in absorption contrast when disregarding the setup design energy. Further, optimal weighting of the transmitted spectrum was found to have a weaker energy dependence than for absorption contrast. Taking the design energy into account yielded a superimposed maximum on both detectability as a function of incident energy, and on optimal weighting. Spectral material decomposition was not facilitated by phase contrast, but phase information may be used instead of spectral information.


Analyzing a Caching Model. Machine Learning has been successfully applied in systems applications such as memory prefetching and caching, where learned models have been shown to outperform heuristics. However, the lack of understanding the inner workings of these models interpretability remains a major obstacle for adoption in real world deployments. Understanding a model's behavior can help system administrators and developers gain confidence in the model, understand risks, and debug unexpected behavior in production. Interpretability for models used in computer systems poses a particular challenge Unlike ML models trained on images or text, the input domain (e.g., memory access patterns, program counters) is not immediately interpretable. A major challenge is therefore to explain the model in terms of concepts that are approachable to a human practitioner. By analyzing a state of the art caching model, we provide evidence that the model has learned concepts beyond simple statistics that can be leveraged for explanations. Our work provides a first step towards explanability of system ML models and highlights both promises and challenges of this emerging research area.


Perturbed and Strict Mean Teachers for Semi supervised Semantic Segmentation. Consistency learning using input image, feature, or network perturbations has shown remarkable results in semi supervised semantic segmentation, but this approach can be seriously affected by inaccurate predictions of unlabelled training images. There are two consequences of these inaccurate predictions 1) the training based on the "strict" cross entropy (CE) loss can easily overfit prediction mistakes, leading to confirmation bias and 2) the perturbations applied to these inaccurate predictions will use potentially erroneous predictions as training signals, degrading consistency learning. In this paper, we address the prediction accuracy problem of consistency learning methods with novel extensions of the mean teacher (MT) model, which include a new auxiliary teacher, and the replacement of MT's mean square error (MSE) by a stricter confidence weighted cross entropy (Conf CE) loss. The accurate prediction by this model allows us to use a challenging combination of network, input data and feature perturbations to improve the consistency learning generalisation, where the feature perturbations consist of a new adversarial perturbation. Results on public benchmarks show that our approach achieves remarkable improvements over the previous SOTA methods in the field. Our code is available at https github.com yyliu01 PS MT.


Binomial expansion for saturated and symbolic powers of sums of ideals. There are two different notions for symbolic powers of ideals existing in the literature, one defined in terms of associated primes, the other in terms of minimal primes. Elaborating on an idea known to Eisenbud, Herzog, Hibi, and Trung, we interpret both notions of symbolic powers as suitable saturations of the ordinary powers. We prove a binomial expansion formula for saturated powers of sums of ideals. This gives a uniform treatment to an array of existing and new results on both notions of symbolic powers of such sums binomial expansion formulas, computations of depth and regularity, and criteria for the equality of ordinary and symbolic powers.


A Generalized Mountain Pass Lemma with a Closed Subset for Locally Lipschitz Functionals. The classical Mountain Pass Lemma of Ambrosetti Rabinowitz has been studied, extended and modified in several directions. Notable examples would certainly include the generalization to locally Lipschitz functionals by K.C. Chang, analyzing the structure of the critical set in the mountain pass theorem in the works of Hofer, Pucci Serrin and Tian, and the extension by Ghoussoub Preiss to closed subsets in a Banach space with recent variations. In this paper, we utilize the generalized gradient of Clarke and Ekeland's variatonal principle to generalize the Ghoussoub Preiss's Theorem in the setting of locally Lipschitz functionals. We give an application to periodic solutions of Hamiltonian systems.


Optimal Control of Semilinear Parabolic Equations with Non smooth Pointwise Integral Control Constraints in Time Space. This work concentrates on a class of optimal control problems for semilinear parabolic equations subject to control constraint of the form u(t) L 1( Omega) le gamma for t in (0,T) . This limits the total control that can be applied to the system at any instant of time. The L 1 norm of the constraint leads to sparsity of the control in space, for the time instants when the constraint is active. Due to the non smoothness of the constraint, the analysis of the control problem requires new techniques. Existence of a solution, first and second order optimality conditions, and regularity of the optimal control are proved. Further, stability of the optimal controls with respect to gamma is investigated on the basis of different second order conditions.


Vision based Excavator Activity Analysis and Safety Monitoring System. In this paper, we propose an excavator activity analysis and safety monitoring system, leveraging recent advancements in deep learning and computer vision. Our proposed system detects the surrounding environment and the excavators while estimating the poses and actions of the excavators. Compared to previous systems, our method achieves higher accuracy in object detection, pose estimation, and action recognition tasks. In addition, we build an excavator dataset using the Autonomous Excavator System (AES) on the waste disposal recycle scene to demonstrate the effectiveness of our system. We also evaluate our method on a benchmark construction dataset. The experimental results show that the proposed action recognition approach outperforms the state of the art approaches on top 1 accuracy by about 5.18 .


A Penalty free Infeasible Approach for a Class of Nonsmooth Optimization Problems over the Stiefel Manifold. Transforming into an exact penalty function model with convex compact constraints yields efficient infeasible approaches for optimization problems with orthogonality constraints. For smooth and ell 2,1 norm regularized cases, these infeasible approaches adopt simple and orthonormalization free updating scheme and show their high efficiency in the test examples. However, to avoid orthonormalization while enforcing the feasibility of the final solution, these infeasible approaches introduce a quadratic penalty term, where an inappropriate penalty parameter can lead to numerical inefficiency. Inspired by penalty free approaches for smooth optimization problems, we proposed a proximal first order algorithm for a class of optimization problems with orthogonality constraints and nonsmooth regularization term. The consequent algorithm, named sequential linearized proximal gradient method (SLPG), alternatively takes tangential steps and normal steps to improve the optimality and feasibility respectively. In SLPG, the orthonormalization process is invoked only once at the last step if high precision in feasibility is needed, showing that main iterations in SLPG are orthonormalization free. Besides, both the tangential steps and normal steps do not involve the penalty parameter, and thus SLPG is penalty free and avoids the inefficiency by inappropriate penalty parameter. We analyze the global convergence properties of SLPG where the tangential steps are inexactly computed. By inexactly computing tangential steps, for smooth cases and ell 2,1 norm regularized cases, SLPG has a closed form updating scheme, which leads to its cheap tangential steps. Numerical experiments illustrate the numerical advantages of SLPG when compared with existing first order methods.


The supercritical deformed Hermitian Yang Mills equation on compact projective manifolds. In this paper, we extend a result of Gao Chen regarding the solvability of the twisted deformed Hermitian Yang Mills equations on compact K "ahler manifolds to allow for the twisting function to be non constant and slightly negative in all dimensions. Using this result, we prove that the twisted supercritical dHYM equation on compact, projective manifolds can be solved provided certain numerical conditions are satisfied.


Preferential Structures for Comparative Probabilistic Reasoning. Qualitative and quantitative approaches to reasoning about uncertainty can lead to different logical systems for formalizing such reasoning, even when the language for expressing uncertainty is the same. In the case of reasoning about relative likelihood, with statements of the form varphi succsim psi expressing that varphi is at least as likely as psi , a standard qualitative approach using preordered preferential structures yields a dramatically different logical system than a quantitative approach using probability measures. In fact, the standard preferential approach validates principles of reasoning that are incorrect from a probabilistic point of view. However, in this paper we show that a natural modification of the preferential approach yields exactly the same logical system as a probabilistic approach not using single probability measures, but rather sets of probability measures. Thus, the same preferential structures used in the study of non monotonic logics and belief revision may be used in the study of comparative probabilistic reasoning based on imprecise probabilities.


Broadband energy squeezing and tunneling based on unidirectional modes. Energy squeezing attracts many attentions for its potential applications in electromagnetic (EM) energy harvesting and optical communication. However, due to the Fabry Perot resonance, only the EM waves with discrete frequencies can be squeezed and, as far as we know, in the previous energy squeezing devices, stringent requirements of the materials or the geometrical shape are needed. We note that the structures filled with epsilon near zero (ENZ) mediums as reported in some works can squeeze and tunnel EM waves at frequencies (e.g. plasma frequency). However, the group velocity is usually near zero which means few EM information travel through the structures. In this paper, low loss energy squeezing and tunneling (EST) based on unidirectional modes were demonstrated in YIG based one way waveguides at microwave frequencies. According to our theoretical analysis and the simulations using finite element method, broadband EST was achieved and the EM EST was observed even for extremely bended structures. Besides, similar EM EST was achieved in a realistic three dimensional remanence based one way waveguide as well. The unidirectional modes based EST paving the way to ultra subwavelength EM focusing, enhanced nonlinear optics, and designing numerous functional devices in integrated optical circuits such as phase modulator.


Proof Theoretic Semantics, a Problem with Negation and Prospects for Modality. This paper discusses proof theoretic semantics, the project of specifying the meanings of the logical constants in terms of rules of inference governing them. I concentrate on Michael Dummett's and Dag Prawitz' philosophical motivations and give precise characterisations of the crucial notions of harmony and stability, placed in the context of proving normalisation results in systems of natural deduction. I point out a problem for defining the meaning of negation in this framework and prospects for an account of the meanings of modal operators in terms of rules of inference.


Combining Set Propagation with Finite Element Methods for Time Integration in Transient Solid Mechanics Problems. The Finite Element Method (FEM) is the gold standard for spatial discretization in numerical simulations for a wide spectrum of real world engineering problems. Prototypical areas of interest include linear heat transfer and linear structural dynamics problems modeled with partial differential equations (PDEs). While different algorithms for direct integration of the equations of motion exist, exploring all feasible behaviors for varying loads, initial states and fluxes in models with large numbers of degrees of freedom remains a challenging task. In this article we propose a novel approach, based in set propagation methods and motivated by recent advances in the field of Reachability Analysis. Assuming a set of initial states and inputs, the proposed method consists in the construction of a union of sets (flowpipe) that enclose the infinite number of solutions of the spatially discretized PDE. We present the numerical results obtained in five examples to illustrate the capabilities of our approach, and compare its performance against reference numerical integration methods. We conclude that, for problems with single known initial conditions, the proposed method is accurate. For problems with uncertain initial conditions included in sets, the proposed method can compute all the solutions of the system more efficiently than numerical integration methods.


A Topic Guided Pointer Generator Model for Generating Natural Language Code Summaries. Code summarization is the task of generating natural language description of source code, which is important for program understanding and maintenance. Existing approaches treat the task as a machine translation problem (e.g., from Java to English) and applied Neural Machine Translation models to solve the problem. These approaches only consider a given code unit (e.g., a method) without its broader context. The lacking of context may hinder the NMT model from gathering sufficient information for code summarization. Furthermore, existing approaches use a fixed vocabulary and do not fully consider the words in code, while many words in the code summary may come from the code. In this work, we present a neural network model named ToPNN for code summarization, which uses the topics in a broader context (e.g., class) to guide the neural networks that combine the generation of new words and the copy of existing words in code. Based on the model we present an approach for generating natural language code summaries at the method level (i.e., method comments). We evaluate our approach using a dataset with 4,203,565 commented Java methods. The results show significant improvement over state of the art approaches and confirm the positive effect of class topics and the copy mechanism.


Qualitative Planning in Imperfect Information Games with Active Sensing and Reactive Sensor Attacks Cost of Unawareness. We consider the probabilistic planning problem where the agent (called Player 1, or P1) can jointly plan the control actions and sensor queries in a sensor network and an attacker (called player 2, or P2) can carry out attacks on the sensors. We model such an adversarial interaction using a formal model a reachability game with partially controllable observation functions. The main contribution of this paper is to assess the cost of P1's unawareness Suppose P1 misinterprets the sensor failures as probabilistic node failures due to unreliable network communication, and P2 is aware of P1's misinterpretation in addition to her partial observability. Then, from which states can P2 carry out sensor attacks to ensure, with probability one, that P1 will not be able to complete her reachability task even though, due to misinterpretation, P1 believes that she can almost surely achieve her task. We develop an algorithm to solve the almost sure winning sensor attack strategy given P1's observation based strategy. Our attack analysis could be used for attack detection in wireless communication networks and the design of provably secured attack aware sensor allocation in decision theoretic models for cyber physical systems.


Safe Affine Transformation Based Guidance of a Large Scale Multi Quadcopter System (MQS). This paper studies the problem of affine transformation based guidance of a multi quadcopter system (MQS) in an obstacle laden environment. Such MQSs can perform a variety of cooperative tasks including information collection, inspection mapping, disinfection, and firefighting. The MQS affine transformation is an approach to a decentralized leader follower coordination guided by n 1 leaders, where leaders are located at vertices of an n D simplex, called leading simplex, at any time t. The remaining agents are followers acquiring the desired affine transformation via local communication. Followers are contained in a rigid size ball at any time t but they can be distributed either inside or outside the leading simplex. By eigen decomposition of the affine transformation coordination, safety in a large scale MQS coordination can be ensured by constraining eigenvalues of the affine transformation. Given the initial and final configurations of the MQS, A star search is applied to optimally plan safe coordination of a large scale MQS minimizing the travel distance between the the initial and final configuration. The paper also proposes a proximity based communication topology for followers to assign communication weights with their in neighbors and acquire the desired coordination with minimal computation cost.


Blockchains for Spectrum Management in Wireless Networks A Survey. Regulatory radio spectrum management is evolving from traditional static frequency allocation and assignment schemes towards dynamic spectrum management and access schemes. This evolution is necessitated by a number of factors including underutilization of licensed spectrum bands, changing market and technological developments and increased demand for spectrum for emerging applications in multimedia communications, internet of things and fifth generation (5G) wireless networks. In simple terms dynamic spectrum management involves allowing unlicensed users known as secondary users (SUs) to access the licensed spectrum of a licensed user also known as primary user (PU). This is primarily achieved using spectrum sharing schemes that leverage spectrum database and cognitive radio techniques. However, the use of spectrum database and cognitive radio techniques faces reliability, security and privacy concerns for spectrum sharing. There is also a need to support other requirements of dynamic spectrum management such as secondary spectrum trading market and dynamic spectrum access coordination. In this work, we review the use of blockchains for enabling spectrum sharing and other aspects of dynamic spectrum management. The review covers the use of blockchain to record spectrum management information such as spectrum sensing results and spectrum auction transactions in a secure manner. The article also covers the use of smart contracts to support complex service levelagreements (SLAs) between network operators which is key to supporting a self organized secondary spectrum sharing market and enforcement of regulatory policies. A taxonomy of the intersection between blockchain and various concepts of dynamic spectrum management is also provided


The numerical range of some periodic tridiagonal operators is the convex hull of the numerical ranges of two finite matrices. In this paper we prove a conjecture stated by the first two authors establishing the closure of the numerical range of a certain class of n 1 periodic tridiagonal operators as the convex hull of the numerical ranges of two tridiagonal (n 1) times (n 1) matrices. Furthermore, when n 1 is odd, we show that the size of such matrices simplifies to frac n 2 1 .


A Non intrusive Failure Prediction Mechanism for Deployed Optical Networks. Failures in optical network backbone can lead to major disruption of internet data traffic. Hence, minimizing such failures is of paramount importance for the network operators. Even better, if the network failures can be predicted and preventive steps can be taken in advance to avoid any disruption in traffic. Various data driven and machine learning techniques have been proposed in literature for failure prediction. Most of these techniques need real time data from the networks and also need different monitors to measure key optical parameters. This means provision for failure prediction has to be available in network nodes, e.g., routers and network management systems. However, sometimes deployed networks do not have failure prediction built into their initial design but subsequently need arises for such mechanisms. For such systems, there are two key challenges. Firstly, statistics of failure distribution, data, etc., are not readily available. Secondly, major changes cannot be made to the network nodes which are already commercially deployed. This paper proposes a novel implementable non intrusive failure prediction mechanism for deployed network nodes using information from log files of those devices. Numerical results show that the mechanism has near perfect accuracy in predicting failures of individual network nodes.


Convergence to nonlinear diffusion waves for a hyperbolic parabolic chemotaxis system modelling vasculogenesis. In this paper, we are concerned with a quasi linear hyperbolic parabolic system of persistence and endogenous chemotaxis modelling vasculogenesis in mathbb R . Under some suitable structural assumption on the pressure function, we first predict the system admits a nonlinear diffusion wave in mathbb R based on the empirical results in the literature. Then we show that the solution of the concerned system will locally and asymptotically converges to this nonlinear diffusion wave if the wave strength is small. By using the time weighted energy estimates, we further prove that the convergence rate of the nonlinear diffusion wave is algebraic.


The Gordon Litherland pairing for links in thickened surfaces. We extend the Gordon Litherland pairing to links in thickened surfaces, and use it to define signature, determinant, and nullity invariants for links that bound (unoriented) spanning surfaces. The invariants are seen to depend only on the S equivalence class of the spanning surface. We prove a duality result relating the invariants from one S equivalence class of spanning surfaces to the restricted invariants of the other. Using Kuperberg's theorem, these invariants give rise to well defined invariants of checkerboard colorable virtual links. The determinants can be applied to determine the minimal support genus of a checkerboard colorable virtual link. The duality result leads to a simple algorithm for computing the invariants from the Tait graph associated to a checkerboard coloring. We show these invariants simultaneously generalize the combinatorial invariants defined by Im, Lee, and Lee, and those defined by Boden, Chrisman, and Gaudreau for almost classical links. We examine the behavior of the invariants under orientation reversal, mirror symmetry, and crossing change. We give a 4 dimensional interpretation of the Gordon Litherland pairing by relating it to the intersection form on the relative homology of certain double branched covers. This correspondence is made explicit through the use of virtual linking matrices associated to (virtual) spanning surfaces and their associated (virtual) Kirby diagrams.


Explanation Aware Experience Replay in Rule Dense Environments. Human environments are often regulated by explicit and complex rulesets. Integrating Reinforcement Learning (RL) agents into such environments motivates the development of learning mechanisms that perform well in rule dense and exception ridden environments such as autonomous driving on regulated roads. In this paper, we propose a method for organising experience by means of partitioning the experience buffer into clusters labelled on a per explanation basis. We present discrete and continuous navigation environments compatible with modular rulesets and 9 learning tasks. For environments with explainable rulesets, we convert rule based explanations into case based explanations by allocating state transitions into clusters labelled with explanations. This allows us to sample experiences in a curricular and task oriented manner, focusing on the rarity, importance, and meaning of events. We label this concept Explanation Awareness (XA). We perform XA experience replay (XAER) with intra and inter cluster prioritisation, and introduce XA compatible versions of DQN, TD3, and SAC. Performance is consistently superior with XA versions of those algorithms, compared to traditional Prioritised Experience Replay baselines, indicating that explanation engineering can be used in lieu of reward engineering for environments with explainable features.


TPSNet Thin Plate Spline Representation for Arbitrary Shape Scene Text Detection. The research focus of scene text detection has shifted to arbitrary shape text in recent years, in which text representation is a fundamental problem. An ideal representation should be compact, complete, integral, and reusable for subsequent recognition in our opinion. However, previous representations suffer from one or several aspects. Thin Plate Spline (TPS) transformation has achieved great success in scene text recognition. Inspired from this, we reversely think its usage and sophisticatedly take TPS as an exquisite representation for arbitrary shape text detection. The TPS representation is compact, complete and integral, and with the predicted TPS parameters, the detected text region can be rectified to near horizontal one which is beneficial for subsequent recognition. To solve the supervision problem of TPS training without key point annotations, two novel losses including the boundary set loss and the shape alignment loss are proposed. Extensive evaluation and ablation on several public benchmarks demonstrate the effectiveness and superiority of the proposed method.


2 switch transition on unicyclic graphs and pseudoforest. In the present work we prove that given any two unicycle graphs (pseudoforests) that share the same degree sequence there is a finite sequence of 2 switches transforming one into the other such that all the graphs in the sequence are also unicyclic graphs (pseudoforests).


Seed banks can help to maintain the diversity of interacting phytoplankton species. Seed formation is part of the reproductive cycle, leading to the accumulation of resistance stages that can withstand harsh environmental conditions for long periods of time. At the community level, multiple species with such long lasting life stages can be more likely to coexist. While the implications of this process for biodiversity have been studied in terrestrial plants, seed banks are usually neglected in phytoplankton multispecies dynamic models, in spite of widespread empirical evidence for such seed banks. In this study, we build a metacommunity model of interacting phytoplankton species, including a resting stage supplying the seed bank. The model is parameterized with empirically driven growth rate functions and field based interaction estimates, which include both facilitative and competitive interactions. Exchanges between compartments (coastal pelagic cells, coastal resting cells on the seabed, and open ocean pelagic cells) are controlled by hydrodynamical parameters to which the sensitivity of the model is assessed. We consider two models, i.e., with and without a saturating effect of the interactions on the growth rates. Our results are consistent between models, and show that a seed bank allows to maintain all species in the community over 30 years. Indeed, a fraction of the species are vulnerable to extinction at specific times within the year, but this process is buffered by their survival in their resting stage. We thus highlight the potential role of the seed bank in the recurrent re invasion of the coastal community, and of coastal environments in re seeding oceanic regions. Moreover, the seed bank enables populations to tolerate stronger interactions within the community as well as more severe changes to the environment, such as those predicted in a climate change context. Our study therefore shows how resting stages may help phytoplanktonic diversity maintenance.


Attention based Multi Reference Learning for Image Super Resolution. This paper proposes a novel Attention based Multi Reference Super resolution network (AMRSR) that, given a low resolution image, learns to adaptively transfer the most similar texture from multiple reference images to the super resolution output whilst maintaining spatial coherence. The use of multiple reference images together with attention based sampling is demonstrated to achieve significantly improved performance over state of the art reference super resolution approaches on multiple benchmark datasets. Reference super resolution approaches have recently been proposed to overcome the ill posed problem of image super resolution by providing additional information from a high resolution reference image. Multi reference super resolution extends this approach by providing a more diverse pool of image features to overcome the inherent information deficit whilst maintaining memory efficiency. A novel hierarchical attention based sampling approach is introduced to learn the similarity between low resolution image features and multiple reference images based on a perceptual loss. Ablation demonstrates the contribution of both multi reference and hierarchical attention based sampling to overall performance. Perceptual and quantitative ground truth evaluation demonstrates significant improvement in performance even when the reference images deviate significantly from the target image. The project website can be found at https marcopesavento.github.io AMRSR


Chirotonia A Scalable and Secure e Voting Framework based on Blockchains and Linkable Ring Signatures. In this paper we propose a comprehensive and scalable framework to build secure by design e voting systems. Decentralization, transparency, determinism, and untamperability of votes are granted by dedicated smart contracts on a blockchain, while voter authenticity and anonymity are achieved through (provable secure) linkable ring signatures. These, in combination with suitable smart contract constraints, also grant protection from double voting. Our design is presented in detail, focusing on its security guarantees and the design choices that allow it to scale to a large number of voters. Finally, we present a proof of concept implementation of the proposed framework, made available as open source.


APTSHIELD A Stable, Efficient and Real time APT Detection System for Linux Hosts. Advanced Persistent Threat (APT) attack usually refers to the form of long term, covert and sustained attack on specific targets, with an adversary using advanced attack techniques to destroy the key facilities of an organization. APT attacks have caused serious security threats and massive financial loss worldwide. Academics and industry thereby have proposed a series of solutions to detect APT attacks, such as dynamic static code analysis, traffic detection, sandbox technology, endpoint detection and response (EDR), etc. However, existing defenses are failed to accurately and effectively defend against the current APT attacks that exhibit strong persistent, stealthy, diverse and dynamic characteristics due to the weak data source integrity, large data processing overhead and poor real time performance in the process of real world scenarios. To overcome these difficulties, in this paper we propose APTSHIELD, a stable, efficient and real time APT detection system for Linux hosts. In the aspect of data collection, audit is selected to stably collect kernel data of the operating system so as to carry out a complete portrait of the attack based on comprehensive analysis and comparison of existing logging tools In the aspect of data processing, redundant semantics skipping and non viable node pruning are adopted to reduce the amount of data, so as to reduce the overhead of the detection system In the aspect of attack detection, an APT attack detection framework based on ATT CK model is designed to carry out real time attack response and alarm through the transfer and aggregation of labels. Experimental results on both laboratory and Darpa Engagement show that our system can effectively detect web vulnerability attacks, file less attacks and remote access trojan attacks, and has a low false positive rate, which adds far more value than the existing frontier work.


Geant4 based Dosimetry Evaluation for Gamma Knife using Different Phantom Materials. This study analyses the dose difference for a variety of phantom materials that can be used for Leksell Gamma Knife. These materials have properties that are very similar to the human tissue not including the skull bone. Geant4 was employed in the analysis the dose distributions for collimator helmet sizes of 4mm and 8mm. The phantom had a radius of 80mm. Water, brain, PMMA (Poly methyl methacrylate) and polystyrene were used as the material types. Results showed no considerable differences for radiation dosimetries depending on the material types. In addition, the polystyrene and PMMA (Poly methyl methacrylate) phantom are also suitable for measuring the dose profiles of the Gamma Knife unit.


A Survey on Interactive Reinforcement Learning Design Principles and Open Challenges. Interactive reinforcement learning (RL) has been successfully used in various applications in different fields, which has also motivated HCI researchers to contribute in this area. In this paper, we survey interactive RL to empower human computer interaction (HCI) researchers with the technical background in RL needed to design new interaction techniques and propose new applications. We elucidate the roles played by HCI researchers in interactive RL, identifying ideas and promising research directions. Furthermore, we propose generic design principles that will provide researchers with a guide to effectively implement interactive RL applications.


Exercising in complex Mahler measures diamonds are not forever. Recently, Hang Liu and Hourong Qin came up with a numerical observation about the relation between the Mahler measures of one hyperelliptic and two elliptic families. The discoverers foresee a proof of the identities "by extending ideas in" two papers of Matilde Lal ' i n and Gang Wu, the ideas based on a theorem of Spencer Bloch and explicit diamond operation calculations on the underlying curves. We prove the relation using the already available diamond free methodology. While finding such relations for the Mahler measures remains an art, proving them afterwards is mere complex (analysis) exercising.


The Realization Problem for Dilation Surfaces. Dilation surfaces, or twisted quadratic differentials, are variants of translation surfaces. In this paper, we study the question of what elements or subgroups of the mapping class group can be realized as affine automorphisms of dilation surfaces. We show that dilation surfaces can have exotic Dehn twists in their affine automorphism groups and will establish that only certain types of mapping class group elements can arise as affine automorphisms of dilation surfaces. We also generalize a construction of Thurston that constructs a translation surface from a pair of filling multicurves to dilation surfaces. This construction will give us dilation surfaces that realize a pair of Dehn multitwists in their affine automorphism groups.


Anonymous Blockchain based System for Consortium. Blockchain brings various advantages to online transactions. However, the total transparency of these transactions may leakage users' sensitive information. Requirements on both cooperation and anonymity for companies organizations become necessary. In this paper, we propose a Multi center Anonymous Blockchain based (MAB) system, with joint management for the consortium and privacy protection for the participants. To achieve that, we formalize the syntax used by the MAB system and present a general construction based on a modular design. By applying cryptographic primitives to each module, we instantiate our scheme with anonymity and decentralization. Furthermore, we carry out a comprehensive formal analysis of the proposed solution. The results demonstrate our constructed scheme is secure and efficient.


DASentimental Detecting depression, anxiety and stress in texts via emotional recall, cognitive networks and machine learning. Most current affect scales and sentiment analysis on written text focus on quantifying valence (sentiment) the most primary dimension of emotion. However, emotions are broader and more complex than valence. Distinguishing negative emotions of similar valence could be important in contexts such as mental health. This project proposes a semi supervised machine learning model (DASentimental) to extract depression, anxiety and stress from written text. First, we trained the model to spot how sequences of recalled emotion words by N 200 individuals correlated with their responses to the Depression Anxiety Stress Scale (DASS 21). Within the framework of cognitive network science, we model every list of recalled emotions as a walk over a networked mental representation of semantic memory, with emotions connected according to free associations in people's memory. Among several tested machine learning approaches, we find that a multilayer perceptron neural network trained on word sequences and semantic network distances can achieve state of art, cross validated predictions for depression ( R 0.7 ), anxiety ( R 0.44 ) and stress ( R 0.52 ). Though limited by sample size, this first of its kind approach enables quantitative explorations of key semantic dimensions behind DAS levels. We find that semantic distances between recalled emotions and the dyad "sad happy" are crucial features for estimating depression levels but are less important for anxiety and stress. We also find that semantic distance of recalls from "fear" can boost the prediction of anxiety but it becomes redundant when the "sad happy" dyad is considered. Adopting DASentimental as a semi supervised learning tool to estimate DAS in text, we apply it to a dataset of 142 suicide notes. We conclude by discussing key directions for future research enabled by artificial intelligence detecting stress, anxiety and depression.


Fast Quantum Property Prediction via Deeper 2D and 3D Graph Networks. Molecular property prediction is gaining increasing attention due to its diverse applications. One task of particular interests and importance is to predict quantum chemical properties without 3D equilibrium structures. This is practically favorable since obtaining 3D equilibrium structures requires extremely expensive calculations. In this work, we design a deep graph neural network to predict quantum properties by directly learning from 2D molecular graphs. In addition, we propose a 3D graph neural network to learn from low cost conformer sets, which can be obtained with open source tools using an affordable budget. We employ our methods to participate in the 2021 KDD Cup on OGB Large Scale Challenge (OGB LSC), which aims to predict the HOMO LUMO energy gap of molecules. Final evaluation results reveal that we are one of the winners with a mean absolute error of 0.1235 on the holdout test set. Our implementation is available as part of the MoleculeX package (https github.com divelab MoleculeX).


CCGL Contrastive Cascade Graph Learning. Supervised learning, while prevalent for information cascade modeling, often requires abundant labeled data in training, and the trained model is not easy to generalize across tasks and datasets. It often learns task specific representations, which can easily result in overfitting for downstream tasks. Recently, self supervised learning is designed to alleviate these two fundamental issues in linguistic and visual tasks. However, its direct applicability for information cascade modeling, especially graph cascade related tasks, remains underexplored. In this work, we present Contrastive Cascade Graph Learning (CCGL), a novel framework for information cascade graph learning in a contrastive, self supervised, and task agnostic way. In particular, CCGL first designs an effective data augmentation strategy to capture variation and uncertainty by simulating the information diffusion in graphs. Second, it learns a generic model for graph cascade tasks via self supervised contrastive pre training using both unlabeled and labeled data. Third, CCGL learns a task specific cascade model via fine tuning using labeled data. Finally, to make the model transferable across datasets and cascade applications, CCGL further enhances the model via distillation using a teacher student architecture. We demonstrate that CCGL significantly outperforms its supervised and semi supervised counterparts for several downstream tasks.


Fairness in ERC token markets A Case Study of CryptoKitties. Fairness is an important trait of open, free markets. Ethereum is a platform meant to enable digital, decentralized markets. Though many researchers debate the market's fairness, there are few discussions around the fairness of automated markets, such as those hosted on Ethereum. In this paper, using pilot studies, we consider unfair factors caused by adding the program. Because CryptoKitties is one of the major blockchain based games and has been in operation for an extended period of time, we focus on its market to examine fairness. As a result, we concluded that a gene determination algorithm in this game has little randomness, and a significant advantage to gain profit is given to players who know its bias over those who do not. We state incompleteness and impact of the algorithm and other factors. Besides, we suppose countermeasures to reduce CryptoKitties' unfairness as a market.


The ring of U operators Definitions and Integrality. In this paper, we define and study the arithmetic of the ring of mathbb U operators for reductive p adic groups. These operators generalise the notion of "successor" operators for trees with a marked end. We show that they are integral over the spherical Hecke algebra. This integrality intervenes crucially in the construction of Euler systems obtained from special cycles of general Shimura varieties and the generalization of the famous Eichler Shimura relation.