Left, Right, and Gender Exploring Interaction Traces to Mitigate Human Biases. Human biases impact the way people analyze data and make decisions. Recent work has shown that some visualization designs can better support cognitive processes and mitigate cognitive biases (i.e., errors that occur due to the use of mental "shortcuts"). In this work, we explore how visualizing a user's interaction history (i.e., which data points and attributes a user has interacted with) can be used to mitigate potential biases that drive decision making by promoting conscious reflection of one's analysis process. Given an interactive scatterplot based visualization tool, we showed interaction history in real time while exploring data (by coloring points in the scatterplot that the user has interacted with), and in a summative format after a decision has been made (by comparing the distribution of user interactions to the underlying distribution of the data). We conducted a series of in lab experiments and a crowd sourced experiment to evaluate the effectiveness of interaction history interventions toward mitigating bias. We contextualized this work in a political scenario in which participants were instructed to choose a committee of 10 fictitious politicians to review a recent bill passed in the U.S. state of Georgia banning abortion after 6 weeks, where things like gender bias or political party bias may drive one's analysis process. We demonstrate the generalizability of this approach by evaluating a second decision making scenario related to movies. Our results are inconclusive for the effectiveness of interaction history (henceforth referred to as interaction traces) toward mitigating biased decision making. However, we find some mixed support that interaction traces, particularly in a summative format, can increase awareness of potential unconscious biases.


Effect of the Choice of Connectives on the Relation between the Logic of Constant Domains and Classical Predicate Logic. It is known that not only classical semantics but also intuitionistic Kripke semantics can be generalized so that it can treat arbitrary propositional connectives characterized by truth tables, or truth functions. In our previous work, it has been shown that the set of Kripke valid propositional sequents and that of classically valid propositional sequents coincide if and only if all available propositional connectives are monotonic. The present paper extend this result to frst order logic showing that, in the case of predicate logic, the condition that all available propositional connectives are monotonic is a necessary and sufficient condition for the set of sequents valid in all constant domain Kripke models, not the set of Kripke valid sequents, and the set of classically valid sequents to coincide.


Bursty magnetic reconnection at the Earth's magnetopause triggered by high speed jets. The impact of high speed jets dynamic pressure enhancements in the magnetosheath on the Earth's magnetopause has been observed to trigger local magnetic reconnection. We perform a three dimensional hybrid simulation to study the magnetosheath and magnetopause under turbulent conditions using a quasi radial southward interplanetary magnetic field (IMF). In contrast to quasi steady reconnection with a strong southward IMF, we show that after the impact of a jet on the magnetopause, the magnetopause moves inwards, the current sheet is compressed and intensified and signatures of local magnetic reconnection are observed, showing similarities to spacecraft measurements


Radiation constrained algorithms for Wireless Energy Transfer in Ad hoc Networks. We study the problem of efficiently charging a set of rechargeable nodes using a set of wireless chargers, under safety constraints on the electromagnetic radiation incurred. In particular, we define a new charging model that greatly differs from existing models in that it takes into account real technology restrictions of the chargers and nodes of the network, mainly regarding energy limitations. Our model also introduces non linear constraints (in the time domain), that radically change the nature of the computational problems we consider. In this charging model, we present and study the Low Radiation Efficient Charging Problem (LREC), in which we wish to optimize the amount of "useful" energy transferred from chargers to nodes (under constraints on the maximum level of imposed radiation). We present several fundamental properties of this problem and provide indications of its hardness. Finally, we propose an iterative local improvement heuristic for LREC, which runs in polynomial time and we evaluate its performance via simulation. Our algorithm decouples the computation of the objective function from the computation of the maximum radiation and also does not depend on the exact formula used for the computation of the electromagnetic radiation in each point of the network, achieving good trade offs between charging efficiency and radiation control it also exhibits good energy balance properties. We provide extensive simulation results supporting our claims and theoretical results.


Users' ability to perceive misinformation An information quality assessment approach. Digital information exchange enables quick creation and sharing of information and thus changes existing habits. Social media is becoming the main source of news for end users replacing traditional media. This also enables the proliferation of fake news, which misinforms readers and is used to serve the interests of the creators. As a result, automated fake news detection systems are attracting attention. However, automatic fake news detection presents a major challenge content evaluation is increasingly becoming the responsibility of the end user. Thus, in the present study we used information quality (IQ) as an instrument to investigate how users can detect fake news. Specifically, we examined how users perceive fake news in the form of shorter paragraphs on individual IQ dimensions. We also investigated which user characteristics might affect fake news detection. We performed an empirical study with 1123 users, who evaluated randomly generated stories with statements of various level of correctness by individual IQ dimensions. The results reveal that IQ can be used as a tool for fake news detection. Our findings show that (1) domain knowledge has a positive impact on fake news detection (2) education in combination with domain knowledge improves fake news detection and (3) personality trait conscientiousness contributes significantly to fake news detection in all dimensions.


Sliding Window Persistence of Quasiperiodic Functions. A function is called quasiperiodic if its fundamental frequencies are linearly independent over the rationals. With appropriate parameters, the sliding window point clouds of such functions can be shown to be dense in tori with dimension equal to the number of independent frequencies. In this paper, we develop theoretical and computational techniques to study the persistent homology of such sets. Specifically, we provide parameter optimization schemes for sliding windows of quasiperiodic functions, and present theoretical lower bounds on their Rips persistent homology. The latter leverages a recent persistent K " u nneth formula. The theory is illustrated via computational examples and an application to dissonance detection in music audio samples.


LAnoBERT System Log Anomaly Detection based on BERT Masked Language Model. The system log generated in a computer system refers to large scale data that are collected simultaneously and used as the basic data for determining simple errors and detecting external adversarial intrusion or the abnormal behaviors of insiders. The aim of system log anomaly detection is to promptly identify anomalies while minimizing human intervention, which is a critical problem in the industry. Previous studies performed anomaly detection through algorithms after converting various forms of log data into a standardized template using a parser. These methods involved generating a template for refining the log key. Particularly, a template corresponding to a specific event should be defined in advance for all the log data using which the information within the log key may get lost.In this study, we propose LAnoBERT, a parser free system log anomaly detection method that uses the BERT model, exhibiting excellent natural language processing performance. The proposed method, LAnoBERT, learns the model through masked language modeling, which is a BERT based pre training method, and proceeds with unsupervised learning based anomaly detection using the masked language modeling loss function per log key word during the inference process. LAnoBERT achieved better performance compared to previous methodology in an experiment conducted using benchmark log datasets, HDFS, and BGL, and also compared to certain supervised learning based models.


Real time FPGA Design for OMP Targeting 8K Image Reconstruction. During the past decade, implementing reconstruction algorithms on hardware has been at the center of much attention in the field of real time reconstruction in Compressed Sensing (CS). Orthogonal Matching Pursuit (OMP) is the most widely used reconstruction algorithm on hardware implementation because OMP obtains good quality reconstruction results under a proper time cost. OMP includes Dot Product (DP) and Least Square Problem (LSP). These two parts have numerous division calculations and considerable vector based multiplications, which limit the implementation of real time reconstruction on hardware. In the theory of CS, besides the reconstruction algorithm, the choice of sensing matrix affects the quality of reconstruction. It also influences the reconstruction efficiency by affecting the hardware architecture. Thus, designing a real time hardware architecture of OMP needs to take three factors into consideration. The choice of sensing matrix, the implementation of DP and LSP. In this paper, a sensing matrix, which is sparsity and contains zero vectors mainly, is adopted to optimize the OMP reconstruction to break the bottleneck of reconstruction efficiency. Based on the features of the chosen matrix, the DP and LSP are implemented by simple shift, add and comparing procedures. This work is implemented on the Xilinx Virtex UltraScale FPGA device. To reconstruct a digital signal with 1024 length under 0.25 sampling rate, the proposal method costs 0.818us while the state of the art costs 238 us. Thus, this work speedups the state of the art method 290 times. This work costs 0.026s to reconstruct an 8K gray image, which achieves 30FPS real time reconstruction.


Kalman Filter from the Mutual Information Perspective. Kalman filter is a best linear unbiased state estimator. It is also comprehensible from the point view of the Bayesian estimation. However, this note gives a detailed derivation of Kalman filter from the mutual information perspective for the first time. Then we extend this result to the R 'enyi mutual information. Finally we draw the conclusion that the measurement update of the Kalman filter is the key step to minimize the uncertainty of the state of the dynamical system.


Class agnostic moving target detection by color and location prediction of moving area. Moving target detection plays an important role in computer vision. However, traditional algorithms such as frame difference and optical flow usually suffer from low accuracy or heavy computation. Recent algorithms such as deep learning based convolutional neural networks have achieved high accuracy and real time performance, but they usually need to know the classes of targets in advance, which limits the practical applications. Therefore, we proposed a model free moving target detection algorithm. This algorithm extracts the moving area through the difference of image features. Then, the color and location probability map of the moving area will be calculated through maximum a posteriori probability. And the target probability map can be obtained through the dot multiply between the two maps. Finally, the optimal moving target area can be solved by stochastic gradient descent on the target probability map. Results show that the proposed algorithm achieves the highest accuracy compared with state of the art algorithms, without needing to know the classes of targets. Furthermore, as the existing datasets are not suitable for moving target detection, we proposed a method for producing evaluation dataset. Besides, we also proved the proposed algorithm can be used to assist target tracking.


Supervised learning for crop weed classification based on color and texture features. Computer vision techniques have attracted a great interest in precision agriculture, recently. The common goal of all computer vision based precision agriculture tasks is to detect the objects of interest (e.g., crop, weed) and discriminating them from the background. The Weeds are unwanted plants growing among crops competing for nutrients, water, and sunlight, causing losses to crop yields. Weed detection and mapping is critical for site specific weed management to reduce the cost of labor and impact of herbicides. This paper investigates the use of color and texture features for discrimination of Soybean crops and weeds. Feature extraction methods including two color spaces (RGB, HSV), gray level Co occurrence matrix (GLCM), and Local Binary Pattern (LBP) are used to train the Support Vector Machine (SVM) classifier. The experiment was carried out on image dataset of soybean crop, obtained from an unmanned aerial vehicle (UAV), which is publicly available. The results from the experiment showed that the highest accuracy (above 96 ) was obtained from the combination of color and LBP features.


Quantitative Physical Ergonomics Assessment of Teleoperation Interfaces. Human factors and ergonomics are the essential constituents of teleoperation interfaces, which can significantly affect the human operator's performance. Thus, a quantitative evaluation of these elements and the ability to establish reliable comparison bases for different teleoperation interfaces are the keys to select the most suitable one for a particular application. However, most of the works on teleoperation have so far focused on the stability analysis and the transparency improvement of these systems, and do not cover the important usability aspects. In this work, we propose a foundation to build a general framework for the analysis of human factors and ergonomics in employing diverse teleoperation interfaces. The proposed framework will go beyond the traditional subjective analyses of usability by complementing it with online measurements of the human body configurations. As a result, multiple quantitative metrics such as joints' usage, range of motion comfort, center of mass divergence, and posture comfort are introduced. To demonstrate the potential of the proposed framework, two different teleoperation interfaces are considered, and real world experiments with eleven participants performing a simulated industrial remote pick and place task are conducted. The quantitative results of this analysis are provided, and compared with subjective questionnaires, illustrating the effectiveness of the proposed framework.


An Empirical Study of Graph Contrastive Learning. Graph Contrastive Learning (GCL) establishes a new paradigm for learning graph representations without human annotations. Although remarkable progress has been witnessed recently, the success behind GCL is still left somewhat mysterious. In this work, we first identify several critical design considerations within a general GCL paradigm, including augmentation functions, contrasting modes, contrastive objectives, and negative mining techniques. Then, to understand the interplay of different GCL components, we conduct extensive, controlled experiments over a set of benchmark tasks on datasets across various domains. Our empirical studies suggest a set of general receipts for effective GCL, e.g., simple topology augmentations that produce sparse graph views bring promising performance improvements contrasting modes should be aligned with the granularities of end tasks. In addition, to foster future research and ease the implementation of GCL algorithms, we develop an easy to use library PyGCL, featuring modularized CL components, standardized evaluation, and experiment management. We envision this work to provide useful empirical evidence of effective GCL algorithms and offer several insights for future research.


GANORCON Are Generative Models Useful for Few shot Segmentation?. Advances in generative modeling based on GANs has motivated the community to find their use beyond image generation and editing tasks. In particular, several recent works have shown that GAN representations can be re purposed for discriminative tasks such as part segmentation, especially when training data is limited. But how do these improvements stack up against recent advances in self supervised learning? Motivated by this we present an alternative approach based on contrastive learning and compare their performance on standard few shot part segmentation benchmarks. Our experiments reveal that not only do the GAN based approach offer no significant performance advantage, their multi step training is complex, nearly an order of magnitude slower, and can introduce additional bias. These experiments suggest that the inductive biases of generative models, such as their ability to disentangle shape and texture, are well captured by standard feed forward networks trained using contrastive learning. These experiments suggest that the inductive biases present in current generative models, such as their ability to disentangle shape and texture, are well captured by standard feed forward networks trained using contrastive learning.


Successive finite element methods for Stokes equations. This paper will suggest a new finite element method to find a P 4 velocity and a P 3 pressure solving Stokes equations. The method solves first the decoupled equation for the P 4 velocity. Then, four kinds of local P 3 pressures and one P 0 pressure will be calculated in a successive way. If we superpose them, the resulting P 3 pressure shows the optimal order of convergence same as a P 3 projection. The chief time cost of the new method is on solving two linear systems for the P 4 velocity and P 0 pressure, respectively.


Interlacing and Friedlander type inequalities for spectral minimal partitions of metric graphs. We prove interlacing inequalities between spectral minimal energies of metric graphs built on Dirichlet and standard Laplacian eigenvalues, as recently introduced in Kennedy et al, arXiv 2005.01126 . These inequalities, which involve the first Betti number and the number of degree one vertices of the graph, recall both interlacing and other inequalities for the Laplacian eigenvalues of the whole graph, as well as estimates on the difference between the number of nodal and Neumann domains of the whole graph eigenfunctions. To this end we study carefully the principle of cutting a graph, in particular quantifying the size of a cut as a perturbation of the original graph via the notion of its rank. As a corollary we obtain an inequality between these energies and the actual Dirichlet and standard Laplacian eigenvalues, valid for all compact graphs, which complements a version for tree graphs of Friedlander's inequalities between Dirichlet and Neumann eigenvalues of a domain. In some cases this results in better Laplacian eigenvalue estimates than those obtained previously via more direct methods.


Robust Differentiable SVD. Eigendecomposition of symmetric matrices is at the heart of many computer vision algorithms. However, the derivatives of the eigenvectors tend to be numerically unstable, whether using the SVD to compute them analytically or using the Power Iteration (PI) method to approximate them. This instability arises in the presence of eigenvalues that are close to each other. This makes integrating eigendecomposition into deep networks difficult and often results in poor convergence, particularly when dealing with large matrices. While this can be mitigated by partitioning the data into small arbitrary groups, doing so has no theoretical basis and makes it impossible to exploit the full power of eigendecomposition. In previous work, we mitigated this using SVD during the forward pass and PI to compute the gradients during the backward pass. However, the iterative deflation procedure required to compute multiple eigenvectors using PI tends to accumulate errors and yield inaccurate gradients. Here, we show that the Taylor expansion of the SVD gradient is theoretically equivalent to the gradient obtained using PI without relying in practice on an iterative process and thus yields more accurate gradients. We demonstrate the benefits of this increased accuracy for image classification and style transfer.


Two way Spectrum Pursuit for CUR Decomposition and Its Application in Joint Column Row Subset Selection. The problem of simultaneous column and row subset selection is addressed in this paper. The column space and row space of a matrix are spanned by its left and right singular vectors, respectively. However, the singular vectors are not within actual columns rows of the matrix. In this paper, an iterative approach is proposed to capture the most structural information of columns rows via selecting a subset of actual columns rows. This algorithm is referred to as two way spectrum pursuit (TWSP) which provides us with an accurate solution for the CUR matrix decomposition. TWSP is applicable in a wide range of applications since it enjoys a linear complexity w.r.t. number of original columns rows. We demonstrated the application of TWSP for joint channel and sensor selection in cognitive radio networks, informative users and contents detection, and efficient supervised data reduction.


Databases of quantum periods for Fano manifolds. Fano manifolds are basic building blocks in geometry they are, in a precise sense, atomic pieces of shapes. The classification of Fano manifolds is therefore an important problem in geometry, which has been open since the 1930s. One can think of this as building a Periodic Table for shapes. A recent breakthrough in Fano classification involves a technique from theoretical physics called Mirror Symmetry. From this perspective, a Fano manifold is encoded by a sequence of integers the coefficients of a power series called the regularized quantum period. Progress to date has been hindered by the fact that quantum periods require specialist expertise to compute, and descriptions of known Fano manifolds and their regularized quantum periods are incomplete and scattered in the literature. We describe databases of regularized quantum periods for Fano manifolds in dimensions up to four. The databases in dimensions one, two, and three are complete the database in dimension four will be updated as new four dimensional Fano manifolds are discovered and new regularized quantum periods computed.


Boosting Supervised Learning Performance with Co training. Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or individuals. Recently, self supervision has emerged as an alternative to leveraging unlabeled data. In this paper, we propose a new light weight self supervised learning framework that could boost supervised learning performance with minimum additional computation cost. Here, we introduce a simple and flexible multi task co training framework that integrates a self supervised task into any supervised task. Our approach exploits pretext tasks to incur minimum compute and parameter overheads and minimal disruption to existing training pipelines. We demonstrate the effectiveness of our framework by using two self supervised tasks, object detection and panoptic segmentation, on different perception models. Our results show that both self supervised tasks can improve the accuracy of the supervised task and, at the same time, demonstrates strong domain adaption capability when used with additional unlabeled data.


Reliability Models for Smartphone Applications. Smartphones have become the most used electronic devices. They carry out most of the functionalities of desktops, offering various useful applications that suit the users needs. Therefore, instead of the operator, the user has been the main controller of the device and its applications, therefore its reliability has become an emergent requirement. As a first step, based on collected smartphone applications failure data, we investigated and evaluated the efficacy of Software Reliability Growth Models (SRGMs) when applied to these smartphone data in order to check whether they achieve the same accuracy as in the desktop laptop area. None of the selected models were able to account for the smartphone data satisfactorily. Their failure is traced back to (i) the hardware and software differences between desktops and smartphones, (ii) the specific features of mobile applications compared to desktop applications, and (iii) the different operational conditions and usage profiles. Thus, a reliability model suited to smartphone applications is still needed. In the second step, we applied the Weibull and Gamma distributions, and their two particular cases, Rayleigh and S Shaped, to model the smartphone failure data sorted by application version number and grouped into different time periods. An estimation of the expected number of defects in each application version was obtained. The performances of the distributions were then compared amongst each other. We found that both Weibull and Gamma distributions can fit the failure data of mobile applications, although the Gamma distribution is frequently more suited.


Microlocal Projector for Complete Flow. In this note we generalize the construction of microlocal projector to the sublevel set of autonomous function with complete Hamiltonian flow under some mild conditions. Furthermore, we mention that the condition of being complete is optimal, by providing a non example that violates the projector property.


Inclusion of higher order terms in the border collision normal form persistence of chaos and applications to power converters. The dynamics near a border collision bifurcation are approximated to leading order by a continuous, piecewise linear map. The purpose of this paper is to consider the higher order terms that are neglected when forming this approximation. For two dimensional maps we establish conditions under which a chaotic attractor created in a border collision bifurcation persists for an open interval of parameters beyond the bifurcation. We apply the results to a prototypical power converter model to prove the model exhibits robust chaos.


Recent Advances in Deep Learning Based Dialogue Systems A Systematic Survey. Dialogue systems are a popular natural language processing (NLP) task as it is promising in real life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on this task are carried out, and most of them are deep learning based due to the outstanding performance. In this survey, we mainly focus on the deep learning based dialogue systems. We comprehensively review state of the art research outcomes in dialogue systems and analyze them from two angles model type and system type. Specifically, from the angle of model type, we discuss the principles, characteristics, and applications of different models that are widely used in dialogue systems. This will help researchers acquaint these models and see how they are applied in state of the art frameworks, which is rather helpful when designing a new dialogue system. From the angle of system type, we discuss task oriented and open domain dialogue systems as two streams of research, providing insight into the hot topics related. Furthermore, we comprehensively review the evaluation methods and datasets for dialogue systems to pave the way for future research. Finally, some possible research trends are identified based on the recent research outcomes. To the best of our knowledge, this survey is the most comprehensive and up to date one at present for deep learning based dialogue systems, extensively covering the popular techniques. We speculate that this work is a good starting point for academics who are new to the dialogue systems or those who want to quickly grasp up to date techniques in this area.


Phish What You Wish. IT professionals have no simple tool to create phishing websites and raise the awareness of users. We developed a prototype that can dynamically mimic websites by using enriched screenshots, which requires no additional programming experience and is simple to set up. The generated websites are functional and remain up to date. We found that 98 of the hyperlinks in mimicked websites are functional with our tool, compared to 43 with the best competitor, and only two participants suspected phishing attempts at the time they were performing tasks with our prototype. This work intends to raise awareness for phishing attempts especially with local websites by providing an easy to use prototype to set up such phishing sites.


A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate. In this paper, a deep collocation method (DCM) for thin plate bending problems is proposed. This method takes advantage of computational graphs and backpropagation algorithms involved in deep learning. Besides, the proposed DCM is based on a feedforward deep neural network (DNN) and differs from most previous applications of deep learning for mechanical problems. First, batches of randomly distributed collocation points are initially generated inside the domain and along the boundaries. A loss function is built with the aim that the governing partial differential equations (PDEs) of Kirchhoff plate bending problems, and the boundary initial conditions are minimised at those collocation points. A combination of optimizers is adopted in the backpropagation process to minimize the loss function so as to obtain the optimal hyperparameters. In Kirchhoff plate bending problems, the C1 continuity requirement poses significant difficulties in traditional mesh based methods. This can be solved by the proposed DCM, which uses a deep neural network to approximate the continuous transversal deflection, and is proved to be suitable to the bending analysis of Kirchhoff plate of various geometries.


Towards a Resilient Information System for Agriculture Extension Information Service An Exploratory Study. Although digital technologies are contributing to human development, several information systems (IS) interventions for development especially in developing countries do not perform as expected nor deliver anticipated outcomes at scale. This raises questions about how to develop and enhance resilient IS for development, an area that requires more research attention. A sound and systematic understanding of the mechanisms local communities apply to maintain resilience and the key transformation areas for a resilient IS development will help to improve the situation. This study addresses how stakeholders can ensure resilient information provision within the Agricultural Extension Information Service (AEIS) and identifies the challenges in designing resilient IS. Conceptually, the study draws from the IS resilience framework. Empirically, it draws from interview data collected from the AEIS provision practice in Ethiopia. The findings show the robustness, self organization, learning, redundancy, rapidity, scale, diversity and equality mechanisms, the challenges and the key transformations required to advance the resilience of IS for AEIS. The study contributes to the conversation on the application of the IS resilience framework in analyzing local information provision practices as well as to practice highlighting the key transformation areas to improve the effectiveness and impact of AEIS.


How can design help enhance trust calibration in public autonomous vehicles?. Trust is a multilayered concept with critical relevance when it comes to introducing new technologies. Understanding how humans will interact with complex vehicle systems and preparing for the functional, societal and psychological aspects of autonomous vehicles' entry into our cities is a pressing concern. Design tools can help calibrate the adequate and affordable level of trust needed for a safe and positive experience. This study focuses on passenger interactions capable of enhancing the system trustworthiness and data accuracy in future shared public transportation.


Predicting and Attending to Damaging Collisions for Placing Everyday Objects in Photo Realistic Simulations. Placing objects is a fundamental task for domestic service robots (DSRs). Thus, inferring the collision risk before a placing motion is crucial for achieving the requested task. This problem is particularly challenging because it is necessary to predict what happens if an object is placed in a cluttered designated area. We show that a rule based approach that uses plane detection, to detect free areas, performs poorly. To address this, we develop PonNet, which has multimodal attention branches and a self attention mechanism to predict damaging collisions, based on RGBD images. Our method can visualize the risk of damaging collisions, which is convenient because it enables the user to understand the risk. For this purpose, we build and publish an original dataset that contains 12,000 photo realistic images of specific placing areas, with daily life objects, in home environments. The experimental results show that our approach improves accuracy compared with the baseline methods.


Hierarchical Representation based Query Specific Prototypical Network for Few Shot Image Classification. Few shot image classification aims at recognizing unseen categories with a small number of labeled training data. Recent metric based frameworks tend to represent a support class by a fixed prototype (e.g., the mean of the support category) and make classification according to the similarities between query instances and support prototypes. However, discriminative dominant regions may locate uncertain areas of images and have various scales, which leads to the misaligned metric. Besides, a fixed prototype for one support category cannot fit for all query instances to accurately reflect their distances with this category, which lowers the efficiency of metric. Therefore, query specific dominant regions in support samples should be extracted for a high quality metric. To address these problems, we propose a Hierarchical Representation based Query Specific Prototypical Network (QPN) to tackle the limitations by generating a region level prototype for each query sample, which achieves both positional and dimensional semantic alignment simultaneously. Extensive experiments conducted on five benchmark datasets (including three fine grained datasets) show that our proposed method outperforms the current state of the art methods.


Spatially and Seamlessly Hierarchical Reinforcement Learning for State Space and Policy space in Autonomous Driving. Despite advances in hierarchical reinforcement learning, its applications to path planning in autonomous driving on highways are challenging. One reason is that conventional hierarchical reinforcement learning approaches are not amenable to autonomous driving due to its riskiness the agent must move avoiding multiple obstacles such as other agents that are highly unpredictable, thus safe regions are small, scattered, and changeable over time. To overcome this challenge, we propose a spatially hierarchical reinforcement learning method for state space and policy space. The high level policy selects not only behavioral sub policy but also regions to pay mind to in state space and for outline in policy space. Subsequently, the low level policy elaborates the short term goal position of the agent within the outline of the region selected by the high level command. The network structure and optimization suggested in our method are as concise as those of single level methods. Experiments on the environment with various shapes of roads showed that our method finds the nearly optimal policies from early episodes, outperforming a baseline hierarchical reinforcement learning method, especially in narrow and complex roads. The resulting trajectories on the roads were similar to those of human strategies on the behavioral planning level.


A new method of carbon budget analysis with application to present and paleo atmospheric concentration data sets. We introduce a new method for analyzing the carbon budget using box models and a mass balance approach. The method describes the net flow of carbon between the atmosphere and other reservoirs. The method assumes that the data can be explained by having the carbon move in and out of the atmosphere through two reservoirs, one consisting of isotopically light carbon (biotic) and the other consisting of isotopically heavy carbon (abiotic). The systems are underdetermined from the data, so the Occam's razor approach is to assume that the least amount of carbon moves between the atmosphere and the reservoirs. As data from known sources and sinks are added to the model, one can determine the constraints on the unknown sources and sinks. To illustrate the method, we analyze data from the Mauna Loa Observatory and data from Antarctic ice cores.


HeteroQA Learning towards Question and Answering through Multiple Information Sources via Heterogeneous Graph Modeling. Community Question Answering (CQA) is a well defined task that can be used in many scenarios, such as E Commerce and online user community for special interests. In these communities, users can post articles, give comment, raise a question and answer it. These data form the heterogeneous information sources where each information source have their own special structure and context (comments attached to an article or related question with answers). Most of the CQA methods only incorporate articles or Wikipedia to extract knowledge and answer the user's question. However, various types of information sources in the community are not fully explored by these CQA methods and these multiple information sources (MIS) can provide more related knowledge to user's questions. Thus, we propose a question aware heterogeneous graph transformer to incorporate the MIS in the user community to automatically generate the answer. To evaluate our proposed method, we conduct the experiments on two datasets text MSM text plus the modified version of benchmark dataset MS MARCO and the AntQA dataset which is the first large scale CQA dataset with four types of MIS. Extensive experiments on two datasets show that our model outperforms all the baselines in terms of all the metrics.


A Survey on Adversarial Attacks for Malware Analysis. Machine learning has witnessed tremendous growth in its adoption and advancement in the last decade. The evolution of machine learning from traditional algorithms to modern deep learning architectures has shaped the way today's technology functions. Its unprecedented ability to discover knowledge patterns from unstructured data and automate the decision making process led to its application in wide domains. High flying machine learning arena has been recently pegged back by the introduction of adversarial attacks. Adversaries are able to modify data, maximizing the classification error of the models. The discovery of blind spots in machine learning models has been exploited by adversarial attackers by generating subtle intentional perturbations in test samples. Increasing dependency on data has paved the blueprint for ever high incentives to camouflage machine learning models. To cope with probable catastrophic consequences in the future, continuous research is required to find vulnerabilities in form of adversarial and design remedies in systems. This survey aims at providing the encyclopedic introduction to adversarial attacks that are carried out against malware detection systems. The paper will introduce various machine learning techniques used to generate adversarial and explain the structure of target files. The survey will also model the threat posed by the adversary and followed by brief descriptions of widely accepted adversarial algorithms. Work will provide a taxonomy of adversarial evasion attacks on the basis of attack domain and adversarial generation techniques. Adversarial evasion attacks carried out against malware detectors will be discussed briefly under each taxonomical headings and compared with concomitant researches. Analyzing the current research challenges in an adversarial generation, the survey will conclude by pinpointing the open future research directions.


Experimental investigation of thermal boundary layers and associated heat loss for transient engine relevant processes using HRCARS and phosphor thermometry. Design of efficient, downsized piston engines requires an understanding of transient wall heat losses. Measurements of the spatially and temporally evolving thermal boundary layer (TBL) are required to facilitate this knowledge. This work takes advantage of hybrid fs ps rotational coherent anti Stokes Raman spectroscopy (HRCARS) to measure single shot, wall normal gas temperatures, which provide exclusive access to the TBL. Phosphor thermometry is used to measure wall temperature. Experiments are performed in a fixed volume chamber that operates with a transient pressure rise decay to simulate engine relevant compression expansion events. This simplified environment is conducive for fundamental BL studies associated with engine relevant processes. The TBL development and corresponding heat losses are evaluated within two engine relevant regimes (1) an unburned gas regime comprised of gaseous compression and (2) a burned gas regime, which includes high temperature compression expansion processes. The time history of important BL quantities such as gas wall temperatures, TBL thickness, wall heat flux, and relative energy lost at the wall are evaluated in these regimes. During the mild compression, Tcore increases by 30K and a TBL is initiated with delta T 200 mu m. Wall heat fluxes remain below 6 kW m2, but corresponds to 6 energy loss per ms. In the burned gas regime, Tcore resembles adiabatic flame temperatures, while Twall increases by 16K. A TBL rapidly develops as delta T increases from 290 730 mu m. Energy losses in excess of 25 occur after flame impingement and slowly decay to 10 at the end of expansion. Measurements also resolve thermal mixing of fresh and burned gases during expansion, which yield strong temperature reversals in the TBL. Findings are compared to canonical environments and demonstrate the transient TBL nature during engine relevant processes.


Unit Selection with Causal Diagram. The unit selection problem aims to identify a set of individuals who are most likely to exhibit a desired mode of behavior, for example, selecting individuals who would respond one way if encouraged and a different way if not encouraged. Using a combination of experimental and observational data, Li and Pearl derived tight bounds on the "benefit function" the payoff cost associated with selecting an individual with given characteristics. This paper shows that these bounds can be narrowed significantly (enough to change decisions) when structural information is available in the form of a causal model. We address the problem of estimating the benefit function using observational and experimental data when specific graphical criteria are assumed to hold.


Stability of regular shrinkers in the network flow. The singularities of network flow are modeled by self similarly shrinking solutions called regular shrinkers. In this paper, we study the stability of regular shrinkers. We show that all regular shrinkers with two or more enclosed regions can be perturbed away. Among the regular shrinkers with one enclosed region, 4 ray star, 5 ray star, fish, and rocket are unstable.


Sim to Real Transfer for Robotic Manipulation with Tactile Sensory. Reinforcement Learning (RL) methods have been widely applied for robotic manipulations via sim to real transfer, typically with proprioceptive and visual information. However, the incorporation of tactile sensing into RL for contact rich tasks lacks investigation. In this paper, we model a tactile sensor in simulation and study the effects of its feedback in RL based robotic control via a zero shot sim to real approach with domain randomization. We demonstrate that learning and controlling with feedback from tactile sensor arrays at the gripper, both in simulation and reality, can enhance grasping stability, which leads to a significant improvement in robotic manipulation performance for a door opening task. In real world experiments, the door open angle was increased by 45 on average for transferred policies with tactile sensing over those without it.


CCQA A New Web Scale Question Answering Dataset for Model Pre Training. With the rise of large scale pre trained language models, open domain question answering (ODQA) has become an important research topic in NLP. Based on the popular pre training fine tuning approach, we posit that an additional in domain pre training stage using a large scale, natural, and diverse question answering (QA) dataset can be beneficial for ODQA. Consequently, we propose a novel QA dataset based on the Common Crawl project in this paper. Using the readily available schema.org annotation, we extract around 130 million multilingual question answer pairs, including about 60 million English data points. With this previously unseen number of natural QA pairs, we pre train popular language models to show the potential of large scale in domain pre training for the task of question answering. In our experiments, we find that pre training question answering models on our Common Crawl Question Answering dataset (CCQA) achieves promising results in zero shot, low resource and fine tuned settings across multiple tasks, models and benchmarks.


2020 State of the Octoverse Securing the World's Software. Open source is the connective tissue for much of the information economy. You would be hard pressed to find a scenario where your data does not pass through at least one open source component. Many of the services and technology we all rely on, from banking to healthcare, also rely on open source software. The artifacts of open source code serve as critical i infrastructure for much of the global economy, making the security of open source software mission critical to the world.


A sufficient condition for mobile sampling in terms of surface density. We provide a sufficient condition for sets of mobile sampling in terms of the surface density of the set.


Magic Layouts Structural Prior for Component Detection in User Interface Designs. We present Magic Layouts a method for parsing screenshots or hand drawn sketches of user interface (UI) layouts. Our core contribution is to extend existing detectors to exploit a learned structural prior for UI designs, enabling robust detection of UI components buttons, text boxes and similar. Specifically we learn a prior over mobile UI layouts, encoding common spatial co occurrence relationships between different UI components. Conditioning region proposals using this prior leads to performance gains on UI layout parsing for both hand drawn UIs and app screenshots, which we demonstrate within the context an interactive application for rapidly acquiring digital prototypes of user experience (UX) designs.


Micro nanoliter droplet extraction by controlling acoustic vortex with miniwatt. Micro nanoliter droplet is capable of achieving versatile applications with tiny volume and substantial surface energy, which is a big plus over bulk liquid. Yet, the contradiction of elaborate manipulation and enough power is still a challenge. Here, we unleash the potential of our miniwatt aspirators pumping up liquid and creating droplets with the help of acoustic vortex beams, inspired by the power mechanism that spirals are significant for most mollusks that live in water. These droplet aspirators produce very large interface deformations by small radiation pressures with orbit angular momentum from spiral electrode transducers. The precisely contactless manipulation of physical, chemical and biological objects at micrometric down to nanometric scales, promises tremendous development in fields as diverse as microrobotics, nanoreactors, or nanoassemblies.


Absence of zeros implies strong spatial mixing. In this paper we show that absence of complex zeros of the partition function of the hard core model on any family of bounded degree graphs implies that the associated probability measure, the emph hard core measure , satisfies strong spatial mixing on that family. As a corollary we obtain that the hard core measure on the family of bounded degree claw free graphs satisfies strong spatial mixing. We furthermore derive strong spatial mixing for graph homomorphism measures from absence of zeros of the graph homomorphism partition function.


Isotope shifts for 1S 0 3P 0,1 o Yb lines from multi configuration Dirac Hartree Fock calculations. Relativistic multiconfiguration Dirac Hartree Fock (MCDHF) calculations with configuration interaction (CI) are carried out for the 1 S 0 and 3 P 0,1 o states in neutral ytterbium by use of the available GRASP2018 package. From the resultant atomic state functions and the RIS4 extension, we evaluate the mass and field shift parameters for the 1 S 0 , 3 P 0 o (clock) and 1 S 0 , 3 P 1 o (intercombination) lines. We present improved estimates of the nuclear charge parameters, lambda A,A' , and differences in mean square charge radii, delta langle r 2 rangle A,A' , and examine the second order hyperfine interaction for the 3 P 0,1 o states. Isotope shifts for the clock transition have been estimated by three largely independent means from which we predict the unknown clock line frequencies in bosonic Yb isotopes. Knowledge of these line frequencies has implications for King plot nonlinearity tests and the search for beyond Standard Model signatures.


An Energy Based View of Graph Neural Networks. Graph neural networks are a popular variant of neural networks that work with graph structured data. In this work, we consider combining graph neural networks with the energy based view of Grathwohl et al. (2019) with the aim of obtaining a more robust classifier. We successfully implement this framework by proposing a novel method to ensure generation over features as well as the adjacency matrix and evaluate our method against the standard graph convolutional network (GCN) architecture (Kipf Welling (2016)). Our approach obtains comparable discriminative performance while improving robustness, opening promising new directions for future research for energy based graph neural networks.


Multi task Federated Edge Learning (MtFEEL) in Wireless Networks. Federated Learning (FL) has evolved as a promising technique to handle distributed machine learning across edge devices. A single neural network (NN) that optimises a global objective is generally learned in most work in FL, which could be suboptimal for edge devices. Although works finding a NN personalised for edge device specific tasks exist, they lack generalisation and or convergence guarantees. In this paper, a novel communication efficient FL algorithm for personalised learning in a wireless setting with guarantees is presented. The algorithm relies on finding a better empirical estimate of losses at each device, using a weighted average of the losses across different devices. It is devised from a Probably Approximately Correct (PAC) bound on the true loss in terms of the proposed empirical loss and is bounded by (i) the Rademacher complexity, (ii) the discrepancy, (iii) and a penalty term. Using a signed gradient feedback to find a personalised NN at each device, it is also proven to converge in a Rayleigh flat fading (in the uplink) channel, at a rate of the order max 1 SNR,1 sqrt(T) Experimental results show that the proposed algorithm outperforms locally trained devices as well as the conventionally used FedAvg and FedSGD algorithms under practical SNR regimes.


Cohomology of annuli, duality and L infty differential forms on Heisenberg groups. In the last few years the authors proved Poincar 'e and Sobolev type inequalities in Heisenberg groups mathbb H n for differential forms in the Rumin's complex. The need to substitute the usual de Rham complex of differential forms for Euclidean spaces with the Rumin's complex is due to the different stratification of the Lie algebra of Heisenberg groups. The crucial feature of Rumin's complex is that d c is a differential operator of order 1 or 2 according to the degree of the form. Roughly speaking, Poincar 'e and Sobolev type inequalities are quantitative formulations of the well known topological problem whether a closed form is exact. More precisely, for suitable p and q , we mean that every exact differential form omega in L p admits a primitive phi in L q such that phi L q leq C omega L p . The cases of the norm L p , p ge 1 and q infty have been already studied in a series of papers by the authors. In the present paper we deal with the limiting case where q infty it is remarkable that, unlike in the scalar case, when the degree of the forms omega is at least 2 , we can take q infty in the left hand side of the inequality. The corresponding inequality in the Euclidean setting mathbb R N ( p N and q infty ) was proven by Bourgain and Brezis.


A Synergetic Attack against Neural Network Classifiers combining Backdoor and Adversarial Examples. In this work, we show how to jointly exploit adversarial perturbation and model poisoning vulnerabilities to practically launch a new stealthy attack, dubbed AdvTrojan. AdvTrojan is stealthy because it can be activated only when 1) a carefully crafted adversarial perturbation is injected into the input examples during inference, and 2) a Trojan backdoor is implanted during the training process of the model. We leverage adversarial noise in the input space to move Trojan infected examples across the model decision boundary, making it difficult to detect. The stealthiness behavior of AdvTrojan fools the users into accidentally trust the infected model as a robust classifier against adversarial examples. AdvTrojan can be implemented by only poisoning the training data similar to conventional Trojan backdoor attacks. Our thorough analysis and extensive experiments on several benchmark datasets show that AdvTrojan can bypass existing defenses with a success rate close to 100 in most of our experimental scenarios and can be extended to attack federated learning tasks as well.


Gamma convergence of quadratic functionals with non uniformly elliptic conductivity matrices. We investigate the homogenization through Gamma convergence for the L 2( Omega) weak topology of the conductivity functional with a zero order term where the matrix valued conductivity is assumed to be non strongly elliptic. Under proper assumptions, we show that the homogenized matrix A ast is provided by the classical homogenization formula. We also give algebraic conditions for two and three dimensional 1 periodic rank one laminates such that the homogenization result holds. For this class of laminates, an explicit expression of A ast is provided which is a generalization of the classical laminate formula. We construct a two dimensional counter example which shows an anomalous asymptotic behaviour of the conductivity functional.


Basic and Depression Specific Emotion Identification in Tweets Multi label Classification Experiments. In this paper, we present empirical analysis on basic and depression specific multi emotion mining in Tweets with the help of state of the art multi label classifiers. We choose our basic emotions from a hybrid emotion model consisting of the common emotions from four highly regarded psychological models of emotions. Moreover, we augment that emotion model with new emotion categories because of their importance in the analysis of depression. Most of those additional emotions have not been used in previous emotion mining research. Our experimental analyses show that a cost sensitive RankSVM algorithm and a Deep Learning model are both robust, measured by both Macro F measures and Micro F measures. This suggests that these algorithms are superior in addressing the widely known data imbalance problem in multi label learning. Moreover, our application of Deep Learning performs the best, giving it an edge in modeling deep semantic features of our extended emotional categories.


CSAT and CEQV for nilpotent Maltsev algebras of Fitting length 2. The circuit satisfaction problem CSAT(A) of an algebra A is the problem of deciding whether an equation over A (encoded by two circuits) has a solution or not. While solving systems of equations over finite algebras is either in P or NP complete, no such dichotomy result is known for CSAT(A). In fact, Idziak, Kawalek and Krzaczkowski constructed examples of nilpotent Maltsev algebras A, for which, under the assumption of ETH and an open conjecture in circuit theory, CSAT(A) can be solved in quasipolynomial, but not polynomial time. The same is true for the circuit equivalence problem CEQV(A). In this paper we generalize their result to all nilpotent Maltsev algebras of Fitting length 2. This not only advances the project of classifying the complexity of CSAT (and CEQV) for algebras from congruence modular varieties, but we also believe that the tools we developed are of independent interest in the study of nilpotent algebras.


Finetuning Transformer Models to Build ASAG System. Research towards creating systems for automatic grading of student answers to quiz and exam questions in educational settings has been ongoing since 1966. Over the years, the problem was divided into many categories. Among them, grading text answers were divided into short answer grading, and essay grading. The goal of this work was to develop an ML based short answer grading system. I hence built a system which uses finetuning on Roberta Large Model pretrained on STS benchmark dataset and have also created an interface to show the production readiness of the system. I evaluated the performance of the system on the Mohler extended dataset and SciEntsBank Dataset. The developed system achieved a Pearsons Correlation of 0.82 and RMSE of 0.7 on the Mohler Dataset which beats the SOTA performance on this dataset which is correlation of 0.805 and RMSE of 0.793. Additionally, Pearsons Correlation of 0.79 and RMSE of 0.56 was achieved on the SciEntsBank Dataset, which only reconfirms the robustness of the system. A few observations during achieving these results included usage of batch size of 1 produced better results than using batch size of 16 or 32 and using huber loss as loss function performed well on this regression task. The system was tried and tested on train and validation splits using various random seeds and still has been tweaked to achieve a minimum of 0.76 of correlation and a maximum 0.15 (out of 1) RMSE on any dataset.


Object aware Video language Pre training for Retrieval. Recently, by introducing large scale dataset and strong transformer network, video language pre training has shown great success especially for retrieval. Yet, existing video language transformer models do not explicitly fine grained semantic align. In this work, we present Object aware Transformers, an object centric approach that extends video language transformer to incorporate object representations. The key idea is to leverage the bounding boxes and object tags to guide the training process. We evaluate our model on three standard sub tasks of video text matching on four widely used benchmarks. We also provide deep analysis and detailed ablation about the proposed method. We show clear improvement in performance across all tasks and datasets considered, demonstrating the value of a model that incorporates object representations into a video language architecture. The code will be released at url https github.com FingerRec OA Transformer .


Natural Language Generation Using Link Grammar for General Conversational Intelligence. Many current artificial general intelligence (AGI) and natural language processing (NLP) architectures do not possess general conversational intelligence that is, they either do not deal with language or are unable to convey knowledge in a form similar to the human language without manual, labor intensive methods such as template based customization. In this paper, we propose a new technique to automatically generate grammatically valid sentences using the Link Grammar database. This natural language generation method far outperforms current state of the art baselines and may serve as the final component in a proto AGI question answering pipeline that understandably handles natural language material.


Projections in moduli spaces of Kleinian groups. A two generator Kleinian group langle f,g rangle can be naturally associated with a discrete group langle f, phi rangle with the generator phi of order 2 and where begin equation langle f, phi f phi 1 rangle langle f,gfg 1 rangle subset langle f,g rangle, quad langle f,g f g 1 rangle langle f, phi rangle 2 end equation This is useful in studying the geometry of Kleinian groups since langle f,g rangle will be discrete only if langle f, phi rangle is, and the moduli space of groups langle f, phi rangle is one complex dimension less. This gives a necessary condition in a simpler space to determine the discreteness of langle f,g rangle . The dimension reduction here is realised by a projection of principal characters of two generator Kleinian groups. In applications it is important to know that the image of the moduli space of Kleinian groups under this projection is closed and, among other results, we show how this follows from J o rgensen's results on algebraic convergence.


High Order Accurate Solution of Poisson's Equation in Infinite Domains for Smooth Functions. In this paper a method is presented for evaluating the convolution of the Green's function for the Laplace operator with a specified function rho( vec x) at all grid points in a rectangular domain Omega subset mathrm R d ( d 1,2,3 ), i.e. a solution of Poisson's equation in an infinite domain. 4th and 6th order versions of the method achieve high accuracy when rho ( vec x ) possesses sufficiently many continuous derivatives. The method utilizes FFT's for computational efficiency and has a computational cost that is rm O (N log N) where rm N is the total number of grid points in the rectangular domain.


Theorems and Conjectures on Some Rational Generating Functions. Let I n(x) prod i 1 n left( 1 x F i 1 right) , where F i 1 denotes a Fibonacci number. Let v r(n) denote the sum of the r th powers of the coefficients of I n(x) . Our prototypical result is that sum n geq 0 v 2(n)x n (1 2x 2) (1 2x 2x 2 2x 3) . We give many related results and conjectures. A certain infinite poset mathfrak F is naturally associated with I n(x) . We discuss some combinatorial properties of mathfrak F and a natural generalization, including a symmetric function that encodes the flag h vector of mathfrak F .


Kernel based methods for Solving Time Dependent Advection Diffusion Equations on Manifolds. In this paper, we extend the class of kernel methods, the so called diffusion maps (DM) and ghost point diffusion maps (GPDM), to solve the time dependent advection diffusion PDE on unknown smooth manifolds without and with boundaries. The core idea is to directly approximate the spatial components of the differential operator on the manifold with a local integral operator and combine it with the standard implicit time difference scheme. When the manifold has a boundary, a simplified version of the GPDM approach is used to overcome the bias of the integral approximation near the boundary. The Monte Carlo discretization of the integral operator over the point cloud data gives rise to a mesh free formulation that is natural for randomly distributed points, even when the manifold is embedded in high dimensional ambient space. Here, we establish the convergence of the proposed solver on appropriate topologies, depending on the distribution of point cloud data and boundary type. We provide numerical results to validate the convergence results on various examples that involve simple geometry and an unknown manifold. Additionally, we also found positive results in solving the one dimensional viscous Burger's equation where GPDM is adopted with a pseudo spectral Galerkin framework to approximate nonlinear advection term.


A PGAS Communication Library for Heterogeneous Clusters. This work presents a heterogeneous communication library for clusters of processors and FPGAs. This library, Shoal, supports the Partitioned Global Address Space (PGAS) memory model for applications. PGAS is a shared memory model for clusters that creates a distinction between local and remote memory access. Through Shoal and its common application programming interface for hardware and software, applications can be more freely migrated to the optimal platform and deployed onto dynamic cluster topologies. The library is tested using a thorough suite of microbenchmarks to establish latency and throughput performance. We also show an implementation of the Jacobi iterative method that demonstrates the ease with which applications can be moved between platforms to yield faster run times. Through this work, we have demonstrated the feasibility of using a PGAS programming model for multi node heterogeneous platforms.


A Survey on 5G Radio Access Network Energy Efficiency Massive MIMO, Lean Carrier Design, Sleep Modes, and Machine Learning. Cellular networks have changed the world we are living in, and the fifth generation (5G) of radio technology is expected to further revolutionise our everyday lives, by enabling a high degree of automation, through its larger capacity, massive connectivity, and ultra reliable low latency communications. In addition, the third generation partnership project (3GPP) new radio (NR) specification also provides tools to significantly decrease the energy consumption and the green house emissions of next generations networks, thus contributing towards information and communication technology (ICT) sustainability targets. In this survey paper, we thoroughly review the state of the art on current energy efficiency research. We first categorise and carefully analyse the different power consumption models and energy efficiency metrics, which have helped to make progress on the understanding of green networks. Then, as a main contribution, we survey in detail from a theoretical and a practical viewpoint the main energy efficiency enabling technologies that 3GPP NR provides, together with their main benefits and challenges. Special attention is paid to four key enabling technologies, i.e., massive multiple input multiple output (MIMO), lean carrier design, and advanced idle modes, together with the role of artificial intelligence capabilities. We dive into their implementation and operational details, and thoroughly discuss their optimal operation points and theoretical trade offs from an energy consumption perspective. This will help the reader to grasp the fundamentals of and the status on green networking. Finally, the areas of research where more effort is needed to make future networks greener are also discussed.


A2 FPN for Semantic Segmentation of Fine Resolution Remotely Sensed Images. Semantic segmentation using fine resolution remotely sensed images plays a critical role in many practical applications, such as urban planning, environmental protection, natural and anthropogenic landscape monitoring, etc. However, the automation of semantic segmentation, i.e., automatic categorization labeling and segmentation is still a challenging task, particularly for fine resolution images with huge spatial and spectral complexity. Addressing such a problem represents an exciting research field, which paves the way for scene level landscape pattern analysis and decision making. In this paper, we propose an approach for automatic land segmentation based on the Feature Pyramid Network (FPN). As a classic architecture, FPN can build a feature pyramid with high level semantics throughout. However, intrinsic defects in feature extraction and fusion hinder FPN from further aggregating more discriminative features. Hence, we propose an Attention Aggregation Module (AAM) to enhance multi scale feature learning through attention guided feature aggregation. Based on FPN and AAM, a novel framework named Attention Aggregation Feature Pyramid Network (A2 FPN) is developed for semantic segmentation of fine resolution remotely sensed images. Extensive experiments conducted on three datasets demonstrate the effectiveness of our A2 FPN in segmentation accuracy. Code is available at https github.com lironui A2 FPN.


A Flexible Multi Task Model for BERT Serving. In this demonstration, we present an efficient BERT based multi task (MT) framework that is particularly suitable for iterative and incremental development of the tasks. The proposed framework is based on the idea of partial fine tuning, i.e. only fine tune some top layers of BERT while keep the other layers frozen. For each task, we train independently a single task (ST) model using partial fine tuning. Then we compress the task specific layers in each ST model using knowledge distillation. Those compressed ST models are finally merged into one MT model so that the frozen layers of the former are shared across the tasks. We exemplify our approach on eight GLUE tasks, demonstrating that it is able to achieve both strong performance and efficiency. We have implemented our method in the utterance understanding system of XiaoAI, a commercial AI assistant developed by Xiaomi. We estimate that our model reduces the overall serving cost by 86 .


Using differential invariants to detect projective equivalences and symmetries of rational 3D curves. We present a new approach using differential invariants to detect projective equivalences and symmetries between two rational parametric 3D curves properly parametrized. In order to do this, we introduce two differential invariants that commute with M "obius transformations, which are the transformations in the parameter space associated with the projective equivalences between the curves. The M "obius transformations are found by first computing the gcd of two polynomials built from the differential invariants, and then searching for the M "obius like factors of this gcd. The projective equivalences themselves are easily computed from the M "obius transformations. In particular, and unlike previous approaches, we avoid solving big polynomial systems. The algorithm has been implemented in Maple, and evidences of its efficiency as well as a comparison with previous approaches are given.


Hausdorff dimension of caloric measure. We examine caloric measures omega on general domains in mathbb R n 1 mathbb R n times mathbb R (space times time) from the perspective of geometric measure theory. On one hand, we give a direct proof of a consequence of a theorem of Taylor and Watson (1985) that the lower parabolic Hausdorff dimension of omega is at least n and omega ll mathcal H n . On the other hand, we prove that the upper parabolic Hausdorff dimension of omega is at most n 2 beta n , where beta n 0 depends only on n . Analogous bounds for harmonic measures were first shown by Nevanlinna (1934) and Bourgain (1987). We also identify and correct an error in the paper by Bourgain. Heuristically, we show that the density of obstacles in a cube needed to make it unlikely that a Brownian motion started outside of the cube exits a domain near the center of the cube must be chosen according to the ambient dimension. In the course of the proof, we give a caloric measure analogue of Bourgain's alternative for any constants 0 epsilon ll n delta 1 2 and closed set E subset mathbb R n 1 , either (i) E cap Q has relatively large caloric measure in Q setminus E for every pole in F or (ii) E cap Q has relatively small rho dimensional parabolic Hausdorff content for every n rho leq n 2 , where Q is a cube, F is a subcube of Q aligned at the center of the top time face, and Q is a subcube of Q that is close to, but separated backwards in time from F Q ( 1 2,1 2) n times ( 1,0), quad F 1 2 delta,1 2 delta n times epsilon 2,0), text and quad Q 1 2 delta,1 2 delta n times 3 epsilon 2, 2 epsilon 2 . Further, we supply a version of the strong Markov property for caloric measures.


Indonesia's Fake News Detection using Transformer Network. Fake news is a problem faced by society in this era. It is not rare for fake news to cause provocation and problem for the people. Indonesia, as a country with the 4th largest population, has a problem in dealing with fake news. More than 30 of rural and urban population are deceived by this fake news problem. As we have been studying, there is only few literatures on preventing the spread of fake news in Bahasa Indonesia. So, this research is conducted to prevent these problems. The dataset used in this research was obtained from a news portal that identifies fake news, turnbackhoax.id. Using Web Scrapping on this page, we got 1116 data consisting of valid news and fake news. The dataset can be accessed at https github.com JibranFawaid turnbackhoax dataset. This dataset will be combined with other available datasets. The methods used are CNN, BiLSTM, Hybrid CNN BiLSTM, and BERT with Transformer Network. This research shows that the BERT method with Transformer Network has the best results with an accuracy of up to 90 .


A Game Theoretic Analysis of Competitive Editing in Wikipedia Contributors' Effort to Influence Articles and the Community's Attempt to Ensure Neutrality. Peer production, such as the collaborative authoring of Wikipedia articles, involves both cooperation and competition between contributors, and we focus on the latter. As individuals, contributors compete to align Wikipedia articles with their personal perspectives. As a community, they work collectively to ensure a neutral point of view (NPOV). We study the interplay between individuals' competition and the community's endeavor to ensure neutrality. We develop a two level game theoretic model, modeling the interactions of ownership motivated individuals and neutrality seeking communal mechanisms as a Stackelberg game. We present our model's predictions regarding the relation between contributors' effort (i.e. typical size of edit) and benefits (i.e. the portion of the article they eventually own''). We validate the model's prediction through an empirical analysis, by studying the interactions of 219,811 distinct contributors that co produced 864 Wikipedia articles over a decade. The analysis and empirical results suggest that contributors who make large edits ( creators'') eventually lose the article's ownership to those who refine the articles and typically make smaller edits ( curators''). Whereas neutrality seeking mechanisms are essential for ensuring that ownership is not concentrated within a small number of contributors, our findings suggest that the burden of excessive governance may deter contributors from participating.


An Orthogonal Equivalence Theorem for Third Order Tensors. In 2011, Kilmer and Martin proposed tensor singular value decomposition (T SVD) for third order tensors. Since then, T SVD has applications in low rank tensor approximation, tensor recovery, multi view clustering, multi view feature extraction, tensor sketching, etc. By going through the Discrete Fourier Transform (DFT), matrix SVD and inverse DFT, a third order tensor is mapped to an f diagonal third order tensor. We call this a Kilmer Martin mapping. We show that the Kilmer Martin mapping of a third order tensor is invariant if that third order tensor is taking T product with some orthogonal tensors. We define singular values and T rank of that third order tensor based upon its Kilmer Martin mapping. Thus, tensor tubal rank, T rank, singular values and T singular values of a third order tensor are invariant when it is taking T product with some orthogonal tensors. Some properties of singular values, T rank and best T rank one approximation are discussed.


Modeling same order modes of multicell cavities. We derive the transfer function of a multicell cavity with parasitic same order modes (from power coupler to pickup probe). The derived model is discussed and compared to measurement data.


Solving a Multi resource Partial ordering Flexible Variant of the Job shop Scheduling Problem with Hybrid ASP. Many complex activities of production cycles, such as quality control or fault analysis, require highly experienced specialists to perform various operations on (semi)finished products using different tools. In practical scenarios, the selection of a next operation is complicated, since each expert has only a local view on the total set of operations to be performed. As a result, decisions made by the specialists are suboptimal and might cause significant costs. In this paper, we consider a Multi resource Partial ordering Flexible Job shop Scheduling (MPF JSS) problem where partially ordered sequences of operations must be scheduled on multiple required resources, such as tools and specialists. The resources are flexible and can perform one or more operations depending on their properties. The problem is modeled using Answer Set Programming (ASP) in which the time assignments are efficiently done using Difference Logic. Moreover, we suggest two multi shot solving strategies aiming at the identification of the time bounds allowing for a solution of the schedule optimization problem. Experiments conducted on a set of instances extracted from a medium sized semiconductor fault analysis lab indicate that our approach can find schedules for 87 out of 91 considered real world instances.


Robust Federated Learning by Mixture of Experts. We present a novel weighted average model based on the mixture of experts (MoE) concept to provide robustness in Federated learning (FL) against the poisoned corrupted outdated local models. These threats along with the non IID nature of data sets can considerably diminish the accuracy of the FL model. Our proposed MoE FL setup relies on the trust between users and the server where the users share a portion of their public data sets with the server. The server applies a robust aggregation method by solving the optimization problem or the Softmax method to highlight the outlier cases and to reduce their adverse effect on the FL process. Our experiments illustrate that MoE FL outperforms the performance of the traditional aggregation approach for high rate of poisoned data from attackers.


COCO Denoiser Using Co Coercivity for Variance Reduction in Stochastic Convex Optimization. First order methods for stochastic optimization have undeniable relevance, in part due to their pivotal role in machine learning. Variance reduction for these algorithms has become an important research topic. In contrast to common approaches, which rarely leverage global models of the objective function, we exploit convexity and L smoothness to improve the noisy estimates outputted by the stochastic gradient oracle. Our method, named COCO denoiser, is the joint maximum likelihood estimator of multiple function gradients from their noisy observations, subject to co coercivity constraints between them. The resulting estimate is the solution of a convex Quadratically Constrained Quadratic Problem. Although this problem is expensive to solve by interior point methods, we exploit its structure to apply an accelerated first order algorithm, the Fast Dual Proximal Gradient method. Besides analytically characterizing the proposed estimator, we show empirically that increasing the number and proximity of the queried points leads to better gradient estimates. We also apply COCO in stochastic settings by plugging it in existing algorithms, such as SGD, Adam or STRSAGA, outperforming their vanilla versions, even in scenarios where our modelling assumptions are mismatched.


Uniform forcing and immune sets in graphs and hypergraphs. Zero forcing is an iterative coloring process on a graph that has been widely used in such different areas as the modelling of propagation phenomena in networks and the study of minimum rank problems in matrices and graphs. This paper deals with zero forcing on hypergraphs. (Representing a network by a hypergraph allows us to account for its community structure and for more general interactions between different subsets of nodes.) We consider two natural generalizations to hypergraphs of zero forcing on graphs (one of them already known) and, for each one of these generalizations we look into two clutters that play a significant role in the forcing process the clutter of minimal forcing sets and the one of minimal immune sets. A formulation of immune sets in terms of neighbourhoods (hence without making reference to the iterative zero forcing process) is presented, highlighting the different behaviour of the distinct forcing rules. Moreover, we obtain the families of minimal forcing and minimal immune sets in the case of complete hypergraphs and we provide a full characterization of forcing and immune uniform clutters, both in the graph and in the hypergraph case.


Brakke's formulation of velocity and the second order regularity property. Suppose that a family of k dimensional surfaces in mathbb R n evolves by the motion law of v h u perp in the sense of Brakke's formulation of velocity, where v is the normal velocity vector, h is the generalized mean curvature vector and u perp is the normal projection of a given vector field u in a dimensionally sharp integrability class. When the flow is locally close to a time independent k dimensional plane in a weak sense of measure in space time, it is represented as a graph of a C 1, alpha function over the plane. On the other hand, it is not known if the graph satisfies the PDE of v h u perp pointwise in general. For this problem, when k n 1 and under the additional assumption that the distributional time derivative of the graph is a signed Radon measure, it is proved that the graph satisfies the PDE pointwise. An application to a short time existence theorem for a surface evolution problem is given.


CLiMP A Benchmark for Chinese Language Model Evaluation. Linguistically informed analyses of language models (LMs) contribute to the understanding and improvement of these models. Here, we introduce the corpus of Chinese linguistic minimal pairs (CLiMP), which can be used to investigate what knowledge Chinese LMs acquire. CLiMP consists of sets of 1,000 minimal pairs (MPs) for 16 syntactic contrasts in Mandarin, covering 9 major Mandarin linguistic phenomena. The MPs are semi automatically generated, and human agreement with the labels in CLiMP is 95.8 . We evaluated 11 different LMs on CLiMP, covering n grams, LSTMs, and Chinese BERT. We find that classifier noun agreement and verb complement selection are the phenomena that models generally perform best at. However, models struggle the most with the ba construction, binding, and filler gap dependencies. Overall, Chinese BERT achieves an 81.8 average accuracy, while the performances of LSTMs and 5 grams are only moderately above chance level.


MCR Net A Multi Step Co Interactive Relation Network for Unanswerable Questions on Machine Reading Comprehension. Question answering systems usually use keyword searches to retrieve potential passages related to a question, and then extract the answer from passages with the machine reading comprehension methods. However, many questions tend to be unanswerable in the real world. In this case, it is significant and challenging how the model determines when no answer is supported by the passage and abstains from answering. Most of the existing systems design a simple classifier to determine answerability implicitly without explicitly modeling mutual interaction and relation between the question and passage, leading to the poor performance for determining the unanswerable questions. To tackle this problem, we propose a Multi Step Co Interactive Relation Network (MCR Net) to explicitly model the mutual interaction and locate key clues from coarse to fine by introducing a co interactive relation module. The co interactive relation module contains a stack of interaction and fusion blocks to continuously integrate and fuse history guided and current query guided clues in an explicit way. Experiments on the SQuAD 2.0 and DuReader datasets show that our model achieves a remarkable improvement, outperforming the BERT style baselines in literature. Visualization analysis also verifies the importance of the mutual interaction between the question and passage.


Graph Convolution for Re ranking in Person Re identification. Nowadays, deep learning is widely applied to extract features for similarity computation in person re identification (re ID) and have achieved great success. However, due to the non overlapping between training and testing IDs, the difference between the data used for model training and the testing data makes the performance of learned feature degraded during testing. Hence, re ranking is proposed to mitigate this issue and various algorithms have been developed. However, most of existing re ranking methods focus on replacing the Euclidean distance with sophisticated distance metrics, which are not friendly to downstream tasks and hard to be used for fast retrieval of massive data in real applications. In this work, we propose a graph based re ranking method to improve learned features while still keeping Euclidean distance as the similarity metric. Inspired by graph convolution networks, we develop an operator to propagate features over an appropriate graph. Since graph is the essential key for the propagation, two important criteria are considered for designing the graph, and three different graphs are explored accordingly. Furthermore, a simple yet effective method is proposed to generate a profile vector for each tracklet in videos, which helps extend our method to video re ID. Extensive experiments on three benchmark data sets, e.g., Market 1501, Duke, and MARS, demonstrate the effectiveness of our proposed approach.


Separating Retention from Extraction in the Evaluation of End to end Relation Extraction. State of the art NLP models can adopt shallow heuristics that limit their generalization capability (McCoy et al., 2019). Such heuristics include lexical overlap with the training set in Named Entity Recognition (Taill 'e et al., 2020) and Event or Type heuristics in Relation Extraction (Rosenman et al., 2020). In the more realistic end to end RE setting, we can expect yet another heuristic the mere retention of training relation triples. In this paper, we propose several experiments confirming that retention of known facts is a key factor of performance on standard benchmarks. Furthermore, one experiment suggests that a pipeline model able to use intermediate type representations is less prone to over rely on retention.


HCR Net A deep learning based script independent handwritten character recognition network. Despite being studied extensively for a few decades, handwritten character recognition (HCR) is considered a challenging learning problem in pattern recognition and there is very limited research on script independent models. This is mainly because of diversity of scripts, focus of the conventional research on handcrafted feature extraction techniques, and unavailability of public datasets and codes to reproduce the results. On the other hand, deep learning has witnessed huge success in different areas of pattern recognition, including HCR, and provides end to end learning but it has been studied for specific scripts only. In this paper, we have proposed a novel deep learning architecture which exploits transfer learning and image augmentation for end to end learning for script independent handwritten character recognition, called HCR Net. HCR Net is based on a novel transfer learning approach for HCR, where some of lower layers of a pre trained network are utilized. Due to transfer learning and image augmentation, HCR Net provides faster training, better performance and better generalizations, and can achieve up to 99 results of its final accuracy in just first epoch. The experimental results on publicly available datasets of Bangla, Punjabi, Hindi, English, Swedish, Urdu, Farsi, Tibetan, Kannada, Malayalam, Telugu, Marathi, Nepali and Arabic languages prove the efficacy of HCR Net and establishes several new benchmarks. For reproducibility of the results and for the advancements of the HCR research, complete code is publicly released at https github.com jmdvinodjmd HCR Net.


The annihilation operator for certain family of q Hermite Sobolev type orthogonal polynomials. We present a new family left S n (x q) right n geq 0 of monic polynomials in x , orthogonal with respect to a Sobolev type inner product related to the q Hermite I orthogonal polynomials, involving a first order q derivative on a mass point alpha in mathbb R located out of the corresponding orthogonality interval 1,1 , for some fixed real number q in (0, 1) . We present connection formulas, and the annihilation operator for this non standard orthogonal polynomial family.


ALTO Adaptive Linearized Storage of Sparse Tensors. The analysis of high dimensional sparse data is becoming increasingly popular in many important domains. However, real world sparse tensors are challenging to process due to their irregular shapes and data distributions. We propose the Adaptive Linearized Tensor Order (ALTO) format, a novel mode agnostic (general) representation that keeps neighboring nonzero elements in the multi dimensional space close to each other in memory. To generate the indexing metadata, ALTO uses an adaptive bit encoding scheme that trades off index computations for lower memory usage and more effective use of memory bandwidth. Moreover, by decoupling its sparse representation from the irregular spatial distribution of nonzero elements, ALTO eliminates the workload imbalance and greatly reduces the synchronization overhead of tensor computations. As a result, the parallel performance of ALTO based tensor operations becomes a function of their inherent data reuse. On a gamut of tensor datasets, ALTO outperforms an oracle that selects the best state of the art format for each dataset, when used in key tensor decomposition operations. Specifically, ALTO achieves a geometric mean speedup of 8X over the best mode agnostic (coordinate and hierarchical coordinate) formats, while delivering a geometric mean compression ratio of 4.3X relative to the best mode specific (compressed sparse fiber) formats.


Predicting the Reproducibility of Social and Behavioral Science Papers Using Supervised Learning Models. In recent years, significant effort has been invested verifying the reproducibility and robustness of research claims in social and behavioral sciences (SBS), much of which has involved resource intensive replication projects. In this paper, we investigate prediction of the reproducibility of SBS papers using machine learning methods based on a set of features. We propose a framework that extracts five types of features from scholarly work that can be used to support assessments of reproducibility of published research claims. Bibliometric features, venue features, and author features are collected from public APIs or extracted using open source machine learning libraries with customized parsers. Statistical features, such as p values, are extracted by recognizing patterns in the body text. Semantic features, such as funding information, are obtained from public APIs or are extracted using natural language processing models. We analyze pairwise correlations between individual features and their importance for predicting a set of human assessed ground truth labels. In doing so, we identify a subset of 9 top features that play relatively more important roles in predicting the reproducibility of SBS papers in our corpus. Results are verified by comparing performances of 10 supervised predictive classifiers trained on different sets of features.


Asymptotic Dynamics of Dispersive, Collisionless Plasmas. A multispecies, collisionless plasma is modeled by the Vlasov Poisson system. Assuming that the electric field decays with sufficient rapidity as t to infty , we show that the velocity characteristics and spatial averages of the particle distributions converge as time grows large. Using these limits we establish the precise asymptotic profile of the electric field and its derivatives, as well as, the charge and current densities. Modified spatial characteristics are then shown to converge using the limiting electric field. Finally, we establish a modified L infty scattering result for each particle distribution function, namely we show that they converge as t to infty along the modified spatial characteristics. When the plasma is non neutral, the estimates of these quantities are sharp, while in the neutral case they may imply faster rates of decay.


A Survey on Federated Learning and its Applications for Accelerating Industrial Internet of Things. Federated learning (FL) brings collaborative intelligence into industries without centralized training data to accelerate the process of Industry 4.0 on the edge computing level. FL solves the dilemma in which enterprises wish to make the use of data intelligence with security concerns. To accelerate industrial Internet of things with the further leverage of FL, existing achievements on FL are developed from three aspects 1) define terminologies and elaborate a general framework of FL for accommodating various scenarios 2) discuss the state of the art of FL on fundamental researches including data partitioning, privacy preservation, model optimization, local model transportation, personalization, motivation mechanism, platform tools, and benchmark 3) discuss the impacts of FL from the economic perspective. To attract more attention from industrial academia and practice, a FL transformed manufacturing paradigm is presented, and future research directions of FL are given and possible immediate applications in Industry 4.0 domain are also proposed.


The Most Informative Order Statistic and its Application to Image Denoising. We consider the problem of finding the subset of order statistics that contains the most information about a sample of random variables drawn independently from some known parametric distribution. We leverage information theoretic quantities, such as entropy and mutual information, to quantify the level of informativeness and rigorously characterize the amount of information contained in any subset of the complete collection of order statistics. As an example, we show how these informativeness metrics can be evaluated for a sample of discrete Bernoulli and continuous Uniform random variables. Finally, we unveil how our most informative order statistics framework can be applied to image processing applications. Specifically, we investigate how the proposed measures can be used to choose the coefficients of the L estimator filter to denoise an image corrupted by random noise. We show that both for discrete (e.g., salt pepper noise) and continuous (e.g., mixed Gaussian noise) noise distributions, the proposed method is competitive with off the shelf filters, such as the median and the total variation filters, as well as with wavelet based denoising methods.


Behavior Constraining in Weight Space for Offline Reinforcement Learning. In offline reinforcement learning, a policy needs to be learned from a single pre collected dataset. Typically, policies are thus regularized during training to behave similarly to the data generating policy, by adding a penalty based on a divergence between action distributions of generating and trained policy. We propose a new algorithm, which constrains the policy directly in its weight space instead, and demonstrate its effectiveness in experiments.


A new tableau model for irreducible polynomial representations of the orthogonal group. We provide a new tableau model from which one can easily deduce the characters of irreducible polynomial representations of the orthogonal group mathrm O n( mathbb C ) . This model originates from representation theory of the imath quantum group of type AI, and is equipped with a combinatorial structure, which we call AI crystal structure. This structure enables us to describe combinatorially the tensor product of an mathrm O n( mathbb C ) module and a mathrm GL n( mathbb C ) module, and the branching from mathrm GL n( mathbb C ) to mathrm O n( mathbb C ) .


Super Resolution Appearance Transfer for 4D Human Performances. A common problem in the 4D reconstruction of people from multi view video is the quality of the captured dynamic texture appearance which depends on both the camera resolution and capture volume. Typically the requirement to frame cameras to capture the volume of a dynamic performance ( 50m 3 ) results in the person occupying only a small proportion 10 of the field of view. Even with ultra high definition 4k video acquisition this results in sampling the person at less than standard definition 0.5k video resolution resulting in low quality rendering. In this paper we propose a solution to this problem through super resolution appearance transfer from a static high resolution appearance capture rig using digital stills cameras ( 8k ) to capture the person in a small volume ( 8m 3 ). A pipeline is proposed for super resolution appearance transfer from high resolution static capture to dynamic video performance capture to produce super resolution dynamic textures. This addresses two key problems colour mapping between different camera systems and dynamic texture map super resolution using a learnt model. Comparative evaluation demonstrates a significant qualitative and quantitative improvement in rendering the 4D performance capture with super resolution dynamic texture appearance. The proposed approach reproduces the high resolution detail of the static capture whilst maintaining the appearance dynamics of the captured video.