Artificial intelligence for detection and quantification of rust and leaf miner in coffee crop. Pest and disease control plays a key role in agriculture since the damage caused by these agents are responsible for a huge economic loss every year. Based on this assumption, we create an algorithm capable of detecting rust (Hemileia vastatrix) and leaf miner (Leucoptera coffeella) in coffee leaves (Coffea arabica) and quantify disease severity using a mobile application as a high level interface for the model inferences. We used different convolutional neural network architectures to create the object detector, besides the OpenCV library, k means, and three treatments the RGB and value to quantification, and the AFSoft software, in addition to the analysis of variance, where we compare the three methods. The results show an average precision of 81,5 in the detection and that there was no significant statistical difference between treatments to quantify the severity of coffee leaves, proposing a computationally less costly method. The application, together with the trained model, can detect the pest and disease over different image conditions and infection stages and also estimate the disease infection stage.


Searchlight Asymptotics for High Frequency Scattering by Boundary Inflection. We consider an inner problem for whispering gallery high frequency asymptotic mode's scattering by a boundary inflection. The related boundary value problem for a Schr " o dinger equation on a half line with a potential linear in both space and time appears fundamental for describing transitions from modal to scattered asymptotic patterns, and despite having been intensively studied over several decades remains largely unsolved. We prove that the solution past the inflection point has a searchlight'' asymptotics corresponding to a beam concentrated near the limit ray, and establish certain decay and smoothness properties of the related searchlight amplitude. We also discuss further interpretations of the above result the existence of associated generalised wave operator, and of a version of a unitary scattering operator connecting the modal and scattered asymptotic regimes.


VolterraNet A higher order convolutional network with group equivariance for homogeneous manifolds. Convolutional neural networks have been highly successful in image based learning tasks due to their translation equivariance property. Recent work has generalized the traditional convolutional layer of a convolutional neural network to non Euclidean spaces and shown group equivariance of the generalized convolution operation. In this paper, we present a novel higher order Volterra convolutional neural network (VolterraNet) for data defined as samples of functions on Riemannian homogeneous spaces. Analagous to the result for traditional convolutions, we prove that the Volterra functional convolutions are equivariant to the action of the isometry group admitted by the Riemannian homogeneous spaces, and under some restrictions, any non linear equivariant function can be expressed as our homogeneous space Volterra convolution, generalizing the non linear shift equivariant characterization of Volterra expansions in Euclidean space. We also prove that second order functional convolution operations can be represented as cascaded convolutions which leads to an efficient implementation. Beyond this, we also propose a dilated VolterraNet model. These advances lead to large parameter reductions relative to baseline non Euclidean CNNs. To demonstrate the efficacy of the VolterraNet performance, we present several real data experiments involving classification tasks on spherical MNIST, atomic energy, Shrec17 data sets, and group testing on diffusion MRI data. Performance comparisons to the state of the art are also presented.


MetricOpt Learning to Optimize Black Box Evaluation Metrics. We study the problem of directly optimizing arbitrary non differentiable task evaluation metrics such as misclassification rate and recall. Our method, named MetricOpt, operates in a black box setting where the computational details of the target metric are unknown. We achieve this by learning a differentiable value function, which maps compact task specific model parameters to metric observations. The learned value function is easily pluggable into existing optimizers like SGD and Adam, and is effective for rapidly finetuning a pre trained model. This leads to consistent improvements since the value function provides effective metric supervision during finetuning, and helps to correct the potential bias of loss only supervision. MetricOpt achieves state of the art performance on a variety of metrics for (image) classification, image retrieval and object detection. Solid benefits are found over competing methods, which often involve complex loss design or adaptation. MetricOpt also generalizes well to new tasks and model architectures.


Safe Learning and Optimization Techniques Towards a Survey of the State of the Art. Safe learning and optimization deals with learning and optimization problems that avoid, as much as possible, the evaluation of non safe input points, which are solutions, policies, or strategies that cause an irrecoverable loss (e.g., breakage of a machine or equipment, or life threat). Although a comprehensive survey of safe reinforcement learning algorithms was published in 2015, a number of new algorithms have been proposed thereafter, and related works in active learning and in optimization were not considered. This paper reviews those algorithms from a number of domains including reinforcement learning, Gaussian process regression and classification, evolutionary algorithms, and active learning. We provide the fundamental concepts on which the reviewed algorithms are based and a characterization of the individual algorithms. We conclude by explaining how the algorithms are connected and suggestions for future research.


Paley type inequality on Hardy space in the Dunkl setting. We investigate lambda Hilbert transform, lambda Possion integral and conjugate lambda Poisson integral on the atomic Hardy space in the Dunkl setting and establish a new version of Paley type inequality which extends the results in cite F and cite ZhongKai Li 3 .


User configurable 3D object regeneration for spatial privacy. Environmental understanding capability of textit augmented (AR) and textit mixed reality (MR) devices are continuously improving through advances in sensing, computer vision, and machine learning. Various AR MR applications demonstrate such capabilities i.e. scanning a space using a handheld or head mounted device and capturing a digital representation of the space that are accurate copies of the real space. However, these capabilities impose privacy risks to users personally identifiable information can leak from captured 3D maps of the sensitive spaces and or captured sensitive objects within the mapped space. Thus, in this work, we demonstrate how we can leverage 3D object regeneration for preserving privacy of 3D point clouds. That is, we employ an intermediary layer of protection to transform the 3D point cloud before providing it to the third party applications. Specifically, we use an existing adversarial autoencoder to generate copies of 3D objects where the likeness of the copies from the original can be varied. To test the viability and performance of this method as a privacy preserving mechanism, we use a 3D classifier to classify and identify these transformed point clouds i.e. perform textit super class and textit intra class classification. To measure the performance of the proposed privacy framework, we define privacy, Pi in 0,1 , and utility metrics, Q in 0,1 , which are desired to be maximized. Experimental evaluation shows that the privacy framework can indeed variably effect the privacy of a 3D object by varying the privilege level l in 0,1 i.e. if a low l 0.17 is maintained, Pi 1, Pi 2 0.4 is ensured where Pi 1, Pi 2 are super and intra class privacy. Lastly, the privacy framework can ensure relatively high intra class privacy and utility i.e. Pi 2 0.63 and Q 0.70 , if the privilege level is kept within the range of 0.17 l 0.25 .


Zero Shot Joint Modeling of Multiple Spoken Text Style Conversion Tasks using Switching Tokens. In this paper, we propose a novel spoken text style conversion method that can simultaneously execute multiple style conversion modules such as punctuation restoration and disfluency deletion without preparing matched datasets. In practice, transcriptions generated by automatic speech recognition systems are not highly readable because they often include many disfluencies and do not include punctuation marks. To improve their readability, multiple spoken text style conversion modules that individually model a single conversion task are cascaded because matched datasets that simultaneously handle multiple conversion tasks are often unavailable. However, the cascading is unstable against the order of tasks because of the chain of conversion errors. Besides, the computation cost of the cascading must be higher than the single conversion. To execute multiple conversion tasks simultaneously without preparing matched datasets, our key idea is to distinguish individual conversion tasks using the on off switch. In our proposed zero shot joint modeling, we switch the individual tasks using multiple switching tokens, enabling us to utilize a zero shot learning approach to executing simultaneous conversions. Our experiments on joint modeling of disfluency deletion and punctuation restoration demonstrate the effectiveness of our method.


Regularity estimates for fractional orthotropic p Laplacians of mixed order. We study robust regularity estimates for a class of nonlinear integro differential operators with anisotropic and singular kernels. In this paper, we prove a Sobolev type inequality, a weak Harnack inequality, and a local H "older estimate.


Use of Formal Ethical Reviews in NLP Literature Historical Trends and Current Practices. Ethical aspects of research in language technologies have received much attention recently. It is a standard practice to get a study involving human subjects reviewed and approved by a professional ethics committee board of the institution. How commonly do we see mention of ethical approvals in NLP research? What types of research or aspects of studies are usually subject to such reviews? With the rising concerns and discourse around the ethics of NLP, do we also observe a rise in formal ethical reviews of NLP studies? And, if so, would this imply that there is a heightened awareness of ethical issues that was previously lacking? We aim to address these questions by conducting a detailed quantitative and qualitative analysis of the ACL Anthology, as well as comparing the trends in our field to those of other related disciplines, such as cognitive science, machine learning, data mining, and systems.


New Interleaving Constructions of Asymptotically Optimal Periodic Quasi Complementary Sequence Sets. The correlation properties of sequences form a focal point in the design of multiple access systems of communications. Such a system must be able to serve a number of simultaneous users while keeping interference low. A popular choice for the set of sequences to deploy is the quasi complementary sequence set (QCSS). Its large set size enables the system to accommodate a lot of users. The set has low nontrivial correlation magnitudes within a zone around the origin. This keeps undue interference among users under control. A QCSS performs better than the perfect complementary sequence set (PCSS) does in schemes with fractional delays. The optimality of a set of periodic sequences is measured by its maximum periodic correlation magnitude, for which there is an established lower bound to aim at. For a fixed period, optimal sets are known only for very restricted parameters. Efforts have therefore been centered around the constructions of asymptotically optimal sets. Their periods are allowed to be as large as sufficient to establish optimality. In this paper we share an insight that a sequence set that asymptotically attains the Welch bound generates an asymptotically optimal periodic QCSS by interleaving. One can simply use known families of such sequence sets to construct the desired QCSSs. Seven families of QCSSs with specific parameters are shown as examples of this general construction. We build upon the insight to propose two new direct constructions of asymptotically optimal QCSSs with very flexible parameters without interleaving. The flexibility enhances their appeal for practical implementation. The mathematical tools come from the theory of groups in the form of additive and multiplicative characters of finite fields.


Learning to Explore by Reinforcement over High Level Options. Autonomous 3D environment exploration is a fundamental task for various applications such as navigation. The goal of exploration is to investigate a new environment and build its occupancy map efficiently. In this paper, we propose a new method which grants an agent two intertwined options of behaviors "look around" and "frontier navigation". This is implemented by an option critic architecture and trained by reinforcement learning algorithms. In each timestep, an agent produces an option and a corresponding action according to the policy. We also take advantage of macro actions by incorporating classic path planning techniques to increase training efficiency. We demonstrate the effectiveness of the proposed method on two publicly available 3D environment datasets and the results show our method achieves higher coverage than competing techniques with better efficiency.


It Takes Two to Tango Mixup for Deep Metric Learning. Metric learning involves learning a discriminative representation such that embeddings of similar classes are encouraged to be close, while embeddings of dissimilar classes are pushed far apart. State of the art methods focus mostly on sophisticated loss functions or mining strategies. On the one hand, metric learning losses consider two or more examples at a time. On the other hand, modern data augmentation methods for classification consider two or more examples at a time. The combination of the two ideas is under studied. In this work, we aim to bridge this gap and improve representations using mixup, which is a powerful data augmentation approach interpolating two or more examples and corresponding target labels at a time. This task is challenging because unlike classification, the loss functions used in metric learning are not additive over examples, so the idea of interpolating target labels is not straightforward. To the best of our knowledge, we are the first to investigate mixing both examples and target labels for deep metric learning. We develop a generalized formulation that encompasses existing metric learning loss functions and modify it to accommodate for mixup, introducing Metric Mix, or Metrix. We also introduce a new metric utilization, to demonstrate that by mixing examples during training, we are exploring areas of the embedding space beyond the training classes, thereby improving representations. To validate the effect of improved representations, we show that mixing inputs, intermediate representations or embeddings along with target labels significantly outperforms state of the art metric learning methods on four benchmark deep metric learning datasets.


Binary code optimization. This article shows that any type of binary data can be defined as a collection from codewords of variable length. This feature helps us to define an Injective and surjective function from the suggested codewords to the required codewords. Therefore, by replacing the new codewords, the binary data becomes another binary data regarding the intended goals. One of these goals is to reduce data size. It means that instead of the original codewords of each binary data, it replaced the Huffman codewords to reduce the data size. One of the features of this method is the result of positive compression for any type of binary data, that is, regardless of the size of the code table, the difference between the original data size and the data size after compression will be greater than or equal to zero. Another important and practical feature of this method is the use of symmetric codewords instead of the suggested codewords in order to create symmetry, reversibility and error resistance properties with two way decoding.


Morphing tree drawings in a small 3D grid. We study crossing free grid morphs for planar tree drawings using 3D. A morph consists of morphing steps, where vertices move simultaneously along straight line trajectories at constant speeds. A crossing free morph is known between two drawings of an n vertex planar graph G with mathcal O (n) morphing steps and using the third dimension it can be reduced to mathcal O ( log n) for an n vertex tree Arseneva et al. 2019 . However, these morphs do not bound one practical parameter, the resolution. Can the number of steps be reduced substantially by using the third dimension while keeping the resolution bounded throughout the morph? We answer this question in an affirmative and present a 3D non crossing morph between two planar grid drawings of an n vertex tree in mathcal O ( sqrt n log n) morphing steps. Each intermediate drawing lies in a 3D grid of polynomial volume.


Automatic Modeling of Social Concepts Evoked by Art Images as Multimodal Frames. Social concepts referring to non physical objects such as revolution, violence, or friendship are powerful tools to describe, index, and query the content of visual data, including ever growing collections of art images from the Cultural Heritage (CH) field. While much progress has been made towards complete image understanding in computer vision, automatic detection of social concepts evoked by images is still a challenge. This is partly due to the well known semantic gap problem, worsened for social concepts given their lack of unique physical features, and reliance on more unspecific features than concrete concepts. In this paper, we propose the translation of recent cognitive theories about social concept representation into a software approach to represent them as multimodal frames, by integrating multisensory data. Our method focuses on the extraction, analysis, and integration of multimodal features from visual art material tagged with the concepts of interest. We define a conceptual model and present a novel ontology for formally representing social concepts as multimodal frames. Taking the Tate Gallery's collection as an empirical basis, we experiment our method on a corpus of art images to provide a proof of concept of its potential. We discuss further directions of research, and provide all software, data sources, and results.


Space time arithmetic quasi periodic homogenization for damped wave equations. This paper is concerned with space time homogenization problems for damped wave equations with spatially periodic oscillating elliptic coefficients and temporally (arithmetic) quasi periodic oscillating viscosity coefficients. Main results consist of a homogenization theorem, qualitative properties of homogenized matrices which appear in homogenized equations and a corrector result for gradients of solutions. In particular, homogenized equations and cell problems will turn out to deeply depend on the quasi periodicity as well as the log ratio of spatial and temporal periods of the coefficients. Even types of equations will change depending on the log ratio and quasi periodicity. Proofs of the main results are based on a (very weak) space time two scale convergence theory.


Unravelling multi agent ranked delegations. We introduce a voting model with multi agent ranked delegations. This model generalises liquid democracy in two aspects first, an agent's delegation can use the votes of multiple other agents to determine their own for instance, an agent's vote may correspond to the majority outcome of the votes of a trusted group of agents second, agents can submit a ranking over multiple delegations, so that a backup delegation can be used when their preferred delegations are involved in cycles. The main focus of this paper is the study of unravelling procedures that transform the delegation ballots received from the agents into a profile of direct votes, from which a winning alternative can then be determined by using a standard voting rule. We propose and study six such unravelling procedures, two based on optimisation and four using a greedy approach. We study both algorithmic and axiomatic properties, as well as related computational complexity problems of our unravelling procedures for different restrictions on the types of ballots that the agents can submit.


Generative Archimedean Copulas. We propose a new generative modeling technique for learning multidimensional cumulative distribution functions (CDFs) in the form of copulas. Specifically, we consider certain classes of copulas known as Archimedean and hierarchical Archimedean copulas, popular for their parsimonious representation and ability to model different tail dependencies. We consider their representation as mixture models with Laplace transforms of latent random variables from generative neural networks. This alternative representation allows for computational efficiencies and easy sampling, especially in high dimensions. We describe multiple methods for optimizing the network parameters. Finally, we present empirical results that demonstrate the efficacy of our proposed method in learning multidimensional CDFs and its computational efficiency compared to existing methods.


Moderate deviation principles for bifurcating Markov chains case of functions dependent of one variable. The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be seen as the models which represent the evolution of a trait along a population where each individual has two offsprings. Unlike the previous results of Bitseki, Djellout Guillin (2014), we consider here the case of functions which depend only on one variable. So, mainly inspired by the recent works of Bitseki Delmas (2020) about the central limit theorem for general additive functionals of bifurcating Markov chains, we give here a moderate deviation principle for additive functionals of bifurcating Markov chains when the functions depend on one variable. This work is done under the uniform geometric ergodicity and the uniform ergodic property based on the second spectral gap assumptions. The proofs of our results are based on martingale decomposition recently developed by Bitseki Delmas (2020) and on results of Dembo (1996), Djellout (2001) and Puhalski (1997).


Ehrhart Equivalence, Equidecomposability, and Unimodular Equivalence of Integral Polytopes. Ehrhart polynomials are extensively studied structures that interpolate the discrete volume of the dilations of integral n polytopes. The coefficients of Ehrhart polynomials, however, are still not fully understood, and it is not known when two polytopes have equivalent Ehrhart polynomials. In this paper, we establish a relationship between Ehrhart equivalence and other forms of equivalence the operatorname GL n( mathbb Z ) equidecomposability and unimodular equivalence of two integral n polytopes in mathbb R n . We conjecture that any two Ehrhart equivalent integral n polytopes P,Q subset mathbb R n are operatorname GL n( mathbb Z ) equidecomposable into frac 1 (n 1)! th unimodular simplices, thereby generalizing the known cases of n 1, 2, 3 . We also create an algorithm to check for unimodular equivalence of any two integral n simplices in mathbb R n . We then find and prove a new one to one correspondence between unimodular equivalence of integral 2 simplices and the unimodular equivalence of their n dimensional pyramids. Finally, we prove the existence of integral n simplices in mathbb R n that are not unimodularly equivalent for all n ge 2 .


Decentralized Task Offloading in Edge Computing A Multi User Multi Armed Bandit Approach. Mobile edge computing facilitates users to offload computation tasks to edge servers for meeting their stringent delay requirements. Previous works mainly explore task offloading when system side information is given (e.g., server processing speed, cellular data rate), or centralized offloading under system uncertainty. But both generally fall short to handle task placement involving many coexisting users in a dynamic and uncertain environment. In this paper, we develop a multi user offloading framework considering unknown yet stochastic system side information to enable a decentralized user initiated service placement. Specifically, we formulate the dynamic task placement as an online multi user multi armed bandit process, and propose a decentralized epoch based offloading (DEBO) to optimize user rewards which are subjected under network delay. We show that DEBO can deduce the optimal user server assignment, thereby achieving a close to optimal service performance and tight O(log T) offloading regret. Moreover, we generalize DEBO to various common scenarios such as unknown reward gap, dynamic entering or leaving of clients, and fair reward distribution, while further exploring when users' offloaded tasks require heterogeneous computing resources. Particularly, we accomplish a sub linear regret for each of these instances. Real measurements based evaluations corroborate the superiority of our offloading schemes over state of the art approaches in optimizing delay sensitive rewards.


Contact detection between an ellipsoid and a combination of quadrics. We analyze the characteristic polynomial associated to an ellipsoid and another quadric in the context of the contact detection problem. We obtain a necessary and sufficient condition for an efficient method to detect contact. This condition is a feature on the size and the shape of the quadrics and can be checked directly from their parameters. Under this hypothesis, contact can be noticed by means of discriminants of the characteristic polynomial. Furthermore, relative positions can be classified through the sign of the coefficients of this polynomial.


Efficient FedRec Efficient Federated Learning Framework for Privacy Preserving News Recommendation. News recommendation is critical for personalized news access. Most existing news recommendation methods rely on centralized storage of users' historical news click behavior data, which may lead to privacy concerns and hazards. Federated Learning is a privacy preserving framework for multiple clients to collaboratively train models without sharing their private data. However, the computation and communication cost of directly learning many existing news recommendation models in a federated way are unacceptable for user clients. In this paper, we propose an efficient federated learning framework for privacy preserving news recommendation. Instead of training and communicating the whole model, we decompose the news recommendation model into a large news model maintained in the server and a light weight user model shared on both server and clients, where news representations and user model are communicated between server and clients. More specifically, the clients request the user model and news representations from the server, and send their locally computed gradients to the server for aggregation. The server updates its global user model with the aggregated gradients, and further updates its news model to infer updated news representations. Since the local gradients may contain private information, we propose a secure aggregation method to aggregate gradients in a privacy preserving way. Experiments on two real world datasets show that our method can reduce the computation and communication cost on clients while keep promising model performance.


Essence of Factual Knowledge. Knowledge bases are collections of domain specific and commonsense facts. Recently, the sizes of KBs are rocketing due to automatic extraction for knowledge and facts. For example, the number of facts in WikiData is up to 974 million! According to our observation, current KBs, especially domain KBs, show strong relevance in relations according to some topics. These patterns can be used to conclude and infer for part of facts in the KBs. Therefore, the original KBs can be minimzed by extracting patterns and essential facts.


A simple and efficient model for epidemic control on multiplex networks. When an unprecedented infectious disease with high mortality and transmissibility emerges, immediate usage of vaccines or medicines is hardly available. Thus, many health authorities rely on non pharmaceutical interventions through traceable fixed contacts. However, in reality, there is an additional type of transmission routes to the regular and fixed contacts the random anonymous infection cases where non pharmaceutical interventions are hardly feasible. In our study, such realistic situations are implemented by the susceptible infected recovered model with isolation on multiplex networks. The multiplex networks are composed of a fixed interaction layer and a layer with time varying random interactions to represent the different types of disease spreading routes. The multiplex networks represent the combinations of the quenched disorder and annealed disorder. Here, we suggest a preemptive isolation protocol which isolates the second nearest neighbors of the hospitalized individuals and compare it with one of the most popular protocol adopted by many health organizations over the globe. From numerical simulations we find that our preemptive measure significantly reduces both the final epidemic size and the number of the isolated per unit time. Our finding suggests a better non pharmaceutical intervention which can be adopted to various types of diseases even though the contact tracing is only partially available.


An explorative study on how human robot interaction is taken into account by robot developers in praxis. How is human robot interaction considered within the development of new robotic systems by practitioners? This study sets out to inquire, whether the development teams of robotic products have been considering human factor methods in their design and implementation process. We were specifically interested in the non verbal communication methods they were aiming to implement, and how they have approached the design process for these. Although valuable insights on tasks and communication needs during the different phases of robot operation could be gathered, the results of this study indicate, that the perspective of the human user or bystander is very often neglected and that knowledge on methods for engineering human robot interaction is missing. The study was conducted with eleven development teams consisting of robot manufacturers and students within a robot building course representing overall 68 individual participants.


A note on Humphreys' conjecture on blocks. Humphreys' conjecture on blocks parametrises the blocks of reduced enveloping algebras U chi( mathfrak g ) , where mathfrak g is the Lie algebra of a reductive algebraic group over an algebraically closed field of characteristic p 0 and chi in mathfrak g . It is well known to hold under Jantzen's standard assumptions. We note here that it holds under slightly weaker assumptions, by utilising the full generality of certain results in the literature. We also provide a new approach to prove the result for mathfrak g of type G 2 in characteristic 3, a case in which the previously mentioned weaker assumptions do not hold. This approach requires some dimensional calculations for certain centralisers, which we conduct in the Appendix for all the exceptional Lie algebras in bad characteristic.


Towards Data Free Domain Generalization. In this work, we investigate the unexplored intersection of domain generalization and data free learning. In particular, we address the question How can knowledge contained in models trained on different source data domains can be merged into a single model that generalizes well to unseen target domains, in the absence of source and target domain data? Machine learning models that can cope with domain shift are essential for for real world scenarios with often changing data distributions. Prior domain generalization methods typically rely on using source domain data, making them unsuitable for private decentralized data. We define the novel problem of Data Free Domain Generalization (DFDG), a practical setting where models trained on the source domains separately are available instead of the original datasets, and investigate how to effectively solve the domain generalization problem in that case. We propose DEKAN, an approach that extracts and fuses domain specific knowledge from the available teacher models into a student model robust to domain shift. Our empirical evaluation demonstrates the effectiveness of our method which achieves first state of the art results in DFDG by significantly outperforming ensemble and data free knowledge distillation baselines.


Graph Guided Deformation for Point Cloud Completion. For a long time, the point cloud completion task has been regarded as a pure generation task. After obtaining the global shape code through the encoder, a complete point cloud is generated using the shape priorly learnt by the networks. However, such models are undesirably biased towards prior average objects and inherently limited to fit geometry details. In this paper, we propose a Graph Guided Deformation Network, which respectively regards the input data and intermediate generation as controlling and supporting points, and models the optimization guided by a graph convolutional network(GCN) for the point cloud completion task. Our key insight is to simulate the least square Laplacian deformation process via mesh deformation methods, which brings adaptivity for modeling variation in geometry details. By this means, we also reduce the gap between the completion task and the mesh deformation algorithms. As far as we know, we are the first to refine the point cloud completion task by mimicing traditional graphics algorithms with GCN guided deformation. We have conducted extensive experiments on both the simulated indoor dataset ShapeNet, outdoor dataset KITTI, and our self collected autonomous driving dataset Pandar40. The results show that our method outperforms the existing state of the art algorithms in the 3D point cloud completion task.


Extracting Causal Visual Features for Limited label Classification. Neural networks trained to classify images do so by identifying features that allow them to distinguish between classes. These sets of features are either causal or context dependent. Grad CAM is a popular method of visualizing both sets of features. In this paper, we formalize this feature divide and provide a methodology to extract causal features from Grad CAM. We do so by defining context features as those features that allow contrast between predicted class and any contrast class. We then apply a set theoretic approach to separate causal from contrast features for COVID 19 CT scans. We show that on average, the image regions with the proposed causal features require 15 less bits when encoded using Huffman encoding, compared to Grad CAM, for an average increase of 3 classification accuracy, over Grad CAM. Moreover, we validate the transfer ability of causal features between networks and comment on the non human interpretable causal nature of current networks.


Unbiased Single scale and Multi scale Quantizers for Distributed Optimization. Massive amounts of data have led to the training of large scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel SGD have received significant interest as a solution to tackle this problem. However, the performance of distributed systems does not scale linearly with the number of workers due to the high network communication cost for synchronizing gradients and parameters. Researchers have proposed techniques such as quantization and sparsification to alleviate this problem by compressing the gradients. Most of the compression schemes result in compressed gradients that cannot be directly aggregated with efficient protocols such as all reduce. In this paper, we present a set of all reduce compatible gradient compression schemes which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We present the results of our experiments with the CIFAR10 dataset and observations derived during the process. Our compression methods perform better than the in built methods currently offered by the deep learning frameworks. Code is available at the repository url https github.com vineeths96 Gradient Compression .


Observer Path Planning for Maximum Information. This paper is concerned with finding an optimal path for an observer, or sensor, moving at a constant speed, which is to estimate the position of a stationary target, using only bearing angle measurements. The generated path is optimal in the sense that, along the path, information, and thus the efficiency of a potential estimator employed, is maximized. In other words, an observer path is deemed optimal if it maximizes information so that the location of the target is estimated with smallest uncertainty, in some sense. We formulate this problem as an optimal control problem maximizing the determinant of the Fisher information matrix, which is one of the possible measures of information. We derive analytical results for optimality using the Maximum Principle. We carry out numerical experiments and discuss the multiple (locally) optimal solutions obtained. We check graphically that the necessary conditions of optimality are verified by the numerical solutions. Finally we provide a comprehensive list of possible extensions for future work.


Assessing gender bias in medical and scientific masked language models with StereoSet. NLP systems use language models such as Masked Language Models (MLMs) that are pre trained on large quantities of text such as Wikipedia create representations of language. BERT is a powerful and flexible general purpose MLM system developed using unlabeled text. Pre training on large quantities of text also has the potential to transparently embed the cultural and social biases found in the source text into the MLM system. This study aims to compare biases in general purpose and medical MLMs with the StereoSet bias assessment tool. The general purpose MLMs showed significant bias overall, with BERT scoring 57 and RoBERTa scoring 61. The category of gender bias is where the best performances were found, with 63 for BERT and 73 for RoBERTa. Performances for profession, race, and religion were similar to the overall bias scores for the general purpose MLMs.Medical MLMs showed more bias in all categories than the general purpose MLMs except for SciBERT, which showed a race bias score of 55, which was superior to the race bias score of 53 for BERT. More gender (Medical 54 58 vs. General 63 73) and religious (46 54 vs. 58) biases were found with medical MLMs. This evaluation of four medical MLMs for stereotyped assessments about race, gender, religion, and profession showed inferior performance to general purpose MLMs. These medically focused MLMs differ considerably in training source data, which is likely the root cause of the differences in ratings for stereotyped biases from the StereoSet tool.


On the Importance of Capturing a Sufficient Diversity of Perspective for the Classification of micro PCBs. We present a dataset consisting of high resolution images of 13 micro PCBs captured in various rotations and perspectives relative to the camera, with each sample labeled for PCB type, rotation category, and perspective categories. We then present the design and results of experimentation on combinations of rotations and perspectives used during training and the resulting impact on test accuracy. We then show when and how well data augmentation techniques are capable of simulating rotations vs. perspectives not present in the training data. We perform all experiments using CNNs with and without homogeneous vector capsules (HVCs) and investigate and show the capsules' ability to better encode the equivariance of the sub components of the micro PCBs. The results of our experiments lead us to conclude that training a neural network equipped with HVCs, capable of modeling equivariance among sub components, coupled with training on a diversity of perspectives, achieves the greatest classification accuracy on micro PCB data.


How to Split the Effect of Word Segmentation on Gender Bias in Speech Translation. Having recognized gender bias as a major issue affecting current translation technologies, researchers have primarily attempted to mitigate it by working on the data front. However, whether algorithmic aspects concur to exacerbate unwanted outputs remains so far under investigated. In this work, we bring the analysis on gender bias in automatic translation onto a seemingly neutral yet critical component word segmentation. Can segmenting methods influence the ability to translate gender? Do certain segmentation approaches penalize the representation of feminine linguistic markings? We address these questions by comparing 5 existing segmentation strategies on the target side of speech translation systems. Our results on two language pairs (English Italian French) show that state of the art sub word splitting (BPE) comes at the cost of higher gender bias. In light of this finding, we propose a combined approach that preserves BPE overall translation quality, while leveraging the higher ability of character based segmentation to properly translate gender.


A Hierarchical Coding Scheme for Glasses free 3D Displays Based on Scalable Hybrid Layered Representation of Real World Light Fields. This paper presents a novel hierarchical coding scheme for light fields based on transmittance patterns of low rank multiplicative layers and Fourier disparity layers. The proposed scheme learns stacked multiplicative layers from subsets of light field views determined from different scanning orders. The multiplicative layers are optimized using a fast data driven convolutional neural network (CNN). The spatial correlation in layer patterns is exploited with varying low ranks in factorization derived from singular value decomposition on a Krylov subspace. Further, encoding with HEVC efficiently removes intra view and inter view correlation in low rank approximated layers. The initial subset of approximated decoded views from multiplicative representation is used to construct Fourier disparity layer (FDL) representation. The FDL model synthesizes second subset of views which is identified by a pre defined hierarchical prediction order. The correlations between the prediction residue of synthesized views is further eliminated by encoding the residual signal. The set of views obtained from decoding the residual is employed in order to refine the FDL model and predict the next subset of views with improved accuracy. This hierarchical procedure is repeated until all light field views are encoded. The critical advantage of proposed hybrid layered representation and coding scheme is that it utilizes not just spatial and temporal redundancies, but efficiently exploits the strong intrinsic similarities among neighboring sub aperture images in both horizontal and vertical directions as specified by different predication orders. Besides, the scheme is flexible to realize a range of multiple bitrates at the decoder within a single integrated system. The compression performance analyzed with real light field shows substantial bitrate savings, maintaining good reconstruction quality.


Slopes of F isocrystals over abelian varieties. We prove that an F isocrystal over an abelian variety defined over a perfect field of positive characteristic has constant slopes. This recovers and extends a theorem of Tsuzuki for abelian varieties over finite fields. Our proof exploits the theory of monodromy groups of convergent isocrystals.


Erratic birational behavior of mappings in positive characteristic. Birational properites of generically finite morphisms X rightarrow Y of algebraic varieties can be understood locally by a valuation of the function field of X . In finite extensions of algebraic local rings in characteristic zero algebraic function fields which are dominated by a valuation there are nice monomial forms of the mapping after blowing up enough, which reflect classical invariants of the valuation. Further, these forms are stable upon suitable further blowing up. In positive characteristic algebraic function fields it is not always possible to find a monomial form after blowing up along a valuation, even in dimension two. In dimension two and positive characteristic, after enough blowing up, there are stable forms of the mapping which hold upon suitable sequences of blowing. We give examples showing that even within these stable forms, the forms can vary dramatically (erratically) upon further blowing up. We construct these examples in towers of defect Artin Schreier extensions which can have any prescribed distance.


Edvertisements Adding Microlearning to Social News Feeds and Websites. Many long term goals, such as learning a language, require people to regularly practice every day to achieve mastery. At the same time, people regularly surf the web and read social news feeds in their spare time. We have built a browser extension that teaches vocabulary to users in the context of Facebook feeds and arbitrary websites, by showing users interactive quizzes they can answer without leaving the website. On Facebook, the quizzes show up as part of the news feed, while on other sites, the quizzes appear where advertisements normally would. In our user study, we examined the effectiveness of inserting microlearning tasks into social news feeds. We compared vocabulary learning rates when we inserted interactive quizzes into feeds, versus inserting links that lead them to a website where they could do the quizzes. Our results suggest that users engage with and learn from our embedded quizzes, and engagement increases when the quizzes can be done directly within their feeds.


Neural News Recommendation with Collaborative News Encoding and Structural User Encoding. Automatic news recommendation has gained much attention from the academic community and industry. Recent studies reveal that the key to this task lies within the effective representation learning of both news and users. Existing works typically encode news title and content separately while neglecting their semantic interaction, which is inadequate for news text comprehension. Besides, previous models encode user browsing history without leveraging the structural correlation of user browsed news to reflect user interests explicitly. In this work, we propose a news recommendation framework consisting of collaborative news encoding (CNE) and structural user encoding (SUE) to enhance news and user representation learning. CNE equipped with bidirectional LSTMs encodes news title and content collaboratively with cross selection and cross attention modules to learn semantic interactive news representations. SUE utilizes graph convolutional networks to extract cluster structural features of user history, followed by intra cluster and inter cluster attention modules to learn hierarchical user interest representations. Experiment results on the MIND dataset validate the effectiveness of our model to improve the performance of news recommendation. Our code is released at https github.com Veason silverbullet NNR.


High Order Residual Distribution Conservative Finite Difference HWENO Scheme for Steady State Problems. In this paper, we develop a high order residual distribution (RD) method for solving steady state conservation laws in a novel Hermite weighted essentially non oscillatory (HWENO) framework recently developed in 24 . In particular, we design a high order HWENO integration for the integrals of source term and fluxes based on the point value of the solution and its spatial derivatives, and the principles of residual distribution schemes are adapted to obtain steady state solutions. Two advantages of the novel HWENO framework have been shown in 24 first, compared with the traditional HWENO framework, the proposed method does not need to introduce additional auxiliary equations to update the derivatives of the unknown variable, and just compute them from the current point value of the solution and its old spatial derivatives, which saves the computational storage and CPU time, and thereby improve the computational efficiency of the traditional HWENO framework. Second, compared with the traditional WENO method, reconstruction stencil of the HWENO methods becomes more compact, their boundary treatment is simpler, and the numerical errors are smaller at the same grid. Thus, it is also a compact scheme when we design the higher order accuracy, compared with that in 11 Chou and Shu proposed. Extensive numerical experiments for one and two dimensional scalar and systems problems confirm the high order accuracy and good quality of our scheme.


Infinitesimals via Cauchy sequences Refining the classical equivalence. A refinement of the classic equivalence relation among Cauchy sequences yields a useful infinitesimal enriched number system. Such an approach can be seen as formalizing Cauchy's sentiment that a null sequence "becomes" an infinitesimal. We signal a little noticed construction of a system with infinitesimals in a 1910 publication by Giuseppe Peano, reversing his earlier endorsement of Cantor's belittling of infinitesimals.


A Systematic Comparison of Two Refactoring aware Merging Techniques. Dealing with merge conflicts in version control systems is a challenging task for software developers. Resolving merge conflicts is a time consuming and error prone process, which distracts developers from important tasks. Recent work shows that refactorings are often involved in merge conflicts and that refactoring related conflicts tend to be larger, making them harder to resolve. In the literature, there are two refactoring aware merging techniques that claim to automatically resolve refactoring related conflicts however, these two techniques have never been empirically compared. In this paper, we present RefMerge, a Java re implementation of the first technique, which is an operation based refactoring aware merging algorithm. We compare RefMerge to Git and the state of the art graph based refactoring aware merging tool, IntelliMerge, on 2,001 merge scenarios with refactoring related conflicts from 20 open source projects. We find that RefMerge completely resolves 143 (7 ) merge scenarios while IntelliMerge resolves only 78 (4 ). We additionally conduct a qualitative analysis of the differences between the three merging algorithms and provide insights of the strengths and weaknesses of each tool.


BGPeek a Boo Active BGP based Traceback for Amplification DDoS Attacks. Amplification DDoS attacks inherently rely on IP spoofing to steer attack traffic to the victim. At the same time, IP spoofing undermines prosecution, as the originating attack infrastructure remains hidden. Researchers have therefore proposed various mechanisms to trace back amplification attacks (or IP spoofed attacks in general). However, existing traceback techniques require either the cooperation of external parties or a priori knowledge about the attacker. We propose BGPeek a Boo, a BGP based approach to trace back amplification attacks to their origin network. BGPeek a Boo monitors amplification attacks with honeypots and uses BGP poisoning to temporarily shut down ingress traffic from selected Autonomous Systems. By systematically probing the entire AS space, we detect systems forwarding and originating spoofed traffic. We then show how a graph based model of BGP route propagation can reduce the search space, resulting in a 5x median speed up and over 20x for 1 4 of all cases. BGPeek a Boo achieves a unique traceback result 60 of the time in a simulation based evaluation supported by real world experiments.


New Yamabe type flow in a compact Riemannian manifold. In this paper, we set up a new Yamabe type flow on a compact Riemannian manifold (M,g) of dimension n geq 3 . Let psi(x) be any smooth function on M . Let p frac n 2 n 2 and c n frac 4(n 1) n 2 . We study the Yamabe type flow u u(t) satisfying u t u 1 p (c n Delta u psi(x)u) r(t)u, in M times (0,T), T 0 with r(t) int M(c n nabla u 2 psi(x)u 2)dv int Mu p 1 , which preserves the L p 1 (M) norm and we can show that for any initial metric u 0 0 , the flow exists globally. We also show that in some cases, the global solution converges to a smooth solution to the equation c n Delta u psi(x)u r( infty)u p 0, on M and our result may be considered as a generalization of the result of T.Aubin, Proposition in p.131 in cite A82 .


Pore scale investigation on natural convection melting in a square cavity with gradient porous media. In this paper, a numerical study on the melting behavior of phase change material (PCM) with gradient porous media has been carried out at the pore scales. In order to solve the governing equations, a pore scale lattice Boltzmann method with the double distribution functions is used, in which a volumetric LB scheme is employed to handle the boundary. The Monte Carlo random sampling is adopted to generate a microstructure of two dimensional gradient foam metal which are then used to simulate the solid liquid phase transition in the cavity. The effect of several factors, such as gradient porosity structure, gradient direction, Rayleigh number and particle diameters on the liquid fraction of PCM are systematically investigated. It is observed that the presence of gradient media affect significantly the melting rate and shortens full melting time compared to that for constant porosity by enhancing natural convection. The melting time of positive and negative gradients will change with Rayleigh number, and there is a critical value for Rayleigh number. Specifically, when Rayleigh number is below the critical value, the positive gradient is more advantageous, and when Rayleigh number exceeds the critical value, the negative gradient is more advantageous. Moreover, smaller particle diameters would lead to lower permeability and larger internal surfaces for heat transfer.


The Elastic Spiral Phase Pipe. We design a device for the passive mode conversion of guided, axisymmetric, ultrasonic waves in hollow elastic pipes into arbitrary non axisymmetric flexural waves that have a constant angular profile along the pipe axis. To achieve this we create an elastic analogue to optical spiral phase plates the elastic spiral phase pipe. Three possible configurations of the elastic spiral phase pipe are presented which allow the efficient generation of non axisymmetric flexural waves from an axisymmetric, longitudinal forcing. The theory leverages the dispersive nature of the guided elastic waves that are supported in pipes through a defined relative refractive index. As such we include a spectral collocation method used to aid the design of the elastic spiral phase pipe that is corroborated with numerical simulations and then experimentally verified.


JPEG Steganography with Embedding Cost Learning and Side Information Estimation. A great challenge to steganography has arisen with the wide application of steganalysis methods based on convolutional neural networks (CNNs). To this end, embedding cost learning frameworks based on generative adversarial networks (GANs) have been proposed and achieved success for spatial steganography. However, the application of GAN to JPEG steganography is still in the prototype stage its anti detectability and training efficiency should be improved. In conventional steganography, research has shown that the side information calculated from the precover can be used to enhance security. However, it is hard to calculate the side information without the spatial domain image. In this work, an embedding cost learning framework for JPEG Steganography via a Generative Adversarial Network (JS GAN) has been proposed, the learned embedding cost can be further adjusted asymmetrically according to the estimated side information. Experimental results have demonstrated that the proposed method can automatically learn a content adaptive embedding cost function, and use the estimated side information properly can effectively improve the security performance. For example, under the attack of a classic steganalyzer GFR with quality factor 75 and 0.4 bpnzAC, the proposed JS GAN can increase the detection error 2.58 over J UNIWARD, and the estimated side information aided version JS GAN(ESI) can further increase the security performance by 11.25 over JS GAN.


Minimal surfaces in mathbb R 4 like the Lagrangian catenoid. In this paper, we discuss complete minimal immersions in mathbb R N ( N geq4 ) with finite total curvature and embedded planar ends. First, we prove nonexistence for the following cases (1) genus 1 with 2 embedded planar ends, (2) genus neq4 , hyperelliptic with 2 embedded planar ends like the Lagrangian catenoid. Then we show the existence of embedded minimal spheres in mathbb R 4 with 3 embedded planar ends. Moreover, we construct genus g examples in mathbb R 4 with d embedded planar ends such that g geq 1 and g 2 leq d leq 2g 1 . These examples include a family of embedded minimal tori with 3 embedded planar ends.


Boundary Aware Segmentation Network for Mobile and Web Applications. Although deep models have greatly improved the accuracy and robustness of image segmentation, obtaining segmentation results with highly accurate boundaries and fine structures is still a challenging problem. In this paper, we propose a simple yet powerful Boundary Aware Segmentation Network (BASNet), which comprises a predict refine architecture and a hybrid loss, for highly accurate image segmentation. The predict refine architecture consists of a densely supervised encoder decoder network and a residual refinement module, which are respectively used to predict and refine a segmentation probability map. The hybrid loss is a combination of the binary cross entropy, structural similarity and intersection over union losses, which guide the network to learn three level (ie, pixel , patch and map level) hierarchy representations. We evaluate our BASNet on two reverse tasks including salient object segmentation, camouflaged object segmentation, showing that it achieves very competitive performance with sharp segmentation boundaries. Importantly, BASNet runs at over 70 fps on a single GPU which benefits many potential real applications. Based on BASNet, we further developed two (close to) commercial applications AR COPY PASTE, in which BASNet is integrated with augmented reality for "COPYING" and "PASTING" real world objects, and OBJECT CUT, which is a web based tool for automatic object background removal. Both applications have already drawn huge amount of attention and have important real world impacts. The code and two applications will be publicly available at https github.com NathanUA BASNet.


Bornological quantum groups as locally compact quantum groups. Bornological quantum groups were introduced by Voigt in order to generalize the theory of algebraic quantum groups in the sense of van Daele. In particular the class of bornological quantum groups contains all classical locally compact groups. In this paper we prove that a bornological quantum group gives rise to a locally compact quantum group, in a similar way to Kustermans and van Daele's result for algebraic quantum groups. We show that the bornological quantum groups, although more general than the algebraic ones, share most of their nice properties. We also argue that bornological quantum groups, when they occur as dense subalgebras of locally compact quantum groups, are useful tools for studying locally compact quantum groups. For instance, we show that the simple definition of a bornological closed quantum subgroup yields a closed subgroup of the locally compact quantum group in the sense of Vaes or Wooronowicz.


Unsupervised Multimodal Language Representations using Convolutional Autoencoders. Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements combining different modalities and capturing temporal information. During the last years, several works have been proposed in the area, mostly centered around supervised learning in downstream tasks. In this paper we propose extracting unsupervised Multimodal Language representations that are universal and can be applied to different tasks. Towards this end, we map the word level aligned multimodal sequences to 2 D matrices and then use Convolutional Autoencoders to learn embeddings by combining multiple datasets. Extensive experimentation on Sentiment Analysis (MOSEI) and Emotion Recognition (IEMOCAP) indicate that the learned representations can achieve near state of the art performance with just the use of a Logistic Regression algorithm for downstream classification. It is also shown that our method is extremely lightweight and can be easily generalized to other tasks and unseen data with small performance drop and almost the same number of parameters. The proposed multimodal representation models are open sourced and will help grow the applicability of Multimodal Language.


Routing Towards Discriminative Power of Class Capsules. Capsule networks are recently proposed as an alternative to modern neural network architectures. Neurons are replaced with capsule units that represent specific features or entities with normalized vectors or matrices. The activation of lower layer capsules affects the behavior of the following capsules via routing links that are constructed during training via certain routing algorithms. We discuss the routing by agreement scheme in dynamic routing algorithm which, in certain cases, leads the networks away from optimality. To obtain better and faster convergence, we propose a routing algorithm that incorporates a regularized quadratic programming problem which can be solved efficiently. Particularly, the proposed routing algorithm targets directly on the discriminative power of class capsules making the correct decision on input instances. We conduct experiments on MNIST, MNIST Fashion, and CIFAR 10 and show competitive classification results compared to existing capsule networks.


Non dimensional parameters for the flapping dynamics of multilayered plates. Coupled flow induced flapping dynamics of flexible plates are governed by three non dimensional numbers Reynolds number, mass ratio, and non dimensional flexural rigidity. The traditional definition of these parameters is limited to isotropic single layered flexible plates. There is a need to define these parameters for a more generic plate made of multiple isotropic layers placed on top of each other. In this work, we derive the non dimensional parameters for a flexible plate of n isotropic layers and validate the non dimensional parameters with the aid of numerical simulations.


Apple Tasting Revisited Bayesian Approaches to Partially Monitored Online Binary Classification. We consider a variant of online binary classification where a learner sequentially assigns labels ( 0 or 1 ) to items with unknown true class. If, but only if, the learner chooses label 1 they immediately observe the true label of the item. The learner faces a trade off between short term classification accuracy and long term information gain. This problem has previously been studied under the name of the apple tasting' problem. We revisit this problem as a partial monitoring problem with side information, and focus on the case where item features are linked to true classes via a logistic regression model. Our principal contribution is a study of the performance of Thompson Sampling (TS) for this problem. Using recently developed information theoretic tools, we show that TS achieves a Bayesian regret bound of an improved order to previous approaches. Further, we experimentally verify that efficient approximations to TS and Information Directed Sampling via P ' o lya Gamma augmentation have superior empirical performance to existing methods.


Comparative study on charging up of single, double and triple Gas Electron Multipliers (GEM). In this paper, a detailed investigation has been carried out to understand the physics behind GEM charging up and its effects on gain. Experiments have been performed on both double and triple GEM with the help of 55Fe x ray source and a comparative study of these configurations along with the single GEM results observed in our previous work, has been reported. The increase in gain due to polarization of GEM foil dielectric and reduction in gain due to charge accumulation on dielectric are studied in detail with variation in parameters, like field configuration and radiation rate.


Hierarchies, entropy, and quantitative propagation of chaos for mean field diffusions. This paper develops a non asymptotic, local approach to quantitative propagation of chaos for a wide class of mean field diffusive dynamics. For a system of n interacting particles, the relative entropy between the marginal law of k particles and its limiting product measure is shown to be O((k n) 2) at each time, as long as the same is true at time zero. A simple Gaussian example shows that this rate is optimal. The main assumption is that the limiting measure obeys a certain functional inequality, which is shown to encompass many potentially irregular but not too singular finite range interactions, as well as some infinite range interactions. This unifies the previously disparate cases of Lipschitz versus bounded measurable interactions, improving the best prior bounds of O(k n) which were deduced from global estimates involving all n particles. We also cover a class of models for which qualitative propagation of chaos and even well posedness of the McKean Vlasov equation were previously unknown. At the center of a new approach is a differential inequality, derived from a form of the BBGKY hierarchy, which bounds the k particle entropy in terms of the (k 1) particle entropy.


Fragmentation a Tool for Finding Information, Encryption and Data Flow in Systems. We introduce a new information theoretic measure, fragmentation (F) which can be used to determine how fragmented predictive information is in a system. The concept can be extended to generate fragmentation matrices that can illustrate information flows through digital brains, in the form of directed graphs. Fragmentation and fragmentation matrices can provide new insights into digital brains structure and function, in other words, how causal digital networks "think" and process information. In addition to describing F we demonstrate how it can be used to examine how complex processing arises in neural networks, including differences in lifetime processing and incidents of incidental encryption.


PRIN SPRIN On Extracting Point wise Rotation Invariant Features. Point cloud analysis without pose priors is very challenging in real applications, as the orientations of point clouds are often unknown. In this paper, we propose a brand new point set learning framework PRIN, namely, Point wise Rotation Invariant Network, focusing on rotation invariant feature extraction in point clouds analysis. We construct spherical signals by Density Aware Adaptive Sampling to deal with distorted point distributions in spherical space. Spherical Voxel Convolution and Point Re sampling are proposed to extract rotation invariant features for each point. In addition, we extend PRIN to a sparse version called SPRIN, which directly operates on sparse point clouds. Both PRIN and SPRIN can be applied to tasks ranging from object classification, part segmentation, to 3D feature matching and label alignment. Results show that, on the dataset with randomly rotated point clouds, SPRIN demonstrates better performance than state of the art methods without any data augmentation. We also provide thorough theoretical proof and analysis for point wise rotation invariance achieved by our methods. Our code is available on https github.com qq456cvb SPRIN.


IIoT Enabled Health Monitoring for Integrated Heat Pump System Using Mixture Slow Feature Analysis. The sustaining evolution of sensing and advancement in communications technologies have revolutionized prognostics and health management for various electrical equipment towards data driven ways. This revolution delivers a promising solution for the health monitoring problem of heat pump (HP) system, a vital device widely deployed in modern buildings for heating use, to timely evaluate its operation status to avoid unexpected downtime. Many HPs were practically manufactured and installed many years ago, resulting in fewer sensors available due to technology limitations and cost control at that time. It raises a dilemma to safeguard HPs at an affordable cost. We propose a hybrid scheme by integrating industrial Internet of Things (IIoT) and intelligent health monitoring algorithms to handle this challenge. To start with, an IIoT network is constructed to sense and store measurements. Specifically, temperature sensors are properly chosen and deployed at the inlet and outlet of the water tank to measure water temperature. Second, with temperature information, we propose an unsupervised learning algorithm named mixture slow feature analysis (MSFA) to timely evaluate the health status of the integrated HP. Characterized by frequent operation switches of different HPs due to the variable demand for hot water, various heating patterns with different heating speeds are observed. Slowness, a kind of dynamics to measure the varying speed of steady distribution, is properly considered in MSFA for both heating pattern division and health evaluation. Finally, the efficacy of the proposed method is verified through a real integrated HP with five connected HPs installed ten years ago. The experimental results show that MSFA is capable of accurately identifying health status of the system, especially failure at a preliminary stage compared to its competing algorithms.


The Medical Authority of AI A Study of AI enabled Consumer facing Health Technology. Recently, consumer facing health technologies such as Artificial Intelligence (AI) based symptom checkers (AISCs) have sprung up in everyday healthcare practice. AISCs solicit symptom information from users and provide medical suggestions and possible diagnoses, a responsibility that people usually entrust with real person authorities such as physicians and expert patients. Thus, the advent of AISCs begs a question of whether and how they transform the notion of medical authority in everyday healthcare practice. To answer this question, we conducted an interview study with thirty AISC users. We found that users assess the medical authority of AISCs using various factors including automated decisions and interaction design patterns of AISC apps, associations with established medical authorities like hospitals, and comparisons with other health technologies. We reveal how AISCs are used in healthcare delivery, discuss how AI transforms conventional understandings of medical authority, and derive implications for designing AI enabled health technology.


Self Taught Cross Domain Few Shot Learning with Weakly Supervised Object Localization and Task Decomposition. The domain shift between the source and target domain is the main challenge in Cross Domain Few Shot Learning (CD FSL). However, the target domain is absolutely unknown during the training on the source domain, which results in lacking directed guidance for target tasks. We observe that since there are similar backgrounds in target domains, it can apply self labeled samples as prior tasks to transfer knowledge onto target tasks. To this end, we propose a task expansion decomposition framework for CD FSL, called Self Taught (ST) approach, which alleviates the problem of non target guidance by constructing task oriented metric spaces. Specifically, Weakly Supervised Object Localization (WSOL) and self supervised technologies are employed to enrich task oriented samples by exchanging and rotating the discriminative regions, which generates a more abundant task set. Then these tasks are decomposed into several tasks to finish the task of few shot recognition and rotation classification. It helps to transfer the source knowledge onto the target tasks and focus on discriminative regions. We conduct extensive experiments under the cross domain setting including 8 target domains CUB, Cars, Places, Plantae, CropDieases, EuroSAT, ISIC, and ChestX. Experimental results demonstrate that the proposed ST approach is applicable to various metric based models, and provides promising improvements in CD FSL.


Integrating Material Selection with Design Optimization via Neural Networks. The engineering design process often entails optimizing the underlying geometry while simultaneously selecting a suitable material. For a certain class of simple problems, the two are separable where, for example, one can first select an optimal material, and then optimize the geometry. However, in general, the two are not separable. Furthermore, the discrete nature of material selection is not compatible with gradient based geometry optimization, making simultaneous optimization challenging. In this paper, we propose the use of variational autoencoders (VAE) for simultaneous optimization. First, a data driven VAE is used to project the discrete material database onto a continuous and differentiable latent space. This is then coupled with a fully connected neural network, embedded with a finite element solver, to simultaneously optimize the material and geometry. The neural network's built in gradient optimizer and back propagation are exploited during optimization. The proposed framework is demonstrated using trusses, where an optimal material needs to be chosen from a database, while simultaneously optimizing the cross sectional areas of the truss members. Several numerical examples illustrate the efficacy of the proposed framework. The Python code used in these experiments is available at github.com UW ERSL MaTruss


On the finiteness of local homology modules. Let R be a commutative Noetherian ring and mathfrak a an ideal of R . Let M be a finitely generated R module and N an Artinian R module. The concept of filter coregular sequence is introduced to determine the infimum of the integers i such that the generalized local homology textrm H mathfrak a i(M, N) is not finitely generated as an widehat R mathfrak a module, where widehat R mathfrak a denotes the mathfrak a adic completion of R . In particular, it is shown that textrm H mathfrak a i(M, N) is a finitely generated widehat R mathfrak a module for all i in mathbb N 0 if and only if (0 N mathfrak a textrm Ann R(M)) has finite length whenever R is a complete semi local ring.


The reductive Borel Serre compactification as a model for unstable algebraic K theory. Let A be an associative ring and M a finitely generated projective A module. We introduce a category operatorname RBS (M) and prove several theorems which show that its geometric realisation functions as a well behaved unstable algebraic K theory space. These categories operatorname RBS (M) naturally arise as generalisations of the exit path infty category of the reductive Borel Serre compactification of a locally symmetric space, and one of our main techniques is to find purely categorical analogues of some familiar structures in these compactifications.


Evaluating Metrics for Standardized Benchmarking of Remote Presence Systems. To reduce the need for business related air travel and its associated energy consumption and carbon footprint, the U.S. Department of Energy's ARPA E is supporting a research project called SCOTTIE Systematic Communication Objectives and Telecommunications Technology Investigations and Evaluations. SCOTTIE tests virtual and augmented reality platforms in a functional comparison with face to face (FtF) interactions to derive travel replacement thresholds for common industrial training scenarios. The primary goal of Study 1 is to match the communication effectiveness and learning outcomes obtained from a FtF control using virtual reality (VR) training scenarios in which a local expert with physical equipment trains a remote apprentice without physical equipment immediately present. This application scenario is commonplace in industrial settings where access to expensive equipment and materials is limited and a number of apprentices must travel to a central location in order to undergo training. Supplying an empirically validated virtual training alternative constitutes a readily adoptable use case for businesses looking to reduce time and monetary expenditures associated with travel. The technology used for three different virtual presence technologies was strategically selected for feasibility, relatively low cost, business relevance, and potential for impact through transition. The authors suggest that the results of this study might generalize to the challenge of virtual conferences.


Optimal Technical Indicator based Trading Strategies Using NSGA II. This paper proposes non dominated sorting genetic algorithm II (NSGA II ) in the context of technical indicator based stock trading, by finding optimal combinations of technical indicators to generate buy and sell strategies such that the objectives, namely, Sharpe ratio and Maximum Drawdown are maximized and minimized respectively. NSGA II is chosen because it is a very popular and powerful bi objective evolutionary algorithm. The training and testing used a rolling based approach (two years training and a year for testing) and thus the results of the approach seem to be considerably better in stable periods without major economic fluctuations. Further, another important contribution of this study is to incorporate the transaction cost and domain expertise in the whole modeling approach.


On the commutation properties of finite convolution and differential operators I commutation. Spectral properties of many finite convolution integral operators have been understood by finding differential operators that commute with them. In this paper we compile a complete list of such commuting pairs, extending previous work to complex valued and non self adjoint operators. In addition, we introduce a new kind of commutation relation, which we call sesquicommutation, that also has implications for the spectral properties of the integral operator. In this case we also compute a complete list of sequicommuting pairs of integral and differential operators.


DPSyn Experiences in the NIST Differential Privacy Data Synthesis Challenges. We summarize the experience of participating in two differential privacy competitions organized by the National Institute of Standards and Technology (NIST). In this paper, we document our experiences in the competition, the approaches we have used, the lessons we have learned, and our call to the research community to further bridge the gap between theory and practice in DP research.


Algorithmic techniques for finding resistance distances on structured graphs. In this paper we give a survey of methods used to calculate values of resistance distance (also known as effective resistance) in graphs. Resistance distance has played a prominent role not only in circuit theory and chemistry, but also in combinatorial matrix theory and spectral graph theory. Moreover resistance distance has applications ranging from quantifying biological structures, distributed control systems, network analysis, and power grid systems. In this paper we discuss both exact techniques and approximate techniques and for each method discussed we provide an illustrative example of the technique. We also present some open questions and conjectures.


Best n term approximation of diagonal operators and application to function spaces with mixed smoothness. In this paper we give exact values of the best n term approximation widths of diagonal operators between ell p( mathbb N ) and ell q( mathbb N ) with 0 p,q leq infty . The result will be applied to obtain the asymptotic constants of best n term approximation widths of embeddings of function spaces with mixed smoothness by trigonometric system.


Deep Structured Reactive Planning. An intelligent agent operating in the real world must balance achieving its goal with maintaining the safety and comfort of not only itself, but also other participants within the surrounding scene. This requires jointly reasoning about the behavior of other actors while deciding its own actions as these two processes are inherently intertwined a vehicle will yield to us if we decide to proceed first at the intersection but will proceed first if we decide to yield. However, this is not captured in most self driving pipelines, where planning follows prediction. In this paper we propose a novel data driven, reactive planning objective which allows a self driving vehicle to jointly reason about its own plans as well as how other actors will react to them. We formulate the problem as an energy based deep structured model that is learned from observational data and encodes both the planning and prediction problems. Through simulations based on both real world driving and synthetically generated dense traffic, we demonstrate that our reactive model outperforms a non reactive variant in successfully completing highly complex maneuvers (lane merges turns in traffic) faster, without trading off collision rate.


Exploring Content Based Image Retrieval for Highly Imbalanced Melanoma Data using Style Transfer, Semantic Image Segmentation and Ensemble Learning. Lesion images are frequently taken in open set settings. Because of this, the image data generated is extremely varied in nature.It is difficult for a convolutional neural network to find proper features and generalise well, as a result content based image retrieval (CBIR) system for lesion images are difficult to build. This paper explores this domain and proposes multiple similarity measures which uses Style Loss and Dice Coefficient via a novel similarity measure called I1 Score. Out of the CBIR similarity measures proposed, pure style loss approach achieves a remarkable accuracy increase over traditional approaches like Euclidean Distance and Cosine Similarity. The I1 Scores using style loss performed better than traditional approaches by a small margin, whereas, I1 Scores with dice coefficient faired very poorly. The model used is trained using ensemble learning for better generalization.


Energy cost study for controlling complex social networks with conformity behavior. In order to understand controlling a complex system, an estimation of the required effort needed to achieve control is vital. Previous works have addressed this issue by studying the scaling laws of energy cost in a general way with continuous time linear dynamics. However, continuous time linear dynamics is unable to capture conformity behavior, which is common in many complex social systems. Therefore, to understand controlling social systems with conformity, discrete time modelling is used and the energy cost scaling laws are derived. The results are validated numerically with model and real networks. In addition, the energy costs needed for controlling systems with and without conformity are compared, and it was found that controlling networked systems with conformity features always requires less control energy. Finally, it is shown through simulations that heterogeneous scale free networks are less controllable, requiring a higher number of minimum drivers. Since the conformity based model relates to various complex systems, such as flocking, or evolutionary games, the results of this paper represent a step forward towards developing realistic control of complex social systems.


Train track maps on graphs of groups. In this paper we develop the theory of train track maps on graphs of groups. Expanding a definition of Bass, we define a notion of a map of a graph of groups, and of a homotopy equivalence. We prove that under one of two technical hypotheses, any homotopy equivalence of a graph of groups may be represented by a relative train track map. The first applies in particular to graphs of groups with finite edge groups, while the second applies in particular to certain generalized Baumslag Solitar groups.


Sensor Data Augmentation by Resampling for Contrastive Learning in Human Activity Recognition. While deep learning has contributed to the advancement of sensor based Human Activity Recognition (HAR), it is usually a costly and challenging supervised task with the needs of a large amount of labeled data. To alleviate this issue, contrastive learning has been applied for sensor based HAR. Data augmentation is an essential part of contrastive learning and has a significant impact on the performance of downstream tasks. However, current popular augmentation methods do not achieve competitive performance in contrastive learning for sensor based HAR. Motivated by this issue, we propose a new sensor data augmentation method by resampling, which simulates more realistic activity data by varying the sampling frequency to maximize the coverage of the sampling space. In addition, we extend MoCo, a popular contrastive learning framework, to MoCoHAR for HAR. The resampling augmentation method will be evaluated on two contrastive learning frameworks, SimCLRHAR and MoCoHAR, using UCI HAR, MotionSensor, and USC HAD datasets. The experiment results show that the resampling augmentation method outperforms all state of the art methods under a small amount of labeled data, on SimCLRHAR and MoCoHAR, with mean F1 score as the evaluation metric. The results also demonstrate that not all data augmentation methods have positive effects in the contrastive learning framework.


Linear complexity over mathbb F q and 2 adic complexity of a class of binary generalized cyclotomic sequences with low value autocorrelation. A class of binary sequences with period 2p is constructed using generalized cyclotomic classes, and their linear complexity, minimal polynomial over mathbb F q as well as 2 adic complexity are determined using Gauss period and group ring theory. The results show that the linear complexity of these sequences attains the maximum when p equiv pm 1( bmod 8) and is equal to p 1 when p equiv pm 3( bmod 8) over extension field. Moreover, the 2 adic complexity of these sequences is maximum. According to Berlekamp Massey(B M) algorithm and the rational approximation algorithm(RAA), these sequences have quite good cryptographyic properties in the aspect of linear complexity and 2 adic complexity.


Semantic Navigation Using Building Information on Construction Sites. With the growth in automated data collection of construction projects, the need for semantic navigation of mobile robots is increasing. In this paper, we propose an infrastructure to leverage building related information for smarter, safer and more precise robot navigation during construction phase. Our use of Building Information Models (BIM) in robot navigation is twofold (1) the intuitive semantic information enables non experts to deploy robots and (2) the semantic data exposed to the navigation system allows optimal path planning (not necessarily the shortest one). Our Building Information Robotic System (BIRS) uses Industry Foundation Classes (IFC) as the interoperable data format between BIM and the Robotic Operating System (ROS). BIRS generates topological and metric maps from BIM for ROS usage. An optimal path planer, integrating critical components for construction assessment is proposed using a cascade strategy (global versus local). The results are validated through series of experiments in construction sites.


The Tur 'an number of Berge book hypergraphs. Given a graph G , a Berge copy of G is a hypergraph obtained by enlarging the edges arbitrarily. Gy H ori in 2006 showed that for r 3 or r 4 , an r uniform n vertex Berge triangle free hypergraph has at most lfloor n 2 8(r 2) rfloor hyperedges if n is large enough, and this bound is sharp. The book graph B t consists of t triangles sharing an edge. Very recently, Ghosh, Gy H o ri, Nagy Gy "orgy, Paulos, Xiao and Zamora showed that a 3 uniform n vertex Berge B t free hypergraph has at most n 2 8 o(n 2) hyperedges if n is large enough. They conjectured that this bound can be improved to lfloor n 2 8 rfloor . We prove this conjecture for t 2 and disprove it for t 2 by proving the sharp bound lfloor n 2 8 rfloor (t 1) 2 . We also consider larger uniformity and determine the largest number of Berge B t free r uniform hypergraphs besides an additive term o(n 2) . We obtain a similar bound if the Berge t fan ( t triangles sharing a vertex) is forbidden.


Deep Neural Networks for Creating Reliable PmP Database with a Case Study in Southern California. Recent progresses in artificial intelligence and machine learning make it possible to automatically identify seismic phases from exponentially growing seismic data. Despite some exciting successes in automatic picking of the first P and S wave arrivals, auto identification of later seismic phases such as the Moho reflected PmP waves remains a significant challenge in matching the performance of experienced analysts. The main difficulty of machine identifying PmP waves is that the identifiable PmP waves are rare, making the problem of identifying the PmP waves from a massive seismic database inherently unbalanced. In this work, by utilizing a high quality PmP dataset (10,192 manual picks) in southern California, we develop PmPNet, a deep neural network based algorithm to automatically identify PmP waves efficiently by doing so, we accelerate the process of identifying the PmP waves. PmPNet applies similar techniques in the machine learning community to address the unbalancement of PmP datasets. The architecture of PmPNet is a residual neural network (ResNet) autoencoder with additional predictor block, where encoder, decoder, and predictor are equipped with ResNet connection. We conduct systematic research with field data, concluding that PmPNet can efficiently achieve high precision and high recall simultaneously to automatically identify PmP waves from a massive seismic database. Applying the pre trained PmPNet to the seismic database from January 1990 to December 1999 in southern California, we obtain nearly twice more PmP picks than the original PmP dataset, providing valuable data for other studies such as mapping the topography of the Moho discontinuity and imaging the lower crust structures of southern California.


MixFace Improving Face Verification Focusing on Fine grained Conditions. The performance of face recognition has become saturated for public benchmark datasets such as LFW, CFP FP, and AgeDB, owing to the rapid advances in CNNs. However, the effects of faces with various fine grained conditions on FR models have not been investigated because of the absence of such datasets. This paper analyzes their effects in terms of different conditions and loss functions using K FACE, a recently introduced FR dataset with fine grained conditions. We propose a novel loss function, MixFace, that combines classification and metric losses. The superiority of MixFace in terms of effectiveness and robustness is demonstrated experimentally on various benchmark datasets.


A kind of KK theory for rings. A group equivariant KK theory for rings will be defined and studied in analogy to Kasparov's KK theory for C algebras. It is a kind of linearization of the category of rings by allowing addition of homomorphisms, imposing also homotopy invariance, invertibility of matrix corner embeddings, and allowing morphisms which are the opposite split of split exact sequences. We demonstrate the potential of this theory by proving for example equivalence induced by Morita equivalence and a Green Julg isomorphism in this framework.


Dual Tuning Joint Prototype Transfer and Structure Regularization for Compatible Feature Learning. Visual retrieval system faces frequent model update and deployment. It is a heavy workload to re extract features of the whole database every time.Feature compatibility enables the learned new visual features to be directly compared with the old features stored in the database. In this way, when updating the deployed model, we can bypass the inflexible and time consuming feature re extraction process. However, the old feature space that needs to be compatible is not ideal and faces the distribution discrepancy problem with the new space caused by different supervision losses. In this work, we propose a global optimization Dual Tuning method to obtain feature compatibility against different networks and losses. A feature level prototype loss is proposed to explicitly align two types of embedding features, by transferring global prototype information. Furthermore, we design a component level mutual structural regularization to implicitly optimize the feature intrinsic structure. Experimental results on million scale datasets demonstrate that our Dual Tuning is able to obtain feature compatibility without sacrificing performance. (Our code will be avaliable at https github.com yanbai1993 Dual Tuning)


Neo Lorentzian Relativity and the Beginning of the Universe. Many physicists have thought that absolute time became otiose with the introduction of Special Relativity. William Lane Craig disagrees and argues that although relativity is empirically adequate within a domain of application, relativity should be supplanted by a Neo Lorentzian alternative that allows for absolute time. Meanwhile, Craig and co author Sinclair have argued that physical cosmology supports the conclusion that physical reality began to exist at a finite time in the past. However, on their view, the beginning of physical reality requires the objective passage of absolute time, so that the beginning of physical reality stands or falls with Craig's Neo Lorentzian metaphysics. I raise doubts about whether, given Craig's NeoLorentzian metaphysics, physical cosmology could adequately support a beginning of physical reality within the finite past. Craig and Sinclair's conception of the beginning of the universe requires a past boundary to the universe. A past boundary to the universe cannot be directly observed and so must be inferred from the observed matter energy distribution in conjunction with auxilary hypotheses drawn from a substantive physical theory. Craig's brand of Neo Lorentzianism has not been sufficiently well specified so as to infer either that there is a past boundary or that the boundary is located in the finite past. Thus, Neo Lorentzianism implicitly introduces a form of skepticism that removes the ability that we might have otherwise had to infer a beginning of the universe. Furthermore, in analyzing traditional big bang models, I develop criteria that Neo Lorentzians should deploy in thinking about the direction and duration of time in cosmological models generally. For my last task, I apply the same criteria to bounce cosmologies and show that Craig and Sinclair have been wrong to interpret bounce cosmologies as including a beginning of physical reality.


Offset Symmetric Gaussians for Differential Privacy. The Gaussian distribution is widely used in mechanism design for differential privacy (DP). Thanks to its sub Gaussian tail, it significantly reduces the chance of outliers when responding to queries. However, it can only provide approximate ( epsilon, delta( epsilon)) DP. In practice, delta( epsilon) must be much smaller than the size of the dataset, which may limit the use of the Gaussian mechanism for large datasets with strong privacy requirements. In this paper, we introduce and analyze a new distribution for use in DP that is based on the Gaussian distribution, but has improved privacy performance. The so called offset symmetric Gaussian tail (OSGT) distribution is obtained through using the normalized tails of two symmetric Gaussians around zero. Consequently, it can still have sub Gaussian tail and lend itself to analytical derivations. We analytically derive the variance of the OSGT random variable and the delta( epsilon) of the OSGT mechanism. We then numerically show that at the same variance, the OSGT mechanism can offer a lower delta( epsilon) than the Gaussian mechanism. We extend the OSGT mechanism to k dimensional queries and derive an easy to compute analytical upper bound for its zero concentrated differential privacy (zCDP) performance. We analytically prove that at the same variance, the same global query sensitivity and for sufficiently large concentration orders alpha , the OSGT mechanism performs better than the Gaussian mechanism in terms of zCDP.


SmartReviews Towards Human and Machine actionable Reviews. Review articles summarize state of the art work and provide a means to organize the growing number of scholarly publications. However, the current review method and publication mechanisms hinder the impact review articles can potentially have. Among other limitations, reviews only provide a snapshot of the current literature and are generally not readable by machines. In this work, we identify the weaknesses of the current review method. Afterwards, we present the SmartReview approach addressing those weaknesses. The approach pushes towards semantic community maintained review articles. At the core of our approach, knowledge graphs are employed to make articles more machine actionable and maintainable.