Ultra sensitive measurement of transverse displacements with structured light. Accurately measuring mechanical displacements is essential for a vast portion of current technologies. Several optical techniques accomplish this task, allowing for non contact sensing even below the diffraction limit. Here we introduce an optical encoding technique, dubbed "linear photonic gears", that enables ultra sensitive measurements of transverse displacements by mapping these into polarization rotations of a laser beam. In ordinary ambient conditions, we measure the relative shift between two objects with a resolution of 400 pm. We argue that a resolution of 50 pm should be achievable with existing state of the art technologies. Our single optical path scheme is intrinsically stable and it could be implemented as a compact sensor, using integrated optics. We anticipate it may have a strong impact on both research and industry.


Learning to solve geometric construction problems from images. We describe a purely image based method for finding geometric constructions with a ruler and compass in the Euclidea geometric game. The method is based on adapting the Mask R CNN state of the art image processing neural architecture and adding a tree based search procedure to it. In a supervised setting, the method learns to solve all 68 kinds of geometric construction problems from the first six level packs of Euclidea with an average 92 accuracy. When evaluated on new kinds of problems, the method can solve 31 of the 68 kinds of Euclidea problems. We believe that this is the first time that a purely image based learning has been trained to solve geometric construction problems of this difficulty.


Understanding Gender and Racial Disparities in Image Recognition Models. Large scale image classification models trained on top of popular datasets such as Imagenet have shown to have a distributional skew which leads to disparities in prediction accuracies across different subsections of population demographics. A lot of approaches have been made to solve for this distributional skew using methods that alter the model pre, post and during training. We investigate one such approach which uses a multi label softmax loss with cross entropy as the loss function instead of a binary cross entropy on a multi label classification problem on the Inclusive Images dataset which is a subset of the OpenImages V6 dataset. We use the MR2 dataset, which contains images of people with self identified gender and race attributes to evaluate the fairness in the model outcomes and try to interpret the mistakes by looking at model activations and suggest possible fixes.


HOT VAE Learning High Order Label Correlation for Multi Label Classification via Attention Based Variational Autoencoders. Understanding how environmental characteristics affect bio diversity patterns, from individual species to communities of species, is critical for mitigating effects of global change. A central goal for conservation planning and monitoring is the ability to accurately predict the occurrence of species communities and how these communities change over space and time. This in turn leads to a challenging and long standing problem in the field of computer science how to perform ac curate multi label classification with hundreds of labels? The key challenge of this problem is its exponential sized output space with regards to the number of labels to be predicted.Therefore, it is essential to facilitate the learning process by exploiting correlations (or dependency) among labels. Previous methods mostly focus on modelling the correlation on label pairs however, complex relations between real world objects often go beyond second order. In this paper, we pro pose a novel framework for multi label classification, High order Tie in Variational Autoencoder (HOT VAE), which per forms adaptive high order label correlation learning. We experimentally verify that our model outperforms the existing state of the art approaches on a bird distribution dataset on both conventional F1 scores and a variety of ecological metrics. To show our method is general, we also perform empirical analysis on seven other public real world datasets in several application domains, and Hot VAE exhibits superior performance to previous methods.


Social Network Analysis of Hadith Narrators from Sahih Bukhari. The ahadith, prophetic traditions for the Muslims around the world, are narrations originating from the sayings and the deeds of Prophet Muhammad (pbuh). They are considered one of the fundamental sources of Islamic legislation along with the Quran. The list of persons involved in the narration of each hadith is carefully scrutinized by scholars studying the hadith, with respect to their reputation and authenticity of the hadith. This is due to the its legislative importance in Islamic principles. There were many narrators who contributed to this responsibility of preserving prophetic narrations over the centuries. But to date, no systematic and comprehensive study, based on the social network, has been adapted to understand the contribution of early hadith narrators and the propagation of hadith across generations. In this study, we represented the chain of narrators of the hadith collection from Sahih Bukhari as a social graph. Based on social network analysis (SNA) on this graph, we found that the network of narrators is a scale free network. We identified a list of influential narrators from the companions as well as the narrators from the second and third generation who contribute significantly in the propagation of hadith collected in Sahih Bukhari. We discovered sixteen communities from the narrators of Sahih Bukhari. In each of these communities, there are other narrators who contributed significantly to the propagation of prophetic narrations. We also found that most narrators were centered in Makkah and Madinah in the era of companions and, then, gradually the center of hadith narrators shifted towards Kufa, Baghdad and central Asia over a period of time. To the best of our knowledge, this the first comprehensive and systematic study based on SNA, representing the narrators as a social graph to analyze their contribution to the preservation and propagation of hadith.


Stability and convergence of Galerkin schemes for parabolic equations with application to Kolmogorov pricing equations in time inhomogeneous L 'evy models. Two essential quantities for the analysis of approximation schemes of evolution equations are stability and convergence. We derive stability and convergence of fully discrete approximation schemes of solutions to linear parabolic evolution equations governed by time dependent coercive operators. We consider abstract Galerkin approximations in space combined with theta schemes in time. The level of generality of our analysis comprises both a large class of time dependent operators and a large choice of approximating Galerkin spaces. In particular the results apply to partial integro differential equations for option pricing in time inhomogeneous L 'evy models and allows for a large variety of option types and models. The derivation builds on the strong foundation laid out by von Petersdorff and Schwab (2003) who provide the respective results for the time homogeneous case. We discuss the assumptions in the context of option pricing.


SoK Fully Homomorphic Encryption Compilers. Fully Homomorphic Encryption (FHE) allows a third party to perform arbitrary computations on encrypted data, learning neither the inputs nor the computation results. Hence, it provides resilience in situations where computations are carried out by an untrusted or potentially compromised party. This powerful concept was first conceived by Rivest et al. in the 1970s. However, it remained unrealized until Craig Gentry presented the first feasible FHE scheme in 2009. The advent of the massive collection of sensitive data in cloud services, coupled with a plague of data breaches, moved highly regulated businesses to increasingly demand confidential and secure computing solutions. This demand, in turn, has led to a recent surge in the development of FHE tools. To understand the landscape of recent FHE tool developments, we conduct an extensive survey and experimental evaluation to explore the current state of the art and identify areas for future development. In this paper, we survey, evaluate, and systematize FHE tools and compilers. We perform experiments to evaluate these tools' performance and usability aspects on a variety of applications. We conclude with recommendations for developers intending to develop FHE based applications and a discussion on future directions for FHE tools development.


Logical Foundations of Quantitative Equality (long version). Quantitative reasoning provides a flexible approach capable to deal with the uncertainty and imprecision that affects modern software systems due to their complexity. Its distinguishing feature is the use of distances, instead of equivalence relations, so that one can measure how much two objects are similar, rather than just saying whether they are equivalent or not. In this paper we aim at providing a solid logical ground to quantitative reasoning, using the categorical language of Lawvere's hyperdoctrines. The key idea is to see distances as equality predicates in Linear Logic. Adding equality to Linear Logic, however, is not as trivial as it might appear. The linear version of the usual rules for equality, asserting that it is reflexive and substitutive, has the consequence that equality collapses to an equivalence relation, as it can be used an arbitrary number of times. To overcome this issue, we consider the extension of Linear Logic with graded modalities and use them to write a resource sensitive substitution rule that keeps equality quantitative. We introduce a deductive calculus for (Graded) Linear Logic with quantitative equality and the notion of Lipschitz doctrine to give semantics to it. Main examples are based on metric spaces and Lipschitz maps and on quantitative realisability.


Stability of Infinite dimensional Sampled data Systems with Unbounded Control Operators and Perturbations. We analyze the robustness of the exponential stability of infinite dimensional sampled data systems with unbounded control operators. The unbounded perturbations we consider are the so called Desch Schappacher perturbations, which arise, e.g., from the boundary perturbations of systems described by partial differential equations. As the main result, we show that the exponential stability of the sampled data system is preserved under all Desch Schappacher perturbations sufficiently small in a certain sense.


Method Towards CVPR 2021 Image Matching Challenge. This report describes Megvii 3D team's approach towards CVPR 2021 Image Matching Workshop.


Temporal Knowledge Graph Completion using Box Embeddings. Knowledge graph completion is the task of inferring missing facts based on existing data in a knowledge graph. Temporal knowledge graph completion (TKGC) is an extension of this task to temporal knowledge graphs, where each fact is additionally associated with a time stamp. Current approaches for TKGC primarily build on existing embedding models which are developed for (static) knowledge graph completion, and extend these models to incorporate time, where the idea is to learn latent representations for entities, relations, and timestamps and then use the learned representations to predict missing facts at various time steps. In this paper, we propose BoxTE, a box embedding model for TKGC, building on the static knowledge graph embedding model BoxE. We show that BoxTE is fully expressive, and possesses strong inductive capacity in the temporal setting. We then empirically evaluate our model and show that it achieves state of the art results on several TKGC benchmarks.


An Enhanced Corpus for Arabic Newspapers Comments. In this paper, we propose our enhanced approach to create a dedicated corpus for Algerian Arabic newspapers comments. The developed approach has to enhance an existing approach by the enrichment of the available corpus and the inclusion of the annotation step by following the Model Annotate Train Test Evaluate Revise (MATTER) approach. A corpus is created by collecting comments from web sites of three well know Algerian newspapers. Three classifiers, support vector machines, na "i ve Bayes, and k nearest neighbors, were used for classification of comments into positive and negative classes. To identify the influence of the stemming in the obtained results, the classification was tested with and without stemming. Obtained results show that stemming does not enhance considerably the classification due to the nature of Algerian comments tied to Algerian Arabic Dialect. The promising results constitute a motivation for us to improve our approach especially in dealing with non Arabic sentences, especially Dialectal and French ones.


Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints. The detection of malware is a critical task for the protection of computing environments. This task often requires extremely low false positive rates (FPR) of 0.01 or even lower, for which modern machine learning has no readily available tools. We introduce the first broad investigation of the use of uncertainty for malware detection across multiple datasets, models, and feature types. We show how ensembling and Bayesian treatments of machine learning methods for static malware detection allow for improved identification of model errors, uncovering of new malware families, and predictive performance under extreme false positive constraints. In particular, we improve the true positive rate (TPR) at an actual realized FPR of 1e 5 from an expected 0.69 for previous methods to 0.80 on the best performing model class on the Sophos industry scale dataset. We additionally demonstrate how previous works have used an evaluation protocol that can lead to misleading results.


On recurrent properties of Fisher Wright's diffusion on (0,1) with mutation. One dimensional Fisher Wright diffusion process on the interval (0,1) with mutations is considered. This is a widely known model in population genetics. The goal of the paper is an exponential recurrence of the process, which also implies exponential rate of convergence towards the invariant measure.


Cross Lingual Named Entity Recognition Using Parallel Corpus A New Approach Using XLM RoBERTa Alignment. We propose a novel approach for cross lingual Named Entity Recognition (NER) zero shot transfer using parallel corpora. We built an entity alignment model on top of XLM RoBERTa to project the entities detected on the English part of the parallel data to the target language sentences, whose accuracy surpasses all previous unsupervised models. With the alignment model we can get pseudo labeled NER data set in the target language to train task specific model. Unlike using translation methods, this approach benefits from natural fluency and nuances in target language original corpus. We also propose a modified loss function similar to focal loss but assigns weights in the opposite direction to further improve the model training on noisy pseudo labeled data set. We evaluated this proposed approach over 4 target languages on benchmark data sets and got competitive F1 scores compared to most recent SOTA models. We also gave extra discussions about the impact of parallel corpus size and domain on the final transfer performance.


Global strong solutions and optimal L 2 decay to the compressible FENE dumbbell model. In this paper, we are concerned with the global well posedness and L 2 decay rate for the strong solutions of the compressible finite extensible nonlinear elastic (FENE) dumbbell model. For d geq 2 , we prove that the compressible FENE dumbbell model admits a unique global strong solution provided the initial data are close to equilibrium state. Moreover, by the Littlewood Paley decomposition theory and the Fourier splitting method, we show optimal L 2 decay rate of global strong solutions for d geq 3 .


On the Isoperimetric Inequality in Finitely Generated Groups. We present a sharp version of the isoperimetric inequality for finitely generated groups due to T. Couhlon and L. Saloff Coste based on the proof suggested by M. Gromov.


Online Algorithms with Lookaround. In this work, we give a unifying view of locality in four settings distributed algorithms, sequential greedy algorithms, dynamic algorithms, and online algorithms. We introduce a new model of computing, called the online LOCAL model the adversary reveals the nodes of the input graph one by one, in the same way as in classical online algorithms, but for each new node the algorithm can also inspect its radius T neighborhood before choosing the output. Instead of looking ahead in time, we have the power of looking around in space. We compare the online LOCAL model with three other models the LOCAL model of distributed computing, where each node produces its output based on its radius T neighborhood, its sequential counterpart SLOCAL, and the dynamic LOCAL model, where changes in the dynamic input graph only influence the radius T neighborhood of the point of change. SLOCAL and dynamic LOCAL models are sandwiched between LOCAL and online LOCAL models, with LOCAL being the weakest and online LOCAL the strongest model. In this work, we seek to answer the following question is the online LOCAL model strictly stronger than the LOCAL model when we look at graph algorithms for solving locally checkable labeling problems (LCLs)? First, we show that for LCL problems in paths, cycles, and rooted trees, all four models are roughly equivalent the locality of any LCL problem falls in the same broad class O( log n) , Theta( log n) , or n Theta(1) in all four models. In particular, prior work on the LOCAL model directly generalizes to all four models. Second, we show that this equivalence does not hold in two dimensional grids. We show that the locality of the 3 coloring problem is O( log n) in the online LOCAL model, while it is known to be Omega( sqrt n ) in the LOCAL model.


X modaler A Versatile and High performance Codebase for Cross modal Analytics. With the rise and development of deep learning over the past decade, there has been a steady momentum of innovation and breakthroughs that convincingly push the state of the art of cross modal analytics between vision and language in multimedia field. Nevertheless, there has not been an open source codebase in support of training and deploying numerous neural network models for cross modal analytics in a unified and modular fashion. In this work, we propose X modaler a versatile and high performance codebase that encapsulates the state of the art cross modal analytics into several general purpose stages (e.g., pre processing, encoder, cross modal interaction, decoder, and decode strategy). Each stage is empowered with the functionality that covers a series of modules widely adopted in state of the arts and allows seamless switching in between. This way naturally enables a flexible implementation of state of the art algorithms for image captioning, video captioning, and vision language pre training, aiming to facilitate the rapid development of research community. Meanwhile, since the effective modular designs in several stages (e.g., cross modal interaction) are shared across different vision language tasks, X modaler can be simply extended to power startup prototypes for other tasks in cross modal analytics, including visual question answering, visual commonsense reasoning, and cross modal retrieval. X modaler is an Apache licensed codebase, and its source codes, sample projects and pre trained models are available on line https github.com YehLi xmodaler.


A higher Kac Moody extension for two dimensional gauge groups. Let Gamma be a finite dimensional Lie group and consider the smooth double loop group, i.e. the Fr 'echet Lie group of smooth maps from the 2 torus to Gamma . For a finite dimensional Hilbert space V, let H denote the Hilbert space of vector valued L 2 functions on the 2 torus. The purpose of this paper is to construct a higher central extension of the smooth double loop group from the representation of the smooth double loop group on H induced by a smooth action of Gamma on V. This higher central extension comes from an action of the smooth double loop group on a 2 category and yields a group cohomology class of degree 3 on the smooth double loop group. We show by a concrete computation that this group cohomology class is non trivial in general. We relate our higher central extension to the Kac Moody extension of the smooth single loop group as a higher dimensional analogue of the latter. More generally, given a group G acting on a bipolarised Hilbert space, we apply higher category theory to construct a group cohomology class of degree 3 on G. As a second motivating example, we use these ideas to introduce a higher central extension of the group of invertible smooth functions on the noncommutative 2 torus.


Goal Aware Neural SAT Solver. Modern neural networks obtain information about the problem and calculate the output solely from the input values. We argue that it is not always optimal, and the network's performance can be significantly improved by augmenting it with a query mechanism that allows the network to make several solution trials at run time and get feedback on the loss value on each trial. To demonstrate the capabilities of the query mechanism, we formulate an unsupervised (not dependant on labels) loss function for Boolean Satisfiability Problem (SAT) and theoretically show that it allows the network to extract rich information about the problem. We then propose a neural SAT solver with a query mechanism called QuerySAT and show that it outperforms the neural baseline on a wide range of SAT tasks and the classical baselines on SHA 1 preimage attack and 3 SAT task.


SoWaF Shuffling of Weights and Feature Maps A Novel Hardware Intrinsic Attack (HIA) on Convolutional Neural Network (CNN). Security of inference phase deployment of Convolutional neural network (CNN) into resource constrained embedded systems (e.g. low end FPGAs) is a growing research area. Using secure practices, third party FPGA designers can be provided with no knowledge of initial and final classification layers. In this work, we demonstrate that hardware intrinsic attack (HIA) in such a "secure" design is still possible. Proposed HIA is inserted inside mathematical operations of individual layers of CNN, which propagates erroneous operations in all the subsequent CNN layers that lead to misclassification. The attack is non periodic and completely random, hence it becomes difficult to detect. Five different attack scenarios with respect to each CNN layer are designed and evaluated based on the overhead resources and the rate of triggering in comparison to the original implementation. Our results for two CNN architectures show that in all the attack scenarios, additional latency is negligible ( 0.61 ), increment in DSP, LUT, FF is also less than 2.36 . Three attack scenarios do not require any additional BRAM resources, while in two scenarios BRAM increases, which compensates with the corresponding decrease in FF and LUTs. To the authors' best knowledge this work is the first to address the hardware intrinsic CNN attack with the attacker does not have knowledge of the full CNN.


Secure (S)Hell Introducing an SSH Deception Proxy Framework. Deceiving an attacker in the network security domain is a well established approach, mainly achieved through deployment of honeypots consisting of open network ports with the sole purpose of raising an alert on a connection. With attackers becoming more careful to avoid honeypots, other decoy elements on real host systems continue to create uncertainty for attackers. This uncertainty makes an attack more difficult, as an attacker cannot be sure whether the system does contain deceptive elements or not. Consequently, each action of an attacker could lead to the discovery. In this paper a framework is proposed for placing decoy elements through an SSH proxy, allowing to deploy decoy elements on the fly without the need for a modification of the protected host system.


Unifying Remote Sensing Image Retrieval and Classification with Robust Fine tuning. Advances in high resolution remote sensing image analysis are currently hampered by the difficulty of gathering enough annotated data for training deep learning methods, giving rise to a variety of small datasets and associated dataset specific methods. Moreover, typical tasks such as classification and retrieval lack a systematic evaluation on standard benchmarks and training datasets, which make it hard to identify durable and generalizable scientific contributions. We aim at unifying remote sensing image retrieval and classification with a new large scale training and testing dataset, SF300, including both vertical and oblique aerial images and made available to the research community, and an associated fine tuning method. We additionally propose a new adversarial fine tuning method for global descriptors. We show that our framework systematically achieves a boost of retrieval and classification performance on nine different datasets compared to an ImageNet pretrained baseline, with currently no other method to compare to.


Minimizing L1 over L2 norms on the gradient. In this paper, we study the L1 L2 minimization on the gradient for imaging applications. Several recent works have demonstrated that L1 L2 is better than the L1 norm when approximating the L0 norm to promote sparsity. Consequently, we postulate that applying L1 L2 on the gradient is better than the classic total variation (the L1 norm on the gradient) to enforce the sparsity of the image gradient. To verify our hypothesis, we consider a constrained formulation to reveal empirical evidence on the superiority of L1 L2 over L1 when recovering piecewise constant signals from low frequency measurements. Numerically, we design a specific splitting scheme, under which we can prove subsequential and global convergence for the alternating direction method of multipliers (ADMM) under certain conditions. Experimentally, we demonstrate visible improvements of L1 L2 over L1 and other nonconvex regularizations for image recovery from low frequency measurements and two medical applications of MRI and CT reconstruction. All the numerical results show the efficiency of our proposed approach.


Towards the Unification and Robustness of Perturbation and Gradient Based Explanations. As machine learning black boxes are increasingly being deployed in critical domains such as healthcare and criminal justice, there has been a growing emphasis on developing techniques for explaining these black boxes in a post hoc manner. In this work, we analyze two popular post hoc interpretation techniques SmoothGrad which is a gradient based method, and a variant of LIME which is a perturbation based method. More specifically, we derive explicit closed form expressions for the explanations output by these two methods and show that they both converge to the same explanation in expectation, i.e., when the number of perturbed samples used by these methods is large. We then leverage this connection to establish other desirable properties, such as robustness, for these techniques. We also derive finite sample complexity bounds for the number of perturbations required for these methods to converge to their expected explanation. Finally, we empirically validate our theory using extensive experimentation on both synthetic and real world datasets.


The Fusemate Logic Programming System (System Description). Fusemate is a logic programming system that implements the possible model semantics for disjunctive logic programs. Its input language is centered around a weak notion of stratification with comprehension and aggregation operators on top of it. Fusemate is implemented as a shallow embedding in the Scala programming language. This enables using Scala data types natively as terms, a tight interface with external systems, and it makes model computation available as an ordinary container data structure constructor. The paper describes the above features and demonstrates them with a non trivial use case, the embedding of the description logic cal ALCIF into Fusemate's input language This version of the paper corrects an error in the published version, which used an unsuitable version of "blocking" in the cal ALCIF embedding.


SplitBrain Hybrid Data and Model Parallel Deep Learning. The recent success of deep learning applications has coincided with those widely available powerful computational resources for training sophisticated machine learning models with huge datasets. Nonetheless, training large models such as convolutional neural networks using model parallelism (as opposed to data parallelism) is challenging because the complex nature of communication between model shards makes it difficult to partition the computation efficiently across multiple machines with an acceptable trade off. This paper presents SplitBrain, a high performance distributed deep learning framework supporting hybrid data and model parallelism. Specifically, SplitBrain provides layer specific partitioning that co locates compute intensive convolutional layers while sharding memory demanding layers. A novel scalable group communication is proposed to further improve the training throughput with reduced communication overhead. The results show that SplitBrain can achieve nearly linear speedup while saving up to 67 of memory consumption for data and model parallel VGG over CIFAR 10.


Improving Factual Consistency of Abstractive Summarization on Customer Feedback. E commerce stores collect customer feedback to let sellers learn about customer concerns and enhance customer order experience. Because customer feedback often contains redundant information, a concise summary of the feedback can be generated to help sellers better understand the issues causing customer dissatisfaction. Previous state of the art abstractive text summarization models make two major types of factual errors when producing summaries from customer feedback, which are wrong entity detection (WED) and incorrect product defect description (IPD). In this work, we introduce a set of methods to enhance the factual consistency of abstractive summarization on customer feedback. We augment the training data with artificially corrupted summaries, and use them as counterparts of the target summaries. We add a contrastive loss term into the training objective so that the model learns to avoid certain factual errors. Evaluation results show that a large portion of WED and IPD errors are alleviated for BART and T5. Furthermore, our approaches do not depend on the structure of the summarization model and thus are generalizable to any abstractive summarization systems.


Latest results on quiescent and post disruption runaway electron mitigation experiments at Frascati Tokamak Upgrade. Results from the last FTU campaigns on the deuterium large (wrt FTU volume) pellet REs suppression capability, mainly due to the induced burst MHD activity expelling REs seed are presented for discharges with 0.5 MA and 5.3T. Clear indications of avalanche multiplication of REs following single pellet injection on 0.36 MA flat top discharges is shown together with quantitative indications of dissipative effects in terms of critical electrical field increase due to fan like instabilities. Analysis of large fan like instabilities on post disruption RE beams, that seem to be correlated with low electrical field and background density drops, reveal their strong RE energy suppression capability suggesting a new strategy for RE energy suppression controlling large fan instabilities. We demonstrate how such density drops can be induced using modulated ECRH power on post disruption beams.


Learning PAC Bayes Priors for Probabilistic Neural Networks. Recent works have investigated deep learning models trained by optimising PAC Bayes bounds, with priors that are learnt on subsets of the data. This combination has been shown to lead not only to accurate classifiers, but also to remarkably tight risk certificates, bearing promise towards self certified learning (i.e. use all the data to learn a predictor and certify its quality). In this work, we empirically investigate the role of the prior. We experiment on 6 datasets with different strategies and amounts of data to learn data dependent PAC Bayes priors, and we compare them in terms of their effect on test performance of the learnt predictors and tightness of their risk certificate. We ask what is the optimal amount of data which should be allocated for building the prior and show that the optimum may be dataset dependent. We demonstrate that using a small percentage of the prior building data for validation of the prior leads to promising results. We include a comparison of underparameterised and overparameterised models, along with an empirical study of different training objectives and regularisation strategies to learn the prior distribution.


Aug3D RPN Improving Monocular 3D Object Detection by Synthetic Images with Virtual Depth. Current geometry based monocular 3D object detection models can efficiently detect objects by leveraging perspective geometry, but their performance is limited due to the absence of accurate depth information. Though this issue can be alleviated in a depth based model where a depth estimation module is plugged to predict depth information before 3D box reasoning, the introduction of such module dramatically reduces the detection speed. Instead of training a costly depth estimator, we propose a rendering module to augment the training data by synthesizing images with virtual depths. The rendering module takes as input the RGB image and its corresponding sparse depth image, outputs a variety of photo realistic synthetic images, from which the detection model can learn more discriminative features to adapt to the depth changes of the objects. Besides, we introduce an auxiliary module to improve the detection model by jointly optimizing it through a depth estimation task. Both modules are working in the training time and no extra computation will be introduced to the detection model. Experiments show that by working with our proposed modules, a geometry based model can represent the leading accuracy on the KITTI 3D detection benchmark.


An FE DMN method for the multiscale analysis of fiber reinforced plastic components. In this work, we propose a fully coupled multiscale strategy for components made from short fiber reinforced composites, where each Gauss point of the macroscopic finite element model is equipped with a deep material network (DMN) which covers the different fiber orientation states varying within the component. These DMNs need to be identified by linear elastic precomputations on representative volume elements, and serve as high fidelity surrogates for full field simulations on microstructures with inelastic constituents. We discuss how to extend direct DMNs to account for varying fiber orientation, and propose a simplified sampling strategy which significantly speeds up the training process. To enable concurrent multiscale simulations, evaluating the DMNs efficiently is crucial. We discuss dedicated techniques for exploiting sparsity and high performance linear algebra modules, and demonstrate the power of the proposed approach on an industrial scale three dimensional component. Indeed, the DMN is capable of accelerating two scale simulations significantly, providing possible speed ups of several magnitudes.


AfriKI Machine in the Loop Afrikaans Poetry Generation. This paper proposes a generative language model called AfriKI. Our approach is based on an LSTM architecture trained on a small corpus of contemporary fiction. With the aim of promoting human creativity, we use the model as an authoring tool to explore machine in the loop Afrikaans poetry generation. To our knowledge, this is the first study to attempt creative text generation in Afrikaans.


Routing with Face Traversal and Auctions Algorithms for Task Allocation in WSRN. Four new algorithms (RFTA1, RFTA2, GFGF2A, and RFTA2GE) handling the event in wireless sensor and robot networks based on the Greedy Face Greedy (GFG) routing extended with auctions are proposed in this paper. In this paper we assume that all robots are mobile and after the event is found (reported by sensors), the goal is to allocate the task to the most suitable robot to act upon the event, using either distance or the robots' remaining energy as metrics. The proposed algorithms consist of two phases. The first phase of algorithms is based on face routing and we introduced the parameter called search radius (SR) at the end of this first phase. Routing is considered successful if the found robot is inside SR. After that, the second phase, based on auctions, is initiated by the robot found in SR trying to find a more suitable one. In the simulations, network lifetime and communication costs are measured and used for comparison. We compare our algorithms with two similar algorithms from the literature (k SAAP and BFS) used for the task assignment. RFTA2 and RFTA2GE feature up to 7 times longer network lifetime with significant communication overhead reduction compared to k SAAP and BFS. Among our algorithms, RFTA2GE features the best robot energy utilization.


Introducing Variational Autoencoders to High School Students. Generative Artificial Intelligence (AI) models are a compelling way to introduce K 12 students to AI education using an artistic medium, and hence have drawn attention from K 12 AI educators. Previous Creative AI curricula mainly focus on Generative Adversarial Networks (GANs) while paying less attention to Autoregressive Models, Variational Autoencoders (VAEs), or other generative models, which have since become common in the field of generative AI. VAEs' latent space structure and interpolation ability could effectively ground the interdisciplinary learning of AI, creative arts, and philosophy. Thus, we designed a lesson to teach high school students about VAEs. We developed a web based game and used Plato's cave, a philosophical metaphor, to introduce how VAEs work. We used a Google Colab notebook for students to re train VAEs with their hand written digits to consolidate their understandings. Finally, we guided the exploration of creative VAE tools such as SketchRNN and MusicVAE to draw the connection between what they learned and real world applications. This paper describes the lesson design and shares insights from the pilot studies with 22 students. We found that our approach was effective in teaching students about a novel AI concept.


Analysis of GRACE Follow On Laser Ranging Interferometer derived inter satellite pointing angles. Gravity Recovery and Climate Experiment Follow On (GRACE FO) was launched on May 22, 2018. It carries the Laser Ranging Interferometer (LRI) as a technology demonstrator that measures the inter satellite range with nanometer precision using a laser link between satellites. To maintain the laser link between satellites, the LRI uses the beam steering method a Fast Steering Mirror (FSM) is actuated to correct for misalignment between the incoming and outgoing laser beams. From the FSM commands, we can compute the inter satellite pitch and yaw angles. These angles provide information about the spacecraft's relative orientation with respect to line of sight (LOS). We analyze LRI derived inter satellite pointing angles for 2019 and 2020. Further, we present its comparison with the pointing angles derived from GRACE FO SCA1B data, which represents the spacecraft attitude computed from star cameras and Inertial Measurement Unit (IMU) data using a Kalman filter. We discuss the correlations seen between the laser based attitude data and the spacecraft temperature variations. This analysis serves as the basis to explore the potential of this new attitude product obtained from the Differential Wavefront Sensing (DWS) control of a FSM.


Temporal Graph Signal Decomposition. Temporal graph signals are multivariate time series with individual components associated with nodes of a fixed graph structure. Data of this kind arises in many domains including activity of social network users, sensor network readings over time, and time course gene expression within the interaction network of a model organism. Traditional matrix decomposition methods applied to such data fall short of exploiting structural regularities encoded in the underlying graph and also in the temporal patterns of the signal. How can we take into account such structure to obtain a succinct and interpretable representation of temporal graph signals? We propose a general, dictionary based framework for temporal graph signal decomposition (TGSD). The key idea is to learn a low rank, joint encoding of the data via a combination of graph and time dictionaries. We propose a highly scalable decomposition algorithm for both complete and incomplete data, and demonstrate its advantage for matrix decomposition, imputation of missing values, temporal interpolation, clustering, period estimation, and rank estimation in synthetic and real world data ranging from traffic patterns to social media activity. Our framework achieves 28 reduction in RMSE compared to baselines for temporal interpolation when as many as 75 of the observations are missing. It scales best among baselines taking under 20 seconds on 3.5 million data points and produces the most parsimonious models. To the best of our knowledge, TGSD is the first framework to jointly model graph signals by temporal and graph dictionaries.


Industrial Strength Verification of Solid State Interlocking Programs. The increasing complexity of modern interlocking poses a major challenge to ensuring railway safety. This calls for application of formal methods forassurance and verification of their safety. We have developed an industry strength toolset, called SafeCap, for formal verification of interlockings. Our aim was to overcome the main barriers in deploying formal methods in industry. The approach proposed verifies interlocking data developed by signalling engineers in the ways they are designed by industry. It ensures fully automated verification of safety properties using the state of the art techniques (automated theorem provers and solvers), and provides diagnostics in terms of the notations used by engineers. In the last two years SafeCap has been successfully used to verify 26 real world mainline interlockings, developed by different suppliers and design offices. SafeCap is currently used in an advisory capacity, supplementing manual checking and testing processes by providing an additional level of verification and enabling earlier identification of errors. We are now developing a safety case to support its use as an alternative to some of these activities.


Assessing asset liability risk with neural networks. We introduce a neural network approach for assessing the risk of a portfolio of assets and liabilities over a given time period. This requires a conditional valuation of the portfolio given the state of the world at a later time, a problem that is particularly challenging if the portfolio contains structured products or complex insurance contracts which do not admit closed form valuation formulas. We illustrate the method on different examples from banking and insurance. We focus on value at risk and expected shortfall, but the approach also works for other risk measures.


Characterization of bounded smooth solutions to the axially symmetric Navier Stokes equations in an infinite pipe with Navier slip boundary. Bounded smooth solutions of the stationary axially symmetric Navier Stokes equations in an infinite pipe, equipped with Navier slip boundary condition, are considered in this paper. Here "smooth" means the velocity is continuous up to second order derivatives, and "bounded" means the velocity itself and its gradient field are bounded. It is shown that such solutions with zero flux at one cross section, must be swirling solutions u ( Cx 2,Cx 1,0) . A slight modification of the proof will show that for an alternative slip boundary condition, solutions will be identically zero. Meanwhile, if the horizontal swirl component of the axially symmetric solution, u theta , is independent of the vertical variable z , it is proven that such solutions must be helical solutions u ( C 1x 2,C 1x 1,C 2) . In this case, boundedness assumptions on solutions can be relaxed extensively to the following growing conditions With respect to the distance to the origin, the vertical component of the velocity, u z , is sublinearly growing, the horizontal radial component of the velocity, u r , is exponentially growing, and the swirl component of the vorticity, omega theta , is polynomially growing at any order. Also, by constructing a counterexample, we show that the growing assumption on u r is optimal.


Predicting Stable Configurations for Semantic Placement of Novel Objects. Human environments contain numerous objects configured in a variety of arrangements. Our goal is to enable robots to repose previously unseen objects according to learned semantic relationships in novel environments. We break this problem down into two parts (1) finding physically valid locations for the objects and (2) determining if those poses satisfy learned, high level semantic relationships. We build our models and training from the ground up to be tightly integrated with our proposed planning algorithm for semantic placement of unknown objects. We train our models purely in simulation, with no fine tuning needed for use in the real world. Our approach enables motion planning for semantic rearrangement of unknown objects in scenes with varying geometry from only RGB D sensing. Our experiments through a set of simulated ablations demonstrate that using a relational classifier alone is not sufficient for reliable planning. We further demonstrate the ability of our planner to generate and execute diverse manipulation plans through a set of real world experiments with a variety of objects.


Instant Teaching An End to End Semi Supervised Object Detection Framework. Supervised learning based object detection frameworks demand plenty of laborious manual annotations, which may not be practical in real applications. Semi supervised object detection (SSOD) can effectively leverage unlabeled data to improve the model performance, which is of great significance for the application of object detection models. In this paper, we revisit SSOD and propose Instant Teaching, a completely end to end and effective SSOD framework, which uses instant pseudo labeling with extended weak strong data augmentations for teaching during each training iteration. To alleviate the confirmation bias problem and improve the quality of pseudo annotations, we further propose a co rectify scheme based on Instant Teaching, denoted as Instant Teaching . Extensive experiments on both MS COCO and PASCAL VOC datasets substantiate the superiority of our framework. Specifically, our method surpasses state of the art methods by 4.2 mAP on MS COCO when using 2 labeled data. Even with full supervised information of MS COCO, the proposed method still outperforms state of the art methods by about 1.0 mAP. On PASCAL VOC, we can achieve more than 5 mAP improvement by applying VOC07 as labeled data and VOC12 as unlabeled data.


Constraint Handling Techniques for Particle Swarm Optimization Algorithms. Population based methods can cope with a variety of different problems, including problems of remarkably higher complexity than those traditional methods can handle. The main procedure consists of successively updating a population of candidate solutions, performing a parallel exploration instead of traditional sequential exploration. While the origins of the PSO method are linked to bird flock simulations, it is a stochastic optimization method in the sense that it relies on random coefficients to introduce creativity, and a bottom up artificial intelligence based approach in the sense that its intelligent behaviour emerges in a higher level than the individuals' rather than deterministically programmed. As opposed to EAs, the PSO involves no operator design and few coefficients to be tuned. Since this paper does not intend to study such tuning, general purpose settings are taken from previous studies. The PSO algorithm requires the incorporation of some technique to handle constraints. A popular one is the penalization method, which turns the original constrained problem into unconstrained by penalizing infeasible solutions. Other techniques can be specifically designed for PSO. Since these strategies present advantages and disadvantages when compared to one another, there is no obvious best constraint handling technique (CHT) for all problems. The aim here is to develop and compare different CHTs suitable for PSOs, which are incorporated to an algorithm with general purpose settings. The comparisons are performed keeping the remaining features of the algorithm the same, while comparisons to other authors' results are offered as a frame of reference for the optimizer as a whole. Thus, the penalization, preserving feasibility and bisection methods are discussed, implemented, and tested on two suites of benchmark problems. Three neighbourhood sizes are also considered in the experiments.


Contrastive Predictive Coding for Anomaly Detection. Reliable detection of anomalies is crucial when deploying machine learning models in practice, but remains challenging due to the lack of labeled data. To tackle this challenge, contrastive learning approaches are becoming increasingly popular, given the impressive results they have achieved in self supervised representation learning settings. However, while most existing contrastive anomaly detection and segmentation approaches have been applied to images, none of them can use the contrastive losses directly for both anomaly detection and segmentation. In this paper, we close this gap by making use of the Contrastive Predictive Coding model (arXiv 1807.03748). We show that its patch wise contrastive loss can directly be interpreted as an anomaly score, and how this allows for the creation of anomaly segmentation masks. The resulting model achieves promising results for both anomaly detection and segmentation on the challenging MVTec AD dataset.


Maximal orthogonal grassmannians of quadratic forms of dimensions up to 22 . Let X be a connected component of the maximal orthogonal grassmannian of a generic n dimensional quadratic form q with trivial Clifford invariant. Consider the canonical epimorphism phi from the Chow ring of X to the associated graded ring of the coniveau filtration on the Grothendieck ring of X . In cite Kar2018 Karpenko proved that phi is an isomorphism for all n leq 12 (conjecturally for all n ). Recently, in cite Yagita Yagita showed that phi is not an isomorphism for n 17, 18 . In the present paper, together with Yagita's results for n 17,18 , we show that the map phi is not an isomorphism for all 13 leq n leq 22 . In particualr, the case n 13 gives the smallest dimensional maximal orthogonal grassmannian whose two graded rings are not isomorphic.


OntoED Low resource Event Detection with Ontology Embedding. Event Detection (ED) aims to identify event trigger words from a given text and classify it into an event type. Most of current methods to ED rely heavily on training instances, and almost ignore the correlation of event types. Hence, they tend to suffer from data scarcity and fail to handle new unseen event types. To address these problems, we formulate ED as a process of event ontology population linking event instances to pre defined event types in event ontology, and propose a novel ED framework entitled OntoED with ontology embedding. We enrich event ontology with linkages among event types, and further induce more event event correlations. Based on the event ontology, OntoED can leverage and propagate correlation knowledge, particularly from data rich to data poor event types. Furthermore, OntoED can be applied to new unseen event types, by establishing linkages to existing ones. Experiments indicate that OntoED is more predominant and robust than previous approaches to ED, especially in data scarce scenarios.


An incremental descent method for multi objective optimization. Current state of the art multi objective optimization solvers, by computing gradients of all m objective functions per iteration, produce after k iterations a measure of proximity to critical conditions that is upper bounded by O(1 sqrt k ) when the objective functions are assumed to have L Lipschitz continuous gradients i.e. they require O(m epsilon 2) gradient and function computations to produce a measure of proximity to critical conditions bellow some target epsilon . We reduce this to O(1 epsilon 2) with a method that requires only a constant number of gradient and function computations per iteration and thus, we obtain for the first time a multi objective descent type method with a query complexity cost that is unaffected by increasing values of m . For this, a brand new multi objective descent direction is identified, which we name the emph central descent direction , and, an incremental approach is proposed. Robustness properties of the central descent direction are established, measures of proximity to critical conditions are derived, and, the incremental strategy for finding solutions to the multi objective problem is shown to attain convergence properties unattained by previous methods. To the best of our knowledge, this is the first method to achieve this with no additional a priori information on the structure of the problem, such as done by scalarizing techniques, and, with no pre known information on the regularity of the objective functions other than Lipschitz continuity of the gradients.


The behavior of essential dimension under specialization. Let A be a discrete valuation ring with generic point eta and closed point s . We show that in a family of torsors over operatorname Spec (A) , the essential dimension of the torsor above s is less than or equal to the essential dimension of the torsor above eta . We give two applications of this result, one in mixed characteristic, the other in equal characteristic.


Laplace and Steklov extremal metrics via n harmonic maps. We present a unified description of extremal metrics for the Laplace and Steklov eigenvalues on manifolds of arbitrary dimension using the notion of n harmonic maps. Our approach extends the well known results linking extremal metrics for eigenvalues on surfaces with minimal immersions and harmonic maps. In the process, we uncover two previously unknown features of the Steklov eigenvalues. First, we show that in higher dimensions there is a unique normalization involving both the volume of the boundary and of the manifold itself, which leads to meaningful extremal eigenvalue problems. Second, we observe that the critical points of the eigenvalue functionals in a fixed conformal class have a natural geometric interpretation provided one considers the Steklov problem with a density. As an example, we construct a family of free boundary harmonic annuli in the three dimensional ball and conjecture that they correspond to metrics maximizing the first Steklov eigenvalue in their respective conformal classes.


Hybrid bounds for the sup norm of automorphic forms in higher rank. Let A be a central division algebra of prime degree p over mathbb Q . We obtain subconvex hybrid bounds, uniform in both the eigenvalue and the discriminant, for the sup norm of Hecke Maass forms on the compact quotients of operatorname SL p( mathbb R ) operatorname SO (p) by unit groups of orders in A . The exponents in the bounds are explicit and polynomial in p . We also prove subconvex hybrid bounds in the case of certain Eichler type orders in division algebras of arbitrary odd degree.


Overview of The MediaEval 2021 Predicting Media Memorability Task. This paper describes the MediaEval 2021 Predicting Media Memorability task, which is in its 4th edition this year, as the prediction of short term and long term video memorability remains a challenging task. In 2021, two datasets of videos are used first, a subset of the TRECVid 2019 Video to Text dataset second, the Memento10K dataset in order to provide opportunities to explore cross dataset generalisation. In addition, an Electroencephalography (EEG) based prediction pilot subtask is introduced. In this paper, we outline the main aspects of the task and describe the datasets, evaluation metrics, and requirements for participants' submissions.


Fighting the Fog Evaluating the Clarity of Privacy Disclosures in the Age of CCPA. Vagueness and ambiguity in privacy policies threaten the ability of consumers to make informed choices about how businesses collect, use, and share their personal information. The California Consumer Privacy Act (CCPA) of 2018 was intended to provide Californian consumers with more control by mandating that businesses (1) clearly disclose their data practices and (2) provide choices for consumers to opt out of specific data practices. In this work, we explore to what extent CCPA's disclosure requirements, as implemented in actual privacy policies, can help consumers to answer questions about the data practices of businesses. First, we analyzed 95 privacy policies from popular websites our findings showed that there is considerable variance in how businesses interpret CCPA's definitions. Then, our user survey of 364 Californian consumers showed that this variance affects the ability of users to understand the data practices of businesses. Our results suggest that CCPA's mandates for privacy disclosures, as currently implemented, have not yet yielded the level of clarity they were designed to deliver, due to both vagueness and ambiguity in CCPA itself as well as potential non compliance by businesses in their privacy policies.


An Effective Attack Scenario Construction Model based on Attack Steps and Stages Identification. A Network Intrusion Detection System (NIDS) is a network security technology for detecting intruder attacks. However, it produces a great amount of low level alerts which makes the analysis difficult, especially to construct the attack scenarios. Attack scenario construction (ASC) via Alert Correlation (AC) is important to reveal the strategy of attack in terms of steps and stages that need to be launched to make the attack successful. In most of the existing works, alerts are correlated by classifying the alerts based on the cause effect relationship. However, the drawback of these works is the identification of false and incomplete correlations due to the infiltration of raw alerts. To address this problem, this work proposes an effective ASC model to discover the complete relationship among alerts. The model is successfully experimented using two types of datasets, which are DARPA 2000, and ISCX2012. The Completeness and Soundness of the proposed model are measured to evaluate the overall correlation effectiveness.


DISCO efficient unsupervised decoding for discrete natural language problems via convex relaxation. In this paper we study test time decoding an ubiquitous step in almost all sequential text generation task spanning across a wide array of natural language processing (NLP) problems. Our main contribution is to develop a continuous relaxation framework for the combinatorial NP hard decoding problem and propose Disco an efficient algorithm based on standard first order gradient based. We provide tight analysis and show that our proposed algorithm linearly converges to within epsilon neighborhood of the optima. Finally, we perform preliminary experiments on the task of adversarial text generation and show superior performance of Disco over several popular decoding approaches.


The Two Phase Stefan Problem with Anomalous Diffusion. The non local in space two phase Stefan problem (a prototype in phase change problems) can be formulated via a singular nonlinear parabolic integro differential equation which admits a unique weak solution. This formulation makes Stefan problem to be part of the General Filtration Problems a class which includes the Porous Medium Equation. In this work, we prove that the weak solutions to both Stefan and Porous Media problems are continuous.


Synergism of the dynamics of tetrahedral hydrogen bonds of liquid water. We used modified Arrhenius approximations to analyze the known temperature dependences (TDs) of water microstructure parameters and its dynamic characteristics. The analysis of activation energies showed a significant difference in the molecular dynamics (MD) of water in the ranges from 273 to 298 K and from 300 to 373 K. The features of MD in the first range were associated with the metastable ice like phase of water, in which hexagonal clusters with tetrahedral hydrogen bonds (HBs) predominate. Based on the ratios of the signs and values of the activation energies of HBs fluctuations and the parameters of the microstructure, it was assumed that fluctuations of HBs dipoles play a key role in the mechanism of resonant activation by thermal energy of consistent reactions of deformation, rupture and formation of tetrahedral HBs in water clusters. The synergism of these reactions and the interaction of the charges of the vacant acceptor and donor tetrahedral orbitals of the oxygen atom trigger at 298 K an explosive transition of the metastable ice like phase of water into the argon like phase. The synergetics of water dynamics above 298 K is adequately characterized by the product diffusion on viscosity, from which TDs follow the activation energies of reactions that determine the form of the Stokes Einstein relation in the temperature ranges below and above the 298 K point.


Sur le nombre d'id 'eaux dont la norme est la valeur d'une forme binaire de degr 'e 3. Let mathbb K be a cyclic extension of degree 3 of mathbb Q . Take G rm Gal ( mathbb K mathbb Q ) and chi the character of a non trivial representation of G . In this case, chi is a non principal Dirichlet character of degree 3 and the quantity r 3(n) defined by r 3(n) big(1 chi chi 2 big)(n) rm , counts the number of ideals of O mathbb K of norm n . In this paper, using a new result on Hooley's Delta function, we prove an asymptotic estimate, in xi , of the quantity Q( xi, mathcal R ,F) sum limits boldsymbol x in mathcal R ( xi) r 3 big(F( boldsymbol x ) big) rm , for a binary form F of degree 3 irreducible over mathbb K and mathcal R a good domain of mathbb R 2 , with mathcal R ( xi) Big boldsymbol x in mathbb R 2 frac boldsymbol x xi in mathcal R Big rm . We also give a geometric interpretation of the main constant of the asymptotic estimate when the ring O mathbb K is principal.


Actor critic is implicitly biased towards high entropy optimal policies. We show that the simplest actor critic method a linear softmax policy updated with TD through interaction with a linear MDP, but featuring no explicit regularization or exploration does not merely find an optimal policy, but moreover prefers high entropy optimal policies. To demonstrate the strength of this bias, the algorithm not only has no regularization, no projections, and no exploration like epsilon greedy, but is moreover trained on a single trajectory with no resets. The key consequence of the high entropy bias is that uniform mixing assumptions on the MDP, which exist in some form in all prior work, can be dropped the implicit regularization of the high entropy bias is enough to ensure that all chains mix and an optimal policy is reached with high probability. As auxiliary contributions, this work decouples concerns between the actor and critic by writing the actor update as an explicit mirror descent, provides tools to uniformly bound mixing times within KL balls of policy space, and provides a projection free TD analysis with its own implicit bias which can be run from an unmixed starting distribution.


Formation of Solitary Structures and Double Layer in Weakly Degenerate Electron Ion Quantum Plasma in Ionosphere. In this paper, we consider ionospheric plasma consisting of weakly degenerate electrons and heavy ions. We embrace our hydrodynamic model by including the quantum diffraction term. By employing Sagdeev's pseudo potential method, we obtain double layers and soliton structure. We have studied the various parametric dependence of solitary structures and double layers. The results thus obtained might be helpful in the studies of many high energy astrophysical phenomena.


A family of tetravalent one regular graphs. A graph is one regular if its automorphism group acts regularly on the set of its arcs. In this paper, 4 valent one regular graphs of order 5p 2 , where p is a prime, are classified


The Greedy and Recursive Search for Morphological Productivity. As children acquire the knowledge of their language's morphology, they invariably discover the productive processes that can generalize to new words. Morphological learning is made challenging by the fact that even fully productive rules have exceptions, as in the well known case of English past tense verbs, which features the ed rule against the irregular verbs. The Tolerance Principle is a recent proposal that provides a precise threshold of exceptions that a productive rule can withstand. Its empirical application so far, however, requires the researcher to fully specify rules defined over a set of words. We propose a greedy search model that automatically hypothesizes rules and evaluates their productivity over a vocabulary. When the search for broader productivity fails, the model recursively subdivides the vocabulary and continues the search for productivity over narrower rules. Trained on psychologically realistic data from child directed input, our model displays developmental patterns observed in child morphology acquisition, including the notoriously complex case of German noun pluralization. It also produces responses to nonce words that, despite receiving only a fraction of the training data, are more similar to those of human subjects than current neural network models' responses are.


Raindrops on Windshield Dataset and Lightweight Gradient Based Detection Algorithm. Autonomous vehicles use cameras as one of the primary sources of information about the environment. Adverse weather conditions such as raindrops, snow, mud, and others, can lead to various image artifacts. Such artifacts significantly degrade the quality and reliability of the obtained visual data and can lead to accidents if they are not detected in time. This paper presents ongoing work on a new dataset for training and assessing vision algorithms' performance for different tasks of image artifacts detection on either camera lens or windshield. At the moment, we present a publicly available set of images containing 8190 images, of which 3390 contain raindrops. Images are annotated with the binary mask representing areas with raindrops. We demonstrate the applicability of the dataset in the problems of raindrops presence detection and raindrop region segmentation. To augment the data, we also propose an algorithm for data augmentation which allows the generation of synthetic raindrops on images. Apart from the dataset, we present a novel gradient based algorithm for raindrop presence detection in a video sequence. The experimental evaluation proves that the algorithm reliably detects raindrops. Moreover, compared with the state of the art cross correlation based algorithm cite Einecke2014 , the proposed algorithm showed a higher quality of raindrop presence detection and image processing speed, making it applicable for the self check procedure of real autonomous systems. The dataset is available at href https github.com EvoCargo RaindropsOnWindshield github.com EvoCargo RaindropsOnWindshield .


The Effective Radius of Self Repelling Elastic Manifolds. We study elastic manifolds with self repelling terms and estimate their effective radius. This class of manifolds is modelled by a self repelling vector valued Gaussian free field with Neumann boundary conditions over the domain N,N d cap mathbb Z d , that takes values in mathbb R d . Our main result states that in two dimensions ( d 2 ), the effective radius R N of the manifold is approximately N . Our results in d geq 3 give a similar lower bound on R N and an upper of order N d 2 . This result implies that self repelling elastic manifolds undergo a substantial stretching at any dimension.


Cross Task Generalization via Natural Language Crowdsourcing Instructions. Humans (e.g., crowdworkers) have a remarkable ability in solving different tasks, by simply reading textual instructions that define them and looking at a few examples. Despite the success of the conventional supervised learning on individual datasets, such models often struggle with generalization across tasks (e.g., a question answering system cannot solve classification tasks). A long standing challenge in AI is to build a model that learns a new task by understanding the human readable instructions that define it. To study this, we introduce NATURAL INSTRUCTIONS, a dataset of 61 distinct tasks, their human authored instructions, and 193k task instances (input output pairs). The instructions are obtained from crowdsourcing instructions used to create existing NLP datasets and mapped to a unified schema. Using this meta dataset, we measure cross task generalization by training models on seen tasks and measuring generalization to the remaining unseen ones. We adopt generative pre trained language models to encode task specific instructions along with input and generate task output. Our results indicate that models benefit from instructions when evaluated in terms of generalization to unseen tasks (19 better for models utilizing instructions). These models, however, are far behind an estimated performance upperbound indicating significant room for more progress in this direction.


From resolvents to generalized equations and quasi variational inequalities existence and differentiability. We consider a generalized equation governed by a strongly monotone and Lipschitz single valued mapping and a maximally monotone set valued mapping in a Hilbert space. We are interested in the sensitivity of solutions w.r.t. perturbations of both mappings. We demonstrate that the directional differentiability of the solution map can be verified by using the directional differentiability of the single valued operator and of the resolvent of the set valued mapping. The result is applied to quasi generalized equations in which we have an additional dependence of the solution within the set valued part of the equation.


Identifying blockchain based cryptocurrency accounts using investment portfolios. Cryptocurrencies based on decentralized systems, especially blockchain, are gaining popularity more than ever. Freedom advocates hail blockchain technology as a breakthrough in digital privacy and internet anonymity. Unfortunately, after recent studies conducted, it may come as a surprise that the transactions are, in fact, not always anonymous. In this short paper, the possibility of identifying a user's accounts in different cryptocurrencies given the user's portfolio of investment gained from social media is investigated. In this study, the generic elements of blockchain systems are briefly studied. In section ref sec blocksim , BlockSim which is a tool for simulating transactions, and an algorithm for answering this question is introduced.


A novel machine learning technique to identify and categorize plasma waves in spacecraft measurements. The available magnetic field data from the terrestrial magnetosphere, solar wind and planetary magnetospheres exceeds over 10 6 hours. Identifying plasma waves in these large data sets is a time consuming and tedious process. In this Paper, we propose a solution to this problem. We demonstrate how Self Organizing Maps can be used for rapid data reduction and identification of plasma waves in large data sets. We use 72,000 fluxgate and 110,000 search coil magnetic field power spectra from the Magnetospheric Multiscale Mission (MMS 1 ) and show how the Self Organizing Map sorts the power spectra into groups based on their shape. Organizing the data in this way makes it very straightforward to identify power spectra with similar properties and therefore this technique greatly reduces the need for manual inspection of the data. We suggest that Self Organizing Maps offer a time effective and robust technique, which can significantly accelerate the processing of magnetic field data and discovery of new wave forms.


Absolutely Free Hyperalgebras. It is well known from universal algebra that, for every signature Sigma , there exist algebras over Sigma which are absolutely free, meaning that they do not satisfy any identities or, alternatively, satisfy the universal mapping property for the class of Sigma algebras. Furthermore, once we fix a cardinality of the generating set, they are, up to isomorphisms, unique, and equal to algebras of terms (or propositional formulas, in the context of logic). Equivalently, the forgetful functor, from the category of Sigma algebras to textbf Set , has a left adjoint. This result does not extend to multialgebras. Not only multialgebras satisfying the universal mapping property do not exist, but the forgetful functor mathcal U , from the category of Sigma multialgebras to textbf Set , does not have a left adjoint. In this paper we generalize, in a natural way, algebras of terms to multialgebras of terms, whose family of submultialgebras enjoys many properties of the former. One example is that, to every pair consisting of a function, from a multialgebra of terms to another multialgebra, and a collection of choices (which selects how a homomorphism approaches indeterminacies), it corresponds a unique homomorphism, which ressembles the universal mapping property. Another example is that the multialgebras of terms are generated by a set that may be viewed as a strong basis, which we call the ground of the multialgebra. Submultialgebras of multialgebras of terms are what we call weakly free multialgebras. Finally, with these definitions at hand, we offer a simple proof that multialgebras with the universal mapping property for the class of all multialgebras do not exist and that mathcal U does not have a left adjoint.


Refined Policy Improvement Bounds for MDPs. The policy improvement bound on the difference of the discounted returns plays a crucial role in the theoretical justification of the trust region policy optimization (TRPO) algorithm. The existing bound leads to a degenerate bound when the discount factor approaches one, making the applicability of TRPO and related algorithms questionable when the discount factor is close to one. We refine the results in cite Schulman2015, Achiam2017 and propose a novel bound that is "continuous" in the discount factor. In particular, our bound is applicable for MDPs with the long run average rewards as well.


Multi Task Pre Training for Plug and Play Task Oriented Dialogue System. Pre trained language models have been recently shown to benefit task oriented dialogue (TOD) systems. Despite their success, existing methods often formulate this task as a cascaded generation problem which can lead to error accumulation across different sub tasks and greater data annotation overhead. In this study, we present PPTOD, a unified plug and play model for task oriented dialogue. In addition, we introduce a new dialogue multi task pre training strategy that allows the model to learn the primary TOD task completion skills from heterogeneous dialog corpora. We extensively test our model on three benchmark TOD tasks, including end to end dialogue modelling, dialogue state tracking, and intent classification. Experimental results show that PPTOD achieves new state of the art on all evaluated tasks in both high resource and low resource scenarios. Furthermore, comparisons against previous SOTA methods show that the responses generated by PPTOD are more factually correct and semantically coherent as judged by human annotators.


Oil Spill SAR Image Segmentation via Probability Distribution Modelling. Segmentation of marine oil spills in Synthetic Aperture Radar (SAR) images is a challenging task because of the complexity and irregularities in SAR images. In this work, we aim to develop an effective segmentation method which addresses marine oil spill identification in SAR images by investigating the distribution representation of SAR images. To seek effective oil spill segmentation, we revisit the SAR imaging mechanism in order to attain the probability distribution representation of oil spill SAR images, in which the characteristics of SAR images are properly modelled. We then exploit the distribution representation to formulate the segmentation energy functional, by which oil spill characteristics are incorporated to guide oil spill segmentation. Moreover, the oil spill segmentation model contains the oil spill contour regularisation term and the updated level set regularisation term which enhance the representational power of the segmentation energy functional. Benefiting from the synchronisation of SAR image representation and oil spill segmentation, our proposed method establishes an effective oil spill segmentation framework. Experimental evaluations demonstrate the effectiveness of our proposed segmentation framework for different types of marine oil spill SAR image segmentation.


Famous Companies Use More Letters in Logo A Large Scale Analysis of Text Area in Logo. This paper analyzes a large number of logo images from the LLD logo dataset, by recent deep learning based techniques, to understand not only design trends of logo images and but also the correlation to their owner company. Especially, we focus on three correlations between logo images and their text areas, between the text areas and the number of followers on Twitter, and between the logo images and the number of followers. Various findings include the weak positive correlation between the text area ratio and the number of followers of the company. In addition, deep regression and deep ranking methods can catch correlations between the logo images and the number of followers.


EvoK Connecting loved ones through Heart Rate sharing. In this work, we present EvoK, a new way of sharing one's heart rate with feedback from their close contacts to alleviate social isolation and loneliness. EvoK consists of a pair of wearable prototype devices (i.e., sender and receiver). The sender is designed as a headband enabling continuous sensing of heart rate with aesthetic designs to maximize social acceptance. The receiver is designed as a wristwatch enabling unobtrusive receiving of the loved one's continuous heart rate with multi modal notification systems.


Software Hardware Co design for Multi modal Multi task Learning in Autonomous Systems. Optimizing the quality of result (QoR) and the quality of service (QoS) of AI empowered autonomous systems simultaneously is very challenging. First, there are multiple input sources, e.g., multi modal data from different sensors, requiring diverse data preprocessing, sensor fusion, and feature aggregation. Second, there are multiple tasks that require various AI models to run simultaneously, e.g., perception, localization, and control. Third, the computing and control system is heterogeneous, composed of hardware components with varied features, such as embedded CPUs, GPUs, FPGAs, and dedicated accelerators. Therefore, autonomous systems essentially require multi modal multi task (MMMT) learning which must be aware of hardware performance and implementation strategies. While MMMT learning has been attracting intensive research interests, its applications in autonomous systems are still underexplored. In this paper, we first discuss the opportunities of applying MMMT techniques in autonomous systems and then discuss the unique challenges that must be solved. In addition, we discuss the necessity and opportunities of MMMT model and hardware co design, which is critical for autonomous systems especially with power resource limited or heterogeneous platforms. We formulate the MMMT model and heterogeneous hardware implementation co design as a differentiable optimization problem, with the objective of improving the solution quality and reducing the overall power consumption and critical path latency. We advocate for further explorations of MMMT in autonomous systems and software hardware co design solutions.


Optimization of Controlled Free Time Sweeping Processes with Applications to Marine Surface Vehicle Modeling. The paper is devoted to a free time optimal control problem for sweeping processes. We develop a constructive finite difference approximation procedure that allows us to establish necessary optimality conditions for discrete optimal solutions and then show how these optimality conditions are applied to solving a controlled marine surface vehicle model.


ACM Net Action Context Modeling Network for Weakly Supervised Temporal Action Localization. Weakly supervised temporal action localization aims to localize action instances temporal boundary and identify the corresponding action category with only video level labels. Traditional methods mainly focus on foreground and background frames separation with only a single attention branch and class activation sequence. However, we argue that apart from the distinctive foreground and background frames there are plenty of semantically ambiguous action context frames. It does not make sense to group those context frames to the same background class since they are semantically related to a specific action category. Consequently, it is challenging to suppress action context frames with only a single class activation sequence. To address this issue, in this paper, we propose an action context modeling network termed ACM Net, which integrates a three branch attention module to measure the likelihood of each temporal point being action instance, context, or non action background, simultaneously. Then based on the obtained three branch attention values, we construct three branch class activation sequences to represent the action instances, contexts, and non action backgrounds, individually. To evaluate the effectiveness of our ACM Net, we conduct extensive experiments on two benchmark datasets, THUMOS 14 and ActivityNet 1.3. The experiments show that our method can outperform current state of the art methods, and even achieve comparable performance with fully supervised methods. Code can be found at https github.com ispc lab ACM Net


Under Pressure Learning to Detect Slip with Barometric Tactile Sensors. Despite the utility of tactile information, tactile sensors have yet to be widely deployed in industrial robotics settings. Part of the challenge lies in identifying slip and other key events from the tactile data stream. In this paper, we present a learning based method to detect slip using barometric tactile sensors. Although these sensors have a low resolution, they have many other desirable properties including high reliability and durability, a very slim profile, and a low cost. We are able to achieve slip detection accuracies of greater than 91 while being robust to the speed and direction of the slip motion. Further, we test our detector on two robot manipulation tasks involving common household objects and demonstrate successful generalization to real world scenarios not seen during training. We show that barometric tactile sensing technology, combined with data driven learning, is potentially suitable for complex manipulation tasks such as slip compensation.


Code Comprehension Confounders A Study of Intelligence and Personal. Literature and intuition suggest that a developer's intelligence and personality have an impact on their performance in comprehending source code. Researchers made this suggestion in the past when discussing threats to validity of their study results. However, the lack of studies investigating the relationship of intelligence and personality to performance in code comprehension makes scientifically sound reasoning about their influence difficult. We conduct the first empirical evaluation, a correlational study with undergraduates, to investigate the correlation of intelligence and personality with performance in code comprehension, that is with correctness in answering comprehension questions on code snippets. We found that personality traits are unlikely to impact code comprehension performance, at least not considered in isolation. Conscientiousness, in combination with other factors, however, explains some of the variance in code comprehension performance. For intelligence, significant small to moderate positive effects on code comprehension performance were found for three of four factors measured, i.e., fluid intelligence, visual perception, and cognitive speed. Crystallized intelligence has a positive but statistically insignificant effect on code comprehension performance. According to our results, several intelligence facets as well as the personality trait conscientiousness are potential confounders that should not be neglected in code comprehension studies of individual performance and should be controlled for via an appropriate study design. We call for the conduct of further studies on the relationship between intelligence and personality with code comprehension, in part because code comprehension involves more facets than we can measure in a single study and because our regression model explains only a small portion of the variance in code comprehension performance.


Classification of hierarchical text using geometric deep learning the case of clinical trials corpus. We consider the hierarchical representation of documents as graphs and use geometric deep learning to classify them into different categories. While graph neural networks can efficiently handle the variable structure of hierarchical documents using the permutation invariant message passing operations, we show that we can gain extra performance improvements using our proposed selective graph pooling operation that arises from the fact that some parts of the hierarchy are invariable across different documents. We applied our model to classify clinical trial (CT) protocols into completed and terminated categories. We use bag of words based, as well as pre trained transformer based embeddings to featurize the graph nodes, achieving f1 scores around 0.85 on a publicly available large scale CT registry of around 360K protocols. We further demonstrate how the selective pooling can add insights into the CT termination status prediction. We make the source code and dataset splits accessible.


Symplectic excision. We say that a subset of a symplectic manifold is symplectically (neighbourhood) excisable if its complement is symplectomorphic to the ambient manifold, (through a symplectomorphism that can be chosen to be the identity outside an arbitrarily small neighbourhood of the subset). We use time independent Hamiltonian flows, and their iterations, to show that certain properly embedded subsets of noncompact symplectic manifolds are symplectically neighbourhood excisable a ray, a "Cantor brush", a "box with a tail", and more generally epigraphs of lower semi continuous functions as well as a "ray with two horns", and more generally open rooted finite trees.


A Challenge Obfuscating Interface for Arbiter PUF Variants against Machine Learning Attacks. Security is of critical importance for the Internet of Things (IoT). Many IoT devices are resource constrained, calling for lightweight security protocols. Physical unclonable functions (PUFs) leverage integrated circuits' variations to produce responses unique for individual devices, and hence are not reproducible even by the manufacturers. Implementable with simplistic circuits of thousands of transistors and operable with low energy, Physical unclonable functions are promising candidates as security primitives for resource constrained IoT devices. Arbiter PUFs (APUFs) are a group of delay based PUFs which are highly lightweight in resource requirements but suffer from high susceptibility to machine learning attacks. To defend APUF variants against machine learning attacks, we introduce challenge input interface, which incurs low resource overhead. With the interface, experimental attack study shows that all tested PUFs have substantially improved their resistance against machine learning attacks, rendering interfaced APUF variants promising candidates for security critical applications.


Distributed continuous time strategy updating rules for noncooperative games with discrete time communication. In this paper, continuous time noncooperative games in networks of double integrator agents are explored. The existing methods require that agents communicate with their neighbors in real time. In this paper, we propose two discrete time communication schemes based on the designed continuous time strategy updating rule for the efficient use of communication resources. First, the property of the designed continuous time rule is analyzed to ensure that all agents' strategies can converge to the Nash equilibrium. Then, we propose periodic and event triggered communication schemes for the implementation of the designed rule with discrete time communication. The rule in the periodic case is implemented synchronously and easily. The rule in the event triggered case is executed asynchronously without Zeno behaviors. All agents in both cases can asymptotically reach to the Nash equilibrium by interacting with neighbors at discrete times. Simulations are performed in networks of Cournot competition to illustrate the effectiveness of the proposed methods.


Nash Bargaining Based Models for Matching Markets One Sided and Two Sided Fisher and Arrow Debreu. This paper addresses two deficiencies of models in the area of matching based market design. The first arises from the recent realization that the most prominent solution that uses cardinal utilities, namely the Hylland Zeckhauser (HZ) mechanism, is intractable in particular, the problem of computing even an approximate equilibrium for it is PPAD complete. The second is the extreme paucity of models that use cardinal utilities this stands in sharp contrast with general equilibrium theory, which has defined and extensively studied several fundamental market models to address a number of specialized and realistic situations. Our paper addresses both these issues by proposing Nash bargaining based matching market models. Since the Nash bargaining solution is captured by a convex program, efficiency follow in addition, it possesses a number of desirable game theoretic properties. Our approach yields a rich collection of models for one sided as well as two sided markets, for Fisher as well as Arrow Debreu settings, and for a wide range of utility functions, all the way from linear to Leontief. We also give very fast implementations for these models which solve large instances, with n 2000 , in one hour on a PC, even for a two sided matching market. A number of new ideas were needed, beyond the standard methods, to obtain these implementations.


Up And Coming Physical Concepts of Wireless Power Transfer. The rapid development of chargeable devices has caused a great deal of interest in efficient and stable wireless power transfer (WPT) solutions. Most conventional WPT technologies exploit outdated electromagnetic field control methods proposed in the 20th century, wherein some essential parameters are sacrificed in favour of the other ones (efficiency vs. stability), making available WPT systems far from the optimal ones. Over the last few years, the development of novel approaches to electromagnetic field manipulation has enabled many up and coming technologies holding great promises for advanced WPT. Examples include coherent perfect absorption, exceptional points in non Hermitian systems, non radiating states and anapoles, advanced artificial materials and metastructures. This work overviews the recent achievements in novel physical effects and materials for advanced WPT. We provide a consistent analysis of existing technologies, their pros and cons, and attempt to envision possible perspectives.


Enhancing Security in VANETs with Efficient Sybil Attack Detection using Fog Computing. Vehicular ad hoc networks (VANETs) facilitate vehicles to broadcast beacon messages to ensure road safety. Rogue nodes in VANETs cause a Sybil attack to create an illusion of fake traffic congestion by broadcasting malicious information leading to catastrophic consequences, such as the collision of vehicles. Previous researchers used either cryptography, trust scores, or past vehicle data to detect rogue nodes, but they suffer from high processing delay, overhead, and false positive rate (FPR). We propose a fog computing based Sybil attack detection for VANETs (FSDV), which utilizes onboard units (OBUs) of all the vehicles in the region to create a dynamic fog for rogue nodes detection. We aim to reduce the data processing delays, overhead, and FPR in detecting rogue nodes causing Sybil attacks at high vehicle densities. The performance of our framework was carried out with simulations using OMNET and SUMO simulators. Results show that our framework ensures 43 lower processing delays, 13 lower overhead, and 35 lower FPR at high vehicle densities compared to existing Sybil attack detection schemes.


Quantitative Corner Case Feature Analysis of Hybrid Automata with ForFET SMT . The analysis and verification of hybrid automata (HA) models against rich formal properties can be a challenging task. Existing methods and tools can mainly reason whether a given property is satisfied or violated. However, such qualitative answers might not provide sufficient information about the model behaviors. This paper presents the ForFET SMT tool which can be used to reason quantitatively about such properties. It employs feature automata and can evaluate quantitative property corners of HA. ForFET SMT uses two third party formal verification tools as its backbone the SpaceEx reachability tool and the SMT solver dReach dReal. Herein, we describe the design and implementation of ForFET SMT and present its functionalities and modules. To improve the usability of the tool for non expert users, we also provide a list of quantitative property templates.


Generalized Tevelev degrees of mathbb P 1 . Let (C,p 1, ldots,p n) be a general curve. We consider the problem of enumerating covers of the projective line by C subject to incidence conditions at the marked points. These counts have been obtained by the first named author with Pandharipande and Schmitt via intersection theory on Hurwitz spaces and by the second named author with Farkas via limit linear series. In this paper, we build on these two approaches to generalize these counts to the situation where the covers are constrained to have arbitrary ramification profiles that is, additional ramification conditions are imposed at the marked points, and some collections of marked points are constrained to have equal image.


Multi Task Federated Reinforcement Learning with Adversaries. Reinforcement learning algorithms, just like any other Machine learning algorithm pose a serious threat from adversaries. The adversaries can manipulate the learning algorithm resulting in non optimal policies. In this paper, we analyze the Multi task Federated Reinforcement Learning algorithms, where multiple collaborative agents in various environments are trying to maximize the sum of discounted return, in the presence of adversarial agents. We argue that the common attack methods are not guaranteed to carry out a successful attack on Multi task Federated Reinforcement Learning and propose an adaptive attack method with better attack performance. Furthermore, we modify the conventional federated reinforcement learning algorithm to address the issue of adversaries that works equally well with and without the adversaries. Experimentation on different small to mid size reinforcement learning problems show that the proposed attack method outperforms other general attack methods and the proposed modification to federated reinforcement learning algorithm was able to achieve near optimal policies in the presence of adversarial agents.


The principal transmission condition. The paper treats pseudodifferential operators P Op(p( xi )) with homogeneous complex symbol p( xi ) of order 2a 0 , generalizing the fractional Laplacian ( Delta ) a but lacking its symmetries, and taken to act on the halfspace R n . The operators are seen to satisfy a principal mu transmission condition relative to R n , but generally not the full mu transmission condition satisfied by ( Delta ) a and related operators (with mu a ). However, P acts well on the so called mu transmission spaces over R n (defined in earlier works), and when P moreover is strongly elliptic, these spaces are the solution spaces for the homogeneous Dirichlet problem for P , leading to regularity results with a factor x n mu (in a limited range of Sobolev spaces). The information is then shown to be sufficient to establish an integration by parts formula over R n for P acting on such functions. The formulation in Sobolev spaces, and the results on strongly elliptic operators going beyond operators with real kernels, are new. Furthermore, large solutions with nonzero Dirichlet traces are described, and a halfways Green's formula is established, for this new class of operators. Since the principal mu transmission condition has weaker requirements than the full mu transmission condition assumed in earlier papers, new arguments were needed, relying on work of Vishik and Eskin instead of the Boutet de Monvel theory. The results cover the case of nonsymmetric operators with real kernel that were only partially treated in a preceding paper.


On smoothing properties and Tao's gauge transform of the Benjamin Ono equation on the torus. We prove smoothing properties of the solutions of the Benjamin Ono equation in the Sobolev space H s ( mathbb T , mathbb R ) for any s ge 0 . To this end we show that Tao's gauge transform is a high frequency approximation of the nonlinear Fourier transform Phi for the Benjamin Ono equation, constructed in our previous work. The results of this paper are manifestations of the quasi linear character of the Benjamin Ono equation.