Robust Visual Teach and Repeat for UGVs Using 3D Semantic Maps. In this paper, we propose a Visual Teach and Repeat (VTR) algorithm using semantic landmarks extracted from environmental objects for ground robots with fixed mount monocular cameras. The proposed algorithm is robust to changes in the starting pose of the camera robot, where a pose is defined as the planar position plus the orientation around the vertical axis. VTR consists of a teach phase in which a robot moves in a prescribed path, and a repeat phase in which the robot tries to repeat the same path starting from the same or a different pose. Most available VTR algorithms are pose dependent and cannot perform well in the repeat phase when starting from an initial pose far from that of the teach phase. To achieve more robust pose independency, the key is to generate a 3D semantic map of the environment containing the camera trajectory and the positions of surrounding objects during the teach phase. For specific implementation, we use ORB SLAM to collect the camera poses and the 3D point clouds of the environment, and YOLOv3 to detect objects in the environment. We then combine the two outputs to build the semantic map. In the repeat phase, we relocalize the robot based on the detected objects and the stored semantic map. The robot is then able to move toward the teach path, and repeat it in both forward and backward directions. We have tested the proposed algorithm in different scenarios and compared it with two most relevant recent studies. The results show that our algorithm is much more robust with respect to pose variations as well as environmental alterations. Our code and data are available at the following Github page https github.com mmahdavian semantic visual teach repeat


Embodied Learning for Lifelong Visual Perception. We study lifelong visual perception in an embodied setup, where we develop new models and compare various agents that navigate in buildings and occasionally request annotations which, in turn, are used to refine their visual perception capabilities. The purpose of the agents is to recognize objects and other semantic classes in the whole building at the end of a process that combines exploration and active visual learning. As we study this task in a lifelong learning context, the agents should use knowledge gained in earlier visited environments in order to guide their exploration and active learning strategy in successively visited buildings. We use the semantic segmentation performance as a proxy for general visual perception and study this novel task for several exploration and annotation methods, ranging from frontier exploration baselines which use heuristic active learning, to a fully learnable approach. For the latter, we introduce a deep reinforcement learning (RL) based agent which jointly learns both navigation and active learning. A point goal navigation formulation, coupled with a global planner which supplies goals, is integrated into the RL model in order to provide further incentives for systematic exploration of novel scenes. By performing extensive experiments on the Matterport3D dataset, we show how the proposed agents can utilize knowledge from previously explored scenes when exploring new ones, e.g. through less granular exploration and less frequent requests for annotations. The results also suggest that a learning based agent is able to use its prior visual knowledge more effectively than heuristic alternatives.


Modular Design Patterns for Hybrid Actors. Recently, a boxology (graphical language) with design patterns for hybrid AI was proposed, combining symbolic and sub symbolic learning and reasoning. In this paper, we extend this boxology with actors and their interactions. The main contributions of this paper are 1) an extension of the taxonomy to describe distributed hybrid AI systems with actors and interactions and 2) showing examples using a few design patterns relevant in multi agent systems and human agent interaction.


A New Split for Evaluating True Zero Shot Action Recognition. Zero shot action recognition is the task of classifying action categories that are not available in the training set. In this setting, the standard evaluation protocol is to use existing action recognition datasets(e.g. UCF101) and randomly split the classes into seen and unseen. However, most recent work builds on representations pre trained on the Kinetics dataset, where classes largely overlap with classes in the zero shot evaluation datasets. As a result, classes which are supposed to be unseen, are present during supervised pre training, invalidating the condition of the zero shot setting. A similar concern was previously noted several years ago for image based zero shot recognition but has not been considered by the zero shot action recognition community. In this paper, we propose a new split for true zero shot action recognition with no overlap between unseen test classes and training or pre training classes. We benchmark several recent approaches on the proposed True Zero Shot(TruZe) Split for UCF101 and HMDB51, with zero shot and generalized zero shot evaluation. In our extensive analysis, we find that our TruZesplits are significantly harder than comparable random splits as nothing is leaking from pre training, i.e. unseen performance is consistently lower,up to 8.9 for zero shot action recognition. In an additional evaluation we also find that similar issues exist in the splits used in few shot action recognition, here we see differences of up to 17.1 . We publish oursplits1and hope that our benchmark analysis will change how the field is evaluating zero and few shot action recognition moving forward.


On the gap between primes. It is proven that there are infinitely prime pairs whose difference is no greater than 110. In proving that result, a new sieve weight is constructed. The new idea is to construct the largest sieve support which admits the use of the Bombieri Vinogradov theorem.


On the Limits of Minimal Pairs in Contrastive Evaluation. Minimal sentence pairs are frequently used to analyze the behavior of language models. It is often assumed that model behavior on contrastive pairs is predictive of model behavior at large. We argue that two conditions are necessary for this assumption to hold First, a tested hypothesis should be well motivated, since experiments show that contrastive evaluation can lead to false positives. Secondly, test data should be chosen such as to minimize distributional discrepancy between evaluation time and deployment time. For a good approximation of deployment time decoding, we recommend that minimal pairs are created based on machine generated text, as opposed to human written references. We present a contrastive evaluation suite for English German MT that implements this recommendation.


Fully Convolutional Line Parsing. We present a one stage Fully Convolutional Line Parsing network (F Clip) that detects line segments from images. The proposed network is very simple and flexible with variations that gracefully trade off between speed and accuracy for different applications. F Clip detects line segments in an end to end fashion by predicting them with each line's center position, length, and angle. Based on empirical observation of the distribution of line angles in real image datasets, we further customize the design of convolution kernels of our fully convolutional network to effectively exploit such statistical priors. We conduct extensive experiments and show that our method achieves a significantly better trade off between efficiency and accuracy, resulting in a real time line detector at up to 73 FPS on a single GPU. Such inference speed makes our method readily applicable to real time tasks without compromising any accuracy of previous methods. Moreover, when equipped with a performance improving backbone network, F Clip is able to significantly outperform all state of the art line detectors on accuracy at a similar or even higher frame rate. Source code https github.com Delay Xili F Clip.


Computing homotopy classes for diagrams. We present an algorithm that, given finite simplicial sets X , A , Y with an action of a finite group G , computes the set X,Y A G of homotopy classes of equivariant maps ell colon X to Y extending a given equivariant map f colon A to Y under the stability assumption dim X H leq 2 operatorname conn Y H and operatorname conn Y H geq 1 , for all subgroups H leq G . For fixed n operatorname dim X , the algorithm runs in polynomial time. When the stability condition is dropped, the problem is undecidable already in the non equivariant setting. The algorithm is obtained as a special case of a more general result For finite diagrams of simplicial sets X , A , Y , i.e. functors mathcal I mathrm op to mathsf sSet , in the stable range operatorname dim X leq 2 operatorname conn Y and operatorname conn Y 1 , we give an algorithm that computes the set X, Y A of homotopy classes of maps of diagrams ell colon X to Y extending a given f colon A to Y . Again, for fixed n dim X , the running time of the algorithm is polynomial. The algorithm can be utilized to compute homotopy invariants in the equivariant setting for example, one can algorithmically compute equivariant stable homotopy groups. Further, one can apply the result to solve problems from computational topology, which we showcase on the following Tverberg type problem Given a k dimensional simplicial complex K , is there a map K to mathbb R d without r tuple intersection points? In the metastable range of dimensions, rd geq (r 1)k 3 , the result of Mabillard and Wagner shows this problem equivalent to the existence of a particular equivariant map. In this range, our algorithm is applicable and, thus, the r Tverberg problem is algorithmically decidable (in polynomial time when k , d and r are fixed).


A depleted and numerical model for pulsed Gaussian wave type II second harmonic generation. This paper presents a three dimensional (3 D) and spatio temporal dependent nonlinear wave model to explain the generation of pulsed Gaussian Second Harmonic Waves (SHW). We solve numerically three coupled equations describing the type II Second Harmonic Generation (SHG) in cylindrical KTP crystals under the assumption of fundamental waves depletion, two for ordinary and one for extraordinary Fundamental Waves (FW). The results are attained by a homemade code written in FORTRAN. The results depict the efficiency of the SHG process with the conversion of FW energy to SHW energy, while SHW keeps the same Gaussian profile as FW. Furthermore, the results examine the effect of pulse energy, beam spot size, and therefore interaction length on SHW efficiency.


BioCode A Data Driven Procedure to Learn the Growth of Biological Networks. Probabilistic biological network growth models have been utilized for many tasks including but not limited to capturing mechanism and dynamics of biological growth activities, null model representation, capturing anomalies, etc. Well known examples of these probabilistic models are Kronecker model, preferential attachment model, and duplication based model. However, we should frequently keep developing new models to better fit and explain the observed network features while new networks are being observed. Additionally, it is difficult to develop a growth model each time we study a new network. In this paper, we propose BioCode, a framework to automatically discover novel biological growth models matching user specified graph attributes in directed and undirected biological graphs. BioCode designs a basic set of instructions which are common enough to model a number of well known biological graph growth models. We combine such instruction wise representation with a genetic algorithm based optimization procedure to encode models for various biological networks. We mainly evaluate the performance of BioCode in discovering models for biological collaboration networks, gene regulatory networks, metabolic networks, and protein interaction networks which features such as assortativity, clustering coefficient, degree distribution closely match with the true ones in the corresponding real biological networks. As shown by the tests on the simulated graphs, the variance of the distributions of biological networks generated by BioCode is similar to the known models' variance for these biological network types.


TME BNA Temporal Motif Preserving Network Embedding with Bicomponent Neighbor Aggregation. Evolving temporal networks serve as the abstractions of many real life dynamic systems, e.g., social network and e commerce. The purpose of temporal network embedding is to map each node to a time evolving low dimension vector for downstream tasks, e.g., link prediction and node classification. The difficulty of temporal network embedding lies in how to utilize the topology and time information jointly to capture the evolution of a temporal network. In response to this challenge, we propose a temporal motif preserving network embedding method with bicomponent neighbor aggregation, named TME BNA. Considering that temporal motifs are essential to the understanding of topology laws and functional properties of a temporal network, TME BNA constructs additional edge features based on temporal motifs to explicitly utilize complex topology with time information. In order to capture the topology dynamics of nodes, TME BNA utilizes Graph Neural Networks (GNNs) to aggregate the historical and current neighbors respectively according to the timestamps of connected edges. Experiments are conducted on three public temporal network datasets, and the results show the effectiveness of TME BNA.


On Hilbert ideals for a class of p groups in characteristic p . Let p be a prime number, Bbbk a field of characteristic p and G a finite p group. Let V be a finite dimensional linear representation of G over Bbbk . Write S mathrm Sym V . For a class of p groups which we call generalised Nakajima groups, we prove the following begin enumerate item The Hilbert ideal is a complete intersection. As a consequence, for the case of generalised Nakajima groups, we prove a conjecture of Shank and Wehlau (reformulated by Broer) that asserts that if the invariant subring S G is a direct summand of S as S G modules then S G is a polynomial ring. item The Hilbert ideal has a generating set with elements of degree at most G . This bound is conjectured by Derksen and Kemper. end enumerate


Improving Sequential Recommendation with Attribute augmented Graph Neural Networks. Many practical recommender systems provide item recommendation for different users only via mining user item interactions but totally ignoring the rich attribute information of items that users interact with. In this paper, we propose an attribute augmented graph neural network model named Murzim. Murzim takes as input the graphs constructed from the user item interaction sequences and corresponding item attribute sequences. By combining the GNNs with node aggregation and an attention network, Murzim can capture user preference patterns, generate embeddings for user item interaction sequences, and then generate recommendations through next item prediction. We conduct extensive experiments on multiple datasets. Experimental results show that Murzim outperforms several state of the art methods in terms of recall and MRR, which illustrates that Murzim can make use of item attribute information to produce better recommendations. At present, Murzim has been deployed in MX Player, one of India's largest streaming platforms, and is recommending videos for tens of thousands of users.


Simultaneous Location of Rail Vehicles and Mapping of Environment with Multiple LiDARs. Precise and real time rail vehicle localization as well as railway environment monitoring is crucial for railroad safety. In this letter, we propose a multi LiDAR based simultaneous localization and mapping (SLAM) system for railway applications. Our approach starts with measurements preprocessing to denoise and synchronize multiple LiDAR inputs. Different frame to frame registration methods are used according to the LiDAR placement. In addition, we leverage the plane constraints from extracted rail tracks to improve the system accuracy. The local map is further aligned with global map utilizing absolute position measurements. Considering the unavoidable metal abrasion and screw loosening, online extrinsic refinement is awakened for long during operation. The proposed method is extensively verified on datasets gathered over 3000 km. The results demonstrate that the proposed system achieves accurate and robust localization together with effective mapping for large scale environments. Our system has already been applied to a freight traffic railroad for monitoring tasks.


Students are the Best Teacher Exit Ensemble Distillation with Multi Exits. This paper proposes a novel knowledge distillation based learning method to improve the classification performance of convolutional neural networks (CNNs) without a pre trained teacher network, called exit ensemble distillation. Our method exploits the multi exit architecture that adds auxiliary classifiers (called exits) in the middle of a conventional CNN, through which early inference results can be obtained. The idea of our method is to train the network using the ensemble of the exits as the distillation target, which greatly improves the classification performance of the overall network. Our method suggests a new paradigm of knowledge distillation unlike the conventional notion of distillation where teachers only teach students, we show that students can also help other students and even the teacher to learn better. Experimental results demonstrate that our method achieves significant improvement of classification performance on various popular CNN architectures (VGG, ResNet, ResNeXt, WideResNet, etc.). Furthermore, the proposed method can expedite the convergence of learning with improved stability. Our code will be available on Github.


Submodular Order Functions and Assortment Optimization. We define a new class of set functions that in addition to being monotone and subadditive, also admit a very limited form of submodularity defined over a permutation of the ground set. We refer to this permutation as a submodular order. This class of functions includes monotone submodular functions as a sub family. To understand the importance of this structure in optimization problems we consider the problem of maximizing function value under various types of constraints. To demonstrate the modeling power of submodular order functions we show applications in two different settings. First, we apply our results to the extensively studied problem of assortment optimization. While the objectives in assortment optimization are known to be non submodular (and non monotone) even for simple choice models, we show that they are compatible with the notion of submodular order. Consequently, we obtain new and in some cases the first constant factor guarantee for constrained assortment optimization in fundamental choice models. As a second application of submodular order functions, we show an intriguing connection to the maximization of monotone submodular functions in the streaming model. We recover some best known guarantees for this problem as a corollary of our results.


A novel W 1, infty approach to shape optimisation with Lipschitz domains. This article introduces a novel method for the implementation of shape optimisation with Lipschitz domains. We propose to use the shape derivative to determine deformation fields which represent steepest descent directions of the shape functional in the W 1, infty topology. The idea of our approach is demonstrated for shape optimisation of n dimensional star shaped domains, which we represent as functions defined on the unit (n 1) sphere. In this setting we provide the specific form of the shape derivative and prove the existence of solutions to the underlying shape optimisation problem. Moreover, we show the existence of a direction of steepest descent in the W 1, infty topology. We also note that shape optimisation in this context is closely related to the infty Laplacian, and to optimal transport, where we highlight the latter in the numerics section. We present several numerical experiments in two dimensions illustrating that our approach seems to be superior over a widely used Hilbert space method in the considered examples, in particular in developing optimised shapes with corners.


Deep Explicit Duration Switching Models for Time Series. Many complex time series can be effectively subdivided into distinct regimes that exhibit persistent dynamics. Discovering the switching behavior and the statistical patterns in these regimes is important for understanding the underlying dynamical system. We propose the Recurrent Explicit Duration Switching Dynamical System (RED SDS), a flexible model that is capable of identifying both state and time dependent switching dynamics. State dependent switching is enabled by a recurrent state to switch connection and an explicit duration count variable is used to improve the time dependent switching behavior. We demonstrate how to perform efficient inference using a hybrid algorithm that approximates the posterior of the continuous states via an inference network and performs exact inference for the discrete switches and counts. The model is trained by maximizing a Monte Carlo lower bound of the marginal log likelihood that can be computed efficiently as a byproduct of the inference routine. Empirical results on multiple datasets demonstrate that RED SDS achieves considerable improvement in time series segmentation and competitive forecasting performance against the state of the art.


Stochastic Model Predictive Control as an Iterated Function System. We present the observation that the process of stochastic model predictive control can be formulated in the framework of an iterated function system. The latter has a rich ergodicity theory that can hence be applied to study the former's limiting behavior. We present how such a framework can be realized for specific problems and illustrate the required conditions for application of the relevant theoretical guarantees.


ChaCha for Online AutoML. We propose the ChaCha (Champion Challengers) algorithm for making an online choice of hyperparameters in online learning settings. ChaCha handles the process of determining a champion and scheduling a set of live' challengers over time based on sample complexity bounds. It is guaranteed to have sublinear regret after the optimal configuration is added into consideration by an application dependent oracle based on the champions. Empirically, we show that ChaCha provides good performance across a wide array of datasets when optimizing over featurization and hyperparameter decisions.


HAN An Efficient Hierarchical Self Attention Network for Skeleton Based Gesture Recognition. Previous methods for skeleton based gesture recognition mostly arrange the skeleton sequence into a pseudo picture or spatial temporal graph and apply deep Convolutional Neural Network (CNN) or Graph Convolutional Network (GCN) for feature extraction. Although achieving superior results, these methods have inherent limitations in dynamically capturing local features of interactive hand parts, and the computing efficiency still remains a serious issue. In this work, the self attention mechanism is introduced to alleviate this problem. Considering the hierarchical structure of hand joints, we propose an efficient hierarchical self attention network (HAN) for skeleton based gesture recognition, which is based on pure self attention without any CNN, RNN or GCN operators. Specifically, the joint self attention module is used to capture spatial features of fingers, the finger self attention module is designed to aggregate features of the whole hand. In terms of temporal features, the temporal self attention module is utilized to capture the temporal dynamics of the fingers and the entire hand. Finally, these features are fused by the fusion self attention module for gesture classification. Experiments show that our method achieves competitive results on three gesture recognition datasets with much lower computational complexity.


A fluid simulation system based on the MPS method. Fluid flow simulation is a highly active area with applications in a wide range of engineering problems and interactive systems. Meshless methods like the Moving Particle Semi implicit (MPS) are a great alternative to deal efficiently with large deformations and free surface flow. However, mesh based approaches can achieve higher numerical precision than particle based techniques with a performance cost. This paper presents a numerically stable and parallelized system that benefits from advances in the literature and parallel computing to obtain an adaptable MPS method. The proposed technique can simulate liquids using different approaches, such as two ways to calculate the particles' pressure, turbulent flow, and multiphase interaction. The method is evaluated under traditional test cases presenting comparable results to recent techniques. This work integrates the previously mentioned advances into a single solution, which can switch on improvements, such as better momentum conservation and less spurious pressure oscillations, through a graphical interface. The code is entirely open source under the GPLv3 free software license. The GPU accelerated code reached speedups ranging from 3 to 43 times, depending on the total number of particles. The simulation runs at one fps for a case with approximately 200,000 particles. Code https github.com andreluizbvs VoxarMPS


Evaluating Contextual Embeddings and their Extraction Layers for Depression Assessment. Recent works have demonstrated ability to assess aspects of mental health from personal discourse. At the same time, pre trained contextual word embedding models have grown to dominate much of NLP but little is known empirically on how to best apply them for mental health assessment. Using degree of depression as a case study, we do an empirical analysis on which off the shelf language model, individual layers, and combinations of layers seem most promising when applied to human level NLP tasks. Notably, we find RoBERTa most effective and, despite the standard in past work suggesting the second to last or concatenation of the last 4 layers, we find layer 19 (sixth to last) is at least as good as layer 23 when using 1 layer. Further, when using multiple layers, distributing them across the second half (i.e. Layers 12 ), rather than last 4, of the 24 layers yielded the most accurate results.


Experimental Analysis of Trajectory Control Using Computer Vision and Artificial Intelligence for Autonomous Vehicles. Perception of the lane boundaries is crucial for the tasks related to autonomous trajectory control. In this paper, several methodologies for lane detection are discussed with an experimental illustration Hough transformation, Blob analysis, and Bird's eye view. Following the abstraction of lane marks from the boundary, the next approach is applying a control law based on the perception to control steering and speed control. In the following, a comparative analysis is made between an open loop response, PID control, and a neural network control law through graphical statistics. To get the perception of the surrounding a wireless streaming camera connected to Raspberry Pi is used. After pre processing the signal received by the camera the output is sent back to the Raspberry Pi that processes the input and communicates the control to the motors through Arduino via serial communication.


Molecular Dynamics Analysis of Biomolecular Systems Including Nucleic Acids. Along with recent progress in structural biology and genome biology, structural dynamics of molecular systems including nucleic acids has attracted attention in the context of gene regulation. Structure function relationship is an important topic, where physicochemical properties of nucleotides are important as well as those of amino acids in proteins. Simulation is a useful tool for the analysis of molecular dynamics in detail, complementary to experiments. However, molecular simulation of nucleic acids has less developed than that of proteins yet, partly due to the physical nature of nucleic acids. In this review, we briefly describe the current situation and future directions of the field, hopefully as a guide to collaboration between experiment and computation.


Prediction of 'artificial' urban archetypes at the pedestrian scale through a synthesis of domain expertise with machine learning methods. The vitality of urban spaces has been steadily undermined by the pervasive adoption of car centric forms of urban development as characterised by lower densities, street networks offering poor connectivity for pedestrians, and a lack of accessible land uses yet, even if these issues have been clearly framed for some time, the problem persists in new forms of planning. It is here posited that a synthesis of domain knowledge and machine learning methods allows for the creation of robust toolsets against which newly proposed developments can be benchmarked in a more rigorous manner in the interest of greater accountability and better evidenced decision making. A worked example develops a sequence of machine learning models that distinguishing artificial' towns from their more walkable and mixed use historical' equivalents. The dataset is developed from network centrality, mixed use, land use accessibility, and population density measures as proxies for spatial complexity, which are computed at the pedestrian scale for 931 towns and cities in Great Britain. Using officially designated New Towns' as a departure point, a series of clues is then developed. First, using an iterative human in the loop procedure, a supervised classifier (Extra Trees) is cultivated from which 185 artificial' locations are identified based on data aggregated to respective town or city boundaries. This information is then used to train supervised and semi supervised (M2) deep neural network classifiers against the higher resolution dataset. The models broadly align with intuitions expressed by urbanists and show potential for continued development to broach ensuing challenges pertaining to selection of curated training exemplars further development of techniques to accentuate localised scales of analysis and methods for the calibration of model probabilities to align with the intuitions of domain experts.


2nd Place Solution to Google Landmark Retrieval 2021. This paper presents the 2nd place solution to the Google Landmark Retrieval 2021 Competition on Kaggle. The solution is based on a baseline with training tricks from person re identification, a continent aware sampling strategy is presented to select training images according to their country tags and a Landmark Country aware reranking is proposed for the retrieval task. With these contributions, we achieve 0.52995 mAP 100 on private leaderboard. Code available at https github.com WesleyZhang1991 Google Landmark Retrieval 2021 2nd Place Solution


Locality Constrained Analysis Dictionary Learning via K SVD Algorithm. Recent years, analysis dictionary learning (ADL) and its applications for classification have been well developed, due to its flexible projective ability and low classification complexity. With the learned analysis dictionary, test samples can be transformed into a sparse subspace for classification efficiently. However, the underling locality of sample data has rarely been explored in analysis dictionary to enhance the discriminative capability of the classifier. In this paper, we propose a novel locality constrained analysis dictionary learning model with a synthesis K SVD algorithm (SK LADL). It considers the intrinsic geometric properties by imposing graph regularization to uncover the geometric structure for the image data. Through the learned analysis dictionary, we transform the image to a new and compact space where the manifold assumption can be further guaranteed. thus, the local geometrical structure of images can be preserved in sparse representation coefficients. Moreover, the SK LADL model is iteratively solved by the synthesis K SVD and gradient technique. Experimental results on image classification validate the performance superiority of our SK LADL model.


Chance and the Continuum Hypothesis. This paper presents and defends an argument that the continuum hypothesis is false, based on considerations about objective chance and an old theorem due to Banach and Kuratowski. More specifically, I argue that the probabilistic inductive methods standardly used in science presuppose that every proposition about the outcome of a chancy process has a certain chance between 0 and 1. I also argue in favour of the standard view that chances are countably additive. Since it is possible to randomly pick out a point on a continuum, for instance using a roulette wheel or by flipping a countable infinity of fair coins, it follows, given the axioms of ZFC, that there are many different cardinalities between countable infinity and the cardinality of the continuum.


Network Activities Recognition and Analysis Based on Supervised Machine Learning Classification Methods Using J48 and Na "ive Bayes Algorithm. Network activities recognition has always been a significant component of intrusion detection. However, with the increasing network traffic flow and complexity of network behavior, it is becoming more and more difficult to identify the specific behavior quickly and accurately by user network monitoring software. It also requires the system security staff to pay close attention to the latest intrusion monitoring technology and methods. All of these greatly increase the difficulty and complexity of intrusion detection tasks. The application of machine learning methods based on supervised classification technology would help to liberate the network security staff from the heavy and boring tasks. A finetuned model would accurately recognize user behavior, which could provide persistent monitoring with a relative high accuracy and good adaptability. Finally, the results of network activities recognition by J48 and Na "ive Bayes algorithms are introduced and evaluated.


A Spatio Temporal Identity Verification Method for Person Action Instance Search in Movies. As one of the challenging problems in video search, Person Action Instance Search (INS) aims to retrieve shots with specific person carrying out specific action from massive video shots. Existing methods mainly include two steps First, two individual INS branches, i.e., person INS and action INS, are separately conducted to compute the initial person and action ranking scores Second, both scores are directly fused to generate the final ranking list. However, direct aggregation of two individual INS scores cannot guarantee the identity consistency between person and action. For example, a shot with "Pat is standing" and "Ian is sitting on couch" may be erroneously understood as "Pat is sitting on couch" or "Ian is standing". To address the above identity inconsistency problem (IIP), we study a spatio temporal identity verification method. Specifically, in the spatial dimension, we propose an identity consistency verification scheme to optimize the direct fusion score of person INS and action INS. The motivation originates from an observation that face detection results usually locate in the identity consistent action bounding boxes. Moreover, in the temporal dimension, considering the complex filming condition, we propose an inter frame detection extension operation to interpolate missing face action detection results in successive video frames. The proposed method is evaluated on the large scale TRECVID INS dataset, and the experimental results show that our method can effectively mitigate the IIP and surpass the existing second places in both TRECVID 2019 and 2020 INS tasks.


Ill posedness for the Burgers equation in Sobolev spaces. In this paper, we considered the Cauchy problem for the Burgers equation and proved that the problem is ill posed in Sobolev spaces H s with s in 1, fr32) .


A Train Formation Plan with Elastic Capacity for Large Scale Rail Networks. This paper studies the problem of optimizing the train formation plan and traffic routing (TFP TR) simultaneously. Based on the previous research of TFP TR with determinate parameters, we consider the fluctuation of flows and associate the elastic features of yard capacities and link capacities. To demonstrate such elastic peculiarities, the fuzzy theory is introduced and the membership function is designed to designate the satisfaction degree for the volumes of traffic flows. A non linear integer programming model is developed considering various operational requirements and a set of capacity constraints, including link capacity, yard reclassification capacity and the maximal number of blocks a yard can be formed, while trying to minimize the total costs of accumulation, reclassification, and transportation.


Learning Pomset Automata. We extend the L algorithm to learn bimonoids recognising pomset languages. We then identify a class of pomset automata that accepts precisely the class of pomset languages recognised by bimonoids and show how to convert between bimonoids and automata.


Employing chunk size adaptation to overcome concept drift. Modern analytical systems must be ready to process streaming data and correctly respond to data distribution changes. The phenomenon of changes in data distributions is called concept drift, and it may harm the quality of the used models. Additionally, the possibility of concept drift appearance causes that the used algorithms must be ready for the continuous adaptation of the model to the changing data distributions. This work focuses on non stationary data stream classification, where a classifier ensemble is used. To keep the ensemble model up to date, the new base classifiers are trained on the incoming data blocks and added to the ensemble while, at the same time, outdated models are removed from the ensemble. One of the problems with this type of model is the fast reaction to changes in data distributions. We propose a new Chunk Adaptive Restoration framework that can be adapted to any block based data stream classification algorithm. The proposed algorithm adjusts the data chunk size in the case of concept drift detection to minimize the impact of the change on the predictive performance of the used model. The conducted experimental research, backed up with the statistical tests, has proven that Chunk Adaptive Restoration significantly reduces the model's restoration time.


Improving the compromise between accuracy, interpretability and personalization of rule based machine learning in medical problems. One of the key challenges when developing a predictive model is the capability to describe the domain knowledge and the cause effect relationships in a simple way. Decision rules are a useful and important methodology in this context, justifying their application in several areas, particularly in clinical practice. Several machine learning classifiers have exploited the advantageous properties of decision rules to build intelligent prediction models, namely decision trees and ensembles of trees (ETs). However, such methodologies usually suffer from a trade off between interpretability and predictive performance. Some procedures consider a simplification of ETs, using heuristic approaches to select an optimal reduced set of decision rules. In this paper, we introduce a novel step to those methodologies. We create a new component to predict if a given rule will be correct or not for a particular patient, which introduces personalization into the procedure. Furthermore, the validation results using three public clinical datasets suggest that it also allows to increase the predictive performance of the selected set of rules, improving the mentioned trade off.


Full Duplex Strategy for Video Object Segmentation. Previous video object segmentation approaches mainly focus on using simplex solutions between appearance and motion, limiting feature collaboration efficiency among and across these two cues. In this work, we study a novel and efficient full duplex strategy network (FSNet) to address this issue, by considering a better mutual restraint scheme between motion and appearance in exploiting the cross modal features from the fusion and decoding stage. Specifically, we introduce the relational cross attention module (RCAM) to achieve bidirectional message propagation across embedding sub spaces. To improve the model's robustness and update the inconsistent features from the spatial temporal embeddings, we adopt the bidirectional purification module (BPM) after the RCAM. Extensive experiments on five popular benchmarks show that our FSNet is robust to various challenging scenarios (e.g., motion blur, occlusion) and achieves favourable performance against existing cutting edges both in the video object segmentation and video salient object detection tasks. The project is publicly available at https dpfan.net FSNet.


STAN Spatio Temporal Attention Network for Next Location Recommendation. The next location recommendation is at the core of various location based applications. Current state of the art models have attempted to solve spatial sparsity with hierarchical gridding and model temporal relation with explicit time intervals, while some vital questions remain unsolved. Non adjacent locations and non consecutive visits provide non trivial correlations for understanding a user's behavior but were rarely considered. To aggregate all relevant visits from user trajectory and recall the most plausible candidates from weighted representations, here we propose a Spatio Temporal Attention Network (STAN) for location recommendation. STAN explicitly exploits relative spatiotemporal information of all the check ins with self attention layers along the trajectory. This improvement allows a point to point interaction between non adjacent locations and non consecutive check ins with explicit spatiotemporal effect. STAN uses a bi layer attention architecture that firstly aggregates spatiotemporal correlation within user trajectory and then recalls the target with consideration of personalized item frequency (PIF). By visualization, we show that STAN is in line with the above intuition. Experimental results unequivocally show that our model outperforms the existing state of the art methods by 9 17 .


Are Word Embedding Methods Stable and Should We Care About It?. A representation learning method is considered stable if it consistently generates similar representation of the given data across multiple runs. Word Embedding Methods (WEMs) are a class of representation learning methods that generate dense vector representation for each word in the given text data. The central idea of this paper is to explore the stability measurement of WEMs using intrinsic evaluation based on word similarity. We experiment with three popular WEMs Word2Vec, GloVe, and fastText. For stability measurement, we investigate the effect of five parameters involved in training these models. We perform experiments using four real world datasets from different domains Wikipedia, News, Song lyrics, and European parliament proceedings. We also observe the effect of WEM stability on three downstream tasks Clustering, POS tagging, and Fairness evaluation. Our experiments indicate that amongst the three WEMs, fastText is the most stable, followed by GloVe and Word2Vec.


VML MOC Segmenting a multiply oriented and curved handwritten text lines dataset. This paper publishes a natural and very complicated dataset of handwritten documents with multiply oriented and curved text lines, namely VML MOC dataset. These text lines were written as remarks on the page margins by different writers over the years. They appear at different locations within the orientations that range between 0 and 180 or as curvilinear forms. We evaluate a multi oriented Gaussian based method to segment these handwritten text lines that are skewed or curved in any orientation. It achieves a mean pixel Intersection over Union score of 80.96 on the test documents. The results are compared with the results of a single oriented Gaussian based text line segmentation method.


The Duo of Artificial Intelligence and Big Data for Industry 4.0 Review of Applications, Techniques, Challenges, and Future Research Directions. The increasing need for economic, safe, and sustainable smart manufacturing combined with novel technological enablers, has paved the way for Artificial Intelligence (AI) and Big Data in support of smart manufacturing. This implies a substantial integration of AI, Industrial Internet of Things (IIoT), Robotics, Big data, Blockchain, 5G communications, in support of smart manufacturing and the dynamical processes in modern industries. In this paper, we provide a comprehensive overview of different aspects of AI and Big Data in Industry 4.0 with a particular focus on key applications, techniques, the concepts involved, key enabling technologies, challenges, and research perspective towards deployment of Industry 5.0. In detail, we highlight and analyze how the duo of AI and Big Data is helping in different applications of Industry 4.0. We also highlight key challenges in a successful deployment of AI and Big Data methods in smart industries with a particular emphasis on data related issues, such as availability, bias, auditing, management, interpretability, communication, and different adversarial attacks and security issues. In a nutshell, we have explored the significance of AI and Big data towards Industry 4.0 applications through panoramic reviews and discussions. We believe, this work will provide a baseline for future research in the domain.


On the image of the period map for polarized hyperk "ahler manifolds of mathrm K3 m type. The moduli space for polarized hyperk "ahler manifolds of mathrm K3 m type with a given polarization type is not necessarily connected, which is a phenomenon that only happens for m large. The period map restricted to each connected component gives an open embedding into the period domain, and the complement of the image is a finite union of Heegner divisors. We give a simplified formula for the number of connected components, as well as a simplified criterion to enumerate the Heegner divisors in the complement. In particular, we show that the image of the period map may be different when restricted to different components of the moduli space.


Capacity Achieving Private Information Retrieval Schemes from Uncoded Storage Constrained Servers with Low Sub packetization. This paper investigates reducing sub packetization of capacity achieving schemes for uncoded Storage Constrained Private Information Retrieval (SC PIR) systems. In the SC PIR system, a user aims to retrieve one out of K files from N servers while revealing nothing about its identity to any individual server, in which the K files are stored at the N servers in an uncoded form and each server can store up to mu K equivalent files, where mu is the normalized storage capacity of each server. We first prove that there exists a capacity achieving SC PIR scheme for a given storage design if and only if all the packets are stored exactly at M triangleq mu N servers for mu such that M mu N in 2,3, ldots,N . Then, the optimal sub packetization for capacity achieving linear SC PIR schemes is characterized as the solution to an optimization problem, which is typically hard to solve because of involving indicator functions. Moreover, a new notion of array called Storage Design Array (SDA) is introduced for the SC PIR system. With any given SDA, an associated capacity achieving SC PIR scheme is constructed. Next, the SC PIR schemes that have equal size packets are investigated. Furthermore, the optimal equal size sub packetization among all capacity achieving linear SC PIR schemes characterized by Woolsey et al. is proved to be frac N(M 1) gcd(N,M) . Finally, by allowing unequal size of packets, a greedy SDA construction is proposed, where the sub packetization of the associated SC PIR scheme is upper bounded by frac N(M 1) gcd(N,M) . Among all capacity achieving linear SC PIR schemes, the sub packetization is optimal when min M,N M N or M N , and within a multiplicative gap frac min M,N M gcd(N,M) of the optimal one otherwise. In particular, for the case N d cdot M pm1 where d geq 2 , another SDA is constructed to obtain lower sub packetization.


Evidence of damage in carbon fibre composite tiles joined to a metallic heat sink under high heat flux fatigue. The two years experience with Active Metal Casting flat bonds shows that this technology is suitable for the heat fluxes expected in Tore Supra (10 MW m 2 ). Tests were pursued up to 3330 cycles, with elements still functional. At higher heat fluxes, fatigue damage is observed, but the bond resists remarkably well with no tile detachment. Examination of such deliberately damaged bonds showed distributed cracking, proving the absence of any weak link. The limitations to those higher heat fluxes are more related to the design and the base materials than to the bond itself.


Deep Compression for PyTorch Model Deployment on Microcontrollers. Neural network deployment on low cost embedded systems, hence on microcontrollers (MCUs), has recently been attracting more attention than ever. Since MCUs have limited memory capacity as well as limited compute speed, it is critical that we employ model compression, which reduces both memory and compute speed requirements. In this paper, we add model compression, specifically Deep Compression, and further optimize Unlu's earlier work on arXiv, which efficiently deploys PyTorch models on MCUs. First, we prune the weights in convolutional and fully connected layers. Secondly, the remaining weights and activations are quantized to 8 bit integers from 32 bit floating point. Finally, forward pass functions are compressed using special data structures for sparse matrices, which store only nonzero weights (without impacting performance and accuracy). In the case of the LeNet 5 model, the memory footprint was reduced by 12.45x, and the inference speed was boosted by 2.57x.


Characterizations of Daugavet and delta points in Lipschitz free spaces. A norm one element x of a Banach space is a Daugavet point (respectively, a Delta point) if every slice of the unit ball (respectively, every slice of the unit ball containing x ) contains an element, which is almost at distance 2 from x . We characterize Daugavet and Delta points in Lipschitz free spaces. Furthermore, we construct a Lipschitz free space with the Radon Nikod 'ym property and a Daugavet point this is the first known example of such a Banach space.


The onset of molecule spanning dynamics in a multi domain protein. Protein dynamics has been investigated on a wide range of time scales. Nano and picosecond dynamics have been assigned to local fluctuations, while slower dynamics have been attributed to larger conformational changes. However, it is largely unknown how local fluctuations can lead to global allosteric changes. Here we show that molecule spanning dynamics on the 100 ns time scale precede larger allosteric changes. We assign global real space movements to dynamic modes on the 100 ns time scales, which became possible by a combination of single molecule fluorescence, quasi elastic neutron scattering and all atom MD simulations. Additionally, we demonstrate the effect of Sba1, a co chaperone of Hsp90, on these molecule spanning dynamics, which implies functional importance of such dynamics. Our integrative approach provides comprehensive insights into molecule spanning dynamics on the nanosecond time scale for a multi domain protein and indicates that such dynamics are the molecular basis for allostery and large conformational changes in proteins.


Modeling Object Recognition in Newborn Chicks using Deep Neural Networks. In recent years, the brain and cognitive sciences have made great strides developing a mechanistic understanding of object recognition in mature brains. Despite this progress, fundamental questions remain about the origins and computational foundations of object recognition. What learning algorithms underlie object recognition in newborn brains? Since newborn animals learn largely through unsupervised learning, we explored whether unsupervised learning algorithms can be used to predict the view invariant object recognition behavior of newborn chicks. Specifically, we used feature representations derived from unsupervised deep neural networks (DNNs) as inputs to cognitive models of categorization. We show that features derived from unsupervised DNNs make competitive predictions about chick behavior compared to supervised features. More generally, we argue that linking controlled rearing studies to image computable DNN models opens new experimental avenues for studying the origins and computational basis of object recognition in newborn animals.


Spectral Shaping with Integrated Self Coupled Sagnac Loop Reflectors. We propose and theoretically investigate integrated photonic filters based on coupled Sagnac loop reflectors (SLRs) formed by a self coupled wire waveguide. By tailoring coherent mode interference in the device, three different filter functions are achieved, including Fano like resonances, wavelength interleaving, and varied resonance mode splitting. For each function, the impact of device structural parameters is analyzed to facilitate optimized performance. Our results theoretically verify the proposed device as a compact multi functional integrated photonic filter for flexible spectral shaping.


Cross Domain Reasoning via Template Filling. In this paper, we explore the ability of sequence to sequence models to perform cross domain reasoning. Towards this, we present a prompt template filling approach to enable sequence to sequence models to perform cross domain reasoning. We also present a case study with commonsense and health and well being domains, where we study how prompt template filling enables pretrained sequence to sequence models across domains. Our experiments across several pretrained encoder decoder models show that cross domain reasoning is challenging for current models. We also show an in depth error analysis and avenues for future research for reasoning across domains


An architecture for enabling A B experiments in automotive embedded software. A B experimentation is a known technique for data driven product development and has demonstrated its value in web facing businesses. With the digitalisation of the automotive industry, the focus in the industry is shifting towards software. For automotive embedded software to continuously improve, A B experimentation is considered an important technique. However, the adoption of such a technique is not without challenge. In this paper, we present an architecture to enable A B testing in automotive embedded software. The design addresses challenges that are unique to the automotive industry in a systematic fashion. Going from hypothesis to practice, our architecture was also applied in practice for running online experiments on a considerable scale. Furthermore, a case study approach was used to compare our proposal with state of practice in the automotive industry. We found our architecture design to be relevant and applicable in the efforts of adopting continuous A B experiments in automotive embedded software.


On the convergence of the orthogonal spectral sequence. We show that the orthogonal spectral sequence introduced by the second author is strongly convergent in Voevodsky's triangulated category of motives DM over a field k. In the context of the Morel Voevodsky motivic stable homotopy category we provide concrete examples where the spectral sequence is not strongly convergent, and give a criterion under which the strong convergence still holds. This criterion holds for Voevodsky's slices, and as a consequence we obtain a spectral sequence which converges strongly to the E1 term of Voevodsky's slice spectral sequence.


Special curves in modular surfaces. We show that geodesics in the upper half plane attached to a maximal split torus or a real quadratic torus in GL 2, mathbf Q are the only irreducible algebraic curves whose image via the j invariant is contained in an algebraic curve.


2nd order Updates with 1st order Complexity. It has long been a goal to efficiently compute and use second order information on a function ( f ) to assist in numerical approximations. Here it is shown how, using only basic physics and a numerical approximation, such information can be accurately obtained at a cost of cal O (N) complexity, where N is the dimensionality of the parameter space of f . In this paper, an algorithm ( em VA Flow ) is developed to exploit this second order information, and pseudocode is presented. It is applied to two classes of problems, that of inverse kinematics (IK) and gradient descent (GD). In the IK application, the algorithm is fast and robust, and is shown to lead to smooth behavior even near singularities. For GD the algorithm also works very well, provided the cost function is locally well described by a polynomial.


A continuation method for computing the multilinear Pagerank. The multilinear Pagerank model Gleich, Lim and Yu, 2015 is a tensor based generalization of the Pagerank model. Its computation requires solving a system of polynomial equations that contains a parameter alpha in 0,1) . For alpha approx 1 , this computation remains a challenging problem, especially since the solution may be non unique. Extrapolation strategies that start from smaller values of alpha and follow' the solution by slowly increasing this parameter have been suggested however, there are known cases where these strategies fail, because a globally continuous solution curve cannot be defined as a function of alpha . In this paper, we improve on this idea, by employing a predictor corrector continuation algorithm based on a more general representation of the solutions as a curve in mathbb R n 1 . We prove several global properties of this curve that ensure the good behavior of the algorithm, and we show in our numerical experiments that this method is significantly more reliable than the existing alternatives.


A lower bound theorem for d polytopes with 2d 1 vertices. We establish the exact lower bound for the number of k faces of d polytopes with 2d 1 vertices, for each value of k , and characterise the minimisers. As a byproduct, we characterise all d polytopes with d 3 vertices, and only one or two edges more than the minimum.


Detecting cities with high intermediacy in the African urban network. Cities play different roles depending on their location within the transport network. Two cities of similar size might have distinct characteristics if one is located on a corridor between two capitals and the other is near a barrier, such as a mountain range. The level of intermediacy is a property of cities that characterises their position in the urban network. We measure the level of intermediacy of African cities by constructing the road infrastructure network obtained from OpenStreetMap. The infrastructure network allows defining city metrics such as degree and centrality. A proxy for the number of journeys that flow through each network edge is approximated using a mathematical model based on the level of attraction or gravity between all pairs of cities. Our model considers the extra time of crossing an international border as a parameter that enables us to proxy the cost of having fragmented regions with costly political barriers. Our results show that small cities have a wide range of intermediacy. We detect a phase transition where cities with less than one million inhabitants have a centrality that depends on the size and degree. For cities above one million inhabitants, centrality tends to be larger and depending primarily on city size rather than degree.


Traceability Technology Adoption in Supply Chain Networks. Modern traceability technologies promise to improve supply chain management by simplifying recalls, increasing demand visibility, or ascertaining sustainable supplier practices. Managers in the traceability initiatives developing such technologies face a difficult question which companies should they target as early adopters to ensure that their technology is broadly employed? To answer this question, managers must consider that supply chains are interlinked in complex networks and that a supply chain effect is inherent to traceability technologies. More specifically, the benefits obtained from traceability are conditional on technology adoption throughout a product's supply chain. We introduce a model of the dynamics of traceability technology adoption in supply chain networks to tackle the problem of selecting the smallest set of early adopters guaranteeing broad dissemination. Our model builds on extant diffusion models while incorporating that a firm's adoption decision depends on previous adoption decisions throughout its supply chains. We show that the problem is NP hard and that no approximation within a polylogarithmic factor can be guaranteed for any polynomial time algorithm. Nevertheless, we introduce an algorithm that identifies an exact solution in polynomial time under certain assumptions on the network structure and provide evidence that it is tractable for real world supply chain networks. We further propose a random generative model that outputs networks consistent with real world supply chain networks. The networks obtained display, whp, structures that allow us to find the optimal seed set in subexponential time using our algorithm. Our generative model also provides approximate seed sets when information on the network is limited.


Machine learning in the social and health sciences. The uptake of machine learning (ML) approaches in the social and health sciences has been rather slow, and research using ML for social and health research questions remains fragmented. This may be due to the separate development of research in the computational data versus social and health sciences as well as a lack of accessible overviews and adequate training in ML techniques for non data science researchers. This paper provides a meta mapping of research questions in the social and health sciences to appropriate ML approaches, by incorporating the necessary requirements to statistical analysis in these disciplines. We map the established classification into description, prediction, and causal inference to common research goals, such as estimating prevalence of adverse health or social outcomes, predicting the risk of an event, and identifying risk factors or causes of adverse outcomes. This meta mapping aims at overcoming disciplinary barriers and starting a fluid dialogue between researchers from the social and health sciences and methodologically trained researchers. Such mapping may also help to fully exploit the benefits of ML while considering domain specific aspects relevant to the social and health sciences, and hopefully contribute to the acceleration of the uptake of ML applications to advance both basic and applied social and health sciences research.


Risk averse non stationary multi armed bandits. This paper tackles the risk averse multi armed bandits problem when incurred losses are non stationary. The conditional value at risk (CVaR) is used as the objective function. Two estimation methods are proposed for this objective function in the presence of non stationary losses, one relying on a weighted empirical distribution of losses and another on the dual representation of the CVaR. Such estimates can then be embedded into classic arm selection methods such as epsilon greedy policies. Simulation experiments assess the performance of the arm selection algorithms based on the two novel estimation approaches, and such policies are shown to outperform naive benchmarks not taking non stationarity into account.


Irregular Mapped Protograph LDPC Coded Modulation A Bandwidth Efficient Solution for 5 G Networks with Massive Data Storage Requirement. The huge amount of data produced in the fifth generation (5G) networks not only brings new challenges to the reliability and efficiency of mobile devices but also drives rapid development of new storage techniques. With the benefits of fast access speed and high reliability, NAND flash memory has become a promising storage solution for the 5G networks. In this paper, we investigate a protograph coded bit interleaved coded modulation with iterative detection and decoding (BICM ID) utilizing irregular mapping (IM) in the multi level cell (MLC) NAND flash memory systems. First, we propose an enhanced protograph based extrinsic information transfer (EPEXIT) algorithm to facilitate the analysis of protograph codes in the IM BICM ID systems. With the use of EPEXIT algorithm, a simple design method is conceived for the construction of a family of high rate protograph codes, called irregular mapped accumulate repeat accumulate (IMARA) codes, which possess both excellent decoding thresholds and linear minimum distance growth property. Furthermore, motivated by the voltage region iterative gain characteristics of IM BICM ID systems, a novel read voltage optimization scheme is developed to acquire accurate read voltage levels, thus minimizing the decoding thresholds of protograph codes. Theoretical analyses and error rate simulations indicate that the proposed IMARA aided IM BICM ID scheme and the proposed read voltage optimization scheme remarkably improve the convergence and decoding performance of flash memory systems. Thus, the proposed protograph coded IM BICM ID flash memory systems can be viewed as a reliable and efficient storage solution for the new generation mobile networks with massive data storage requirement.


Action of prime ideals on generalized derivations I. In the present paper, we investigate the commutativity of quotient ring R P where R is any ring and P is a prime ideal of R which admits generalized derivations are satisfying some algebraic identities acting on prime ideals P .


Beyond Equi joins Ranking, Enumeration and Factorization. We study theta joins in general and join predicates with conjunctions and disjunctions of inequalities in particular, focusing on ranked enumeration where the answers are returned incrementally in an order dictated by a given ranking function. Our approach achieves strong time and space complexity properties with n denoting the number of tuples in the database, we guarantee for acyclic full join queries with inequality conditions that for every value of k , the k top ranked answers are returned in mathcal O (n operatorname polylog n k log k) time. This is within a polylogarithmic factor of mathcal O (n k log k) , i.e., the best known complexity for equi joins, and even of mathcal O (n k) , i.e., the time it takes to look at the input and return k answers in any order. Our guarantees extend to join queries with selections and many types of projections (namely those called "free connex" queries and those that use bag semantics). Remarkably, they hold even when the number of join results is n ell for a join of ell relations. The key ingredient is a novel mathcal O (n operatorname polylog n) size factorized representation of the query output, which is constructed on the fly for a given query and database. In addition to providing the first non trivial theoretical guarantees beyond equi joins, we show in an experimental study that our ranked enumeration approach is also memory efficient and fast in practice, beating the running time of state of the art database systems by orders of magnitude.


Scaling Up Hardware Accelerator Verification using A QED with Functional Decomposition. Hardware accelerators (HAs) are essential building blocks for fast and energy efficient computing systems. Accelerator Quick Error Detection (A QED) is a recent formal technique which uses Bounded Model Checking for pre silicon verification of HAs. A QED checks an HA for self consistency, i.e., whether identical inputs within a sequence of operations always produce the same output. Under modest assumptions, A QED is both sound and complete. However, as is well known, large design sizes significantly limit the scalability of formal verification, including A QED. We overcome this scalability challenge through a new decomposition technique for A QED, called A QED with Decomposition (A QED 2 ). A QED 2 systematically decomposes an HA into smaller, functional sub modules, called sub accelerators, which are then verified independently using A QED. We prove completeness of A QED 2 in particular, if the full HA under verification contains a bug, then A QED 2 ensures detection of that bug during A QED verification of the corresponding sub accelerators. Results on over 100 (buggy) versions of a wide variety of HAs with millions of logic gates demonstrate the effectiveness and practicality of A QED 2 .


Prediction of Intermittent Fluctuations from Surface Pressure Measurements on a Turbulent Airfoil. This work studies the effectiveness of several machine learning techniques for predicting extreme events occurring in the flow around an airfoil at low Reynolds. For certain Reynolds numbers the aerodynamic forces exhibit intermittent fluctuations caused by changes in the behavior of vortices in the airfoil wake. Such events are prototypical of the unsteady behavior observed in airfoils at low Reynolds and their prediction is extremely challenging due to their intermittency and the chaotic nature of the flow. We seek to forecast these fluctuations in advance of their occurrence by a specified length of time. We assume knowledge only of the pressure at a discrete set of points on the surface of the airfoil, as well as offline knowledge of the state of the flow. Methods include direct prediction from historical pressure measurements, flow reconstruction followed by forward integration using a full order solver, and data driven dynamic models in various low dimensional quantities. Methods are compared using several criteria tailored for extreme event prediction. We show that methods using data driven models of low order dynamic variables outperform those without dynamic models and that unlike previous works, low dimensional initializations do not accurately predict observables with extreme events such as drag.


n ideal and n weak amenability of Frechet algebras. In this paper, we introduce and study some notations of amenability such as n ideal amenability and n weak amenability for Frechet algebra and we examine how these concepts in Banach algebra can be generalized and defined for Frechet algebra. We will also examine some inherited properties of n ideal and n weak amenable Frechet algebra and determine the relations between m and n weak amenability and m and n ideal amenability for Frechet algebra. Also, the relation of these new concepts of amenability of a Frechet algebra and its unitization is investigated.


Cycle4Completion Unpaired Point Cloud Completion using Cycle Transformation with Missing Region Coding. In this paper, we present a novel unpaired point cloud completion network, named Cycle4Completion, to infer the complete geometries from a partial 3D object. Previous unpaired completion methods merely focus on the learning of geometric correspondence from incomplete shapes to complete shapes, and ignore the learning in the reverse direction, which makes them suffer from low completion accuracy due to the limited 3D shape understanding ability. To address this problem, we propose two simultaneous cycle transformations between the latent spaces of complete shapes and incomplete ones. The insight of cycle transformation is to promote networks to understand 3D shapes by learning to generate complete or incomplete shapes from their complementary ones. Specifically, the first cycle transforms shapes from incomplete domain to complete domain, and then projects them back to the incomplete domain. This process learns the geometric characteristic of complete shapes, and maintains the shape consistency between the complete prediction and the incomplete input. Similarly, the inverse cycle transformation starts from complete domain to incomplete domain, and goes back to complete domain to learn the characteristic of incomplete shapes. We provide a comprehensive evaluation in experiments, which shows that our model with the learned bidirectional geometry correspondence outperforms state of the art unpaired completion methods.


Active Learning for Deep Visual Tracking. Convolutional neural networks (CNNs) have been successfully applied to the single target tracking task in recent years. Generally, training a deep CNN model requires numerous labeled training samples, and the number and quality of these samples directly affect the representational capability of the trained model. However, this approach is restrictive in practice, because manually labeling such a large number of training samples is time consuming and prohibitively expensive. In this paper, we propose an active learning method for deep visual tracking, which selects and annotates the unlabeled samples to train the deep CNNs model. Under the guidance of active learning, the tracker based on the trained deep CNNs model can achieve competitive tracking performance while reducing the labeling cost. More specifically, to ensure the diversity of selected samples, we propose an active learning method based on multi frame collaboration to select those training samples that should be and need to be annotated. Meanwhile, considering the representativeness of these selected samples, we adopt a nearest neighbor discrimination method based on the average nearest neighbor distance to screen isolated samples and low quality samples. Therefore, the training samples subset selected based on our method requires only a given budget to maintain the diversity and representativeness of the entire sample set. Furthermore, we adopt a Tversky loss to improve the bounding box estimation of our tracker, which can ensure that the tracker achieves more accurate target states. Extensive experimental results confirm that our active learning based tracker (ALT) achieves competitive tracking accuracy and speed compared with state of the art trackers on the seven most challenging evaluation benchmarks.


Constructing Stronger and Faster Baselines for Skeleton based Action Recognition. One essential problem in skeleton based action recognition is how to extract discriminative features over all skeleton joints. However, the complexity of the recent State Of The Art (SOTA) models for this task tends to be exceedingly sophisticated and over parameterized. The low efficiency in model training and inference has increased the validation costs of model architectures in large scale datasets. To address the above issue, recent advanced separable convolutional layers are embedded into an early fused Multiple Input Branches (MIB) network, constructing an efficient Graph Convolutional Network (GCN) baseline for skeleton based action recognition. In addition, based on such the baseline, we design a compound scaling strategy to expand the model's width and depth synchronously, and eventually obtain a family of efficient GCN baselines with high accuracies and small amounts of trainable parameters, termed EfficientGCN Bx, where "x" denotes the scaling coefficient. On two large scale datasets, i.e., NTU RGB D 60 and 120, the proposed EfficientGCN B4 baseline outperforms other SOTA methods, e.g., achieving 91.7 accuracy on the cross subject benchmark of NTU 60 dataset, while being 3.15x smaller and 3.21x faster than MS G3D, which is one of the best SOTA methods. The source code in PyTorch version and the pretrained models are available at https github.com yfsong0709 EfficientGCNv1.


Stickelberger series and Main Conjecture for function fields. Let F be a global function field of characteristic p with ring of integers A and let Phi be a Hayes module on the Hilbert class field H(A) of F. We prove an Iwasawa Main Conjecture for the Z p infty extension F F generated by the mathfrak p power torsion of Phi ( mathfrak p a prime of A). The main tool is a Stickelberger series whose specialization provides a generator for the Fitting ideal of the class group of F. Moreover we prove that the same series, evaluated at complex or p adic characters, interpolates the Goss Zeta function or some p adic L function, thus providing the link between the algebraic structure (class groups) and the analytic functions, which is the crucial part of Iwasawa Main Conjecture.


Type4Py Practical Deep Similarity Learning Based Type Inference for Python. Dynamic languages, such as Python and Javascript, trade static typing for developer flexibility and productivity. Lack of static typing can cause run time exceptions and is a major factor for weak IDE support. To alleviate these issues, PEP 484 introduced optional type annotations for Python. As retrofitting types to existing codebases is error prone and laborious, machine learning (ML) based approaches have been proposed to enable automatic type inference based on existing, partially annotated codebases. However, previous ML based approaches are trained and evaluated on human provided type annotations, which might not always be sound, and hence this may limit the practicality for real world usage. In this paper, we present Type4Py, a deep similarity learning based hierarchical neural network model. It learns to discriminate between similar and dissimilar types in a high dimensional space, which results in clusters of types. Likely types for arguments, variables, and return values can then be inferred through the nearest neighbor search. Unlike previous work, we trained and evaluated our model on a type checked dataset and used mean reciprocal rank (MRR) to reflect the performance perceived by users. The obtained results show that Type4Py achieves an MRR of 77.1 , which is a substantial improvement of 8.1 and 16.7 over the state of the art approaches Typilus and TypeWriter, respectively. Finally, to aid developers with retrofitting types, we released a Visual Studio Code extension, which uses Type4Py to provide ML based type auto completion for Python.


Single Shot Multitask Pedestrian Detection and Behavior Prediction. Detecting and predicting the behavior of pedestrians is extremely crucial for self driving vehicles to plan and interact with them safely. Although there have been several research works in this area, it is important to have fast and memory efficient models such that it can operate in embedded hardware in these autonomous machines. In this work, we propose a novel architecture using spatial temporal multi tasking to do camera based pedestrian detection and intention prediction. Our approach significantly reduces the latency by being able to detect and predict all pedestrians' intention in a single shot manner while also being able to attain better accuracy by sharing features with relevant object level information and interactions.


Elucidating atmospheric brown carbon Supplanting chemical intuition with exhaustive enumeration and machine learning. To unravel the structures of C12H12O7 isomers, identified as light absorbing photooxidation products of syringol in atmospheric chamber experiments, we apply a graph based molecule generator and machine learning workflow. To accomplish this in a bias free manner, molecular graphs of the entire chemical subspace of C12H12O7 were generated, assuming that the isomers contain two C6 rings this led to 260 million molecular graphs and 120 million stable structures. Using quantum chemistry excitation energies and oscillator strengths as training data, we predicted these quantities using kernel ridge regression and simulated UV Vis absorption spectra. Then we determined the probability of the molecules to cause the experimental spectrum within the errors of the different methods. Molecules whose spectra were likely to match the experimental spectrum were clustered according to structural features, resulting in clusters of 500,000 molecules. While we identified several features that correlate with a high probability to cause the experimental spectrum, no clear composition of necessary features can be given. Thus, the absorption spectrum is not sufficient to uniquely identify one specific isomer structure. If more structural features were known from experimental data, the number of structures could be reduced to a few tens of thousands candidates. We offer a procedure to detect when sufficient fragmentation data has been included to reduce the number of possible molecules. The most efficient strategy to obtain valid candidates is obtained if structural data is applied already at the bias free molecule generation stage. The systematic enumeration, however, is necessary to avoid mis identification of molecules, while it guarantees that there are no other molecules that would also fit the spectrum in question.


3D Flow Field Measurements Outside Nanopores. We demonstrate a non stereoscopic, video based particle tracking system with optical tweezers to study fluid flow in 3D in the vicinity of glass nanopores. In particular, we used the Quadrant Interpolation algorithm to extend our video based particle tracking to displacements out of the trapping plane of the tweezers. This permitted the study of flow from nanopores oriented at an angle to the trapping plane, enabling the mounting of nanopores on a micromanipulator with which it was then possible to automate the mapping procedure. Mapping of voltage driven flow in 3D volumes outside nanopores revealed polarity dependent flow fields. This is in agreement with the model of voltage driven flow in conical nanopores depending on the interaction of distinct flows within the nanopore and along the outer walls.


Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction. Predicting human motion from historical pose sequence is crucial for a machine to succeed in intelligent interactions with humans. One aspect that has been obviated so far, is the fact that how we represent the skeletal pose has a critical impact on the prediction results. Yet there is no effort that investigates across different pose representation schemes. We conduct an indepth study on various pose representations with a focus on their effects on the motion prediction task. Moreover, recent approaches build upon off the shelf RNN units for motion prediction. These approaches process input pose sequence sequentially and inherently have difficulties in capturing long term dependencies. In this paper, we propose a novel RNN architecture termed AHMR (Attentive Hierarchical Motion Recurrent network) for motion prediction which simultaneously models local motion contexts and a global context. We further explore a geodesic loss and a forward kinematics loss for the motion prediction task, which have more geometric significance than the widely employed L2 loss. Interestingly, we applied our method to a range of articulate objects including human, fish, and mouse. Empirical results show that our approach outperforms the state of the art methods in short term prediction and achieves much enhanced long term prediction proficiency, such as retaining natural human like motions over 50 seconds predictions. Our codes are released.


Q abelian and mathbb Q Fano finite quotients of abelian varieties. We study finite quotients of abelian varieties (fqav for short) i.e. quotients of abelian varieties by finite groups. We show that Q abelian varieties (i.e. fqav's with mathbb Q linearly trivial canonical divisors) are characterized by the existence of quasi 'etale polarized (or int amplified) endomorphisms. We show that every fqav has a finite quasi 'etale cover by the product of an abelian variety and a mathbb Q Fano fqav. Using such coverings, we give a characterization of mathbb Q Fano fqav's, and show that mathbb Q Fano fqav's and Q abelian varieties are building blocks'' of general fqav's.


Compactness and Large Scale Regularity for Darcy's Law. This paper is concerned with the quantitative homogenization of the steady Stokes equations with the Dirichlet condition in a periodically perforated domain. Using a compactness method, we establish the large scale interior C 1, alpha and Lipschitz estimates for the velocity as well as the corresponding estimates for the pressure. These estimates, when combined with the classical regularity estimates for the Stokes equations, yield the uniform Lipschitz estimates. As a consequence, we also obtain the uniform W k, p estimates for 1 p infty .


Node2Seq Towards Trainable Convolutions in Graph Neural Networks. Investigating graph feature learning becomes essentially important with the emergence of graph data in many real world applications. Several graph neural network approaches are proposed for node feature learning and they generally follow a neighboring information aggregation scheme to learn node features. While great performance has been achieved, the weights learning for different neighboring nodes is still less explored. In this work, we propose a novel graph network layer, known as Node2Seq, to learn node embeddings with explicitly trainable weights for different neighboring nodes. For a target node, our method sorts its neighboring nodes via attention mechanism and then employs 1D convolutional neural networks (CNNs) to enable explicit weights for information aggregation. In addition, we propose to incorporate non local information for feature learning in an adaptive manner based on the attention scores. Experimental results demonstrate the effectiveness of our proposed Node2Seq layer and show that the proposed adaptively non local information learning can improve the performance of feature learning.


N2 H2 capacitively coupled radio frequency discharges at low pressure. Part II. Modelling results the relevance of plasma surface interaction. In this work, we present the results of simulations carried out for N2 H2 capacitively coupled radio frequency discharges, running at low pressure (0.3 0.9 mbar), low power (5 20 W), and for amounts of H2 up to 5 pct. Simulations are performed using a hybrid code that couples a two dimensional time dependent fluid module, describing the dynamics of the charged particles in the discharge, to a zero dimensional kinetic module, that solves the Boltzmann equation and describes the production and destruction of neutral species. The model accounts for the production of several vibrationally and electronic excited states, and contains a detailed surface chemistry that includes recombination processes and the production of NHx molecules. The results obtained highlight the relevance of the interactions between plasma and surface, given the role of the secondary electron emission in the electrical parameters of the discharge and the critical importance of the surface production of ammonia to the neutral and ionic chemistry of the discharge.


Risk utility tradeoff shapes memory strategies for evolving patterns. Keeping a memory of evolving stimuli is ubiquitous in biology, an example of which is immune memory for evolving pathogens. However, learning and memory storage for dynamic patterns still pose challenges in machine learning. Here, we introduce an analytical energy based framework to address this problem. By accounting for the tradeoff between utility in keeping a high affinity memory and the risk in forgetting some of the diverse stimuli, we show that a moderate tolerance for risk enables a repertoire to robustly classify evolving patterns, without much fine tuning. Our approach offers a general guideline for learning and memory storage in systems interacting with diverse and evolving stimuli.


Out of Distribution Detection for Dermoscopic Image Classification. Medical image diagnosis can be achieved by deep neural networks, provided there is enough varied training data for each disease class. However, a hitherto unknown disease class not encountered during training will inevitably be misclassified, even if predicted with low probability. This problem is especially important for medical image diagnosis, when an image of a hitherto unknown disease is presented for diagnosis, especially when the images come from the same image domain, such as dermoscopic skin images. Current out of distribution detection algorithms act unfairly when the in distribution classes are imbalanced, by favouring the most numerous disease in the training sets. This could lead to false diagnoses for rare cases which are often medically important. We developed a novel yet simple method to train neural networks, which enables them to classify in distribution dermoscopic skin disease images and also detect novel diseases from dermoscopic images at test time. We show that our BinaryHeads model not only does not hurt classification balanced accuracy when the data is imbalanced, but also consistently improves the balanced accuracy. We also introduce an important method to investigate the effectiveness of out of distribution detection methods based on presence of varying amounts of out of distribution data, which may arise in real world settings.


Selective Focusing Learning in Conditional GANs. Conditional generative adversarial networks (cGANs) have demonstrated remarkable success due to their class wise controllability and superior quality for complex generation tasks. Typical cGANs solve the joint distribution matching problem by decomposing two easier sub problems marginal matching and conditional matching. From our toy experiments, we found that it is the best to apply only conditional matching to certain samples due to the content aware optimization of the discriminator. This paper proposes a simple (a few lines of code) but effective training methodology, selective focusing learning, which enforces the discriminator and generator to learn easy samples of each class rapidly while maintaining diversity. Our key idea is to selectively apply conditional and joint matching for the data in each mini batch. We conducted experiments on recent cGAN variants in ImageNet (64x64 and 128x128), CIFAR 10, and CIFAR 100 datasets, and improved the performance significantly (up to 35.18 in terms of FID) without sacrificing diversity.


Using Blockchain to Achieve Decentralized Privacy In IoT Healthcare. With the advent of the Internet of Things (IoT), e health has become one of the main topics of research. Due to the sensitivity of patient information, patient privacy seems challenging. Nowadays, patient data is usually stored in the cloud in healthcare programs, making it difficult for users to have enough control over their data. The recent increment in announced cases of security and surveillance breaches compromising patients' privacy call into question the conventional model, in which third parties gather and control immense amounts of patients' Healthcare data. In this work, we try to resolve the issues mentioned above by using blockchain technology. We propose a blockchain based protocol suitable for e health applications that does not require trust in a third party and provides an efficient privacy preserving access control mechanism. Transactions in our proposed system, unlike Bitcoin, are not entirely financial, and we do not use conventional methods for consensus operations in blockchain like Proof of Work (PoW). It is not suitable for IoT applications because IoT devices have resources constraints. Usage of appropriate consensus method helps us to increase network security and efficiency, as well as reducing network cost, i.e., bandwidth and processor usage. Finally, we provide security and privacy analysis of our proposed protocol.


The number of n queens configurations. The n queens problem is to determine mathcal Q (n) , the number of ways to place n mutually non threatening queens on an n times n board. We show that there exists a constant alpha 1.942 pm 3 times 10 3 such that mathcal Q (n) ((1 pm o(1))ne alpha ) n . The constant alpha is characterized as the solution to a convex optimization problem in mathcal P ( 1 2,1 2 2) , the space of Borel probability measures on the square. The chief innovation is the introduction of limit objects for n queens configurations, which we call "queenons". These are a convex set in mathcal P ( 1 2,1 2 2) . We define an entropy function that counts the number of n queens configurations that approximate a given queenon. The upper bound uses the entropy method. For the lower bound we describe a randomized algorithm that constructs a configuration near a prespecified queenon and whose entropy matches that found in the upper bound. The enumeration of n queens configurations is then obtained by maximizing the (concave) entropy function in the space of queenons. Along the way we prove a large deviations principle for n queens configurations that can be used to study their typical structure.


Est ce que vous compute? Code switching, cultural identity, and AI. Cultural code switching concerns how we adjust our overall behaviours, manners of speaking, and appearance in response to a perceived change in our social environment. We defend the need to investigate cultural code switching capacities in artificial intelligence systems. We explore a series of ethical and epistemic issues that arise when bringing cultural code switching to bear on artificial intelligence. Building upon Dotson's (2014) analysis of testimonial smothering, we discuss how emerging technologies in AI can give rise to epistemic oppression, and specifically, a form of self silencing that we call 'cultural smothering'. By leaving the socio dynamic features of cultural code switching unaddressed, AI systems risk negatively impacting already marginalised social groups by widening opportunity gaps and further entrenching social inequalities.


High fidelity reconstruction of turbulent flow from spatially limited data using enhanced super resolution generative adversarial network. In this study, a deep learning based approach is applied with the aim of reconstructing high resolution turbulent flow fields using minimal flow fields data. A multi scale enhanced super resolution generative adversarial network with a physics based loss function is introduced as a model to reconstruct the high resolution flow fields. The model capability to reconstruct high resolution laminar flows is examined using data of laminar flow around a square cylinder. The results reveal that the model can accurately reproduce the high resolution flow fields even when limited spatial information is provided. The case of turbulent channel flow is used to assess the ability of the model to reconstruct the high resolution wall bounded turbulent flow fields. The instantaneous and statistical results obtained from the model agree well with the ground truth data, indicating that the model can successfully learn to map the coarse flow fields to the high resolution once. Furthermore, the computational cost of the proposed model, which is examined carefully, is found to be effectively low. This demonstrates that using high fidelity training data with physics guided generative adversarial network based models can be practically efficient in reconstructing high resolution turbulent flow fields from extremely coarse data.


Traveling water waves the ebb and flow of two centuries. This survey covers the mathematical theory of steady water waves with an emphasis on topics that are at the forefront of current research. These areas include variational characterizations of traveling water waves analytical and numerical studies of periodic waves with critical layers that may overhang existence, nonexistence, and qualitative theory of solitary waves and fronts traveling waves with localized vorticity or density stratification and waves in three dimensions.


On asymptotic joint distributions of cherries and pitchforks for random phylogenetic trees. Tree shape statistics provide valuable quantitative insights into evolutionary mechanisms underpinning phylogenetic trees, a commonly used graph representation of evolution systems ranging from viruses to species. By developing limit theorems for a version of extended P 'olya urn models in which negative entries are permitted for their replacement matrices, we present strong laws of large numbers and central limit theorems for asymptotic joint distributions of two subtree counting statistics, the number of cherries and that of pitchforks, for random phylogenetic trees generated by two widely used null tree models the proportional to distinguishable arrangements (PDA) and the Yule Harding Kingman (YHK) models. Our results indicate that the limiting behaviour of these two statistics, when appropriately scaled, are independent of the initial trees used in the tree generating process.


Self Sovereign Identity A Systematic Map and Review. Self Sovereign Identity is a user centric identity model. In this model, the user maintains and controls their data. When requested by a service provider, user data is sent directly by the user, without the intermediation of third parties. Thus, in Self Sovereign Identity, the participation of known identity providers for proof of identity is reduced, which increases user privacy. This identity model has attracted the attention of researchers and organizations around the world. All this interest increased the number of scientific articles published on the subject. The analysis of published materials showed that ideas and proposals are very diverse and dispersed. Although there are few systematic reviews, they lack methodological rigor and are limited to a small subset of published works. This study presents a rigorous systematic mapping and systematic literature review covering theoretical and practical advances in Self Sovereign Identity. We identified and aggregated evidence from publications to answer four research questions, resulting in a classification scheme used to categorize and review publications. Open challenges are also discussed, providing recommendations for future work.


A Comparison of CPU and GPU implementations for the LHCb Experiment Run 3 Trigger. The LHCb experiment at CERN is undergoing an upgrade in preparation for the Run 3 data taking period of the LHC. As part of this upgrade the trigger is moving to a fully software implementation operating at the LHC bunch crossing rate. We present an evaluation of a CPU based and a GPU based implementation of the first stage of the High Level Trigger. After a detailed comparison both options are found to be viable. This document summarizes the performance and implementation details of these options, the outcome of which has led to the choice of the GPU based implementation as the baseline.