Multi Camera Sensor Fusion for Visual Odometry using Deep Uncertainty Estimation. Visual Odometry (VO) estimation is an important source of information for vehicle state estimation and autonomous driving. Recently, deep learning based approaches have begun to appear in the literature. However, in the context of driving, single sensor based approaches are often prone to failure because of degraded image quality due to environmental factors, camera placement, etc. To address this issue, we propose a deep sensor fusion framework which estimates vehicle motion using both pose and uncertainty estimations from multiple on board cameras. We extract spatio temporal feature representations from a set of consecutive images using a hybrid CNN RNN model. We then utilise a Mixture Density Network (MDN) to estimate the 6 DoF pose as a mixture of distributions and a fusion module to estimate the final pose using MDN outputs from multi cameras. We evaluate our approach on the publicly available, large scale autonomous vehicle dataset, nuScenes. The results show that the proposed fusion approach surpasses the state of the art, and provides robust estimates and accurate trajectories compared to individual camera based estimations.


Existence results on Lagrange multiplier approach for gradient flows and application to optimization. This paper deals with the geometric numerical integration of gradient flow and its application to optimization. Gradient flows often appear as model equations of various physical phenomena, and their dissipation laws are essential. Therefore, dissipative numerical methods, which are numerical methods replicating the dissipation law, have been studied in the literature. Recently, Cheng, Lin, and Shen proposed a novel dissipative method, the Lagrange multiplier approach, for gradient flows, which is computationally cheaper than existing dissipative methods. Although their efficacy is numerically confirmed in existing studies, the existence results of the Lagrange multiplier approach are not known in the literature. In this paper, we establish some existence results. We prove the existence of the solution under a relatively mild assumption. In addition, by restricting ourselves to a special case, we show some existence and uniqueness results with concrete bounds. As gradient flows also appear in optimization, we further apply the latter results to optimization problems.


Precise Approximation of Convolutional Neural Networks for Homomorphically Encrypted Data. Homomorphic encryption is one of the representative solutions to privacy preserving machine learning (PPML) classification enabling the server to classify private data of clients while guaranteeing privacy. This work focuses on PPML using word wise fully homomorphic encryption (FHE). In order to implement deep learning on word wise homomorphic encryption (HE), the ReLU and max pooling functions should be approximated by some polynomials for homomorphic operations. Most of the previous studies focus on HE friendly networks, where the ReLU and max pooling functions are approximated using low degree polynomials. However, for the classification of the CIFAR 10 dataset, using a low degree polynomial requires designing a new deep learning model and training. In addition, this approximation by low degree polynomials cannot support deeper neural networks due to large approximation errors. Thus, we propose a precise polynomial approximation technique for the ReLU and max pooling functions. Precise approximation using a single polynomial requires an exponentially high degree polynomial, which results in a significant number of non scalar multiplications. Thus, we propose a method to approximate the ReLU and max pooling functions accurately using a composition of minimax approximate polynomials of small degrees. If we replace the ReLU and max pooling functions with the proposed approximate polynomials, well studied deep learning models such as ResNet and VGGNet can still be used without further modification for PPML on FHE. Even pre trained parameters can be used without retraining. We approximate the ReLU and max pooling functions in the ResNet 152 using the composition of minimax approximate polynomials of degrees 15, 27, and 29. Then, we succeed in classifying the plaintext ImageNet dataset with 77.52 accuracy, which is very close to the original model accuracy of 78.31 .


D2S Document to Slide Generation Via Query Based Text Summarization. Presentations are critical for communication in all areas of our lives, yet the creation of slide decks is often tedious and time consuming. There has been limited research aiming to automate the document to slides generation process and all face a critical challenge no publicly available dataset for training and benchmarking. In this work, we first contribute a new dataset, SciDuet, consisting of pairs of papers and their corresponding slides decks from recent years' NLP and ML conferences (e.g., ACL). Secondly, we present D2S, a novel system that tackles the document to slides task with a two step approach 1) Use slide titles to retrieve relevant and engaging text, figures, and tables 2) Summarize the retrieved context into bullet points with long form question answering. Our evaluation suggests that long form QA outperforms state of the art summarization baselines on both automated ROUGE metrics and qualitative human evaluation.


Bridging the Gap Between Object Detection and User Intent via Query Modulation. When interacting with objects through cameras, or pictures, users often have a specific intent. For example, they may want to perform a visual search. However, most object detection models ignore the user intent, relying on image pixels as their only input. This often leads to incorrect results, such as lack of a high confidence detection on the object of interest, or detection with a wrong class label. In this paper we investigate techniques to modulate standard object detectors to explicitly account for the user intent, expressed as an embedding of a simple query. Compared to standard object detectors, query modulated detectors show superior performance at detecting objects for a given label of interest. Thanks to large scale training data synthesized from standard object detection annotations, query modulated detectors can also outperform specialized referring expression recognition systems. Furthermore, they can be simultaneously trained to solve for both query modulated detection and standard object detection.


Securing Full Duplex Amplify and Forward Relay Aided Transmissions Through Processing Time Optimization. We investigate physical layer security of the full duplex (FD) amplify and forward (AF) relay channel. We provide a new perspective on the problem and show that the processing time (delay) at the relay can be exploited to improve the system's security. We show that the FD AF relay channel can be seen as an intersymbol interference (ISI) channel, hence, the discrete Fourier transform (DFT) can be used for data modulation and demodulation to convert the frequency selective channel into flat fading channel per sub channel sub carrier. By exploiting the fact that the channel memory needs to be cleared by inserting the cyclic prefix, Alice injects an artificial noise (AN) signal that hurts the eavesdropping nodes only. The strength of this AN signal and its interference rank are controlled by the relay's processing time.


Dynamic resource allocation for efficient parallel CFD simulations. CFD users of supercomputers usually resort to rule of thumb methods to select the number of subdomains (partitions) when relying on MPI based parallelization. One common approach is to set a minimum number of elements or cells per subdomain, under which the parallel efficiency of the code is "known" to fall below a subjective level, say 80 . The situation is even worse when the user is not aware of the "good" practices for the given code and a huge amount of resources can thus be wasted. This work presents an elastic computing methodology to adapt at runtime the resources allocated to a simulation automatically. The criterion to control the required resources is based on a runtime measure of the communication efficiency of the execution. According to some analytical estimates, the resources are then expanded or reduced to fulfil this criterion and eventually execute an efficient simulation.


On the Bounded Negativity Conjecture and singular plane curves. There are no known failures of Bounded Negativity in characteristic 0. In the light of recent work showing the Bounded Negativity Conjecture fails in positive characteristics for rational surfaces, we propose new characteristic free conjectures as a replacement. We also develop bounds on numerical characteristics of curves constraining their negativity. For example, we show that the H constant of a rational curve C with at most 9 singular points satisfies H(C) 2 regardless of the characteristic.


Estimation of electric field impact in deep brain stimulation from axon diameter distribution in the human brain. Background Finite element method (FEM) simulations of the electric field magnitude (EF) are commonly used to estimate the affected tissue surrounding the active contact of deep brain stimulation (DBS) leads. Previous studies have found that DBS starts to noticeably activate axons at approximately 0.2 V mm, corresponding to activation of 3.4 mu m axons in simulations of individual axon triggering. Most axons in the brain are considerably smaller however, and the effect of the electric field is thus expected to be stronger with increasing EF as more and more axons become activated. Objective To estimate the fraction of activated axons as a function of electric field magnitude. Methods The EF thresholds required for axon stimulation of myelinated axon diameters between 1 and 5 mu m were obtained from a combined cable and Hodgkin Huxley model in a FEM simulated electric field from a Medtronic 3389 lead. These thresholds were compared with the average axon diameter distribution from literature from several structures in the human brain to obtain an estimate of the fraction of axons activated at EF levels between 0.1 and 1.8 V mm. Results The effect of DBS is estimated to be 41 cdot EF 7.4 starting at a threshold level EFt0 0.18 V mm. Conclusion The fraction of activated axons from DBS in a voxel is estimated to increase linearly with EF above the threshold level of 0.18 V mm. This means linear regression between EF above 0.18 V mm and clinical outcome is a suitable statistical method when doing improvement maps for DBS.


On the Convergence of Orthogonal Vector AMP Long Memory Message Passing Strategy. Orthogonal vector approximate message passing (AMP) is a powerful message passing (MP) algorithm for signal reconstruction in compressed sensing. This paper proves the convergence of Bayes optimal orthogonal vector AMP in the large system limit. The proof strategy is based on a novel long memory (LM) MP approach A first step is a construction of LM MP that is guaranteed to converge systematically. A second step is a large system analysis of LM MP via an existing framework of state evolution. A third step is to prove the convergence of state evolution recursions for Bayes optimal LM MP via a new statistical interpretation of existing LM damping. The last is an exact reduction of the state evolution recursions for Bayes optimal LM MP to those for Bayes optimal orthogonal vector AMP. The convergence of the state evolution recursions for Bayes optimal LM MP implies that for Bayes optimal orthogonal vector AMP. Numerical simulations are presented to show the verification of state evolution results for damped orthogonal vector AMP and a negative aspect of LM MP in finite sized systems.


FedChain Chained Algorithms for Near Optimal Communication Cost in Federated Learning. Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local data before communicating with the server (e.g., FedAvg). Local methods can exploit similarity between clients' data. However, in existing analyses, this comes at the cost of slow convergence in terms of the dependence on the number of communication rounds R. On the other hand, global methods, where clients simply return a gradient vector in each round (e.g., SGD), converge faster in terms of R but fail to exploit the similarity between clients even when clients are homogeneous. We propose FedChain, an algorithmic framework that combines the strengths of local methods and global methods to achieve fast convergence in terms of R while leveraging the similarity between clients. Using FedChain, we instantiate algorithms that improve upon previously known rates in the general convex and PL settings, and are near optimal (via an algorithm independent lower bound that we show) for problems that satisfy strong convexity. Empirical results support this theoretical gain over existing methods.


On the Stability Region of Intermittent Interference Networks. Recent information theoretic studies have resulted in several interference management (IM) techniques that promise significant capacity improvements over interference avoidance techniques. However, in practice, the stable throughput region is a more relevant metric compared to the capacity region. In this work, we focus on the stable throughput region of a two pair intermittent interference network with distributed transmitters and propose a queue based transmission protocol in different regimes to handle the data between queues. In this context, we translate physical layer IM protocols to accommodate stochastic message arrivals. To evaluate our proposed techniques, we compare the stable throughput region to the capacity region and show, through simulations, that the stable throughput region matches the capacity region when the latter is known. We show that in order to achieve the optimal stable throughput region, new ingredients are needed when compared to prior results. We quantify the trade off between the encoding decoding complexity of the proposed scheme (in terms of number of required algebraic operations), and the achievable rates. Finally, we study the lifetime of messages (i.e. the duration from arrival to successful delivery) vis a vis the total communication time, and we observe that the average lifetime scales as the square root of the total communication time.


Global well posedness for a system of quasilinear wave equations on a product space. We consider a system of quasilinear wave equations on the product space mathbb R 1 3 times mathbb S 1 , which we want to see as a toy model for Einstein equations with additional compact dimensions. We show global existence for small and regular initial data with polynomial decay at infinity. The method combines energy estimates on hyperboloids inside the light cone and weighted energy estimates outside the light cone.


Comparative Analysis of Impact of Cryptography Algorithms on Wireless Sensor Networks. Cryptography techniques are essential for a robust and stable security design of a system to mitigate the risk of external attacks and thus improve its efficiency. Wireless Sensor Networks (WSNs) play a pivotal role in sensing, monitoring, processing, and accumulating raw data to enhance the performance of the actuators, micro controllers, embedded architectures, IoT devices, and computing machines to which they are connected. With so much threat of potential adversaries, it is essential to scale up the security level of WSN without affecting its primary goal of seamless data collection and communication with relay devices. This paper intends to explore the past and ongoing research activities in this domain. An extensive study of these algorithms referred here, are studied and analyzed. Based on these findings this paper will illustrate the best possible cryptography algorithms which will be most suited to implement the security aspects of the WSN and protect it from any threat and reduce its vulnerabilities. This study will pave the way for future research on this topic since it will provide a comprehensive and holistic view of the subject.


Minimal Envy Matchings in the Hospitals Residents Problem with Lower Quotas. In the Hospitals Residents problem, every hospital has an upper quota that limits the number of residents assigned to it. While, in some applications, each hospital also has a lower quota for the number of residents it receives. In this setting, a stable matching may not exist. Envy freeness is introduced as a relaxation of stability that allows blocking pairs involving a resident and an empty position of a hospital. While, envy free matching might not exist either when lower quotas are introduced. We consider the problem of finding a feasible matching that satisfies lower quotas and upper quotas and minimizes envy in terms of envy pairs and envy residents in the Hospitals Resident problem with Lower Quota. We show that the problem is NP hard with both envy measurement. We also give a simple exponential time algorithm for the Minimum Envy Pair HRLQ problem.


Twin width IV ordered graphs and matrices. We establish a list of characterizations of bounded twin width for hereditary, totally ordered binary structures. This has several consequences. First, it allows us to show that a (hereditary) class of matrices over a finite alphabet either contains at least n! matrices of size n times n , or at most c n for some constant c . This generalizes the celebrated Stanley Wilf conjecture Marcus Tardos theorem from permutation classes to any matrix class over a finite alphabet, answers our small conjecture SODA '21 in the case of ordered graphs, and with more work, settles a question first asked by Balogh, Bollob 'as, and Morris Eur. J. Comb. '06 on the growth of hereditary classes of ordered graphs. Second, it gives a fixed parameter approximation algorithm for twin width on ordered graphs. Third, it yields a full classification of fixed parameter tractable first order model checking on hereditary classes of ordered binary structures. Fourth, it provides a model theoretic characterization of classes with bounded twin width.


MUNet Motion Uncertainty aware Semi supervised Video Object Segmentation. The task of semi supervised video object segmentation (VOS) has been greatly advanced and state of the art performance has been made by dense matching based methods. The recent methods leverage space time memory (STM) networks and learn to retrieve relevant information from all available sources, where the past frames with object masks form an external memory and the current frame as the query is segmented using the mask information in the memory. However, when forming the memory and performing matching, these methods only exploit the appearance information while ignoring the motion information. In this paper, we advocate the return of the emph motion information and propose a motion uncertainty aware framework (MUNet) for semi supervised VOS. First, we propose an implicit method to learn the spatial correspondences between neighboring frames, building upon a correlation cost volume. To handle the challenging cases of occlusion and textureless regions during constructing dense correspondences, we incorporate the uncertainty in dense matching and achieve motion uncertainty aware feature representation. Second, we introduce a motion aware spatial attention module to effectively fuse the motion feature with the semantic feature. Comprehensive experiments on challenging benchmarks show that textbf textit using a small amount of data and combining it with powerful motion information can bring a significant performance boost . We achieve 76.5 mathcal J mathcal F only using DAVIS17 for training, which significantly outperforms the textit SOTA methods under the low data protocol. textit The code will be released.


MetaCorrection Domain aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentation. Unsupervised domain adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain. Existing self training based UDA approaches assign pseudo labels for target data and treat them as ground truth labels to fully leverage unlabeled target data for model adaptation. However, the generated pseudo labels from the model optimized on the source domain inevitably contain noise due to the domain gap. To tackle this issue, we advance a MetaCorrection framework, where a Domain aware Meta learning strategy is devised to benefit Loss Correction (DMLC) for UDA semantic segmentation. In particular, we model the noise distribution of pseudo labels in target domain by introducing a noise transition matrix (NTM) and construct meta data set with domain invariant source data to guide the estimation of NTM. Through the risk minimization on the meta data set, the optimized NTM thus can correct the noisy issues in pseudo labels and enhance the generalization ability of the model on the target data. Considering the capacity gap between shallow and deep features, we further employ the proposed DMLC strategy to provide matched and compatible supervision signals for different level features, thereby ensuring deep adaptation. Extensive experimental results highlight the effectiveness of our method against existing state of the art methods on three benchmarks.


Generating Diverse 3D Reconstructions from a Single Occluded Face Image. Occlusions are a common occurrence in unconstrained face images. Single image 3D reconstruction from such face images often suffers from corruption due to the presence of occlusions. Furthermore, while a plurality of 3D reconstructions is plausible in the occluded regions, existing approaches are limited to generating only a single solution. To address both of these challenges, we present Diverse3DFace, which is specifically designed to simultaneously generate a diverse and realistic set of 3D reconstructions from a single occluded face image. It consists of three components a global local shape fitting process, a graph neural network based mesh VAE, and a Determinantal Point Process based diversity promoting iterative optimization procedure. Quantitative and qualitative comparisons of 3D reconstruction on occluded faces show that Diverse3DFace can estimate 3D shapes that are consistent with the visible regions in the target image while exhibiting high, yet realistic, levels of diversity on the occluded regions. On face images occluded by masks, glasses, and other random objects, Diverse3DFace generates a distribution of 3D shapes having 50 higher diversity on the occluded regions compared to the baselines. Moreover, our closest sample to the ground truth has 40 lower MSE than the singular reconstructions by existing approaches.


Certifiable Outlier Robust Geometric Perception Exact Semidefinite Relaxations and Scalable Global Optimization. We propose the first general and scalable framework to design certifiable algorithms for robust geometric perception in the presence of outliers. Our first contribution is to show that estimation using common robust costs, such as truncated least squares (TLS), maximum consensus, Geman McClure, Tukey's biweight, among others, can be reformulated as polynomial optimization problems (POPs). By focusing on the TLS cost, our second contribution is to exploit sparsity in the POP and propose a sparse semidefinite programming (SDP) relaxation that is much smaller than the standard Lasserre's hierarchy while preserving exactness, i.e., the SDP recovers the optimizer of the nonconvex POP with an optimality certificate. Our third contribution is to solve the SDP relaxations at an unprecedented scale and accuracy by presenting STRIDE, a solver that blends global descent on the convex SDP with fast local search on the nonconvex POP. Our fourth contribution is an evaluation of the proposed framework on six geometric perception problems including single and multiple rotation averaging, point cloud and mesh registration, absolute pose estimation, and category level object pose and shape estimation. Our experiments demonstrate that (i) our sparse SDP relaxation is exact with up to 60 90 outliers across applications (ii) while still being far from real time, STRIDE is up to 100 times faster than existing SDP solvers on medium scale problems, and is the only solver that can solve large scale SDPs with hundreds of thousands of constraints to high accuracy (iii) STRIDE provides a safeguard to existing fast heuristics for robust estimation (e.g., RANSAC or Graduated Non Convexity), i.e., it certifies global optimality if the heuristic estimates are optimal, or detects and allows escaping local optima when the heuristic estimates are suboptimal.


Wilson lines in the Abelian lattice Higgs model. Lattice gauge theories are lattice approximations of the Yang Mills theory in physics. The abelian lattice Higgs model is one of the simplest examples of a lattice gauge theory interacting with an external field. In a previous paper cite flv2021 , we calculated the leading order term of the expected value of Wilson loop observables in the low temperature regime of the abelian lattice Higgs model on mathbb Z 4 , with structure group G mathbb Z n for some n geq 2. In the absence of a Higgs field, these are important observables since they exhibit a phase transition which can be interpreted as distinguishing between regions with and without quark confinement. However, in the presence of a Higgs field, this is no longer the case, and a more relevant family of observables are so called open Wilson lines. In this paper, we extend and refine the ideas introduced in cite flv2021 to calculate the leading order term of the expected value of the more general Wilson line observables. Using our main result, we then calculate the leading order term of several natural ratios of expected values and confirm the behavior predicted by physicists.


Differentiable Drawing and Sketching. We present a bottom up differentiable relaxation of the process of drawing points, lines and curves into a pixel raster. Our approach arises from the observation that rasterising a pixel in an image given parameters of a primitive can be reformulated in terms of the primitive's distance transform, and then relaxed to allow the primitive's parameters to be learned. This relaxation allows end to end differentiable programs and deep networks to be learned and optimised and provides several building blocks that allow control over how a compositional drawing process is modelled. We emphasise the bottom up nature of our proposed approach, which allows for drawing operations to be composed in ways that can mimic the physical reality of drawing rather than being tied to, for example, approaches in modern computer graphics. With the proposed approach we demonstrate how sketches can be generated by directly optimising against photographs and how auto encoders can be built to transform rasterised handwritten digits into vectors without supervision. Extensive experimental results highlight the power of this approach under different modelling assumptions for drawing tasks.


Contextualized Keyword Representations for Multi modal Retinal Image Captioning. Medical image captioning automatically generates a medical description to describe the content of a given medical image. A traditional medical image captioning model creates a medical description only based on a single medical image input. Hence, an abstract medical description or concept is hard to be generated based on the traditional approach. Such a method limits the effectiveness of medical image captioning. Multi modal medical image captioning is one of the approaches utilized to address this problem. In multi modal medical image captioning, textual input, e.g., expert defined keywords, is considered as one of the main drivers of medical description generation. Thus, encoding the textual input and the medical image effectively are both important for the task of multi modal medical image captioning. In this work, a new end to end deep multi modal medical image captioning model is proposed. Contextualized keyword representations, textual feature reinforcement, and masked self attention are used to develop the proposed approach. Based on the evaluation of the existing multi modal medical image captioning dataset, experimental results show that the proposed model is effective with the increase of 53.2 in BLEU avg and 18.6 in CIDEr, compared with the state of the art method.


Arrhenius activation energy and transitivity in fission track annealing equations. Fission track annealing models aim to extrapolate laboratory annealing kinetics to the geological timescale for application to geological studies. Model trends empirically capture the mechanisms of track length reduction. To facilitate the interpretation of the fission track annealing trends, a formalism, based on quantities already in use for the study of physicochemical processes, is developed and allows for the calculation of rate constants, Arrhenius activation energies, and transitivity functions for the fission track annealing models. These quantities are then obtained for the parallel Arrhenius, parallel curvilinear, fanning Arrhenius, and fanning curvilinear models, fitted with Durango apatite data. Parallel models showed to be consistent with a single activation energy mechanism and a reaction order model of order 4. However, the fanning curvilinear model is the one that results in better fits laboratory data and predictions in better agreement with geological evidence. Fanning models seem to describe a more complex picture, with concurrent recombination mechanisms presenting activation energies varying with time and temperature, and the reaction order model seems not to be the most appropriate. It is apparent from the transitivity analysis that the dominant mechanisms described by the fanning models are classical (not quantum) energy barrier transitions.


An Improved Algorithm for The k Dyck Edit Distance Problem. A Dyck sequence is a sequence of opening and closing parentheses (of various types) that is balanced. The Dyck edit distance of a given sequence of parentheses S is the smallest number of edit operations (insertions, deletions, and substitutions) needed to transform S into a Dyck sequence. We consider the threshold Dyck edit distance problem, where the input is a sequence of parentheses S and a positive integer k , and the goal is to compute the Dyck edit distance of S only if the distance is at most k , and otherwise report that the distance is larger than k . Backurs and Onak PODS'16 showed that the threshold Dyck edit distance problem can be solved in O(n k 16 ) time. In this work, we design new algorithms for the threshold Dyck edit distance problem which costs O(n k 4.782036 ) time with high probability or O(n k 4.853059 ) deterministically. Our algorithms combine several new structural properties of the Dyck edit distance problem, a refined algorithm for fast ( min, ) matrix product, and a careful modification of ideas used in Valiant's parsing algorithm.


NEAT Neural Attention Fields for End to End Autonomous Driving. Efficient reasoning about the semantic, spatial, and temporal structure of a scene is a crucial prerequisite for autonomous driving. We present NEural ATtention fields (NEAT), a novel representation that enables such reasoning for end to end imitation learning models. NEAT is a continuous function which maps locations in Bird's Eye View (BEV) scene coordinates to waypoints and semantics, using intermediate attention maps to iteratively compress high dimensional 2D image features into a compact representation. This allows our model to selectively attend to relevant regions in the input while ignoring information irrelevant to the driving task, effectively associating the images with the BEV representation. In a new evaluation setting involving adverse environmental conditions and challenging scenarios, NEAT outperforms several strong baselines and achieves driving scores on par with the privileged CARLA expert used to generate its training data. Furthermore, visualizing the attention maps for models with NEAT intermediate representations provides improved interpretability.


Topological Linear System Identification via Moderate Deviations Theory. Two dynamical systems are topologically equivalent when their phase portraits can be morphed into each other by a homeomorphic coordinate transformation on the state space. The induced equivalence classes capture qualitative properties such as stability or the oscillatory nature of the state trajectories, for example. In this paper we develop a method to learn the topological class of an unknown stable system from a single trajectory of finitely many state observations. Using a moderate deviations principle for the least squares estimator of the unknown system matrix theta , we prove that the probability of misclassification decays exponentially with the number of observations at a rate that is proportional to the square of the smallest singular value of theta .


Be your own Benchmark No Reference Trajectory Metric on Registered Point Clouds. This paper addresses the problem of assessing trajectory quality in conditions when no ground truth poses are available or when their accuracy is not enough for the specific task for example, small scale mapping in outdoor scenes. In our work, we propose a no reference metric, Mutually Orthogonal Metric (MOM), that estimates the quality of the map from registered point clouds via the trajectory poses. MOM strongly correlates with full reference trajectory metric Relative Pose Error, making it a trajectory benchmarking tool on setups where 3D sensing technologies are employed. We provide a mathematical foundation for such correlation and confirm it statistically in synthetic environments. Furthermore, since our metric uses a subset of points from mutually orthogonal surfaces, we provide an algorithm for the extraction of such subset and evaluate its performance in synthetic CARLA environment and on KITTI dataset. The code of the proposed metric is publicly available as pip package.


Neural Tree Expansion for Multi Robot Planning in Non Cooperative Environments. We present a self improving, Neural Tree Expansion (NTE) method for multi robot online planning in non cooperative environments, where each robot attempts to maximize its cumulative reward while interacting with other self interested robots. Our algorithm adapts the centralized, perfect information, discrete action space method from AlphaZero to a decentralized, partial information, continuous action space setting for multi robot applications. Our method has three interacting components (i) a centralized, perfect information "expert" Monte Carlo Tree Search (MCTS) with large computation resources that provides expert demonstrations, (ii) a decentralized, partial information "learner" MCTS with small computation resources that runs in real time and provides self play examples, and (iii) policy value neural networks that are trained with the expert demonstrations and bias both the expert and the learner tree growth. Our numerical experiments demonstrate Neural Tree Expansion's computational advantage by finding better solutions than a MCTS with 20 times more resources. The resulting policies are dynamically sophisticated, demonstrate coordination between robots, and play the Reach Target Avoid differential game significantly better than the state of the art control theoretic baseline for multi robot, double integrator systems. Our hardware experiments on an aerial swarm demonstrate the computational advantage of Neural Tree Expansion, enabling online planning at 20Hz with effective policies in complex scenarios.


Revisiting Knowledge Distillation for Object Detection. The existing solutions for object detection distillation rely on the availability of both a teacher model and ground truth labels. We propose a new perspective to relax this constraint. In our framework, a student is first trained with pseudo labels generated by the teacher, and then fine tuned using labeled data, if any available. Extensive experiments demonstrate improvements over existing object detection distillation algorithms. In addition, decoupling the teacher and ground truth distillation in this framework provides interesting properties such as 1) using unlabeled data to further improve the student's performance, 2) combining multiple teacher models of different architectures, even with different object categories, and 3) reducing the need for labeled data (with only 20 of COCO labels, this method achieves the same performance as the model trained on the entire set of labels). Furthermore, a by product of this approach is the potential usage for domain adaptation. We verify these properties through extensive experiments.


A Logic Theory Pattern for Linearized Control Systems. This paper describes a procedure that system developers can follow to translate typical mathematical representations of linearized control systems into logic theories. These theories are then used to verify system requirements and find constraints on design parameters, with the support of computer assisted theorem proving. This method contributes to the integration of formal verification methods into the standard model driven development processes for control systems. The theories obtained through its application comprise a set of assumptions that the system equations must satisfy, and a translation of the equations into the logic language of the Prototype Verification System theorem proving environment. The method is illustrated with a standard case study from control theory.


Ribet's conjecture for Eisenstein maximal ideals. According to Ogg's conjecture (Mazur's Theorem), cuspidal subgroup coincides with rational torsion points of the Jacobian variety of modular curves of the form X 0(N) for a it prime number N . There is a recent interest to generalize the conjecture for arbitrary N by Ribet, Ohta and Yoo. In this direction, Ribet conjectured that all the Eisenstein maximal ideals are "cuspidal". Hwajong Yoo proved the conjecture ( under certain hypothesis) provided that those ideals are it rational . In this article, we show that ( under certain hypothesis), Ribet's conjecture is true for it non rational Eisenstein maximal ideals.


Transformation of Node to Knowledge Graph Embeddings for Faster Link Prediction in Social Networks. Recent advances in neural networks have solved common graph problems such as link prediction, node classification, node clustering, node recommendation by developing embeddings of entities and relations into vector spaces. Graph embeddings encode the structural information present in a graph. The encoded embeddings then can be used to predict the missing links in a graph. However, obtaining the optimal embeddings for a graph can be a computationally challenging task specially in an embedded system. Two techniques which we focus on in this work are 1) node embeddings from random walk based methods and 2) knowledge graph embeddings. Random walk based embeddings are computationally inexpensive to obtain but are sub optimal whereas knowledge graph embeddings perform better but are computationally expensive. In this work, we investigate a transformation model which converts node embeddings obtained from random walk based methods to embeddings obtained from knowledge graph methods directly without an increase in the computational cost. Extensive experimentation shows that the proposed transformation model can be used for solving link prediction in real time.


Pano AVQA Grounded Audio Visual Question Answering on 360 circ Videos. 360 circ videos convey holistic views for the surroundings of a scene. It provides audio visual cues beyond pre determined normal field of views and displays distinctive spatial relations on a sphere. However, previous benchmark tasks for panoramic videos are still limited to evaluate the semantic understanding of audio visual relationships or spherical spatial property in surroundings. We propose a novel benchmark named Pano AVQA as a large scale grounded audio visual question answering dataset on panoramic videos. Using 5.4K 360 circ video clips harvested online, we collect two types of novel question answer pairs with bounding box grounding spherical spatial relation QAs and audio visual relation QAs. We train several transformer based models from Pano AVQA, where the results suggest that our proposed spherical spatial embeddings and multimodal training objectives fairly contribute to a better semantic understanding of the panoramic surroundings on the dataset.


Convergence rate of DeepONets for learning operators arising from advection diffusion equations. We present convergence analysis of operator learning in Chen and Chen 1995 and Lu et al. 2020 , where continuous operators are approximated by a sum of products of branch and trunk networks. In this work, we consider the rates of learning solution operators from both linear and nonlinear advection diffusion equations with or without reaction. We find that the convergence rates depend on the architecture of branch networks as well as the smoothness of inputs and outputs of solution operators.


Vector valued Spline Method for the Spherical Multiple shell Electro magnetoencephalography Problem. Human brain activity is based on electrochemical processes, which can only be measured invasively. Therefore, quantities such as magnetic flux density (MEG) or electric potential differences (EEG) are measured non invasively in medicine and research. The reconstruction of the neuronal current from the measurements is a severely ill posed problem though its visualization is one of the main research tools in cognitive neuroscience. Here, using an isotropic multiple shell model for the geometry of the head and a quasi static approach for modeling the electro magnetic processes, we derive a novel vector valued spline method based on reproducing kernel Hilbert spaces. The presented vector spline method follows the path of former spline approaches and provides classical minimum norm properties. In addition, it minimizes the (infinite dimensional) Tikhonov Philips functional handling the instability of the inverse problem. This optimization problem reduces to solving a finite dimensional system of linear equations without loss of information. It results in a unique solution which takes into account that only the harmonic and solenoidal component of the current affects the measurements. Besides, we prove a convergence result the solution achieved by the vector spline method converges to the generator of the data as the number of measurements increases. The vector splines are applied to the inversion of synthetic test cases, where the irregularly distributed data situation could be handled very well. Combined with parameter choice methods, numerical results are shown with and without additional Gaussian white noise. Former approaches based on scalar splines are outperformed by the vector splines results with respect to the normalized root mean square error. Finally, reasonable results with respect to physiological expectations for real data are shown.


UPSLAM Union of Panoramas SLAM. We present an empirical investigation of a new mapping system based on a graph of panoramic depth images. Panoramic images efficiently capture range measurements taken by a spinning lidar sensor, recording fine detail on the order of a few centimeters within maps of expansive scope on the order of tens of millions of cubic meters. The flexibility of the system is demonstrated by running the same mapping software against data collected by hand carrying a sensor around a laboratory space at walking pace, moving it outdoors through a campus environment at running pace, driving the sensor on a small wheeled vehicle on and off road, flying the sensor through a forest, carrying it on the back of a legged robot navigating an underground coal mine, and mounting it on the roof of a car driven on public roads. The full 3D maps are built online with a median update time of less than ten milliseconds on an embedded NVIDIA Jetson AGX Xavier system.


An Argumentative Dialogue System for COVID 19 Vaccine Information. Dialogue systems are widely used in AI to support timely and interactive communication with users. We propose a general purpose dialogue system architecture that leverages computational argumentation to perform reasoning and provide consistent and explainable answers. We illustrate the system using a COVID 19 vaccine information case study.


Multiphase flows simulation with the Smoothed Particle Hydrodynamics method. This work presents a new multiphase SPH model that includes the shifting algorithm and a variable smoothing length formalism to simulate multi phase flows with accuracy and proper interphase management. The implementation was performed in the DualSPHysics code and validated for different canonical experiments, such as the single phase and multiphase Poiseuille and Couette test cases. The method is accurate even for the multiphase case for which two phases are simulated. The shifting algorithm and the variable smoothing length formalism has been applied in the multiphase SPH model to improve the numerical results at the interphase even when it is highly deformed and non linear effects become important. The obtained accuracy in the validation tests and the good interphase definition in the instability cases indicate an important improvement in the numerical results compared with single phase and multiphase models where the shifting algorithm and the variable smoothing length formalism are not applied.


Measurement of electric field noise from interchangeable samples with a trapped ion sensor. We demonstrate the use of a single trapped ion as a sensor to probe electric field noise from interchangeable test surfaces. As proof of principle, we measure the magnitude and distance dependence of electric field noise from two ion trap like samples with patterned Au electrodes. This trapped ion sensor could be combined with other surface characterization tools to help elucidate the mechanisms that give rise to electric field noise from ion trap surfaces. Such noise presents a significant hurdle for performing large scale trapped ion quantum computations.


Visual Probing Cognitive Framework for Explaining Self Supervised Image Representations. Recently introduced self supervised methods for image representation learning provide on par or superior results to their fully supervised competitors, yet the corresponding efforts to explain the self supervised approaches lag behind. Motivated by this observation, we introduce a novel visual probing framework for explaining the self supervised models by leveraging probing tasks employed previously in natural language processing. The probing tasks require knowledge about semantic relationships between image parts. Hence, we propose a systematic approach to obtain analogs of natural language in vision, such as visual words, context, and taxonomy. Our proposal is grounded in Marr's computational theory of vision and concerns features like textures, shapes, and lines. We show the effectiveness and applicability of those analogs in the context of explaining self supervised representations. Our key findings emphasize that relations between language and vision can serve as an effective yet intuitive tool for discovering how machine learning models work, independently of data modality. Our work opens a plethora of research pathways towards more explainable and transparent AI.


(R)SE challenges in HPC. We discuss some specific software engineering challenges in the field of high performance computing, and argue that the slow adoption of SE tools and techniques is at least in part caused by the fact that these do not address the HPC challenges out of the box'. By giving some examples of solutions for designing, testing and benchmarking HPC software, we intend to bring software engineering and HPC closer together.


Semi Symmetric Nonnegative Matrix Factorization. The Semi Symmetric Nonnegative Factorization is a factorization of an n times n nonnegative symmetric matrix A of the form BCB T , where C is a k times k symmetric matrix, and both B and C are required to be nonnegative. The minimal k for which such factorization exists is called the SSNF rank of A . In this work, basic properties of the SSNF rank are given, SSNF rank of low rank matrices is explored, and selected constructions of matrices that control the SSNF rank are presented.


Kinship Verification Based on Cross Generation Feature Interaction Learning. Kinship verification from facial images has been recognized as an emerging yet challenging technique in many potential computer vision applications. In this paper, we propose a novel cross generation feature interaction learning (CFIL) framework for robust kinship verification. Particularly, an effective collaborative weighting strategy is constructed to explore the characteristics of cross generation relations by corporately extracting features of both parents and children image pairs. Specifically, we take parents and children as a whole to extract the expressive local and non local features. Different from the traditional works measuring similarity by distance, we interpolate the similarity calculations as the interior auxiliary weights into the deep CNN architecture to learn the whole and natural features. These similarity weights not only involve corresponding single points but also excavate the multiple relationships cross points, where local and non local features are calculated by using these two kinds of distance measurements. Importantly, instead of separately conducting similarity computation and feature extraction, we integrate similarity learning and feature extraction into one unified learning process. The integrated representations deduced from local and non local features can comprehensively express the informative semantics embedded in images and preserve abundant correlation knowledge from image pairs. Extensive experiments demonstrate the efficiency and superiority of the proposed model compared to some state of the art kinship verification methods.


Algebraic cycles and Lehn Lehn Sorger van Straten eightfolds. This article is about Lehn Lehn Sorger van Straten eightfolds Z , and their anti symplectic involution iota . When Z is birational to the Hilbert scheme of points on a K3 surface, we give an explicit formula for the action of iota on the Chow group of 0 cycles of Z . The formula is in agreement with the Bloch Beilinson conjectures, and has some non trivial consequences for the Chow ring of the quotient.


Particle Radial Distribution Function and Relative Velocity Measurement in Turbulence at Small Particle Pair Separations. The collision rate of particles suspended in turbulent flow is critical to particle agglomeration and droplet coalescence. The collision kernel can be evaluated by the radial distribution function (RDF) and radial relative velocity (RV) between particles at small separations r . Previously, the smallest r was limited to roughly the Kolmogorov length eta due to particle position uncertainty and image overlap. We report a new approach to measure RDF and RV near contact ( r a approx 2.07, a particle radius) overcoming these limitations. Three dimensional particle tracking velocimetry using four pulse Shake the Box algorithm recorded short particle tracks with the interpolated midpoints registered as particle positions to avoid image overlap. This strategy further allows removal of mismatched tracks using their characteristic false RV. We measured RDF and RV in a one meter diameter isotropic turbulence chamber with Taylor Reynolds number Re lambda 324 with particles of 12 16 mu m radius and Stokes number approx 0.7. While at large r the measured RV agrees with the literature, when r 20 eta the first moment of negative RV is 10 times higher than direct numerical simulations of non interacting particles. Likewise, when r eta , RDF scales as r 0.39 reflecting RDF scaling for polydisperse particles in the literature , but when r lessapprox eta RDF scales as r 6 , yielding 1000 times higher near contact RDF than simulations. Such extreme clustering and relative velocity enhancement can be attributed to particle particle interactions. Uncertainty analysis substantiates the observed trends. This first ever simultaneous RDF and RV measurement at small separations provides a clear glimpse into the clustering and relative velocities of particles in turbulence near contact.


Homological eigenvalues of graph p Laplacians. Inspired by persistent homology in topological data analysis, we introduce the homological eigenvalues of the graph p Laplacian Delta p , which allows us to analyse and classify non variational eigenvalues. We show the stability of homological eigenvalues, and we prove that for any homological eigenvalue lambda( Delta p) , the function p mapsto p(2 lambda( Delta p)) frac1p is locally increasing, while the function p mapsto 2 p lambda( Delta p) is locally decreasing. As a special class of homological eigenvalues, the variational (min max) eigenvalues lambda 1( Delta p) , lambda 2( Delta p) , cdots , lambda k( Delta p) , cdots , are locally Lipschitz continuous with respect to p in 1, infty) . We also establish the monotonicity of p(2 lambda k( Delta p)) frac1p and 2 p lambda k( Delta p) with respect to p in 1, infty) . These results establish refined analysis of Delta p eigenvalues for varying p , which lead to several applications, including (1) settle an open problem by Amghibech on the monotonicity of some function involving eigenvalues of p Laplacian with respect to p (2) resolve a question asking whether the third eigenvalue of graph p Laplacian is of min max form (3) refine the higher order Cheeger inequalities for graph p Laplacians by Tudisco and Hein, and extend the multi way Cheeger inequality by Lee, Oveis Gharan and Trevisan to the p Laplacian case. Furthermore, for the 1 Laplacian case, we characterize the homological eigenvalues and variational eigenvalues from the perspective of topological combinatorics, where our idea is similar to the authors' work on discrete Morse theory.


All in one stroke? Intervention Spaces for Dark Patterns. This position paper draws from the complexity of dark patterns to develop arguments for differentiated interventions. We propose a matrix of interventions with a textit measure axis (from user directed to environment directed) and a textit scope axis (from general to specific). We furthermore discuss a set of interventions situated in different fields of the intervention spaces. The discussions at the 2021 CHI workshop "What can CHI do about dark patterns?" should help hone the matrix structure and fill its fields with specific intervention proposals.


Two Novel Performance Improvements for Evolving CNN Topologies. Convolutional Neural Networks (CNNs) are the state of the art algorithms for the processing of images. However the configuration and training of these networks is a complex task requiring deep domain knowledge, experience and much trial and error. Using genetic algorithms, competitive CNN topologies for image recognition can be produced for any specific purpose, however in previous work this has come at high computational cost. In this work two novel approaches are presented to the utilisation of these algorithms, effective in reducing complexity and training time by nearly 20 . This is accomplished via regularisation directly on training time, and the use of partial training to enable early ranking of individual architectures. Both approaches are validated on the benchmark CIFAR10 data set, and maintain accuracy.


Model Doctor A Simple Gradient Aggregation Strategy for Diagnosing and Treating CNN Classifiers. Recently, Convolutional Neural Network (CNN) has achieved excellent performance in the classification task. It is widely known that CNN is deemed as a 'black box', which is hard for understanding the prediction mechanism and debugging the wrong prediction. Some model debugging and explanation works are developed for solving the above drawbacks. However, those methods focus on explanation and diagnosing possible causes for model prediction, based on which the researchers handle the following optimization of models manually. In this paper, we propose the first completely automatic model diagnosing and treating tool, termed as Model Doctor. Based on two discoveries that 1) each category is only correlated with sparse and specific convolution kernels, and 2) adversarial samples are isolated while normal samples are successive in the feature space, a simple aggregate gradient constraint is devised for effectively diagnosing and optimizing CNN classifiers. The aggregate gradient strategy is a versatile module for mainstream CNN classifiers. Extensive experiments demonstrate that the proposed Model Doctor applies to all existing CNN classifiers, and improves the accuracy of 16 mainstream CNN classifiers by 1 5 .


On Meshfree Collocation to Compute the Probability of Default under a Regime Switching Synchronous Jump Tempered Stable L ' e vy Model. In the paper Hainaut, D. and Colwell, D.B., rm A structural model for credit risk with switching processes and synchronous jumps , The European Journal of Finance 22(11) (2016) 1040 1062 , the authors exploit a synchronous jump regime switching model to compute the default probability of a publicly traded company. Here, we first generalize the proposed L ' e vy model to more general setting of tempered stable processes recently introduced into the finance literature. Based on the singularity of the resulting partial integro differential operator, we propose a general framework based on strictly positive definite functions to de singularize the operator. We then analyze an efficient meshfree collocation method based on radial basis functions to approximate the solution of the corresponding system of partial integro differential equations arising from the structural credit risk model. We show that under some regularity assumptions, our proposed method naturally de sinularizes the problem in the tempered stable case. Numerical results of applying the method on some standard examples from the literature confirms the accuracy of our theoretical results and numerical algorithm.


Diversification in Session based News Recommender Systems. Recommender systems are widely applied in digital platforms such as news websites to personalize services based on user preferences. In news websites most of users are anonymous and the only available data is sequences of items in anonymous sessions. Due to this, typical collaborative filtering methods, which are highly applied in many applications, are not effective in news recommendations. In this context, session based recommenders are able to recommend next items given the sequence of previous items in the active session. Neighborhood based session based recommenders has been shown to be highly effective compared to more sophisticated approaches. In this study we propose scenarios to make these session based recommender systems diversity aware and to address the filter bubble phenomenon. The filter bubble phenomenon is a common concern in news recommendation systems and it occurs when the system narrows the information and deprives users of diverse information. The results of applying the proposed scenarios show that these diversification scenarios improve the diversity measures in these session based recommender systems based on four news datasets.


SIM SITU A Framework for the Faithful Simulation of in situ Workflows. The amount of data generated by numerical simulations in various scientific domains such as molecular dynamics, climate modeling, biology, or astrophysics, led to a fundamental redesign of application workflows. The throughput and the capacity of storage subsystems have not evolved as fast as the computing power in extreme scale supercomputers. As a result, the classical post hoc analysis of simulation outputs became highly inefficient. In situ workflows have then emerged as a solution in which simulation and data analytics are intertwined through shared computing resources, thus lower latencies. Determining the best allocation, i.e., how many resources to allocate to each component of an in situ workflow and mapping, i.e., where and at which frequency to run the data analytics component, is a complex task whose performance assessment is crucial to the efficient execution of in situ workflows. However, such a performance evaluation of different allocation and mapping strategies usually relies either on directly running them on the targeted execution environments, which can rapidly become extremely time and resource consuming, or on resorting to the simulation of simplified models of the components of an in situ workflow, which can lack of realism. In both cases, the validity of the performance evaluation is limited. To address this issue, we introduce SIM SITU, a framework for the faithful simulation of in situ workflows. This framework builds on the SimGrid toolkit and benefits of several important features of this versatile simulation tool. We designed SIM SITU to reflect the typical structure of in situ workflows and thanks to its modular design, SIM SITU has the necessary flexibility to easily and faithfully evaluate the behavior and performance of various allocation and mapping strategies for in situ workflows. We illustrate the simulation capabilities of SIM SITU on a Molecular Dynamics use case. We study the impact of different allocation and mapping strategies on performance and show how users can leverage SIM SITU to determine interesting tradeoffs when designing their in situ workflow.


Spinors, Twistors and Classical Geometry. The paper studies explicitly the Hitchin system restricted to the Higgs fields on a fixed very stable rank 2 bundle in genus 2 and 3. The associated families of quadrics relate to both the geometry of Penrose's twistor spaces and several classical results.


Arithmetic and Thin Monodromy in mathrm Sp (6) . Expanding on the results of 2 we explore the arithmeticity and thinness of hypergeometric groups of type mathrm Sp (6) . We prove the arithmeticity of 2 and thinness of 17 hypergeometric groups with a maximally unipotent monodromy. Consequently, it is now established that out of 40 such groups there are at least 20 arithmetic and 17 thin. In addition, we establish the thinness of 46 and arithmeticity of 3 more hypergeometric groups, associated to pairs of polynomials f,g discussed in Table C of 2 . To the best of our knowledge, this article produces the first 63 examples in the cyclotomic family of Zariski dense non arithmetic hypergeometric monodromy groups of real rank three.


Maximum principle satisfying discontinuous Galerkin methods for incompressible two phase immiscible flow. This paper proposes a fully implicit numerical scheme for immiscible incompressible two phase flow in porous media taking into account gravity, capillary effects, and heterogeneity. The objective is to develop a fully implicit stable discontinuous Galerkin (DG) solver for this system that is accurate, bound preserving, and locally mass conservative. To achieve this, we augment our DG formulation with post processing flux and slope limiters. The proposed framework is applied to several benchmark problems and the discrete solutions are shown to be accurate, to satisfy the maximum principle and local mass conservation.


Semantically Constrained Memory Allocation (SCMA) for Embedding in Efficient Recommendation Systems. Deep learning based models are utilized to achieve state of the art performance for recommendation systems. A key challenge for these models is to work with millions of categorical classes or tokens. The standard approach is to learn end to end, dense latent representations or embeddings for each token. The resulting embeddings require large amounts of memory that blow up with the number of tokens. Training and inference with these models create storage, and memory bandwidth bottlenecks leading to significant computing and energy consumption when deployed in practice. To this end, we present the problem of textit Memory Allocation under budget for embeddings and propose a novel formulation of memory shared embedding, where memory is shared in proportion to the overlap in semantic information. Our formulation admits a practical and efficient randomized solution with Locality sensitive hashing based Memory Allocation (LMA). We demonstrate a significant reduction in the memory footprint while maintaining performance. In particular, our LMA embeddings achieve the same performance compared to standard embeddings with a 16 times reduction in memory footprint. Moreover, LMA achieves an average improvement of over 0.003 AUC across different memory regimes than standard DLRM models on Criteo and Avazu datasets


Generalisable and distinctive 3D local deep descriptors for point cloud registration. An effective 3D descriptor should be invariant to different geometric transformations, such as scale and rotation, repeatable in the case of occlusions and clutter, and generalisable in different contexts when data is captured with different sensors. We present a simple but yet effective method to learn generalisable and distinctive 3D local descriptors that can be used to register point clouds captured in different contexts with different sensors. Point cloud patches are extracted, canonicalised with respect to their local reference frame, and encoded into scale and rotation invariant compact descriptors by a point permutation invariant deep neural network. Our descriptors can effectively generalise across sensor modalities from locally and randomly sampled points. We evaluate and compare our descriptors with alternative handcrafted and deep learning based descriptors on several indoor and outdoor datasets reconstructed using both RGBD sensors and laser scanners. Our descriptors outperform most recent descriptors by a large margin in terms of generalisation, and become the state of the art also in benchmarks where training and testing are performed in the same scenarios.


MMD MIX Value Function Factorisation with Maximum Mean Discrepancy for Cooperative Multi Agent Reinforcement Learning. In the real world, many tasks require multiple agents to cooperate with each other under the condition of local observations. To solve such problems, many multi agent reinforcement learning methods based on Centralized Training with Decentralized Execution have been proposed. One representative class of work is value decomposition, which decomposes the global joint Q value Q text jt into individual Q values Q a to guide individuals' behaviors, e.g. VDN (Value Decomposition Networks) and QMIX. However, these baselines often ignore the randomness in the situation. We propose MMD MIX, a method that combines distributional reinforcement learning and value decomposition to alleviate the above weaknesses. Besides, to improve data sampling efficiency, we were inspired by REM (Random Ensemble Mixture) which is a robust RL algorithm to explicitly introduce randomness into the MMD MIX. The experiments demonstrate that MMD MIX outperforms prior baselines in the StarCraft Multi Agent Challenge (SMAC) environment.


The algebraic structure of the densification and the sparsification tasks for CSPs. The tractability of certain CSPs for dense or sparse instances is known from the 90s. Recently, the densification and the sparsification of CSPs were formulated as computational tasks and the systematical study of their computational complexity was initiated. We approach this problem by introducing the densification operator, i.e. the closure operator that, given an instance of a CSP, outputs all constraints that are satisfied by all of its solutions. According to the Galois theory of closure operators, any such operator is related to a certain implicational system (or, a functional dependency) Sigma . We are specifically interested in those classes of fixed template CSPs, parameterized by constraint languages Gamma , for which the size of an implicational system Sigma is a polynomial in the number of variables n . We show that in the Boolean case, Sigma is of polynomial size if and only if Gamma is of bounded width. For such languages, Sigma can be computed in log space or in a logarithmic time with a polynomial number of processors. Given an implicational system Sigma , the densification task is equivalent to the computation of the closure of input constraints. The sparsification task is equivalent to the computation of the minimal key. Finally, we give a complete classification of constraint languages over the Boolean domain for which the densification problem is tractable.


Hand Pose Classification Based on Neural Networks. In this work, deep learning models are applied to a segment of a robust hand washing dataset that has been created with the help of 30 volunteers. This work demonstrates the classification of presence of one hand, two hands and no hand in the scene based on transfer learning. The pre trained model simplest NN from Keras library is utilized to train the network with 704 images of hand gestures and the predictions are carried out for the input image. Due to the controlled and restricted dataset, 100 accuracy is achieved during the training with correct predictions for the input image. Complete handwashing dataset with dense models such as AlexNet for video classification for hand hygiene stages will be used in the future work.


Wavelet Design with Optimally Localized Ambiguity Function a Variational Approach. In this paper, we design mother wavelets for the 1D continuous wavelet transform with some optimality properties. An optimal mother wavelet here is one that has an ambiguity function with minimal spread in the continuous coefficient space (also called phase space). Since the ambiguity function is the reproducing kernel of the coefficient space, optimal windows lead to phase space representations which are "optimally sharp." Namely, the wavelet coefficients have minimal correlations with each other. Such a construction also promotes sparsity in phase space. The spread of the ambiguity function is modeled as the sum of variances along the axes in phase space. In order to optimize the mother wavelet directly as a 1D signal, we pull back the variances, defined on the 2D phase space, to the so called window signal space. This is done using the recently developed wavelet Plancharel theory. The approach allows formulating the optimization problem of the 2D ambiguity function as a minimization problem of the 1D mother wavelet. The resulting 1D formulation is more efficient and does not involve complicated constraints on the 2D ambiguity function. We optimize the mother wavelet using gradient descent, which yields a locally optimal mother wavelet.


Fourier decay for homogeneous self affine measures. We show that for Lebesgue almost all d tuples ( theta 1, ldots, theta d) , with theta j 1 , any self affine measure for a homogeneous non degenerate iterated function system Ax a j j 1 m in mathbb R d , where A 1 is a diagonal matrix with the entries ( theta 1, ldots, theta d) , has power Fourier decay at infinity.


Answer to an Isomorphism Problem in mathbb Z 2 . For S subset mathbb R n and d 0 , denote by G(S, d) the graph with vertex set S with any two vertices being adjacent if and only if they are at a Euclidean distance d apart. Deem such a graph to be non trivial" if d is actually realized as a distance between points of S . In a 2015 article, the author asked if there exist distinct d 1, d 2 such that the non trivial graphs G( mathbb Z 2, d 1) and G( mathbb Z 2, d 2) are isomorphic. In our current work, we offer a straightforward geometric construction to show that a negative answer holds for this question.


Fluctuations of balanced urns with infinitely many colours. In this paper, we prove convergence and fluctuation results for measure valued P 'olya processes (MVPPs, also known as P 'olya urns with infinitely many colours). Our convergence results hold almost surely and in L 2 , under assumptions that are different from that of other convergence results in the literature. Our fluctuation results are the first second order results in the literature on MVPPs they generalise classical fluctuation results from the literature on finitely many colour P 'olya urns. As in the finitely many colour case, the order and shape of the fluctuations depend on whether the "spectral gap is small or large". To prove these results, we show that MVPPs are stochastic approximations taking values in the set of measures on a measurable space E (the colour space). We then use martingale methods and standard operator theory to prove convergence and fluctuation results for these stochastic approximations.


Einstein and the old quantum theory. Objecting that Sommerfeld's quantum conditions refer to particular coordinates, Einstein proposes a canonically invariant rule. But even if the invariance is canonical, Einstein may have in mind a double emph configuration space invariance with respect to loop deformations, and to emph point transformation all on a torus where features of the Liouville Arnol'd theorem already appear.


Efficient Quasi Geodesics on the Stiefel Manifold. Solving the so called geodesic endpoint problem, i.e., finding a geodesic that connects two given points on a manifold, is at the basis of virtually all data processing operations, including averaging, clustering, interpolation and optimization. On the Stiefel manifold of orthonormal frames, this problem is computationally involved. A remedy is to use quasi geodesics as a replacement for the Riemannian geodesics. Quasi geodesics feature constant speed and covariant acceleration with constant (but possibly non zero) norm. For a well known type of quasi geodesics, we derive a new representation that is suited for large scale computations. Moreover, we introduce a new kind of quasi geodesics that turns out to be much closer to the Riemannian geodesics.


Summation of certain trigonometric series with logarithmic coefficients. The sums of three trigonometric series with logarithmic coefficients are derived by extending an approach first utilized by Lerch. By applying Frullani's theorem to two of these series, two non trivial integrals involving hyperbolic functions are evaluated in terms of the digamma function.


Adaptive Warden Strategy for Countering Network Covert Storage Channels. The detection and elimination of covert channels are performed by a network node, known as a warden. Especially if faced with adaptive covert communication parties, a regular warden equipped with a static set of normalization rules is ineffective compared to a dynamic warden. However, dynamic wardens rely on periodically changing rule sets and have their own limitations, since they do not consider traffic specifics. We propose a novel adaptive warden strategy, capable of selecting active normalization rules by taking into account the characteristics of the observed network traffic. Our goal is to disturb the covert channel and provoke the covert peers to expose themselves more by increasing the number of packets required to perform a successful covert data transfer. Our evaluation revealed that the adaptive warden has better efficiency and effectiveness when compared to the dynamic warden because of its adaptive selection of normalization rules.


Locally conformal SKT structures. A Hermitian metric on a complex manifold is called SKT (strong K "ahler with torsion) if the Bismut torsion 3 form H is closed. As the conformal generalization of the SKT condition, we introduce a new type of Hermitian structure, called emph locally conformal SKT (or shortly LCSKT). More precisely, a Hermitian structure (J,g) is said to be LCSKT if there exists a closed non zero 1 form alpha such that d H alpha wedge H . In the paper we consider non trivial LCSKT structures, i.e. we assume that d H neq 0 and we study their existence on Lie groups and their compact quotients by lattices. In particular, we classify 6 dimensional nilpotent Lie algebras admitting a LCSKT structure and we show that, in contrast to the SKT case, there exists a 6 dimensional 3 step nilpotent Lie algebra admitting a non trivial LCSKT structure. Moreover, we show a characterization of even dimensional almost abelian Lie algebras admitting a non trivial LCSKT structure, which allows us to construct explicit examples of 6 dimensional unimodular almost abelian Lie algebras admitting a non trivial LCSKT structure. The compatibility between the LCSKT and the balanced condition is also discussed, showing that a Hermitian structure on a 6 dimensional nilpotent or a 2n dimensional almost abelian Lie algebra cannot be simultaneously LCSKT and balanced, unless it is K " a hler.


Beam Beam Interaction in a Dielectric Laser Accelerator Electron Positron Collider. We examine through numerical calculation the collision of counter propagating trains of optically spaced electron positron microbunches in a 1 TeV collider scenario for a dielectric laser accelerator (DLA). A time dependent envelope equation is derived for arbitrary number of bunches in the classical limit, with inclusion of the radiation reaction force (RRF). Example parameters are examined based on a constrained luminosity relation that takes into account the bunch charge for optimal efficiency, material damage limits, and power constraints. We find that for initially identical counter propagating Gaussian bunch trains the periodic temporal structure leads to a peak in luminosity with number of bunches. For longer bunch trains, the enhancement then decreases inversely with number of bunches. The corresponding fractional energy loss of the beam is found to be of order 1.75 , which is reduced to 0.35 when the nonlinear radial dependence of the transverse force is included, with an average beamstrahlung parameter of 0.075, an important result considering that beamstrahlung losses are a critical concern for future TeV colliders.


Refining Language Models with Compositional Explanations. Pre trained language models have been successful on text classification tasks, but are prone to learning spurious correlations from biased datasets, and are thus vulnerable when making inferences in a new domain. Prior work reveals such spurious patterns via post hoc explanation algorithms which compute the importance of input features. Further, the model is regularized to align the importance scores with human knowledge, so that the unintended model behaviors are eliminated. However, such a regularization technique lacks flexibility and coverage, since only importance scores towards a pre defined list of features are adjusted, while more complex human knowledge such as feature interaction and pattern generalization can hardly be incorporated. In this work, we propose to refine a learned language model for a target domain by collecting human provided compositional explanations regarding observed biases. By parsing these explanations into executable logic rules, the human specified refinement advice from a small set of explanations can be generalized to more training examples. We additionally introduce a regularization term allowing adjustments for both importance and interaction of features to better rectify model behavior. We demonstrate the effectiveness of the proposed approach on two text classification tasks by showing improved performance in target domain as well as improved model fairness after refinement.


Optimal Hardy weights for elliptic operators with mixed boundary conditions. We construct families of optimal Hardy weights for a subcritical linear second order elliptic operator (P,B) with degenerate mixed boundary conditions. By an optimal Hardy weight for a subcritical operator we mean a nonzero nonnegative weight function W such that (P W,B) is critical and null critical with respect to W . Our results rely on a recently developed criticality theory for positive solutions of the corresponding mixed boundary value problem.


Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning. To quantitatively and intuitively explore the generalization ability of pre trained language models (PLMs), we have designed several tasks of arithmetic and logical reasoning. We both analyse how well PLMs generalize when the test data is in the same distribution as the train data and when it is different, for the latter analysis, we have also designed a cross distribution test set other than the in distribution test set. We conduct experiments on one of the most advanced and publicly released generative PLM BART. Our research finds that the PLMs can easily generalize when the distribution is the same, however, it is still difficult for them to generalize out of the distribution.


Short Review Pathology of the image big data era using electron microscopy. The human body is mysterious, consisting of innumerable fine and complex structures and a vast amount of information. The field of modern pathology has been systematized around the findings and observations obtained from light microscopy. However, such observations in the visible light range are limited to those at the cellular level thus, observations of cellular ultrastructures are difficult. Therefore, only vague information can be collected. Various imaging methodologies and tissue staining techniques have been created to further understand the complexity of biological tissues. Using such approaches, it has been realized that cellular morphology data that comprehensively acquire biological tissue information can be treated as new omics information, termed the 'Totalities of body tissue morphology (morphome)'. In addition, it is also possible to revisit vague morphological information quantitatively and objectively using knowledge relating to the latest scientific information. Currently, new technologies are allowing additional frontiers to be opened. Indeed, I believe that a new revolution is about to take place regarding the 'viewing' of tissues by innovative imaging technologies such as 'wide area electron microscopy (EM)', which can observe a wide area of several millimeters or more with nano level resolution. Moreover, with the advent of cutting edge information technology, I expect big data processing to be more innovative. Through the incorporation of these new methodologies, the field of pathology is expected to deepen through the identification of previously unknown structures, the quantification of infrequent rare events, the new reclassification of diseases, and the automatic diagnosis of diseases. In this review, I introduce the innovation of the EM imaging and discuss the field of pathology with regard to the big data era.


Side Channel Trojan Insertion a Practical Foundry Side Attack via ECO. Design companies often outsource their integrated circuit (IC) fabrication to third parties where ICs are susceptible to malicious acts such as the insertion of a side channel hardware trojan horse (SCT). In this paper, we present a framework for designing and inserting an SCT based on an engineering change order (ECO) flow, which makes it the first to disclose how effortlessly a trojan can be inserted into an IC. The trojan is designed with the goal of leaking multiple bits per power signature reading. Our findings and results show that a rogue element within a foundry has, today, all means necessary for performing a foundry side attack via ECO.


Steiner triple systems and spreading sets in projective spaces. We address several extremal problems concerning the spreading property of point sets of Steiner triple systems. This property is closely related to the structure of subsystems, as a set is spreading if and only if there is no proper subsystem which contains it. We give sharp upper bounds on the size of a minimal spreading set in a Steiner triple system and show that if all the minimal spreading sets are large then the examined triple system must be a projective space. We also show that the size of a minimal spreading set is not an invariant of a Steiner triple system.


A Lindstr "om theorem for intuitionistic first order logic. We extend the main result of (G. Badia and G. Olkhovikov. A Lindstr "om theorem for intuitionistic propositional logic. Notre Dame Journal of Formal Logic, 61 (1) 11 30 (2020)) to the first order intuitionistic logic (with and without equality), showing that it is the maximal (with respect to expressive power) abstract logic satisfying a certain form of compactness, the Tarski union property and preservation under asimulations. A similar result is also shown for the intuitionistic logic of constant domains.


Transversal factors and spanning trees. Given a collection of graphs mathbf G (G 1, ldots, G m) with the same vertex set, an m edge graph H subset cup i in m G i is a transversal if there is a bijection phi E(H) to m such that e in E(G phi(e) ) for each e in E(H) . We give asymptotically tight minimum degree conditions for a graph collection on an n vertex set to have a transversal which is a copy of a graph H , when H is an n vertex graph which is an F factor or a tree with maximum degree o(n log n) .


Integrated Task Assignment and Path Planning for Capacitated Multi Agent Pickup and Delivery. Multi agent Pickup and Delivery (MAPD) is a challenging industrial problem where a team of robots is tasked with transporting a set of tasks, each from an initial location and each to a specified target location. Appearing in the context of automated warehouse logistics and automated mail sortation, MAPD requires first deciding which robot is assigned what task (i.e., Task Assignment or TA) followed by a subsequent coordination problem where each robot must be assigned collision free paths so as to successfully complete its assignment (i.e., Multi Agent Path Finding or MAPF). Leading methods in this area solve MAPD sequentially first assigning tasks, then assigning paths. In this work we propose a new coupled method where task assignment choices are informed by actual delivery costs instead of by lower bound estimates. The main ingredients of our approach are a marginal cost assignment heuristic and a meta heuristic improvement strategy based on Large Neighbourhood Search. As a further contribution, we also consider a variant of the MAPD problem where each robot can carry multiple tasks instead of just one. Numerical simulations show that our approach yields efficient and timely solutions and we report significant improvement compared with other recent methods from the literature.


Predicting Music Relistening Behavior Using the ACT R Framework. Providing suitable recommendations is of vital importance to improve the user satisfaction of music recommender systems. Here, users often listen to the same track repeatedly and appreciate recommendations of the same song multiple times. Thus, accounting for users' relistening behavior is critical for music recommender systems. In this paper, we describe a psychology informed approach to model and predict music relistening behavior that is inspired by studies in music psychology, which relate music preferences to human memory. We adopt a well established psychological theory of human cognition that models the operations of human memory, i.e., Adaptive Control of Thought Rational (ACT R). In contrast to prior work, which uses only the base level component of ACT R, we utilize five components of ACT R, i.e., base level, spreading, partial matching, valuation, and noise, to investigate the effect of five factors on music relistening behavior (i) recency and frequency of prior exposure to tracks, (ii) co occurrence of tracks, (iii) the similarity between tracks, (iv) familiarity with tracks, and (v) randomness in behavior. On a dataset of 1.7 million listening events from Last.fm, we evaluate the performance of our approach by sequentially predicting the next track(s) in user sessions. We find that recency and frequency of prior exposure to tracks is an effective predictor of relistening behavior. Besides, considering the co occurrence of tracks and familiarity with tracks further improves performance in terms of R precision. We hope that our work inspires future research on the merits of considering cognitive aspects of memory retrieval to model and predict complex user behavior.


Hypergeometric Functions over Finite Fields and Modular Forms A Survey and New Conjectures. Hypergeometric functions over finite fields were introduced by Greene in the 1980s as a finite field analogue of classical hypergeometric series. These functions, and their generalizations, naturally lend themselves to, and have been widely used in, character sum evaluations and counting points on algebraic varieties. More interestingly, perhaps, are their links to Fourier coefficients of modular forms. In this paper, we outline the main results in this area and also conjecture 13 new relations.


On the Chow ring of some Lagrangian fibrations. Let X be a hyperk "ahler variety admitting a Lagrangian fibration. Beauville's "splitting property" conjecture predicts that fibres of the Lagrangian fibration should have a particular behaviour in the Chow ring of X . We study this conjectural behaviour for two very classical examples of Lagrangian fibrations.


DepOwl Detecting Dependency Bugs to Prevent Compatibility Failures. Applications depend on libraries to avoid reinventing the wheel. Libraries may have incompatible changes during evolving. As a result, applications will suffer from compatibility failures. There has been much research on addressing detecting incompatible changes in libraries, or helping applications co evolve with the libraries. The existing solution helps the latest application version work well against the latest library version as an afterthought. However, end users have already been suffering from the failures and have to wait for new versions. In this paper, we propose DepOwl, a practical tool helping users prevent compatibility failures. The key idea is to avoid using incompatible versions from the very beginning. We evaluated DepOwl on 38 known compatibility failures from StackOverflow, and DepOwl can prevent 32 of them. We also evaluated DepOwl using the software repository shipped with Ubuntu 19.10. DepOwl detected 77 unknown dependency bugs, which may lead to compatibility failures.


A Simple Long Tailed Recognition Baseline via Vision Language Model. The visual world naturally exhibits a long tailed distribution of open classes, which poses great challenges to modern visual systems. Existing approaches either perform class re balancing strategies or directly improve network modules to address the problem. However, they still train models with a finite set of predefined labels, limiting their supervision information and restricting their transferability to novel instances. Recent advances in large scale contrastive visual language pretraining shed light on a new pathway for visual recognition. With open vocabulary supervisions, pretrained contrastive vision language models learn powerful multimodal representations that are promising to handle data deficiency and unseen concepts. By calculating the semantic similarity between visual and text inputs, visual recognition is converted to a vision language matching problem. Inspired by this, we propose BALLAD to leverage contrastive vision language models for long tailed recognition. We first continue pretraining the vision language backbone through contrastive learning on a specific long tailed target dataset. Afterward, we freeze the backbone and further employ an additional adapter layer to enhance the representations of tail classes on balanced training samples built with re sampling strategies. Extensive experiments have been conducted on three popular long tailed recognition benchmarks. As a result, our simple and effective approach sets the new state of the art performances and outperforms competitive baselines with a large margin. Code is released at https github.com gaopengcuhk BALLAD.


Filter Distribution Templates in Convolutional Networks for Image Classification Tasks. Neural network designers have reached progressive accuracy by increasing models depth, introducing new layer types and discovering new combinations of layers. A common element in many architectures is the distribution of the number of filters in each layer. Neural network models keep a pattern design of increasing filters in deeper layers such as those in LeNet, VGG, ResNet, MobileNet and even in automatic discovered architectures such as NASNet. It remains unknown if this pyramidal distribution of filters is the best for different tasks and constrains. In this work we present a series of modifications in the distribution of filters in four popular neural network models and their effects in accuracy and resource consumption. Results show that by applying this approach, some models improve up to 8.9 in accuracy showing reductions in parameters up to 54 .


Doping MAPbBr 3 hybrid perovskites with CdSe CdZnS quantum dots from emissive thin films to hybrid single photon sources. We report the first doping of crystalline methylammonium lead bromide (MAPbBr 3 ) perovskite thin films with CdSe CdZnS core shell quantum dots (QDs), using a soft chemistry method that preserves their high quantum yield and other remarkable fluorescence properties. Our approach produces MAPbBr 3 films of 100 nm thickness doped at volume ratios between 0.025 and 5 with colloidal CdSe CdZnS QDs whose organic ligands are exchanged with halide ions to allow for close contact between the QDs and the perovskite matrix. Ensemble photoluminescence (PL) measurements demonstrate the retained emission of the QDs after incorporation into the MAPbBr 3 matrix. Ensemble photoluminescence excitation (PLE) spectra exhibit signatures of wavelength dependent coupling between the CdSe CdZnS QDs and the MAPbBr 3 matrix. Spatially resolved PL experiments reveal a strong correlation between the positions of QDs and an enhancement of the PL signal of the matrix. Fluorescence lifetime imaging (FLIM)of the doped films furthermore show that the emission lifetime of MAPbBr 3 is slower in the vicinity of QDs, which, in combination with the increased PL signal of the matrix, suggests that QDs can act as nucleation seeds that improve the crystallinity of MAPbBr 3 , boosting its emission quantum yield. Antibunching measurements provide clear evidence of single photon emission from individual QDs in perovskite. Finally, the analysis of blinking statistics indicates an improvement of the photostability of individual QDs in perovskite as compared to bare CdSe CdZnS QDs. At high doping levels, this work opens the route to hybrid based LEDs. Low doping content would lead to hybrid single photon sources embedded in field effect devices to serve as an alternative to solid state QDs and help building nanophotonic devices with high quantum yield CdSe based QDs.


All you need are a few pixels semantic segmentation with PixelPick. A central challenge for the task of semantic segmentation is the prohibitive cost of obtaining dense pixel level annotations to supervise model training. In this work, we show that in order to achieve a good level of segmentation performance, all you need are a few well chosen pixel labels. We make the following contributions (i) We investigate the novel semantic segmentation setting in which labels are supplied only at sparse pixel locations, and show that deep neural networks can use a handful of such labels to good effect (ii) We demonstrate how to exploit this phenomena within an active learning framework, termed PixelPick, to radically reduce labelling cost, and propose an efficient "mouse free" annotation strategy to implement our approach (iii) We conduct extensive experiments to study the influence of annotation diversity under a fixed budget, model pretraining, model capacity and the sampling mechanism for picking pixels in this low annotation regime (iv) We provide comparisons to the existing state of the art in semantic segmentation with active learning, and demonstrate comparable performance with up to two orders of magnitude fewer pixel annotations on the CamVid, Cityscapes and PASCAL VOC 2012 benchmarks (v) Finally, we evaluate the efficiency of our annotation pipeline and its sensitivity to annotator error to demonstrate its practicality.


Each Attribute Matters Contrastive Attention for Sentence based Image Editing. Sentence based Image Editing (SIE) aims to deploy natural language to edit an image. Offering potentials to reduce expensive manual editing, SIE has attracted much interest recently. However, existing methods can hardly produce accurate editing and even lead to failures in attribute editing when the query sentence is with multiple editable attributes. To cope with this problem, by focusing on enhancing the difference between attributes, this paper proposes a novel model called Contrastive Attention Generative Adversarial Network (CA GAN), which is inspired from contrastive training. Specifically, we first design a novel contrastive attention module to enlarge the editing difference between random combinations of attributes which are formed during training. We then construct an attribute discriminator to ensure effective editing on each attribute. A series of experiments show that our method can generate very encouraging results in sentence based image editing with multiple attributes on CUB and COCO dataset. Our code is available at https github.com Zlq2021 CA GAN


CropDefender deep watermark which is more convenient to train and more robust against cropping. Digital image watermarking, which is a technique for invisibly embedding information into an image, is used in fields such as property rights protection. In recent years, some research has proposed the use of neural networks to add watermarks to natural images. We take StegaStamp as an example for our research. Whether facing traditional image editing methods, such as brightness, contrast, saturation adjustment, or style change like 1 bit conversion, GAN, StegaStamp has robustness far beyond traditional watermarking techniques, but it still has two drawbacks it is vulnerable to cropping and is hard to train. We found that the causes of vulnerability to cropping is not the loss of information on the edge, but the movement of watermark position. By explicitly introducing the perturbation of cropping into the training, the cropping resistance is significantly improved. For the problem of difficult training, we introduce instance normalization to solve the vanishing gradient, set losses' weights as learnable parameters to reduce the number of hyperparameters, and use sigmoid to restrict pixel values of the generated image.