An Open Source Tool for Classification Models in Resource Constrained Hardware. Applications that need to sense, measure, and gather real time information from the environment frequently face three main restrictions power consumption, cost, and lack of infrastructure. Most of the challenges imposed by these limitations can be better addressed by embedding Machine Learning (ML) classifiers in the hardware that senses the environment, creating smart sensors able to interpret the low level data stream. However, for this approach to be cost effective, we need highly efficient classifiers suitable to execute in unresourceful hardware, such as low power microcontrollers. In this paper, we present an open source tool named EmbML Embedded Machine Learning that implements a pipeline to develop classifiers for resource constrained hardware. We describe its implementation details and provide a comprehensive analysis of its classifiers considering accuracy, classification time, and memory usage. Moreover, we compare the performance of its classifiers with classifiers produced by related tools to demonstrate that our tool provides a diverse set of classification algorithms that are both compact and accurate. Finally, we validate EmbML classifiers in a practical application of a smart sensor and trap for disease vector mosquitoes.


Density Dependent Singular Stochastic Differential Equations. The (strong and weak) well posedness is proved for singular SDEs depending on the distribution density point wisely and globally, where the drift satisfies a local integrability condition in time spatial variables, and is Lipschitz continuous in the distribution density with respect to a local L k norm. Density dependent reflecting SDEs are also studied.


Empirical Conditional Method A New Approach to Predict Throughput in TCP Mobile Data Network. Experience of live video streaming can be improved if future available bandwidth can be predicted more accurately at the video uploader side. Thus follows a natural question which is how to make predictions both easily and precisely in an ever changing network. Researchers have developed many prediction algorithms in the literature, from where a simple algorithm, Arithmetic Mean (AM), stands out. Based on that, we are purposing a new method called Empirical Conditional Method (ECM) based on a Markov model, hoping to utilize more information in the past data to get a more accurate prediction without loss of practicality. Through simulations, we found that our ECM algorithm performs better than the commonly used AM one, in the sense of reducing the loss by about 10 compared with AM. Besides, ECM also has a higher utilization rate of available bandwidth, which means ECM can send more data out while not having a higher loss rate or delay, especially under a low FPS setting. ECM can be more helpful for those who have relatively limited networks to reach a more considerable balance between frame loss rate and video quality hence improving the quality of experience.


DeepInsight Interpretability Assisting Detection of Adversarial Samples on Graphs. With the rapid development of artificial intelligence, a number of machine learning algorithms, such as graph neural networks have been proposed to facilitate network analysis or graph data mining. Although effective, recent studies show that these advanced methods may suffer from adversarial attacks, i.e., they may lose effectiveness when only a small fraction of links are unexpectedly changed. This paper investigates three well known adversarial attack methods, i.e., Nettack, Meta Attack, and GradArgmax. It is found that different attack methods have their specific attack preferences on changing the target network structures. Such attack pattern are further verified by experimental results on some real world networks, revealing that generally the top four most important network attributes on detecting adversarial samples suffice to explain the preference of an attack method. Based on these findings, the network attributes are utilized to design machine learning models for adversarial sample detection and attack method recognition with outstanding performance.


Forward Backward algorithms for stochastic Nash equilibrium seeking in restricted strongly and strictly monotone games. We study stochastic Nash equilibrium problems with expected valued cost functions whose pseudogradient satisfies restricted monotonicity properties which hold only with respect to the solution. We propose a forward backward algorithm and prove its convergence under restricted strong monotonicity, restricted strict monotonicity and restricted cocoercivity of the pseudogradient mapping. To approximate the expected value, we use either a finite number of samples and a vanishing step size or an increasing number of samples with a constant step. Numerical simulations show that our proposed algorithm might be faster than the available algorithms.


Further examples of non geometric sections of arithmetic fundamental groups. We show the existence of group theoretic sections of certain geometrically pro nilpotent by abelian arithmetic fundamental groups of hyperbolic curves over p adic local fields which are non geometric, i.e., which do not arise from rational points. Among these quotients is the geometrically metabelian arithmetic fundamental group.


Adversarially Regularized Graph Attention Networks for Inductive Learning on Partially Labeled Graphs. Graph embedding is a general approach to tackling graph analytic problems by encoding nodes into low dimensional representations. Most existing embedding methods are transductive since the information of all nodes is required in training, including those to be predicted. In this paper, we propose a novel inductive embedding method for semi supervised learning on graphs. This method generates node representations by learning a parametric function to aggregate information from the neighborhood using an attention mechanism, and hence naturally generalizes to previously unseen nodes. Furthermore, adversarial training serves as an external regularization enforcing the learned representations to match a prior distribution for improving robustness and generalization ability. Experiments on real world clean or noisy graphs are used to demonstrate the effectiveness of this approach.


Continuity of envelopes of unbounded plurisubharmonic functions. On bounded B regular domains, we study envelopes of plurisubharmonic functions bounded from above by a function phi such that phi phi on the closure of the domain. For phi satisfying certain additional criteria limiting its behavior at the singularities, we establish a set where the Perron Bremermann envelope P phi is guaranteed to be continuous. This result is a generalization of a classic result in pluripotential theory due to J. B. Walsh. As an application, we show that the complex Monge Amp ere equation (dd cu) n mu being uniquely solvable for continuous boundary data implies that it is also uniquely solvable for a class of boundary values unbounded from above.


PFENet Boosting Few shot Semantic Segmentation with the Noise filtered Context aware Prior Mask. In this work, we revisit the prior mask guidance proposed in "Prior Guided Feature Enrichment Network for Few Shot Segmentation". The prior mask serves as an indicator that highlights the region of interests of unseen categories, and it is effective in achieving better performance on different frameworks of recent studies. However, the current method directly takes the maximum element to element correspondence between the query and support features to indicate the probability of belonging to the target class, thus the broader contextual information is seldom exploited during the prior mask generation. To address this issue, first, we propose the Context aware Prior Mask (CAPM) that leverages additional nearby semantic cues for better locating the objects in query images. Second, since the maximum correlation value is vulnerable to noisy features, we take one step further by incorporating a lightweight Noise Suppression Module (NSM) to screen out the unnecessary responses, yielding high quality masks for providing the prior knowledge. Both two contributions are experimentally shown to have substantial practical merit, and the new model named PFENet significantly outperforms the baseline PFENet as well as all other competitors on three challenging benchmarks PASCAL 5 i , COCO 20 i and FSS 1000. The new state of the art performance is achieved without compromising the efficiency, manifesting the potential for being a new strong baseline in few shot semantic segmentation. Our code will be available at https github.com dvlab research PFENet .


Contact simulation of a 2D Bipedal Robot kicking a ball. This report describes an approach for simulating multi body contacts of actively controlled systems. In this work, we focus on the controls and contact simulation of a 2 dimensional bipedal robot kicking a circular ball.


HENet Forcing a Network to Think More for Font Recognition. Although lots of progress were made in Text Recognition OCR in recent years, the task of font recognition is remaining challenging. The main challenge lies in the subtle difference between these similar fonts, which is hard to distinguish. This paper proposes a novel font recognizer with a pluggable module solving the font recognition task. The pluggable module hides the most discriminative accessible features and forces the network to consider other complicated features to solve the hard examples of similar fonts, called HE Block. Compared with the available public font recognition systems, our proposed method does not require any interactions at the inference stage. Extensive experiments demonstrate that HENet achieves encouraging performance, including on character level dataset Explor all and word level dataset AdobeVFR


Multi Agent Reinforcement Learning for Joint Cooperative Spectrum Sensing and Channel Access in Cognitive UAV Networks. This paper studies the problem of distributed spectrum channel access for cognitive radio enabled unmanned aerial vehicles (CUAVs) that overlay upon primary channels. Under the framework of cooperative spectrum sensing and opportunistic transmission, a one shot optimization problem for channel allocation, aiming to maximize the expected cumulative weighted reward of multiple CUAVs, is formulated. To handle the uncertainty due to the lack of prior knowledge about the primary user activities as well as the lack of the channel access coordinator, the original problem is cast into a competition and cooperation hybrid multi agent reinforcement learning (CCH MARL) problem in the framework of Markov game (MG). Then, a value iteration based RL algorithm, which features upper confidence bound Hoeffding (UCB H) strategy searching, is proposed by treating each CUAV as an independent learner (IL). To address the curse of dimensionality, the UCB H strategy is further extended with a double deep Q network (DDQN). Numerical simulations show that the proposed algorithms are able to efficiently converge to stable strategies, and significantly improve the network performance when compared with the benchmark algorithms such as the vanilla Q learning and DDQN algorithms.


New upper bounds for the forgotten index among bicyclic graphs. The forgotten topological index of a graph G , denoted by F(G) , is defined as the sum of weights d(u) 2 d(v) 2 over all edges uv of G , where d(u) denotes the degree of a vertex u . In this paper, we give sharp upper bounds of the F index (forgotten topological index) over bicyclic graphs, in terms of the order and maximum degree.


Necklace structured high harmonic generation for low divergence, soft X ray harmonic combs with tunable line spacing. The extreme nonlinear optical process of high harmonic generation (HHG) makes it possible to map the properties of a laser beam onto a radiating electron wavefunction, and in turn, onto the emitted x ray light. Bright HHG beams typically emerge from a longitudinal phased distribution of atomic scale quantum antennae. Here, we form a transverse necklace shaped phased array of HHG emitters, where orbital angular momentum conservation allows us to tune the line spacing and divergence properties of extreme ultraviolet and soft X ray high harmonic combs. The on axis HHG emission has extremely low divergence, well below that obtained when using Gaussian driving beams, which further decreases with harmonic order. This work provides a new degree of freedom for the design of harmonic combs, particularly in the soft X ray regime, where very limited options are available. Such harmonic beams can enable more sensitive probes of the fastest correlated charge and spin dynamics in molecules, nanoparticles and materials.


PhishMatch A Layered Approach for Effective Detection of Phishing URLs. Phishing attacks continue to be a significant threat on the Internet. Prior studies show that it is possible to determine whether a website is phishing or not just by analyzing its URL more carefully. A major advantage of the URL based approach is that it can identify a phishing website even before the web page is rendered in the browser, thus avoiding other potential problems such as cryptojacking and drive by downloads. However, traditional URL based approaches have their limitations. Blacklist based approaches are prone to zero hour phishing attacks, advanced machine learning based approaches consume high resources, and other approaches send the URL to a remote server which compromises user's privacy. In this paper, we present a layered anti phishing defense, PhishMatch, which is robust, accurate, inexpensive, and client side. We design a space time efficient Aho Corasick algorithm for exact string matching and n gram based indexing technique for approximate string matching to detect various cybersquatting techniques in the phishing URL. To reduce false positives, we use a global whitelist and personalized user whitelists. We also determine the context in which the URL is visited and use that information to classify the input URL more accurately. The last component of PhishMatch involves a machine learning model and controlled search engine queries to classify the URL. A prototype plugin of PhishMatch, developed for the Chrome browser, was found to be fast and lightweight. Our evaluation shows that PhishMatch is both efficient and effective.


Domain Generalization for Vision based Driving Trajectory Generation. One of the challenges in vision based driving trajectory generation is dealing with out of distribution scenarios. In this paper, we propose a domain generalization method for vision based driving trajectory generation for autonomous vehicles in urban environments, which can be seen as a solution to extend the Invariant Risk Minimization (IRM) method in complex problems. We leverage an adversarial learning approach to train a trajectory generator as the decoder. Based on the pre trained decoder, we infer the latent variables corresponding to the trajectories, and pre train the encoder by regressing the inferred latent variable. Finally, we fix the decoder but fine tune the encoder with the final trajectory loss. We compare our proposed method with the state of the art trajectory generation method and some recent domain generalization methods on both datasets and simulation, demonstrating that our method has better generalization ability.


Optimal Algorithms for Range Searching over Multi Armed Bandits. This paper studies a multi armed bandit (MAB) version of the range searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified point, we have an associated weight, and the problem objective is to find a maximum weight point within every given interval. The current work addresses range searching with stochastic weights each point corresponds to an arm (that admits sample access) and the point's weight is the (unknown) mean of the underlying distribution. In this MAB setup, we develop sample efficient algorithms that find, with high probability, near optimal arms within the given intervals, i.e., we obtain PAC (probably approximately correct) guarantees. We also provide an algorithm for a generalization wherein the weight of each point is a multi dimensional vector. The sample complexities of our algorithms depend, in particular, on the size of the optimal hitting set of the given intervals. Finally, we establish lower bounds proving that the obtained sample complexities are essentially tight. Our results highlight the significance of geometric constructs specifically, hitting sets in our MAB setting.


Visualizing Representations of Adversarially Perturbed Inputs. It has been shown that deep learning models are vulnerable to adversarial attacks. We seek to further understand the consequence of such attacks on the intermediate activations of neural networks. We present an evaluation metric, POP N, which scores the effectiveness of projecting data to N dimensions under the context of visualizing representations of adversarially perturbed inputs. We conduct experiments on CIFAR 10 to compare the POP 2 score of several dimensionality reduction algorithms across various adversarial attacks. Finally, we utilize the 2D data corresponding to high POP 2 scores to generate example visualizations.


Towards Discovery and Attribution of Open world GAN Generated Images. With the recent progress in Generative Adversarial Networks (GANs), it is imperative for media and visual forensics to develop detectors which can identify and attribute images to the model generating them. Existing works have shown to attribute images to their corresponding GAN sources with high accuracy. However, these works are limited to a closed set scenario, failing to generalize to GANs unseen during train time and are therefore, not scalable with a steady influx of new GANs. We present an iterative algorithm for discovering images generated from previously unseen GANs by exploiting the fact that all GANs leave distinct fingerprints on their generated images. Our algorithm consists of multiple components including network training, out of distribution detection, clustering, merge and refine steps. Through extensive experiments, we show that our algorithm discovers unseen GANs with high accuracy and also generalizes to GANs trained on unseen real datasets. We additionally apply our algorithm to attribution and discovery of GANs in an online fashion as well as to the more standard task of real fake detection. Our experiments demonstrate the effectiveness of our approach to discover new GANs and can be used in an open world setup.


Enhanced Boundary Learning for Glass like Object Segmentation. Glass like objects such as windows, bottles, and mirrors exist widely in the real world. Sensing these objects has many applications, including robot navigation and grasping. However, this task is very challenging due to the arbitrary scenes behind glass like objects. This paper aims to solve the glass like object segmentation problem via enhanced boundary learning. In particular, we first propose a novel refined differential module that outputs finer boundary cues. We then introduce an edge aware point based graph convolution network module to model the global shape along the boundary. We use these two modules to design a decoder that generates accurate and clean segmentation results, especially on the object contours. Both modules are lightweight and effective they can be embedded into various segmentation models. In extensive experiments on three recent glass like object segmentation datasets, including Trans10k, MSD, and GDD, our approach establishes new state of the art results. We also illustrate the strong generalization properties of our method on three generic segmentation datasets, including Cityscapes, BDD, and COCO Stuff. Code and models is available at url https github.com hehao13 EBLNet .


A Bayesian Framework for Information Theoretic Probing. Pimentel et al. (2020) recently analysed probing from an information theoretic perspective. They argue that probing should be seen as approximating a mutual information. This led to the rather unintuitive conclusion that representations encode exactly the same information about a target task as the original sentences. The mutual information, however, assumes the true probability distribution of a pair of random variables is known, leading to unintuitive results in settings where it is not. This paper proposes a new framework to measure what we term Bayesian mutual information, which analyses information from the perspective of Bayesian agents allowing for more intuitive findings in scenarios with finite data. For instance, under Bayesian MI we have that data can add information, processing can help, and information can hurt, which makes it more intuitive for machine learning applications. Finally, we apply our framework to probing where we believe Bayesian mutual information naturally operationalises ease of extraction by explicitly limiting the available background knowledge to solve a task.


Deep Learning based Novel View Synthesis. Predicting novel views of a scene from real world images has always been a challenging task. In this work, we propose a deep convolutional neural network (CNN) which learns to predict novel views of a scene from given collection of images. In comparison to prior deep learning based approaches, which can handle only a fixed number of input images to predict novel view, proposed approach works with different numbers of input images. The proposed model explicitly performs feature extraction and matching from a given pair of input images and estimates, at each pixel, the probability distribution (pdf) over possible depth levels in the scene. This pdf is then used for estimating the novel view. The model estimates multiple predictions of novel view, one estimate per input image pair, from given image collection. The model also estimates an occlusion mask and combines multiple novel view estimates in to a single optimal prediction. The finite number of depth levels used in the analysis may cause occasional blurriness in the estimated view. We mitigate this issue with simple multi resolution analysis which improves the quality of the estimates. We substantiate the performance on different datasets and show competitive performance.


Refined decay bounds on the entries of spectral projectors associated with sparse Hermitian matrices. Spectral projectors of Hermitian matrices play a key role in many applications, and especially in electronic structure computations. Linear scaling methods for gapped systems are based on the fact that these special matrix functions are localized, which means that the entries decay exponentially away from the main diagonal or with respect to more general sparsity patterns. The relation with the sign function together with an integral representation is used to obtain new decay bounds, which turn out to be optimal in an asymptotic sense. The influence of isolated eigenvalues in the spectrum on the decay properties is also investigated and a superexponential behaviour is predicted.


Compact and weakly compact Lipschitz operators. Any Lipschitz map f M to N between two pointed metric spaces may be extended in a unique way to a bounded linear operator widehat f mathcal F(M) to mathcal F(N) between their corresponding Lipschitz free spaces. In this paper, we give a necessary and sufficient condition for widehat f to be compact in terms of metric conditions on f . This extends a result by A. Jim ' e nez Vargas and M. Villegas Vallecillos in the case of non separable and unbounded metric spaces. After studying the behavior of weakly convergent sequences made of finitely supported elements in Lipschitz free spaces, we also deduce that widehat f is compact if and only if it is weakly compact.


SURFNet Super resolution of Turbulent Flows with Transfer Learning using Small Datasets. Deep Learning (DL) algorithms are emerging as a key alternative to computationally expensive CFD simulations. However, state of the art DL approaches require large and high resolution training data to learn accurate models. The size and availability of such datasets are a major limitation for the development of next generation data driven surrogate models for turbulent flows. This paper introduces SURFNet, a transfer learning based super resolution flow network. SURFNet primarily trains the DL model on low resolution datasets and transfer learns the model on a handful of high resolution flow problems accelerating the traditional numerical solver independent of the input size. We propose two approaches to transfer learning for the task of super resolution, namely one shot and incremental learning. Both approaches entail transfer learning on only one geometry to account for fine grid flow fields requiring 15x less training data on high resolution inputs compared to the tiny resolution (64x256) of the coarse model, significantly reducing the time for both data collection and training. We empirically evaluate SURFNet's performance by solving the Navier Stokes equations in the turbulent regime on input resolutions up to 256x larger than the coarse model. On four test geometries and eight flow configurations unseen during training, we observe a consistent 2 2.1x speedup over the OpenFOAM physics solver independent of the test geometry and the resolution size (up to 2048x2048), demonstrating both resolution invariance and generalization capabilities. Our approach addresses the challenge of reconstructing high resolution solutions from coarse grid models trained using low resolution inputs (super resolution) without loss of accuracy and requiring limited computational resources.


A novel multigrid method for elliptic distributed control problems. Large linear systems of saddle point type have arisen in a wide variety of applications throughout computational science and engineering. The discretizations of distributed control problems have a saddle point structure. The numerical solution of saddle point problems has attracted considerable interest in recent years. In this work, we propose a novel Braess Sarazin multigrid relaxation scheme for finite element discretizations of the distributed control problems, where we use the stiffness matrix obtained from the five point finite difference method for the Laplacian to approximate the inverse of the mass matrix arising in the saddle point system. We apply local Fourier analysis to examine the smoothing properties of the Braess Sarazin multigrid relaxation. From our analysis, the optimal smoothing factor for Braess Sarazin relaxation is derived. Numerical experiments validate our theoretical results. The relaxation scheme considered here shows its high efficiency and robustness with respect to the regularization parameter and grid size.


Efficient and Privacy Preserving Infection Control System for Covid 19 Like Pandemics using Blockchain. Contact tracing is a very effective way to control the COVID 19 like pandemics. It aims to identify individuals who closely contacted an infected person during the incubation period of the virus and notify them to quarantine. However, the existing systems suffer from privacy, security, and efficiency issues. To address these limitations, in this paper, we propose an efficient and privacy preserving Blockchain based infection control system. Instead of depending on a single authority to run the system, a group of health authorities, that form a consortium Blockchain, run our system. Using Blockchain technology not only secures our system against single point of failure and denial of service attacks, but also brings transparency because all transactions can be validated by different parties. Although contact tracing is important, it is not enough to effectively control an infection. Thus, unlike most of the existing systems that focus only on contact tracing, our system consists of three integrated subsystems, including contact tracing, public places access control, and safe places recommendation. The access control subsystem prevents infected people from visiting public places to prevent spreading the virus, and the recommendation subsystem categorizes zones based on the infection level so that people can avoid visiting contaminated zones. Our analysis demonstrates that our system is secure and preserves the privacy of the users against identification, social graph disclosure, and tracking attacks, while thwarting false reporting (or panic) attacks. Moreover, our extensive performance evaluations demonstrate the scalability of our system (which is desirable in pandemics) due to its low communication, computation, and storage overheads.


HumanGAN A Generative Model of Humans Images. Generative adversarial networks achieve great performance in photorealistic image synthesis in various domains, including human images. However, they usually employ latent vectors that encode the sampled outputs globally. This does not allow convenient control of semantically relevant individual parts of the image, and is not able to draw samples that only differ in partial aspects, such as clothing style. We address these limitations and present a generative model for images of dressed humans offering control over pose, local body part appearance and garment style. This is the first method to solve various aspects of human image generation such as global appearance sampling, pose transfer, parts and garment transfer, and parts sampling jointly in a unified framework. As our model encodes part based latent appearance vectors in a normalized pose independent space and warps them to different poses, it preserves body and clothing appearance under varying posture. Experiments show that our flexible and general generative method outperforms task specific baselines for pose conditioned image generation, pose transfer and part sampling in terms of realism and output resolution.


A topological characterisation of the Kashiwara Vergne groups. In 2017 Bar Natan and the first author showed that solutions to the Kashiwara Vergne equations are in bijection with certain knot invariants homomorphic expansions of welded foams. Welded foams are a class of knotted tubes in mathbb R 4 , which can be finitely presented algebraically as a circuit algebra, or, equivalently, a wheeled prop. In this paper we describe the Kashiwara Vergne groups mathsf KV and mathsf KRV the symmetry groups of Kashiwara Vergne solutions as automorphisms of the completed circuit algebras of welded foams, and their associated graded circuit algebra of arrow diagrams, respectively. Finally, we provide a description of the graded Grothendieck Teichm "uller group mathsf GRT 1 as automorphisms of arrow diagrams.


Towards General and Efficient Active Learning. Active learning selects the most informative samples to exploit limited annotation budgets. Existing work follows a cumbersome pipeline that repeats the time consuming model training and batch data selection multiple times. In this paper, we challenge this status quo by proposing a novel general and efficient active learning (GEAL) method following our designed new pipeline. Utilizing a publicly available pretrained model, our method selects data from different datasets with a single pass inference of the same model without extra training or supervision. To capture subtle local information, we propose knowledge clusters extracted from intermediate features. Free from the troublesome batch selection strategy, all data samples are selected in one shot through a distance based sampling in the fine grained knowledge cluster level. This whole process is faster than prior arts by hundreds of times. Extensive experiments verify the effectiveness of our method on object detection, image classification, and semantic segmentation. Our code is publicly available in https github.com yichen928 GEAL active learning.


Theorem Proving and Algebra. This book can be seen either as a text on theorem proving that uses techniques from general algebra, or else as a text on general algebra illustrated and made concrete by practical exercises in theorem proving. The book considers several different logical systems, including first order logic, Horn clause logic, equational logic, and first order logic with equality. Similarly, several different proof paradigms are considered. However, we do emphasize equational logic, and for simplicity we use only the OBJ3 software system, though it is used in a rather flexible manner. We do not pursue the lofty goal of mechanizing proofs like those of which mathematicians are justly so proud instead, we seek to take steps towards providing mechanical assistance for proofs that are useful for computer scientists in developing software and hardware. This more modest goal has the advantage of both being achievable and having practical benefits. The following topics are covered many sorted signature, algebra and homomorphism term algebra and substitution equation and satisfaction conditional equations equational deduction and its completeness deduction for conditional equations the theorem of constants interpretation and equivalence of theories term rewriting, termination, confluence and normal form abstract rewrite systems standard models, abstract data types, initiality, and induction rewriting and deduction modulo equations first order logic, models, and proof planning second order algebra order sorted algebra and rewriting modules unification and completion and hidden algebra. In parallel with these are a gradual introduction to OBJ3, applications to group theory, various abstract data types (such as number systems, lists, and stacks), propositional calculus, hardware verification, the lambda calculus, correctness of functional programs, and other topics.


Deep Stochastic Volatility Model. Volatility for financial assets returns can be used to gauge the risk for financial market. We propose a deep stochastic volatility model (DSVM) based on the framework of deep latent variable models. It uses flexible deep learning models to automatically detect the dependence of the future volatility on past returns, past volatilities and the stochastic noise, and thus provides a flexible volatility model without the need to manually select features. We develop a scalable inference and learning algorithm based on variational inference. In real data analysis, the DSVM outperforms several popular alternative volatility models. In addition, the predicted volatility of the DSVM provides a more reliable risk measure that can better reflex the risk in the financial market, reaching more quickly to a higher level when the market becomes more risky and to a lower level when the market is more stable, compared with the commonly used GARCH type model with a huge data set on the U.S. stock market.


Crepant resolutions of quotient varieties in positive characteristics and their Euler characteristics. In characteristic zero, if a quotient variety has a crepant resolution, the Euler characteristic of the crepant resolution is equal to the number of conjugacy classes of the acting group, by Batyrev's theorem. This is one of the McKay correspondence. It is natural to consider the analogue statement in the positive characteristic. In this paper, we present sequences of crepant resolutions of quotient varieties in the positive characteristic and show that one of the sequences gives a counterexample to the analogue statement of Batyrev's theorem.


Hopscotching Jellyfish combining different duty cycle kinematics can lead to enhanced swimming performance. Jellyfish (Medusozoa) have been deemed the most energy efficient animals in the world. Their bell morphology and relatively simple nervous systems make them attractive to robotocists. Although, the science community has devoted much attention to understanding their swimming performance, there is still much to be learned about the jet propulsive locomotive gait displayed by prolate jellyfish. Traditionally, computational scientists have assumed uniform duty cycle kinematics when computationally modeling jellyfish locomotion. In this study we used fluid structure interaction modeling to determine possible enhancements in performance from shuffling different duty cycles together across multiple Reynolds numbers and contraction frequencies. Increases in speed and reductions in cost of transport were observed as high as 80 and 50 , respectively. Generally, the net effects were greater for cases involving lower contraction frequencies. Overall, robust duty cycle combinations were determined that led to enhanced or impeded performance.


Structured Reordering for Modeling Latent Alignments in Sequence Transduction. Despite success in many domains, neural models struggle in settings where train and test examples are drawn from different distributions. In particular, in contrast to humans, conventional sequence to sequence (seq2seq) models fail to generalize systematically, i.e., interpret sentences representing novel combinations of concepts (e.g., text segments) seen in training. Traditional grammar formalisms excel in such settings by implicitly encoding alignments between input and output segments, but are hard to scale and maintain. Instead of engineering a grammar, we directly model segment to segment alignments as discrete structured latent variables within a neural seq2seq model. To efficiently explore the large space of alignments, we introduce a reorder first align later framework whose central component is a neural reordering module producing it separable permutations. We present an efficient dynamic programming algorithm performing exact marginal inference of separable permutations, and, thus, enabling end to end differentiable training of our model. The resulting seq2seq model exhibits better systematic generalization than standard models on synthetic problems and NLP tasks (i.e., semantic parsing and machine translation).


Combining Latent Space and Structured Kernels for Bayesian Optimization over Combinatorial Spaces. We consider the problem of optimizing combinatorial spaces (e.g., sequences, trees, and graphs) using expensive black box function evaluations. For example, optimizing molecules for drug design using physical lab experiments. Bayesian optimization (BO) is an efficient framework for solving such problems by intelligently selecting the inputs with high utility guided by a learned surrogate model. A recent BO approach for combinatorial spaces is through a reduction to BO over continuous spaces by learning a latent representation of structures using deep generative models (DGMs). The selected input from the continuous space is decoded into a discrete structure for performing function evaluation. However, the surrogate model over the latent space only uses the information learned by the DGM, which may not have the desired inductive bias to approximate the target black box function. To overcome this drawback, this paper proposes a principled approach referred as LADDER. The key idea is to define a novel structure coupled kernel that explicitly integrates the structural information from decoded structures with the learned latent space representation for better surrogate modeling. Our experiments on real world benchmarks show that LADDER significantly improves over the BO over latent space method, and performs better or similar to state of the art methods.


Co segmentation Inspired Attention Module for Video based Computer Vision Tasks. Video based computer vision tasks can benefit from the estimation of the salient regions and interactions between those regions. Traditionally, this has been done by identifying the object regions in the images by utilizing pre trained models to perform object detection, object segmentation, and or object pose estimation. Though using pre trained models seems to be a viable approach, it is infeasible in practice due to the need for exhaustive annotation of object categories, domain gap between datasets, and bias present in pre trained models. To overcome these downsides, we propose to utilize the common rationale that a sequence of video frames capture a set of common objects and interactions between them, thus a notion of co segmentation between the video frame features may equip the model with the ability to automatically focus on salient regions and improve underlying task's performance in an end to end manner. In this regard, we propose a generic module called "Co Segmentation Activation Module" (COSAM) that can be plugged into any CNN to promote the notion of co segmentation based attention among a sequence of video frame features. We show the application of COSAM in three video based tasks namely 1) Video based person re ID, 2) Video captioning, 3) Video action classification, and demonstrate that COSAM is able to capture salient regions in the video frames, thus leading to notable performance improvements along with interpretable attention maps.


Testing the quasicentroid molecular dynamics method on gas phase ammonia. Quasicentroid molecular dynamics (QCMD) is a path integral method for approximating nuclear quantum effects in dynamics simulations, which has given promising results for gas and condensed phase water. Here, by simulating the infrared spectrum of gas phase ammonia, we test the feasibility of extending QCMD beyond water. Overall, QCMD works as well for ammonia as for water, reducing or eliminating blue shifts from the classical spectrum without introducing the artificial red shifts or broadening associated with other imaginary time path integral methods. However, QCMD gives only a modest improvement over the classical spectrum for the position of the symmetric bend mode, which is highly anharmonic (since it correlates with the inversion pathway). We expect QCMD to have similar problems with large amplitude degrees of freedom in other molecules, but otherwise to work as well as for water.


Fast Low Rank column wise Compressive Sensing. In this work, we study the following problem, that we refer to as Low Rank column wise Compressive Sensing (LRcCS) how to recover an n times q rank r matrix, X x 1 , x 2 ,...x q from m independent linear projections of each of its q columns, i.e., from y k A k x k , k in q , when y k is an m length vector. The matrices A k are known and mutually independent for different k . The regime of interest is low rank, i.e., r ll min(n,q) , and undersampled measurements, i.e., m n . Even though many LR recovery problems have been extensively studied in the last decade, this particular problem has received little attention so far in terms of methods with provable guarantees. We introduce a novel gradient descent (GD) based solution called altGDmin. We show that, if all entries of all A k s are i.i.d. Gaussian, and if the right singular vectors of X satisfy the incoherence assumption, then epsilon accurate recovery of X is possible with mq C (n q) r 2 log(1 epsilon) total samples and O( mq nr log (1 epsilon)) time. Compared to existing work, to our best knowledge, this is the fastest solution and, for epsilon 1 sqrt r , it also has the best sample complexity. Moreover, we show that a simple extension of our approach also solves LR Phase Retrieval (LRPR), which is the magnitude only generalization of LRcCS. It involves recovering X from the magnitudes of entries of y k . We show that altGDmin LRPR has matching sample complexity and better time complexity when compared with the (best) existing solution for LRPR.


End to end Alternating Optimization for Blind Super Resolution. Previous methods decompose the blind super resolution (SR) problem into two sequential steps textit i ) estimating the blur kernel from given low resolution (LR) image and textit ii ) restoring the SR image based on the estimated kernel. This two step solution involves two independently trained models, which may not be well compatible with each other. A small estimation error of the first step could cause a severe performance drop of the second one. While on the other hand, the first step can only utilize limited information from the LR image, which makes it difficult to predict a highly accurate blur kernel. Towards these issues, instead of considering these two steps separately, we adopt an alternating optimization algorithm, which can estimate the blur kernel and restore the SR image in a single model. Specifically, we design two convolutional neural modules, namely textit Restorer and textit Estimator . textit Restorer restores the SR image based on the predicted kernel, and textit Estimator estimates the blur kernel with the help of the restored SR image. We alternate these two modules repeatedly and unfold this process to form an end to end trainable network. In this way, textit Estimator utilizes information from both LR and SR images, which makes the estimation of the blur kernel easier. More importantly, textit Restorer is trained with the kernel estimated by textit Estimator , instead of the ground truth kernel, thus textit Restorer could be more tolerant to the estimation error of textit Estimator . Extensive experiments on synthetic datasets and real world images show that our model can largely outperform state of the art methods and produce more visually favorable results at a much higher speed. The source code is available at url https github.com greatlog DAN.git .


Learning to Adversarially Blur Visual Object Tracking. Motion blur caused by the moving of the object or camera during the exposure can be a key challenge for visual object tracking, affecting tracking accuracy significantly. In this work, we explore the robustness of visual object trackers against motion blur from a new angle, i.e., adversarial blur attack (ABA). Our main objective is to online transfer input frames to their natural motion blurred counterparts while misleading the state of the art trackers during the tracking process. To this end, we first design the motion blur synthesizing method for visual tracking based on the generation principle of motion blur, considering the motion information and the light accumulation process. With this synthetic method, we propose optimization based ABA (OP ABA) by iteratively optimizing an adversarial objective function against the tracking w.r.t. the motion and light accumulation parameters. The OP ABA is able to produce natural adversarial examples but the iteration can cause heavy time cost, making it unsuitable for attacking real time trackers. To alleviate this issue, we further propose one step ABA (OS ABA) where we design and train a joint adversarial motion and accumulation predictive network (JAMANet) with the guidance of OP ABA, which is able to efficiently estimate the adversarial motion and accumulation parameters in a one step way. The experiments on four popular datasets (e.g., OTB100, VOT2018, UAV123, and LaSOT) demonstrate that our methods are able to cause significant accuracy drops on four state of the art trackers with high transferability. Please find the source code at url https github.com tsingqguo ABA .


Cross domain error minimization for unsupervised domain adaptation. Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain invariant features to decrease the discrepancy between the feature distributions as well as minimizing the source error and have made remarkable progress. However, a recently proposed theory reveals that such a strategy is not sufficient for a successful domain adaptation. It shows that besides a small source error, both the discrepancy between the feature distributions and the discrepancy between the labeling functions should be small across domains. The discrepancy between the labeling functions is essentially the cross domain errors which are ignored by existing methods. To overcome this issue, in this paper, a novel method is proposed to integrate all the objectives into a unified optimization framework. Moreover, the incorrect pseudo labels widely used in previous methods can lead to error accumulation during learning. To alleviate this problem, the pseudo labels are obtained by utilizing structural information of the target domain besides source classifier and we propose a curriculum learning based strategy to select the target samples with more accurate pseudo labels during training. Comprehensive experiments are conducted, and the results validate that our approach outperforms state of the art methods.


Singularities of parallels to tangent developable surfaces. It is known that the class of developable surfaces which have zero Gaussian curvature in three dimensional Euclidean space is preserved by the parallel transformations. A tangent developable surface is defined as a ruled developable surface by tangent lines to a space curve and it has singularities at least along the space curve, called the directrix or the the edge of regression. Also the class of tangent developable surfaces are invariant under the parallel deformations. In this paper the notions of tangent developable surfaces and their parallels are naturally generalized for frontal curves in general in Euclidean spaces of arbitrary dimensions. We study singularities appearing on parallels to tangent developable surfaces of frontal curves and give the classification of generic singularities on them for frontal curves in 3 or 4 dimensional Euclidean spaces.


Problem solving benefits of down sampled lexicase selection. In genetic programming, an evolutionary method for producing computer programs that solve specified computational problems, parent selection is ordinarily based on aggregate measures of performance across an entire training set. Lexicase selection, by contrast, selects on the basis of performance on random sequences of training cases this has been shown to enhance problem solving power in many circumstances. Lexicase selection can also be seen as better reflecting biological evolution, by modeling sequences of challenges that organisms face over their lifetimes. Recent work has demonstrated that the advantages of lexicase selection can be amplified by down sampling, meaning that only a random subsample of the training cases is used each generation. This can be seen as modeling the fact that individual organisms encounter only subsets of the possible environments, and that environments change over time. Here we provide the most extensive benchmarking of down sampled lexicase selection to date, showing that its benefits hold up to increased scrutiny. The reasons that down sampling helps, however, are not yet fully understood. Hypotheses include that down sampling allows for more generations to be processed with the same budget of program evaluations that the variation of training data across generations acts as a changing environment, encouraging adaptation or that it reduces overfitting, leading to more general solutions. We systematically evaluate these hypotheses, finding evidence against all three, and instead draw the conclusion that down sampled lexicase selection's main benefit stems from the fact that it allows the evolutionary process to examine more individuals within the same computational budget, even though each individual is examined less completely.


On the Relation between Syntactic Divergence and Zero Shot Performance. We explore the link between the extent to which syntactic relations are preserved in translation and the ease of correctly constructing a parse tree in a zero shot setting. While previous work suggests such a relation, it tends to focus on the macro level and not on the level of individual edges a gap we aim to address. As a test case, we take the transfer of Universal Dependencies (UD) parsing from English to a diverse set of languages and conduct two sets of experiments. In one, we analyze zero shot performance based on the extent to which English source edges are preserved in translation. In another, we apply three linguistically motivated transformations to UD, creating more cross lingually stable versions of it, and assess their zero shot parsability. In order to compare parsing performance across different schemes, we perform extrinsic evaluation on the downstream task of cross lingual relation extraction (RE) using a subset of a popular English RE benchmark translated to Russian and Korean. In both sets of experiments, our results suggest a strong relation between cross lingual stability and zero shot parsing performance.


Interactive Object Segmentation with Dynamic Click Transform. In the interactive segmentation, users initially click on the target object to segment the main body and then provide corrections on mislabeled regions to iteratively refine the segmentation masks. Most existing methods transform these user provided clicks into interaction maps and concatenate them with image as the input tensor. Typically, the interaction maps are determined by measuring the distance of each pixel to the clicked points, ignoring the relation between clicks and mislabeled regions. We propose a Dynamic Click Transform Network (DCT Net), consisting of Spatial DCT and Feature DCT, to better represent user interactions. Spatial DCT transforms each user provided click with individual diffusion distance according to the target scale, and Feature DCT normalizes the extracted feature map to a specific distribution predicted from the clicked points. We demonstrate the effectiveness of our proposed method and achieve favorable performance compared to the state of the art on three standard benchmark datasets.


Robotic additive construction of bar structures Unified sequence and motion planning. Additive robotic construction of building scale discrete bar structures, such as trusses and space frames, is increasingly attractive due to the potential improvements in efficiency, safety, and design possibilities. However, programming complex robots, such as manipulators with seven degrees of freedom, to successfully complete construction tasks can be tedious, challenging, or impossible for a human to do manually. Namely, the structure must be constructed in a sequence that preserves structural properties, such as stiffness, at each step. At the same time, this sequence must allow for the robot to precisely manipulate elements within the in progress structure while respecting geometric constraints that, for example, ensure the robot does not collide with what it has built. In this work, we present an automated and newly generalized planning approach for jointly finding a construction sequence and robot motion plan for additive construction that satisfies these requirements. Our approach can be applied in a variety of additive construction processes, and we demonstrate it specifically on spatial extrusion and discrete bar assembly in this paper. We demonstrate the effectiveness of our approach on several simulated and real world extrusion and assembly tasks, including a human scale physical prototype, for which our algorithm is deployed for the first time to plan the assembly of a complicated double tangent bar system design.


Polynomial Matrices, Splitting Subspaces and Krylov Subspaces over Finite Fields. Let T be a linear operator on an mathbb F q vector space V of dimension n . For any divisor m of n , an m dimensional subspace W of V is T splitting if V W oplus TW oplus cdots oplus T d 1 W, where d n m . Let sigma(m,d T) denote the number of m dimensional T splitting subspaces. Determining sigma(m,d T) for an arbitrary operator T is an open problem. This problem is closely related to another open problem on Krylov spaces. We discuss this connection and give explicit formulae for sigma(m,d T) in the case where the invariant factors of T satisfy certain degree conditions. A connection with another enumeration problem on polynomial matrices is also discussed.


A Generalizable Model and Data Driven Approach for Open Set RFF Authentication. Radio frequency fingerprints (RFFs) are promising solutions for realizing low cost physical layer authentication. Machine learning based methods have been proposed for RFF extraction and discrimination. However, most existing methods are designed for the closed set scenario where the set of devices is remains unchanged. These methods can not be generalized to the RFF discrimination of unknown devices. To enable the discrimination of RFF from both known and unknown devices, we propose a new end to end deep learning framework for extracting RFFs from raw received signals. The proposed framework comprises a novel preprocessing module, called neural synchronization (NS), which incorporates the data driven learning with signal processing priors as an inductive bias from communication model based processing. Compared to traditional carrier synchronization techniques, which are static, this module estimates offsets by two learnable deep neural networks jointly trained by the RFF extractor. Additionally, a hypersphere representation is proposed to further improve the discrimination of RFF. Theoretical analysis shows that such a data and model framework can better optimize the mutual information between device identity and the RFF, which naturally leads to better performance. Experimental results verify that the proposed RFF significantly outperforms purely data driven DNN design and existing handcrafted RFF methods in terms of both discrimination and network generalizability.


The Tri Pants Graph of the Twice Punctured Torus. We investigate the structure of the tri pants graph, a simplicial graph introduced by Maloni and Palesi, whose vertices correspond to particular collections of homotopy classes of simple closed curves of the twice punctured torus, called tri pants, and whose edges connect two vertices whenever the corresponding pants differ by suitable elementary moves. In particular, by examining the relationship between the tri pants graph and the dual of the Farey complex, we prove that the tri pants graph is connected and has infinite diameter.


RePOSE Fast 6D Object Pose Refinement via Deep Texture Rendering. We present RePOSE, a fast iterative refinement method for 6D object pose estimation. Prior methods perform refinement by feeding zoomed in input and rendered RGB images into a CNN and directly regressing an update of a refined pose. Their runtime is slow due to the computational cost of CNN, which is especially prominent in multiple object pose refinement. To overcome this problem, RePOSE leverages image rendering for fast feature extraction using a 3D model with a learnable texture. We call this deep texture rendering, which uses a shallow multi layer perceptron to directly regress a view invariant image representation of an object. Furthermore, we utilize differentiable Levenberg Marquardt (LM) optimization to refine a pose fast and accurately by minimizing the feature metric error between the input and rendered image representations without the need of zooming in. These image representations are trained such that differentiable LM optimization converges within few iterations. Consequently, RePOSE runs at 92 FPS and achieves state of the art accuracy of 51.6 on the Occlusion LineMOD dataset a 4.1 absolute improvement over the prior art, and comparable result on the YCB Video dataset with a much faster runtime. The code is available at https github.com sh8 repose.


Text Classification Models for Form Entity Linking. Forms are a widespread type of template based document used in a great variety of fields including, among others, administration, medicine, finance, or insurance. The automatic extraction of the information included in these documents is greatly demanded due to the increasing volume of forms that are generated in a daily basis. However, this is not a straightforward task when working with scanned forms because of the great diversity of templates with different location of form entities, and the quality of the scanned documents. In this context, there is a feature that is shared by all forms they contain a collection of interlinked entities built as key value (or label value) pairs, together with other entities such as headers or images. In this work, we have tacked the problem of entity linking in forms by combining image processing techniques and a text classification model based on the BERT architecture. This approach achieves state of the art results with a F1 score of 0.80 on the FUNSD dataset, a 5 improvement regarding the best previous method. The code of this project is available at https github.com mavillot FUNSD Entity Linking.


A note on the category of equivalence relations. We make some beginning observations about the category mathbb E mathrm q of equivalence relations on the set of natural numbers, where a morphism between two equivalence relations R,S is a mapping from the set of R equivalence classes to that of S equivalence classes, which is induced by a computable function. We also consider some full subcategories of mathbb E mathrm q , such as the category mathbb E mathrm q ( Sigma 0 1) of computably enumerable equivalence relations (called ceers), the category mathbb E mathrm q ( Pi 0 1) of co computably enumerable equivalence relations, and the category mathbb E mathrm q ( mathrm Dark ) whose objects are the so called dark ceers plus the ceers with finitely many equivalence classes. Although in all these categories the monomorphisms coincide with the injective morphisms, we show that in mathbb E mathrm q ( Sigma 0 1) the epimorphisms coincide with the onto morphisms, but in mathbb E mathrm q ( Pi 0 1) there are epimorphisms that are not onto. Moreover, mathbb E mathrm q , mathbb E mathrm q ( Sigma 0 1) , and mathbb E mathrm q ( mathrm Dark ) are closed under finite products, binary coproducts, and coequalizers, but we give an example of two morphisms in mathbb E mathrm q ( Pi 0 1) whose coequalizer in mathbb E mathrm q is not an object of mathbb E mathrm q ( Pi 0 1) .


DeepBLE Generalizing RSSI based Localization Across Different Devices. Accurate smartphone localization ( 1 meter error) for indoor navigation using only RSSI received from a set of BLE beacons remains a challenging problem, due to the inherent noise of RSSI measurements. To overcome the large variance in RSSI measurements, we propose a data driven approach that uses a deep recurrent network, DeepBLE, to localize the smartphone using RSSI measured from multiple beacons in an environment. In particular, we focus on the ability of our approach to generalize across many smartphone brands (e.g., Apple, Samsung) and models (e.g., iPhone 8, S10). Towards this end, we collect a large scale dataset of 15 hours of smartphone data, which consists of over 50,000 BLE beacon RSSI measurements collected from 47 beacons in a single building using 15 different popular smartphone models, along with precise 2D location annotations. Our experiments show that there is a very high variability of RSSI measurements across smartphone models (especially across brand), making it very difficult to apply supervised learning using only a subset of smartphone models. To address this challenge, we propose a novel statistic similarity loss (SSL) which enables our model to generalize to unseen phones using a semi supervised learning approach. For known phones, the iPhone XR achieves the best mean distance error of 0.84 meters. For unknown phones, the Huawei Mate20 Pro shows the greatest improvement, cutting error by over 38 from 2.62 meters to 1.63 meters error using our semi supervised adaptation method.


Challenges and Outlook in Robotic Manipulation of Deformable Objects. Deformable object manipulation (DOM) is an emerging research problem in robotics. The ability to manipulate deformable objects endows robots with higher autonomy and promises new applications in the industrial, services, and healthcare sectors. However, compared to rigid object manipulation, the manipulation of deformable objects is considerably more complex, and is still an open research problem. Addressing DOM challenges demand breakthroughs in almost all aspects of robotics, namely hardware design, sensing, (deformation) modeling, planning, and control. In this article, we review recent advances and highlight the main challenges when considering deformation in each sub field. A particular focus of our paper lies in the discussions of these challenges and proposing future directions of research.


Space time finite element methods for the initial temperature reconstruction. This work is devoted to the reconstruction of the initial temperature in the backward heat equation using the space time finite element method on fully unstructured space time simplicial meshes proposed by Steinbach (2015). Such a severely ill posed problem is tackled by the standard Tikhonov regularization method. This leads to a related optimal control for an parabolic equation in the space time domain. In this setting, the control is taken as initial condition, whereas the terminal observation data serve as target. The objective becomes a standard terminal observation functional combined with the Tikhonov regularization. The space time finite element method is applied to the space time optimality system that is well posed for a fixed regularization parameter.


Using Distributional Principles for the Semantic Study of Contextual Language Models. Many studies were recently done for investigating the properties of contextual language models but surprisingly, only a few of them consider the properties of these models in terms of semantic similarity. In this article, we first focus on these properties for English by exploiting the distributional principle of substitution as a probing mechanism in the controlled context of SemCor and WordNet paradigmatic relations. Then, we propose to adapt the same method to a more open setting for characterizing the differences between static and contextual language models.


Using Steered Molecular Dynamic Tension for Assessing Quality of Computational Protein Structure Models. The native structures of proteins, except for notable exceptions of intrinsically disordered proteins, in general take their most stable conformation in the physiological condition to maintain their structural framework so that their biological function can be properly carried out. Experimentally, the stability of a protein can be measured by several means, among which the pulling experiment using the atomic force microscope (AFM) stands as a unique method. AFM directly measures the resistance from unfolding, which can be quantified from the observed force extension profile. It has been shown that key features observed in an AFM pulling experiment can be well reproduced by computational molecular dynamics simulations. Here, we applied computational pulling for estimating the accuracy of computational protein structure models under the hypothesis that the structural stability would positively correlated with the accuracy, i.e. the closeness to the native, of a model. We used in total 4,929 structure models for 24 target proteins from the Critical Assessment of Techniques of Structure Prediction (CASP) and investigated if the magnitude of the break force, i.e., the force required to rearrange the model structure, from the force profile was sufficient information for selecting near native models. We found that near native models can be successfully selected by examining their break forces suggesting that high break force indeed indicates high stability of models. On the other hand, there were also near native models that had relatively low peak forces. The mechanisms of the stability exhibited by the break forces were explored and discussed.


The canonical complex of the weak order. We define and study the canonical complex of a finite semidistributive lattice L . It is the simplicial complex on the join or meet irreducible elements of L which encodes each interval of L by recording the canonical join representation of its bottom element and the canonical meet representation of its top element. This complex behaves properly with respect to lattice quotients of L , in the sense that the canonical complex of a quotient of L is the subcomplex of the canonical complex of L induced by the join or meet irreducibles of L uncontracted in the quotient. We then describe combinatorially the canonical complex of the weak order on permutations in terms of semi crossing arc bidiagrams, formed by the superimposition of two non crossing arc diagrams of N. Reading. We provide explicit direct bijections between the semi crossing arc bidiagrams and the weak order interval posets of G. Ch atel, V. Pilaud and V. Pons. Finally, we provide an algorithm to describe the Kreweras maps in any lattice quotient of the weak order in terms of semi crossing arc bidiagrams.


Escaping the Gradient Vanishing Periodic Alternatives of Softmax in Attention Mechanism. Softmax is widely used in neural networks for multiclass classification, gate structure and attention mechanisms. The statistical assumption that the input is normal distributed supports the gradient stability of Softmax. However, when used in attention mechanisms such as transformers, since the correlation scores between embeddings are often not normally distributed, the gradient vanishing problem appears, and we prove this point through experimental confirmation. In this work, we suggest that replacing the exponential function by periodic functions, and we delve into some potential periodic alternatives of Softmax from the view of value and gradient. Through experiments on a simply designed demo referenced to LeViT, our method is proved to be able to alleviate the gradient problem and yield substantial improvements compared to Softmax and its variants. Further, we analyze the impact of pre normalization for Softmax and our methods through mathematics and experiments. Lastly, we increase the depth of the demo and prove the applicability of our method in deep structures.


Design and evaluation of a FPGA ADC prototype for the PET detector based on LYSO Crystals and SiPM arrays. The aim of this study is to design and evaluate a simple free running Analog Digital Converter (ADC) based on the Field Programmable Gate Array (FPGA) device to accomplish the energy and position readout of the silicon photomultiplier (SiPM) array for application as PET scanners. This simple FPGA ADC based on a carry chain Time Digital Converter (TDC) implemented on a Kintex 7 FPGA consists of only one off chip resistor so it has greater advantages in improving system integration and reducing cost than commercial chips. In this paper, a FPGA ADC based front end electronics prototype is presented, and both the design principle and implementation considerations are discussed. Experiments were performed using an 8 x 8 (crystal size 4 x 4 x 15 mm3 ) and a 12 x 12 (crystal size 2.65 x2.65 x 15 mm3 ) segmented LYSO crystals coupled with an 8 x 8 SiPM (Jseries, from ON Semiconductor) array which is under 22Na point source excitation. Initial test results indicate that the energy resolution of the two detectors after correction is around 13.2 and 13.5 at 511 keV, and the profiles of the flood histograms show a clear visualization of the discrete scintillator element. All measurements were carried out at room temperature ( 25 degree), without additional cooling


A Numeration System for Fibonacci like Wang Shifts. Motivated by the study of Fibonacci like Wang shifts, we define a numeration system for mathbb Z and mathbb Z 2 based on the binary alphabet 0,1 . We introduce a set of 16 Wang tiles that admits a valid tiling of the plane described by a deterministic finite automaton taking as input the representation of a position (m,n) in mathbb Z 2 and outputting a Wang tile.


Topological generation of simple algebraic groups. Let G be a simple algebraic group over an algebraically closed field and let X be an irreducible subvariety of G r with r geqslant 2 . In this paper, we consider the general problem of determining if there exists a tuple (x 1, ldots, x r) in X such that langle x 1, ldots, x r rangle is Zariski dense in G . We are primarily interested in the case where X C 1 times cdots times C r and each C i is a conjugacy class of G comprising elements of prime order modulo the center of G . In this setting, our main theorem gives a complete solution to the problem when G is a symplectic or orthogonal group. By combining our results with earlier work on linear and exceptional groups, this gives a complete solution for all simple algebraic groups. We also present several applications. For example, we use our main theorem to show that many faithful representations of symplectic and orthogonal groups are generically free. We also establish new asymptotic results on the probabilistic generation of finite simple groups by pairs of prime order elements, completing a line of research initiated by Liebeck and Shalev over 25 years ago.


Natural line bundles on completions of period mappings. We give conditions under which natural lines bundles associated with completions of period mappings are semi ample and ample.


Marx Strohh " a cker theorem for Multivalent Functions. Some differential implications of classical Marx Strohh "acker theorem are extended for multivalent functions. These results are also generalized for functions with fixed second coefficient by using the theory of first order differential subordination which in turn, corrects the results of Selvaraj and Stelin On multivalent functions associated with fixed second coefficient and the principle of subordination, Int. J. Math. Anal. bf 9 (2015), no. 18, 883 895 .


SnakeLines integrated set of computational pipelines for sequencing reads. Background With the rapid growth of massively parallel sequencing technologies, still more laboratories are utilizing sequenced DNA fragments for genomic analyses. Interpretation of sequencing data is, however, strongly dependent on bioinformatics processing, which is often too demanding for clinicians and researchers without a computational background. Another problem represents the reproducibility of computational analyses across separated computational centers with inconsistent versions of installed libraries and bioinformatics tools. Results We propose an easily extensible set of computational pipelines, called SnakeLines, for processing sequencing reads including mapping, assembly, variant calling, viral identification, transcriptomics, metagenomics, and methylation analysis. Individual steps of an analysis, along with methods and their parameters can be readily modified in a single configuration file. Provided pipelines are embedded in virtual environments that ensure isolation of required resources from the host operating system, rapid deployment, and reproducibility of analysis across different Unix based platforms. Conclusion SnakeLines is a powerful framework for the automation of bioinformatics analyses, with emphasis on a simple set up, modifications, extensibility, and reproducibility. Keywords Computational pipeline, framework, massively parallel sequencing, reproducibility, virtual environment


Ley de Reciprocidad Cuadr 'atica y aplicaciones. The goal of this survey is to introduce all the necessary concepts and theorems to provide a rigorous and self contained proof of the Law of Quadratic Reciprocity and see how this is a useful tool to obtain results such as the problem of the two squares, the problem of determining when a second grade congruence equation has any solutions, to prove some properties about prime numbers and even to obtain information about the zero set of an elliptic curve. We include examples specifically chosen to improve the understanding of the theorems, those examples were created with the program GAP due to its convenience for this topic of mathematics and we include the codes so the reader can readily test it.


Scalable communication for high order stencil computations using CUDA aware MPI. Modern compute nodes in high performance computing provide a tremendous level of parallelism and processing power. However, as arithmetic performance has been observed to increase at a faster rate relative to memory and network bandwidths, optimizing data movement has become critical for achieving strong scaling in many communication heavy applications. This performance gap has been further accentuated with the introduction of graphics processing units, which can provide by multiple factors higher throughput in data parallel tasks than central processing units. In this work, we explore the computational aspects of iterative stencil loops and implement a generic communication scheme using CUDA aware MPI, which we use to accelerate magnetohydrodynamics simulations based on high order finite differences and third order Runge Kutta integration. We put particular focus on improving intra node locality of workloads. In comparison to a theoretical performance model, our implementation exhibits strong scaling from one to 64 devices at 50 87 efficiency in sixth order stencil computations when the problem domain consists of 256 3 1024 3 cells.


Private and Robust Distributed Nonconvex Optimization via Polynomial Approximation. There has been work that exploits polynomial approximation to solve distributed nonconvex optimization problems involving univariate objectives. This idea facilitates arbitrarily precise global optimization without requiring local evaluations of gradients at every iteration. Nonetheless, there remains a gap between existing theoretical guarantees and diverse practical requirements, e.g., privacy preservation and robustness to network imperfections. To fill this gap and keep the above strengths, we propose a Private and Robust Chebyshev Proxy based distributed Optimization Algorithm (PR CPOA). Specifically, to ensure both accuracy of solutions and privacy of local objectives, we design a new privacy preserving mechanism. This mechanism leverages the randomness in blockwise insertions of perturbed vector states and hence provides an improved privacy guarantee in the scope of ( alpha, beta ) data privacy. Furthermore, to gain robustness against various network imperfections, we use the push sum consensus protocol as a backbone, discuss its specific enhancements, and evaluate the performance of the proposed algorithm accordingly. Thanks to the purely consensus type iterations, we avoid the privacy accuracy trade off and the bother of selecting appropriate step sizes in different settings. We provide rigorous analysis of the accuracy, privacy, and complexity. It is shown that the advantages brought by the idea of polynomial approximation are maintained when all the above requirements exist.


MD MTL An Ensemble Med Multi Task Learning Package for DiseaseScores Prediction and Multi Level Risk Factor Analysis. While many machine learning methods have been used for medical prediction and risk factor analysis on healthcare data, most prior research has involved single task learning (STL) methods. However, healthcare research often involves multiple related tasks. For instance, implementation of disease scores prediction and risk factor analysis in multiple subgroups of patients simultaneously and risk factor analysis at multi levels synchronously. In this paper, we developed a new ensemble machine learning Python package based on multi task learning (MTL), referred to as the Med Multi Task Learning (MD MTL) package and applied it in predicting disease scores of patients, and in carrying out risk factor analysis on multiple subgroups of patients simultaneously. Our experimental results on two datasets demonstrate the utility of the MD MTL package, and show the advantage of MTL (vs. STL), when analyzing data that is organized into different categories (tasks, which can be various age groups, different levels of disease severity, etc.).


AWESAM A Python Module for Automated Volcanic Event Detection Applied to Stromboli. Many active volcanoes in the world exhibit Strombolian activity, which is typically characterized by relatively frequent mild events and also by rare and much more destructive major explosions and paroxysms. Detailed analyses of past major and minor events can help to understand the eruptive behavior of the volcano and the underlying physical and chemical processes. Catalogs of volcanic eruptions may be established using continuous seismic recordings at stations in the proximity of volcanoes. However, in many cases, the analysis of the recordings relies heavily on the manual picking of events by human experts. Recently developed Machine Learning based approaches require large training data sets which may not be available a priori. Here, we propose an alternative automated approach the Adaptive Window Volcanic Event Selection Analysis Module (AWESAM). This process of creating event catalogs consists of three main steps (i) identification of potential volcanic events based on squared ground velocity amplitudes, an adaptive MaxFilter, and a prominence threshold. (ii) catalog consolidation by comparing and verification of the initial detections based on recordings from two different seismic stations. (iii) identification and exclusion of signals from regional tectonic earthquakes. The software package is applied to publicly accessible continuous seismic recordings from two almost equidistant stations at Stromboli volcano in Italy. We tested AWESAM by comparison with a hand picked catalog and found that around 95 percent of the eruptions with a signal to noise ratio above three are detected. In a first application, we derive a new amplitude frequency relationship from over 290.000 volcanic events at Stromboli during 2019 2020. The module allows for a straightforward generalization and application to other volcanoes worldwide.


Formal derivation of quantum drift diffusion equations with spin orbit interaction. Quantum drift diffusion equations for a two dimensional electron gas with spin orbit interactions of Rashba type are formally derived from a collisional Wigner equation. The collisions are modeled by a Bhatnagar Gross Krook type operator describing the relaxation of the electron gas to a local equilibrium that is given by the quantum maximum entropy principle. Because of non commutativity properties of the operators, the standard diffusion scaling cannot be used in this context, and a hydrodynamic time scaling is required. A Chapman Enskog procedure leads, up to first order in the relaxation time, to a system of nonlocal quantum drift diffusion equations for the charge density and spin vector densities. Local equations including the Bohm potential are obtained in the semiclassical expansion up to second order in the scaled Planck constant. The main novelty of this work is that all spin components are considered, while previous models only consider special spin directions.


Nearly Linear Time Approximate Scheduling Algorithms. We study nearly linear time approximation algorithms for non preemptive scheduling problems in two settings the unrelated machine setting, and the identical machine with job precedence constraints setting. The objectives we study include makespan, weighted completion time, and L q norm of machine loads. We develop nearly linear time approximation algorithms for the studied problems with O(1) approximation ratios, many of which match the correspondent best known ratios achievable in polynomial time. Our main technique is linear programming relaxation. For problems in the unrelated machine setting, we formulate mixed packing and covering LP relaxations of nearly linear size, and solve them approximately using the nearly linear time solver of Young. We show the LP solutions can be rounded within O(1) factor loss. For problems in the identical machine with precedence constraints setting, the precedence constraints can not be formulated as packing or covering constraints. To achieve the claimed running time, we define a polytope for the constraints, and leverage the multiplicative weight update (MWU) method with an oracle which always returns solutions in the polytope. Along the way of designing the oracle, we encounter the single commodity maximum flow problem over a directed acyclic graph G (V, E) , where sources and sinks have limited supplies and demands, but edges have infinite capacities. We develop a frac 1 1 epsilon approximation for the problem in time O left( frac E epsilon log V right) , which may be of independent interest.


Queue layouts and nonrepetitive colouring of planar graphs and powers of trees. Dujmovi ' c , Joret, Micek, Morin, Ueckerdt and Wood recently in Planar graphs have bounded queue number, Journal of the ACM, Volume 67, Issue 4, Article No. 22, August 2020 showed some attractive graph product structure theorems for planar graphs. By using the product structure, they proved that planar graphs have bounded queue number 48 in Planar graphs have bounded nonrepetitive chromatic number, Advances in Combinatorics, 5, 11 pp, 2020 , the authors proved that planar graphs have bounded nonrepetitive chromatic number 768 . In this paper, still by using some product structure theorem, we improve the upper bound of queue number of planar graphs to 27 and the non repetitive chromatic number to 320 . We also study powers of trees. We show a graph product structure theorem of the k th power T k of tree T , then use it giving an upper bound of the nonrepetitive chromatic number of T k . We also give an asymptotically tight upper bound of the queue number of T k .


Joint Resource Management for MC NOMA A Deep Reinforcement Learning Approach. This paper presents a novel and effective deep reinforcement learning (DRL) based approach to addressing joint resource management (JRM) in a practical multi carrier non orthogonal multiple access (MC NOMA) system, where hardware sensitivity and imperfect successive interference cancellation (SIC) are considered. We first formulate the JRM problem to maximize the weighted sum system throughput. Then, the JRM problem is decoupled into two iterative subtasks subcarrier assignment (SA, including user grouping) and power allocation (PA). Each subtask is a sequential decision process. Invoking a deep deterministic policy gradient algorithm, our proposed DRL based JRM (DRL JRM) approach jointly performs the two subtasks, where the optimization objective and constraints of the subtasks are addressed by a new joint reward and internal reward mechanism. A multi agent structure and a convolutional neural network are adopted to reduce the complexity of the PA subtask. We also tailor the neural network structure for the stability and convergence of DRL JRM. Corroborated by extensive experiments, the proposed DRL JRM scheme is superior to existing alternatives in terms of system throughput and resistance to interference, especially in the presence of many users and strong inter cell interference. DRL JRM can flexibly meet individual service requirements of users.


The isomorphism problem of projective schemes and related algorithmic problems. We discuss the isomorphism problem of projective schemes given two projective schemes, can we algorithmically decide whether they are isomorphic? We give affirmative answers in the case of one dimensional projective schemes, the case of smooth irreducible varieties with a big canonical sheaf or a big anti canonical sheaf, and the case of K3 surfaces with a finite automorphism group. As related algorithmic problems, we also discuss decidability of positivity properties of invertible sheaves, and approximation of the nef cone and the pseudo effective cone.


Orthogonal Eisenstein Series at Harmonic Points and Modular Forms of Singular Weight. We investigate the behaviour of orthogonal non holomorphic Eisenstein series at their harmonic points by using theta lifts. In the case of singular weight, we show that the orthogonal non holomorphic Eisenstein series that can be written as a theta lift have a simple pole at s 1 whose residues yield holomorphic orthogonal modular forms that are Eisenstein series on the boundary and we give a sufficient condition on the surjectivity of this construction.


Generalizable Episodic Memory for Deep Reinforcement Learning. Episodic memory based methods can rapidly latch onto past successful strategies by a non parametric memory and improve sample efficiency of traditional reinforcement learning. However, little effort is put into the continuous domain, where a state is never visited twice, and previous episodic methods fail to efficiently aggregate experience across trajectories. To address this problem, we propose Generalizable Episodic Memory (GEM), which effectively organizes the state action values of episodic memory in a generalizable manner and supports implicit planning on memorized trajectories. GEM utilizes a double estimator to reduce the overestimation bias induced by value propagation in the planning process. Empirical evaluation shows that our method significantly outperforms existing trajectory based methods on various MuJoCo continuous control tasks. To further show the general applicability, we evaluate our method on Atari games with discrete action space, which also shows a significant improvement over baseline algorithms.


A New Acceleration Paradigm for Discrete CosineTransform and Other Fourier Related Transforms. Discrete cosine transform (DCT) and other Fourier related transforms have broad applications in scientific computing. However, off the shelf high performance multi dimensional DCT (MD DCT) libraries are not readily available in parallel computing systems. Public MD DCT implementations leverage a straightforward method that decomposes the computation into multiple 1D DCTs along every single dimension, which inevitably has non optimal performance due to low computational efficiency, parallelism, and locality. In this paper, we propose a new acceleration paradigm for MD DCT. A three stage procedure is proposed to factorize MD DCT into MD FFT and highly optimized preprocessing postprocessing with efficient computation and high arithmetic intensity. Our paradigm can be easily extended to other Fourier related transforms and other parallel computing systems. Experimental results show that our 2D DCT IDCT CUDA implementation has a stable, FFT comparable execution time, which is 2 times faster than the previous row column method. Several case studies demonstrate that a promising efficiency improvement can be achieved with our paradigm. The implementations are available at https github.com JeremieMelo dct cuda tree reconstruct.


Ray tracing and finite element modeling of sound propagation in a compartment fire. A compartment fire (a fire in a room or building) creates temperature gradients and inhomogeneous time varying temperature, density, and flow fields. This work compared experimental measurements of the room acoustic impulse frequency response in a room with a fire to numerically modeled responses. The fire is modeled using Fire Dynamics Simulator (FDS). Acoustic modeling was performed using the temperature field computed by FDS. COMSOL Multiphysics was used for finite element acoustic modeling and Bellhop for ray trace acoustics modeling. The results show that the fire causes wave fronts to arrive earlier (due to the higher sound speed) and with more variation in the delay times (due to the sound speed perturbations). The frequency response shows that the modes are shifted up in frequency and high frequency ( 2500 Hz) modes are significantly attenuated. Model results are compared with data and show good agreement in observed trends.


A multiscale model of urban morphogenesis. The dynamics and processes of urban morphogenesis are a central issue regarding a long term sustainability of urban systems. They however imply stakeholders and parameters at multiple temporal and spatial scales simultaneously, leading to intricate interactions between dimensions and scales. We introduce in this paper from a theoretical viewpoint a simple agent based model of urban morphogenesis at the scale of an urban area, with the feature of integrating the microscopic and the mesoscopic scales. At the local level, developer agents drive urban development conditioned by local properties but also an infrastructure network at a smaller scale. The network evolves more slowly following global properties. Indicators of sustainability including modal shares and urban density suggest an application of the model to multi objective optimisation. We finally discuss possible implementation, extensions and applications of the model.


Modulation instability of Kerr optical frequency combs in dual coupled optical cavities. Kerr optical frequency combs generated in a coherently driven Kerr nonlinear resonator has the potential for a wide range of applications. However, in a single cavity which is a widely adopted configuration for Kerr optical frequency combs generation, modulation instability is suppressed in normal dispersion regime and the pump to comb conversion efficiency is extremely low for a single dissipative Kerr soliton in anomalous dispersion regime. Dual coupled cavities have been proposed to generate Kerr optical frequency combs in normal dispersion regime, and have potential to remarkably increase conversion efficiency for Kerr optical frequency combs. Here, we investigate modulation instability and Kerr optical frequency comb formation in dual coupled cavities. Based on solutions of the continuous wave steady state, we obtain a quadric algebraic equation describing the modulation instability gain, and we find that it is intensely influenced by the group velocity mismatch between the two cavities. Our numerical simulations demonstrate that platicons can be generated via pump scanning scheme for the case that both the two cavities possess normal dispersion, and a single dissipative Kerr soliton can be generated in the cavity with anomalous dispersion while the dispersion of the other cavity is normal. Our analysis of modulation instability provides a powerful tool for Kerr optical frequency comb generation via pump modulation and cavity detuning tuning scheme in dual coupled cavities.


Ramsey Numbers for Non trivial Berge Cycles. In this paper, we consider an extension of cycle complete graph Ramsey numbers to Berge cycles in hypergraphs for k geq 2 , a em non trivial Berge k cycle is a family of sets e 1,e 2, dots,e k such that e 1 cap e 2, e 2 cap e 3, dots,e k cap e 1 has a system of distinct representatives and e 1 cap e 2 cap dots cap e k emptyset . In the case that all the sets e i have size three, let mathcal B k denotes the family of all non trivial Berge k cycles. The em Ramsey numbers R(t, mathcal B k) denote the minimum n such that every n vertex 3 uniform hypergraph contains either a non trivial Berge k cycle or an independent set of size t . We prove R(t, mathcal B 2k ) leq t 1 frac 1 2k 1 frac 4 sqrt log t and moreover, we show that if a conjecture of Erd H o s and Simonovits cite ES on girth in graphs is true, then this is tight up to a factor t o(1) as t rightarrow infty .


From Domain Specific Languages to Memory Optimized Accelerators for Fluid Dynamics. Many applications are increasingly requiring numerical simulations for solving complex problems. Most of these numerical algorithms are massively parallel and often implemented on parallel high performance computers. However, classic CPU based platforms suffers due to the demand for higher resolutions and the exponential growth of data. FPGAs offer a powerful and flexible alternative that can host accelerators to complement such platforms. Developing such application specific accelerators is still challenging because it is hard to provide efficient code for hardware synthesis. In this paper, we study the challenges of porting a numerical simulation kernel onto FPGA. We propose an automated tool flow from a domain specific language (DSL) to generate accelerators for computational fluid dynamics on FPGA. Our DSL based flow simplifies the exploration of parameters and constraints such as on chip memory usage. We also propose a decoupled optimization of memory and logic resources, which allows us to better use the limited FPGA resources. In our preliminary evaluation, this enabled doubling the number of parallel kernels, increasing the accelerator speedup versus ARM execution from 7 to 12 times.


Visualization of Deep Transfer Learning In SAR Imagery. Synthetic Aperture Radar (SAR) imagery has diverse applications in land and marine surveillance. Unlike electro optical (EO) systems, these systems are not affected by weather conditions and can be used in the day and night times. With the growing importance of SAR imagery, it would be desirable if models trained on widely available EO datasets can also be used for SAR images. In this work, we consider transfer learning to leverage deep features from a network trained on an EO ships dataset and generate predictions on SAR imagery. Furthermore, by exploring the network activations in the form of class activation maps (CAMs), we visualize the transfer learning process to SAR imagery and gain insight on how a deep network interprets a new modality.


Contextual Hate Speech Detection in Code Mixed Text using Transformer Based Approaches. In the recent past, social media platforms have helped people in connecting and communicating to a wider audience. But this has also led to a drastic increase in cyberbullying. It is essential to detect and curb hate speech to keep the sanity of social media platforms. Also, code mixed text containing more than one language is frequently used on these platforms. We, therefore, propose automated techniques for hate speech detection in code mixed text from scraped Twitter. We specifically focus on code mixed English Hindi text and transformer based approaches. While regular approaches analyze the text independently, we also make use of content text in the form of parent tweets. We try to evaluate the performances of multilingual BERT and Indic BERT in single encoder and dual encoder settings. The first approach is to concatenate the target text and context text using a separator token and get a single representation from the BERT model. The second approach encodes the two texts independently using a dual BERT encoder and the corresponding representations are averaged. We show that the dual encoder approach using independent representations yields better performance. We also employ simple ensemble methods to further improve the performance. Using these methods we report the best F1 score of 73.07 on the HASOC 2021 ICHCL code mixed data set.