Unsupervised Out of Domain Detection via Pre trained Transformers. Deployed real world machine learning applications are often subject to uncontrolled and even potentially malicious inputs. Those out of domain inputs can lead to unpredictable outputs and sometimes catastrophic safety issues. Prior studies on out of domain detection require in domain task labels and are limited to supervised classification scenarios. Our work tackles the problem of detecting out of domain samples with only unsupervised in domain data. We utilize the latent representations of pre trained transformers and propose a simple yet effective method to transform features across all layers to construct out of domain detectors efficiently. Two domain specific fine tuning approaches are further proposed to boost detection accuracy. Our empirical evaluations of related methods on two datasets validate that our method greatly improves out of domain detection ability in a more general scenario.


Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Images. Cell instance segmentation in fluorescence microscopy images is becoming essential for cancer dynamics and prognosis. Data extracted from cancer dynamics allows to understand and accurately model different metabolic processes such as proliferation. This enables customized and more precise cancer treatments. However, accurate cell instance segmentation, necessary for further cell tracking and behavior analysis, is still challenging in scenarios with high cell concentration and overlapping edges. Within this framework, we propose a novel cell instance segmentation approach based on the well known U Net architecture. To enforce the learning of morphological information per pixel, a deep distance transformer (DDT) acts as a back bone model. The DDT output is subsequently used to train a top model. The following top models are considered a three class ( emph e.g., foreground, background and cell border) U net, and a watershed transform. The obtained results suggest a performance boost over traditional U Net architectures. This opens an interesting research line around the idea of injecting morphological information into a fully convolutional model.


On a generalized Brauer group in mixed characteristic cases, II. As an extension of an author's previous paper, we prove the Gersten's conjecture for the p torsion subgroup of the generalized Brauer group over a henselian regular local ring of mixed characteristic (0, p) . We also prove the mathbb P 1 homotopy invariance for the generalized Brauer group which is an analogue of a result due to Auel Bigazzi B " o hning Graf von Bothmer in mixed characteristic cases.


Multiple Object Trackers in OpenCV A Benchmark. Object tracking is one of the most important and fundamental disciplines of Computer Vision. Many Computer Vision applications require specific object tracking capabilities, including autonomous and smart vehicles, video surveillance, medical treatments, and many others. The OpenCV as one of the most popular libraries for Computer Vision includes several hundred Computer Vision algorithms. Object tracking tasks in the library can be roughly clustered in single and multiple object trackers. The library is widely used for real time applications, but there are a lot of unanswered questions such as when to use a specific tracker, how to evaluate its performance, and for what kind of objects will the tracker yield the best results? In this paper, we evaluate 7 trackers implemented in OpenCV against the MOT20 dataset. The results are shown based on Multiple Object Tracking Accuracy (MOTA) and Multiple Object Tracking Precision (MOTP) metrics.


Khovanov homology and the cinquefoil. We prove that Khovanov homology with coefficients in mathbb Z 2 mathbb Z detects the (2,5) torus knot. Our proof makes use of a wide range of deep tools in Floer homology, Khovanov homology, and Khovanov homotopy. We combine these tools with classical results on the dynamics of surface homeomorphisms to reduce the detection question to a problem about mutually braided unknots, which we then solve with computer assistance.


Free boundary problems with long range interactions uniform Lipschitz estimates in the radius. Consider the class of optimal partition problems with long range interactions inf left sum i 1 k lambda 1( omega i) ( omega 1, ldots, omega k) in mathcal P r( Omega) right , where lambda 1( cdot) denotes the first Dirichlet eigenvalue, and mathcal P r( Omega) is the set of open k partitions of Omega whose elements are at distance at least r textrm dist ( omega i, omega j) geq r for every i neq j . In this paper we prove optimal uniform bounds (as r to 0 ) in mathrm Lip norm for the associated L 2 normalized eigenfunctions, connecting in particular the nonlocal case r 0 with the local one r to 0 . The proof uses new pointwise estimates for eigenfunctions, a one phase Alt Caffarelli Friedman and the Caffarelli Jerison Kenig monotonicity formulas, combined with elliptic and energy estimates. Our result extends to other contexts, such as singularly perturbed harmonic maps with distance constraints.


You Only Write Thrice Creating Documents, Computational Notebooks and Presentations From a Single Source. Academic trade requires juggling multiple variants of the same content published in different formats manuscripts, presentations, posters and computational notebooks. The need to track versions to accommodate for the write review rebut revise life cycle adds another layer of complexity. We propose to significantly reduce this burden by maintaining a single source document in a version controlled environment (such as git), adding functionality to generate a collection of output formats popular in academia. To this end, we utilise various open source tools from the Jupyter scientific computing ecosystem and operationalise selected software engineering concepts. We offer a proof of concept workflow that composes Jupyter Book (an online document), Jupyter Notebook (a computational narrative) and reveal.js slides from a single markdown source file. Hosted on GitHub, our approach supports change tracking and versioning, as well as a transparent review process based on the underlying code issue management infrastructure. An exhibit of our workflow can be previewed at https so cool.github.io you only write thrice .


Graphfool Targeted Label Adversarial Attack on Graph Embedding. Deep learning is effective in graph analysis. It is widely applied in many related areas, such as link prediction, node classification, community detection, and graph classification etc. Graph embedding, which learns low dimensional representations for vertices or edges in the graph, usually employs deep models to derive the embedding vector. However, these models are vulnerable. We envision that graph embedding methods based on deep models can be easily attacked using adversarial examples. Thus, in this paper, we propose Graphfool, a novel targeted label adversarial attack on graph embedding. It can generate adversarial graph to attack graph embedding methods via classifying boundary and gradient information in graph convolutional network (GCN). Specifically, we perform the following steps 1),We first estimate the classification boundaries of different classes. 2), We calculate the minimal perturbation matrix to misclassify the attacked vertex according to the target classification boundary. 3), We modify the adjacency matrix according to the maximal absolute value of the disturbance matrix. This process is implemented iteratively. To the best of our knowledge, this is the first targeted label attack technique. The experiments on real world graph networks demonstrate that Graphfool can derive better performance than state of art techniques. Compared with the second best algorithm, Graphfool can achieve an average improvement of 11.44 in attack success rate.


Analytical solution of the Euler Poinsot problem. In the present paper, an analysis was performed on the torque free motion of a rigid body, developing Euler's analytical solution and Poinsot's geometric solution. From mathematical formulations, the analytical solution for the time evolution of the angular velocity and Euler's angles was obtained and described given some initial conditions. Besides, an animation of Poinsot's geometric solution was elaborated and a study was carried out on the conditions in which the herpolhode forms a closed curve. Finally, an algorithm was developed in the software Scilab that displays the analytical and numerical solutions obtained, it also generates an animation of the geometric solution, moreover to having an algorithm that generates closed herpolhodes.


The total coloring of K 5 minor free graphs. A total k coloring of a graph G is a coloring of V(G) cup E(G) using k colors such that no two adjacent or incident elements receive the same color. The total chromatic number chi"(G) of G is the smallest integer k such that G has a total k coloring. In the paper, it is proved that for any K 5 minor free graph G , chi''(G) leq Delta(G) 2 if Delta(G) geq 7 . Moreover, chi"(G) Delta(G) 1 if Delta(G) geq 10 .


Negative Sample Matters A Renaissance of Metric Learning for Temporal Grounding. Temporal grounding aims to localize a video moment which is semantically aligned with a given natural language query. Existing methods typically apply a detection or regression pipeline on the fused representation with the research focus on designing complicated prediction heads or fusion strategies. Instead, from a perspective on temporal grounding as a metric learning problem, we present a Mutual Matching Network (MMN), to directly model the similarity between language queries and video moments in a joint embedding space. This new metric learning framework enables fully exploiting negative samples from two new aspects constructing negative cross modal pairs in a mutual matching scheme and mining negative pairs across different videos. These new negative samples could enhance the joint representation learning of two modalities via cross modal mutual matching to maximize their mutual information. Experiments show that our MMN achieves highly competitive performance compared with the state of the art methods on four video grounding benchmarks. Based on MMN, we present a winner solution for the HC STVG challenge of the 3rd PIC workshop. This suggests that metric learning is still a promising method for temporal grounding via capturing the essential cross modal correlation in a joint embedding space. Code is available at https github.com MCG NJU MMN.


Differential Critic GAN Generating What You Want by a Cue of Preferences. This paper proposes Differential Critic Generative Adversarial Network (DiCGAN) to learn the distribution of user desired data when only partial instead of the entire dataset possesses the desired property, which generates desired data that meets user's expectations and can assist in designing biological products with desired properties. Existing approaches select the desired samples first and train regular GANs on the selected samples to derive the user desired data distribution. However, the selection of the desired data relies on an expert criterion and supervision over the entire dataset. DiCGAN introduces a differential critic that can learn the preference direction from the pairwise preferences, which is amateur knowledge and can be defined on part of the training data. The resultant critic guides the generation of the desired data instead of the whole data. Specifically, apart from the Wasserstein GAN loss, a ranking loss of the pairwise preferences is defined over the critic. It endows the difference of critic values between each pair of samples with the pairwise preference relation. The higher critic value indicates that the sample is preferred by the user. Thus training the generative model for higher critic values encourages the generation of user preferred samples. Extensive experiments show that our DiCGAN achieves state of the art performance in learning the user desired data distributions, especially in the cases of insufficient desired data and limited supervision.


Model Based Reinforcement Learning via Latent Space Collocation. The ability to plan into the future while utilizing only raw high dimensional observations, such as images, can provide autonomous agents with broad capabilities. Visual model based reinforcement learning (RL) methods that plan future actions directly have shown impressive results on tasks that require only short horizon reasoning, however, these methods struggle on temporally extended tasks. We argue that it is easier to solve long horizon tasks by planning sequences of states rather than just actions, as the effects of actions greatly compound over time and are harder to optimize. To achieve this, we draw on the idea of collocation, which has shown good results on long horizon tasks in optimal control literature, and adapt it to the image based setting by utilizing learned latent state space models. The resulting latent collocation method (LatCo) optimizes trajectories of latent states, which improves over previously proposed shooting methods for visual model based RL on tasks with sparse rewards and long term goals. Videos and code at https orybkin.github.io latco .


Models and methods of complex evaluation of complex network and hierarchically network systems. The flow models of complex network system are developed and main flow characteristics of its elements are defined. Those characteristics are applied for determining actual structure of the system, analyzing its development on all lifecycle stages and finding alternative flow directions that bypass isolated areas of network. Influence and betweenness parameters of components of network systems are defined. Using those parameters, the conditions were studied under which system is resistant to negative internal and external influence. The notion of flow core of complex network systems is defined, that allows to distinguish the most important components of system structure in terms of operation to solve the problem of finding communities within the network. The notions of p core and kernel of mono flow partially overlapped multilayered network are defined that allow to determine components of system structure that play the most important role in implementation of interactions between systems. The methodology is developed for complex evaluation of quality of complex hierarchical network systems. This methodology combines the interconnected methods of local, forecasting, interactive and aggregated analysis of system components behavior on all hierarchy levels. It is demonstrated that application of proposed complex evaluation methodology is efficient for solving problem of defining practically possible criteria of network system element quality, novelty detection, determining critical and optimal system operation modes and selecting optimal system of given class of systems.


Tabular Data Deep Learning is Not All You Need. A key element in solving real life data science problems is selecting the types of models to use. Tree ensemble models (such as XGBoost) are usually recommended for classification and regression problems with tabular data. However, several deep learning models for tabular data have recently been proposed, claiming to outperform XGBoost for some use cases. This paper explores whether these deep models should be a recommended option for tabular data by rigorously comparing the new deep models to XGBoost on various datasets. In addition to systematically comparing their performance, we consider the tuning and computation they require. Our study shows that XGBoost outperforms these deep models across the datasets, including the datasets used in the papers that proposed the deep models. We also demonstrate that XGBoost requires much less tuning. On the positive side, we show that an ensemble of deep models and XGBoost performs better on these datasets than XGBoost alone.


Encrypted Data Processing. In this paper, we present a comprehensive architecture for confidential computing, which we show to be general purpose and quite efficient. It executes the application as is, without any added burden or discipline requirements from the application developers. Furthermore, it does not require the trust of system software at the computing server and does not impose any added burden on the communication subsystem. The proposed Encrypted Data Processing (EDAP) architecture accomplishes confidentiality, authenticity, and freshness of the key based cryptographic data protection by adopting data encryption with a multi level key protection scheme. It guarantees that the user data is visible only in non privileged mode to a designated program trusted by the data owner on a designated hardware, thus protecting the data from an untrusted hardware, hypervisor, OS, or other users' applications. The cryptographic keys and protocols used for achieving these confidential computing requirements are described in a use case example. Encrypting and decrypting data in an EDAP enabled processor can lead to performance degradation as it adds cycle time to the overall execution. However, our simulation result shows that the slowdown is only 6 on average across a collection of commercial workloads when the data encryption engine is placed between the L1 and L2 cache. We demonstrate that the EDAP architecture is valuable and practicable in the modern cloud environment for confidential computing. EDAP delivers a zero trust model of computing where the user software does not trust system software and vice versa.


Finite time blow up for the heat flow of H surface with constant mean curvature. In this paper, the authors consider an initial boundary value problem for the heat flow of equation of surfaces with constant mean curvatures, which was investigated in On the heat flow of equation of surfaces of constant mean curvatures, Manuscripta Mathematica, 2011, 134 259 271 by Huang et al., where global well posedness and finite time blow up of regular solutions were obtained. Their results are complemented in this paper in the sense that some new conditions on the initial data are provided for the solutions to develop finite time singularity.


Ridge Regression Neural Network for Pediatric Bone Age Assessment. Bone age is an important measure for assessing the skeletal and biological maturity of children. Delayed or increased bone age is a serious concern for pediatricians, and needs to be accurately assessed in a bid to determine whether bone maturity is occurring at a rate consistent with chronological age. In this paper, we introduce a unified deep learning framework for bone age assessment using instance segmentation and ridge regression. The proposed approach consists of two integrated stages. In the first stage, we employ an image annotation and segmentation model to annotate and segment the hand from the radiographic image, followed by background removal. In the second stage, we design a regression neural network architecture composed of a pre trained convolutional neural network for learning salient features from the segmented pediatric hand radiographs and a ridge regression output layer for predicting the bone age. Experimental evaluation on a dataset of hand radiographs demonstrates the competitive performance of our approach in comparison with existing deep learning based methods for bone age assessment.


Representations of multimeasures via multivalued Bartle Dunford Schwartz integral. An integral for a scalar function with respect to a multimeasure N taking its values in a locally convex space is introduced. The definition is independent of the selections of N and is related to a functional version of the Bartle Dunford Schwartz integral with respect to a vector measure presented by Lewis. Its properties are studied together with its application to Radon Nikodym theorems in order to represent as an integrable derivative the ratio of two general multimeasures or two d H multimeasures equivalent conditions are provided in both cases.


Identifying Ransomware Actors in the Bitcoin Network. Due to the pseudo anonymity of the Bitcoin network, users can hide behind their bitcoin addresses that can be generated in unlimited quantity, on the fly, without any formal links between them. Thus, it is being used for payment transfer by the actors involved in ransomware and other illegal activities. The other activity we consider is related to gambling since gambling is often used for transferring illegal funds. The question addressed here is that given temporally limited graphs of Bitcoin transactions, to what extent can one identify common patterns associated with these fraudulent activities and apply them to find other ransomware actors. The problem is rather complex, given that thousands of addresses can belong to the same actor without any obvious links between them and any common pattern of behavior. The main contribution of this paper is to introduce and apply new algorithms for local clustering and supervised graph machine learning for identifying malicious actors. We show that very local subgraphs of the known such actors are sufficient to differentiate between ransomware, random and gambling actors with 85 prediction accuracy on the test data set.


Quad layouts with high valence singularities for flexible quad meshing. A novel algorithm that produces a quad layout based on imposed set of singularities is proposed. In this paper, we either use singularities that appear naturally, e.g., by minimizing Ginzburg Landau energy, or use as an input user defined singularity pattern, possibly with high valence singularities that do not appear naturally in cross field computations. The first contribution of the paper is the development of a formulation that allows computing a cross field from a given set of singularities through the resolution of two linear PDEs. A specific mesh refinement is applied at the vicinity of singularities to accommodate the large gradients of cross directions that appear in the vicinity of singularities of high valence. The second contribution of the paper is a correction scheme that repairs limit cycles and or non quadrilateral patches. Finally, a high quality block structured quad mesh is generated from the quad layout and per partition parameterization.


Connection between antennas, beam steering, and the moir ' e effect. The moir ' e effect provides an interpretation for the steering of antennas that form beams through internal spatial interferences. We make an explicit connection between such antennas and the moir ' e effect, and use it to model six planar antennas that steer by scaling, rotating, or translating operations. Three of the antennas illustrate how to use moir ' e patterns to generate antenna designs.


Graph2Pix A Graph Based Image to Image Translation Framework. In this paper, we propose a graph based image to image translation framework for generating images. We use rich data collected from the popular creativity platform Artbreeder (http artbreeder.com), where users interpolate multiple GAN generated images to create artworks. This unique approach of creating new images leads to a tree like structure where one can track historical data about the creation of a particular image. Inspired by this structure, we propose a novel graph to image translation model called Graph2Pix, which takes a graph and corresponding images as input and generates a single image as output. Our experiments show that Graph2Pix is able to outperform several image to image translation frameworks on benchmark metrics, including LPIPS (with a 25 improvement) and human perception studies (n 60), where users preferred the images generated by our method 81.5 of the time. Our source code and dataset are publicly available at https github.com catlab team graph2pix.


Graphs of Maximal Energy with Fixed Maximal Degree. We give a bound for the graph energy with given maximal degree in terms of the second and fourth moments of a graph. In the case in which the graph is d regular we obtain the bound that is given in Van Dam, E. et al. (2014). through elementary methods.


Stock price prediction using BERT and GAN. The stock market has been a popular topic of interest in the recent past. The growth in the inflation rate has compelled people to invest in the stock and commodity markets and other areas rather than saving. Further, the ability of Deep Learning models to make predictions on the time series data has been proven time and again. Technical analysis on the stock market with the help of technical indicators has been the most common practice among traders and investors. One more aspect is the sentiment analysis the emotion of the investors that shows the willingness to invest. A variety of techniques have been used by people around the globe involving basic Machine Learning and Neural Networks. Ranging from the basic linear regression to the advanced neural networks people have experimented with all possible techniques to predict the stock market. It's evident from recent events how news and headlines affect the stock markets and cryptocurrencies. This paper proposes an ensemble of state of the art methods for predicting stock prices. Firstly sentiment analysis of the news and the headlines for the company Apple Inc, listed on the NASDAQ is performed using a version of BERT, which is a pre trained transformer model by Google for Natural Language Processing (NLP). Afterward, a Generative Adversarial Network (GAN) predicts the stock price for Apple Inc using the technical indicators, stock indexes of various countries, some commodities, and historical prices along with the sentiment scores. Comparison is done with baseline models like Long Short Term Memory (LSTM), Gated Recurrent Units (GRU), vanilla GAN, and Auto Regressive Integrated Moving Average (ARIMA) model.


Interpretable Artificial Intelligence through the Lens of Feature Interaction. Interpretation of deep learning models is a very challenging problem because of their large number of parameters, complex connections between nodes, and unintelligible feature representations. Despite this, many view interpretability as a key solution to trustworthiness, fairness, and safety, especially as deep learning is applied to more critical decision tasks like credit approval, job screening, and recidivism prediction. There is an abundance of good research providing interpretability to deep learning models however, many of the commonly used methods do not consider a phenomenon called "feature interaction." This work first explains the historical and modern importance of feature interactions and then surveys the modern interpretability methods which do explicitly consider feature interactions. This survey aims to bring to light the importance of feature interactions in the larger context of machine learning interpretability, especially in a modern context where deep learning models heavily rely on feature interactions.


Deductive Association Networks. we introduce deductive association networks(DANs), a network that performs deductive reasoning. To have high dimensional thinking, combining various axioms and putting the results back into another axiom is necessary to produce new relationships and results. For example, it would be given two propositions "Socrates is a man." and "All men are mortals." and two propositions could be used to infer the new proposition, "Therefore Socrates is mortal.". To evaluate, we used MNIST Dataset, a handwritten numerical image dataset, to apply it to the group theory and show the results of performing deductive learning.


Towards Compact Single Image Super Resolution via Contrastive Self distillation. Convolutional neural networks (CNNs) are highly successful for super resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead, significantly restricts their practical deployments on resource limited devices. In this paper, we proposed a novel contrastive self distillation (CSD) framework to simultaneously compress and accelerate various off the shelf SR models. In particular, a channel splitting super resolution network can first be constructed from a target teacher network as a compact student network. Then, we propose a novel contrastive loss to improve the quality of SR images and PSNR SSIM via explicit knowledge transfer. Extensive experiments demonstrate that the proposed CSD scheme effectively compresses and accelerates several standard SR models such as EDSR, RCAN and CARN. Code is available at https github.com Booooooooooo CSD.


False Negative Distillation and Contrastive Learning for Personalized Outfit Recommendation. Personalized outfit recommendation has recently been in the spotlight with the rapid growth of the online fashion industry. However, recommending outfits has two significant challenges that should be addressed. The first challenge is that outfit recommendation often requires a complex and large model that utilizes visual information, incurring huge memory and time costs. One natural way to mitigate this problem is to compress such a cumbersome model with knowledge distillation (KD) techniques that leverage knowledge from a pretrained teacher model. However, it is hard to apply existing KD approaches in recommender systems (RS) to the outfit recommendation because they require the ranking of all possible outfits while the number of outfits grows exponentially to the number of consisting clothing items. Therefore, we propose a new KD framework for outfit recommendation, called False Negative Distillation (FND), which exploits false negative information from the teacher model while not requiring the ranking of all candidates. The second challenge is that the explosive number of outfit candidates amplifying the data sparsity problem, often leading to poor outfit representation. To tackle this issue, inspired by the recent success of contrastive learning (CL), we introduce a CL framework for outfit representation learning with two proposed data augmentation methods. Quantitative and qualitative experiments on outfit recommendation datasets demonstrate the effectiveness and soundness of our proposed methods.


Some remarks on relative modular categories. We study properties of relative modular categories and derive sufficient conditions for their existence. In particular, we derive sufficient conditions for relative pre modular categories to be non degenerate and relative modular, and for the quotient of categories taking a particular form by their ideal of negligible modules to be generically semi simple.


Winner Team Mia at TextVQA Challenge 2021 Vision and Language Representation Learning with Pre trained Sequence to Sequence Model. TextVQA requires models to read and reason about text in images to answer questions about them. Specifically, models need to incorporate a new modality of text present in the images and reason over it to answer TextVQA questions. In this challenge, we use generative model T5 for TextVQA task. Based on pre trained checkpoint T5 3B from HuggingFace repository, two other pre training tasks including masked language modeling(MLM) and relative position prediction(RPP) are designed to better align object feature and scene text. In the stage of pre training, encoder is dedicate to handle the fusion among multiple modalities question text, object text labels, scene text labels, object visual features, scene visual features. After that decoder generates the text sequence step by step, cross entropy loss is required by default. We use a large scale scene text dataset in pre training and then fine tune the T5 3B with the TextVQA dataset only.


Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation. Sequential recommendation as an emerging topic has attracted increasing attention due to its important practical significance. Models based on deep learning and attention mechanism have achieved good performance in sequential recommendation. Recently, the generative models based on Variational Autoencoder (VAE) have shown the unique advantage in collaborative filtering. In particular, the sequential VAE model as a recurrent version of VAE can effectively capture temporal dependencies among items in user sequence and perform sequential recommendation. However, VAE based models suffer from a common limitation that the representational ability of the obtained approximate posterior distribution is limited, resulting in lower quality of generated samples. This is especially true for generating sequences. To solve the above problem, in this work, we propose a novel method called Adversarial and Contrastive Variational Autoencoder (ACVAE) for sequential recommendation. Specifically, we first introduce the adversarial training for sequence generation under the Adversarial Variational Bayes (AVB) framework, which enables our model to generate high quality latent variables. Then, we employ the contrastive loss. The latent variables will be able to learn more personalized and salient characteristics by minimizing the contrastive loss. Besides, when encoding the sequence, we apply a recurrent and convolutional structure to capture global and local relationships in the sequence. Finally, we conduct extensive experiments on four real world datasets. The experimental results show that our proposed ACVAE model outperforms other state of the art methods.


Semiclassical Trajectory Perspective of Glory Rescattering in Strong field Photoelectron Holography. We investigate theoretically the photoelectron momentum distribution (PMD) of the ionized atoms irradiated by a linearly polarized intense laser, focusing on the holography interference patterns in PMD that carry important information of the initial wavefunction of a tunneled electron and its experienced atomic potential in rescattering. With the help of Dyson series and semiclassical propagator, we calculate the scattering amplitudes in the cylindrical coordinate representation. In contrast to conventional recognitions that the photoelectron holography is the interference of two branches of electron trajectories, however, we find strikingly that infinite semiclassical trajectories can be deflected by the combined Coulomb potential and laser field into the same final momentum The initial momenta are found to be distributed on a ring shape curve in the transverse momentum plane and the initial positions of these trajectories are perpendicular to their initial momentum vectors. For the zero final transverse momentum, the above ring source trajectories degenerate into the point source axial caustic trajectories (or Glory trajectories) and the quantum interference of these trajectories will dramatically alter the scattering amplitudes that is termed as Glory rescattering effect. With following Berry's spirit of uniform approximation for Glory scattering in optics, we can finally derive a uniform formulation of the rescattering amplitude in the Bessel functions for the strong field photoelectron holography (SFPH) patterns. Our results are in good agreement with solutions of the time dependent Schr "odinger equation and can account for recent photoelectron holography experiments. Important applications of our theory are also discussed.


Homography Decomposition Networks for Planar Object Tracking. Planar object tracking plays an important role in AI applications, such as robotics, visual servoing, and visual SLAM. Although the previous planar trackers work well in most scenarios, it is still a challenging task due to the rapid motion and large transformation between two consecutive frames. The essential reason behind this problem is that the condition number of such a non linear system changes unstably when the searching range of the homography parameter space becomes larger. To this end, we propose a novel Homography Decomposition Networks(HDN) approach that drastically reduces and stabilizes the condition number by decomposing the homography transformation into two groups. Specifically, a similarity transformation estimator is designed to predict the first group robustly by a deep convolution equivariant network. By taking advantage of the scale and rotation estimation with high confidence, a residual transformation is estimated by a simple regression model. Furthermore, the proposed end to end network is trained in a semi supervised fashion. Extensive experiments show that our proposed approach outperforms the state of the art planar tracking methods at a large margin on the challenging POT, UCSB and POIC datasets.


Points2Vec Unsupervised Object level Feature Learning from Point Clouds. Unsupervised representation learning techniques, such as learning word embeddings, have had a significant impact on the field of natural language processing. Similar representation learning techniques have not yet become commonplace in the context of 3D vision. This, despite the fact that the physical 3D spaces have a similar semantic structure to bodies of text words are surrounded by words that are semantically related, just like objects are surrounded by other objects that are similar in concept and usage. In this work, we exploit this structure in learning semantically meaningful low dimensional vector representations of objects. We learn these vector representations by mining a dataset of scanned 3D spaces using an unsupervised algorithm. We represent objects as point clouds, a flexible and general representation for 3D data, which we encode into a vector representation. We show that using our method to include context increases the ability of a clustering algorithm to distinguish different semantic classes from each other. Furthermore, we show that our algorithm produces continuous and meaningful object embeddings through interpolation experiments.


Biomedical Data to Text Generation via Fine Tuning Transformers. Data to text (D2T) generation in the biomedical domain is a promising yet mostly unexplored field of research. Here, we apply neural models for D2T generation to a real world dataset consisting of package leaflets of European medicines. We show that fine tuned transformers are able to generate realistic, multisentence text from data in the biomedical domain, yet have important limitations. We also release a new dataset (BioLeaflets) for benchmarking D2T generation models in the biomedical domain.


On the splitting conjecture in the hybrid model for the Riemann zeta function. We show that the splitting conjecture in the hybrid model of Gonek Hughes Keating holds to order on the Riemann hypothesis. Our results are valid in a larger range of the parameter X which mediates between the partial Euler and Hadamard products. We also show that the asymptotic splitting conjecture holds for this larger range of X in the cases of the second and fourth moments.


Free uniformly complete vector lattices. We define a free uniformly complete vector lattice over a set of generators and give its concrete representation as a space of continuous positively homogeneous functions.


Self energy recycling for low power reliable networks Half duplex or Full duplex?. Self energy recycling (sER), which allows transmit energy re utilization, has emerged as a viable option for improving the energy efficiency (EE) in low power Internet of Things networks. In this work, we investigate its benefits also in terms of reliability improvements and compare the performance of full duplex (FD) and half duplex (HD) schemes when using multi antenna techniques in a communication system. We analyze the trade offs when considering not only the energy spent on transmission but also the circuitry power consumption, thus making the analysis of much more practical interest. In addition to the well known spectral efficiency improvements, results show that FD also outperforms HD in terms of reliability. We show that sER introduces not only benefits in EE matters but also some modifications on how to achieve maximum reliability fairness between uplink and downlink transmissions, which is the main goal in this work. In order to achieve this objective, we propose the use of a dynamic FD scheme where the small base station (SBS) determines the optimal allocation of antennas for transmission and reception. We show the significant improvement gains of this strategy for the system outage probability when compared to the simple HD and FD schemes.


A Group Key Establishment Scheme. Group authentication is a method of confirmation that a set of users belong to a group and of distributing a common key among them. Unlike the standard authentication schemes where one central authority authenticates users one by one, group authentication can handle the authentication process at once for all members of the group. The recently presented group authentication algorithms mainly exploit Lagrange's polynomial interpolation along with elliptic curve groups over finite fields. As a fresh approach, this work suggests use of linear spaces for group authentication and key establishment for a group of any size. The approach with linear spaces introduces a reduced computation and communication load to establish a common shared key among the group members. The advantages of using vector spaces make the proposed method applicable to energy and resource constrained devices. In addition to providing lightweight authentication and key agreement, this proposal allows any user in a group to make a non member to be a member, which is expected to be useful for autonomous systems in the future. The scheme is designed in a way that the sponsors of such members can easily be recognized by anyone in the group. Unlike the other group authentication schemes based on Lagrange's polynomial interpolation, the proposed scheme doesn't provide a tool for adversaries to compromise the whole group secrets by using only a few members' shares as well as it allows to recognize a non member easily, which prevents service interruption attacks.


On Sombor coindex of graphs. Motivated by the recently introduced topological index, the Somber index, we define a new topological index of a graph in this paper, we call it Sombor coindex. The Sombor coindex is defined by considering analogous contributions from the pairs of non adjacent vertices, capturing, thus, and quantifying a possible influence of remote pairs of vertices. We give several properties of the Somber coindex and its relations to the Sombor index, the Zagreb (co)indices, forgotten coindex and other important graph parameters. We also compute the bounds of the Somber coindex of some graph operations and compute the Sombor coindex for some chemical graphs as an application.


Maximizing Parallelism in Distributed Training for Huge Neural Networks. The recent Natural Language Processing techniques have been refreshing the state of the art performance at an incredible speed. Training huge language models is therefore an imperative demand in both industry and academy. However, huge language models impose challenges to both hardware and software. Graphical processing units (GPUs) are iterated frequently to meet the exploding demand, and a variety of ASICs like TPUs are spawned. However, there is still a tension between the fast growth of the extremely huge models and the fact that Moore's law is approaching the end. To this end, many model parallelism techniques are proposed to distribute the model parameters to multiple devices, so as to alleviate the tension on both memory and computation. Our work is the first to introduce a 3 dimensional model parallelism for expediting huge language models. By reaching a perfect load balance, our approach presents smaller memory and communication cost than existing state of the art 1 D and 2 D model parallelism. Our experiments on 64 TACC's V100 GPUs show that our 3 D parallelism outperforms the 1 D and 2 D parallelism with 2.32x and 1.57x speedup, respectively.


Multi Structural Games and Number of Quantifiers. We study multi structural games, played on two sets mathcal A and mathcal B of structures. These games generalize Ehrenfeucht Fra " i ss ' e games. Whereas Ehrenfeucht Fra " i ss ' e games capture the quantifier rank of a first order sentence, multi structural games capture the number of quantifiers, in the sense that Spoiler wins the r round game if and only if there is a first order sentence phi with at most r quantifiers, where every structure in mathcal A satisfies phi and no structure in mathcal B satisfies phi . We use these games to give a complete characterization of the number of quantifiers required to distinguish linear orders of different sizes, and develop machinery for analyzing structures beyond linear orders.


Local Fourier Analysis of P Multigrid for High Order Finite Element Operators. Multigrid methods are popular for solving linear systems derived from discretizing PDEs. Local Fourier Analysis (LFA) is a technique for investigating and tuning multigrid methods. P multigrid is popular for high order or spectral finite element methods, especially on unstructured meshes. In this paper, we introduce LFAToolkit.jl, a new Julia package for LFA of high order finite element methods. LFAToolkit.jl analyzes preconditioning techniques for arbitrary systems of second order PDEs and supports mixed finite element methods. Specifically, we develop LFA of p multigrid with arbitrary second order PDEs using high order finite element discretizations and examine the performance of Jacobi and Chebyshev smoothing for two grid schemes with aggressive p coarsening. A natural extension of this LFA framework is the analysis of h multigrid for finite element discretizations or finite difference discretizations that can be represented in the language of finite elements. With this extension, we can replicate previous work on the LFA of h multigrid for arbitrary order discretizations using a convenient and extensible abstraction. Examples in one, two, and three dimensions are presented to validate our LFA of p multigrid for the Laplacian and linear elasticity.


A Sketch Based Neural Model for Generating Commit Messages from Diffs. Commit messages have an important impact in software development, especially when working in large teams. Multiple developers who have a different style of writing may often be involved in the same project. For this reason, it may be difficult to maintain a strict pattern of writing informative commit messages, with the most frequent issue being that these messages are not descriptive enough. In this paper we apply neural machine translation (NMT) techniques to convert code diffs into commit messages and we present an improved sketch based encoder for this task. We split the approach into three parts. Firstly, we focus on finding a more suitable NMT baseline for this problem. Secondly, we show that the performance of the NMT models can be improved by training on examples containing a specific file type. Lastly, we introduce a novel sketch based neural model inspired by recent approaches used for code generation and we show that the sketch based encoder significantly outperforms existing state of the art solutions. The results highlight that this improvement is relevant especially for Java source code files, by examining two different datasets introduced in recent years for this task.


NSOP 1 like independence in AECats. The classes stable, simple and NSOP 1 in the stability hierarchy for first order theories can be characterised by the existence of a certain independence relation. For each of them there is a canonicity theorem there can be at most one nice independence relation. Independence in stable and simple first order theories must come from forking and dividing (which then coincide), and for NSOP 1 theories it must come from Kim dividing. We generalise this work to the framework of AECats (Abstract Elementary Categories) with the amalgamation property. These are a certain kind of accessible category generalising the category of (subsets of) models of some theory. We prove canonicity theorems for stable, simple and NSOP 1 like independence relations. The stable and simple cases have been done before in slightly different setups, but we provide them here as well so that we can recover part of the original stability hierarchy. We also provide abstract definitions for each of these independence relations as what we call isi dividing, isi forking and long Kim dividing.


Bernoulli convolutions with Garsia parameters in (1, sqrt 2 have continuous density functions. Let lambda in (1, sqrt 2 be an algebraic integer with Mahler measure 2. A classical result of Garsia shows that the Bernoulli convolution mu lambda is absolutely continuous with respect to the Lebesgue measure with a density function in L infty . In this paper, we show that the density function is continuous.


Current eHealth Challenges and recent trends in eHealth applications. eHealth (Health Informatics Medical Informatics) field is growing worldwide due to acknowledge of reputable Organizations such as World Health Organization, Institute of Medicine in USA and several others. This field is facing number of challenges and there is need to classify these challenges mentioned by different researchers of this area. The purpose of this study is to classify different eHealth challenges in broader categories. We also analyzed recent eHealth Applications to identify current trends of such applications. In this paper, we identify stakeholders who are responsible to contribute in a particular eHealth challenge. Through eHealth application analysis, we categories these applications based on different factors. We identify different socio economic benefits, which these applications can provide. We also present ecosystem of an eHealth application. We gave recommendations for eHealth challenges relevant to Information Technology domain. We conclude our discussion by specifying areas for future research and recommending researchers to work on identify which type of disease can control and manage by different eHealth applications.


Exploring Conditional Text Generation for Aspect Based Sentiment Analysis. Aspect based sentiment analysis (ABSA) is an NLP task that entails processing user generated reviews to determine (i) the target being evaluated, (ii) the aspect category to which it belongs, and (iii) the sentiment expressed towards the target and aspect pair. In this article, we propose transforming ABSA into an abstract summary like conditional text generation task that uses targets, aspects, and polarities to generate auxiliary statements. To demonstrate the efficacy of our task formulation and a proposed system, we fine tune a pre trained model for conditional text generation tasks to get new state of the art results on a few restaurant domains and urban neighborhoods domain benchmark datasets.


Classification of Handwritten Names of Cities and Handwritten Text Recognition using Various Deep Learning Models. This article discusses the problem of handwriting recognition in Kazakh and Russian languages. This area is poorly studied since in the literature there are almost no works in this direction. We have tried to describe various approaches and achievements of recent years in the development of handwritten recognition models in relation to Cyrillic graphics. The first model uses deep convolutional neural networks (CNNs) for feature extraction and a fully connected multilayer perceptron neural network (MLP) for word classification. The second model, called SimpleHTR, uses CNN and recurrent neural network (RNN) layers to extract information from images. We also proposed the Bluechet and Puchserver models to compare the results. Due to the lack of available open datasets in Russian and Kazakh languages, we carried out work to collect data that included handwritten names of countries and cities from 42 different Cyrillic words, written more than 500 times in different handwriting. We also used a handwritten database of Kazakh and Russian languages (HKR). This is a new database of Cyrillic words (not only countries and cities) for the Russian and Kazakh languages, created by the authors of this work.


Parabolic boundary value problems and generalized Sobolev spaces. The research monograph expounds the foundation of a new theory of parabolic initial boundary value problems in scales of generalized anisotropic Sobolev spaces. These scales are calibrated essentially more finely with the help of a function parameter of regularity than the classes of spaces used earlier in the theory of parabolic problems. The monograph is featured by the systematic application of the method of quadratic interpolation (with function parameter) between abstract and Sobolev inner product spaces. The monograph is intended for the researches, professors, PhD students, and senior students specializing in differential equations and mathematical analysis.


Matroid stratifications of hypergraph varieties, their realization spaces, and discrete conditional independence models. We study conditional independence (CI) models in statistical theory, in the case of discrete random variables, from the point of view of algebraic geometry and matroid theory. Any CI model with hidden random variables corresponds to a variety defined by certain determinantal conditions on a matrix whose entries are probabilities of events involving the observed random variables. We show that any CI variety, and more generally any hypergraph variety, admits a matroid stratification. Our main motivation for studying decompositions of CI varieties is the realizability problem given a collection of CI relations, the goal is to determine the existence of random variables that satisfy these constraints and violates the rest. We show that the realization spaces of CI models and the matroid varieties in their decompositions are closely related. We use ideas from incidence geometry, in particular point and line configurations, to find minimal decompositions of general hypergraph varieties in terms of matroid varieties, which are not necessarily irreducible by Mn "ev Sturmfels universality theorem, and may have arbitrary singularities. We focus on various families of hypergraph varieties for which we explicitly compute an irredundant irreducible decomposition. Our main findings in this direction are threefold (1) we describe minimal matroids of such hypergraphs (2) we prove that the varieties of these matroids are irreducible and their union is the hypergraph variety and (3) we show that every such matroid is realizable over real numbers. Our decomposition strategy gives immediate matroid interpretations of the irreducible components of many families of CI varieties in algebraic statistics, and unravels the symmetric structures in CI varieties which hugely simplifies the computations.


On the pathwise uniqueness for a class of degenerate It o stochastic differential equations. We show pathwise uniqueness for a class of degenerate It o SDE among all of its weak solutions that spend zero time at the points of degeneracy of the dispersion matrix. Consequently, by the Yamada Watanabe Theorem and a weak existence result, the pathwise unique solutions can be shown to be strong and to exist. The main tools to show pathwise uniqueness are inequalities associated with maximal functions and a Krylov type estimate derived from elliptic regularity and uniqueness in law.


Learning to ignore rethinking attention in CNNs. Recently, there has been an increasing interest in applying attention mechanisms in Convolutional Neural Networks (CNNs) to solve computer vision tasks. Most of these methods learn to explicitly identify and highlight relevant parts of the scene and pass the attended image to further layers of the network. In this paper, we argue that such an approach might not be optimal. Arguably, explicitly learning which parts of the image are relevant is typically harder than learning which parts of the image are less relevant and, thus, should be ignored. In fact, in vision domain, there are many easy to identify patterns of irrelevant features. For example, image regions close to the borders are less likely to contain useful information for a classification task. Based on this idea, we propose to reformulate the attention mechanism in CNNs to learn to ignore instead of learning to attend. Specifically, we propose to explicitly learn irrelevant information in the scene and suppress it in the produced representation, keeping only important attributes. This implicit attention scheme can be incorporated into any existing attention mechanism. In this work, we validate this idea using two recent attention methods Squeeze and Excitation (SE) block and Convolutional Block Attention Module (CBAM). Experimental results on different datasets and model architectures show that learning to ignore, i.e., implicit attention, yields superior performance compared to the standard approaches.


Generalized Zero shot Intent Detection via Commonsense Knowledge. Identifying user intents from natural language utterances is a crucial step in conversational systems that has been extensively studied as a supervised classification problem. However, in practice, new intents emerge after deploying an intent detection model. Thus, these models should seamlessly adapt and classify utterances with both seen and unseen intents unseen intents emerge after deployment and they do not have training data. The few existing models that target this setting rely heavily on the scarcely available training data and overfit to seen intents data, resulting in a bias to misclassify utterances with unseen intents into seen ones. We propose RIDE an intent detection model that leverages commonsense knowledge in an unsupervised fashion to overcome the issue of training data scarcity. RIDE computes robust and generalizable relationship meta features that capture deep semantic relationships between utterances and intent labels these features are computed by considering how the concepts in an utterance are linked to those in an intent label via commonsense knowledge. Our extensive experimental analysis on three widely used intent detection benchmarks shows that relationship meta features significantly increase the accuracy of detecting both seen and unseen intents and that RIDE outperforms the state of the art model for unseen intents.


Grassmannians and Singularities. Let X be an integral scheme of finite presentation over a perfect field. Let q be a singular closed point of X . We prove that there exists an open subset V of X containing q such that V admits a resolution, that is, there exists a smooth scheme widetilde V and a proper birational morphism from widetilde V onto V .


A Multi Tenant Framework for Cloud Container Services. Container technologies have been evolving rapidly in the cloud native era. Kubernetes, as a production grade container orchestration platform, has been proven to be successful at managing containerized applications in on premises datacenters. However, Kubernetes lacks sufficient multi tenant supports by design, meaning in cloud environments, dedicated clusters are required to serve multiple users, i.e., tenants. This limitation significantly diminishes the benefits of cloud computing, and makes it difficult to build multi tenant software as a service (SaaS) products using Kubernetes. In this paper, we propose Virtual Cluster, a new multi tenant framework that extends Kubernetes with adequate multi tenant supports. Basically, VirtualCluster provides both control plane and data plane isolations while sharing the underlying compute resources among tenants. The new framework preserves the API compatibility by avoiding modifying the Kubernetes core components. Hence, it can be easily integrated with existing Kubernetes use cases. Our experimental results show that the overheads introduced by VirtualCluster, in terms of latency and throughput, is moderate.


Corpus Based Paraphrase Detection Experiments and Review. Paraphrase detection is important for a number of applications, including plagiarism detection, authorship attribution, question answering, text summarization, text mining in general, etc. In this paper, we give a performance overview of various types of corpus based models, especially deep learning (DL) models, with the task of paraphrase detection. We report the results of eight models (LSI, TF IDF, Word2Vec, Doc2Vec, GloVe, FastText, ELMO, and USE) evaluated on three different public available corpora Microsoft Research Paraphrase Corpus, Clough and Stevenson and Webis Crowd Paraphrase Corpus 2011. Through a great number of experiments, we decided on the most appropriate approaches for text pre processing hyper parameters, sub model selection where they exist (e.g., Skipgram vs. CBOW), distance measures, and semantic similarity paraphrase detection threshold. Our findings and those of other researchers who have used deep learning models show that DL models are very competitive with traditional state of the art approaches and have potential that should be further developed.


Asymmetric topological pumping in nonparaxial photonics. Topological photonics was initially inspired by the quantum optical analogy between the Schr "odinger equation for an electron wavefunction and the paraxial equation for a light beam. Here, we reveal an unexpected phenomenon in topological pumping observed in arrays of nonparaxial optical waveguides where the quantum optical analogy becomes invalid. We predict theoretically and demonstrate experimentally an asymmetric topological pumping when the injected field transfers from one side of the waveguide array to the other side whereas the reverse process is unexpectedly forbidden. Our finding could open an avenue for exploring topological photonics that enables nontrivial topological phenomena and designs in photonics driven by nonparaxiality.


Theory of Deep Convolutional Neural Networks III Approximating Radial Functions. We consider a family of deep neural networks consisting of two groups of convolutional layers, a downsampling operator, and a fully connected layer. The network structure depends on two structural parameters which determine the numbers of convolutional layers and the width of the fully connected layer. We establish an approximation theory with explicit approximation rates when the approximated function takes a composite form f circ Q with a feature polynomial Q and a univariate function f . In particular, we prove that such a network can outperform fully connected shallow networks in approximating radial functions with Q(x) x 2 , when the dimension d of data from mathbb R d is large. This gives the first rigorous proof for the superiority of deep convolutional neural networks in approximating functions with special structures. Then we carry out generalization analysis for empirical risk minimization with such a deep network in a regression framework with the regression function of the form f circ Q . Our network structure which does not use any composite information or the functions Q and f can automatically extract features and make use of the composite nature of the regression function via tuning the structural parameters. Our analysis provides an error bound which decreases with the network depth to a minimum and then increases, verifying theoretically a trade off phenomenon observed for network depths in many practical applications.


Constrained Shortest Path Search with Graph Convolutional Neural Networks. Planning for Autonomous Unmanned Ground Vehicles (AUGV) is still a challenge, especially in difficult, off road, critical situations. Automatic planning can be used to reach mission objectives, to perform navigation or maneuvers. Most of the time, the problem consists in finding a path from a source to a destination, while satisfying some operational constraints. In a graph without negative cycles, the computation of the single pair shortest path from a start node to an end node is solved in polynomial time. Additional constraints on the solution path can however make the problem harder to solve. This becomes the case when we need the path to pass through a few mandatory nodes without requiring a specific order of visit. The complexity grows exponentially with the number of mandatory nodes to visit. In this paper, we focus on shortest path search with mandatory nodes on a given connected graph. We propose a hybrid model that combines a constraint based solver and a graph convolutional neural network to improve search performance. Promising results are obtained on realistic scenarios.


The persistent question of potassium channel permeation mechanisms. Potassium channels play critical roles in many physiological processes, providing a selective permeation route for K ions in and out of a cell, by employing a carefully designed selectivity filter, evolutionarily conserved from viruses to mammals. The structure of the selectivity filter was determined at atomic resolution by x ray crystallography, showing a tight coordination of desolvated K ions by the channel. However, the molecular mechanism of K ions permeation through potassium channels remains unclear, with structural, functional and computational studies often providing conflicting data and interpretations. In this review, we will present the proposed mechanisms, discuss their origins, and will critically assess them against all available data. General properties shared by all potassium channels are introduced first, followed by the introduction of two main mechanisms of ion permeation soft and direct knock on. Then, we will discuss critical computational and experimental studies that shaped the field. We will especially focus on molecular dynamics (MD) simulations, that provided mechanistic and energetic aspects of K permeation, but at the same time created long standing controversies. Further challenges and possible solutions are presented as well.


Structural identifiability analysis of PDEs A case study in continuous age structured epidemic models. Computational and mathematical models rely heavily on estimated parameter values for model development. Identifiability analysis determines how well the parameters of a model can be estimated from experimental data. Identifiability analysis is crucial for interpreting and determining confidence in model parameter values and to provide biologically relevant predictions. Structural identifiability analysis, in which one assumes data to be noiseless and arbitrarily fine grained, has been extensively studied in the context of ordinary differential equation (ODE) models, but has not yet been widely explored for age structured partial differential equation (PDE) models. These models present additional difficulties due to increased number of variables and partial derivatives as well as the presence of boundary conditions. In this work, we establish a pipeline for structural identifiability analysis of age structured PDE models using a differential algebra framework and derive identifiability results for specific age structured models. We use epidemic models to demonstrate this framework because of their wide spread use in many different diseases and for the corresponding parallel work previously done for ODEs. In our application of the identifiability analysis pipeline, we focus on a Susceptible Exposed Infected model for which we compare identifiability results for a PDE and corresponding ODE system and explore effects of age dependent parameters on identifiability. We also show how practical identifiability analysis can be applied in this example.


Remarks on iterations of the mathbb A 1 chain connected components construction. We show that the sheaf of mathbb A 1 connected components of a Nisnevich sheaf of sets and its universal mathbb A 1 invariant quotient (obtained by iterating the mathbb A 1 chain connected components construction and taking the direct limit) agree on field valued points. This establishes an explicit formula for the field valued points of the sheaf of mathbb A 1 connected components of any space. Given any natural number n , we construct an mathbb A 1 connected space on which the iterations of the naive mathbb A 1 connected components construction do not stabilize before the n th stage.


Higher Gaussian Maps on K3 surfaces. We give necessary conditions for the surjectivity of the higher Gaussian maps on a polarized K3 surface. As an application, we show that the higher k th Gauss map for a general curve of genus g (that depends quadratically with k ) is surjective.


Pseudo Relevance Feedback for Multiple Representation Dense Retrieval. Pseudo relevance feedback mechanisms, from Rocchio to the relevance models, have shown the usefulness of expanding and reweighting the users' initial queries using information occurring in an initial set of retrieved documents, known as the pseudo relevant set. Recently, dense retrieval through the use of neural contextual language models such as BERT for analysing the documents' and queries' contents and computing their relevance scores has shown a promising performance on several information retrieval tasks still relying on the traditional inverted index for identifying documents relevant to a query. Two different dense retrieval families have emerged the use of single embedded representations for each passage and query (e.g. using BERT's CLS token), or via multiple representations (e.g. using an embedding for each token of the query and document). In this work, we conduct the first study into the potential for multiple representation dense retrieval to be enhanced using pseudo relevance feedback. In particular, based on the pseudo relevant set of documents identified using a first pass dense retrieval, we extract representative feedback embeddings (using KMeans clustering) while ensuring that these embeddings discriminate among passages (based on IDF) which are then added to the query representation. These additional feedback embeddings are shown to both enhance the effectiveness of a reranking as well as an additional dense retrieval operation. Indeed, experiments on the MSMARCO passage ranking dataset show that MAP can be improved by upto 26 on the TREC 2019 query set and 10 on the TREC 2020 query set by the application of our proposed ColBERT PRF method on a ColBERT dense retrieval approach.


Fairness in Ranking under Uncertainty. Fairness has emerged as an important consideration in algorithmic decision making. Unfairness occurs when an agent with higher merit obtains a worse outcome than an agent with lower merit. Our central point is that a primary cause of unfairness is uncertainty. A principal or algorithm making decisions never has access to the agents' true merit, and instead uses proxy features that only imperfectly predict merit (e.g., GPA, star ratings, recommendation letters). None of these ever fully capture an agent's merit yet existing approaches have mostly been defining fairness notions directly based on observed features and outcomes. Our primary point is that it is more principled to acknowledge and model the uncertainty explicitly. The role of observed features is to give rise to a posterior distribution of the agents' merits. We use this viewpoint to define a notion of approximate fairness in ranking. We call an algorithm phi fair (for phi in 0,1 ) if it has the following property for all agents x and all k if agent x is among the top k agents with respect to merit with probability at least rho (according to the posterior merit distribution), then the algorithm places the agent among the top k agents in its ranking with probability at least phi rho . We show how to compute rankings that optimally trade off approximate fairness against utility to the principal. In addition to the theoretical characterization, we present an empirical analysis of the potential impact of the approach in simulation studies. For real world validation, we applied the approach in the context of a paper recommendation system that we built and fielded at the KDD 2020 conference.


Quoka Atlas of Scholarly Knowledge Production An Interactive Sensemaking Tool for Exploring the Outputs of Research Institutions. The vast amount of research produced at institutions world wide is extremely diverse, and coarse grained quantitative measures of impact often obscure the individual contributions of these institutions to specific research fields and topics. We show that by applying an information retrieval model to index research articles which are faceted by institution and time, we can develop tools to rank institutions given a keyword query. We present an interactive atlas, Quoka, designed to enable a user to explore these rankings contextually by geography and over time. Through a set of use cases we demonstrate that the atlas can be used to perform sensemaking tasks to learn and collect information about the relationships between institutions and scholarly knowledge production.


Lie algebroids are curved Lie algebras. We show that there is an equivalence of infty categories between Lie algebroids and certain kinds of curved Lie algebras. For this we develop a method to study the infty category of curved Lie algebras using the homotopy theory of algebras over a complete operad.


Automatic Knowledge Augmentation for Generative Commonsense Reasoning. Generative commonsense reasoning is the capability of a language model to generate a sentence with a given concept set that is based on commonsense knowledge. However, generative language models still struggle to provide outputs, and the training set does not contain patterns that are sufficient for generative commonsense reasoning. In this paper, we propose a data centric method that uses automatic knowledge augmentation to extend commonsense knowledge using a machine knowledge generator. This method can generate semi golden sentences that improve the generative commonsense reasoning of a language model without architecture modifications. Furthermore, this approach is a model agnostic method and does not require human effort for data construction.


System Component Level Self Adaptations for Security via Bayesian Games. Security attacks present unique challenges to self adaptive system design due to the adversarial nature of the environment. However, modeling the system as a single player, as done in prior works in security domain, is insufficient for the system under partial compromise and for the design of fine grained defensive strategies where the rest of the system with autonomy can cooperate to mitigate the impact of attacks. To deal with such issues, we propose a new self adaptive framework incorporating Bayesian game and model the defender (i.e., the system) at the granularity of components in system architecture. The system architecture model is translated into a Bayesian multi player game, where each component is modeled as an independent player while security attacks are encoded as variant types for the components. The defensive strategy for the system is dynamically computed by solving the pure equilibrium to achieve the best possible system utility, improving the resiliency of the system against security attacks.


The algebra of row monomial matrices. We consider an algebra with non standard operations on the class of row monomial matrices (having one unit and rest of zeros in every row). The class of row monomial matrices is closed under multiplication, but not closed under ordinary matrix addition. The paper considers a kind of summation operation on row monomial matrices and the necessary conditions to be closed under the operation in this class. The most significant difference between the algebra of row monomial matrices and linear algebra is the summation operation, with respect to which the class of row monomial matrices is closed. The operation of summation in the algebra can be considered also as an algebra of subsets of any set. The class of subsets of given set is closed under considered operation of summation. The deterministic finite automaton (DFA) can be presented by a complete underlying graph of the automaton with edges labelled by letters of an alphabet. Row monomial matrices can be induced by words in the alphabet of labels on edges of underlying graph of DFA and present a mapping of the set of states. A word s of letters on edges of underlying graph Gamma of deterministic finite automaton (DFA) is called synchronizing if s sends all states of the automaton to a unique state. J. v C erny discovered in 1964 a sequence of n state complete DFA possessing a minimal synchronizing word of length (n 1) 2 . The hypothesis, mostly known today as v C erny conjecture, claims that (n 1) 2 is a precise upper bound on the length of such a word over alphabet Sigma of letters on edges of Gamma for every complete n state DFA. The hypothesis was formulated in 1966 by Starke. The following proof of the conjecture uses the algebra of row monomial matrices.


Partition theorems for expanded trees. We look for partition theorems for large subtrees for suitable uncountable trees and colourings. The intention is to apply it to model theoretic problems.


A splitting result for real submanifolds of a Kahler manifold. Let (Z, omega) be a connected Kahler manifold with an holomorphic action of the complex reductive Lie group U mathbb C , where U is a compact connected Lie group acting in a hamiltonian fashion. Let G be a closed compatible Lie group of U mathbb C and let M be a G invariant connected submanifold of Z . Let x in M . If G is a real form of U mathbb C , we investigate conditions such that G cdot x compact implies U mathbb C cdot x is compact as well. The vice versa is also investigated. We also characterize G invariant real submanifolds such that the norm square of the gradient map is constant. As an application, we prove a splitting result for real connected submanifolds of (Z, omega) generalizing a result proved in cite pg , see also cite bg,bs .


Combinatorial Algorithms for Rooted Prize Collecting Walks and Applications to Orienteering and Minimum Latency Problems. We consider the rooted prize collecting walks (PCW) problem, wherein we seek a collection C of rooted walks having minimum prize collecting cost, which is the (total cost of walks in C ) (total node reward of nodes not visited by any walk in C ). This problem arises naturally as the Lagrangian relaxation of both orienteering, where we seek a length bounded walk of maximum reward, and the ell stroll problem, where we seek a minimum length walk covering at least ell nodes. Our main contribution is to devise a simple, combinatorial algorithm for the PCW problem in directed graphs that returns a rooted tree whose prize collecting cost is at most the optimum value of the prize collecting walks problem. We utilize our algorithm to develop combinatorial approximation algorithms for two fundamental vehicle routing problems (VRPs) (1) orienteering and (2) k minimum latency problem ( k MLP), wherein we seek to cover all nodes using k paths starting at a prescribed root node, so as to minimize the sum of the node visiting times. Our combinatorial algorithm allows us to sidestep the part where we solve a preflow based LP in the LP rounding algorithms of Friggstand and Swamy (2017) for orienteering, and in the state of the art 7.183 approximation algorithm for k MP in Post and Swamy (2015). Consequently, we obtain combinatorial implementations of these algorithms with substantially improved running times compared with the current best approximation factors. We report computational results for our resulting (combinatorial implementations of) orienteering algorithms, which show that the algorithms perform quite well in practice, both in terms of the quality of the solution they return, as also the upper bound they yield on the orienteering optimum (which is obtained by leveraging the workings of our PCW algorithm).


Explaining decision of model from its prediction. This document summarizes different visual explanations methods such as CAM, Grad CAM, Localization using Multiple Instance Learning Saliency based methods, Saliency driven Class Impressions, Muting pixels in input image Adversarial methods and Activation visualization, Convolution filter visualization Feature based methods. We have also shown the results produced by different methods and a comparison between CAM, GradCAM, and Guided Backpropagation.


Slicing the hypercube is not easy. We prove that at least Omega(n 0.51 ) hyperplanes are needed to slice all edges of the n dimensional hypercube. We provide a couple of applications lower bounds on the computational complexity of parity, and a lower bound on the cover number of the hypercube by skew hyperplanes.


Matching in power graphs of finite groups. The power graph P(G) of a finite group G is the undirected simple graph with vertex set G , where two elements are adjacent if one is a power of the other. In this paper, the matching numbers of power graphs of finite groups are investigated. We give upper and lower bounds, and conditions for the power graph of a group to possess a perfect matching. We give a formula for the matching number for any finite nilpotent group. In addition, using some elementary number theory, we show that the matching number of the enhanced power graph P e(G) of G (in which two elements are adjacent if both are powers of a common element) is equal to that of the power graph of G .


Learning Action Completeness from Points for Weakly supervised Temporal Action Localization. We tackle the problem of localizing temporal intervals of actions with only a single frame label for each action instance for training. Owing to label sparsity, existing work fails to learn action completeness, resulting in fragmentary action predictions. In this paper, we propose a novel framework, where dense pseudo labels are generated to provide completeness guidance for the model. Concretely, we first select pseudo background points to supplement point level action labels. Then, by taking the points as seeds, we search for the optimal sequence that is likely to contain complete action instances while agreeing with the seeds. To learn completeness from the obtained sequence, we introduce two novel losses that contrast action instances with background ones in terms of action score and feature similarity, respectively. Experimental results demonstrate that our completeness guidance indeed helps the model to locate complete action instances, leading to large performance gains especially under high IoU thresholds. Moreover, we demonstrate the superiority of our method over existing state of the art methods on four benchmarks THUMOS'14, GTEA, BEOID, and ActivityNet. Notably, our method even performs comparably to recent fully supervised methods, at the 6 times cheaper annotation cost. Our code is available at https github.com Pilhyeon.


Parallel Newton Krylov BDDC and FETI DP deluxe solvers for implicit time discretizations of the cardiac Bidomain equations. Two novel parallel Newton Krylov Balancing Domain Decomposition by Constraints (BDDC) and Dual Primal Finite Element Tearing and Interconnecting (FETI DP) solvers are here constructed, analyzed and tested numerically for implicit time discretizations of the three dimensional Bidomain system of equations. This model represents the most advanced mathematical description of the cardiac bioelectrical activity and it consists of a degenerate system of two non linear reaction diffusion partial differential equations (PDEs), coupled with a stiff system of ordinary differential equations (ODEs). A finite element discretization in space and a segregated implicit discretization in time, based on decoupling the PDEs from the ODEs, yields at each time step the solution of a non linear algebraic system. The Jacobian linear system at each Newton iteration is solved by a Krylov method, accelerated by BDDC or FETI DP preconditioners, both augmented with the recently introduced em deluxe scaling of the dual variables. A polylogarithmic convergence rate bound is proven for the resulting parallel Bidomain solvers. Extensive numerical experiments on linux clusters up to two thousands processors confirm the theoretical estimates, showing that the proposed parallel solvers are scalable and quasi optimal.


Spectral MVIR Joint Reconstruction of 3D Shape and Spectral Reflectance. Reconstructing an object's high quality 3D shape with inherent spectral reflectance property, beyond typical device dependent RGB albedos, opens the door to applications requiring a high fidelity 3D model in terms of both geometry and photometry. In this paper, we propose a novel Multi View Inverse Rendering (MVIR) method called Spectral MVIR for jointly reconstructing the 3D shape and the spectral reflectance for each point of object surfaces from multi view images captured using a standard RGB camera and low cost lighting equipment such as an LED bulb or an LED projector. Our main contributions are twofold (i) We present a rendering model that considers both geometric and photometric principles in the image formation by explicitly considering camera spectral sensitivity, light's spectral power distribution, and light source positions. (ii) Based on the derived model, we build a cost optimization MVIR framework for the joint reconstruction of the 3D shape and the per vertex spectral reflectance while estimating the light source positions and the shadows. Different from most existing spectral 3D acquisition methods, our method does not require expensive special equipment and cumbersome geometric calibration. Experimental results using both synthetic and real world data demonstrate that our Spectral MVIR can acquire a high quality 3D model with accurate spectral reflectance property.


Falling Through the Gaps Neural Architectures as Models of Morphological Rule Learning. Recent advances in neural architectures have revived the problem of morphological rule learning. We evaluate the Transformer as a model of morphological rule learning and compare it with Recurrent Neural Networks (RNN) on English, German, and Russian. We bring to the fore a hitherto overlooked problem, the morphological gaps, where the expected inflection of a word is missing. For example, 63 Russian verbs lack a first person singular present form such that one cannot comfortably say " o v s v c u v s v c u" ("I feel"). Even English has gaps, such as the past participle of "stride" the function of morphological inflection can be partial. Both neural architectures produce inflections that ought to be missing. Analyses reveal that Transformers recapitulate the statistical distribution of inflections in the training data, similar to RNNs. Models' success on English and German is driven by the fact that rules in these languages can be identified with the majority forms, which is not universal.


Biological applications of ferroelectric materials. The study and applications of ferroelectric materials in the biomedical and biotechnological fields is a novel and very promising scientific area that spans roughly one decade. However, some groups have already provided experimental proof of very interesting biological modulation when living systems are exposed to different ferroelectrics and excitation mechanisms. These materials should offer several advantages in the field of bioelectricity, such as no need of an external electric power source or circuits, scalable size of the electroactive regions, flexible and reconfigurable virtual electrodes, or fully proved biocompatibility. In this focused review we provide the underlying physics of ferroelectric activity and a recount of the research reports already published, along with some tentative biophysical mechanisms that can explain the observed results. More specifically, we focused on the biological actions of domain ferroelectrics, and ferroelectrics excited by the bulk photovoltaic effect or the pyroelectric effect. It is our goal to provide a comprehensive account of the published material so far, and to set the stage for a vigorous expansion of the field, with envisioned applications that span from cell biology and signaling to cell and tissue regeneration, antitumoral action, or cell bioengineering to name a few.


Compensation phenomena for concentration effects via nonlinear elliptic estimates. We study compensation phenomena for fields satisfying both a pointwise and a linear differential constraint. The compensation effect takes the form of nonlinear elliptic estimates, where constraining the values of the field to lie in a cone compensates for the lack of ellipticity of the differential operator. We give a series of new examples of this phenomenon, focusing on the case where the cone is a subset of the space of symmetric matrices and the differential operator is the divergence or the curl. One of our main findings is that the maximal gain of integrability is tied to both the differential operator and the cone, contradicting in particular a recent conjecture from arXiv 2106.03077. This appends the classical compensated compactness framework for oscillations with a variant designed for concentrations, and also extends the recent theory of compensated integrability due to D. Serre. In particular, we find a new family of integrands that are Div quasiconcave under convex constraints.


A Biologically Plausible Parser. We describe a parser of English effectuated by biologically plausible neurons and synapses, and implemented through the Assembly Calculus, a recently proposed computational framework for cognitive function. We demonstrate that this device is capable of correctly parsing reasonably nontrivial sentences. While our experiments entail rather simple sentences in English, our results suggest that the parser can be extended beyond what we have implemented, to several directions encompassing much of language. For example, we present a simple Russian version of the parser, and discuss how to handle recursion, embedding, and polysemy.


School of hard knocks Curriculum analysis for Pommerman with a fixed computational budget. Pommerman is a hybrid cooperative adversarial multi agent environment, with challenging characteristics in terms of partial observability, limited or no communication, sparse and delayed rewards, and restrictive computational time limits. This makes it a challenging environment for reinforcement learning (RL) approaches. In this paper, we focus on developing a curriculum for learning a robust and promising policy in a constrained computational budget of 100,000 games, starting from a fixed base policy (which is itself trained to imitate a noisy expert policy). All RL algorithms starting from the base policy use vanilla proximal policy optimization (PPO) with the same reward function, and the only difference between their training is the mix and sequence of opponent policies. One expects that beginning training with simpler opponents and then gradually increasing the opponent difficulty will facilitate faster learning, leading to more robust policies compared against a baseline where all available opponent policies are introduced from the start. We test this hypothesis and show that within constrained computational budgets, it is in fact better to "learn in the school of hard knocks", i.e., against all available opponent policies nearly from the start. We also include ablation studies where we study the effect of modifying the base environment properties of ammo and bomb blast strength on the agent performance.


Toeplitz operators on the Fock space via the Fourier transform. In sprite by Berger Coburn theorems and their conjecture in cite Coburn1994 , we use the Fourier transform to decompose T g as an infinite sum of Toeplitz operators with symbols which have compact support in the frequency domain. As a consequence, we obtain a sufficient condition for T g to be bounded in terms of the Carleson measure conditions defined by the heat transform of the symbol g . Moreover the decomposition of a Toeplitz operator leads us to get easily understanding that for a bounded function g , if its Berezin transform vanishes at infinity, then the Toeplitz operator T g is compact cite Eng and the Toeplitz algebra generated by Toeplitz operators with symbols in L infty is indeed generated by Toeplitz operators with symbols which on uniformly continuous on mathbb C n cite Bauer2012 .Further, we will apply our decomposition theory for a Toeplitz operator to estimate the Schatten p norm of the product of two Toeplitz operators.


Analysis of complex circadian time series data using wavelets. Experiments that compare rhythmic properties across different genetic alterations and entrainment conditions underlie some of the most important breakthroughs in circadian biology. A robust estimation of the rhythmic properties of the circadian signals goes hand in hand with these discoveries. Widely applied traditional signal analysis methods such as fitting cosine functions or Fourier transformations rely on the assumption that oscillation periods do not change over time. However, novel high resolution recording techniques have shown that, most commonly, circadian signals exhibit time dependent changes of periods and amplitudes which cannot be captured with the traditional approaches. In this chapter we introduce a method to determine time dependent properties of oscillatory signals, using the novel open source Python based Biological Oscillations Analysis Toolkit (pyBOAT). We show with examples how to detect rhythms, compute and interpret high resolution time dependent spectral results, analyze the main oscillatory component and to subsequently determine these main components time dependent instantaneous period, amplitude and phase. We introduce step by step how such an analysis can be done by means of the easy to use point and click graphical user interface (GUI) provided by pyBOAT or executed within a Python programming environment. Concepts are explained using simulated signals as well as experimentally obtained time series.


Numerical modeling of anisotropic ferroelectric materials with hybridizable discontinuous Galerkin methods. We investigate a gradient flow structure of the Ginzburg Landau Devonshire (GLD) model for anisotropic ferroelectric materials by reconstructing its energy form. We show that the modified energy form admits at least one minimizer. Under some regularity assumptions for the electric charge distribution and the initial polarization field, we prove that the L 2 gradient flow structure has a unique solution. To simulate the GLD model numerically, we propose an energy stable semi implicit time stepping scheme and a hybridizable discontinuous Galerkin method for space discretization. Some numerical tests are provided to verify the stability and convergence of the proposed numerical scheme as well as some properties of ferroelectric materials.


Space Efficient Fault Tolerant Diameter Oracles. We design f edge fault tolerant diameter oracles ( f FDOs). We preprocess a given graph G on n vertices and m edges, and a positive integer f , to construct a data structure that, when queried with a set F of F leq f edges, returns the diameter of G F . For a single failure ( f 1 ) in an unweighted directed graph of diameter D , there exists an approximate FDO by Henzinger et al. ITCS 2017 with stretch (1 varepsilon) , constant query time, space O(m) , and a combinatorial preprocessing time of widetilde O (mn n 1.5 sqrt Dm varepsilon ) .We present an FDO for directed graphs with the same stretch, query time, and space. It has a preprocessing time of widetilde O (mn n 2 varepsilon) . The preprocessing time nearly matches a conditional lower bound for combinatorial algorithms, also by Henzinger et al. With fast matrix multiplication, we achieve a preprocessing time of widetilde O (n 2.5794 n 2 varepsilon) . We further prove an information theoretic lower bound showing that any FDO with stretch better than 3 2 requires Omega(m) bits of space. For multiple failures ( f 1 ) in undirected graphs with non negative edge weights, we give an f FDO with stretch (f 2) , query time O(f 2 log 2 n ) , widetilde O (fn) space, and preprocessing time widetilde O (fm) . We complement this with a lower bound excluding any finite stretch in o(fn) space. We show that for unweighted graphs with polylogarithmic diameter and up to f o( log n log log n) failures, one can swap approximation for query time and space. We present an exact combinatorial f FDO with preprocessing time mn 1 o(1) , query time n o(1) , and space n 2 o(1) . When using fast matrix multiplication instead, the preprocessing time can be improved to n omega o(1) , where omega 2.373 is the matrix multiplication exponent.


A Survey on Role Oriented Network Embedding. Recently, Network Embedding (NE) has become one of the most attractive research topics in machine learning and data mining. NE approaches have achieved promising performance in various of graph mining tasks including link prediction and node clustering and classification. A wide variety of NE methods focus on the proximity of networks. They learn community oriented embedding for each node, where the corresponding representations are similar if two nodes are closer to each other in the network. Meanwhile, there is another type of structural similarity, i.e., role based similarity, which is usually complementary and completely different from the proximity. In order to preserve the role based structural similarity, the problem of role oriented NE is raised. However, compared to community oriented NE problem, there are only a few role oriented embedding approaches proposed recently. Although less explored, considering the importance of roles in analyzing networks and many applications that role oriented NE can shed light on, it is necessary and timely to provide a comprehensive overview of existing role oriented NE methods. In this review, we first clarify the differences between community oriented and role oriented network embedding. Afterwards, we propose a general framework for understanding role oriented NE and a two level categorization to better classify existing methods. Then, we select some representative methods according to the proposed categorization and briefly introduce them by discussing their motivation, development and differences. Moreover, we conduct comprehensive experiments to empirically evaluate these methods on a variety of role related tasks including node classification and clustering (role discovery), top k similarity search and visualization using some widely used synthetic and real world datasets...