A pro 2 group with full normal Hausdorff spectra. We construct a 2 generated pro 2 group with full normal Hausdorff spectrum 0,1 , with respect to each of the four standard filtration series the 2 power series, the lower 2 series, the Frattini series, and the dimension subgroup series. This answers a question of Klopsch and the second author, for the even prime case the odd prime case was settled by the first author and Klopsch. Also, our construction gives the first example of a finitely generated pro 2 group with full Hausdorff spectrum with respect to the lower 2 series.


Fusion GCN Multimodal Action Recognition using Graph Convolutional Networks. In this paper, we present Fusion GCN, an approach for multimodal action recognition using Graph Convolutional Networks (GCNs). Action recognition methods based around GCNs recently yielded state of the art performance for skeleton based action recognition. With Fusion GCN, we propose to integrate various sensor data modalities into a graph that is trained using a GCN model for multi modal action recognition. Additional sensor measurements are incorporated into the graph representation, either on a channel dimension (introducing additional node attributes) or spatial dimension (introducing new nodes). Fusion GCN was evaluated on two public available datasets, the UTD MHAD and MMACT datasets, and demonstrates flexible fusion of RGB sequences, inertial measurements and skeleton sequences. Our approach gets comparable results on the UTD MHAD dataset and improves the baseline on the large scale MMACT dataset by a significant margin of up to 12.37 (F1 Measure) with the fusion of skeleton estimates and accelerometer measurements.


Stratified flow past a sphere at moderate Reynolds numbers. A numerical study of stably stratified flows past spheres at Reynolds numbers Re 200 and Re 300 is reported. In these flow regimes, a neutrally stratified laminar flow induces distinctly different near wake features. However, the flow behaviour changes significantly as the stratification increases and suppresses the scale of vertical displacements of fluid parcels. Computations for a range of Froude numbers Fr in 0.1, infty show that as Froude number decreases, the flow patterns for both Reynolds numbers become similar. The representative simulations of the lee wave instability at Fr 0.625 and the two dimensional vortex shedding at Fr 0.25 regimes are illustrated for flows past single and tandem spheres, thereby providing further insight into the dynamics of stratified flows past bluff bodies. In particular, the reported study examines the relative influence of viscosity and stratification on the dividing streamline elevation, wake structure and flow separation. The solutions of the Navier Stokes equations in the incompressible Boussinesq limit are obtained on unstructured meshes suitable for simulations involving multiple bodies. Computations are accomplished using the finite volume, non oscillatory forward in time (NFT) Multidimensional Positive Definite Transport Algorithm (MPDATA) based solver. The impact and validity of the numerical approximations, especially for the cases exhibiting strong stratification, are also discussed. Qualitative and quantitative comparisons with available laboratory experiments and prior numerical studies confirm the validity of the numerical approach.


On a k matching algorithm and finding k factors in random graphs with minimum degree k 1 in linear time. We prove that for k 1 geq 3 and c (k 1) 2 w.h.p. the random graph on n vertices, cn edges and minimum degree k 1 contains a (near) perfect k matching. As an immediate consequence we get that w.h.p. the (k 1) core of G n,p , if non empty, spans a (near) spanning k regular subgraph. This improves upon a result of Chan and Molloy and completely resolves a conjecture of Bollob 'as, Kim and Verstra " e te. In addition, we show that w.h.p. such a subgraph can be found in linear time. A substantial element of the proof is the analysis of a randomized algorithm for finding k matchings in random graphs with minimum degree k 1 .


Generating Probabilistic Safety Guarantees for Neural Network Controllers. Neural networks serve as effective controllers in a variety of complex settings due to their ability to represent expressive policies. The complex nature of neural networks, however, makes their output difficult to verify and predict, which limits their use in safety critical applications. While simulations provide insight into the performance of neural network controllers, they are not enough to guarantee that the controller will perform safely in all scenarios. To address this problem, recent work has focused on formal methods to verify properties of neural network outputs. For neural network controllers, we can use a dynamics model to determine the output properties that must hold for the controller to operate safely. In this work, we develop a method to use the results from neural network verification tools to provide probabilistic safety guarantees on a neural network controller. We develop an adaptive verification approach to efficiently generate an overapproximation of the neural network policy. Next, we modify the traditional formulation of Markov decision process (MDP) model checking to provide guarantees on the overapproximated policy given a stochastic dynamics model. Finally, we incorporate techniques in state abstraction to reduce overapproximation error during the model checking process. We show that our method is able to generate meaningful probabilistic safety guarantees for aircraft collision avoidance neural networks that are loosely inspired by Airborne Collision Avoidance System X (ACAS X), a family of collision avoidance systems that formulates the problem as a partially observable Markov decision process (POMDP).


Equitable modelling of brain imaging by counterfactual augmentation with morphologically constrained 3D deep generative models. We describe Countersynth, a conditional generative model of diffeomorphic deformations that induce label driven, biologically plausible changes in volumetric brain images. The model is intended to synthesise counterfactual training data augmentations for downstream discriminative modelling tasks where fidelity is limited by data imbalance, distributional instability, confounding, or underspecification, and exhibits inequitable performance across distinct subpopulations. Focusing on demographic attributes, we evaluate the quality of synthesized counterfactuals with voxel based morphometry, classification and regression of the conditioning attributes, and the Fr ' e chet inception distance. Examining downstream discriminative performance in the context of engineered demographic imbalance and confounding, we use UK Biobank magnetic resonance imaging data to benchmark CounterSynth augmentation against current solutions to these problems. We achieve state of the art improvements, both in overall fidelity and equity. The source code for CounterSynth is available online.


PatentNet A Large Scale Incomplete Multiview, Multimodal, Multilabel Industrial Goods Image Database. In deep learning area, large scale image datasets bring a breakthrough in the success of object recognition and retrieval. Nowadays, as the embodiment of innovation, the diversity of the industrial goods is significantly larger, in which the incomplete multiview, multimodal and multilabel are different from the traditional dataset. In this paper, we introduce an industrial goods dataset, namely PatentNet, with numerous highly diverse, accurate and detailed annotations of industrial goods images, and corresponding texts. In PatentNet, the images and texts are sourced from design patent. Within over 6M images and corresponding texts of industrial goods labeled manually checked by professionals, PatentNet is the first ongoing industrial goods image database whose varieties are wider than industrial goods datasets used previously for benchmarking. PatentNet organizes millions of images into 32 classes and 219 subclasses based on the Locarno Classification Agreement. Through extensive experiments on image classification, image retrieval and incomplete multiview clustering, we demonstrate that our PatentNet is much more diverse, complex, and challenging, enjoying higher potentials than existing industrial image datasets. Furthermore, the characteristics of incomplete multiview, multimodal and multilabel in PatentNet are able to offer unparalleled opportunities in the artificial intelligence community and beyond.


Asymptotic approximations of Good's special functions arising in atomic physics. We study various asymptotic approximations of Good's special functions arising in atomic physics. These special functions are situated beyond Anger's functions to which they are closely related. Our major tool is the method of the stationary phase.


A Deeper Look into Convolutions via Pruning. Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much less parameters due to their parameter sharing principle. Hence, modern architectures are designed to contain a very small number of fully connected layers, often at the end, after multiple layers of convolutions. It is interesting to observe that we can replace large fully connected layers with relatively small groups of tiny matrices applied on the entire image. Moreover, although this strategy already reduces the number of parameters, most of the convolutions can be eliminated as well, without suffering any loss in recognition performance. However, there is no solid recipe to detect this hidden subset of convolutional neurons that is responsible for the majority of the recognition work. Hence, in this work, we use the matrix characteristics based on eigenvalues in addition to the classical weight based importance assignment approach for pruning to shed light on the internal mechanisms of a widely used family of CNNs, namely residual neural networks (ResNets), for the image classification problem using CIFAR 10, CIFAR 100 and Tiny ImageNet datasets.


Adaptable image quality assessment using meta reinforcement learning of task amenability. The performance of many medical image analysis tasks are strongly associated with image data quality. When developing modern deep learning algorithms, rather than relying on subjective (human based) image quality assessment (IQA), task amenability potentially provides an objective measure of task specific image quality. To predict task amenability, an IQA agent is trained using reinforcement learning (RL) with a simultaneously optimised task predictor, such as a classification or segmentation neural network. In this work, we develop transfer learning or adaptation strategies to increase the adaptability of both the IQA agent and the task predictor so that they are less dependent on high quality, expert labelled training data. The proposed transfer learning strategy re formulates the original RL problem for task amenability in a meta reinforcement learning (meta RL) framework. The resulting algorithm facilitates efficient adaptation of the agent to different definitions of image quality, each with its own Markov decision process environment including different images, labels and an adaptable task predictor. Our work demonstrates that the IQA agents pre trained on non expert task labels can be adapted to predict task amenability as defined by expert task labels, using only a small set of expert labels. Using 6644 clinical ultrasound images from 249 prostate cancer patients, our results for image classification and segmentation tasks show that the proposed IQA method can be adapted using data with as few as respective 19.7 and 29.6 expert reviewed consensus labels and still achieve comparable IQA and task performance, which would otherwise require a training dataset with 100 expert labels.


Linear diophantine equations in several variables. Let R be a ring and let (a 1, dots,a n) in R n be a unimodular vector, where n geq 2 and each a i is in the center of R . Consider the linear equation a 1X 1 cdots a nX n 0 , with solution set S . Then S S 1 cdots S n , where each S i is naturally derived from (a 1, dots,a n) , and we give a presentation of S in terms of generators taken from the S i and appropriate relations. Moreover, under suitable assumptions, we elucidate the structure of each quotient module S S i . Furthermore, assuming that R is a principal ideal domain, we provide a simple way to construct a basis of S and, as an application, we determine the structure of the quotient module S U i , where each U i is a specific module containing S i .


Keeping Your Eye on the Ball Trajectory Attention in Video Transformers. In video transformers, the time dimension is often treated in the same way as the two spatial dimensions. However, in a scene where objects or the camera may move, a physical point imaged at one location in frame t may be entirely unrelated to what is found at that location in frame t k . These temporal correspondences should be modeled to facilitate learning about dynamic scenes. To this end, we propose a new drop in block for video transformers trajectory attention that aggregates information along implicitly determined motion paths. We additionally propose a new method to address the quadratic dependence of computation and memory on the input size, which is particularly important for high resolution or long videos. While these ideas are useful in a range of settings, we apply them to the specific task of video action recognition with a transformer model and obtain state of the art results on the Kinetics, Something Something V2, and Epic Kitchens datasets. Code and models are available at https github.com facebookresearch Motionformer


Feature context driven Federated Meta Learning for Rare Disease Prediction. Millions of patients suffer from rare diseases around the world. However, the samples of rare diseases are much smaller than those of common diseases. In addition, due to the sensitivity of medical data, hospitals are usually reluctant to share patient information for data fusion citing privacy concerns. These challenges make it difficult for traditional AI models to extract rare disease features for the purpose of disease prediction. In this paper, we overcome this limitation by proposing a novel approach for rare disease prediction based on federated meta learning. To improve the prediction accuracy of rare diseases, we design an attention based meta learning (ATML) approach which dynamically adjusts the attention to different tasks according to the measured training effect of base learners. Additionally, a dynamic weight based fusion strategy is proposed to further improve the accuracy of federated learning, which dynamically selects clients based on the accuracy of each local model. Experiments show that with as few as five shots, our approach out performs the original federated meta learning algorithm in accuracy and speed. Compared with each hospital's local model, the proposed model's average prediction accuracy increased by 13.28 .


Self Supervised Predictive Convolutional Attentive Block for Anomaly Detection. Anomaly detection is commonly pursued as a one class classification problem, where models can only learn from normal training samples, while being evaluated on both normal and abnormal test samples. Among the successful approaches for anomaly detection, a distinguished category of methods relies on predicting masked information (e.g. patches, future frames, etc.) and leveraging the reconstruction error with respect to the masked information as an abnormality score. Different from related methods, we propose to integrate the reconstruction based functionality into a novel self supervised predictive architectural building block. The proposed self supervised block is generic and can easily be incorporated into various state of the art anomaly detection methods. Our block starts with a convolutional layer with dilated filters, where the center area of the receptive field is masked. The resulting activation maps are passed through a channel attention module. Our block is equipped with a loss that minimizes the reconstruction error with respect to the masked area in the receptive field. We demonstrate the generality of our block by integrating it into several state of the art frameworks for anomaly detection on image and video, providing empirical evidence that shows considerable performance improvements on MVTec AD, Avenue, and ShanghaiTech. We release our code as open source at https github.com ristea sspcab.


Most direct product of graphs are Type 1. A textit k total coloring of a graph G is an assignment of k colors to its elements (vertices and edges) so that adjacent or incident elements have different colors. The total chromatic number is the smallest integer k for which the graph G has a k total coloring. Clearly, this number is at least Delta(G) 1 , where Delta(G) is the maximum degree of G . When the lower bound is reached, the graph is said to be Type 1. The upper bound of Delta(G) 2 is a central problem that has been open for fifty years, is verified for graphs with maximum degree 4 but not for regular graphs. Most classified direct product of graphs are Type 1. The particular cases of the direct product of cycle graphs C m times C n , for m 3p, 5 ell and 8 ell with p geq 2 and ell geq 1 , and arbitrary n geq 3 , were previously known to be Type 1 and motivated the conjecture that, except for C 4 times C 4 , all direct product of cycle graphs C m times C n with m,n geq 3 are Type 1. We give a general pattern proving that all C m times C n are Type 1, except for C 4 times C 4 . dditionally, we investigate sufficient conditions to ensure that the direct product reaches the lower bound for the total chromatic number.


Non trivial extensions in equivariant cohomology with constant coefficients. In this paper, we prove some computational results about equivariant cohomology over the cyclic group C p n of prime power order. We show that there is an inductive formula when the dimension of the C p fixed points of the grading is large. Among other calculations, we also show the existence of non trivial extensions when n geq 3 .


Deep Representation Learning with an Information theoretic Loss. This paper proposes a deep representation learning using an information theoretic loss with an aim to increase the inter class distances as well as within class similarity in the embedded space. Tasks such as anomaly and out of distribution detection, in which test samples comes from classes unseen in training, are problematic for deep neural networks. For such tasks, it is not sufficient to merely discriminate between known classes. Our intuition is to represent the known classes in compact and separated embedded regions in order to decrease the possibility of known and unseen classes overlapping in the embedded space. We derive a loss from Information Bottleneck principle, which reflects the inter class distances as well as the compactness within classes, thus will extend the existing deep data description models. Our empirical study shows that the proposed model improves the segmentation of normal classes in the deep feature space, and subsequently contributes to identifying out of distribution samples.


MutualFormer Multi Modality Representation Learning via Mutual Transformer. Aggregating multi modality data to obtain accurate and reliable data representation attracts more and more attention. The pristine researchers generally adopt the CNN to extract features of independent modality and aggregate them with a fusion module. However, the overall performance is becoming saturated due to limited local convolutional features. Recent studies demonstrate that Transformer models usually work comparable or even better than CNN for multi modality task, but they simply adopt concatenation or cross attention for feature fusion which may just obtain sub optimal results. In this work, we re thinking the self attention based Transformer and propose a novel MutualFormer for multi modality data fusion and representation. The core of MutualFormer is the design of both token mixer and modality mixer to conduct the communication among both tokens and modalities. Specifically, it contains three main modules, i.e., i) Self attention (SA) for intra modality token mixer, ii) Cross diffusion attention (CDA) for inter modality mixer and iii) Aggregation module. The main advantage of the proposed CDA is that it is defined based on individual domain similarities in the metric space which thus can naturally avoid the issue of domain modality gap in cross modality similarities computation. We successfully apply the MutualFormer to the saliency detection problem and propose a novel approach to obtain the reinforced features of RGB and Depth images. Extensive experiments on six popular datasets demonstrate that our model achieves comparable results with 16 SOTA models.


Spatially homogeneous few cycle compression of Yb lasers via all solid state free space soliton management. The high power and variable repetition rate of Yb femtosecond lasers make them very attractive for ultrafast science. However, for capturing sub 200 fs dynamics, efficient, high fidelity, and high stability pulse compression techniques are essential. Spectral broadening using an all solid state free space geometry is particularly attractive, as it is simple, robust, and low cost. However, spatial and temporal losses caused by spatio spectral inhomogeneities have been a major challenge to date, due to coupled space time dynamics associated with unguided nonlinear propagation. In this work, we use all solid state free space compressors to demonstrate compression of 170 fs pulses at a wavelength of 1030nm from a Yb KGW laser to 9.2 fs, with a highly spatially homogeneous mode. This is achieved by ensuring that the nonlinear beam propagation in periodic layered Kerr media occurs in soliton modes and confining the nonlinear phase through each material layer to less than 1.0 rad. A remarkable spatio spectral homogeneity of 0.87 can be realized, which yields a high efficiency of 50 for few cycle compression. The universality of the method is demonstrated by implementing high quality pulse compression under a wide range of laser conditions. The high spatiotemporal quality and the exceptional stability of the compressed pulses are further verified by high harmonic generation. This work represents the highest efficiency and the best spatio spectral quality ever achieved by an all solid state free space pulse compressor for few cycle pulse generation.


Self Supervised Pretraining for RGB D Salient Object Detection. Existing CNNs Based RGB D salient object detection (SOD) networks are all required to be pretrained on the ImageNet to learn the hierarchy features which helps provide a good initialization. However, the collection and annotation of large scale datasets are time consuming and expensive. In this paper, we utilize self supervised representation learning (SSL) to design two pretext tasks the cross modal auto encoder and the depth contour estimation. Our pretext tasks require only a few and unlabeled RGB D datasets to perform pretraining, which makes the network capture rich semantic contexts and reduce the gap between two modalities, thereby providing an effective initialization for the downstream task. In addition, for the inherent problem of cross modal fusion in RGB D SOD, we propose a consistency difference aggregation (CDA) module that splits a single feature fusion into multi path fusion to achieve an adequate perception of consistent and differential information. The CDA module is general and suitable for cross modal and cross level feature fusion. Extensive experiments on six benchmark datasets show that our self supervised pretrained model performs favorably against most state of the art methods pretrained on ImageNet. The source code will be publicly available at textcolor red url https github.com Xiaoqi Zhao DLUT SSLSOD .


Medium Access Control protocol for Collaborative Spectrum Learning in Wireless Networks. In recent years there is a growing effort to provide learning algorithms for spectrum collaboration. In this paper we present a medium access control protocol which allows spectrum collaboration with minimal regret and high spectral efficiency in highly loaded networks. We present a fully distributed algorithm for spectrum collaboration in congested ad hoc networks. The algorithm jointly solves both the channel allocation and access scheduling problems. We prove that the algorithm has an optimal logarithmic regret. Based on the algorithm we provide a medium access control protocol which allows distributed implementation of the algorithm in ad hoc networks. The protocol utilizes single channel opportunistic carrier sensing to carry out a low complexity distributed auction in time and frequency. We also discuss practical implementation issues such as bounded frame size and speed of convergence. Computer simulations comparing the algorithm to state of the art distributed medium access control protocols show the significant advantage of the proposed scheme.


Testing Hamiltonicity (and other problems) in Minor Free Graphs. In this paper we provide sub linear algorithms for several fundamental problems in the setting in which the input graph excludes a fixed minor, i.e., is a minor free graph. In particular, we provide the following algorithms for minor free unbounded degree graphs. (1) A tester for Hamiltonicity with two sided error with poly(1 epsilon) query complexity, where epsilon is the proximity parameter. (2) A local algorithm, as defined by Rubinfeld et al. (ICS 2011), for constructing a spanning subgraph with almost minimum weight, specifically, at most a factor (1 epsilon) of the optimum, with poly(1 epsilon) query complexity. Both our algorithms use partition oracles, a tool introduced by Hassidim et al. (FOCS 2009), which are oracles that provide access to a partition of the graph such that the number of cut edges is small and each part of the partition is small. The polynomial dependence in 1 epsilon of our algorithms is achieved by combining the recent poly(d epsilon) query partition oracle of Kumar Seshadhri Stolman (ECCC 2021) for minor free graphs with degree bounded by d . For bounded degree minor free graphs we introduce the notion of covering partition oracles which is a relaxed version of partition oracles and design a poly(d epsilon) time covering partition oracle. Using our covering partition oracle we provide the same results as above (except that the tester for Hamiltonicity has one sided error) for minor free bounded degree graphs, as well as showing that any property which is monotone and additive (e.g. bipartiteness) can be tested in minor free graphs by making poly(d epsilon) queries. The benefit of using the covering partition oracle rather than the partition oracle in our algorithms is its simplicity and an improved polynomial dependence in 1 epsilon in the obtained query complexity.


Some recent advances in urban system science models and data. Cities are characterized by the presence of a dense population with a high potential for interactions between individuals of diverse backgrounds. They appear in parallel to the Neolithic revolution a few millennia ago. The advantages brought in terms of agglomeration for economy, innovation, social and cultural advancements have kept them as a major landmark in recent human history. There are many different aspects to study in urban systems from a scientific point of view, just to name a few one can concentrate in demography and population evolution, mobility, economic output, land use and urban planning, home accessibility and real estate market, energy and water consumption, waste processing, health, education, integration of minorities, etc. In the last decade, the introduction of communication and information technologies have enormously facilitated the collection of datasets on these and other questions, making possible a more quantitative approach to city science. All these topics have been addressed in many works in the literature, and we do not intend to offer here a systematic review. Instead, we will only provide a brief taste of some of these above mentioned aspects, which could serve as an introduction to a subsequent special number. Such a non systematic view will lead us to leave outside many relevant papers, and for this we apologise.


Stable Centres II Finite Classical Groups. Farahat and Higman constructed an algebra mathrm FH interpolating the centres of symmetric group algebras Z( mathbb Z S n) by proving that the structure constants in these rings are "polynomial in n ". Inspired by a construction of mathrm FH due to Ivanov and Kerov, we prove for G n GL n, U n, Sp 2n , O n , that the structure constants of Z( mathbb Z G n( mathbb F q)) are "polynomial in q n ", allowing us to construct an equivalent of the Farahat Higman algebra in each case.


An averaging formula for the cohomology of PEL type Rapoport Zink spaces. We prove under certain assumptions a formula for the cohomology of PEL type Rapoport Zink spaces that "averages" over the Kottwitz set. Our formula generalizes that of Shin's beyond the EL type case and is proven by combining Mantovan's formula with descriptions of the cohomology of Shimura and Igusa varieties. We then use this averaging formula to derive a conjectural description of the cohomology of Rapoport Zink spaces, generalizing our earlier work for EL type spaces. Along the way, we give a description of the cohomology of Igusa varieties in terms of the Langlands correspondence, generalizing work in Shin's thesis.


Accelerating Gradient based Meta Learner. Meta Learning has been in focus in recent years due to the meta learner model's ability to adapt well and generalize to new tasks, thus, reducing both the time and data requirements for learning. However, a major drawback of meta learner is that, to reach to a state from where learning new tasks becomes feasible with less data, it requires a large number of iterations and a lot of time. We address this issue by proposing various acceleration techniques to speed up meta learning algorithms such as MAML (Model Agnostic Meta Learning). We present 3.73X acceleration on a well known RNN optimizer based meta learner proposed in literature 11 . We introduce a novel method of training tasks in clusters, which not only accelerates the meta learning process but also improves model accuracy performance. Keywords Meta learning, RNN optimizer, AGI, Performance optimization


Coordinating drones with mothership vehicles The mothership and multiple drones routing problem with Graphs. This paper considers the optimization problems that arise to coordinate a tandem between a mothership vehicle and a fleet of drones. more than one drone. Each drone can be launched from the mothership to perform an operation. After completing the operations the drones return to the mothership to recharge batteries and to be ready for a new operation. Operations consist on (partially) visiting graphs with given lengths to deliver some service or to perform some surveillance inspection activity. The goal is to minimize the overall weighted distance traveled by the mothership while satisfying some requirements in terms of percentages of visits to the target graphs. In all cases, we develop exact formulations resorting to mixed integer second order cone programs that are compared on a testbed of instances to assess their performance. We also develop a matheuristic algorithm that provides reasonable solutions. Computational experiments show the usefulness of our methods in different scenarios.


Reduced operator inference for nonlinear partial differential equations. We present a new scientific machine learning method that learns from data a computationally inexpensive surrogate model for predicting the evolution of a system governed by a time dependent nonlinear partial differential equation (PDE), an enabling technology for many computational algorithms used in engineering settings. Our formulation generalizes to the function space PDE setting the Operator Inference method previously developed in B. Peherstorfer and K. Willcox, Data driven operator inference for non intrusive projection based model reduction, Computer Methods in Applied Mechanics and Engineering, 306 (2016) for systems governed by ordinary differential equations. The method brings together two main elements. First, ideas from projection based model reduction are used to explicitly parametrize the learned model by low dimensional polynomial operators which reflect the known form of the governing PDE. Second, supervised machine learning tools are used to infer from data the reduced operators of this physics informed parametrization. For systems whose governing PDEs contain more general (non polynomial) nonlinearities, the learned model performance can be improved through the use of lifting variable transformations, which expose polynomial structure in the PDE. The proposed method is demonstrated on two examples a heat equation model problem that demonstrates the benefits of the function space formulation in terms of consistency with the underlying continuous truth, and a three dimensional combustion simulation with over 18 million degrees of freedom, for which the learned reduced models achieve accurate predictions with a dimension reduction of five orders of magnitude and model runtime reduction of up to nine orders of magnitude.


Time averaged velocity and scalar fields of the flow surrounding a group of cylinders. We examine the characteristics of mean flow and scalar concentration characteristics of a turbulent boundary layer flow impinging on a cluster of tall obstacles (which can also be interpreted as a porous obstruction). The cluster is created with a group of cylinders of diameter d and height h arranged in a circular patch of diameter D .The solidity of the patch obstruction is defined by phi (the total planar area covered by cylinders), which is systematically varied ( 0.098 leq phi leq 1 ) by increasing the number of cylinders in a patch ( N c ). A point source is placed at ground level upstream of the patch and its transport around the patch is examined. Time averaged velocity and scalar fields, obtained from simultaneous planar PIV PLIF (particle image velocimetry planar laser induced fluorescence) measurements, reveal that the characteristics of wake and flow above porous patches are heavily influenced by phi . In particular, we observe that the horizontal and vertical extent of the wake and scalar concentration downstream of the patches decreases and increases with phi , respectively. Here, the recirculation bubble is shifted closer to the trailing edge of the patches as phi increases, limiting the flow from convecting downstream, decreasing the scalar concentration and virtually extending' the patch in streamwise direction. As the bubble forms in the trailing edge, vertical bleeding increases and hence the concentration increases above patch where the cylinders appear to be extend' vertically towards the freestream.


Geometric generalizations of the square sieve, with an application to cyclic covers. We formulate a general problem given projective schemes mathbb Y and mathbb X over a global field K and a K morphism eta from mathbb Y to mathbb X of finite degree, how many points in mathbb X (K) of height at most B have a pre image under eta in mathbb Y (K) ? This problem is inspired by a well known conjecture of Serre on quantitative upper bounds for the number of points of bounded height on an irreducible projective variety defined over a number field. We give a non trivial answer to the general problem when K mathbb F q(T) and mathbb Y is a prime degree cyclic cover of mathbb X mathbb P K n . Our tool is a new geometric sieve, which generalizes the polynomial sieve to a geometric setting over global function fields.


Potential density of projective varieties having an int amplified endomorphism. We consider the potential density of rational points on an algebraic variety defined over a number field K , i.e., the property that the set of rational points of X becomes Zariski dense after a finite field extension of K . For a non uniruled projective variety with an int amplified endomorphism, we show that it always satisfies potential density. When a rationally connected variety admits an int amplified endomorphism, we prove that there exists some rational curve with a Zariski dense forward orbit, assuming the Zariski dense orbit conjecture in lower dimensions. As an application, we prove the potential density for projective varieties with int amplified endomorphisms in dimension leq 3 . We also study the existence of densely many rational points with the maximal arithmetic degree over a sufficiently large number field.


General 2 Dimensional Adjunctions, Universal Monads and Simplicial Structures. We use the general notion of 2 dimensional adjunction with given coherence equations as introduced by MacDonald Stone, building on earlier work by Gray, to derive coherence equations for a general 2 monad, which we refer to as a lax Gray monad. The free lax Gray 2 monad on one object may be regarded as the suspension of a lax 2 dimensional analogue of the simplicial category Delta. We call this analogue Delta LG for lax Gray Delta. This is analogous to the way that the free 1 monad Mnd (as presented in Schanuel Street) is a concrete example of the suspension of the simplicial category Delta, described by Mac Lane.


Adaptive Knowledge Enhanced Bayesian Meta Learning for Few shot Event Detection. Event detection (ED) aims at detecting event trigger words in sentences and classifying them into specific event types. In real world applications, ED typically does not have sufficient labelled data, thus can be formulated as a few shot learning problem. To tackle the issue of low sample diversity in few shot ED, we propose a novel knowledge based few shot event detection method which uses a definition based encoder to introduce external event knowledge as the knowledge prior of event types. Furthermore, as external knowledge typically provides limited and imperfect coverage of event types, we introduce an adaptive knowledge enhanced Bayesian meta learning method to dynamically adjust the knowledge prior of event types. Experiments show our method consistently and substantially outperforms a number of baselines by at least 15 absolute F1 points under the same few shot settings.


Asymptotics of coefficients of algebraic series via embedding into rational series (extended abstract). We present a strategy for computing asymptotics of coefficients of d variate algebraic generating functions. Using known constructions, we embed the coefficient array into an array represented by a rational generating functions in d 1 variables, and then apply ACSV theory to analyse the latter. This method allows us to give systematic results in the multivariate case, seems more promising than trying to derive analogs of the rational ACSV theory for algebraic GFs, and gives the prospect of further improvements as embedding methods are studied in more detail.


Fine Grained Completeness for Optimization in P. We initiate the study of fine grained completeness theorems for exact and approximate optimization in the polynomial time regime. Inspired by the first completeness results for decision problems in P (Gao, Impagliazzo, Kolokolova, Williams, TALG 2019) as well as the classic class MaxSNP and MaxSNP completeness for NP optimization problems (Papadimitriou, Yannakakis, JCSS 1991), we define polynomial time analogues MaxSP and MinSP, which contain a number of natural optimization problems in P, including Maximum Inner Product, general forms of nearest neighbor search and optimization variants of the k XOR problem. Specifically, we define MaxSP as the class of problems definable as max x 1, dots,x k (y 1, dots,y ell) phi(x 1, dots,x k, y 1, dots,y ell) , where phi is a quantifier free first order property over a given relational structure (with MinSP defined analogously). On m sized structures, we can solve each such problem in time O(m k ell 1 ) . Our results are We determine (a sparse variant of) the Maximum Minimum Inner Product problem as complete under deterministic fine grained reductions A strongly subquadratic algorithm for Maximum Minimum Inner Product would beat the baseline running time of O(m k ell 1 ) for all problems in MaxSP MinSP by a polynomial factor. This completeness transfers to approximation Maximum Minimum Inner Product is also complete in the sense that a strongly subquadratic c approximation would give a (c varepsilon) approximation for all MaxSP MinSP problems in time O(m k ell 1 delta ) , where varepsilon 0 can be chosen arbitrarily small. Combining our completeness with (Chen, Williams, SODA 2019), we obtain the perhaps surprising consequence that refuting the OV Hypothesis is equivalent to giving a O(1) approximation for all MinSP problems in faster than O(m k ell 1 ) time.


Projective toric varieties of codimension 2 with maximal Castelnuovo Mumford regularity. The Eisenbud Goto conjecture states that operatorname reg X le operatorname deg X operatorname codim X 1 for a nondegenerate irreducible projective variety X over an algebraically closed field. While this conjecture is known to be false in general, it has been proven in several special cases, including when X is a projective toric variety of codimension 2 . We classify the projective toric varieties of codimension 2 having maximal regularity, that is, for which equality holds in the Eisenbud Goto bound. We also give combinatorial characterizations of the arithmetically Cohen Macaulay toric varieties of maximal regularity in characteristic 0 .


FQuAD2.0 French Question Answering and knowing that you know nothing. Question Answering, including Reading Comprehension, is one of the NLP research areas that has seen significant scientific breakthroughs over the past few years, thanks to the concomitant advances in Language Modeling. Most of these breakthroughs, however, are centered on the English language. In 2020, as a first strong initiative to bridge the gap to the French language, Illuin Technology introduced FQuAD1.1, a French Native Reading Comprehension dataset composed of 60,000 questions and answers samples extracted from Wikipedia articles. Nonetheless, Question Answering models trained on this dataset have a major drawback they are not able to predict when a given question has no answer in the paragraph of interest, therefore making unreliable predictions in various industrial use cases. In the present work, we introduce FQuAD2.0, which extends FQuAD with 17,000 unanswerable questions, annotated adversarially, in order to be similar to answerable ones. This new dataset, comprising a total of almost 80,000 questions, makes it possible to train French Question Answering models with the ability of distinguishing unanswerable questions from answerable ones. We benchmark several models with this dataset our best model, a fine tuned CamemBERT large, achieves a F1 score of 82.3 on this classification task, and a F1 score of 83 on the Reading Comprehension task.


Grammar Index By Induced Suffix Sorting. Pattern matching is the most central task for text indices. Most recent indices leverage compression techniques to make pattern matching feasible for massive but highly compressible datasets. Within this kind of indices, we propose a new compressed text index built upon a grammar compression based on induced suffix sorting Nunes et al., DCC'18 . We show that this grammar exhibits a locality sensitive parsing property, which allows us to specify, given a pattern P , certain substrings of P , called cores, that are similarly parsed in the text grammar whenever these occurrences are extensible to occurrences of P . Supported by the cores, given a pattern of length m , we can locate all its occ occurrences in a text T of length n within O(m lg mathcal S occ C lg mathcal S lg n occ) time, where mathcal S is the set of all characters and non terminals, occ is the number of occurrences, and occ C is the number of occurrences of a chosen core C of P in the right hand side of all production rules of the grammar of T . Our grammar index requires O(g) words of space and can be built in O(n) time using O(g) working space, where g is the sum of the right hand sides of all production rules. We underline the strength of our grammar index with an exhaustive practical evaluation that gives evidence that our proposed solution excels at locating long patterns in highly repetitive texts.


Transfer function interpolation remainder formula of rational Krylov subspace methods. Rational Krylov subspace projection methods are one of successful methods in MOR, mainly because some order derivatives of the approximate and original transfer functions are the same. This is the well known moments matching result. However, the properties of points which are far from the interpolating points are little known. In this paper, we obtain the error's explicit expression which involves shifts and Ritz values. The advantage of our result over than the known moments matches theory is, to some extent, similar to the one of Lagrange type remainder formula over than Peano Type remainder formula in Taylor theorem. Expect for the proof, we also provide three explanations for the error formula. One explanation shows that in the Gauss Christoffel quadrature sense, the error is the Gauss quadrature remainder, when the Gauss quadrature formula is applied onto the resolvent function. By using the error formula, we propose some greedy algorithms for the interpolatory H infty norm MOR.


Spatial Temporal Tensor Graph Convolutional Network for Traffic Prediction. Accurate traffic prediction is crucial to the guidance and management of urban traffics. However, most of the existing traffic prediction models do not consider the computational burden and memory space when they capture spatial temporal dependence among traffic data. In this work, we propose a factorized Spatial Temporal Tensor Graph Convolutional Network to deal with traffic speed prediction. Traffic networks are modeled and unified into a graph that integrates spatial and temporal information simultaneously. We further extend graph convolution into tensor space and propose a tensor graph convolution network to extract more discriminating features from spatial temporal graph data. To reduce the computational burden, we take Tucker tensor decomposition and derive factorized a tensor convolution, which performs separate filtering in small scale space, time, and feature modes. Besides, we can benefit from noise suppression of traffic data when discarding those trivial components in the process of tensor decomposition. Extensive experiments on two real world traffic speed datasets demonstrate our method is more effective than those traditional traffic prediction methods, and meantime achieves state of the art performance.


Symplectic mapping class groups of K3 surfaces and Seiberg Witten invariants. The purpose of this note is to prove that the symplectic mapping class groups of many K3 surfaces are infinitely generated. Our proof makes no use of any Floer theoretic machinery but instead follows the approach of Kronheimer and uses invariants derived from the Seiberg Witten equations.


Spatial structure and information transfer in visual networks. In human and animal groups, social interactions often rely on the transmission of information via visual observation of the behavior of others. These visual interactions are governed by the laws of physics and sensory limits. Individuals appear smaller when far away and thus become harder to detect visually, while close by neighbors tend to occlude large areas of the visual field and block out interactions with individuals behind them. Here, we systematically study the effect of a group's spatial structure, its density as well as polarization and aspect ratio of the physical bodies, on the properties of the visual interaction network. In such a network individuals are connected if they can see each other as opposed to other interaction models such as metric or topological networks that omit these limitations due to the individual's physical bodies. We study the effect that spatial configuration has on the static properties of these networks as well as its influence on the transmission of information or behaviors which we investigate via two generic models of social contagion. We expect our work to have implications for the study of animal groups, where it could inform the study of functional benefits of different macroscopic states. It may also be applicable to the construction of robotic swarms communicating via vision or for understanding the spread of panics in human crowds.


Pure Characteristics Demand Models and Distributionally Robust Mathematical Programs with Stochastic Complementarity Constraints. We formulate pure characteristics demand models under uncertainties of probability distributions as distributionally robust mathematical programs with stochastic complementarity constraints (DRMP SCC). For any fixed first stage variable and a random realization, the second stage problem of DRMP SCC is a monotone linear complementarity problem (LCP). To deal with uncertainties of probability distributions of the involved random variables in the stochastic LCP, we use the distributionally robust approach. Moreover, we propose an approximation problem with regularization and discretization to solve DRMP SCC, which is a two stage nonconvex nonconcave minimax optimization problem. We prove the convergence of the approximation problem to DRMP SCC regarding the optimal solution sets, optimal values and stationary points as the regularization parameter goes to zero and the sample size goes to infinity. Finally, preliminary numerical results for investigating distributional robustness of pure characteristics demand models are reported to illustrate the effectiveness and efficiency of our approaches.


Suffix connected languages. Inspired by a series of papers initiated in 2015 by Berth 'e et al., we introduce a new condition called suffix connectedness. We show that the groups generated by the return sets of a uniformly recurrent suffix connected language lie in a single conjugacy class of subgroups of the free group. Moreover, the rank of the subgroups in this conjugacy class only depends on the number of connected components in the extension graph of the empty word. We also show how to explicitly compute a representative of this conjugacy class using the first order Rauzy graph. Finally, we provide an example of suffix connected, uniformly recurrent language that contains infinitely many disconnected words.


Polynomials vanishing at lattice points in a convex set. Let P be a bounded convex subset of mathbb R n of positive volume. Denote the smallest degree of a polynomial p(X 1, dots,X n) vanishing on P cap mathbb Z n by r P and denote the smallest number u geq0 such that every function on P cap mathbb Z n can be interpolated by a polynomial of degree at most u by s P . We show that the values (r d cdot P 1) d and s d cdot P d for dilates d cdot P converge from below to some numbers v P,w P 0 as d goes to infinity. The limits satisfy v P n 1 w P leq n! cdot operatorname vol (P) . When P is a triangle in the plane, we show equality v Pw P 2 operatorname vol (P) . These results are obtained by looking at the set of standard monomials of the vanishing ideal of d cdot P cap mathbb Z n and by applying the Bernstein Kushnirenko theorem. Finally, we study irreducible Laurent polynomials that vanish with large multiplicity at a point. This work is inspired by questions about Seshadri constants.


On ductile regime elliptical vibration cutting of silicon with identifying the lower bound of practical nominal cutting velocity. This study investigates the ductile to brittle transition behavior in elliptical vibration cutting (EVC) of silicon and identifies the practical process window for ductile regime cutting. EVC has been reported to increase the critical depth of ductile regime cutting of silicon. This study demonstrates that the enhanced ductile cutting performance, however, is only optimal in a carefully determined process window. The vibration amplitudes and nominal cutting velocity have significant impacts on the ductile to brittle transition behaviors. Systematic experiments covering a wide span of vibration amplitudes and cutting velocity have been conducted to investigate their effects. Two quantitative performance indices, the critical depth and ductile ratio, are utilized to analyze cutting performance by considering two unique characteristics of elliptical vibration cutting, i.e., the time varying undeformed chip thickness and effective cutting direction angle. The results show that there exists a lower bound for the nominal cutting velocity to ensure the ductile regime material removal, besides the well known upper bound. Besides, the increases of vibration amplitudes in both the cutting and depth of cut (DOC) directions first enhance but then deteriorate the cutting performance. Based on the theoretical analysis and experimental results, the optimal process parameters have been recommended for the elliptical vibration cutting of silicon.


Bisimulations for Neural Network Reduction. We present a notion of bisimulation that induces a reduced network which is semantically equivalent to the given neural network. We provide a minimization algorithm to construct the smallest bisimulation equivalent network. Reductions that construct bisimulation equivalent neural networks are limited in the scale of reduction. We present an approximate notion of bisimulation that provides semantic closeness, rather than, semantic equivalence, and quantify semantic deviation between the neural networks that are approximately bisimilar. The latter provides a trade off between the amount of reduction and deviations in the semantics.


Efficiency of Using Utility for Usernames Verification in Online Community Management. The study deals with the methods and means of checking the reliability of usernames of online communities on the basis of computer linguistic analysis of the results of their communicative interaction. The methodological basis of the study is a combination of general scientific methods and special approaches to the study of the data verification of online communities in the Ukrainian segment of the global information environment. The algorithm of functioning of the utility Verifier of online community username is developed. The informational model of the automated means of checking the usernames of online community is designed. The utility Verifier of online community username data validation system approbation is realized in the online community. The indicator of the data verification system effectiveness is determined.


Fast Entropy Coding for ALICE Run 3. In LHC Run 3, the upgraded ALICE detector will record Pb Pb collisions at a rate of 50 kHz usingcontinuous readout. The resulting stream of raw data at 3.5 TB s has to be processed with a setof lossy and lossless compression and data reduction techniques to a storage data rate of 90 GB swhile preserving relevant data for physics analysis. This contribution presents a custom losslessdata compression scheme based on entropy coding as the final component in the data reductionchain which has to compress the data rate from 300 GB s to 90 GB s. A flexible, multi processarchitecture for the data compression scheme is proposed that seamlessly interfaces with the datareduction algorithms of earlier stages and allows to use parallel processing in order to keep therequired firm real time guarantees of the system. The data processed inside the compressionprocess have a structure that allows the use of an rANS entropy coder with more resource efficientstatic distribution tables. Extensions to the rANS entropy coder are introduced to efficientlywork with these static distribution tables and large but sparse source alphabets consisting of upto 25 Bit per symbol. Preliminary performance results show compliance with the firm real timerequirements while offering close to optimal data compression.


Top k Convolution and the Quest for Near Linear Output Sensitive Subset Sum. In the classical Subset Sum problem we are given a set X and a target t , and the task is to decide whether there exists a subset of X which sums to t . A recent line of research has resulted in tilde O (t) time algorithms, which are (near )optimal under popular complexity theoretic assumptions. On the other hand, the standard dynamic programming algorithm runs in time O(n cdot mathcal S (X,t) ) , where mathcal S (X,t) is the set of all subset sums of X that are smaller than t . Furthermore, all known pseudopolynomial algorithms actually solve a stronger task, since they actually compute the whole set mathcal S (X,t) . As the aforementioned two running times are incomparable, in this paper we ask whether one can achieve the best of both worlds running time tilde O ( mathcal S (X,t) ) . In particular, we ask whether mathcal S (X,t) can be computed in near linear time in the output size. Using a diverse toolkit containing techniques such as color coding, sparse recovery, and sumset estimates, we make considerable progress towards this question and design an algorithm running in time tilde O ( mathcal S (X,t) 4 3 ) . Central to our approach is the study of top k convolution, a natural problem of independent interest given sparse polynomials with non negative coefficients, compute the lowest k non zero monomials of their product. We design an algorithm running in time tilde O (k 4 3 ) , by a combination of sparse convolution and sumset estimates considered in Additive Combinatorics. Moreover, we provide evidence that going beyond some of the barriers we have faced requires either an algorithmic breakthrough or possibly new techniques from Additive Combinatorics on how to pass from information on restricted sumsets to information on unrestricted sumsets.


Lower Bounds from Fitness Levels Made Easy. One of the first and easy to use techniques for proving run time bounds for evolutionary algorithms is the so called method of fitness levels by Wegener. It uses a partition of the search space into a sequence of levels which are traversed by the algorithm in increasing order, possibly skipping levels. An easy, but often strong upper bound for the run time can then be derived by adding the reciprocals of the probabilities to leave the levels (or upper bounds for these). Unfortunately, a similarly effective method for proving lower bounds has not yet been established. The strongest such method, proposed by Sudholt (2013), requires a careful choice of the viscosity parameters gamma i,j , 0 le i j le n . In this paper we present two new variants of the method, one for upper and one for lower bounds. Besides the level leaving probabilities, they only rely on the probabilities that levels are visited at all. We show that these can be computed or estimated without greater difficulties and apply our method to reprove the following known results in an easy and natural way. (i) The precise run time of the (1 1) EA on textsc LeadingOnes . (ii) A lower bound for the run time of the (1 1) EA on textsc OneMax , tight apart from an O(n) term. (iii) A lower bound for the run time of the (1 1) EA on long k paths. We also prove a tighter lower bound for the run time of the (1 1) EA on jump functions by showing that, regardless of the jump size, only with probability O(2 n ) the algorithm can avoid to jump over the valley of low fitness.


Evaluation Of Word Embeddings From Large Scale French Web Content. Distributed word representations are popularly used in many tasks in natural language processing. Adding that pretrained word vectors on huge text corpus achieved high performance in many different NLP tasks. This paper introduces multiple high quality word vectors for the French language where two of them are trained on massive crawled French data during this study and the others are trained on an already existing French corpus. We also evaluate the quality of our proposed word vectors and the existing French word vectors on the French word analogy task. In addition, we do the evaluation on multiple real NLP tasks that shows the important performance enhancement of the pre trained word vectors compared to the existing and random ones. Finally, we created a demo web application to test and visualize the obtained word embeddings. The produced French word embeddings are available to the public, along with the finetuning code on the NLU tasks and the demo code.


Multiply resonant Second harmonic Generation using Surface Lattice Resonances in Aluminum Metasurfaces. Nonlinear metamaterials show potential for realizing flat nonlinear optical devices but generally lack in terms of achievable conversion efficiencies. Recent work has focused on enhancing nonlinear processes by utilizing high quality factor resonances, such as collective responses known as surface lattice resonances (SLRs) taking place in periodic metal nanoparticle arrays. Here, we investigate how the dispersive nature of SLRs affects the nonlinear responses of SLR supporting metasurfaces. Particularly, we measure second harmonic generation from aluminum nanoparticle arrays and demonstrate that by tilting the sample along two orthogonal directions, the sample can be made multiply resonant for several pump and second harmonic signal wavelength combinations. Characterized metasurfaces are estimated to exhibit a second order susceptibility value of 0.40 pm V, demonstrating aluminum as a potential material for nonlinear metasurfaces.


Progressive Transformer Based Generation of Radiology Reports. Inspired by Curriculum Learning, we propose a consecutive (i.e., image to text to text) generation framework where we divide the problem of radiology report generation into two steps. Contrary to generating the full radiology report from the image at once, the model generates global concepts from the image in the first step and then reforms them into finer and coherent texts using a transformer architecture. We follow the transformer based sequence to sequence paradigm at each step. We improve upon the state of the art on two benchmark datasets.


Supervised Contrastive Learning for Detecting Anomalous Driving Behaviours from Multimodal Videos. Distracted driving is one of the major reasons for vehicle accidents. Therefore, detecting distracted driving behaviors is of paramount importance to reduce the millions of deaths and injuries occurring worldwide. Distracted or anomalous driving behaviors are deviations from 'normal' driving that need to be identified correctly to alert the driver. However, these driving behaviors do not comprise one specific type of driving style and their distribution can be different during the training and test phases of a classifier. We formulate this problem as a supervised contrastive learning approach to learn a visual representation to detect normal, and seen and unseen anomalous driving behaviors. We made a change to the standard contrastive loss function to adjust the similarity of negative pairs to aid the optimization. Normally, in a (self) supervised contrastive framework, the projection head layers are omitted during the test phase as the encoding layers are considered to contain general visual representative information. However, we assert that for a video based supervised contrastive learning task, including a projection head can be beneficial. We showed our results on a driver anomaly detection dataset that contains 783 minutes of video recordings of normal and anomalous driving behaviors of 31 drivers from the various top and front cameras (both depth and infrared). Out of 9 video modalities combinations, our proposed contrastive approach improved the ROC AUC on 6 in comparison to the baseline models (from 4.23 to 8.91 for different modalities). We performed statistical tests that showed evidence that our proposed method performs better than the baseline contrastive learning setup. Finally, the results showed that the fusion of depth and infrared modalities from the top and front views achieved the best AUC ROC of 0.9738 and AUC PR of 0.9772.


Integer Factorization By Sieving The Delta. Let n mathrm p ! cdot ! mathrm q (p q) and Delta lvert p q rvert , where p,q are odd integers, then, it is hypothesized that factorizing this composite n will take O(1) time once the steady state value is reached for any Delta in zone 0 of some observation deck (od) with specific dial settings. We also introduce a new factorization approach by looking for Delta in different Delta sieve zones. Once Delta is found and n is already given, one can easily find the factors of this composite n from any one of the following quadratic equations p 2 p Delta n 0 or q 2 q Delta n 0 . The new factorization approach does not rely on congruence of squares or any special properties of n, p or q and is only based on sieving the Delta . In addition, some other new factorization approaches are also discussed. Finally, a new trapdoor function is presented which is leveraged to encrypt and decrypt a message with different keys. The most fascinating part of the discovery is how addition is used in factorization of a semiprime number by making it yield the difference of its prime factors.


End To End Anomaly Detection for Identifying Malicious Cyber Behavior through NLP Based Log Embeddings. Rule based IDS (intrusion detection systems) are being replaced by more robust neural IDS, which demonstrate great potential in the field of Cybersecurity. However, these ML approaches continue to rely on ad hoc feature engineering techniques, which lack the capacity to vectorize inputs in ways that are fully relevant to the discovery of anomalous cyber activity. We propose a deep end to end framework with NLP inspired components for identifying potentially malicious behaviors on enterprise computer networks. We also demonstrate the efficacy of this technique on the recently released DARPA OpTC data set.


The Nielsen realization problem for high degree del Pezzo surfaces. Let M be a smooth 4 manifold underlying some del Pezzo surface of degree d geq 6 . We consider the smooth Nielsen realization problem for M which finite subgroups of text Mod (M) pi 0( text Homeo (M)) have lifts to text Diff (M) leq text Homeo (M) under the quotient map pi text Homeo (M) to text Mod (M) ? We give a complete classification of such finite subgroups of text Mod (M) for d geq 7 and a partial answer for d 6 . For the cases d geq 8 , the quotient map pi admits a section with image contained in text Diff (M) . For the case d 7 , we show that all finite order elements of text Mod (M) have lifts to text Diff (M) , but there are finite subgroups of text Mod (M) that do not lift to text Diff (M) . We prove that the condition of whether a finite subgroup G leq text Mod (M) lifts to text Diff (M) is equivalent to the existence of a certain equivariant connected sum realizing G . For the case d 6 , we show this equivalence for all maximal finite subgroups G leq text Mod (M) .


Preventing Covid59. SARS CoV 2 is the third betacoronavirus to enter the human population in the past 20 years, revealing a concerning pattern. Clearly, preventing a future pandemic from such viruses is a critical priority. Previous studies have shown that shRNAs can be powerful suppressors of RNA viruses in transgenic animals and substantially reduce transmission. Thus, we propose the introduction of anti betacoronavirus shRNAs using CRISPR CAS9 gene drive into the horseshoe bat population, the natural reservoir of those viruses, to combat this pandemic threat at its source. Importantly, our approach is not expected to create any harm to bats and can benefit other animals in the ecosystem that contract betacoronaviruses from bats. We map the ethical and the technical aspects and suggest guidelines for moving forward with this proposal.


Learning Description Logic Ontologies. Five Approaches. Where Do They Stand?. The quest for acquiring a formal representation of the knowledge of a domain of interest has attracted researchers with various backgrounds into a diverse field called ontology learning. We highlight classical machine learning and data mining approaches that have been proposed for (semi )automating the creation of description logic (DL) ontologies. These are based on association rule mining, formal concept analysis, inductive logic programming, computational learning theory, and neural networks. We provide an overview of each approach and how it has been adapted for dealing with DL ontologies. Finally, we discuss the benefits and limitations of each of them for learning DL ontologies.


Construction of a right inverse for the divergence in non cylindrical time dependent domains. We construct a stable right inverse for the divergence operator in non cylindrical domains in space time. The domains are assumed to be H "older regular in space and evolve continuously in time. The inverse operator is of Bogovskij type, meaning that it attains zero boundary values. We provide estimates in Sobolev spaces of positive and negative order with respect to both time and space variables. The regularity estimates on the operator depend on the assumed H "older regularity of the domain. The results can naturally be connected to the known theory for Lipschitz domains. As an application, we prove refined pressure estimates for weak and very weak solutions to Navier Stokes equations in time dependent domains.


Leveraging Graph and Deep Learning Uncertainties to Detect Anomalous Trajectories. Understanding and representing traffic patterns are key to detecting anomalous trajectories in the transportation domain. However, some trajectories can exhibit heterogeneous maneuvering characteristics despite confining to normal patterns. Thus, we propose a novel graph based trajectory representation and association scheme for extraction and confederation of traffic movement patterns, such that data patterns and uncertainty can be learned by deep learning (DL) models. This paper proposes the usage of a recurrent neural network (RNN) based evidential regression model, which can predict trajectory at future timesteps as well as estimate the data and model uncertainties associated, to detect maritime anomalous trajectories, such as unusual vessel maneuvering, using automatic identification system (AIS) data. Furthermore, we utilize evidential deep learning classifiers to detect unusual turns of vessels and the loss of transmitted signal using predicted class probabilities with associated uncertainties. Our experimental results suggest that the graphical representation of traffic patterns improves the ability of the DL models, such as evidential and Monte Carlo dropout, to learn the temporal spatial correlation of data and associated uncertainties. Using different datasets and experiments, we demonstrate that the estimated prediction uncertainty yields fundamental information for the detection of traffic anomalies in the maritime and, possibly in other domains.


Billiards in a circle with trajectories circumscribing a triangle. We consider a bar billiards problem for a triangle in the unit circle. For the point on the unit circle, we construct a line from it in a counterclockwise direction tangent to the triangle, and examine a map corresponding to the point of intersection with the circle. For the rotation number rho of this map,we give frac 1 3 leq rho frac 1 2 and necessary and sufficient conditions for rho frac 1 3 , which is related to an ellipse. We give an application to elementary geometry.


Learning to Navigate Intersections with Unsupervised Driver Trait Inference. Navigation through uncontrolled intersections is one of the key challenges for autonomous vehicles. Identifying the subtle differences in hidden traits of other drivers can bring significant benefits when navigating in such environments. We propose an unsupervised method for inferring driver traits such as driving styles from observed vehicle trajectories. We use a variational autoencoder with recurrent neural networks to learn a latent representation of traits without any ground truth trait labels. Then, we use this trait representation to learn a policy for an autonomous vehicle to navigate through a T intersection with deep reinforcement learning. Our pipeline enables the autonomous vehicle to adjust its actions when dealing with drivers of different traits to ensure safety and efficiency. Our method demonstrates promising performance and outperforms state of the art baselines in the T intersection scenario.


Dimensions of Commonsense Knowledge. Commonsense knowledge is essential for many AI applications, including those in natural language processing, visual processing, and planning. Consequently, many sources that include commonsense knowledge have been designed and constructed over the past decades. Recently, the focus has been on large text based sources, which facilitate easier integration with neural (language) models and application to textual tasks, typically at the expense of the semantics of the sources and their harmonization. Efforts to consolidate commonsense knowledge have yielded partial success, with no clear path towards a comprehensive solution. We aim to organize these sources around a common set of dimensions of commonsense knowledge. We survey a wide range of popular commonsense sources with a special focus on their relations. We consolidate these relations into 13 knowledge dimensions. This consolidation allows us to unify the separate sources and to compute indications of their coverage, overlap, and gaps with respect to the knowledge dimensions. Moreover, we analyze the impact of each dimension on downstream reasoning tasks that require commonsense knowledge, observing that the temporal and desire goal dimensions are very beneficial for reasoning on current downstream tasks, while distinctness and lexical knowledge have little impact. These results reveal preferences for some dimensions in current evaluation, and potential neglect of others.


Stochastic Models of Neural Plasticity A Scaling Approach. In neuroscience, synaptic plasticity refers to the set of mechanisms driving the dynamics of neuronal connections, called synapses and represented by a scalar value, the synaptic weight. A Spike Timing Dependent Plasticity (STDP) rule is a biologically based model representing the time evolution of the synaptic weight as a functional of the past spiking activity of adjacent neurons. A general mathematical framework has been introduced in arXiv 2010.08195. In this paper we develop and investigate a scaling approach of these models based on several biological assumptions. Experiments show that long term synaptic plasticity evolves on a much slower timescale than the cellular mechanisms driving the activity of neuronal cells, like their spiking activity or the concentration of various chemical components created suppressed by this spiking activity. For this reason, a scaled version of the stochastic model of arXiv 2010.08195 is introduced and a limit theorem, an averaging principle, is stated for a large class of plasticity kernels. A companion paper arXiv 2010.08790 is entirely devoted to the tightness properties used to prove these convergence results. These averaging principles are used to study two important STDP models pair based rules and calcium based rules. Our results are compared with the approximations of neuroscience STDP models. A class of discrete models of STDP rules is also investigated for the analytical tractability of its limiting dynamical system.


Extended Sprague Grundy theory for locally finite games, and applications to random game trees. For a collection of papers in memory of Elwyn Berlekamp (1940 2019), John Conway (1937 2020), and Richard Guy (1916 2020). The Sprague Grundy theory for finite games without cycles was extended to general finite games by Cedric Smith and by Aviezri Fraenkel and coauthors. We observe that the same framework used to classify finite games also covers the case of locally finite games (that is, games where any position has only finitely many options). In particular, any locally finite game is equivalent to some finite game. We then study cases where the directed graph of a game is chosen randomly, and is given by the tree of a Galton Watson branching process. Natural families of offspring distributions display a surprisingly wide range of behaviour. The setting shows a nice interplay between ideas from combinatorial game theory and ideas from probability.


MirrorME Implementation of an IoT based Smart Mirror through Facial Recognition and Personalized Information Recommendation Algorithm. We are living in the era of the fourth industrial revolution, which also treated as 4IR or Industry 4.0. Generally, 4IR considered as the mixture of robotics, artificial intelligence (AI), quantum computing, the Internet of Things (IoT) and other frontier technologies. It is obvious that nowadays a plethora of smart devices is providing services to make the daily life of human easier. However, in the morning most people around the globe use a traditional mirror while preparing themselves for daily task. The aim is to build a low cost intelligent mirror system that can display a variety of details based on user recommendations. Therefore, in this article, Internet of Things (IoT) and AI based smart mirror is introduced that will support the users to receive the necessary daily update of weather information, date, time, calendar, to do list, updated news headlines, traffic updates, COVID 19 cases status and so on. Moreover, a face detection method also implemented with the smart mirror to construct the architecture more secure. Our proposed MirrorME application provides a success rate of nearly 87 in interacting with the features of face recognition and voice input. The mirror is capable of delivering multimedia facilities while maintaining high levels of security within the device.


On summation formulas in probability theory. We offer some summation formulas that appear to have great utility in probability theory. The proofs require some recent results from analysis that have thus far been applied to basic hypergeometric functions.


FairyTailor A Multimodal Generative Framework for Storytelling. Storytelling is an open ended task that entails creative thinking and requires a constant flow of ideas. Natural language generation (NLG) for storytelling is especially challenging because it requires the generated text to follow an overall theme while remaining creative and diverse to engage the reader. In this work, we introduce a system and a web based demo, FairyTailor, for human in the loop visual story co creation. Users can create a cohesive children's fairytale by weaving generated texts and retrieved images with their input. FairyTailor adds another modality and modifies the text generation process to produce a coherent and creative sequence of text and images. To our knowledge, this is the first dynamic tool for multimodal story generation that allows interactive co formation of both texts and images. It allows users to give feedback on co created stories and share their results.


Tamagawa numbers of elliptic curves with prescribed torsion subgroup or isogeny. We study Tamagawa numbers of elliptic curves with torsion mathbb Z 2 mathbb Z oplus mathbb Z 14 mathbb Z over cubic fields and of elliptic curves with an n isogeny over mathbb Q , for n in 6,8,10,12,14,16,17,18,19,37,43,67,163 . Bruin and Najman proved that every elliptic curve with torsion mathbb Z 2 mathbb Z oplus mathbb Z 14 mathbb Z over a cubic field is a base change of an elliptic curve defined over mathbb Q . We find that Tamagawa numbers of elliptic curves defined over mathbb Q with torsion mathbb Z 2 mathbb Z oplus mathbb Z 14 mathbb Z over a cubic field are always divisible by 14 2 , with each factor 14 coming from a rational prime with split multiplicative reduction of type I 14k , one of which is always p 2. The only exception is the curve 1922.e2, with c E c 2 14. The same curves defined over cubic fields over which they have torsion subgroup mathbb Z 2 mathbb Z oplus mathbb Z 14 mathbb Z turn out to have the Tamagawa number divisible by 14 3 . As for n isogenies, Tamagawa numbers of elliptic curves with an 18 isogeny must be divisible by 4, while elliptic curves with an n isogeny for the remaining n from the mentioned set must have Tamagawa numbers divisible by 2, except for finite sets of specified curves.


Continuous Random Variable Estimation is not Optimal for the Witsenhausen Counterexample. Optimal design of distributed decision policies can be a difficult task, illustrated by the famous Witsenhausen counterexample. In this paper we characterize the optimal control designs for the vector valued setting assuming that it results in an internal state that can be described by a continuous random variable which has a probability density function. More specifically, we provide a genie aided outer bound that relies on our previous results for empirical coordination problems. This solution turns out to be not optimal in general, since it consists of a time sharing strategy between two linear schemes of specific power. It follows that the optimal decision strategy for the original scalar Witsenhausen problem must lead to an internal state that cannot be described by a continuous random variable which has a probability density function.


A converse to the neo classical inequality with an application to the Mittag Leffler function. We prove two inequalities for the Mittag Leffler function, namely that the function log E alpha(x alpha) is sub additive for 0 alpha 1, and super additive for alpha 1. These assertions follow from two new binomial inequalities, one of which is a converse to the neo classical inequality. The proofs use a generalization of the binomial theorem due to Hara and Hino (Bull. London Math. Soc. 2010). For 0 alpha 2, we also show that E alpha(x alpha) is log concave resp. log convex, using analytic as well as probabilistic arguments.


The Robin problem for the nonlinear Schr "odinger equation on the half line. We consider the nonlinear Schr " o dinger equation on the half line x geq 0 with a Robin boundary condition at x 0 and with initial data in the weighted Sobolev space H 1,1 ( mathbb R ) . We prove that there exists a global weak solution of this initial boundary value problem and provide a representation for the solution in terms of the solution of a Riemann Hilbert problem. Using this representation, we obtain asymptotic formulas for the long time behavior of the solution. In particular, by restricting our asymptotic result to solutions whose initial data are close to the initial profile of the stationary one soliton, we obtain results on the asymptotic stability of the stationary one solitons under any small perturbation in H 1,1 ( mathbb R ) . In the focusing case, such a result was already established by Deift and Park using different methods, and our work provides an alternative approach to obtain such results.


Exploring Underexplored Limitations of Cross Domain Text to SQL Generalization. Recently, there has been significant progress in studying neural networks for translating text descriptions into SQL queries under the zero shot cross domain setting. Despite achieving good performance on some public benchmarks, we observe that existing text to SQL models do not generalize when facing domain knowledge that does not frequently appear in the training data, which may render the worse prediction performance for unseen domains. In this work, we investigate the robustness of text to SQL models when the questions require rarely observed domain knowledge. In particular, we define five types of domain knowledge and introduce Spider DK (DK is the abbreviation of domain knowledge), a human curated dataset based on the Spider benchmark for text to SQL translation. NL questions in Spider DK are selected from Spider, and we modify some samples by adding domain knowledge that reflects real world question paraphrases. We demonstrate that the prediction accuracy dramatically drops on samples that require such domain knowledge, even if the domain knowledge appears in the training set, and the model provides the correct predictions for related training samples.


The functorial source problem via dimension data. For an automorphic representation pi of Ramanujan type, there is a conjectural subgroup mathcal H pi of the Langlands L group L G associated to pi , called the it functional source of pi . The functorial source problem proposed by Langlands and refined by Arthur intends to determine mathcal H pi via analytic and arithmetic data of pi . In this paper, we consider the functorial source problem of automorphic representations of a split group, a unitary group, or an orthogonal group which do not come from endoscopy and have minimal possible ramification. In this setting, mathcal H pi must be an S subgroup of L G . We approach the functorial source problem by proving distinction and linear independence among dimension data of S subgroups. Nice results along this direction are shown in this paper. We define a notion of quasi root system and use it as the key tool for studying S subgroups and their dimension data.


Sampling low spectrum signals on graphs via cluster concentrated modes examples. We establish frame inequalities for signals in Paley Wiener spaces on two specific families of graphs consisting of combinations of cubes and cycles. The frame elements are localizations to cubes, regarded as clusters in the graphs, of vertex functions that are eigenvectors of certain spatio spectral limiting operators on graph signals.


Towards an Automated Pipeline for Detecting and Classifying Malware through Machine Learning. The constant growth in the number of malware software or code fragment potentially harmful for computers and information networks and the use of sophisticated evasion and obfuscation techniques have seriously hindered classic signature based approaches. On the other hand, malware detection systems based on machine learning techniques started offering a promising alternative to standard approaches, drastically reducing analysis time and turning out to be more robust against evasion and obfuscation techniques. In this paper, we propose a malware taxonomic classification pipeline able to classify Windows Portable Executable files (PEs). Given an input PE sample, it is first classified as either malicious or benign. If malicious, the pipeline further analyzes it in order to establish its threat type, family, and behavior(s). We tested the proposed pipeline on the open source dataset EMBER, containing approximately 1 million PE samples, analyzed through static analysis. Obtained malware detection results are comparable to other academic works in the current state of art and, in addition, we provide an in depth classification of malicious samples. Models used in the pipeline provides interpretable results which can help security analysts in better understanding decisions taken by the automated pipeline.


Profinite groups with an automorphism of prime order whose fixed points have finite Engel sinks. A right Engel sink of an element g of a group G is a set mathscr R (g) such that for every x in G all sufficiently long commutators ... g,x ,x , dots ,x belong to mathscr R (g) . (Thus, g is a right Engel element precisely when we can choose mathscr R (g) 1 .) We prove that if a profinite group G admits a coprime automorphism varphi of prime order such that every fixed point of varphi has a finite right Engel sink, then G has an open locally nilpotent subgroup. A left Engel sink of an element g of a group G is a set mathscr E (g) such that for every x in G all sufficiently long commutators ... x,g ,g , dots ,g belong to mathscr E (g) . (Thus, g is a left Engel element precisely when we can choose mathscr E (g) 1 .) We prove that if a profinite group G admits a coprime automorphism varphi of prime order such that every fixed point of varphi has a finite left Engel sink, then G has an open pronilpotent by nilpotent subgroup.


A noncommutative analogue of the Peskine Szpiro Acyclicity Lemma. We present a variant of the Peskine Szpiro Acyclicity Lemma, and hence a way to certify exactness of a complex of finite modules over a large class of (possibly) noncommutative rings. Specifically, over the class of Auslander regular rings. In the case of relative mathscr D X modules, for example mathscr D X s 1 , dots, s r modules, the hypotheses have geometric realizations making them easier to authenticate. We demonstrate the efficacy of this lemma and its various forms by independently recovering some results related to Bernstein Sato polynomials.


Convergence Rates of Gradient Methods for Convex Optimization in the Space of Measures. We study the convergence rate of Bregman gradient methods for convex optimization in the space of measures on a d dimensional manifold. Under basic regularity assumptions, we show that the suboptimality gap at iteration k is in O(log(k)k 1 ) for multiplicative updates, while it is in O(k q (d q) ) for additive updates for some q 1, 2, 4 determined by the structure of the objective function. Our flexible proof strategy, based on approximation arguments, allows to painlessly cover all Bregman Proximal Gradient Methods (PGM) and their acceleration (APGM) under various geometries such as the hyperbolic entropy and L p divergences. We also prove the tightness of our analysis with matching lower bounds and confirm the theoretical results with numerical experiments on low dimensional problems. Note that all these optimization methods must additionally pay the computational cost of discretization, which can be exponential in d.


Page Table Management for Heterogeneous Memory Systems. Modern enterprise servers are increasingly embracing tiered memory systems with a combination of low latency DRAMs and large capacity but high latency non volatile main memories (NVMMs) such as Intel's Optane DC PMM. Prior works have focused on efficient placement and migration of data on a tiered memory system, but have not studied the optimal placement of page tables. Explicit and efficient placement of page tables is crucial for large memory footprint applications with high TLB miss rates because they incur dramatically higher page walk latency when page table pages are placed in NVMM. We show that (i) page table pages can end up on NVMM even when enough DRAM memory is available and (ii) page table pages that spill over to NVMM due to DRAM memory pressure are not migrated back later when memory is available in DRAM. We study the performance impact of page table placement in a tiered memory system and propose an efficient and transparent page table management technique that (i) applies different placement policies for data and page table pages, (ii) introduces a differentiating policy for page table pages by placing a small but critical part of the page table in DRAM, and (iii) dynamically and judiciously manages the rest of the page table by transparently migrating the page table pages between DRAM and NVMM. Our implementation on a real system equipped with Intel's Optane NVMM running Linux reduces the page table walk cycles by 12 and total cycles by 20 on an average. This improves the runtime by 20 on an average for a set of synthetic and real world large memory footprint applications when compared with various default Linux kernel techniques.


Explainable AI in Credit Risk Management. Artificial Intelligence (AI) has created the single biggest technology revolution the world has ever seen. For the finance sector, it provides great opportunities to enhance customer experience, democratize financial services, ensure consumer protection and significantly improve risk management. While it is easier than ever to run state of the art machine learning models, designing and implementing systems that support real world finance applications have been challenging. In large part because they lack transparency and explainability which are important factors in establishing reliable technology and the research on this topic with a specific focus on applications in credit risk management. In this paper, we implement two advanced post hoc model agnostic explainability techniques called Local Interpretable Model Agnostic Explanations (LIME) and SHapley Additive exPlanations (SHAP) to machine learning (ML) based credit scoring models applied to the open access data set offered by the US based P2P Lending Platform, Lending Club. Specifically, we use LIME to explain instances locally and SHAP to get both local and global explanations. We discuss the results in detail and present multiple comparison scenarios by using various kernels available for explaining graphs generated using SHAP values. We also discuss the practical challenges associated with the implementation of these state of art eXplainabale AI (XAI) methods and document them for future reference. We have made an effort to document every technical aspect of this research, while at the same time providing a general summary of the conclusions.


Edge Assisted Congestion Control Mechanism for 5G Network Using Software Defined Networking. In order to cope with the explosive growth of data traffic which is associated with a wide plethora of emerging applications and services that are expected to be used by both ordinary users and vertical industries, the congestion control mechanism is considered to be vital. In this paper, we proposed a congestion control mechanism that could function within the framework of Multi Access Edge Computing (MEC). The proposed mechanism is aiming to make real time decisions for selectively buffering traffic while taking network condition and Quality of Service (QoS) into consideration. In order to support a MEC assisted scheme, the MEC server is expected to locally store delay tolerant data traffics until the delay conditions expire. This enables the network to have better control over the radio resource provisioning of higher priority data. To achieve this, we introduced a dedicated function known as Congestion Control Engine (CCE), which can capture Radio Access Network (RAN) condition through Radio Network Information Service (RNIS) function, and use this knowledge to make the real time decision for selectively offloading traffic so that it can perform more intelligently. Analytical evaluation results of our proposed mechanism confirm that it can alleviate network congestion more efficiently.


Scaling up HBM Efficiency of Top K SpMV for Approximate Embedding Similarity on FPGAs. Top K SpMV is a key component of similarity search on sparse embeddings. This sparse workload does not perform well on general purpose NUMA systems that employ traditional caching strategies. Instead, modern FPGA accelerator cards have a few tricks up their sleeve. We introduce a Top K SpMV FPGA design that leverages reduced precision and a novel packet wise CSR matrix compression, enabling custom data layouts and delivering bandwidth efficiency often unreachable even in architectures with higher peak bandwidth. With HBM based boards, we are 100x faster than a multi threaded CPU implementation and 2x faster than a GPU with 20 higher bandwidth, with 14.2x higher power efficiency.


Complementary Pseudo Labels For Unsupervised Domain Adaptation On Person Re identification. In recent years, supervised person re identification (re ID) models have received increasing studies. However, these models trained on the source domain always suffer dramatic performance drop when tested on an unseen domain. Existing methods are primary to use pseudo labels to alleviate this problem. One of the most successful approaches predicts neighbors of each unlabeled image and then uses them to train the model. Although the predicted neighbors are credible, they always miss some hard positive samples, which may hinder the model from discovering important discriminative information of the unlabeled domain. In this paper, to complement these low recall neighbor pseudo labels, we propose a joint learning framework to learn better feature embeddings via high precision neighbor pseudo labels and high recall group pseudo labels. The group pseudo labels are generated by transitively merging neighbors of different samples into a group to achieve higher recall. However, the merging operation may cause subgroups in the group due to imperfect neighbor predictions. To utilize these group pseudo labels properly, we propose using a similarity aggregating loss to mitigate the influence of these subgroups by pulling the input sample towards the most similar embeddings. Extensive experiments on three large scale datasets demonstrate that our method can achieve state of the art performance under the unsupervised domain adaptation re ID setting.


HVTR Hybrid Volumetric Textural Rendering for Human Avatars. We propose a novel neural rendering pipeline, Hybrid Volumetric Textural Rendering (HVTR), which synthesizes virtual human avatars from arbitrary poses efficiently and at high quality. First, we learn to encode articulated human motions on a dense UV manifold of the human body surface. To handle complicated motions (e.g., self occlusions), we then leverage the encoded information on the UV manifold to construct a 3D volumetric representation based on a dynamic pose conditioned neural radiance field. While this allows us to represent 3D geometry with changing topology, volumetric rendering is computationally heavy. Hence we employ only a rough volumetric representation using a pose conditioned downsampled neural radiance field (PD NeRF), which we can render efficiently at low resolutions. In addition, we learn 2D textural features that are fused with rendered volumetric features in image space. The key advantage of our approach is that we can then convert the fused features into a high resolution, high quality avatar by a fast GAN based textural renderer. We demonstrate that hybrid rendering enables HVTR to handle complicated motions, render high quality avatars under user controlled poses shapes and even loose clothing, and most importantly, be fast at inference time. Our experimental results also demonstrate state of the art quantitative results.