iALS Speeding up Matrix Factorization with Subspace Optimization. iALS is a popular algorithm for learning matrix factorization models from implicit feedback with alternating least squares. This algorithm was invented over a decade ago but still shows competitive quality compared to recent approaches like VAE, EASE, SLIM, or NCF. Due to a computational trick that avoids negative sampling, iALS is very efficient especially for large item catalogues. However, iALS does not scale well with large embedding dimensions, d, due to its cubic runtime dependency on d. Coordinate descent variations, iCD, have been proposed to lower the complexity to quadratic in d. In this work, we show that iCD approaches are not well suited for modern processors and can be an order of magnitude slower than a careful iALS implementation for small to mid scale embedding sizes (d 100) and only perform better than iALS on large embeddings d 1000. We propose a new solver iALS that combines the advantages of iALS in terms of vector processing with a low computational complexity as in iCD. iALS is an order of magnitude faster than iCD both for small and large embedding dimensions. It can solve benchmark problems like Movielens 20M or Million Song Dataset even for 1000 dimensional embedding vectors in a few minutes.


Dense Point Prediction A Simple Baseline for Crowd Counting and Localization. In this paper, we propose a simple yet effective crowd counting and localization network named SCALNet. Unlike most existing works that separate the counting and localization tasks, we consider those tasks as a pixel wise dense prediction problem and integrate them into an end to end framework. Specifically, for crowd counting, we adopt a counting head supervised by the Mean Square Error (MSE) loss. For crowd localization, the key insight is to recognize the keypoint of people, i.e., the center point of heads. We propose a localization head to distinguish dense crowds trained by two loss functions, i.e., Negative Suppressed Focal (NSF) loss and False Positive (FP) loss, which balances the positive negative examples and handles the false positive predictions. Experiments on the recent and large scale benchmark, NWPU Crowd, show that our approach outperforms the state of the art methods by more than 5 and 10 improvement in crowd localization and counting tasks, respectively. The code is publicly available at https github.com WangyiNTU SCALNet.


Tangled Paths A Random Graph Model from Mallows Permutations. We introduce the random graph mathcal P (n,q) which results from taking the union of two paths of length n geq 1 , where the vertices of one of the paths have been relabelled according to a Mallows permutation with real parameter 0 q(n) leq 1 . This random graph model, the tangled path, goes through an evolution if q is close to 0 the graph bears resemblance to a path and as q tends to 1 it becomes an expander. In an effort to understand the evolution of mathcal P (n,q) we determine the treewidth and cutwidth of mathcal P (n,q) up to log factors for all q . We also show that the property of having a separator of size one has a sharp threshold. In addition, we prove bounds on the diameter, and vertex isoperimetric number for specific values of q .


Proper CAT(0) actions of unipotent free linear groups. Let Gamma be a finitely generated group of matrices over mathbb C . We construct an isometric action of Gamma on a complete CAT(0) space X such that the restriction of this action to any subgroup of Gamma containing no nontrivial unipotent elements is well behaved. As an application, we show that if M is a graph manifold that does not admit a nonpositively curved Riemannian metric, then any finite dimensional mathbb C linear representation of pi 1(M) maps a nontrivial element of pi 1(M) to a unipotent matrix. In particular, the fundamental groups of such 3 manifolds do not admit any faithful finite dimensional unitary representations.


On the enumeration of Fano Bott manifolds. Fano Bott manifolds bijectively correspond to signed rooted forests with some equivalence relation. Using this bijective correspondence, we enumerate the isomorphism classes of Fano Bott manifolds and the diffeomorphism classes of indecomposable Fano Bott manifolds. We also observe that the signed rooted forests with the equivalence relation bijectively correspond to rooted triangular cacti.


On the Left Connected Subalgebra of the Descent Algebra of a Coxeter Group of Classical Type. A Coxeter group of classical type A n , B n or D n contains a chain of subgroups of the same type. We show that intersections of conjugates of these subgroups are again of the same type, and make precise in which sense and to what extent this property is exclusive to the classical types of Coxeter groups. As the main tool for the proof we use Solomon's descent algebra. Using Stirling numbers, we express certain basis elements of the descent algebra as polynomials and derive explicit multiplication formulas for a commutative subalgebra of the descent algebra.


Amendment of the numerical dispersion in particle in cell methods for evaluation of charges of self injected electron bunches in the laser wakefield acceleration. Total charge and energy evaluations for the electron beams generated in the laser wakefield acceleration (LWFA) is the primary step in the determination of the required target and laser parameters. Particle in cell (PIC) simulations is an efficient numerical tool that can provide such evaluations unless the effect of numerical dispersion is not diminished. The numerical dispersion, which is specific for the PIC modeling, affects not only the dephasing lengths in LWFA but also the total amount of the self injected electrons. A numerical error of the order of 10 4 10 3 in the calculation of the speed of light results in a significant error in the total injected charge and energy gain of the accelerated electron bunches. In the standard numerical approach, the numerical correction of the speed of light either requires infinitely small spatial grid resolution (which needs large computation platform) or force to compromise with the numerical accuracy. A simple and easy to implement numerical scheme is shown to suppress the numerical dispersion of the electromagnetic pulse in PIC simulations even with a modest spatial resolution, and without any special treatments to the core structure of the numerical algorithm. Evaluated charges of the self injected electron bunches become essentially lower owing to the better calculations of the wake phase velocity.


Smoothed Differential Privacy. Differential privacy (DP) is a widely accepted and widely applied notion of privacy based on worst case analysis. Often, DP classifies most mechanisms without external noise as non private Dwork et al., 2014 , and external noises, such as Gaussian noise or Laplacian noise Dwork et al., 2006 , are introduced to improve privacy. In many real world applications, however, adding external noise is undesirable and sometimes prohibited. For example, presidential elections often require a deterministic rule to be used Liu et al., 2020 , and small noises can lead to dramatic decreases in the prediction accuracy of deep neural networks, especially the underrepresented classes Bagdasaryan et al., 2019 . In this paper, we propose a natural extension and relaxation of DP following the worst average case idea behind the celebrated smoothed analysis Spielman and Teng, 2004 . Our notion, the smoothed DP, can effectively measure the privacy leakage of mechanisms without external noises under realistic settings. We prove several strong properties of the smoothed DP, including composability, robustness to post processing and etc. We proved that any discrete mechanism with sampling procedures is more private than what DP predicts. In comparison, many continuous mechanisms with sampling procedures are still non private under smoothed DP. Experimentally, we first verified that the discrete sampling mechanisms are private in real world elections. Then, we apply the smoothed DP notion on quantized gradient descent, which indicates some neural networks can be private without adding any extra noises. We believe that these results contribute to the theoretical foundation of realistic privacy measures beyond worst case analysis.


A simple proof of the Fundamental Theorem of Algebra. We present a simple short proof of the Fundamental Theorem of Algebra, without complex analysis and with a minimal use of topology. It can be taught in a first year calculus class.


Fast Graph Learning with Unique Optimal Solutions. We consider two popular Graph Representation Learning (GRL) methods message passing for node classification and network embedding for link prediction. For each, we pick a popular model that we (i) linearize and (ii) and switch its training objective to Frobenius norm error minimization. These simplifications can cast the training into finding the optimal parameters in closed form. We program in TensorFlow a functional form of Truncated Singular Value Decomposition (SVD), such that, we could decompose a dense matrix mathbf M , without explicitly computing mathbf M . We achieve competitive performance on popular GRL tasks while providing orders of magnitude speedup. We open source our code at http github.com samihaija tf fsvd


The flow group of rooted abelian or quadratic differentials. We define the flow group of any component of any stratum of rooted abelian or quadratic differentials (those marked with a horizontal separatrix) to be the group generated by almost flow loops. We prove that the flow group is equal to the fundamental group of the component. As a corollary, we show that the plus and minus modular Rauzy Veech groups are finite index subgroups of their ambient modular monodromy groups. This partially answers a question of Yoccoz. Using this, and recent advances on algebraic hulls and Zariski closures of monodromy groups, we prove that the Rauzy Veech groups are Zariski dense in their ambient symplectic groups. Density, in turn, implies the simplicity of the plus and minus Lyapunov spectra of any component of any stratum of quadratic differentials. Thus, we establish the Kontsevich Zorich conjecture.


Community evolution in retweet networks. Communities in social networks often reflect close social ties between their members and their evolution through time. We propose an approach that tracks two aspects of community evolution in retweet networks flow of the members in, out and between the communities, and their influence. We start with high resolution time windows, and then select several timepoints which exhibit large differences between the communities. For community detection, we propose a two stage approach. In the first stage, we apply an enhanced Louvain algorithm, called Ensemble Louvain, to find stable communities. In the second stage, we form influence links between these communities, and identify linked super communities. For the detected communities, we compute internal and external influence, and for individual users, the retweet h index influence. We apply the proposed approach to three years of Twitter data of all Slovenian tweets. The analysis shows that the Slovenian tweetosphere is dominated by politics, that the left leaning communities are larger, but that the right leaning communities and users exhibit significantly higher impact. An interesting observation is that retweet networks change relatively gradually, despite such events as the emergence of the Covid 19 pandemic or the change of government.


Logarithmic Weisfeiler Leman Identifies All Planar Graphs. The Weisfeiler Leman (WL) algorithm is a well known combinatorial procedure for detecting symmetries in graphs and it is widely used in graph isomorphism tests. It proceeds by iteratively refining a colouring of vertex tuples. The number of iterations needed to obtain the final output is crucial for the parallelisability of the algorithm. We show that there is a constant k such that every planar graph can be identified (that is, distinguished from every non isomorphic graph) by the k dimensional WL algorithm within a logarithmic number of iterations. This generalises a result due to Verbitsky (STACS 2007), who proved the same for 3 connected planar graphs. The number of iterations needed by the k dimensional WL algorithm to identify a graph corresponds to the quantifier depth of a sentence that defines the graph in the (k 1) variable fragment C k 1 of first order logic with counting quantifiers. Thus, our result implies that every planar graph is definable with a C k 1 sentence of logarithmic quantifier depth.


Bidiagonal Triads and the Tetrahedron Algebra. We introduce a linear algebraic object called a bidiagonal triad. A bidiagonal triad is a modification of the previously studied and similarly defined concept of bidiagonal triple. A bidiagonal triad and a bidiagonal triple both consist of three diagonalizable linear transformations on a finite dimensional vector space, each of which acts in a bidiagonal fashion on the eigenspaces of the other two. A triad differs from a triple in the way these bidiagonal actions are defined. We modify a number of theorems about bidiagonal triples to the case of bidiagonal triads. We also describe the close relationship between bidiagonal triads and the representation theory of the tetrahedron Lie algebra.


Efficient edge preserving methods for dynamic inverse problems. We consider efficient methods for computing solutions to dynamic inverse problems, where both the quantities of interest and the forward operator (measurement process) may change at different time instances but we want to solve for all the images simultaneously. We are interested in large scale ill posed problems that are made more challenging by their dynamic nature and, possibly, by the limited amount of available data per measurement step. To remedy these difficulties, we apply regularization methods that enforce simultaneous regularization in space and time (such as edge enhancement at each time instant and proximity at consecutive time instants) and achieve this with low computational cost and enhanced accuracy. More precisely, we develop iterative methods based on a majorization minimization (MM) strategy with quadratic tangent majorant, which allows the resulting least squares problem to be solved with a generalized Krylov subspace (GKS) method the regularization parameter can be defined automatically and efficiently at each iteration. Numerical examples from a wide range of applications, such as limited angle computerized tomography (CT), space time image deblurring, and photoacoustic tomography (PAT), illustrate the effectiveness of the described approaches.


Guaranteed a posteriori local error estimation for finite element solutions of boundary value problems. This paper considers the finite element solution of the boundary value problem of Poisson's equation and proposes a guaranteed em a posteriori local error estimation based on the hypercircle method. Compared to the existing literature on qualitative error estimation, the proposed error estimation provides an explicit and sharp bound for the approximation error in the subdomain of interest, and its efficiency can be enhanced by further utilizing a non uniform mesh. Such a result is applicable to problems without H 2 regularity, since it only utilizes the first order derivative of the solution. The efficiency of the proposed method is demonstrated by numerical experiments for both convex and non convex 2D domains with uniform or non uniform meshes.


Nine Potential Pitfalls when Designing Human AI Co Creative Systems. This position paper examines potential pitfalls on the way towards achieving human AI co creation with generative models in a way that is beneficial to the users' interests. In particular, we collected a set of nine potential pitfalls, based on the literature and our own experiences as researchers working at the intersection of HCI and AI. We illustrate each pitfall with examples and suggest ideas for addressing it. Reflecting on all pitfalls, we discuss and conclude with implications for future research directions. With this collection, we hope to contribute to a critical and constructive discussion on the roles of humans and AI in co creative interactions, with an eye on related assumptions and potential side effects for creative practices and beyond.


A fundamental derivation of two Boris solvers and the Ge Marsden theorem. For a separable Hamiltonian, there are two fundamental, time symmetric, second order velocity Verlet (VV) and position Verlet (PV) symplectic integrators. Similarly, there are two VV and PV version of exact energy conserving algorithms for solving magnetic field trajectories. For a constant magnetic field, both algorithms can be further modified so that their trajectories are exactly on the gyro circle. The magnetic PV integrator then becomes the well known Boris solver, while VV yields a second, previously unknown, Boris type algorithm. Remarkably, the required on orbit modification is a reparametrization of the time step, reminiscent of the Ge Marsden theorem.


Multi Scale Aligned Distillation for Low Resolution Detection. In instance level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting the performance of low resolution models by distilling knowledge from a high or multi resolution model. We first identify the challenge of applying knowledge distillation (KD) to teacher and student networks that act on different input resolutions. To tackle it, we explore the idea of spatially aligning feature maps between models of varying input resolutions by shifting feature pyramid positions and introduce aligned multi scale training to train a multi scale teacher that can distill its knowledge to a low resolution student. Further, we propose crossing feature level fusion to dynamically fuse teacher's multi resolution features to guide the student better. On several instance level detection tasks and datasets, the low resolution models trained via our approach perform competitively with high resolution models trained via conventional multi scale training, while outperforming the latter's low resolution models by 2.1 to 3.6 in terms of mAP. Our code is made publicly available at https github.com dvlab research MSAD.


Stability of some vector bundles on Hilbert schemes of points on K3 surfaces. Let X be a projective K3 surfaces. In two examples where there exists a fine moduli space M of stable vector bundles on X , isomorphic to a Hilbert scheme of points, we prove that the universal family mathcal E on X times M can be understood as a complete flat family of stable vector bundles on M parametrized by X , which identifies X with a smooth connected component of some moduli space of stable sheaves on M .


Tridiagonal pairs of q Serre type and their linear perturbations. A tridiagonal pair is an ordered pair of diagonalizable linear maps on a nonzero finite dimensional vector space, that each act on the eigenspaces of the other in a block tridiagonal fashion. We consider a tridiagonal pair (A, A ) of q Serre type for such a pair the maps A and A satisfy the q Serre relations. There is a linear map K in the literature that is used to describe how A and A are related. We investigate a pair of linear maps B A and B tA (1 t)K , where t is any scalar. Our goal is to find a necessary and sufficient condition on t for the pair (B, B ) to be a tridiagonal pair. We show that (B, B ) is a tridiagonal pair if and only if t neq 0 and P bigl( t(q q 1 ) 2 bigr) not 0 , where P is a certain polynomial attached to (A, A ) called the Drinfel'd polynomial.


Well resolved velocity fields using discontinuous Galerkin shallow water solutions. Computational models based on the depth averaged shallow water equations (SWE) offer an efficient choice to analyse velocity fields around hydraulic structures. Second order finite volume (FV2) solvers have often been used for this purpose subject to adding an eddy viscosity term at sub meter resolution, but have been shown to fall short of capturing small scale field transients emerging from wave structure interactions. The second order discontinuous Galerkin (DG2) alternative is significantly more resistant to the growth of numerical diffusion and leads to faster convergence rates. These properties make the DG2 solver a promising modelling tool for detailed velocity field predictions. This paper focuses on exploring this DG2 capability with reference to an FV2 counterpart for a selection of test cases that require well resolved velocity field predictions. The findings of this work lead to identifying a particular setting for the DG2 solver that allows for obtaining more accurate and efficient depth averaged velocity fields incorporating small scale transients.


Policy Smoothing for Provably Robust Reinforcement Learning. The study of provable adversarial robustness for deep neural networks (DNNs) has mainly focused on static supervised learning tasks such as image classification. However, DNNs have been used extensively in real world adaptive tasks such as reinforcement learning (RL), making such systems vulnerable to adversarial attacks as well. Prior works in provable robustness in RL seek to certify the behaviour of the victim policy at every time step against a non adaptive adversary using methods developed for the static setting. But in the real world, an RL adversary can infer the defense strategy used by the victim agent by observing the states, actions, etc. from previous time steps and adapt itself to produce stronger attacks in future steps. We present an efficient procedure, designed specifically to defend against an adaptive RL adversary, that can directly certify the total reward without requiring the policy to be robust at each time step. Our main theoretical contribution is to prove an adaptive version of the Neyman Pearson Lemma a key lemma for smoothing based certificates where the adversarial perturbation at a particular time can be a stochastic function of current and previous observations and states as well as previous actions. Building on this result, we propose policy smoothing where the agent adds a Gaussian noise to its observation at each time step before passing it through the policy function. Our robustness certificates guarantee that the final total reward obtained by policy smoothing remains above a certain threshold, even though the actions at intermediate time steps may change under the attack. Our experiments on various environments like Cartpole, Pong, Freeway and Mountain Car show that our method can yield meaningful robustness guarantees in practice.


Difference radical in terms of shifting zero and applications to the Stothers Mason theorem. In this paper, we study the shifting zeros with its heights and an analogue to difference radical. We focus on the Stothers Mason theorem by using falling factorials. As applications, we discuss the difference version of the Fermat type functional equations. Some examples are given.


Visual Odometry with an Event Camera Using Continuous Ray Warping and Volumetric Contrast Maximization. We present a new solution to tracking and mapping with an event camera. The motion of the camera contains both rotation and translation, and the displacements happen in an arbitrarily structured environment. As a result, the image matching may no longer be represented by a low dimensional homographic warping, thus complicating an application of the commonly used Image of Warped Events (IWE). We introduce a new solution to this problem by performing contrast maximization in 3D. The 3D location of the rays cast for each event is smoothly varied as a function of a continuous time motion parametrization, and the optimal parameters are found by maximizing the contrast in a volumetric ray density field. Our method thus performs joint optimization over motion and structure. The practical validity of our approach is supported by an application to AGV motion estimation and 3D reconstruction with a single vehicle mounted event camera. The method approaches the performance obtained with regular cameras, and eventually outperforms in challenging visual conditions.


Deep Marching Tetrahedra a Hybrid Representation for High Resolution 3D Shape Synthesis. We introduce DMTet, a deep 3D conditional generative model that can synthesize high resolution 3D shapes using simple user guides such as coarse voxels. It marries the merits of implicit and explicit 3D representations by leveraging a novel hybrid 3D representation. Compared to the current implicit approaches, which are trained to regress the signed distance values, DMTet directly optimizes for the reconstructed surface, which enables us to synthesize finer geometric details with fewer artifacts. Unlike deep 3D generative models that directly generate explicit representations such as meshes, our model can synthesize shapes with arbitrary topology. The core of DMTet includes a deformable tetrahedral grid that encodes a discretized signed distance function and a differentiable marching tetrahedra layer that converts the implicit signed distance representation to the explicit surface mesh representation. This combination allows joint optimization of the surface geometry and topology as well as generation of the hierarchy of subdivisions using reconstruction and adversarial losses defined explicitly on the surface mesh. Our approach significantly outperforms existing work on conditional shape synthesis from coarse voxel inputs, trained on a dataset of complex 3D animal shapes. Project page https nv tlabs.github.io DMTet .


Automata Linear Dynamic Logic on Finite Traces. Temporal logics are widely used by the Formal Methods and AI communities. Linear Temporal Logic is a popular temporal logic and is valued for its ease of use as well as its balance between expressiveness and complexity. LTL is equivalent in expressiveness to Monadic First Order Logic and satisfiability for LTL is PSPACE complete. Linear Dynamic Logic (LDL), another temporal logic, is equivalent to Monadic Second Order Logic, but its method of satisfiability checking cannot be applied to a nontrivial subset of LDL formulas. Here we introduce Automata Linear Dynamic Logic on Finite Traces (ALDL f) and show that satisfiability for ALDL f formulas is in PSPACE. A variant of Linear Dynamic Logic on Finite Traces (LDL f), ALDL f combines propositional logic with nondeterministic finite automata (NFA) to express temporal constraints. ALDL f is equivalent in expressiveness to Monadic Second Order Logic. This is a gain in expressiveness over LTL at no cost.


Expert driven Trace Clustering with Instance level Constraints. Within the field of process mining, several different trace clustering approaches exist for partitioning traces or process instances into similar groups. Typically, this partitioning is based on certain patterns or similarity between the traces, or driven by the discovery of a process model for each cluster. The main drawback of these techniques, however, is that their solutions are usually hard to evaluate or justify by domain experts. In this paper, we present two constrained trace clustering techniques that are capable to leverage expert knowledge in the form of instance level constraints. In an extensive experimental evaluation using two real life datasets, we show that our novel techniques are indeed capable of producing clustering solutions that are more justifiable without a substantial negative impact on their quality.


Self supervised Monocular Multi robot Relative Localization with Efficient Deep Neural Networks. Relative localization is an important ability for multiple robots to perform cooperative tasks in GPS denied environment. This paper presents a novel autonomous positioning framework for monocular relative localization of multiple tiny flying robots. This approach does not require any groundtruth data from external systems or manual labelling. Instead, the proposed framework is able to label real world images with 3D relative positions between robots based on another onboard relative estimation technology, using ultra wide band (UWB). After training in this self supervised manner, the proposed deep neural network (DNN) can predict relative positions of peer robots by purely using a monocular camera. This deep learning based visual relative localization is scalable, distributed and autonomous. We also built an open source and light weight simulation pipeline by using Blender for 3D rendering, which allows synthetic image generation of other robots, and generalized training of the neural network. The proposed localization framework is tested on two real world Crazyflie2 quadrotors by running the DNN on the onboard AIdeck (a tiny AI chip and monocular camera). All results demonstrate the effectiveness of the self supervised multi robot localization method.


A categorical Connes' chi(M) . Popa introduced the tensor category tilde chi (M) of approximately inner, centrally trivial bimodules of a rm II 1 factor M , generalizing Connes' chi(M) . We extend Popa's notions to define the rm W tensor category operatorname End rm loc ( mathcal C ) of local endofunctors on a rm W category mathcal C . We construct a unitary braiding on operatorname End rm loc ( mathcal C ) , giving a new construction of a braided tensor category associated to an arbitrary rm W category. For the rm W category of finite modules over a rm II 1 factor, this yields a unitary braiding on Popa's tilde chi (M) , which extends Jones' kappa invariant for chi(M) . Given a finite depth inclusion M 0 subseteq M 1 of non Gamma rm II 1 factors, we show that the braided unitary tensor category tilde chi (M infty ) is equivalent to the Drinfeld center of the standard invariant, where M infty is the inductive limit of the associated Jones tower. This implies that for any pair of finite depth non Gamma subfactors N 0 subseteq N 1 and M 0 subseteq M 1 , if the standard invariants are not Morita equivalent, then the inductive limit factors N infty and M infty are not stably isomorphic.


An Exact Method for (Constrained) Assortment Optimization Problems with Product Costs. We study the problem of optimizing assortment decisions in the presence of product specific costs when customers choose according to a multinomial logit model. This problem is NP hard and approximate solutions methods have been proposed in the literature to obtain both primal and dual bounds in a tractable manner. We propose the first exact solution method for this problem and show that provably optimal assortments of instances with up to one thousand products can be found, on average, in about two tenths of a second. In particular, we propose a bounding procedure based on the approximation method of Feldman and Topaloglu (2015a) to provide tight primal and dual bounds at a fraction of their computing times. We show how these bounds can be used to effectively identify an optimal assortment. We also describe how to adapt our approach for handling cardinality constraints on the size of the assortment or space resource capacity constraints.


Exploratory Lagrangian Based Particle Tracing Using Deep Learning. Time varying vector fields produced by computational fluid dynamics simulations are often prohibitively large and pose challenges for accurate interactive analysis and exploration. To address these challenges, reduced Lagrangian representations have been increasingly researched as a means to improve scientific time varying vector field exploration capabilities. This paper presents a novel deep neural network based particle tracing method to explore time varying vector fields represented by Lagrangian flow maps. In our workflow, in situ processing is first utilized to extract Lagrangian flow maps, and deep neural networks then use the extracted data to learn flow field behavior. Using a trained model to predict new particle trajectories offers a fixed small memory footprint and fast inference. To demonstrate and evaluate the proposed method, we perform an in depth study of performance using a well known analytical data set, the Double Gyre. Our study considers two flow map extraction strategies as well as the impact of the number of training samples and integration durations on efficacy, evaluates multiple sampling options for training and testing and informs hyperparameter settings. Overall, we find our method requires a fixed memory footprint of 10.5 MB to encode a Lagrangian representation of a time varying vector field while maintaining accuracy. For post hoc analysis, loading the trained model costs only two seconds, significantly reducing the burden of I O when reading data for visualization. Moreover, our parallel implementation can infer one hundred locations for each of two thousand new pathlines across the entire temporal resolution in 1.3 seconds using one NVIDIA Titan RTX GPU.


StyleAugment Learning Texture De biased Representations by Style Augmentation without Pre defined Textures. Recent powerful vision classifiers are biased towards textures, while shape information is overlooked by the models. A simple attempt by augmenting training images using the artistic style transfer method, called Stylized ImageNet, can reduce the texture bias. However, Stylized ImageNet approach has two drawbacks in fidelity and diversity. First, the generated images show low image quality due to the significant semantic gap betweeen natural images and artistic paintings. Also, Stylized ImageNet training samples are pre computed before training, resulting in showing the lack of diversity for each sample. We propose a StyleAugment by augmenting styles from the mini batch. StyleAugment does not rely on the pre defined style references, but generates augmented images on the fly by natural images in the mini batch for the references. Hence, StyleAugment let the model observe abundant confounding cues for each image by on the fly the augmentation strategy, while the augmented images are more realistic than artistic style transferred images. We validate the effectiveness of StyleAugment in the ImageNet dataset with robustness benchmarks, such as texture de biased accuracy, corruption robustness, natural adversarial samples, and occlusion robustness. StyleAugment shows better generalization performances than previous unsupervised de biasing methods and state of the art data augmentation methods in our experiments.


Spoof Surface Waves on Non Conducting Structured Interfaces. Spoof surface waves are demonstrated theoretically to propagate along periodic corrugated surfaces made of non conductive lossless materials with positive permittivity. An analytic derivation of the Spoof surface wave dispersion relation is presented in the case of deeply subwavelength period of a corrugated structure using impedance boundary conditions at the interfaces. Thus obtained dispersion relation is verified numerically and limitations as well as physicality of impedance boundary conditions when modeling Spoof surface waves are discussed. Finally, suitable materials, potential experimental realization, and sensing applications of Spoof surface waves in the terahertz spectral range are discussed.


Gorenstein homogeneous subrings of graphs. Let G (V,E) be a connected simple graph, with n vertices such that S is its homogeneous monomial subring. We prove that if S is normal and Gorenstein, then G is unmixed with cover number lceil frac n 2 rceil and G has a strong lceil frac n 2 rceil tau reduction. Furthermore, if n is even, then we show that G is bipartite. Finally, if S is normal and G is unmixed whose cover number is lceil frac n 2 rceil , we give sufficient conditions for S to be Gorenstein.


Wild Randomness, and the application of Hyperbolic Diffusion in Financial Modelling. The application of the Cauchy distribution has often been discussed as a potential model of the financial markets. In particular the way in which single extreme, or "Black Swan", events can impact long term historical moments, is often cited. In this article we show how one can construct Martingale processes, which have marginal distributions that tend to the Cauchy distribution in the large volatility limit. This provides financial justification to approaches discussed by other authors, and highlights an example of how quantum probability can be used to construct non Gaussian Martingales. We go on to illustrate links with hyperbolic diffusion, and discuss the insight this provides.


Surveying Wonderland for many more literature visualization techniques. There are still many potential literature visualizations to be discovered. By focusing on a single text, the author surveys many existing visualizations across research domains, in the wild, and creates new visualizations. 58 techniques are indicated, suggesting a wider variety of visualizations beyond research disciplines.


Is the empirical out of sample variance an informative risk measure for the high dimensional portfolios?. The main contribution of this paper is the derivation of the asymptotic behaviour of the out of sample variance, the out of sample relative loss, and of their empirical counterparts in the high dimensional setting, i.e., when both ratios p n and p m tend to some positive constants as m to infty and n to infty , where p is the portfolio dimension, while n and m are the sample sizes from the in sample and out of sample periods, respectively. The results are obtained for the traditional estimator of the global minimum variance (GMV) portfolio, for the two shrinkage estimators introduced by cite frahm2010 and cite bodnar2018estimation , and for the equally weighted portfolio, which is used as a target portfolio in the specification of the two considered shrinkage estimators. We show that the behaviour of the empirical out of sample variance may be misleading is many practical situations. On the other hand, this will never happen with the empirical out of sample relative loss, which seems to provide a natural normalization of the out of sample variance in the high dimensional setup. As a result, an important question arises if this risk measure can safely be used in practice for portfolios constructed from a large asset universe.


LIFE Learning Individual Features for Multivariate Time Series Prediction with Missing Values. Multivariate time series (MTS) prediction is ubiquitous in real world fields, but MTS data often contains missing values. In recent years, there has been an increasing interest in using end to end models to handle MTS with missing values. To generate features for prediction, existing methods either merge all input dimensions of MTS or tackle each input dimension independently. However, both approaches are hard to perform well because the former usually produce many unreliable features and the latter lacks correlated information. In this paper, we propose a Learning Individual Features (LIFE) framework, which provides a new paradigm for MTS prediction with missing values. LIFE generates reliable features for prediction by using the correlated dimensions as auxiliary information and suppressing the interference from uncorrelated dimensions with missing values. Experiments on three real world data sets verify the superiority of LIFE to existing state of the art models.


Sandwich Batch Normalization A Drop In Replacement for Feature Distribution Heterogeneity. We present Sandwich Batch Normalization (SaBN), a frustratingly easy improvement of Batch Normalization (BN) with only a few lines of code changes. SaBN is motivated by addressing the inherent feature distribution heterogeneity that one can be identified in many tasks, which can arise from data heterogeneity (multiple input domains) or model heterogeneity (dynamic architectures, model conditioning, etc.). Our SaBN factorizes the BN affine layer into one shared sandwich affine layer, cascaded by several parallel independent affine layers. Concrete analysis reveals that, during optimization, SaBN promotes balanced gradient norms while still preserving diverse gradient directions a property that many application tasks seem to favor. We demonstrate the prevailing effectiveness of SaBN as a drop in replacement in four tasks conditional image generation, neural architecture search (NAS), adversarial training, and arbitrary style transfer. Leveraging SaBN immediately achieves better Inception Score and FID on CIFAR 10 and ImageNet conditional image generation with three state of the art GANs boosts the performance of a state of the art weight sharing NAS algorithm significantly on NAS Bench 201 substantially improves the robust and standard accuracies for adversarial defense and produces superior arbitrary stylized results. We also provide visualizations and analysis to help understand why SaBN works. Codes are available at https github.com VITA Group Sandwich Batch Normalization.


Widom factors for generalized Jacobi measures. We study optimal lower and upper bounds for Widom factors W infty,n (K,w) associated with Chebyshev polynomials for the weights w(x) sqrt 1 x and w(x) sqrt 1 x on compact subsets of 1,1 . We show which sets saturate these bounds. We consider Widom factors W 2,n ( mu) for L 2( mu) extremal polynomials for measures of the form d mu(x) (1 x) alpha (1 x) beta d mu K(x) where alpha beta geq 1 , alpha, beta in mathbb N cup 0 and mu K is the equilibrium measure of a compact regular set K in 1,1 with pm 1 in K . We show that for such measures the improved lower bound W 2,n ( mu) 2 geq 2S( mu) holds. For the special cases d mu(x) (1 x 2)d mu K(x) , d mu(x) (1 x)d mu K(x) , d mu(x) (1 x)d mu K(x) we determine which sets saturate this lower bound and discuss how saturated lower bounds for W 2,n ( mu) 2 and W infty,n (K,w) are related.


Effective user intent mining with unsupervised word representation models and topic modelling. Understanding the intent behind chat between customers and customer service agents has become a crucial problem nowadays due to an exponential increase in the use of the Internet by people from different cultures and educational backgrounds. More importantly, the explosion of e commerce has led to a significant increase in text conversation between customers and agents. In this paper, we propose an approach to data mining the conversation intents behind the textual data. Using the customer service data set, we train unsupervised text representation models, and then develop an intent mapping model which would rank the predefined intents base on cosine similarity between sentences and intents. Topic modeling techniques are used to define intents and domain experts are also involved to interpret topic modelling results. With this approach, we can get a good understanding of the user intentions behind the unlabelled customer service textual data.


AdeNet Deep learning architecture that identifies damaged electrical insulators in power lines. Ceramic insulators are important to electronic systems, designed and installed to protect humans from the danger of high voltage electric current. However, insulators are not immortal, and natural deterioration can gradually damage them. Therefore, the condition of insulators must be continually monitored, which is normally done using UAVs. UAVs collect many images of insulators, and these images are then analyzed to identify those that are damaged. Here we describe AdeNet as a deep neural network designed to identify damaged insulators, and test multiple approaches to automatic analysis of the condition of insulators. Several deep neural networks were tested, as were shallow learning methods. The best results (88.8 ) were achieved using AdeNet without transfer learning. AdeNet also reduced the false negative rate to sim 7 . While the method cannot fully replace human inspection, its high throughput can reduce the amount of labor required to monitor lines for damaged insulators and provide early warning to replace damaged insulators.


Assessing the Benefits of Model Ensembles in Neural Re Ranking for Passage Retrieval. Our work aimed at experimentally assessing the benefits of model ensembling within the context of neural methods for passage reranking. Starting from relatively standard neural models, we use a previous technique named Fast Geometric Ensembling to generate multiple model instances from particular training schedules, then focusing or attention on different types of approaches for combining the results from the multiple model instances (e.g., averaging the ranking scores, using fusion methods from the IR literature, or using supervised learning to rank). Tests with the MS MARCO dataset show that model ensembling can indeed benefit the ranking quality, particularly with supervised learning to rank although also with unsupervised rank aggregation.


Feature Driven Survey of Physical Protection Systems. Many systems nowadays require protection against security or safety threats. A physical protection system (PPS) integrates people, procedures, and equipment to protect assets or facilities. PPSs have targeted various systems, including airports, rail transport, highways, hospitals, bridges, the electricity grid, dams, power plants, seaports, oil refineries, and water systems. Hence, PPSs are characterized by a broad set of features, from which part is common, while other features are variant and depend on the particular system to be developed. The notion of PPS has been broadly addressed in the literature, and even domain specific PPS development methods have been proposed. However, the common and variant features are fragmented across many studies. This situation seriously impedes the identification of the required features and likewise the guidance of the systems engineering process of PPSs. To enhance the understanding and support the guidance of the development of PPS, in this paper, we provide a feature driven survey of PPSs. The approach applies a systematic domain analysis process based on the state of the art of PPSs. It presents a family feature model that defines the common and variant features and herewith the configuration space of PPSs


The CSO Classifier Ontology Driven Detection of Research Topics in Scholarly Articles. Classifying research papers according to their research topics is an important task to improve their retrievability, assist the creation of smart analytics, and support a variety of approaches for analysing and making sense of the research environment. In this paper, we present the CSO Classifier, a new unsupervised approach for automatically classifying research papers according to the Computer Science Ontology (CSO), a comprehensive ontology of re search areas in the field of Computer Science. The CSO Classifier takes as input the metadata associated with a research paper (title, abstract, keywords) and returns a selection of research concepts drawn from the ontology. The approach was evaluated on a gold standard of manually annotated articles yielding a significant improvement over alternative methods.


Unconditional bound preserving and energy dissipating finite volume schemes for the Cahn Hilliard equation. We propose finite volume schemes for the Cahn Hilliard equation that unconditionally and discretely satisfy the boundedness of the phase field and the free energy dissipation. Our numerical framework is applicable to a variety of free energy potentials including the Ginzburg Landau and Flory Huggins, general wetting boundary conditions and degenerate mobilities. Its central thrust is the finite volume upwind methodology, which we combine with a semi implicit formulation based on the classical convex splitting approach for the free energy terms. Extension to an arbitrary number of dimensions is straightforward thanks to their cost saving dimensional splitting nature, which allows to efficiently solve higher dimensional simulations with a simple parallelization. The numerical schemes are validated and tested in a variety of prototypical configurations with different numbers of dimensions and a rich variety of contact angles between droplets and substrates.


Search for Invariant Sets of the Generalized Tent Map. This paper describes a predictive control method to search for unstable periodic orbits of the generalized tent map. The invariant set containing periodic orbits is a repelling set with a complicated Cantor like structure. Therefore, a simple local stabilization of the orbit may not be enough to find a periodic orbit, due to the small measure of the basin of attraction. It is shown that for certain values of the control parameter, both the local behavior and the global behavior of solutions change in the controlled system in particular, the invariant set enlarges to become an interval or the entire real axis. The computational particularities of using the control system are considered, and necessary conditions for the orbit to be periodic are given. The question of local asymptotic stability of subcycles of the controlled system's stable cycles is fully investigated, and some statistical properties of the subset of the classical Cantor middle thirds set that is determined by the periodic points of the generalized tent map are described.


Resolving the temporal dynamics of mode locked laser with single shot time microscope. Mode locked lasers, which produce ultrashort pulses in the picosecond and femtosecond range, have enabled some of the most precise measurements. However, despite significant recent progress, resolving the temporal behavior of their short pulses is still a challenge. State of the art oscilloscopes with tens of picosecond resolution prevent time resolved observations in mode locked lasers and limit the real time pulse evolution tracking of ultrafast lasers. Here, using the time lens technique with a Raman amplifier, we implement an ultrafast single shot time microscope (TM) with a high temporal magnification factor of 355 and a time measurement window of 1 millisecond that contains 1.8 10 4 consecutive pulses. We use this TM to characterize the temporal evolution of mode locked lasers and reveal a temporal sideway oscillation (winding) behavior, a previously unobserved feature of lasers in both theory and experiment. Our experimental observations confirm that the winding behavior is an essential feature in the operation of mode locked lasers. We theoretically and experimentally found that the winding characteristic evolution originates from gain induced fluctuations for relatively high gain energies, while Q switched modulations being the main cause for lower energies. Our findings based on advanced real time measurements open up new insights into ultrafast and transient optics and may impact future laser designs, modern ultrafast diagnostics, and influence progress in nonlinear optics in general.


Combining Recurrent, Convolutional, and Continuous time Models with Linear State Space Layers. Recurrent neural networks (RNNs), temporal convolutions, and neural differential equations (NDEs) are popular families of deep learning models for time series data, each with unique strengths and tradeoffs in modeling power and computational efficiency. We introduce a simple sequence model inspired by control systems that generalizes these approaches while addressing their shortcomings. The Linear State Space Layer (LSSL) maps a sequence u mapsto y by simply simulating a linear continuous time state space representation dot x Ax Bu, y Cx Du . Theoretically, we show that LSSL models are closely related to the three aforementioned families of models and inherit their strengths. For example, they generalize convolutions to continuous time, explain common RNN heuristics, and share features of NDEs such as time scale adaptation. We then incorporate and generalize recent theory on continuous time memorization to introduce a trainable subset of structured matrices A that endow LSSLs with long range memory. Empirically, stacking LSSL layers into a simple deep neural network obtains state of the art results across time series benchmarks for long dependencies in sequential image classification, real world healthcare regression tasks, and speech. On a difficult speech classification task with length 16000 sequences, LSSL outperforms prior approaches by 24 accuracy points, and even outperforms baselines that use hand crafted features on 100x shorter sequences.


Rank growth of elliptic curves over N th root extensions. Fix an elliptic curve E over a number field F and an integer n which is a power of 3 . We study the growth of the Mordell Weil rank of E after base change to the fields K d F( sqrt 2n d ) . If E admits a 3 isogeny, we show that the average "new rank" of E over K d , appropriately defined, is bounded as the height of d goes to infinity. When n 3 , we moreover show that for many elliptic curves E mathbb Q , there are no new points on E over mathbb Q ( sqrt 6 d) , for a positive proportion of integers d . This is a horizontal analogue of a well known result of Cornut and Vatsal. The proof combines our recent work on ranks of abelian varieties in cyclotomic twist families with a technique we call the "correlation trick", which applies in a more general context where one is trying to show simultaneous vanishing of multiple Selmer groups. We also apply this technique to families of twists of Prym surfaces. As a corollary, we give bounds on the number of rational points in sextic twist families of bielliptic genus 3 curves.


Interpretable Multiple Treatment Revenue Uplift Modeling. Big data and business analytics are critical drivers of business and societal transformations. Uplift models support a firm's decision making by predicting the change of a customer's behavior due to a treatment. Prior work examines models for single treatments and binary customer responses. The paper extends corresponding approaches by developing uplift models for multiple treatments and continuous outcomes. This facilitates selecting an optimal treatment from a set of alternatives and estimating treatment effects in the form of business outcomes of continuous scale. Another contribution emerges from an evaluation of an uplift model's interpretability, whereas prior studies focus almost exclusively on predictive performance. To achieve these goals, the paper develops revenue uplift models for multiple treatments based on a recently introduced algorithm for causal machine learning, the causal forest. Empirical experimentation using two real world marketing data sets demonstrates the advantages of the proposed modeling approach over benchmarks and standard marketing practices.


Classification of K type formulas for the Heisenberg ultrahyperbolic operator square s for widetilde SL (3, mathbb R ) and tridiagonal determinants for local Heun functions. The K type formulas of the space of K finite solutions to the Heisenberg ultrahyperbolic equation square sf 0 for the non linear group widetilde SL (3, mathbb R ) are classified. This completes a previous study of Kable for the linear group SL(m, mathbb R ) in the case of m 3 , as well as generalizes our earlier results on a certain second order differential operator. As a by product we also show several properties of certain sequences P j(x y) j 0 infty and Q j(x y) j 0 infty of tridiagonal determinants, whose generating functions are given by local Heun functions. In particular, it is shown that these sequences satisfy a certain arithmetic combinatorial property, which we refer to as a palindromic property. We further show that classical sequences of Cayley continuants mathrm Cay j(x y) j 0 infty and Krawtchouk polynomials mathcal K j(x y) j 0 infty also admit this property. In the end a new proof of Sylvester's formula for certain tridiagonal determinant mathrm Sylv (x n) is provided from a representation theory point of view.


An Information Theoretic Perspective on Successive Cancellation List Decoding and Polar Code Design. This work identifies information theoretic quantities that are closely related to the required list size on average for successive cancellation list (SCL) decoding to implement maximum likelihood decoding over general binary memoryless symmetric (BMS) channels. It also provides upper and lower bounds for these quantities that can be computed efficiently for very long codes. For the binary erasure channel (BEC), we provide a simple method to estimate the mean accurately via density evolution. The analysis shows how to modify, e.g., Reed Muller codes, to improve the performance when practical list sizes, e.g., L in 8, 1024 , are adopted. Exemplary constructions with block lengths N in 128,512 outperform polar codes of 5G over the binary input additive white Gaussian noise channel. It is further shown that there is a concentration around the mean of the logarithm of the required list size for sufficiently large block lengths, over discrete output BMS channels. We provide the probability mass functions (p.m.f.s) of this logarithm, over the BEC, for a sequence of the modified RM codes with an increasing block length via simulations, which illustrate that the p.m.f.s concentrate around the estimated mean.


Personalized Education in the AI Era What to Expect Next?. The objective of personalized learning is to design an effective knowledge acquisition track that matches the learner's strengths and bypasses her weaknesses to ultimately meet her desired goal. This concept emerged several years ago and is being adopted by a rapidly growing number of educational institutions around the globe. In recent years, the boost of artificial intelligence (AI) and machine learning (ML), together with the advances in big data analysis, has unfolded novel perspectives to enhance personalized education in numerous dimensions. By taking advantage of AI ML methods, the educational platform precisely acquires the student's characteristics. This is done, in part, by observing the past experiences as well as analyzing the available big data through exploring the learners' features and similarities. It can, for example, recommend the most appropriate content among numerous accessible ones, advise a well designed long term curriculum, connect appropriate learners by suggestion, accurate performance evaluation, and the like. Still, several aspects of AI based personalized education remain unexplored. These include, among others, compensating for the adverse effects of the absence of peers, creating and maintaining motivations for learning, increasing diversity, removing the biases induced by the data and algorithms, and the like. In this paper, while providing a brief review of state of the art research, we investigate the challenges of AI ML based personalized education and discuss potential solutions.


Academic Source Code Plagiarism Detection by Measuring Program Behavioural Similarity. Source code plagiarism is a long standing issue in tertiary computer science education. Many source code plagiarism detection tools have been proposed to aid in the detection of source code plagiarism. However, existing detection tools are not robust to pervasive plagiarism hiding transformations, and as a result can be inaccurate in the detection of plagiarised source code. This article presents BPlag, a behavioural approach to source code plagiarism detection. BPlag is designed to be both robust to pervasive plagiarism hiding transformations, and accurate in the detection of plagiarised source code. Greater robustness and accuracy is afforded by analysing the behaviour of a program, as behaviour is perceived to be the least susceptible aspect of a program impacted upon by plagiarism hiding transformations. BPlag applies symbolic execution to analyse execution behaviour and represent a program in a novel graph based format. Plagiarism is then detected by comparing these graphs and evaluating similarity scores. BPlag is evaluated for robustness, accuracy and efficiency against 5 commonly used source code plagiarism detection tools. It is then shown that BPlag is more robust to plagiarism hiding transformations and more accurate in the detection of plagiarised source code, but is less efficient than compared tools.


Design Study of APSU Type Hybrid MBA Lattice for Mid Energy DLSR. In recent years, a new generation of storage ring based light sources, known as diffraction limited storage rings (DLSRs), whose emittance approaches the diffraction limit for the range of X ray wavelengths of interest to the scientific community, has garnered significant attention worldwide. Researchers have begun to design and build DLSRs. Among various DLSR proposals, the hybrid multibend achromat (HMBA) lattice enables sextupole strengths to be maintained at a reasonable level when minimizing the emittance hence, it has been adopted in many DLSR designs. Based on the H7BA lattice, the design of the Advanced Photon Source Upgrade Project (APSU) can effectively reduce emittance by replacing six quadrupoles with antibends. Herein, we discuss the feasibility of designing an APSU type HMBA lattice for the Southern Advanced Photon Source, a mid energy DLSR light source with ultralow emittance that has been proposed to be built adjacent to the China Spallation Neutron Source. Both linear and nonlinear dynamics are optimized to obtain a detailed design of this type of lattice. The emittance is minimized, while a sufficiently large dynamic aperture (DA) and momentum acceptance (MA) are maintained. A design comprising 36 APSU type H7BAs, with an energy of 3 GeV and a circumference of 972 m, is achieved. The horizontal natural emittance is 20 pm rad, with a horizontal DA of 5.8 mm, a vertical DA of 4.5 mm, and an MA of 4 , as well as a long longitudinal damping time of 120 ms. Subsequently, a few modifications are performed based on the APSU type lattice to reduce the longitudinal damping time from 120 to 44 ms while maintaining other performance parameters at the same level.


On the number of zeros of diagonal quartic forms over finite fields. Let mathbb F q be the finite field of q p m equiv 1 pmod 4 elements with p being an odd prime and m being a positive integer. For c, y in mathbb F q with y in mathbb F q non quartic, let N n(c) and M n(y) be the numbers of zeros of x 1 4 ... x n 4 c and x 1 4 ... x n 1 4 yx n 4 0 , respectively. In 1979, Myerson used Gauss sum and exponential sum to show that the generating function sum n 1 infty N n(0)x n is a rational function in x and presented its explicit expression. In this paper, we make use of the cyclotomic theory and exponential sums to show that the generating functions sum n 1 infty N n(c)x n and sum n 1 infty M n 1 (y)x n are rational functions in x . We also obtain the explicit expressions of these generating functions. Our result extends Myerson's theorem gotten in 1979.


Performance Testing Using a Smart Reinforcement Learning Driven Test Agent. Performance testing with the aim of generating an efficient and effective workload to identify performance issues is challenging. Many of the automated approaches mainly rely on analyzing system models, source code, or extracting the usage pattern of the system during the execution. However, such information and artifacts are not always available. Moreover, all the transactions within a generated workload do not impact the performance of the system the same way, a finely tuned workload could accomplish the test objective in an efficient way. Model free reinforcement learning is widely used for finding the optimal behavior to accomplish an objective in many decision making problems without relying on a model of the system. This paper proposes that if the optimal policy (way) for generating test workload to meet a test objective can be learned by a test agent, then efficient test automation would be possible without relying on system models or source code. We present a self adaptive reinforcement learning driven load testing agent, RELOAD, that learns the optimal policy for test workload generation and generates an effective workload efficiently to meet the test objective. Once the agent learns the optimal policy, it can reuse the learned policy in subsequent testing activities. Our experiments show that the proposed intelligent load test agent can accomplish the test objective with lower test cost compared to common load testing procedures, and results in higher test efficiency.


Characterizing the Communication Requirements of GNN Accelerators A Model Based Approach. Relational data present in real world graph representations demands for tools capable to study it accurately. In this regard Graph Neural Network (GNN) is a powerful tool, wherein various models for it have also been developed over the past decade. Recently, there has been a significant push towards creating accelerators that speed up the inference and training process of GNNs. These accelerators, however, do not delve into the impact of their dataflows on the overall data movement and, hence, on the communication requirements. In this paper, we formulate analytical models that capture the amount of data movement in the most recent GNN accelerator frameworks. Specifically, the proposed models capture the dataflows and hardware setup of these accelerator designs and expose their scalability characteristics for a set of hardware, GNN model and input graph parameters. Additionally, the proposed approach provides means for the comparative analysis of the vastly different GNN accelerators.


Methodology centered review of molecular modeling, simulation, and prediction of SARS CoV 2. The deadly coronavirus disease 2019 (COVID 19) pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS CoV 2) has gone out of control globally. Despite much effort by scientists, medical experts, and society in general, the slow progress on drug discovery and antibody therapeutic development, the unknown possible side effects of the existing vaccines, and the high transmission rate of the SARS CoV 2, remind us of the sad reality that our current understanding of the transmission, infectivity, and evolution of SARS CoV 2 is unfortunately very limited. The major limitation is the lack of mechanistic understanding of viral host cell interactions, the viral regulation, protein protein interactions, including antibody antigen binding, protein drug binding, host immune response, etc. This limitation will likely haunt the scientific community for a long time and have a devastating consequence in combating COVID 19 and other pathogens. Notably, compared to the long cycle, highly cost, and safety demanding molecular level experiments, the theoretical and computational studies are economical, speedy, and easy to perform. There exists a tsunami of the literature on molecular modeling, simulation, and prediction of SARS CoV 2 that has become impossible to fully be covered in a review. To provide the reader a quick update about the status of molecular modeling, simulation, and prediction of SARS CoV 2, we present a comprehensive and systematic methodology centered narrative in the nick of time. Aspects such as molecular modeling, Monte Carlo (MC) methods, structural bioinformatics, machine learning, deep learning, and mathematical approaches are included in this review. This review will be beneficial to researchers who are looking for ways to contribute to SARS CoV 2 studies and those who are assessing the current status in the field.


NPE An FPGA based Overlay Processor for Natural Language Processing. In recent years, transformer based models have shown state of the art results for Natural Language Processing (NLP). In particular, the introduction of the BERT language model brought with it breakthroughs in tasks such as question answering and natural language inference, advancing applications that allow humans to interact naturally with embedded devices. FPGA based overlay processors have been shown as effective solutions for edge image and video processing applications, which mostly rely on low precision linear matrix operations. In contrast, transformer based NLP techniques employ a variety of higher precision nonlinear operations with significantly higher frequency. We present NPE, an FPGA based overlay processor that can efficiently execute a variety of NLP models. NPE offers software like programmability to the end user and, unlike FPGA designs that implement specialized accelerators for each nonlinear function, can be upgraded for future NLP models without requiring reconfiguration. We demonstrate that NPE can meet real time conversational AI latency targets for the BERT language model with 4 times lower power than CPUs and 6 times lower power than GPUs. We also show NPE uses 3 times fewer FPGA resources relative to comparable BERT network specific accelerators in the literature. NPE provides a cost effective and power efficient FPGA based solution for Natural Language Processing at the edge.


Learnable Triangulation for Deep Learning based 3D Reconstruction of Objects of Arbitrary Topology from Single RGB Images. We propose a novel deep reinforcement learning based approach for 3D object reconstruction from monocular images. Prior works that use mesh representations are template based. Thus, they are limited to the reconstruction of objects that have the same topology as the template. Methods that use volumetric grids as intermediate representations are computationally expensive, which limits their application in real time scenarios. In this paper, we propose a novel end to end method that reconstructs 3D objects of arbitrary topology from a monocular image. It is composed of of (1) a Vertex Generation Network (VGN), which predicts the initial 3D locations of the object's vertices from an input RGB image, (2) a differentiable triangulation layer, which learns in a non supervised manner, using a novel reinforcement learning algorithm, the best triangulation of the object's vertices, and finally, (3) a hierarchical mesh refinement network that uses graph convolutions to refine the initial mesh. Our key contribution is the learnable triangulation process, which recovers in an unsupervised manner the topology of the input shape. Our experiments on ShapeNet and Pix3D benchmarks show that the proposed method outperforms the state of the art in terms of visual quality, reconstruction accuracy, and computational time.


Facial Expressions Recognition with Convolutional Neural Networks. Over the centuries, humans have developed and acquired a number of ways to communicate. But hardly any of them can be as natural and instinctive as facial expressions. On the other hand, neural networks have taken the world by storm. And no surprises, that the area of Computer Vision and the problem of facial expressions recognitions hasn't remained untouched. Although a wide range of techniques have been applied, achieving extremely high accuracies and preparing highly robust FER systems still remains a challenge due to heterogeneous details in human faces. In this paper, we will be deep diving into implementing a system for recognition of facial expressions (FER) by leveraging neural networks, and more specifically, Convolutional Neural Networks (CNNs). We adopt the fundamental concepts of deep learning and computer vision with various architectures, fine tune it's hyperparameters and experiment with various optimization methods and demonstrate a state of the art single network accuracy of 70.10 on the FER2013 dataset without using any additional training data.


Equifocal submanifolds with non flat section and topological Tits buildings. From the Lytchak's result for polar foliations on an irreducible simply connected symmetric space G K of compact type and rank greater than one, we can derive that there exists no equifocal submanifold with non flat section whose codimension is greater than two in the symmetric space G K . In the first half part of this paper, we give a new proof of this non existence theorem. The recipi of our new proof is as follows. Suppose that there exists an equifocal submanifold M with non flat section whose codimension is greater than two in an irreducible symmertric space G K of compact type and rank greater than one. We introduce the notion of a slice topology of G K associated to M . We consider the universal covering pi widehat G K to G K of the slice topological space G K and give widehat G K the manifold structure and the Riemannian metric such that pi is a Riemannian submersion onto the symmetric space G K . First we show that a simplicial decomposition of the Riemannian manifold widehat G K gives an irreducible topological Tits building of spherical type and rank greater than two. By applying Burns Spatzier's theorem to this topological Tits building, we show that the Riemannian manifold widehat G K is homothetic to the unit sphere. Furthermore, from this fact, we show that G K is isometric to a sphere, a complex projective space or a quaternionic projective space. This contradicts that G K is of rank greater than one. This is the recipi of our proof. In the second half part, we estimate the codimension of M from above by using the multiplicities of the roots of the root system of G K . As its result, we can show that there exists no equifocal submanifold with non flat section in some irreducible simply connected symmetric spaces of compact type.


Classifying Component Function in Product Assemblies with Graph Neural Networks. Function is defined as the ensemble of tasks that enable the product to complete the designed purpose. Functional tools, such as functional modeling, offer decision guidance in the early phase of product design, where explicit design decisions are yet to be made. Function based design data is often sparse and grounded in individual interpretation. As such, function based design tools can benefit from automatic function classification to increase data fidelity and provide function representation models that enable function based intelligent design agents. Function based design data is commonly stored in manually generated design repositories. These design repositories are a collection of expert knowledge and interpretations of function in product design bounded by function flow and component taxonomies. In this work, we represent a structured taxonomy based design repository as assembly flow graphs, then leverage a graph neural network (GNN) model to perform automatic function classification. We support automated function classification by learning from repository data to establish the ground truth of component function assignment. Experimental results show that our GNN model achieves a micro average F 1 score of 0.832 for tier 1 (broad), 0.756 for tier 2, and 0.783 for tier 3 (specific) functions. Given the imbalance of data features, the results are encouraging. Our efforts in this paper can be a starting point for more sophisticated applications in knowledge based CAD systems and Design for X consideration in function based design.


TinyDefectNet Highly Compact Deep Neural Network Architecture for High Throughput Manufacturing Visual Quality Inspection. A critical aspect in the manufacturing process is the visual quality inspection of manufactured components for defects and flaws. Human only visual inspection can be very time consuming and laborious, and is a significant bottleneck especially for high throughput manufacturing scenarios. Given significant advances in the field of deep learning, automated visual quality inspection can lead to highly efficient and reliable detection of defects and flaws during the manufacturing process. However, deep learning driven visual inspection methods often necessitate significant computational resources, thus limiting throughput and act as a bottleneck to widespread adoption for enabling smart factories. In this study, we investigated the utilization of a machine driven design exploration approach to create TinyDefectNet, a highly compact deep convolutional network architecture tailored for high throughput manufacturing visual quality inspection. TinyDefectNet comprises of just 427K parameters and has a computational complexity of 97M FLOPs, yet achieving a detection accuracy of a state of the art architecture for the task of surface defect detection on the NEU defect benchmark dataset. As such, TinyDefectNet can achieve the same level of detection performance at 52 times lower architectural complexity and 11x lower computational complexity. Furthermore, TinyDefectNet was deployed on an AMD EPYC 7R32, and achieved 7.6x faster throughput using the native Tensorflow environment and 9x faster throughput using AMD ZenDNN accelerator library. Finally, explainability driven performance validation strategy was conducted to ensure correct decision making behaviour was exhibited by TinyDefectNet to improve trust in its usage by operators and inspectors.


Evolutionary instability of selfish learning in repeated games. Across many domains of interaction, both natural and artificial, individuals use their past experiences to shape their future behaviors. The result of such learning processes depends on what individuals wish to maximize. A natural objective is one's own success, and indeed this kind of "selfish" learning has become a standard paradigm to model adaptation processes. However, when two selfish learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of interest. Here, we explore the dynamics that arises when learning rules themselves are subject to evolutionary pressure. By combining extensive simulations and analytical techniques, we demonstrate that selfish learning is unstable in most classical two player games. Instead, if evolution operates on the level of long run payoffs, selection favors learning rules that incorporate other regarding preferences. To further corroborate these results, we analyze data from a repeated prisoner's dilemma experiment. We find that selfish learning is insufficient to explain human behavior when there is a trade off between payoff maximization and fairness. Our results have important implications on evolutionary game theory, behavioral economics, and multi agent learning.


Classification of diffraction patterns using a convolutional neural network in single particle imaging experiments performed at X ray free electron lasers. Single particle imaging (SPI) at X ray free electron lasers (XFELs) is particularly well suited to determine the 3D structure of particles in their native environment. For a successful reconstruction, diffraction patterns originating from a single hit must be isolated from a large number of acquired patterns. We propose to formulate this task as an image classification problem and solve it using convolutional neural network (CNN) architectures. Two CNN configurations are developed one that maximises the F1 score and one that emphasises high recall. We also combine the CNNs with expectation maximization (EM) selection as well as size filtering. We observed that our CNN selections have lower contrast in power spectral density functions relative to the EM selection, used in our previous work. However, the reconstruction of our CNN based selections gives similar results. Introducing CNNs into SPI experiments allows streamlining the reconstruction pipeline, enables researchers to classify patterns on the fly, and, as a consequence, enables them to tightly control the duration of their experiments. We think that bringing non standard artificial intelligence (AI) based solutions in a well described SPI analysis workflow may be beneficial for the future development of the SPI experiments.


Evaluating Presidential Support in the Brazilian House of Representatives Through a Network Based Approach. Conflicts between the executive and legislative powers are a common, and even expected, characteristic of presidential systems, with some governments being more successful in the activity of obtaining support from the Congress than others. In the case of Brazil, specifically, this factor is considered crucial in the so called "coalition governments", with direct positive or negative consequences for the president, in terms of government performance during his (her) term. In this work, we investigate this problem by testing and comparing two different methods for evaluating the government support in the Brazilian House of Representatives. The first method is a more traditional one, being based on roll call voting data, and measures the presidential support at the legislators level. The second method uses a network based approach, and performs the same type of analysis but at the parties level. The obtained results, when applying both methods on legislative data comprising the period from 1998 until 2019, indicate that both methods are valid, with common features being found not only between the results provided by the two of them, but also when comparing their results with those obtained by previous and relevant studies in this field, by using the same type of data but different methodologies.


A Reinforcement Learning Environment for Mathematical Reasoning via Program Synthesis. We convert the DeepMind Mathematics Dataset into a reinforcement learning environment by interpreting it as a program synthesis problem. Each action taken in the environment adds an operator or an input into a discrete compute graph. Graphs which compute correct answers yield positive reward, enabling the optimization of a policy to construct compute graphs conditioned on problem statements. Baseline models are trained using Double DQN on various subsets of problem types, demonstrating the capability to learn to correctly construct graphs despite the challenges of combinatorial explosion and noisy rewards.


QGTC Accelerating Quantized Graph Neural Networks via GPU Tensor Core. Over the most recent years, quantized graph neural network (QGNN) attracts lots of research and industry attention due to its high robustness and low computation and memory overhead. Unfortunately, the performance gains of QGNN have never been realized on modern GPU platforms. To this end, we propose the first Tensor Core (TC) based computing framework, QGTC, to support any bitwidth computation for QGNNs on GPUs. We introduce a novel quantized low bit arithmetic design based on the low bit data representation and bit decomposed computation. We craft a novel TC tailored CUDA kernel design by incorporating 3D stacked bit compression, zero tile jumping, and non zero tile reuse technique to improve the performance systematically. We incorporate an effective bandwidth optimized subgraph packing strategy to maximize the transferring efficiency between CPU host and GPU device. We integrate QGTC with Pytorch for better programmability and extensibility. Extensive experiments demonstrate that QGTC achieves on average 2.7x speedup compared with the state of the art Deep Graph Library framework across diverse settings.


On the Newton polygons of twisted L functions of binomials. Let chi be an order c multiplicative character of a finite field and f(x) x d lambda x e a binomial with (d,e) 1 . We study the twisted classical and T adic Newton polygons of f . When p (d e)(2d 1) , we give a lower bound of Newton polygons and show that they coincide if p does not divide a certain integral constant depending on p bmod cd . We conjecture that this condition holds if p is large enough with respect to c,d by combining all known results and the conjecture given by Zhang Niu. As an example, we show that it holds for e d 1 .


Formation of Temporally Shaped Electron Bunches for Beam Driven Collinear Wakefield Accelerators. Beam driven collinear wakefield accelerators (CWAs) that operate by using slow wave structures or plasmas hold great promise toward reducing the size of contemporary accelerators. Sustainable acceleration of charged particles to high energies in the CWA relies on using field generating relativistic electron bunches with a highly asymmetric peak current profile and a large energy chirp. A new approach to obtaining such bunches has been proposed and illustrated with the accelerator design supported by particle tracking simulations. It has been shown that the required particle distribution in the longitudinal phase space can be obtained without collimators, giving CWAs an opportunity for employment in applications requiring a high repetition rate of operation.


Local systems in diffeology. By making use of Halperin's local systems over simplicial sets and the model structure of the category of diffeological spaces due to Kihara, we introduce a framework of rational homotopy theory for such smooth spaces with arbitrary fundamental groups. As a consequence, we have an equivalence between the homotopy categories of fibrewise rational diffeological spaces and an algebraic category of minimal local systems elaborated by G 'omez Tato, Halperin and Tanr 'e. Moreover, a spectral sequence converging to the singular de Rham cohomology of a diffeological adjunction space is constructed with a pullback of relevant local systems. In case of a stratifold obtained by attaching manifolds, the spectral sequence converges to the Souriau de Rham cohomology algebra of the diffeological space.


The Interplay between Distribution Parameters and the Accuracy Robustness Tradeoff in Classification. Adversarial training tends to result in models that are less accurate on natural (unperturbed) examples compared to standard models. This can be attributed to either an algorithmic shortcoming or a fundamental property of the training data distribution, which admits different solutions for optimal standard and adversarial classifiers. In this work, we focus on the latter case under a binary Gaussian mixture classification problem. Unlike earlier work, we aim to derive the natural accuracy gap between the optimal Bayes and adversarial classifiers, and study the effect of different distributional parameters, namely separation between class centroids, class proportions, and the covariance matrix, on the derived gap. We show that under certain conditions, the natural error of the optimal adversarial classifier, as well as the gap, are locally minimized when classes are balanced, contradicting the performance of the Bayes classifier where perfect balance induces the worst accuracy. Moreover, we show that with an ell infty bounded perturbation and an adversarial budget of epsilon , this gap is Theta( epsilon 2) for the worst case parameters, which for suitably small epsilon indicates the theoretical possibility of achieving robust classifiers with near perfect accuracy, which is rarely reflected in practical algorithms.


Strong shift equivalence as a category notion. In this paper, we present a completely radical way to investigate the main problem of symbolic dynamics, the conjugacy problem, by proving that this problem actually relates to a natural question in category theory regarding the theory of traced bialgebras. As a consequence of this theory, we obtain a systematic way of obtaining new invariants for the conjugacy problem by looking at existing bialgebras in the literature.


VideoLightFormer Lightweight Action Recognition using Transformers. Efficient video action recognition remains a challenging problem. One large model after another takes the place of the state of the art on the Kinetics dataset, but real world efficiency evaluations are often lacking. In this work, we fill this gap and investigate the use of transformers for efficient action recognition. We propose a novel, lightweight action recognition architecture, VideoLightFormer. In a factorized fashion, we carefully extend the 2D convolutional Temporal Segment Network with transformers, while maintaining spatial and temporal video structure throughout the entire model. Existing methods often resort to one of the two extremes, where they either apply huge transformers to video features, or minimal transformers on highly pooled video features. Our method differs from them by keeping the transformer models small, but leveraging full spatiotemporal feature structure. We evaluate VideoLightFormer in a high efficiency setting on the temporally demanding EPIC KITCHENS 100 and Something Something V2 (SSV2) datasets and find that it achieves a better mix of efficiency and accuracy than existing state of the art models, apart from the Temporal Shift Module on SSV2.


X ray phase sensitive microscope imaging with a grating interferometer theory and simulation. In this work, a general theoretical framework is presented to explain the formation of the phase signal in an X ray microscope integrated with a grating interferometer, which simultaneously enables the high spatial resolution imaging and the improved image contrast. Using this theory, several key parameters of phase contrast imaging can be predicted, for instance, the fringe visibility and period, the conversion condition from the differential phase imaging (DPI) to the phase difference imaging (PDI). Additionally, numerical simulations are performed with certain X ray optical components and imaging geometry. Results demonstrate the accuracy of this developed quantitative analysis method of X ray phase sensitive microscope imaging.


Learning Robust and Lightweight Model through Separable Structured Transformations. With the proliferation of mobile devices and the Internet of Things, deep learning models are increasingly deployed on devices with limited computing resources and memory, and are exposed to the threat of adversarial noise. Learning deep models with both lightweight and robustness is necessary for these equipments. However, current deep learning solutions are difficult to learn a model that possesses these two properties without degrading one or the other. As is well known, the fully connected layers contribute most of the parameters of convolutional neural networks. We perform a separable structural transformation of the fully connected layer to reduce the parameters, where the large scale weight matrix of the fully connected layer is decoupled by the tensor product of several separable small sized matrices. Note that data, such as images, no longer need to be flattened before being fed to the fully connected layer, retaining the valuable spatial geometric information of the data. Moreover, in order to further enhance both lightweight and robustness, we propose a joint constraint of sparsity and differentiable condition number, which is imposed on these separable matrices. We evaluate the proposed approach on MLP, VGG 16 and Vision Transformer. The experimental results on datasets such as ImageNet, SVHN, CIFAR 100 and CIFAR10 show that we successfully reduce the amount of network parameters by 90 , while the robust accuracy loss is less than 1.5 , which is better than the SOTA methods based on the original fully connected layer. Interestingly, it can achieve an overwhelming advantage even at a high compression rate, e.g., 200 times.


RNA Number of Some Parity Signed Generalized Petersen Graphs. A signed graph Sigma (G, sigma) is said to be parity signed if there exists a bijection f V(G) rightarrow 1,2,..., V(G) such that sigma(uv) if and only if f(u) and f(v) are of same parity, where uv is an edge of G . The rna number of a graph G , denoted sigma (G) , is the minimum number of negative edges among all possible parity signed graphs over G . The rna number is also equal to the minimum cut size that has nearly equal sides. In this paper, for generalized Petersen graph P(n,k) , we prove that 3 leq sigma (P(n,k)) leq n and these bounds are sharp. The exact value of sigma (P(n,k)) is determined for k 1,2 . Some famous generalized Petersen graphs namely, Petersen graph P(5,2) , Durer graph P(6,2) , Mobius Kantor graph P(8,3) , Dodecahedron P(10,2) , Desargues graph P(10,3) and Nauru graph P(12,5) are also treated. We show that the minimum order of a (4n 1) regular graph having rna number one is bounded above by 12n 2 . The sharpness of this upper bound is also shown for n 1 . We also show that the minimum order of a (4n 1) regular graph having rna number one is 8n 6 . Finally, for any simple connected graph of order n , we propose an O(2 n n lfloor frac n 2 rfloor ) time algorithm for computing its rna number.


Multi view analysis of unregistered medical images using cross view transformers. Multi view medical image analysis often depends on the combination of information from multiple views. However, differences in perspective or other forms of misalignment can make it difficult to combine views effectively, as registration is not always possible. Without registration, views can only be combined at a global feature level, by joining feature vectors after global pooling. We present a novel cross view transformer method to transfer information between unregistered views at the level of spatial feature maps. We demonstrate this method on multi view mammography and chest X ray datasets. On both datasets, we find that a cross view transformer that links spatial feature maps can outperform a baseline model that joins feature vectors after global pooling.


Frequency Domain Representation of First Order Methods A Simple and Robust Framework of Analysis. Motivated by recent applications in min max optimization, we employ tools from nonlinear control theory in order to analyze a class of "historical" gradient based methods, for which the next step lies in the span of the previously observed gradients within a time horizon. Specifically, we leverage techniques developed by Hu and Lessard (2017) to build a frequency domain framework which reduces the analysis of such methods to numerically solvable algebraic tasks, establishing linear convergence under a class of strongly monotone and co coercive operators. On the applications' side, we focus on the Optimistic Gradient Descent (OGD) method, which augments the standard Gradient Descent with an additional past gradient in the optimization step. The proposed framework leads to a simple and sharp analysis of OGD and generalizations thereof under a much broader regime of parameters. Notably, this characterization directly extends under adversarial noise in the observed value of the gradient. Moreover, our frequency domain framework provides an exact quantitative comparison between simultaneous and alternating updates of OGD. An interesting byproduct is that OGD and variants thereof is an instance of PID control, arguably one of the most influential algorithms of the last century this observation sheds more light to the stabilizing properties of "optimism".


The geometric phase and the dry friction of sleeping tops on inclined planes. We report on the motion of a spinning sleeping top on an inclined plane. Below a critical inclination angle the sleeping tops are force free. The trajectory of a sleeping top on weakly inclined planes in the adiabatic limit is invariant of the angular frequency of the top and thus invariant under a rescaling of the time, however not invariant under time reversal. The stationary trajectory of the sleeping top is characterized by its angle to the in plane horizontal direction. At larger inclinations of the plane the stationary motion of the top becomes unstable and the top accelerates downhill. The behavior points towards a complex law of dry friction of the contact point between the top tip and the material of the inclined plane that depends on a slip parameter. We propose a phenomenological law of dry friction that can explain the relaxation of the top into the sleeping position, the geometric behavior of the top trajectories, and the instability of the stationary motion at larger inclination angles.


User Requirements and Analysis of Preeclampsia Detection done through a Smart Bracelet. Medical students along with the medical staff have to monitor the state of the patients by using modern devices which have to offer precise results in a short amount of time, so that the intervention to be done as soon as possible. E learning systems for blood pressure monitoring are used and new methods of patient observation, evaluation and treatment are applied compared to classical intervention. Based on this, medical students can improve their knowledge for the practical training. In the medical activities specialized devices occupy an important place. A device that can monitor the blood pressure is a smart bracelet that incorporates a pressure sensor along the wrist for continuous recording of blood pressure values. This enables the prediction of the emergency disorders using a decision support system. It facilitates the learning of new intervention approaches and boosts the responsiveness among learners. According to the World Health Organization, hypertensive disorders affect about 10 of pregnant women worldwide and are an important cause of disability and long term death among mothers and children. This paper is based on a survey completed by persons of different ages and having various specialization domains regarding the use of smart bracelets for detecting preeclampsia. The aim is to decide upon its popularity among people and to determine the user requirements. The pregnant women will be constantly monitored, doctors can update the diagnosis of the patient. The medical students can learn from the critical situations and benefit from these cases while learning. The results of the survey showed that most of the interviewed persons consider the existence of such a device to be very useful, mostly the female individuals would feel more comfortable to have their blood pressure monitored during pregnancy.


Homomorphisms to 3 manifold groups. We prove foundational results about the set of homomorphisms from a finitely generated group to the collection of all fundamental groups of compact 3 manifolds and answer questions of Reid Wang Zhou and Agol Liu.


A negative answer to Ulam's Problem 19 from the Scottish Book. We give a negative answer to Ulam's Problem 19 from the Scottish Book asking it is a solid of uniform density which will float in water in every position a sphere? Assuming that the density of water is 1 , we show that there exists a strictly convex body of revolution K subset mathbb R 3 of uniform density frac 1 2 , which is not a Euclidean ball, yet floats in equilibrium in every orientation. We prove an analogous result in all dimensions d ge 3 .