Understanding Visual Saliency in Mobile User Interfaces. For graphical user interface (UI) design, it is important to understand what attracts visual attention. While previous work on saliency has focused on desktop and web based UIs, mobile app UIs differ from these in several respects. We present findings from a controlled study with 30 participants and 193 mobile UIs. The results speak to a role of expectations in guiding where users look at. Strong bias toward the top left corner of the display, text, and images was evident, while bottom up features such as color or size affected saliency less. Classic, parameter free saliency models showed a weak fit with the data, and data driven models improved significantly when trained specifically on this dataset (e.g., NSS rose from 0.66 to 0.84). We also release the first annotated dataset for investigating visual saliency in mobile UIs.


Extremal Uniquely Resolvable Multisets. For positive integers n and m , consider a multiset of non empty subsets of m such that there is a textit unique partition of these subsets into n partitions of m . We study the maximum possible size g(n,m) of such a multiset. We focus on the regime n leq 2 m 1 1 and show that g(n,m) geq Omega( frac nm log n ) . When n 2 cm for any c in (0,1) , this lower bound simplifies to Omega( frac n c ) , and we show a matching upper bound g(n,m) leq O( frac n c log( frac 1 c )) that is optimal up to a factor of log( frac 1 c ) . We also compute g(n,m) exactly when n geq 2 m 1 O(2 frac m 2 ) .


Physics constrained Deep Learning for Robust Inverse ECG Modeling. The rapid developments in advanced sensing and imaging bring about a data rich environment, facilitating the effective modeling, monitoring, and control of complex systems. For example, the body sensor network captures multi channel information pertinent to the electrical activity of the heart (i.e., electrocardiograms (ECG)), which enables medical scientists to monitor and detect abnormal cardiac conditions. However, the high dimensional sensing data are generally complexly structured and realizing the full data potential depends to a great extent on advanced analytical and predictive methods. This paper presents a physics constrained deep learning (P DL) framework for high dimensional inverse ECG modeling. This method integrates the physical laws of the complex system with the advanced deep learning infrastructure for effective prediction of the system dynamics. The proposed P DL approach is implemented to solve the inverse ECG model and predict the time varying distribution of electric potentials in the heart from the ECG data measured by the body surface sensor network. Experimental results show that the proposed P DL method significantly outperforms existing methods that are commonly used in current practice.


Learning in Sinusoidal Spaces with Physics Informed Neural Networks. A physics informed neural network (PINN) uses physics augmented loss functions, e.g., incorporating the residual term from governing partial differential equations (PDEs), to ensure its output is consistent with fundamental physics laws. However, it turns out to be difficult to train an accurate PINN model for many problems in practice. In this paper, we present a novel perspective of the merits of learning in sinusoidal spaces with PINNs. By analyzing behavior at model initialization, we first show that a PINN of increasing expressiveness induces an initial bias around flat output functions. Notably, this initial solution can be very close to satisfying many physics PDEs, i.e., falling into a local minimum of the PINN loss that only minimizes PDE residuals, while still being far from the true solution that jointly minimizes PDE residuals and the initial and or boundary conditions. It is difficult for gradient descent optimization to escape from such a local minimum trap, often causing the training to stall. We then prove that the sinusoidal mapping of inputs, in an architecture we label as sf PINN, is effective to increase input gradient variability, thus avoiding being trapped in such deceptive local minimum. The level of variability can be effectively modulated to match high frequency patterns in the problem at hand. A key facet of this paper is the comprehensive empirical study that demonstrates the efficacy of learning in sinusoidal spaces with PINNs for a wide range of forward and inverse modelling problems spanning multiple physics domains.


IBM HBCU Quantum Center A model for industry academic partnerships to advance the creation of a diverse, quantum aware workforce. The IBM HBCU Quantum Center is a first of a kind collaboration between IBM and a consortium of Historically Black Colleges and Universities (HBCUs) that seeks to address the lack of Black representation and build a diverse and aware workforce in quantum information science and engineering (QISE). Key pillars of the Center are focused on 1) building community and fostering a sense of belonging, 2) strengthening relationships internally and with the broader quantum community, and 3) providing funding to support undergraduate, graduate, and faculty research at HBCUs. As a part of the program, students and faculty are invited to participate in grant development workshops, a QISE invited speaker series, community hack a thons, and other opportunities to build competencies in the growing field of QISE. Since its launch, the IBM HBCU Quantum Center has engaged a community of over 400 students, faculty, and researchers and will continue to establish a research presence in QISE and increase opportunities for research and workforce development.


H2OPUS TLR High Performance Tile Low Rank Symmetric Factorizations using Adaptive Randomized Approximation. Tile low rank representations of dense matrices partition them into blocks of roughly uniform size, where each off diagonal tile is compressed and stored as its own low rank factorization. They offer an attractive representation for many data sparse dense operators that appear in practical applications, where substantial compression and a much smaller memory footprint can be achieved. TLR matrices are a compromise between the simplicity of a regular perfectly strided data structure and the optimal complexity of the unbalanced trees of hierarchically low rank matrices, and provide a convenient performance tuning parameter through their tile size that can be proportioned to take into account the cache size where the tiles reside in the memory hierarchy. There are currently no high performance algorithms that can generate Cholesky and LDL T factorizations, particularly on GPUs. The difficulties in achieving high performance when factoring TLR matrices come from the expensive compression operations that must be performed during the factorization process and the adaptive rank distribution of the tiles that causes an irregular work pattern for the processing cores. In this work, we develop a dynamic batching operation and combine it with batched adaptive randomized approximations to achieve high performance both on GPUs and CPUs. Our implementation attains over 1.2 TFLOP s in double precision on the V100 GPU, and is limited by the performance of batched GEMM operations. The Cholesky factorization of covariance matrix of size N 131K arising in spatial statistics can be factored to an accuracy epsilon 10 2 in just a few seconds. We believe the proposed GEMM centric algorithm allows it to be readily ported to newer hardware such as the tensor cores that are optimized for small GEMM operations.


Diffeomorphisms of odd dimensional discs, glued into a manifold. For a compact (2n 1) dimensional smooth manifold, let mu M B Diff partial (D 2n 1 ) to B Diff (M) be the map that is defined by extending diffeomorphisms on an embedded disc by the identity. By a classical result of Farrell and Hsiang, the rational homotopy groups and the rational homology of B Diff partial (D 2n 1 ) are known in the concordance stable range. We prove two results on the behaviour of the map mu M in the concordance stable range. Firstly, it is emph injective on rational homotopy groups, and secondly, it is emph trivial on rational homology, if M contains sufficiently many embedded copies of S n times S n 1 setminus int(D 2n 1 ) . The homotopical statement is probably not new and follows from the theory of smooth torsion invariants. The homological statement relies on work by Botvinnik and Perlmutter on diffeomorphism of odd dimensional manifolds.


Rectangles conformally inscribed in lines. A parallelogram is conformally inscribed in four lines in the plane if it is inscribed in a scaled copy of the configuration of four lines. We describe the geometry of the three dimensional Euclidean space whose points are the parallelograms conformally inscribed in sequence in these four lines. In doing so, we describe the flow of inscribed rectangles by introducing a compact model of the rectangle inscription problem.


Deep Reinforcement Learning Aided RAN Slicing Enforcement for B5G Latency Sensitive Services. The combination of cloud computing capabilities at the network edge and artificial intelligence promise to turn future mobile networks into service and radio aware entities, able to address the requirements of upcoming latency sensitive applications. In this context, a challenging research goal is to exploit edge intelligence to dynamically and optimally manage the Radio Access Network Slicing (that is a less mature and more complex technology than fifth generation Network Slicing) and Radio Resource Management, which is a very complex task due to the mostly unpredictably nature of the wireless channel. This paper presents a novel architecture that leverages Deep Reinforcement Learning at the edge of the network in order to address Radio Access Network Slicing and Radio Resource Management optimization supporting latency sensitive applications. The effectiveness of our proposal against baseline methodologies is investigated through computer simulation, by considering an autonomous driving use case.


Stochastic Learning Approach to Binary Optimization for Optimal Design of Experiments. We present a novel stochastic approach to binary optimization for optimal experimental design (OED) for Bayesian inverse problems governed by mathematical models such as partial differential equations. The OED utility function, namely, the regularized optimality criterion, is cast into a stochastic objective function in the form of an expectation over a multivariate Bernoulli distribution. The probabilistic objective is then solved by using a stochastic optimization routine to find an optimal observational policy. The proposed approach is analyzed from an optimization perspective and also from a machine learning perspective with correspondence to policy gradient reinforcement learning. The approach is demonstrated numerically by using an idealized two dimensional Bayesian linear inverse problem, and validated by extensive numerical experiments carried out for sensor placement in a parameter identification setup.


NPASA An algorithm for nonlinear programming Motivation and Global Convergence. In this paper, we present a two phase method for solving nonlinear programming problems called Nonlinear Polyhedral Active Set Algorithm (NPASA) that has global and local convergence guarantees under reasonable assumptions. The first phase consists of an augmented Lagrangian method to ensure global convergence while the second phase is designed to promote fast local convergence by performing a balanced reduction of two error estimators for nonlinear programs. After presenting error estimators for nonlinear programs and our algorithm NPASA, we establish global convergence properties for NPASA. Local quadratic convergence of NPASA is established in a companion paper.


Halfcanonical Gorenstein curves of codimension four. Recent work of Schenck, Stillman and Yuan arXiv 2011.10871 outlines all possible Betti tables for Artin Gorenstein algebras A with regularity( A ) 4 codim( A ). We populate the second half of this list with examples of stable curves, and ask if there are further possible constructions. The problem of deformation between curves with the same Hilbert series but different Betti tables is ongoing work, but our work solves one case a deformation (due to Jan Stevens) between a reducible curve corresponding to Betti table type 2.7 in arXiv 2011.10871 and the curve obtained as the intersection of a del Pezzo surface of degree 5 and a cubic hypersurface.


Bounded point evaluation for operators with the wandering subspace property. We extend and study the notion of bounded point evaluation introduced by Williams for a cyclic operator to the class of operators with the wandering subspace property. We characterize the set bpe(T) of all bounded point evaluations for an operator T with the wandering subspace property in terms of the invertibility of certain projections. This result generalizes the earlier established characterization of bpe(T) for a finitely cyclic operator T . Further, if T is a left invertible operator with the wandering subspace property, then we determine the bpe(T) and the set abpe(T) of all analytic bounded point evaluations for T . We also give examples of left invertible operator T with the wandering subspace property for which mathbb D big(0, r(T') 1 big) subsetneqq abpe(T) subseteq bpe(T) , where r(T') is the spectral radius of the Cauchy dual T' of T .


Embodied engagement with scientific concepts An exploration into emergent learning. In response to an invitation to integrate science and art pedagogy, science and dance students, enrolled in specific discipline courses, collaboratively produced choreography based on scientific principles. This paper reports students experience of this process. Science students reported an increased understanding of concepts, while dance students found inspiration for choreography within scientific concepts. Tensions and misconceptions were evident in the process with respect to disciplinary language, the notion of scientific thought, and the level of physical awareness. The relationship between movement and forms of knowledge production in science is investigated as well. The paper ends with recommendations for future classes.


Turbulent transport of impurities in 3D devices. A large diffusive turbulent contribution to the radial impurity transport in Wendelstein 7 X (W7 X) plasmas has been experimentally inferred during the first campaigns and numerically confirmed by means of gyrokinetic simulations with the code stella. In general, the absence of strong impurity accumulation during the initial W7 X campaigns is attributed to this diffusive term. In the present work the diffusive contribution is also calculated in other stellarator plasmas. In particular, the diffusion (D) and convection (V) coefficients of carbon and iron impurities produced by ion temperature gradient (ITG) turbulence are obtained for W7 X, LHD, TJ II and NCSX. The results show that, although the size of D and V can differ across the four devices, inward convection is found for all of them. For W7 X, TJ II and NCSX the two coefficients are comparable and the turbulent peaking factor is surprisingly similar. In LHD, appreciably weaker diffusive and convective impurity transport and significantly larger turbulent peaking factor are predicted. All this suggests that ITG turbulence, although not strongly, would lead to negative impurity density gradients in stellarators. Then, considering mixed ITG Trapped Electron Mode (TEM) turbulence for the specific case of W7 X, it has been quantitatively assessed to what degree pellet fueled reduced turbulence scenarios feature reduced turbulent transport of impurities as well. The results for trace iron impurities show that, although their turbulent transport is not entirely suppressed, a significant reduction of V and a stronger decrease of D are found. Although the diffusion is still above neoclassical levels, the neoclassical convection would gain under such conditions a greater specific weight on the dynamics of impurities in comparison with standard ECRH scenarios.


The density theorem for projective representations via twisted group von Neumann algebras. We consider converses to the density theorem for irreducible, projective, unitary group representations restricted to lattices using the dimension theory of Hilbert modules over twisted group von Neumann algebras. We show that under the right assumptions, the restriction of a sigma projective unitary representation pi of a group G to a lattice Gamma extends to a Hilbert module over the twisted group von Neumann algebra text L ( Gamma, sigma) . We then compute the center valued von Neumann dimension of this Hilbert module. For abelian groups with 2 cocycle satisfying Kleppner's condition, we show that the center valued von Neumann dimension reduces to the scalar value d pi text vol (G Gamma) , where d pi is the formal dimension of pi and text vol (G Gamma) is the covolume of Gamma in G . We apply our results to characterize the existence of multiwindow super frames and Riesz sequences associated to pi and Gamma . In particular, we characterize when a lattice in the time frequency plane of a second countable, locally compact abelian group admits a Gabor frame or Gabor Riesz sequence.


Oil and Gas Pipeline Monitoring during COVID 19 Pandemic via Unmanned Aerial Vehicle. The vast network of oil and gas transmission pipelines requires periodic monitoring for maintenance and hazard inspection to avoid equipment failure and potential accidents. The severe COVID 19 pandemic situation forced the companies to shrink the size of their teams. One risk which is faced on site is represented by the uncontrolled release of flammable oil and gas. Among many inspection methods, the unmanned aerial vehicle system contains flexibility and stability. Unmanned aerial vehicles can transfer data in real time, while they are doing their monitoring tasks. The current article focuses on unmanned aerial vehicles equipped with optical sensing and artificial intelligence, especially image recognition with deep learning techniques for pipeline surveillance. Unmanned aerial vehicles can be used for regular patrolling duties to identify and capture images and videos of the area of interest. Places that are hard to reach will be accessed faster, cheaper and with less risk. The current paper is based on the idea of capturing video and images of drone based inspections, which can discover several potential hazardous problems before they become dangerous. Damage can emerge as a weakening of the cladding on the external pipe insulation. There can also be the case when the thickness of piping through external corrosion can occur. The paper describes a survey completed by experts from the oil and gas industry done for finding the functional and non functional requirements of the proposed system.


A note on mathfrak su (2) models and the biorthogonality of generating functions of Krawtchouk polynomials. Eigenvalue problems on irreducible mathfrak su (2) modules and their adjoints are considered in the Bargmann, Barut Girardello and finite difference models. The biorthogonality relations that arise between the corresponding generating functions of the Krawtchouk polynomials are sorted out. A link with Pad 'e approximation is made.


Challenges and Opportunities in Approximate Bayesian Deep Learning for Intelligent IoT Systems. Approximate Bayesian deep learning methods hold significant promise for addressing several issues that occur when deploying deep learning components in intelligent systems, including mitigating the occurrence of over confident errors and providing enhanced robustness to out of distribution examples. However, the computational requirements of existing approximate Bayesian inference methods can make them ill suited for deployment in intelligent IoT systems that include lower powered edge devices. In this paper, we present a range of approximate Bayesian inference methods for supervised deep learning and highlight the challenges and opportunities when applying these methods on current edge hardware. We highlight several potential solutions to decreasing model storage requirements and improving computational scalability, including model pruning and distillation methods.


Multirate Linearly Implicit GARK Schemes. Many complex applications require the solution of initial value problems where some components change fast, while others vary slowly. Multirate schemes apply different step sizes to resolve different components of the system, according to their dynamics, in order to achieve increased computational efficiency. The stiff components of the system, fast or slow, are best discretized with implicit base methods in order to ensure numerical stability. To this end, linearly implicit methods are particularly attractive as they solve only linear systems of equations at each step. This paper develops the Multirate GARK ROS ROW (MR GARK ROS ROW) framework for linearly implicit multirate time integration. The order conditions theory considers both exact and approximative Jacobians. The effectiveness of implicit multirate methods depends on the coupling between the slow and fast computations an array of efficient coupling strategies and the resulting numerical schemes are analyzed. Multirate infinitesimal step linearly implicit methods, that allow arbitrarily small micro steps and offer extreme computational flexibility, are constructed. The new unifying framework includes existing multirate Rosenbrock( W) methods as particular cases, and opens the possibility to develop new classes of highly effective linearly implicit multirate integrators.


Using edge contractions to reduce the semitotal domination number. In this paper, we consider the problem of reducing the semitotal domination number of a given graph by contracting k edges, for some fixed k geq 1 . We show that this can always be done with at most 3 edge contractions and further characterise those graphs requiring 1, 2 or 3 edge contractions, respectively, to decrease their semitotal domination number. We then study the complexity of the problem for k 1 and obtain in particular a complete complexity dichotomy for monogenic classes.


Does the First Response Matter for Future Contributions? A Study of First Contributions. Context Open Source Software (OSS) projects rely on a continuous stream of new contributors for sustainable livelihood. Recent studies reported that new contributors experience many barriers in their first contribution. One of the critical barriers is the social barrier. Although a number of studies investigated the social barriers to new contributors, to the best of our knowledge, the relationship between the first response to the first contributions and their future contributions has not been studied comprehensively. Objective In this registered report, we introduce the study protocols that investigate the correlation between the first response given to the first contributions and the future contribution. First, we performed a preliminary survey to manually explore the sentiments of the first response. Preliminary analysis confirms that the first responses are mainly neutral. Method Our execution plan includes both qualitative and quantitative approaches with three research questions. We inspect the first response of the first contributions, investigate the effects of characteristics of the first response to the interaction between first time contributor and project contributors, and find the impact of the interactions between other contributors.


New geometric constants of isosceles orthogonal type. Based on the parallelogram law and isosceles orthogonality, we define a new orthogonal geometric constant. We first discuss some basic properties of this new constant. Next, we consider the relation between the constant and the uniformly non square property. Moreover, a generalized constant is also introduced and some basic properties are presented. It is shown that, for a normed space, the constant value is equal to 1 if and only if the norm can be induced by the inner product. Finally, we verify that this constant is closely related to the well known geometric constants through some inequalities.


Applications of Common Information to Computing Functions. We design a low complexity distributed compression scheme for computing arbitrary functions of sources with discrete alphabets. We use a helper based method that extends the definition of the G 'a cs K "o rner Witsenhausen (GKW) common information to functional common information. The helper relaxes the combinatorial structure of GKW by partitioning the joint source distribution into nests imposed by the function, which ensures hierarchical cooperation between the sources for effectively distributed computing. By contrasting our approach's performance with existing efficient techniques, we demonstrate the rate savings in recovering function and source data. Permutation invariant functions are prevalent in learning and combinatorial optimization fields and most recently applied to graph neural networks. We consider the efficient compression for computing permutation invariant functions in a network with two sources and one decoder. We use a bipartite graph representation, where two disjoint sets of vertices (parts) denote the individual source graphs and the edge weights capture the joint source distribution. We compress bipartite graphs by creating connected components determined by the function's distribution, accounting for the edge symmetries, and eliminating the low probability edges. We separately encode those edges and send them as refinements. Our approach can substitute high complexity joint decoding techniques and inform neural networks to reduce the computing time and reduce complexity.


Explicit construction of joint multipoint statistics in complex systems. Complex systems often involve random fluctuations for which self similar properties in space and time play an important role. Fractional Brownian motions, characterized by a single scaling exponent, the Hurst exponent H , provide a convenient tool to construct synthetic signals that capture the statistical properties of many processes in the physical sciences and beyond. However, in certain strongly interacting systems, e.g., turbulent flows, stock market indices, or cardiac interbeats, multiscale interactions lead to significant deviations from self similarity and may therefore require a more elaborate description. In the context of turbulence, the Kolmogorov Oboukhov model (K62) describes anomalous scaling, albeit explicit constructions of a turbulent signal by this model are not available yet. Here, we derive an explicit formula for the joint multipoint probability density function of a multifractal field. To this end, we consider a scale mixture of fractional Ornstein Uhlenbeck processes and introduce a fluctuating length scale in the corresponding covariance function. In deriving the complete statistical properties of the field, we are able to systematically model synthetic multifractal phenomena. We conclude by giving a brief outlook on potential applications which range from specific tailoring or stochastic interpolation of wind fields to the modeling of financial data or non Gaussian features in geophysical or geospatial settings.


On the Gibbs Thomson equation for the crystallization of confined fluids. The Gibbs Thomson (GT) equation describes the shift of the crystallization temperature for a confined fluid with respect to the bulk as a function of pore size. While this century old relation is successfully used to analyze experiments, its derivations found in the literature often rely on nucleation theory arguments (i.e. kinetics instead of thermodynamics) or fail to state their assumptions, therefore leading to similar but different expressions. Here, we revisit the derivation of the GT equation to clarify the system definition, corresponding thermodynamic ensemble, and assumptions made along the way. We also discuss the role of the thermodynamic conditions in the external reservoir on the final result. We then turn to numerical simulations of a model system to compute independently the various terms entering in the GT equation, and compare the predictions of the latter with the melting temperatures determined under confinement by means of hyper parallel tempering grand canonical Monte Carlo simulations. We highlight some difficulties related to the sampling of crystallization under confinement in simulations. Overall, despite its limitations, the GT equation may provide an interesting alternative route to predict the melting temperature in large pores, using molecular simulations to evaluate the relevant quantities entering in this equation. This approach could for example be used to investigate the nanoscale capillary freezing of ionic liquids recently observed experimentally between the tip of an Atomic Force Microscope and a substrate.


"Will You Find These Shortcuts?" A Protocol for Evaluating the Faithfulness of Input Salience Methods for Text Classification. Feature attribution a.k.a. input salience methods which assign an importance score to a feature are abundant but may produce surprisingly different results for the same model on the same input. While differences are expected if disparate definitions of importance are assumed, most methods claim to provide faithful attributions and point at the features most relevant for a model's prediction. Existing work on faithfulness evaluation is not conclusive and does not provide a clear answer as to how different methods are to be compared. Focusing on text classification and the model debugging scenario, our main contribution is a protocol for faithfulness evaluation that makes use of partially synthetic data to obtain ground truth for feature importance ranking. Following the protocol, we do an in depth analysis of four standard salience method classes on a range of datasets and shortcuts for BERT and LSTM models and demonstrate that some of the most popular method configurations provide poor results even for simplest shortcuts. We recommend following the protocol for each new task and model combination to find the best method for identifying shortcuts.


Positional Contrastive Learning for Volumetric Medical Image Segmentation. The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts. Contrastive learning, an unsupervised learning technique, has been proved powerful in learning image level representations from unlabeled data. The learned encoder can then be transferred or fine tuned to improve the performance of downstream tasks with limited labels. A critical step in contrastive learning is the generation of contrastive data pairs, which is relatively simple for natural image classification but quite challenging for medical image segmentation due to the existence of the same tissue or organ across the dataset. As a result, when applied to medical image segmentation, most state of the art contrastive learning frameworks inevitably introduce a lot of false negative pairs and result in degraded segmentation quality. To address this issue, we propose a novel positional contrastive learning (PCL) framework to generate contrastive data pairs by leveraging the position information in volumetric medical images. Experimental results on CT and MRI datasets demonstrate that the proposed PCL method can substantially improve the segmentation performance compared to existing methods in both semi supervised setting and transfer learning setting.


Enhancing Transformer for Video Understanding Using Gated Multi Level Attention and Temporal Adversarial Training. The introduction of Transformer model has led to tremendous advancements in sequence modeling, especially in text domain. However, the use of attention based models for video understanding is still relatively unexplored. In this paper, we introduce Gated Adversarial Transformer (GAT) to enhance the applicability of attention based models to videos. GAT uses a multi level attention gate to model the relevance of a frame based on local and global contexts. This enables the model to understand the video at various granularities. Further, GAT uses adversarial training to improve model generalization. We propose temporal attention regularization scheme to improve the robustness of attention modules to adversarial examples. We illustrate the performance of GAT on the large scale YoutTube 8M data set on the task of video categorization. We further show ablation studies along with quantitative and qualitative analysis to showcase the improvement.


Chow groups and L derivatives of automorphic motives for unitary groups, II. In this article, we improve our main results from emph Chow groups and L derivatives of automorphic motives for unitary groups in two direction First, we allow ramified places in the CM extension E F at which we consider representations that are spherical with respect to a certain special maximal compact subgroup, by formulating and proving an analogue of the Kudla Rapoport conjecture for exotic smooth Rapoport Zink spaces. Second, we lift the restriction on the components at split places of the automorphic representation, by proving a more general vanishing result on certain cohomology of integral models of unitary Shimura varieties with Drinfeld level structures.


Leray Hopf solutions to a viscoelastoplastic fluid model with nonsmooth stress strain relation. We consider a fluid model including viscoelastic and viscoplastic effects. The state is given by the fluid velocity and an internal stress tensor that is transported along the flow with the Zaremba Jaumann derivative. Moreover, the stress tensor obeys a nonlinear and nonsmooth dissipation law as well as stress diffusion. We prove the existence of global in time weak solutions satisfying an energy inequality under general Dirichlet conditions for the velocity field and Neumann conditions for the stress tensor.


Removal lemmas and approximate homomorphisms. We study quantitative relationships between the triangle removal lemma and several of its variants. One such variant, which we call the triangle free lemma, states that for each epsilon 0 there exists M such that every triangle free graph G has an epsilon approximate homomorphism to a triangle free graph F on at most M vertices (here an epsilon approximate homomorphism is a map V(G) to V(F) where all but at most epsilon V(G) 2 edges of G are mapped to edges of F ). One consequence of our results is that the least possible M in the triangle free lemma grows faster than exponential in any polynomial in epsilon 1 . We also prove more general results for arbitrary graphs, as well as arithmetic analogues over finite fields, where the bounds are close to optimal.


Standing waves to upper critical Choquard equation with a local perturbation multiplicity, qualitative properties and stability. In this paper, we consider the upper critical Choquard equation with a local perturbation begin equation begin cases Delta u lambda u (I alpha ast u p ) u p 2 u mu u q 2 u, x in mathbb R N , u in H 1( mathbb R N), int mathbb R N u 2 a, end cases end equation where N geq 3 , mu 0 , a 0 , lambda in mathbb R , alpha in (0,N) , p bar p frac N alpha N 2 , q in (2,2 frac 4 N ) and I alpha frac C x N alpha with C 0 . When mu a frac q(1 gamma q) 2 leq (2K) frac q gamma q 2 bar p 2( bar p 1) with gamma q frac N 2 frac N q and K being some positive constant, we prove (1) Existence and orbital stability of the ground states. (2) Existence, positivity, radial symmetry, exponential decay and orbital instability of the second class' solutions. This paper generalized and improved parts of the results obtained in cite JEANJEAN JENDREJ , Jeanjean Le , Soave JFA , Wei Wu 2021 to the Schr " o dinger equation.


Phylogenetic typology. In this article we propose a novel method to estimate the frequency distribution of linguistic variables while controlling for statistical non independence due to shared ancestry. Unlike previous approaches, our technique uses all available data, from language families large and small as well as from isolates, while controlling for different degrees of relatedness on a continuous scale estimated from the data. Our approach involves three steps First, distributions of phylogenies are inferred from lexical data. Second, these phylogenies are used as part of a statistical model to statistically estimate transition rates between parameter states. Finally, the long term equilibrium of the resulting Markov process is computed. As a case study, we investigate a series of potential word order correlations across the languages of the world.


Spectral analysis of dispersive shocks for quantum hydrodynamics with nonlinear viscosity. In this paper we investigate spectral stability of traveling wave solutions to 1 D quantum hydrodynamics system with nonlinear viscosity in the ( rho,u) , that is, density and velocity, variables. We derive a sufficient condition for the stability of the essential spectrum and we estimate the maximum modulus of eigenvalues with non negative real part. In addition, we present numerical computations of the Evans function in sufficiently large domain of the unstable half plane and show numerically that its winding number is (approximately) zero, thus giving a numerical evidence of point spectrum stability.


RAWLSNET Altering Bayesian Networks to Encode Rawlsian Fair Equality of Opportunity. We present RAWLSNET, a system for altering Bayesian Network (BN) models to satisfy the Rawlsian principle of fair equality of opportunity (FEO). RAWLSNET's BN models generate aspirational data distributions data generated to reflect an ideally fair, FEO satisfying society. FEO states that everyone with the same talent and willingness to use it should have the same chance of achieving advantageous social positions (e.g., employment), regardless of their background circumstances (e.g., socioeconomic status). Satisfying FEO requires alterations to social structures such as school assignments. Our paper describes RAWLSNET, a method which takes as input a BN representation of an FEO application and alters the BN's parameters so as to satisfy FEO when possible, and minimize deviation from FEO otherwise. We also offer guidance for applying RAWLSNET, including on recognizing proper applications of FEO. We demonstrate the use of our system with publicly available data sets. RAWLSNET's altered BNs offer the novel capability of generating aspirational data for FEO relevant tasks. Aspirational data are free from the biases of real world data, and thus are useful for recognizing and detecting sources of unfairness in machine learning algorithms besides biased data.


Cusps and Commensurability Classes of Hyperbolic 4 Manifolds. There are six orientable, compact, flat 3 manifolds that can occur as cusp cross sections of hyperbolic 4 manifolds. This paper provides criteria for exactly when a given commensurability class of arithmetic hyperbolic 4 manifolds contains a representative with a given cusp type. In particular, for three of the six cusp types, we provide infinitely many examples of commensurability classes that contain no manifolds with cusps of the given type no such examples were previously known for any cusp type.


On the axioms of singquandles. In this paper we deal with the notion of singquandles introduced in Indu R. U. Churchill, Mohamed Elhamdadi, Mustafa Hajij, and Sam Nelson, Singular knots and involutive quandles, Journal of Knot Theory and Its Ramifications 26 (2017), no. 14. This is an algebraic structure that naturally axiomatizes Reidemeister moves for singular links, similarly to what happens for ordinary links and quandle structure. We present a new axiomatization that shows different algebraic aspects and simplifies applications. We also reformulate and simplify the axioms for affine singquandles (in particular in the idempotent case).


Logical limit laws for layered permutations and related structures. We show that several classes of ordered structures (namely, convex linear orders, layered permutations, and compositions) admit first order logical limit laws.


Temperature Dependent Group Delay of Photonic Bandgap Hollow Core Fiber Tuned by Surface Mode Coupling. Surface modes (SM) are highly spatially localized modes existing at the core cladding interface of photonic bandgap hollow core fiber (PBG HCF). When coupling with SM, the air modes (AM) in the core would suffer a higher loss despite being spectrally within the cladding photonic bandgap, and would be highly dispersive around the avoided crossing (anti crossing) wavelength. In this paper, we numerically demonstrate that such avoided crossings can play an important role in the tuning of the temperature dependence of group delay of AM of PBG HCF. At higher temperatures, both the thermal optic effect and thermal expansion contribute to the redshift of avoided crossing wavelength, giving rise to a temperature dependence of the AM dispersion. Numerical simulations show that the redshift of avoided crossing can significantly tune the thermal coefficient of delay (TCD) of PBG HCF from 400 ps km K to 400 ps km K, approximately 120 ppm K to 120 ppm K. In comparison with the known tuning mechanism by the thermal induced redshift of photonic bandgap Fokoua et al., Optica 4, 659, 2017 , the tuning of TCD by SM coupling presents a much broader tuning range and higher efficiency. Our finding would provide a new route to design PBG HCF for propagation time sensitive applications.


Dosimetric characterization of a new 192Ir pulse dose rate brachytherapy source with the Monte Carlo simulation and thermoluminescent dosimeter. In this study, recommendations of the AAPM TG 43 (U1) report have been followed to characterize the new 192Ir pulse dose rate source, provided by the Applied Radiation Research School, Nuclear Science and Technology Research Institute in Iran. Dose rate constant, radial dose function, geometry factors, and anisotropy function were calculated according to the relevant American Association of Physicists in Medicine AAPM and TG43 (U1) reports. In this study, 192Ir source was characterized using Monte Carlo simulation in water phantom, and in addition, experimental measurements were carried out using thermoluminescent dosimeters (TLD 100) in plexiglass (PMMA) phantoms. The dose rate constant for the 192Ir PDR was found to be equal to 1.131 cGyh 1U 1 and 1.173 cGyh 1U 1 with TLD measurement and Monte Carlo simulation, respectively. Also in this study, the geometry function, radial dose functions g(r), and the anisotropy function have been calculated at distances from 0.1 to 16 cm. The dose rate constant of these calculations has been compared with measured values for an actual 192Ir seed. The results of dosimetry parameters, presented in tabulated and graphical formats, exhibited good agreement to those reported from other commercially available PDR 192Ir sources. The results obtained in this study are in close agreement with the characteristics of the commercially available 192Ir sources. The results obtained in this study can be treated as an initial assessment of this source to be employed in the conventional treatment planning systems subsequent to complementary investigations.


Algebraic cycles and Fano threefolds of genus 8. We show that prime Fano threefolds Y of genus 8 have a multiplicative Chow K "unneth decomposition, in the sense of Shen Vial. As a consequence, a certain tautological subring of the Chow ring of powers of Y injects into cohomology.


Superior Resistance Switching in Monolayer MoS2 Channel Based Gated Binary Resistive RAM via Gate Bias Dependence and a Unique Forming Process. In this work, we unveil the effect of RS, induced by a current voltage hysteresis cycles across CVD grown monolayer MoS2 based gated RRAM, on its transistors electrical and reliability characteristics. A unique gate voltage dependence on the RS is identified which has a remarkable impact on the switching performance of MoS2 RRAM. RS behavior was found to be significantly dependent on the charge conduction in the channel. Moreover, we have shown a potential device forming event when MoS2 gated RRAMs were subjected to a steady state electrical stress. Both hysteresis and steady state electrical stress were found to disturb the transistor action of these gated RRAMs, which in fact can be used as a signature of RS. Interestingly, current voltage hysteresis resulted in unipolar RS, whereas steady state electrical stress before RS measurement led to bipolar RS. Moreover, successive stress cycles of such an electrical stress leads to multiple resistance states, a behavior similar to synaptic properties like long term potentiation and long term depression, typically found in memristors. We find that charge transport mechanism dominant in the MoS2 FET in conjunction with steady state stress induced device forming determine the extent of RS induced in these MoS2 based gated RRAMs. Finally on the basis of insights developed from the dependence on charge transport mechanism and steady state stress induced forming of MoS2 channel, we propose a certain steady state electrical stress condition which can be used as a forming process employed prior to use of MoS2 based binary RRAMs for improved switching performance.


Intra Class Uncertainty Loss Function for Classification. Most classification models can be considered as the process of matching templates. However, when intra class uncertainty variability is not considered, especially for datasets containing unbalanced classes, this may lead to classification errors. To address this issue, we propose a loss function with intra class uncertainty following Gaussian distribution. Specifically, in our framework, the features extracted by deep networks of each class are characterized by independent Gaussian distribution. The parameters of distribution are learned with a likelihood regularization along with other network parameters. The means of the Gaussian play a similar role as the center anchor in existing methods, and the variance describes the uncertainty of different classes. In addition, similar to the inter class margin in traditional loss functions, we introduce a margin to intra class uncertainty to make each cluster more compact and reduce the imbalance of feature distribution from different categories. Based on MNIST, CIFAR, ImageNet, and Long tailed CIFAR analyses, the proposed approach shows improved classification performance, through learning a better class representation.


VibEmoji Exploring User authoring Multi modal Emoticons in Social Communication. Emoticons are indispensable in online communications. With users' growing needs for more customized and expressive emoticons, recent messaging applications begin to support (limited) multi modal emoticons e.g., enhancing emoticons with animations or vibrotactile feedback. However, little empirical knowledge has been accumulated concerning how people create, share and experience multi modal emoticons in everyday communication, and how to better support them through design. To tackle this, we developed VibEmoji, a user authoring multi modal emoticon interface for mobile messaging. Extending existing designs, VibEmoji grants users greater flexibility to combine various emoticons, vibrations, and animations on the fly, and offers non aggressive recommendations based on these components' emotional relevance. Using VibEmoji as a probe, we conducted a four week field study with 20 participants, to gain new understandings from in the wild usage and experience, and extract implications for design. We thereby contribute both a novel system and various insights for supporting users' creation and communication of multi modal emoticons.


Matching Point Sets with Quantum Circuit Learning. In this work, we propose a parameterised quantum circuit learning approach to point set matching problem. In contrast to previous annealing based methods, we propose a quantum circuit based framework whose parameters are optimised via descending the gradients w.r.t a kernel based loss function. We formulate the shape matching problem into a distribution learning task that is, to learn the distribution of the optimal transformation parameters. We show that this framework is able to find multiple optimal solutions for symmetric shapes and is more accurate, scalable and robust than the previous annealing based method. Code, data and pre trained weights are available at the project page href https hansen7.github.io qKC https hansen7.github.io qKC


Predict then Interpolate A Simple Algorithm to Learn Stable Classifiers. We propose Predict then Interpolate (PI), a simple algorithm for learning correlations that are stable across environments. The algorithm follows from the intuition that when using a classifier trained on one environment to make predictions on examples from another environment, its mistakes are informative as to which correlations are unstable. In this work, we prove that by interpolating the distributions of the correct predictions and the wrong predictions, we can uncover an oracle distribution where the unstable correlation vanishes. Since the oracle interpolation coefficients are not accessible, we use group distributionally robust optimization to minimize the worst case risk across all such interpolations. We evaluate our method on both text classification and image classification. Empirical results demonstrate that our algorithm is able to learn robust classifiers (outperforms IRM by 23.85 on synthetic environments and 12.41 on natural environments). Our code and data are available at https github.com YujiaBao Predict then Interpolate.


Learning Implicit Temporal Alignment for Few shot Video Classification. Few shot video classification aims to learn new video categories with only a few labeled examples, alleviating the burden of costly annotation in real world applications. However, it is particularly challenging to learn a class invariant spatial temporal representation in such a setting. To address this, we propose a novel matching based few shot learning strategy for video sequences in this work. Our main idea is to introduce an implicit temporal alignment for a video pair, capable of estimating the similarity between them in an accurate and robust manner. Moreover, we design an effective context encoding module to incorporate spatial and feature channel context, resulting in better modeling of intra class variations. To train our model, we develop a multi task loss for learning video matching, leading to video features with better generalization. Extensive experimental results on two challenging benchmarks, show that our method outperforms the prior arts with a sizable margin on SomethingSomething V2 and competitive results on Kinetics.


Order Agnostic Cross Entropy for Non Autoregressive Machine Translation. We propose a new training objective named order agnostic cross entropy (OaXE) for fully non autoregressive translation (NAT) models. OaXE improves the standard cross entropy loss to ameliorate the effect of word reordering, which is a common source of the critical multimodality problem in NAT. Concretely, OaXE removes the penalty for word order errors, and computes the cross entropy loss based on the best possible alignment between model predictions and target tokens. Since the log loss is very sensitive to invalid references, we leverage cross entropy initialization and loss truncation to ensure the model focuses on a good part of the search space. Extensive experiments on major WMT benchmarks show that OaXE substantially improves translation performance, setting new state of the art for fully NAT models. Further analyses show that OaXE alleviates the multimodality problem by reducing token repetitions and increasing prediction confidence. Our code, data, and trained models are available at https github.com tencent ailab ICML21 OAXE.


A Research and Educational Robotic Testbed for Real time Control of Emerging Mobility Systems From Theory to Scaled Experiments. Emerging mobility systems, e.g., connected and automated vehicles (CAVs), shared mobility, and electric vehicles, provide the most intriguing opportunity for enabling users to better monitor transportation network conditions and make better decisions for improving safety and transportation efficiency. However, before connectivity and automation are deployed en masse, a thorough evaluation of CAVs is required ranging from numerical simulation to real world public roads. Assessment of the performance of CAVs in scaled testbeds has recently gained momentum due to the flexibility they offer to conduct quick, repeatable experiments that could go one step beyond simulation. This article introduces the Information and Decision Science Lab's Scaled Smart City (IDS 3 C), a 1 25 research and educational scaled robotic testbed that is capable of replicating different real world urban traffic scenarios. IDS 3 C was designed to investigate the effect of emerging mobility systems on safety and transportation efficiency. On the educational front, IDS 3 C can be used for (a) training and educating graduate students by exposing them to a balanced mix of theory and practice, (b) integrating the research outcomes into existing courses, (c) involving undergraduate students in research, (d) creating interactive educational demos, and (e) reaching out to high school students. In our exposition, we also present a real time control framework that can be used to coordinate CAVs at traffic scenarios such as crossing signal free intersections, merging at roadways and roundabouts, cruising in congested traffic, passing through speed reduction zones, and lane merging or passing maneuvers. Finally, we provide a tutorial for applying our framework in coordinating robotic CAVs to a multi lane roundabout scenario and a transportation corridor in IDS 3 C.


Smooth Selection for Infinite Sets. Whitney's extension problem asks the following Given a compact set E subset mathbb R n and a function f E to mathbb R , how can we tell whether there exists F in C m( mathbb R n) such that F f on E ? A 2006 theorem of Charles Fefferman cite F06 answers this question in its full generality. In this paper, we establish a version of this theorem adapted for variants of the Whitney extension problem, including nonnegative extensions and the smooth selection problems. Among other things, we generalize the Finiteness Principle for smooth selection by Fefferman Israel Luli cite FIL16 to the setting of infinite sets. Our main result is stated in terms of the iterated Glaeser refinement of a bundle formed by taking potential Taylor polynomials at each point of E . In particular, we show that such bundles (and any bundles with closed, convex fibers) stabilize after a bounded number of Glaeser refinements, thus strengthening the previous results of Glaeser, Bierstone Milman Paw l ucki, and Fefferman which only hold for bundles with affine fibers.


Flowing from intersection product to cup product. We use a vector field flow defined through a cubulation of a closed manifold to reconcile the partially defined commutative product on geometric cochains with the standard cup product on cubical cochains, which is fully defined and commutative only up to coherent homotopies. The interplay between intersection and cup product dates back to the beginnings of homology theory, but, to our knowledge, this result is the first to give an explicit cochain level comparison between these approaches.


Isaac Gym High Performance GPU Based Physics Simulation For Robot Learning. Isaac Gym offers a high performance learning platform to train policies for wide variety of robotics tasks directly on GPU. Both physics simulation and the neural network policy training reside on GPU and communicate by directly passing data from physics buffers to PyTorch tensors without ever going through any CPU bottlenecks. This leads to blazing fast training times for complex robotics tasks on a single GPU with 2 3 orders of magnitude improvements compared to conventional RL training that uses a CPU based simulator and GPU for neural networks. We host the results and videos at url https sites.google.com view isaacgym nvidia and isaac gym can be downloaded at url https developer.nvidia.com isaac gym .


Online List Access with Precedence Constraints. This paper considers a natural generalization of the online list access problem in the paid exchange model, where additionally there can be precedence constraints ("dependencies") among the nodes in the list. For example, this generalization is motivated by applications in the context of packet classification. Our main contributions are constant competitive deterministic and randomized online algorithms, designed around a procedure Move Recursively Forward, a generalization of Move To Front tailored to handle node dependencies. Parts of the analysis build upon ideas of the classic online algorithms Move To Front and BIT, and address the challenges of the extended model. We further discuss the challenges related to insertions and deletions.


Collision cross section specificity for small molecule identification workflows. The physical chemical property of molecular collision cross section (CCS) is increasingly used to assist in small molecule identification however, questions remain regarding the extent of its true utility in contributing to such identifications, especially given its correlation with mass. To investigate the contribution of CCS to uniqueness within a given library, we measured its discriminatory capacity as a function of error in CCS values (from measurement or prediction), CCS variance, parent mass, mass error, and or reference database size using a multi directional grid search. While experimental CCS databases exist, they are currently small thus, we used a CCS prediction tool, DarkChem, to provide theoretical CCS values for use in this study. These predicted CCS values were then modified to mirror experimental variance. By augmenting our search within a library based on mass alone with CCS at a variety of accuracies, we found that, (i) the use of multiple adducts (i.e. alternative ionized forms of the same parent compound) for the same molecule, compared to using a single adduct, greatly improves specificity and (ii) even a single CCS leads to a significant specificity boost when low CCS error (e.g. 1 composite error) can be achieved. Based on these results, we recommend using multiple adducts to build up evidence of presence, as each adduct supplies additional information per dimension. Additionally, the utility of ion mobility spectrometry when coupled with mass spectrometry should still be considered, regardless of whether CCS is considered as an identification metric, due to advantages such as increased peak resolution, sensitivity (e.g. from reducing load on the detector at any given time), improvements in data independent MS MS spectra acquisition, and cleaner tandem mass spectral fragmentation patterns.


Data Driven Invariant Learning for Probabilistic Programs. Morgan and McIver's weakest pre expectation framework is one of the most well established methods for deductive verification of probabilistic programs. Roughly, the idea is to generalize binary state assertions to real valued expectations. While loop free programs can be analyzed by mechanically transforming expectations, verifying loops usually requires finding an invariant expectation, a difficult task. We propose a new view of invariant expectation synthesis as a regression problem given an input state, predict the average value of the post expectation. Guided by this perspective, we develop the first data driven invariant synthesis method for probabilistic programs. Unlike prior work on probabilistic invariant inference, our approach can learn piecewise continuous invariants without relying on template expectations, and also works when only given black box access to the program. We implement our approach and demonstrate its effectiveness on a variety of benchmarks from the probabilistic programming literature.


Frequency explicit approximability estimates for time harmonic Maxwell's equations. We consider time harmonic Maxwell's equations set in an heterogeneous medium with perfectly conducting boundary conditions. Given a divergence free right hand side lying in L 2 , we provide a frequency explicit approximability estimate measuring the difference between the corresponding solution and its best approximation by high order N 'ed 'elec finite elements. Such an approximability estimate is crucial in both the a priori and a posteriori error analysis of finite element discretizations of Maxwell's equations, but the derivation is not trivial. Indeed, it is hard to take advantage of high order polynomials given that the right hand side only exhibits L 2 regularity. We proceed in line with previously obtained results for the simpler setting of the scalar Helmholtz equation, and propose a regularity splitting of the solution. In turn, this splitting yields sharp approximability estimates generalizing known results for the scalar Helmoltz equation and showing the interest of high order methods.


Factorizations of almost simple linear groups. This is the first one in a series of papers classifying the factorizations of almost simple groups with nonsolvable factors. In this paper we deal with almost simple linear groups.


Program Specialization as a Tool for Solving Word Equations. The paper focuses on the automatic generating of the witnesses for the word equation satisfiability problem by means of specializing an interpreter which tests whether a composition of variable substitutions of a given word equation system produces its solution. We specialize such an interpreter w.r.t. the equation system, while the substitutions are unknown. We show that several variants of such interpreters, when specialized using the basic unfold fold specialization methods, are able to construct the whole solution sets for some classes of the word equations whose left and right hand sides share variables. We prove that the specialization process wrt the constructed interpreters gives a simple syntactic criterion of the satisfiability of the equations considered, and show that the suggested approach can solve some equations not solvable by Z3str3 and CVC4, the widely used SMT solvers.


Removal of 5 Terms from a Degree 21 Polynomial. In 1683 Tschirnhaus claimed to have developed an algebraic method to determine the roots of any degree n polynomial. His argument was flawed, but it spurred a great deal of work by mathematicians including Bring, Jerrard, Hamilton, Sylvester, and Hilbert. Many of the problems they considered can be framed in terms of the geometric notion of resolvent degree, introduced by Farb and Wolfson. Roughly speaking, we have RD(n) leq n k if a general degree n polynomial can be put into an (n k) parameter form. In the present note we discuss a method introduced by Sylvester for solving systems of polynomial equations, and apply it to finding bounds on resolvent degree. In particular, we prove the bound RD(21) leq 15 . This bound has been independently established by Sutherland using the classical theory of polarity.


An inequality on polarized endomorphisms. We show that assuming the standard conjectures, for any smooth projective variety X of dimension n over an algebraically closed field, there is a constant C 0 such that for any positive rational number r and for any polarized endomorphism f of X , we have G r circ f le C , mathrm deg (G r circ f), where G r is a correspondence of X so that for each 0 le i le 2n its pullback action on the i th Weil cohomology group is the multiplication by r i map. This inequality has been conjectured by the authors to hold in a more general setting, which in the special case of polarized endomorphisms confirms the validity of the analog of a well known result by Serre in the K "ahler setting.


The Grassl R "otteler cyclic and consta cyclic MDS codes are generalised Reed Solomon codes. We prove that the cyclic and constacyclic codes constructed by Grassl and R "otteler in arXiv 1502.05267 are generalised Reed Solomon codes. This note can be considered as an addendum to that article. It can also be considered as an appendix to arXiv 2106.10180, where Conjecture 11 of arXiv 1502.0526, which was stated for Grassl R "otteler codes, is proven for generalised Reed Solomon codes. The content of this note, together with arXiv 2106.10180, therefore implies that Conjecture 11 from arXiv 1502.0526 is true.


Independence Properties of Generalized Submodular Information Measures. Recently a class of generalized information measures was defined on sets of items parametrized by submodular functions. In this paper, we propose and study various notions of independence between sets with respect to such information measures, and connections thereof. Since entropy can also be used to parametrize such measures, we derive interesting independence properties for the entropy of sets of random variables. We also study the notion of multi set independence and its properties. Finally, we present optimization algorithms for obtaining a set that is independent of another given set, and also discuss the implications and applications of combinatorial independence.


Factorisations of some partially ordered sets and small categories. Orbits of automorphism groups of partially ordered sets are not necessarily congruence classes, i.e. images of an order homomorphism. Based on so called orbit categories a framework of factorisations and unfoldings is developed that preserves the antisymmetry of the order Relation. Finally some suggestions are given, how the orbit categories can be represented by simple directed and annotated graphs and annotated binary relations. These relations are reflexive, and, in many cases, they can be chosen to be antisymmetric. From these constructions arise different suggestions for fundamental systems of partially ordered sets and reconstruction data which are illustrated by examples from mathematical music theory.


Searching for Designs in between. The use of evolutionary methods in design and art is increasing in diversity and popularity. Approaches to using these methods for creative production typically focus either on optimisation or exploration. In this paper we introduce an evolutionary system for design that combines these two approaches, enabling users to explore landscapes of design alternatives using design oriented measures of fitness, along with their own aesthetic preferences. We test our methods using a biologically inspired generative system capable of producing 3D objects that can be exported directly as 3D printing toolpath instructions. For the search stage of our system we combine the use of the CMA ES algorithm for optimisation and linear interpolation between generated objects for feature exploration. We investigate the system s capabilities by evolving highly fit artefacts and then combining them with aesthetically interesting ones.


Reconfiguration of Regular Induced Subgraphs. We study the problem of checking the existence of a step by step transformation of d regular induced subgraphs in a graph, where d ge 0 and each step in the transformation must follow a fixed reconfiguration rule. Our problem for d 0 is equivalent to textsc Independent Set Reconfiguration , which is one of the most well studied reconfiguration problems. In this paper, we systematically investigate the complexity of the problem, in particular, on chordal graphs and bipartite graphs. Our results give interesting contrasts to known ones for textsc Independent Set Reconfiguration .


HiT Hierarchical Transformer with Momentum Contrast for Video Text Retrieval. Video Text Retrieval has been a hot research topic with the growth of multimedia data on the internet. Transformer for video text learning has attracted increasing attention due to its promising performance. However, existing cross modal transformer approaches typically suffer from two major limitations 1) Exploitation of the transformer architecture where different layers have different feature characteristics is limited 2) End to end training mechanism limits negative sample interactions in a mini batch. In this paper, we propose a novel approach named Hierarchical Transformer (HiT) for video text retrieval. HiT performs Hierarchical Cross modal Contrastive Matching in both feature level and semantic level, achieving multi view and comprehensive retrieval results. Moreover, inspired by MoCo, we propose Momentum Cross modal Contrast for cross modal learning to enable large scale negative sample interactions on the fly, which contributes to the generation of more precise and discriminative representations. Experimental results on the three major Video Text Retrieval benchmark datasets demonstrate the advantages of our method.


Noncatastrophic convolutional codes over a finite ring. Noncatastrophic encoders are an important class of polynomial generator matrices of convolutional codes. When these polynomials have coefficients in a finite field, these encoders have been characterized are being polynomial left prime matrices. In this paper we study the notion of noncatastrophicity in the context of convolutional codes when the polynomial matrices have entries in a finite ring. In particular, we need to introduce two different notion of primeness in order to fully characterize noncatastrophic encoders over the finite ring Z p r . The second part of the paper is devoted to investigate the notion of free and column distance in this context when the convolutional code is a free finitely generated Z p r module. We introduce the notion of b degree and provide new bounds on the free distances and column distance. We show that this class of convolutional codes is optimal with respect to the column distance and to the free distance if and only if its projection on Z p is.


On the relationship between predictive coding and backpropagation. Artificial neural networks are often interpreted as abstract models of biological neuronal networks, but they are typically trained using the biologically unrealistic backpropagation algorithm and its variants. Predictive coding has been proposed as a potentially more biologically realistic alternative to backpropagation for training neural networks. This manuscript reviews and extends recent work on the mathematical relationship between predictive coding and backpropagation for training feedforward artificial neural networks on supervised learning tasks. Implications of these results for the interpretation of predictive coding and deep neural networks as models of biological learning are discussed along with a repository of functions, Torch2PC, for performing predictive coding with PyTorch neural network models.


Community Detection in Interval Weighted Networks. In this paper we introduce and develop the concept of Interval Weighted Networks (IWN), a novel approach in Social Network Analysis, where the edge weights are represented by closed intervals composed with precise information, comprehending intrinsic variability. We extend IWN for both Newman's modularity and modularity gain and the Louvain algorithm (LA), considering a tabular representation of networks by contingency tables. We apply our methodology in a real world commuter network in mainland Portugal between the twenty three NUTS 3 regions. The optimal partition of regions is developed and compared using two new different approaches, designated as Classic Louvain'' (CL) and Hybrid Louvain'' (HL), which allow taking into account the variability observed in the original network, thereby minimizing the loss of information present in the raw data. Our findings suggest the division of the twenty three Portuguese regions in three main communities. However, we find different geographical partitions according to the community detection methodology used. This analysis can be useful in many real world applications, since it takes into account that the weights may vary within the ranges, rather than being constant.


LoSAC An Efficient Local Stochastic Average Control Method for Federated Optimization. Federated optimization (FedOpt), which targets at collaboratively training a learning model across a large number of distributed clients, is vital for federated learning. The primary concerns in FedOpt can be attributed to the model divergence and communication efficiency, which significantly affect the performance. In this paper, we propose a new method, i.e., LoSAC, to learn from heterogeneous distributed data more efficiently. Its key algorithmic insight is to locally update the estimate for the global full gradient after each regular local model update. Thus, LoSAC can keep clients' information refreshed in a more compact way. In particular, we have studied the convergence result for LoSAC. Besides, the bonus of LoSAC is the ability to defend the information leakage from the recent technique Deep Leakage Gradients (DLG). Finally, experiments have verified the superiority of LoSAC comparing with state of the art FedOpt algorithms. Specifically, LoSAC significantly improves communication efficiency by more than 100 on average, mitigates the model divergence problem and equips with the defense ability against DLG.


Calibrating LiDAR and Camera using Semantic Mutual information. We propose an algorithm for automatic, targetless, extrinsic calibration of a LiDAR and camera system using semantic information. We achieve this goal by maximizing mutual information (MI) of semantic information between sensors, leveraging a neural network to estimate semantic mutual information, and matrix exponential for calibration computation. Using kernel based sampling to sample data from camera measurement based on LiDAR projected points, we formulate the problem as a novel differentiable objective function which supports the use of gradient based optimization methods. We also introduce an initial calibration method using 2D MI based image registration. Finally, we demonstrate the robustness of our method and quantitatively analyze the accuracy on a synthetic dataset and also evaluate our algorithm qualitatively on KITTI360 and RELLIS 3D benchmark datasets, showing improvement over recent comparable approaches.


Saliency Diversified Deep Ensemble for Robustness to Adversaries. Deep learning models have shown incredible performance on numerous image recognition, classification, and reconstruction tasks. Although very appealing and valuable due to their predictive capabilities, one common threat remains challenging to resolve. A specifically trained attacker can introduce malicious input perturbations to fool the network, thus causing potentially harmful mispredictions. Moreover, these attacks can succeed when the adversary has full access to the target model (white box) and even when such access is limited (black box setting). The ensemble of models can protect against such attacks but might be brittle under shared vulnerabilities in its members (attack transferability). To that end, this work proposes a novel diversity promoting learning approach for the deep ensembles. The idea is to promote saliency map diversity (SMD) on ensemble members to prevent the attacker from targeting all ensemble members at once by introducing an additional term in our learning objective. During training, this helps us minimize the alignment between model saliencies to reduce shared member vulnerabilities and, thus, increase ensemble robustness to adversaries. We empirically show a reduced transferability between ensemble members and improved performance compared to the state of the art ensemble defense against medium and high strength white box attacks. In addition, we demonstrate that our approach combined with existing methods outperforms state of the art ensemble algorithms for defense under white box and black box attacks.


Characterization of positive definite, radial functions on free groups. This article studies the properties of positive definite, radial functions on free groups following the work of Haagerup and Knudby . We obtain characterizations of radial functions with respect to the ell 2 length on the free groups with infinite generators and the characterization of the positive definite, radial functions with respect to the ell p length on the free real line with infinite generators for 0 p leq 2 . We obtain the Levi Khintchine formulas for length radial conditionally negative functions as well.


Cycle Balanced Representation Learning For Counterfactual Inference. With the widespread accumulation of observational data, researchers obtain a new direction to learn counterfactual effects in many domains (e.g., health care and computational advertising) without Randomized Controlled Trials(RCTs). However, observational data suffer from inherent missing counterfactual outcomes, and distribution discrepancy between treatment and control groups due to behaviour preference. Motivated by recent advances of representation learning in the field of domain adaptation, we propose a novel framework based on Cycle Balanced REpresentation learning for counterfactual inference (CBRE), to solve above problems. Specifically, we realize a robust balanced representation for different groups using adversarial training, and meanwhile construct an information loop, such that preserve original data properties cyclically, which reduces information loss when transforming data into latent representation space.Experimental results on three real world datasets demonstrate that CBRE matches outperforms the state of the art methods, and it has a great potential to be applied to counterfactual inference.


DiPSeN Differentially Private Self normalizing Neural Networks For Adversarial Robustness in Federated Learning. The need for robust, secure and private machine learning is an important goal for realizing the full potential of the Internet of Things (IoT). Federated learning has proven to help protect against privacy violations and information leakage. However, it introduces new risk vectors which make machine learning models more difficult to defend against adversarial samples. In this study, we examine the role of differential privacy and self normalization in mitigating the risk of adversarial samples specifically in a federated learning environment. We introduce DiPSeN, a Differentially Private Self normalizing Neural Network which combines elements of differential privacy noise with self normalizing techniques. Our empirical results on three publicly available datasets show that DiPSeN successfully improves the adversarial robustness of a deep learning classifier in a federated learning environment based on several evaluation metrics.


AutoSVA Democratizing Formal Verification of RTL Module Interactions. Modern SoC design relies on the ability to separately verify IP blocks relative to their own specifications. Formal verification (FV) using SystemVerilog Assertions (SVA) is an effective method to exhaustively verify blocks at unit level. Unfortunately, FV has a steep learning curve and requires engineering effort that discourages hardware designers from using it during RTL module development. We propose AutoSVA, a framework to automatically generate FV testbenches that verify liveness and safety of control logic involved in module interactions. We demonstrate AutoSVA's effectiveness and efficiency on deadlock critical modules of widely used open source hardware projects.


Data Poisoning Attacks to Deep Learning Based Recommender Systems. Recommender systems play a crucial role in helping users to find their interested information in various web services such as Amazon, YouTube, and Google News. Various recommender systems, ranging from neighborhood based, association rule based, matrix factorization based, to deep learning based, have been developed and deployed in industry. Among them, deep learning based recommender systems become increasingly popular due to their superior performance. In this work, we conduct the first systematic study on data poisoning attacks to deep learning based recommender systems. An attacker's goal is to manipulate a recommender system such that the attacker chosen target items are recommended to many users. To achieve this goal, our attack injects fake users with carefully crafted ratings to a recommender system. Specifically, we formulate our attack as an optimization problem, such that the injected ratings would maximize the number of normal users to whom the target items are recommended. However, it is challenging to solve the optimization problem because it is a non convex integer programming problem. To address the challenge, we develop multiple techniques to approximately solve the optimization problem. Our experimental results on three real world datasets, including small and large datasets, show that our attack is effective and outperforms existing attacks. Moreover, we attempt to detect fake users via statistical analysis of the rating patterns of normal and fake users. Our results show that our attack is still effective and outperforms existing attacks even if such a detector is deployed.


An Invitation to Tropical Alexandrov Curvature. We study Alexandrov curvature in the tropical projective torus with respect to the tropical metric. Alexandrov curvature is a generalization of classical Riemannian sectional curvature to more general metric spaces it is determined by a comparison of triangles in an arbitrary metric space to corresponding triangles in Euclidean space. In the polyhedral setting of tropical geometry, triangles are a combinatorial object, which adds a combinatorial dimension to our analysis. We study the effect that the triangle types have on curvature, and what can be revealed about these types from the curvature. We find that positive, negative, zero, and undefined Alexandrov curvature can exist concurrently in tropical settings and that there is a tight connection between triangle combinatorial type and curvature. Our results are established both by proof and numerical experiments, and shed light on the intricate geometry of the tropical projective torus. This paper is dedicated to Bernd Sturmfels on the occasion of his 60th birthday.


Comparative Analysis of Cryptographic Key Management Systems. Managing cryptographic keys can be a complex task for an enterprise and particularly difficult to scale when an increasing number of users and applications need to be managed. In order to address scalability issues, typical IT infrastructures employ key management systems that are able to handle a large number of encryption keys and associate them with the authorized requests. Given their necessity, recent years have witnessed a variety of key management systems, aligned with the features, quality, price and security needs of specific organisations. While the spectrum of such solutions is welcome and demonstrates the expanding nature of the market, it also makes it time consuming for IT managers to identify the appropriate system for their respective company needs. This paper provides a list of key management tools which include a minimum set of features, such as availability of secure database for managing keys, an authentication, authorization, and access control model for restricting and managing access to keys, effective logging of actions with keys, and the presence of an API for accessing functions directly from the application code. Five systems were comprehensively compared by evaluating the attributes related to complexity of the implementation, its popularity, linked vulnerabilities and technical performance in terms of response time and network usage. These were Pinterest Knox, Hashicorp Vault, Square Keywhiz, OpenStack Barbican, and Cyberark Conjur. Out of these five, Hachicorp Vault was determined to be the most suitable system for small businesses.


Load balancing for distributed nonlocal models within asynchronous many task systems. In this work, we consider the challenges of developing a distributed solver for models based on nonlocal interactions. In nonlocal models, in contrast to the local model, such as the wave and heat partial differential equation, the material interacts with neighboring points on a larger length scale compared to the mesh discretization. In developing a fully distributed solver, the interaction over a length scale greater than mesh size introduces additional data dependencies among the compute nodes and communication bottleneck. In this work, we carefully look at these challenges in the context of nonlocal models to keep the presentation specific to the computational issues, we consider a nonlocal heat equation in a 2d setting. In particular, the distributed framework we propose pays greater attention to the bottleneck of data communication and the dynamic balancing of loads among nodes with varying compute capacity. For load balancing, we propose a novel framework that assesses the compute capacity of nodes and dynamically balances the load so that the idle time among nodes is minimal. Our framework relies heavily on HPX library, an asynchronous many task run time system. We present several results demonstrating the effectiveness of the proposed framework.


Analysis of training and seed bias in small molecules generated with a conditional graph based variational autoencoder Insights for practical AI driven molecule generation. The application of deep learning to generative molecule design has shown early promise for accelerating lead series development. However, questions remain concerning how factors like training, dataset, and seed bias impact the technology's utility to medicine and computational chemists. In this work, we analyze the impact of seed and training bias on the output of an activity conditioned graph based variational autoencoder (VAE). Leveraging a massive, labeled dataset corresponding to the dopamine D2 receptor, our graph based generative model is shown to excel in producing desired conditioned activities and favorable unconditioned physical properties in generated molecules. We implement an activity swapping method that allows for the activation, deactivation, or retention of activity of molecular seeds, and we apply independent deep learning classifiers to verify the generative results. Overall, we uncover relationships between noise, molecular seeds, and training set selection across a range of latent space sampling procedures, providing important insights for practical AI driven molecule generation.


Auto KWS 2021 Challenge Task, Datasets, and Baselines. Auto KWS 2021 challenge calls for automated machine learning (AutoML) solutions to automate the process of applying machine learning to a customized keyword spotting task. Compared with other keyword spotting tasks, Auto KWS challenge has the following three characteristics 1) The challenge focuses on the problem of customized keyword spotting, where the target device can only be awakened by an enrolled speaker with his specified keyword. The speaker can use any language and accent to define his keyword. 2) All dataset of the challenge is recorded in realistic environment. It is to simulate different user scenarios. 3) Auto KWS is a "code competition", where participants need to submit AutoML solutions, then the platform automatically runs the enrollment and prediction steps with the submitted code.This challenge aims at promoting the development of a more personalized and flexible keyword spotting system. Two baseline systems are provided to all participants as references.


Robust Kalman Filtering Under Model Uncertainty the Case of Degenerate Densities. We consider a robust state space filtering problem in the case that the transition probability density is unknown and possibly degenerate. The resulting robust filter has a Kalman like structure and solves a minimax game the nature selects the least favorable model in a prescribed ambiguity set which also contains non Gaussian probability densities, while the other player designs the optimum filter for the least favorable model. It turns out that the resulting robust filter is characterized by a Riccati like iteration evolving on the cone of the positive semidefinite matrices. Moreover, we study the convergence of such iteration in the case that the nominal model is with constant parameters on the basis of the contraction analysis in the same spirit of Bougerol. Finally, some numerical examples show that the proposed filter outperforms the standard Kalman filter.


Learning Robot Structure and Motion Embeddings using Graph Neural Networks. We propose a learning framework to find the representation of a robot's kinematic structure and motion embedding spaces using graph neural networks (GNN). Finding a compact and low dimensional embedding space for complex phenomena is a key for understanding its behaviors, which may lead to a better learning performance, as we observed in other domains of images or languages. However, although numerous robotics applications deal with various types of data, the embedding of the generated data has been relatively less studied by roboticists. To this end, our work aims to learn embeddings for two types of robotic data the robot's design structure, such as links, joints, and their relationships, and the motion data, such as kinematic joint positions. Our method exploits the tree structure of the robot to train appropriate embeddings to the given robot data. To avoid overfitting, we formulate multi task learning to find a general representation of the embedding spaces. We evaluate the proposed learning method on a robot with a simple linear structure and visualize the learned embeddings using t SNE. We also study a few design choices of the learning framework, such as network architectures and message passing schemes.


Ill posedness for the Half wave Schr "odinger equation. We study ill posedness for the half wave Schr "odinger equation introduced by Xu cite Xu . Ill posedness is obtained in the super critical or at the critical space. The proof is based on the argument established by Christ, Colliander and Tao cite CCT1 . For the critical space, we use the standing wave solution, which was proved the existence by Bahri, Ibrahim and Kikuchi cite BIK .


The more legs the merrier A new composition for symmetric (multi )lenses. Lenses are a category theoretic construct and are used in a wide variety of applications. Symmetric lenses compose to, of course, form new symmetric lenses. Symmetric lenses are usually represented as spans of asymmetric lenses. In many applications, the fact that a symmetric lens might also be represented as a cospan of asymmetric lenses is important, especially for implementation purposes. However, the composition of symmetric lenses does not preserve the property that the lenses can be represented by cospans two such symmetric lenses may (and frequently do) compose to form a symmetric lens which cannot be represented as a cospan of asymmetric lenses. Thus preserving the factorisation to show how cospans of asymmetric lenses might be used in implementations becomes important. In 2018, the first work on multilenses was begun. Multilenses can be represented as multi spans of asymmetric lenses (often called 'wide spans', these are spans with an arbitrary finite number of legs). In this paper we analyse a small but realistic example of a supply chain in which the cospan representations would be 'composed away' by ordinary symmetric lens composition, and introduce a new kind of composition which we call 'fusion' in which two ordinary symmetric lenses (spans with two legs) fuse to form a multilens with three legs preserving the cospan representations, and more generally, two symmetric multilenses, spans with say m and n legs, fuse to form a symmetric multilens with m n 1 legs, again preserving cospan representations.


The electromagnetic field outside the steadily rotating relativistic uniform system. Using the method of retarded potentials approximate formulas are obtained that describe the electromagnetic field outside the relativistic uniform system in the form of a charged sphere rotating at a constant speed. For the near, middle and far zones the corresponding expressions are found for the scalar and vector potentials, as well as for the electric and magnetic fields. Then these expressions are assessed for correspondence to the Laplace equations for potentials and fields. One of the purposes is to test the truth of the assumption that the scalar potential and the electric field depend neither on the value of the angular velocity of rotation of the sphere nor on the direction to the point where the field is measured. However, calculations show that potentials and fields increase as the observation point gets closer to the sphere's equator and to the sphere's surface, compared with the case for a stationary sphere. In this case, additions are proportional to the square of the angular velocity of rotation, the square of the sphere's radius and inversely proportional to the square of the speed of light. The largest found relative increase in potentials and fields could reach the value of 4 for the rapidly rotating neutron star PSR J1614 2230, if the star were charged. For a proton, a similar increase in fields on its surface near the equator reaches 54 .


FLOW Mapping Planning and Managing Communication in Distributed Teams. Distributed software development is more difficult than co located software development. One of the main reasons is that communication is more difficult in distributed settings. Defined processes and artifacts help, but cannot cover all information needs. Not communicating important project information, decisions and rationales can result in duplicate or extra work, delays or even project failure. Planning and managing a distributed project from an information flow perspective helps to facilitate available communication channels right from the start beyond the documents and artifacts which are defined for a given development process. In this paper we propose FLOW Mapping, a systematic approach for planning and managing information flows in distributed projects. We demonstrate the feasibility of our approach with a case study in a distributed agile class room project. FLOW Mapping is sufficient to plan communication and to measure conformance to the communication strategy. We also discuss cost and impact of our approach.


Sobolev gradients of viscosity supersolutions. We investigate which elliptic PDEs that have the property that every viscosity supersolution is W 1,q loc ( Omega) , Omega subseteq mathbb R n . The asymptotic cone of the operator's sublevel set seems to be essential. It turns out that much can be said if we know how this cone compares to the sublevel set of a certain minimal operator associated with the exponent q .


The Hodge D Conjecture fora Product of Elliptic Curves. Let X C be a general product of elliptic curves. Our goal is to establish the Hodge D conjecture for X . We accomplish this when dim X leq 5 . For dim X geq 6 , we reduce the conjecture to a matrix rank condition that is amenable to computer calculation.


How to transfer algorithmic reasoning knowledge to learn new algorithms?. Learning to execute algorithms is a fundamental problem that has been widely studied. Prior work cite veli19neural has shown that to enable systematic generalisation on graph algorithms it is critical to have access to the intermediate steps of the program algorithm. In many reasoning tasks, where algorithmic style reasoning is important, we only have access to the input and output examples. Thus, inspired by the success of pre training on similar tasks or data in Natural Language Processing (NLP) and Computer Vision, we set out to study how we can transfer algorithmic reasoning knowledge. Specifically, we investigate how we can use algorithms for which we have access to the execution trace to learn to solve similar tasks for which we do not. We investigate two major classes of graph algorithms, parallel algorithms such as breadth first search and Bellman Ford and sequential greedy algorithms such as Prim and Dijkstra. Due to the fundamental differences between algorithmic reasoning knowledge and feature extractors such as used in Computer Vision or NLP, we hypothesise that standard transfer techniques will not be sufficient to achieve systematic generalisation. To investigate this empirically we create a dataset including 9 algorithms and 3 different graph types. We validate this empirically and show how instead multi task learning can be used to achieve the transfer of algorithmic reasoning knowledge.


Mathers regions of instability for annulus diffeomorphisms. Let f be a C 1 varepsilon diffeomorphism of the closed annulus A that preserves orientation and the boundary components, and widetilde f be a lift of f to its universal covering space. Assume that A is a Birkhoff region of instability for f , and the rotation set of widetilde f is a non degenerate interval. Then there exists an open f invariant annulus A whose boundary intersects both boundary components of of A , and points z and z in A , such that the positive (resp. negative) orbit of z converges to a set contained in the upper (resp. lower) boundary component of A and the positive (resp. negative) orbit of z converges to a set contained in the lower (resp. upper) boundary component of A . This extends a celebrated result originally proved by Mather for area preserving twist diffeomorphisms.


Algebraic curves and foliations. Consider a field k of characteristic 0 , not necessarily algebraically closed, and a fixed algebraic curve f 0 defined by a tame polynomial f in k x,y with only quasi homogeneous singularities. We prove that the space of holomorphic foliations in the plane mathbb A 2 k having f 0 as a fixed invariant curve is generated as k x,y module by at most four elements, three of them are the trivial foliations fdx,fdy and df . Our proof is algorithmic and constructs the fourth foliation explicitly. Using Serre's GAGA and Quillen Suslin theorem, we show that for a suitable field extension K of k such a module over K x,y is actually generated by two elements, and therefore, such curves are free divisors in the sense of K. Saito. After performing Groebner basis for this module, we observe that in many well known examples, K k .